[2025-10-09T17:00:01.993174] [INFO ] [MAIN ] Using last completed trading day: 2025-10-09 [2025-10-09T17:00:02.217559] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-09T17:00:02.217971] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-09T17:00:02.434188] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-09T17:00:02.434833] [WARN ] [STATE ] State set to: RUNNING [2025-10-09T17:00:02.434944] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-09T17:00:02.435060] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-09T17:00:02.435238] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-09T17:00:02.435296] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-09T17:00:03.506898] [DEBUG] [SYMBOL ] Found 2425 valid NYSE symbols. [2025-10-09T17:00:03.507064] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-09T17:00:03.507267] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-09T17:00:03.507875] [INFO ] [LOCAL ] Symbols cache updated with 2373 symbols. [2025-10-09T17:00:03.507967] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-09T17:00:03.508021] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-09T17:00:03.508082] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-09T17:00:03.508116] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-09T17:00:03.508144] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-09T17:00:03.508538] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-10-09T17:00:03.508580] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-09T17:00:03.508758] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-09T17:00:03.508814] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2373 valid symbols. [2025-10-09T17:00:03.508847] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-09T17:00:03.508878] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-09T17:00:03.529954] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-09T17:00:03.551150] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-09T17:00:03.551299] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-09T17:00:03.551337] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-09T17:00:03.551367] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-09T17:00:03.551426] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-09T17:00:03.551814] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-10-09T17:00:03.551868] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-09T17:00:03.551902] [INFO ] [MAIN ] Starting incremental update for 2373 symbols. [2025-10-09T17:00:03.551930] [INFO ] [MAIN ] Running in parallel mode [2025-10-09T17:00:03.552130] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2373 symbols [2025-10-09T17:00:04.174760] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:04.266635] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:04.285401] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:04.307337] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-09T17:00:04.343719] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-09T17:00:04.370479] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-09T17:00:04.370198] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:04.371798] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-09T17:00:04.371921] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-09T17:00:04.371976] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-09T17:00:04.372206] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-09T17:00:04.372133] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-09T17:00:04.384253] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-09T17:00:04.410679] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-09T17:00:04.461210] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-09T17:00:04.477430] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-09T17:00:04.869987] [DEBUG] [LOCAL ] A: Loaded 50744 existing records from primary storage. [2025-10-09T17:00:04.937758] [DEBUG] [LOCAL ] AA: Loaded 53620 existing records from primary storage. [2025-10-09T17:00:04.990479] [INFO ] [MAIN ] A: Loaded 50744 existing records. [2025-10-09T17:00:05.010770] [INFO ] [MAIN ] AA: Loaded 53620 existing records. [2025-10-09T17:00:05.569189] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:05.600299] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:05.596586] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-09T17:00:05.699853] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-09T17:00:05.704300] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:05.727065] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-09T17:00:05.748142] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-09T17:00:05.751921] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:05.752208] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-09T17:00:05.752280] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-09T17:00:05.752496] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-09T17:00:05.752562] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-09T17:00:05.763665] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-09T17:00:05.775085] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-09T17:00:06.051868] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:00:06.187861] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-09T17:00:06.201561] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-09T17:00:06.249725] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:00:06.262362] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-09T17:00:06.303474] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-09T17:00:06.362887] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:00:06.387128] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-09T17:00:06.421627] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-09T17:00:06.438675] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-09T17:00:06.455912] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-09T17:00:06.522179] [INFO ] [MAIN ] Update Progress: 1/2373 symbols completed. AAMI took 2.8s. Estimated remaining: 1h 57m 25s. Rate: 20.2 symbols/min [2025-10-09T17:00:06.522068] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:06.566049] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-09T17:00:06.606545] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:06.649727] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-09T17:00:06.771465] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:06.767704] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-09T17:00:06.772812] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-09T17:00:06.860687] [DEBUG] [LOCAL ] AAP: Loaded 51882 existing records from primary storage. [2025-10-09T17:00:06.861380] [INFO ] [MAIN ] AAP: Loaded 51882 existing records. [2025-10-09T17:00:07.064490] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:07.064845] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-09T17:00:07.064907] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-09T17:00:07.065182] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-09T17:00:07.065243] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-09T17:00:07.143258] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-09T17:00:07.166433] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-09T17:00:07.431465] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:07.431811] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-09T17:00:07.544547] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-09T17:00:07.545503] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-09T17:00:07.902353] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-09T17:00:07.903400] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-09T17:00:08.232478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-09T17:00:08.233535] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-09T17:00:08.287215] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T17:00:08.298804] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-09T17:00:08.326460] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:00:08.336939] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-09T17:00:08.472043] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-09T17:00:08.472981] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-09T17:00:09.130596] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T17:00:09.132430] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-09T17:00:09.134286] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T17:00:09.151145] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-09T17:00:09.669310] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:00:09.680044] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-09T17:00:09.829843] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T17:00:09.831204] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-09T17:00:10.127222] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-09T17:00:10.141299] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-09T17:00:10.179758] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T17:00:10.181031] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-09T17:00:10.623369] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T17:00:10.624121] [INFO ] [REMOTE ] AAM: Full fetch complete (940 records). [2025-10-09T17:00:10.624252] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-09T17:00:10.816455] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-09T17:00:10.816741] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:00:10.816813] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:00:10.816902] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-09T17:00:10.816967] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-09T17:00:10.817004] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-09T17:00:10.817043] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-09T17:00:10.817121] [INFO ] [MAIN ] Update Progress: 2/2373 symbols completed. AAM took 7.2s. Estimated remaining: 2h 23m 33s. Rate: 16.5 symbols/min [2025-10-09T17:00:10.991881] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:11.030276] [DEBUG] [LOCAL ] AAT: Loaded 30285 existing records from primary storage. [2025-10-09T17:00:11.030560] [INFO ] [MAIN ] AAT: Loaded 30285 existing records. [2025-10-09T17:00:11.246188] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:11.249141] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-09T17:00:11.249341] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-09T17:00:11.261397] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-09T17:00:11.262200] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-09T17:00:11.262360] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-09T17:00:11.263743] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-09T17:00:11.599614] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-09T17:00:11.695854] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-09T17:00:11.705091] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:11.707151] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-09T17:00:12.043402] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T17:00:12.053633] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-09T17:00:12.640477] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T17:00:12.647243] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-09T17:00:12.989126] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:00:12.999160] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-09T17:00:13.561002] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T17:00:13.572160] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-09T17:00:13.790413] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:00:13.796060] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-09T17:00:14.554743] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T17:00:14.565808] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-09T17:00:14.880437] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-10-09T17:00:14.892404] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-09T17:00:14.910853] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:00:14.917457] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-09T17:00:15.777109] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T17:00:15.795913] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-09T17:00:16.322501] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T17:00:16.354893] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:00:16.355503] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-09T17:00:16.370210] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-09T17:00:16.514680] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T17:00:16.521221] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-09T17:00:17.418750] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T17:00:17.431286] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-09T17:00:17.836288] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T17:00:17.844340] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-09T17:00:18.367280] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T17:00:18.378674] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-09T17:00:18.813627] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T17:00:18.821104] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-09T17:00:18.915251] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-09T17:00:18.927724] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-09T17:00:19.354442] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T17:00:19.366769] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-09T17:00:19.613747] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:00:19.620245] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-09T17:00:19.887710] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:00:19.898713] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-09T17:00:20.433097] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:00:20.443892] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-09T17:00:20.818802] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T17:00:20.826711] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-09T17:00:21.298871] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T17:00:21.313374] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-09T17:00:21.470941] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:00:21.482323] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-09T17:00:21.979412] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T17:00:21.986734] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-09T17:00:22.021710] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T17:00:22.033623] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-09T17:00:22.845894] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T17:00:22.895607] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-09T17:00:22.896852] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T17:00:22.912495] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-09T17:00:22.966385] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T17:00:22.973087] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-09T17:00:23.290941] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T17:00:23.308853] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-09T17:00:23.853342] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T17:00:23.857004] [INFO ] [REMOTE ] AAT: Full fetch complete (42691 records). [2025-10-09T17:00:23.857109] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-09T17:00:24.242609] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-09T17:00:24.242720] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-09T17:00:24.243148] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-09T17:00:24.243192] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-09T17:00:24.244197] [DEBUG] [LOCAL ] AAT: Trimmed 42691 records to 30487 (keeping 200 days of data) [2025-10-09T17:00:24.452137] [DEBUG] [LOCAL ] AAT: Primary data saved (30487 records). [2025-10-09T17:00:24.452394] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-09T17:00:24.452558] [INFO ] [MAIN ] Update Progress: 3/2373 symbols completed. AAT took 13.6s. Estimated remaining: 4h 35m 11s. Rate: 8.6 symbols/min [2025-10-09T17:00:24.643041] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:24.643796] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-09T17:00:24.644072] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-09T17:00:24.644912] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-09T17:00:24.645273] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-09T17:00:24.645396] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-09T17:00:24.645613] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-09T17:00:24.781571] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T17:00:24.889313] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-09T17:00:25.035913] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T17:00:25.074600] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-09T17:00:25.085870] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-09T17:00:25.114993] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-09T17:00:25.173516] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:25.174082] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-09T17:00:25.376730] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:00:25.377043] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-09T17:00:25.377132] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:00:25.377183] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-09T17:00:25.377245] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:00:25.377337] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-09T17:00:25.377403] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-09T17:00:25.377440] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-09T17:00:25.377480] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-09T17:00:25.377528] [INFO ] [MAIN ] Update Progress: 4/2373 symbols completed. AAUC took 0.9s. Estimated remaining: 3h 35m 26s. Rate: 11.0 symbols/min [2025-10-09T17:00:25.556411] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:25.556577] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-09T17:00:25.556617] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-09T17:00:25.556753] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-09T17:00:25.556797] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-09T17:00:25.556840] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-09T17:00:25.556875] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-09T17:00:25.936777] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:25.937115] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-09T17:00:26.314895] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:00:26.320208] [INFO ] [REMOTE ] AAP: Full fetch complete (75018 records). [2025-10-09T17:00:26.320344] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-09T17:00:26.730200] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T17:00:26.759450] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-09T17:00:26.760015] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-09T17:00:26.761097] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-09T17:00:26.761500] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-09T17:00:26.763360] [INFO ] [REMOTE ] A: Full fetch complete (73108 records). [2025-10-09T17:00:26.763513] [DEBUG] [LOCAL ] AAP: Trimmed 75018 records to 52268 (keeping 200 days of data) [2025-10-09T17:00:26.763817] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-09T17:00:26.975062] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-09T17:00:26.998347] [INFO ] [REMOTE ] AA: Full fetch complete (77542 records). [2025-10-09T17:00:27.029175] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-09T17:00:27.501476] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-09T17:00:27.517885] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-09T17:00:27.524290] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-09T17:00:27.550951] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-09T17:00:27.572842] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:00:27.626486] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-09T17:00:27.640116] [DEBUG] [LOCAL ] A: Trimmed 73108 records to 51104 (keeping 200 days of data) [2025-10-09T17:00:27.875124] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-09T17:00:27.875277] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-09T17:00:27.877136] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-09T17:00:27.878015] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-09T17:00:27.886468] [DEBUG] [LOCAL ] AA: Trimmed 77542 records to 54010 (keeping 200 days of data) [2025-10-09T17:00:28.485891] [DEBUG] [LOCAL ] AAP: Primary data saved (52268 records). [2025-10-09T17:00:28.488288] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-09T17:00:28.491087] [INFO ] [MAIN ] Update Progress: 5/2373 symbols completed. AAP took 22.0s. Estimated remaining: 3h 16m 51s. Rate: 12.0 symbols/min [2025-10-09T17:00:28.738632] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:28.851939] [DEBUG] [LOCAL ] A: Primary data saved (51104 records). [2025-10-09T17:00:28.854009] [INFO ] [MAIN ] A: Full history saved. [2025-10-09T17:00:28.855332] [INFO ] [MAIN ] Update Progress: 6/2373 symbols completed. A took 25.3s. Estimated remaining: 2h 46m 22s. Rate: 14.2 symbols/min [2025-10-09T17:00:28.972432] [DEBUG] [LOCAL ] ABBV: Loaded 53686 existing records from primary storage. [2025-10-09T17:00:29.000508] [INFO ] [MAIN ] ABBV: Loaded 53686 existing records. [2025-10-09T17:00:29.117412] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:29.119378] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-09T17:00:29.135499] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-09T17:00:29.124876] [DEBUG] [LOCAL ] AA: Primary data saved (54010 records). [2025-10-09T17:00:29.158019] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-09T17:00:29.158359] [INFO ] [MAIN ] AA: Full history saved. [2025-10-09T17:00:29.164217] [INFO ] [MAIN ] Update Progress: 7/2373 symbols completed. AA took 25.6s. Estimated remaining: 2h 24m 17s. Rate: 16.4 symbols/min [2025-10-09T17:00:29.163614] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-09T17:00:29.242175] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-09T17:00:29.250145] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-09T17:00:29.360666] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T17:00:29.500952] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-09T17:00:29.543294] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:29.567819] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-09T17:00:29.578233] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-09T17:00:29.658094] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-09T17:00:29.672416] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-09T17:00:29.675867] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:30.146458] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:30.163229] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-09T17:00:30.279387] [DEBUG] [LOCAL ] ABEV: Loaded 53281 existing records from primary storage. [2025-10-09T17:00:30.301964] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:30.302289] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-09T17:00:30.303259] [INFO ] [MAIN ] ABEV: Loaded 53281 existing records. [2025-10-09T17:00:30.494493] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:30.494753] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-09T17:00:30.494807] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-09T17:00:30.495914] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-09T17:00:30.495989] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-09T17:00:30.876817] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:30.877228] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-09T17:00:31.101964] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T17:00:31.111408] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-09T17:00:31.177360] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:00:31.183277] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-09T17:00:32.311972] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:00:32.319419] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-09T17:00:32.406871] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T17:00:32.418525] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-09T17:00:32.570138] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T17:00:32.598727] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-09T17:00:32.599144] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-09T17:00:32.610102] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-09T17:00:33.617408] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T17:00:33.624065] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-09T17:00:33.728344] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T17:00:33.736721] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-09T17:00:33.817522] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:00:33.828214] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-09T17:00:34.092964] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T17:00:34.103785] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-09T17:00:34.896734] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:00:34.903003] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-09T17:00:34.955453] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:00:34.962813] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-09T17:00:35.567367] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T17:00:35.578289] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-09T17:00:35.591162] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T17:00:35.595912] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-09T17:00:35.765670] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T17:00:35.775873] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-09T17:00:35.938772] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T17:00:35.946761] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-09T17:00:36.560231] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T17:00:36.565890] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-09T17:00:37.007840] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T17:00:37.014177] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-09T17:00:37.109185] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:00:37.120572] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-09T17:00:37.636933] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T17:00:37.642150] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-09T17:00:37.883682] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-09T17:00:37.895016] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-09T17:00:38.121968] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T17:00:38.127860] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-09T17:00:38.659120] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:00:38.686313] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-09T17:00:38.689021] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:00:38.696149] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-09T17:00:39.032070] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T17:00:39.041950] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-09T17:00:39.568082] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T17:00:39.570482] [INFO ] [REMOTE ] AB: Full fetch complete (44957 records). [2025-10-09T17:00:39.570582] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-09T17:00:39.989843] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-09T17:00:39.990157] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-09T17:00:39.990881] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-09T17:00:39.991040] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-09T17:00:39.992536] [DEBUG] [LOCAL ] AB: Trimmed 44957 records to 26515 (keeping 200 days of data) [2025-10-09T17:00:40.142596] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T17:00:40.171913] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-09T17:00:40.227516] [DEBUG] [LOCAL ] AB: Primary data saved (26515 records). [2025-10-09T17:00:40.228735] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:00:40.228836] [INFO ] [MAIN ] AB: Full history saved. [2025-10-09T17:00:40.235028] [INFO ] [MAIN ] Update Progress: 8/2373 symbols completed. AB took 14.9s. Estimated remaining: 3h 0m 44s. Rate: 13.1 symbols/min [2025-10-09T17:00:40.256574] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-09T17:00:40.405403] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:40.424774] [DEBUG] [LOCAL ] ABG: Loaded 18494 existing records from primary storage. [2025-10-09T17:00:40.425074] [INFO ] [MAIN ] ABG: Loaded 18494 existing records. [2025-10-09T17:00:40.603520] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:40.603914] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-09T17:00:40.603987] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-09T17:00:40.614908] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-09T17:00:40.631768] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-09T17:00:40.696174] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T17:00:40.750796] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-09T17:00:41.001217] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:41.001556] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-09T17:00:41.345860] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:00:41.356828] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-09T17:00:41.954348] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T17:00:41.958009] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-09T17:00:42.466255] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T17:00:42.477968] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-09T17:00:42.488087] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T17:00:42.491630] [INFO ] [REMOTE ] ABCB: Full fetch complete (44633 records). [2025-10-09T17:00:42.491782] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-09T17:00:42.852403] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T17:00:42.899475] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-09T17:00:42.944725] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-09T17:00:42.945918] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-09T17:00:42.956678] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-09T17:00:42.957616] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-09T17:00:42.957823] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-09T17:00:42.958309] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-09T17:00:42.960239] [DEBUG] [LOCAL ] ABCB: Trimmed 44633 records to 30682 (keeping 200 days of data) [2025-10-09T17:00:43.151949] [DEBUG] [LOCAL ] ABCB: Primary data saved (30682 records). [2025-10-09T17:00:43.152092] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-09T17:00:43.152173] [INFO ] [MAIN ] Update Progress: 9/2373 symbols completed. ABCB took 14.3s. Estimated remaining: 2h 53m 22s. Rate: 13.6 symbols/min [2025-10-09T17:00:43.329394] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:43.362894] [DEBUG] [LOCAL ] ABM: Loaded 31947 existing records from primary storage. [2025-10-09T17:00:43.363173] [INFO ] [MAIN ] ABM: Loaded 31947 existing records. [2025-10-09T17:00:43.536580] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:43.536834] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-09T17:00:43.536889] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-09T17:00:43.537130] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-09T17:00:43.537187] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-09T17:00:43.897219] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:43.907720] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T17:00:43.906891] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-09T17:00:43.912634] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-09T17:00:44.072990] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T17:00:44.086368] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-09T17:00:44.815848] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T17:00:44.829135] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-09T17:00:44.852426] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T17:00:44.857776] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-09T17:00:44.883315] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T17:00:44.891040] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-09T17:00:45.817292] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T17:00:45.823534] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-09T17:00:46.057710] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T17:00:46.069609] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-09T17:00:46.112808] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T17:00:46.119015] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-09T17:00:47.012960] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T17:00:47.053028] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T17:00:47.053919] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T17:00:47.051753] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-09T17:00:47.065154] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-09T17:00:47.065721] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-09T17:00:47.851938] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T17:00:47.865215] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-09T17:00:47.876914] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T17:00:47.881099] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-09T17:00:48.053560] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T17:00:48.060888] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-09T17:00:48.541684] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T17:00:48.546541] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-09T17:00:49.155056] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-09T17:00:49.166807] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-09T17:00:49.461151] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T17:00:49.468967] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-09T17:00:49.527761] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T17:00:49.533484] [INFO ] [REMOTE ] ABEV: Full fetch complete (77216 records). [2025-10-09T17:00:49.533687] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-09T17:00:49.671774] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T17:00:49.716374] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-09T17:00:49.971074] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-09T17:00:49.971155] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-09T17:00:49.971929] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-09T17:00:49.971997] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-09T17:00:49.973517] [DEBUG] [LOCAL ] ABEV: Trimmed 77216 records to 53667 (keeping 200 days of data) [2025-10-09T17:00:50.296873] [DEBUG] [LOCAL ] ABEV: Primary data saved (53667 records). [2025-10-09T17:00:50.297121] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-09T17:00:50.297306] [INFO ] [MAIN ] Update Progress: 10/2373 symbols completed. ABEV took 21.1s. Estimated remaining: 3h 4m 6s. Rate: 12.8 symbols/min [2025-10-09T17:00:50.468662] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:50.519310] [DEBUG] [LOCAL ] ABR: Loaded 51958 existing records from primary storage. [2025-10-09T17:00:50.519677] [INFO ] [MAIN ] ABR: Loaded 51958 existing records. [2025-10-09T17:00:50.685926] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T17:00:50.723243] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:50.735264] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-09T17:00:50.735763] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-09T17:00:50.737789] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T17:00:50.738086] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-09T17:00:50.736548] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-09T17:00:50.738370] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-09T17:00:50.778492] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-09T17:00:51.060470] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T17:00:51.100705] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-09T17:00:51.154136] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:51.154418] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-09T17:00:51.825285] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:00:51.834138] [INFO ] [REMOTE ] ABBV: Full fetch complete (77330 records). [2025-10-09T17:00:51.835177] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-09T17:00:51.835059] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:00:51.838246] [INFO ] [REMOTE ] ABG: Full fetch complete (26576 records). [2025-10-09T17:00:51.838114] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:00:51.838427] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-09T17:00:51.838587] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:00:51.838800] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:00:51.839067] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-09T17:00:51.839149] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-09T17:00:51.900281] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-09T17:00:51.956713] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-10-09T17:00:51.978821] [INFO ] [MAIN ] Update Progress: 11/2373 symbols completed. ABBV took 23.5s. Estimated remaining: 2h 53m 19s. Rate: 13.6 symbols/min [2025-10-09T17:00:52.572175] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:52.574039] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-09T17:00:52.574283] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-09T17:00:52.575335] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-09T17:00:52.575466] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-09T17:00:52.594835] [DEBUG] [LOCAL ] ABG: Trimmed 26576 records to 18588 (keeping 200 days of data) [2025-10-09T17:00:52.612500] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T17:00:52.687822] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-09T17:00:52.817844] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-09T17:00:52.820009] [INFO ] [MAIN ] ABT: Loaded 53623 existing records. [2025-10-09T17:00:52.949551] [DEBUG] [LOCAL ] ABG: Primary data saved (18588 records). [2025-10-09T17:00:52.984315] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-09T17:00:52.992907] [INFO ] [MAIN ] Update Progress: 12/2373 symbols completed. ABG took 12.8s. Estimated remaining: 2h 42m 7s. Rate: 14.6 symbols/min [2025-10-09T17:00:53.185998] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:53.229783] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-09T17:00:53.244754] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T17:00:53.242787] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-09T17:00:53.291863] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-09T17:00:53.292931] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-09T17:00:53.299124] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-09T17:00:53.481855] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:53.484277] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-09T17:00:53.484331] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-09T17:00:53.484473] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-09T17:00:53.484776] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-09T17:00:53.484868] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-09T17:00:53.495387] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-09T17:00:54.030578] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:54.051811] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-09T17:00:54.142296] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:54.158339] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-09T17:00:54.162336] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:00:54.169980] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-09T17:00:55.243385] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T17:00:55.254462] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-09T17:00:55.346027] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T17:00:55.354283] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-09T17:00:55.734715] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T17:00:55.742089] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-09T17:00:55.857252] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T17:00:55.868109] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-09T17:00:56.521959] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T17:00:56.528698] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-09T17:00:56.713550] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T17:00:56.723384] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-09T17:00:57.221183] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T17:00:57.229388] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-09T17:00:57.249087] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T17:00:57.254192] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-09T17:00:57.547053] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:00:57.561454] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-09T17:00:58.178412] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:00:58.181806] [INFO ] [REMOTE ] ABM: Full fetch complete (44830 records). [2025-10-09T17:00:58.181948] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-09T17:00:58.710770] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T17:00:58.712530] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-09T17:00:58.713307] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-09T17:00:58.723586] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-09T17:00:58.730333] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-09T17:00:58.731225] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-09T17:00:58.731517] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-09T17:00:58.731811] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-09T17:00:58.734452] [DEBUG] [LOCAL ] ABM: Trimmed 44830 records to 32168 (keeping 200 days of data) [2025-10-09T17:00:58.951908] [DEBUG] [LOCAL ] ABM: Primary data saved (32168 records). [2025-10-09T17:00:58.952053] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-09T17:00:58.952145] [INFO ] [MAIN ] Update Progress: 13/2373 symbols completed. ABM took 15.8s. Estimated remaining: 2h 47m 37s. Rate: 14.1 symbols/min [2025-10-09T17:00:59.166202] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:59.213123] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T17:00:59.224450] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-09T17:00:59.238541] [DEBUG] [LOCAL ] ACCO: Loaded 37076 existing records from primary storage. [2025-10-09T17:00:59.238905] [INFO ] [MAIN ] ACCO: Loaded 37076 existing records. [2025-10-09T17:00:59.424828] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:59.425084] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-09T17:00:59.425143] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-09T17:00:59.425436] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-09T17:00:59.425495] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-09T17:00:59.794191] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:59.794598] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-09T17:00:59.913671] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T17:00:59.920229] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-09T17:01:00.793846] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T17:01:00.805096] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-09T17:01:00.923774] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:01:00.931953] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-09T17:01:01.105043] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T17:01:01.111040] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-09T17:01:01.291415] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-09T17:01:01.302575] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-09T17:01:01.938885] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T17:01:01.944342] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-09T17:01:02.223600] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T17:01:02.233927] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-09T17:01:02.377523] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T17:01:02.396708] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-09T17:01:02.972797] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T17:01:03.014510] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T17:01:03.170949] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:01:03.196679] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-09T17:01:03.996723] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-09T17:01:04.129142] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:01:04.319120] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:01:04.796727] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-09T17:01:05.596756] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-09T17:01:05.941392] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T17:01:06.396693] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-09T17:01:06.560913] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:01:07.024076] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:01:07.196742] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-09T17:01:07.441514] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T17:01:07.996751] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-09T17:01:08.796749] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-09T17:01:08.881606] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:01:09.382075] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:01:09.596739] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-09T17:01:10.396802] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-09T17:01:10.583517] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T17:01:10.922027] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:01:11.196737] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-09T17:01:11.534901] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T17:01:11.996729] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-09T17:01:12.796692] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-09T17:01:12.926372] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T17:01:13.596754] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-09T17:01:13.838759] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T17:01:14.239600] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:01:14.396697] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-09T17:01:14.671338] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T17:01:14.673684] [INFO ] [REMOTE ] ACA: Full fetch complete (34186 records). [2025-10-09T17:01:14.673801] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-09T17:01:15.061109] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-09T17:01:15.061216] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-09T17:01:15.062672] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-09T17:01:15.062757] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-09T17:01:15.063821] [DEBUG] [LOCAL ] ACA: Trimmed 34186 records to 23314 (keeping 200 days of data) [2025-10-09T17:01:15.199150] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-09T17:01:15.213392] [DEBUG] [LOCAL ] ACA: Primary data saved (23314 records). [2025-10-09T17:01:15.213504] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-09T17:01:15.213607] [INFO ] [MAIN ] Update Progress: 14/2373 symbols completed. ACA took 22.2s. Estimated remaining: 3h 21m 15s. Rate: 11.7 symbols/min [2025-10-09T17:01:15.384353] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:15.384552] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-09T17:01:15.384591] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-09T17:01:15.384735] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-09T17:01:15.384782] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-09T17:01:15.384825] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-09T17:01:15.384860] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-09T17:01:15.758340] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:15.996707] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-09T17:01:16.334828] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T17:01:16.339723] [INFO ] [REMOTE ] ABR: Full fetch complete (75243 records). [2025-10-09T17:01:16.339874] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-09T17:01:16.512739] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T17:01:16.799161] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-09T17:01:16.798953] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-09T17:01:16.800062] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-09T17:01:16.801002] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-09T17:01:16.801172] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-09T17:01:16.802688] [DEBUG] [LOCAL ] ABR: Trimmed 75243 records to 52338 (keeping 200 days of data) [2025-10-09T17:01:17.131170] [DEBUG] [LOCAL ] ABR: Primary data saved (52338 records). [2025-10-09T17:01:17.131329] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-09T17:01:17.131494] [INFO ] [MAIN ] Update Progress: 15/2373 symbols completed. ABR took 26.8s. Estimated remaining: 3h 12m 47s. Rate: 12.2 symbols/min [2025-10-09T17:01:17.299227] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:17.348518] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-09T17:01:17.348873] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-09T17:01:17.527944] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:01:17.528212] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-09T17:01:17.528376] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-09T17:01:17.528722] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-09T17:01:17.528883] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-09T17:01:17.596690] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-09T17:01:17.919797] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T17:01:17.923494] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:17.950673] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T17:01:18.396769] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-09T17:01:18.778203] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T17:01:19.196830] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-09T17:01:19.996745] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-09T17:01:20.283457] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T17:01:20.706228] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T17:01:20.710765] [INFO ] [REMOTE ] ABT: Full fetch complete (77595 records). [2025-10-09T17:01:20.710878] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-09T17:01:20.806985] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-09T17:01:21.145235] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-09T17:01:21.160320] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-09T17:01:21.160422] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-09T17:01:21.161341] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-09T17:01:21.161418] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-09T17:01:21.163191] [DEBUG] [LOCAL ] ABT: Trimmed 77595 records to 54012 (keeping 200 days of data) [2025-10-09T17:01:21.500490] [DEBUG] [LOCAL ] ABT: Primary data saved (54012 records). [2025-10-09T17:01:21.500635] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-09T17:01:21.500766] [INFO ] [MAIN ] Update Progress: 16/2373 symbols completed. ABT took 29.5s. Estimated remaining: 3h 11m 23s. Rate: 12.3 symbols/min [2025-10-09T17:01:21.601959] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-09T17:01:21.677313] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:21.677508] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-09T17:01:21.677564] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-09T17:01:21.677698] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-09T17:01:21.677755] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-09T17:01:21.677852] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-09T17:01:21.677949] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-09T17:01:22.041872] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:22.113241] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:01:22.396752] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-09T17:01:22.965494] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:01:23.196781] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-09T17:01:23.996725] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-09T17:01:24.148719] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:01:24.796729] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-09T17:01:25.252029] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T17:01:25.256581] [INFO ] [REMOTE ] ACCO: Full fetch complete (53713 records). [2025-10-09T17:01:25.256757] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-09T17:01:25.257517] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:01:25.257613] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:01:25.257694] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:01:25.257750] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-09T17:01:25.257830] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-09T17:01:25.257882] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-09T17:01:25.258142] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-10-09T17:01:25.258270] [INFO ] [MAIN ] Update Progress: 17/2373 symbols completed. ACCO took 26.3s. Estimated remaining: 3h 8m 44s. Rate: 12.5 symbols/min [2025-10-09T17:01:25.441953] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:25.442166] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-10-09T17:01:25.442221] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-10-09T17:01:25.442333] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-09T17:01:25.442375] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-09T17:01:25.442417] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-09T17:01:25.442451] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-09T17:01:25.618533] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-09T17:01:25.806176] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:25.836891] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-09T17:01:26.020254] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T17:01:26.396732] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-09T17:01:27.196724] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-09T17:01:27.454228] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T17:01:27.765975] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T17:01:27.996720] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-09T17:01:28.796738] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-09T17:01:29.163808] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T17:01:29.463414] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-09T17:01:29.596670] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-09T17:01:30.097680] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T17:01:30.396800] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-09T17:01:31.196701] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-09T17:01:31.266928] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T17:01:31.996767] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-09T17:01:32.327380] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-09T17:01:32.774293] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:01:32.796672] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-09T17:01:33.466280] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:01:33.596676] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-09T17:01:34.402952] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-09T17:01:34.421373] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T17:01:34.643327] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T17:01:35.196736] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-09T17:01:35.996781] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-09T17:01:36.306285] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:01:36.796707] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-09T17:01:36.911812] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-09T17:01:37.116068] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:01:37.596790] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-09T17:01:38.091539] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T17:01:38.396779] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-09T17:01:39.196777] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-09T17:01:39.996708] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-09T17:01:40.044887] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T17:01:40.091878] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-09T17:01:40.796766] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-09T17:01:40.921883] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T17:01:40.963143] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T17:01:41.596740] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-09T17:01:42.396745] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-09T17:01:43.196689] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-09T17:01:43.452665] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T17:01:43.510455] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-09T17:01:43.746829] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T17:01:43.996683] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-09T17:01:44.290096] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T17:01:44.292537] [INFO ] [REMOTE ] ACEL: Full fetch complete (38724 records). [2025-10-09T17:01:44.292609] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-09T17:01:44.672879] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-09T17:01:44.672984] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-09T17:01:44.673456] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-09T17:01:44.673500] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-09T17:01:44.674548] [DEBUG] [LOCAL ] ACEL: Trimmed 38724 records to 26864 (keeping 200 days of data) [2025-10-09T17:01:44.796890] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-09T17:01:44.872070] [DEBUG] [LOCAL ] ACEL: Primary data saved (26864 records). [2025-10-09T17:01:44.872231] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-09T17:01:44.872344] [INFO ] [MAIN ] Update Progress: 18/2373 symbols completed. ACEL took 29.7s. Estimated remaining: 3h 40m 56s. Rate: 10.7 symbols/min [2025-10-09T17:01:45.129116] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:45.216560] [DEBUG] [LOCAL ] ACN: Loaded 53428 existing records from primary storage. [2025-10-09T17:01:45.217457] [INFO ] [MAIN ] ACN: Loaded 53428 existing records. [2025-10-09T17:01:45.547731] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:01:45.548110] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-09T17:01:45.548202] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-09T17:01:45.548829] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-09T17:01:45.548894] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-09T17:01:45.599796] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-09T17:01:45.986124] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:46.015944] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T17:01:46.396772] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-09T17:01:46.520748] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T17:01:47.196761] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-09T17:01:47.786494] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T17:01:47.996754] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-09T17:01:48.225704] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T17:01:48.765168] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:01:48.796678] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-09T17:01:49.008154] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:01:49.596712] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-09T17:01:50.396686] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-09T17:01:50.582253] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T17:01:51.196794] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-09T17:01:51.634079] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T17:01:51.764896] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T17:01:51.996694] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-09T17:01:52.807317] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-09T17:01:52.809735] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T17:01:53.596682] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-09T17:01:53.710686] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T17:01:54.117300] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:01:54.396710] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-09T17:01:55.056738] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T17:01:55.060425] [INFO ] [REMOTE ] ACM: Full fetch complete (62749 records). [2025-10-09T17:01:55.060530] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-09T17:01:55.201825] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-09T17:01:55.457583] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-09T17:01:55.457712] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-09T17:01:55.458391] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-09T17:01:55.458457] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-09T17:01:55.459827] [DEBUG] [LOCAL ] ACM: Trimmed 62749 records to 43290 (keeping 200 days of data) [2025-10-09T17:01:55.730544] [DEBUG] [LOCAL ] ACM: Primary data saved (43290 records). [2025-10-09T17:01:55.730709] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-09T17:01:55.730795] [INFO ] [MAIN ] Update Progress: 19/2373 symbols completed. ACM took 30.5s. Estimated remaining: 3h 51m 38s. Rate: 10.2 symbols/min [2025-10-09T17:01:55.913765] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:55.946521] [DEBUG] [LOCAL ] ACP: Loaded 31022 existing records from primary storage. [2025-10-09T17:01:55.947085] [INFO ] [MAIN ] ACP: Loaded 31022 existing records. [2025-10-09T17:01:56.005675] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-09T17:01:56.146605] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:01:56.146886] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-09T17:01:56.146939] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-09T17:01:56.147376] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-09T17:01:56.147436] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-09T17:01:56.531925] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:56.578257] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-09T17:01:56.796745] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-09T17:01:57.020356] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T17:01:57.596720] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-09T17:01:58.223635] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:01:58.311730] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-09T17:01:58.396708] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-09T17:01:59.196686] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-09T17:01:59.275390] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:01:59.281436] [INFO ] [REMOTE ] ACI: Full fetch complete (77042 records). [2025-10-09T17:01:59.281731] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-09T17:01:59.695194] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-09T17:01:59.695359] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-09T17:01:59.696223] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-09T17:01:59.696320] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-09T17:01:59.698124] [DEBUG] [LOCAL ] ACI: Trimmed 77042 records to 53644 (keeping 200 days of data) [2025-10-09T17:01:59.929335] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T17:02:00.005924] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-09T17:02:00.052811] [DEBUG] [LOCAL ] ACI: Primary data saved (53644 records). [2025-10-09T17:02:00.052957] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-09T17:02:00.053032] [INFO ] [MAIN ] Update Progress: 20/2373 symbols completed. ACI took 38.6s. Estimated remaining: 3h 48m 26s. Rate: 10.3 symbols/min [2025-10-09T17:02:00.222159] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:00.228949] [DEBUG] [LOCAL ] ACR: Loaded 5619 existing records from primary storage. [2025-10-09T17:02:00.229101] [INFO ] [MAIN ] ACR: Loaded 5619 existing records. [2025-10-09T17:02:00.410946] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:00.411186] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-09T17:02:00.411235] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-09T17:02:00.411423] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-09T17:02:00.411481] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-09T17:02:00.770159] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:00.796702] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-09T17:02:01.159208] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T17:02:01.482159] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T17:02:01.556942] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-09T17:02:01.562090] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-09T17:02:01.562238] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-09T17:02:01.601858] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-09T17:02:02.043372] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-09T17:02:02.043483] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-09T17:02:02.044359] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-09T17:02:02.044429] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-09T17:02:02.046079] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-10-09T17:02:02.381087] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-10-09T17:02:02.381233] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-09T17:02:02.381316] [INFO ] [MAIN ] Update Progress: 21/2373 symbols completed. ACHR took 45.2s. Estimated remaining: 3h 41m 49s. Rate: 10.6 symbols/min [2025-10-09T17:02:02.401836] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-09T17:02:02.551955] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:02.586351] [DEBUG] [LOCAL ] ACRE: Loaded 33676 existing records from primary storage. [2025-10-09T17:02:02.586670] [INFO ] [MAIN ] ACRE: Loaded 33676 existing records. [2025-10-09T17:02:02.759427] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:02.759692] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-09T17:02:02.759749] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-09T17:02:02.759976] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-09T17:02:02.760032] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-09T17:02:03.105535] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:03.196672] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-09T17:02:03.805743] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T17:02:03.851049] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T17:02:03.996694] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-09T17:02:04.384820] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T17:02:04.796730] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-09T17:02:05.120068] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T17:02:05.170201] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-09T17:02:05.596781] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-09T17:02:06.396686] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-09T17:02:06.846491] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T17:02:07.196731] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-09T17:02:07.826850] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T17:02:07.992464] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T17:02:08.001110] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-09T17:02:08.760144] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T17:02:08.796722] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-09T17:02:09.356126] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T17:02:09.596731] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-09T17:02:10.346687] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:02:10.396691] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-09T17:02:11.196731] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-09T17:02:11.738305] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T17:02:11.996678] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-09T17:02:12.796699] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-09T17:02:12.867178] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T17:02:13.039985] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T17:02:13.596764] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-09T17:02:13.968675] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-09T17:02:14.176067] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T17:02:14.396765] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-09T17:02:15.196791] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-09T17:02:15.850102] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T17:02:15.996722] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-09T17:02:16.796774] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-09T17:02:17.165358] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:02:17.389459] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-09T17:02:17.532673] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T17:02:17.596674] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-09T17:02:18.396738] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-09T17:02:18.719780] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T17:02:19.196723] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-09T17:02:19.996837] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-09T17:02:20.490784] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T17:02:20.740193] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:02:20.796679] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-09T17:02:21.120162] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T17:02:21.123438] [INFO ] [REMOTE ] ACP: Full fetch complete (46494 records). [2025-10-09T17:02:21.123711] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-09T17:02:21.125992] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:02:21.126222] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:02:21.126291] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:02:21.126371] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-09T17:02:21.126465] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-09T17:02:21.126536] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-09T17:02:21.126844] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-09T17:02:21.126991] [INFO ] [MAIN ] Update Progress: 22/2373 symbols completed. ACP took 25.4s. Estimated remaining: 4h 5m 2s. Rate: 9.6 symbols/min [2025-10-09T17:02:21.308935] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:21.309141] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-09T17:02:21.309181] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-09T17:02:21.309293] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-09T17:02:21.309336] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-09T17:02:21.309379] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-09T17:02:21.309413] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-09T17:02:21.604966] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-09T17:02:21.690388] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:22.137638] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T17:02:22.224135] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T17:02:22.396714] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-09T17:02:23.196729] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-09T17:02:23.555777] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T17:02:23.921104] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T17:02:23.996731] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-09T17:02:24.488767] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T17:02:24.489666] [INFO ] [REMOTE ] ACR: Full fetch complete (8562 records). [2025-10-09T17:02:24.489738] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-09T17:02:24.801896] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-09T17:02:24.917396] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-09T17:02:24.917498] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-09T17:02:24.917744] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-09T17:02:24.917809] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-09T17:02:24.918304] [DEBUG] [LOCAL ] ACR: Trimmed 8562 records to 5643 (keeping 200 days of data) [2025-10-09T17:02:24.956026] [DEBUG] [LOCAL ] ACR: Primary data saved (5643 records). [2025-10-09T17:02:24.956189] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-09T17:02:24.956290] [INFO ] [MAIN ] Update Progress: 23/2373 symbols completed. ACR took 24.9s. Estimated remaining: 4h 0m 48s. Rate: 9.8 symbols/min [2025-10-09T17:02:25.127792] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:25.128022] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-10-09T17:02:25.128079] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-10-09T17:02:25.128191] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-09T17:02:25.128234] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-09T17:02:25.128277] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-09T17:02:25.128310] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-09T17:02:25.478188] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:25.558872] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T17:02:25.596700] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-09T17:02:26.396731] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-09T17:02:26.757797] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:02:27.196716] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-09T17:02:27.439688] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T17:02:27.996717] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-09T17:02:28.150436] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T17:02:28.393816] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T17:02:28.796762] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-09T17:02:29.373865] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T17:02:29.596707] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-09T17:02:30.396734] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-09T17:02:31.007887] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T17:02:31.196727] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-09T17:02:31.996747] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-09T17:02:32.050028] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T17:02:32.550118] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:02:32.796730] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-09T17:02:33.596750] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-09T17:02:33.986756] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T17:02:34.396693] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-09T17:02:34.468558] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:02:34.500896] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T17:02:35.196716] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-09T17:02:35.996697] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-09T17:02:36.008057] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:02:36.374703] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T17:02:36.796725] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-09T17:02:37.143982] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T17:02:37.147058] [INFO ] [REMOTE ] ACRE: Full fetch complete (50218 records). [2025-10-09T17:02:37.147216] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-09T17:02:37.552543] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-09T17:02:37.552672] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-09T17:02:37.553282] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-09T17:02:37.553329] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-09T17:02:37.554554] [DEBUG] [LOCAL ] ACRE: Trimmed 50218 records to 33893 (keeping 200 days of data) [2025-10-09T17:02:37.634705] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-09T17:02:37.830948] [DEBUG] [LOCAL ] ACRE: Primary data saved (33893 records). [2025-10-09T17:02:37.831127] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-09T17:02:37.831220] [INFO ] [MAIN ] Update Progress: 24/2373 symbols completed. ACRE took 35.4s. Estimated remaining: 4h 11m 40s. Rate: 9.3 symbols/min [2025-10-09T17:02:38.095390] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:38.097833] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-09T17:02:38.097902] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-09T17:02:38.098120] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-09T17:02:38.098176] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-09T17:02:38.098228] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-09T17:02:38.098269] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-09T17:02:38.299212] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T17:02:38.401839] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-09T17:02:38.569237] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:38.602378] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T17:02:39.084833] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T17:02:39.196699] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-09T17:02:39.996703] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-09T17:02:40.186424] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:02:40.186746] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-09T17:02:40.186855] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:02:40.186941] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-09T17:02:40.187024] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:02:40.187116] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-09T17:02:40.187195] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-09T17:02:40.187236] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-09T17:02:40.187278] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-09T17:02:40.187338] [INFO ] [MAIN ] Update Progress: 25/2373 symbols completed. AD took 2.4s. Estimated remaining: 4h 5m 11s. Rate: 9.6 symbols/min [2025-10-09T17:02:40.363545] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:40.407573] [DEBUG] [LOCAL ] ADC: Loaded 46168 existing records from primary storage. [2025-10-09T17:02:40.407886] [INFO ] [MAIN ] ADC: Loaded 46168 existing records. [2025-10-09T17:02:40.601445] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:40.601728] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-09T17:02:40.601803] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-09T17:02:40.602221] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-09T17:02:40.602282] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-09T17:02:40.809387] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-09T17:02:40.999712] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T17:02:40.998263] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:41.459942] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T17:02:41.596683] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-09T17:02:42.396739] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-09T17:02:43.153078] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:02:43.196668] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-09T17:02:43.996702] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-09T17:02:44.249926] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T17:02:44.254955] [INFO ] [REMOTE ] ACN: Full fetch complete (77152 records). [2025-10-09T17:02:44.255080] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-09T17:02:44.670268] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-09T17:02:44.670459] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-09T17:02:44.671295] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-09T17:02:44.674634] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-09T17:02:44.676759] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T17:02:44.680302] [DEBUG] [LOCAL ] ACN: Trimmed 77152 records to 53818 (keeping 200 days of data) [2025-10-09T17:02:44.798937] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-09T17:02:44.823517] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T17:02:45.071739] [DEBUG] [LOCAL ] ACN: Primary data saved (53818 records). [2025-10-09T17:02:45.071882] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-09T17:02:45.073620] [INFO ] [MAIN ] Update Progress: 26/2373 symbols completed. ACN took 1m 0s. Estimated remaining: 4h 3m 0s. Rate: 9.7 symbols/min [2025-10-09T17:02:45.270036] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:45.305787] [DEBUG] [LOCAL ] ADCT: Loaded 35096 existing records from primary storage. [2025-10-09T17:02:45.306054] [INFO ] [MAIN ] ADCT: Loaded 35096 existing records. [2025-10-09T17:02:45.484625] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:45.484853] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-09T17:02:45.484898] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-09T17:02:45.485124] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-09T17:02:45.485181] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-09T17:02:45.601894] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-09T17:02:45.886080] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:45.984535] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T17:02:46.396749] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-09T17:02:47.165214] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T17:02:47.196717] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-09T17:02:47.996720] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-09T17:02:48.122571] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T17:02:48.529240] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T17:02:48.800154] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-09T17:02:48.803203] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:02:49.596736] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-09T17:02:50.388358] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T17:02:50.397997] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-09T17:02:51.196720] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-09T17:02:51.366196] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T17:02:51.463415] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:02:51.919635] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:02:51.921385] [INFO ] [REMOTE ] ACV: Full fetch complete (10290 records). [2025-10-09T17:02:51.921460] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-09T17:02:52.001881] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-09T17:02:52.309216] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-09T17:02:52.309293] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-09T17:02:52.309473] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-09T17:02:52.309512] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-09T17:02:52.309960] [DEBUG] [LOCAL ] ACV: Trimmed 10290 records to 7732 (keeping 200 days of data) [2025-10-09T17:02:52.356018] [DEBUG] [LOCAL ] ACV: Primary data saved (7732 records). [2025-10-09T17:02:52.356145] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-09T17:02:52.356216] [INFO ] [MAIN ] Update Progress: 27/2373 symbols completed. ACV took 31.2s. Estimated remaining: 4h 4m 27s. Rate: 9.6 symbols/min [2025-10-09T17:02:52.524449] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:52.577423] [DEBUG] [LOCAL ] ADM: Loaded 53388 existing records from primary storage. [2025-10-09T17:02:52.577763] [INFO ] [MAIN ] ADM: Loaded 53388 existing records. [2025-10-09T17:02:52.757513] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:52.757779] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-09T17:02:52.757828] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-09T17:02:52.758085] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-09T17:02:52.758142] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-09T17:02:52.801987] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-09T17:02:53.126936] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:53.548192] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T17:02:53.596710] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-09T17:02:54.362122] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T17:02:54.396746] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-09T17:02:55.196722] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-09T17:02:55.250413] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:02:55.915915] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:02:55.996676] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-09T17:02:56.652835] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T17:02:56.796725] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-09T17:02:57.455350] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:02:57.596694] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-09T17:02:58.162284] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T17:02:58.396768] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-09T17:02:58.832589] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:02:59.196790] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-09T17:02:59.996698] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-09T17:03:00.144623] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:03:00.382520] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T17:03:00.796765] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-09T17:03:01.596794] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-09T17:03:01.801052] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:03:01.805434] [INFO ] [REMOTE ] ACVA: Full fetch complete (70552 records). [2025-10-09T17:03:01.805847] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-09T17:03:02.267325] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:03:02.267579] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-09T17:03:02.273738] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-09T17:03:02.274975] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-09T17:03:02.275395] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-09T17:03:02.276969] [DEBUG] [LOCAL ] ACVA: Trimmed 70552 records to 49581 (keeping 200 days of data) [2025-10-09T17:03:02.396761] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-09T17:03:02.583546] [DEBUG] [LOCAL ] ACVA: Primary data saved (49581 records). [2025-10-09T17:03:02.583716] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-09T17:03:02.583800] [INFO ] [MAIN ] Update Progress: 28/2373 symbols completed. ACVA took 37.6s. Estimated remaining: 4h 9m 54s. Rate: 9.4 symbols/min [2025-10-09T17:03:02.761278] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:02.803342] [DEBUG] [LOCAL ] ADNT: Loaded 47191 existing records from primary storage. [2025-10-09T17:03:02.803694] [INFO ] [MAIN ] ADNT: Loaded 47191 existing records. [2025-10-09T17:03:02.983783] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:02.984216] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-09T17:03:02.984371] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-09T17:03:02.984775] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-09T17:03:02.984835] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-09T17:03:03.201803] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-09T17:03:03.358562] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:03.388328] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T17:03:03.729603] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T17:03:03.996698] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-09T17:03:04.796795] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-09T17:03:04.987318] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:03:05.596780] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-09T17:03:06.036371] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-09T17:03:06.401795] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-09T17:03:06.415355] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T17:03:07.160021] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:03:07.196733] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-09T17:03:07.942396] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:03:07.946875] [INFO ] [REMOTE ] ADC: Full fetch complete (66204 records). [2025-10-09T17:03:07.947050] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-09T17:03:08.005182] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-09T17:03:08.372015] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-09T17:03:08.372158] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-09T17:03:08.372893] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-09T17:03:08.372960] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-09T17:03:08.374333] [DEBUG] [LOCAL ] ADC: Trimmed 66204 records to 46495 (keeping 200 days of data) [2025-10-09T17:03:08.690981] [DEBUG] [LOCAL ] ADC: Primary data saved (46495 records). [2025-10-09T17:03:08.691365] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-09T17:03:08.691692] [INFO ] [MAIN ] Update Progress: 29/2373 symbols completed. ADC took 28.5s. Estimated remaining: 4h 9m 24s. Rate: 9.4 symbols/min [2025-10-09T17:03:08.801784] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-09T17:03:08.902360] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:08.915676] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:03:08.974411] [DEBUG] [LOCAL ] ADT: Loaded 53446 existing records from primary storage. [2025-10-09T17:03:08.974809] [INFO ] [MAIN ] ADT: Loaded 53446 existing records. [2025-10-09T17:03:09.165973] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:09.166208] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-09T17:03:09.166254] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-09T17:03:09.166485] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-09T17:03:09.166542] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-09T17:03:09.567531] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:09.591542] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T17:03:09.599331] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-09T17:03:10.396700] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-09T17:03:10.720761] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:03:11.145261] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:03:11.196682] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-09T17:03:11.300498] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T17:03:11.996738] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-09T17:03:12.769269] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T17:03:12.796671] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-09T17:03:13.010560] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T17:03:13.596714] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-09T17:03:14.393578] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T17:03:14.397372] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-09T17:03:14.624478] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T17:03:15.196724] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-09T17:03:15.996733] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-09T17:03:16.065247] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:03:16.796723] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-09T17:03:17.195971] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T17:03:17.596690] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-09T17:03:17.709635] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:03:18.277506] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:03:18.396746] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-09T17:03:18.817286] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:03:19.196718] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-09T17:03:19.837178] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T17:03:19.842418] [INFO ] [REMOTE ] ADCT: Full fetch complete (51448 records). [2025-10-09T17:03:19.842513] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-09T17:03:20.001873] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-09T17:03:20.246061] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-09T17:03:20.246146] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-09T17:03:20.246740] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-09T17:03:20.246827] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-09T17:03:20.248186] [DEBUG] [LOCAL ] ADCT: Trimmed 51448 records to 35427 (keeping 200 days of data) [2025-10-09T17:03:20.470352] [DEBUG] [LOCAL ] ADCT: Primary data saved (35427 records). [2025-10-09T17:03:20.470736] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-09T17:03:20.472276] [INFO ] [MAIN ] Update Progress: 30/2373 symbols completed. ADCT took 35.4s. Estimated remaining: 4h 16m 19s. Rate: 9.1 symbols/min [2025-10-09T17:03:20.668845] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:20.697568] [DEBUG] [LOCAL ] ADX: Loaded 27572 existing records from primary storage. [2025-10-09T17:03:20.698066] [INFO ] [MAIN ] ADX: Loaded 27572 existing records. [2025-10-09T17:03:20.807580] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-09T17:03:20.895796] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:20.896283] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-09T17:03:20.896342] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-09T17:03:20.908084] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-09T17:03:20.928456] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-09T17:03:21.012156] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:03:21.312267] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:21.596773] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-09T17:03:21.632992] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T17:03:22.396732] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-09T17:03:22.430028] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T17:03:23.198400] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:03:23.196725] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-09T17:03:23.866757] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:03:23.996791] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-09T17:03:24.796695] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-09T17:03:24.890819] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T17:03:25.423335] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T17:03:25.596730] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-09T17:03:25.792754] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T17:03:26.396732] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-09T17:03:27.059455] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:03:27.196708] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-09T17:03:27.916579] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T17:03:27.996687] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-09T17:03:28.639521] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T17:03:28.796733] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-09T17:03:29.596686] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-09T17:03:29.664518] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T17:03:30.396804] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-09T17:03:30.576680] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T17:03:31.196720] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-09T17:03:31.471323] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T17:03:31.492004] [INFO ] [REMOTE ] ADM: Full fetch complete (77262 records). [2025-10-09T17:03:31.494349] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-09T17:03:31.496095] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T17:03:31.907453] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-09T17:03:31.907546] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-09T17:03:31.908315] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-09T17:03:31.908385] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-09T17:03:31.909975] [DEBUG] [LOCAL ] ADM: Trimmed 77262 records to 53778 (keeping 200 days of data) [2025-10-09T17:03:32.000207] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-09T17:03:32.239186] [DEBUG] [LOCAL ] ADM: Primary data saved (53778 records). [2025-10-09T17:03:32.239336] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-09T17:03:32.240355] [INFO ] [MAIN ] Update Progress: 31/2373 symbols completed. ADM took 39.9s. Estimated remaining: 4h 22m 46s. Rate: 8.9 symbols/min [2025-10-09T17:03:32.419477] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:32.419690] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-10-09T17:03:32.419747] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-10-09T17:03:32.419871] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-09T17:03:32.419942] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-09T17:03:32.420008] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-09T17:03:32.420064] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-09T17:03:32.795718] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:32.796665] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-09T17:03:33.094088] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T17:03:33.596690] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-09T17:03:33.649057] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:03:34.256115] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T17:03:34.396734] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-09T17:03:35.064872] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:03:35.069839] [INFO ] [REMOTE ] ADT: Full fetch complete (77184 records). [2025-10-09T17:03:35.069994] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-09T17:03:35.201912] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-09T17:03:35.510550] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-09T17:03:35.510920] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-09T17:03:35.522090] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-09T17:03:35.529721] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-09T17:03:35.530499] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T17:03:35.538913] [DEBUG] [LOCAL ] ADT: Trimmed 77184 records to 53834 (keeping 200 days of data) [2025-10-09T17:03:35.861944] [DEBUG] [LOCAL ] ADT: Primary data saved (53834 records). [2025-10-09T17:03:35.862098] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-09T17:03:35.862194] [INFO ] [MAIN ] Update Progress: 32/2373 symbols completed. ADT took 27.2s. Estimated remaining: 4h 18m 52s. Rate: 9.0 symbols/min [2025-10-09T17:03:36.006941] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-09T17:03:36.041442] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:36.053093] [DEBUG] [LOCAL ] AEFC: Loaded 8446 existing records from primary storage. [2025-10-09T17:03:36.053411] [INFO ] [MAIN ] AEFC: Loaded 8446 existing records. [2025-10-09T17:03:36.229945] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:36.230170] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-09T17:03:36.230219] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-09T17:03:36.230421] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-09T17:03:36.230482] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-09T17:03:36.621596] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:36.796682] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-09T17:03:36.948522] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:03:37.492303] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T17:03:37.506112] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T17:03:37.596707] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-09T17:03:38.341490] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:03:38.396757] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-09T17:03:39.196759] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-09T17:03:39.577545] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T17:03:39.582361] [INFO ] [REMOTE ] ADNT: Full fetch complete (67947 records). [2025-10-09T17:03:39.582477] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-09T17:03:39.907050] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T17:03:39.997460] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-09T17:03:39.997324] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-09T17:03:39.997801] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-09T17:03:39.999772] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-09T17:03:39.999846] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-09T17:03:40.001376] [DEBUG] [LOCAL ] ADNT: Trimmed 67947 records to 47491 (keeping 200 days of data) [2025-10-09T17:03:40.285246] [DEBUG] [LOCAL ] ADNT: Primary data saved (47491 records). [2025-10-09T17:03:40.285386] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-09T17:03:40.285470] [INFO ] [MAIN ] Update Progress: 33/2373 symbols completed. ADNT took 37.7s. Estimated remaining: 4h 16m 8s. Rate: 9.1 symbols/min [2025-10-09T17:03:40.464394] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:40.464668] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-10-09T17:03:40.464726] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-10-09T17:03:40.464842] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-09T17:03:40.464884] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-09T17:03:40.464925] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-09T17:03:40.464958] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-09T17:03:40.803121] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-09T17:03:40.827549] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:40.835482] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T17:03:41.596711] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-09T17:03:42.189043] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:03:42.371607] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T17:03:42.396690] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-09T17:03:43.072439] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T17:03:43.196751] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-09T17:03:43.996750] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-09T17:03:44.278708] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T17:03:44.477323] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T17:03:44.796756] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-09T17:03:45.596741] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-09T17:03:46.390277] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T17:03:46.396687] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-09T17:03:47.196686] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-09T17:03:47.460066] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T17:03:47.759983] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T17:03:47.996773] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-09T17:03:48.652302] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:03:48.796734] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-09T17:03:49.372381] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T17:03:49.561102] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T17:03:49.596709] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-09T17:03:50.159180] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T17:03:50.396716] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-09T17:03:50.990338] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T17:03:51.196739] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-09T17:03:51.996717] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-09T17:03:52.441139] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T17:03:52.796728] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-09T17:03:53.230424] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:03:53.418250] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T17:03:53.419269] [INFO ] [REMOTE ] AEFC: Full fetch complete (11945 records). [2025-10-09T17:03:53.419340] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-09T17:03:53.602497] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-09T17:03:53.827847] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-09T17:03:53.827924] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-09T17:03:53.828174] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-09T17:03:53.828219] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-09T17:03:53.828688] [DEBUG] [LOCAL ] AEFC: Trimmed 11945 records to 8470 (keeping 200 days of data) [2025-10-09T17:03:53.879632] [DEBUG] [LOCAL ] AEFC: Primary data saved (8470 records). [2025-10-09T17:03:53.879789] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-09T17:03:53.879869] [INFO ] [MAIN ] Update Progress: 34/2373 symbols completed. AEFC took 18.0s. Estimated remaining: 4h 24m 5s. Rate: 8.9 symbols/min [2025-10-09T17:03:54.042886] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:54.094842] [DEBUG] [LOCAL ] AEM: Loaded 53466 existing records from primary storage. [2025-10-09T17:03:54.095183] [INFO ] [MAIN ] AEM: Loaded 53466 existing records. [2025-10-09T17:03:54.272263] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:54.272530] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-09T17:03:54.272577] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-09T17:03:54.272937] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-09T17:03:54.273010] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-09T17:03:54.408858] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-09T17:03:54.625104] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:54.641331] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T17:03:55.196715] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-09T17:03:55.996749] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-09T17:03:56.262536] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:03:56.796706] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-09T17:03:56.892232] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:03:56.964991] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T17:03:56.967524] [INFO ] [REMOTE ] ADX: Full fetch complete (41858 records). [2025-10-09T17:03:56.967617] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-09T17:03:57.342956] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-09T17:03:57.343032] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-09T17:03:57.343463] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-09T17:03:57.343505] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-09T17:03:57.344348] [DEBUG] [LOCAL ] ADX: Trimmed 41858 records to 27755 (keeping 200 days of data) [2025-10-09T17:03:57.523466] [DEBUG] [LOCAL ] ADX: Primary data saved (27755 records). [2025-10-09T17:03:57.523603] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-09T17:03:57.523705] [INFO ] [MAIN ] Update Progress: 35/2373 symbols completed. ADX took 37.1s. Estimated remaining: 4h 20m 29s. Rate: 9.0 symbols/min [2025-10-09T17:03:57.601875] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-09T17:03:57.692590] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:57.742159] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-09T17:03:57.742488] [INFO ] [MAIN ] AEO: Loaded 53563 existing records. [2025-10-09T17:03:57.915434] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:57.915620] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-09T17:03:57.915697] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-09T17:03:57.915949] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-09T17:03:57.916013] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-09T17:03:58.278447] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:58.396675] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-09T17:03:58.472456] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:03:59.196691] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-09T17:03:59.321845] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T17:03:59.996707] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-09T17:04:00.354215] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T17:04:00.796747] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-09T17:04:01.118626] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:04:01.596773] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-09T17:04:01.752514] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T17:04:02.243768] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:04:02.396709] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-09T17:04:03.174264] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:04:03.196696] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-09T17:04:03.996758] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-09T17:04:04.086254] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T17:04:04.614115] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:04:04.796709] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-09T17:04:05.596690] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-09T17:04:05.718589] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:04:06.157073] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T17:04:06.396740] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-09T17:04:07.196715] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-09T17:04:07.797676] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-09T17:04:07.996737] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-09T17:04:08.043305] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T17:04:08.796765] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-09T17:04:09.145745] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T17:04:09.596694] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-09T17:04:09.920183] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:04:10.072471] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T17:04:10.396719] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-09T17:04:10.821065] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T17:04:11.196739] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-09T17:04:11.996688] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-09T17:04:12.034492] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T17:04:12.796691] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-09T17:04:12.903505] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T17:04:13.596721] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-09T17:04:14.102382] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T17:04:14.334897] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T17:04:14.396677] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-09T17:04:15.144121] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T17:04:15.196698] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-09T17:04:15.996714] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-09T17:04:16.194322] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T17:04:16.796696] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-09T17:04:17.195550] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T17:04:17.207638] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:04:17.596783] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-09T17:04:18.229688] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:04:18.233952] [INFO ] [REMOTE ] AEE: Full fetch complete (72313 records). [2025-10-09T17:04:18.234116] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-09T17:04:18.235130] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:04:18.235290] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:04:18.235333] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:04:18.235371] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-09T17:04:18.235429] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-09T17:04:18.235464] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-09T17:04:18.235521] [DEBUG] [LOCAL ] AEE: No derivative data file found to delete. [2025-10-09T17:04:18.235604] [INFO ] [MAIN ] Update Progress: 36/2373 symbols completed. AEE took 46.0s. Estimated remaining: 4h 35m 33s. Rate: 8.5 symbols/min [2025-10-09T17:04:18.404081] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-09T17:04:18.407579] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:18.461754] [DEBUG] [LOCAL ] AER: Loaded 48212 existing records from primary storage. [2025-10-09T17:04:18.462087] [INFO ] [MAIN ] AER: Loaded 48212 existing records. [2025-10-09T17:04:18.646971] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:18.647226] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-09T17:04:18.647281] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-09T17:04:18.647636] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-09T17:04:18.647731] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-09T17:04:19.015697] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:19.196739] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-09T17:04:19.745676] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-09T17:04:19.900050] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T17:04:19.904253] [INFO ] [REMOTE ] AEG: Full fetch complete (70231 records). [2025-10-09T17:04:19.904360] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-09T17:04:20.001885] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-09T17:04:20.326731] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-09T17:04:20.326866] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-09T17:04:20.328013] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-09T17:04:20.328086] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-09T17:04:20.330296] [DEBUG] [LOCAL ] AEG: Trimmed 70231 records to 49927 (keeping 200 days of data) [2025-10-09T17:04:20.667180] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T17:04:20.686970] [DEBUG] [LOCAL ] AEG: Primary data saved (49927 records). [2025-10-09T17:04:20.687077] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-09T17:04:20.687144] [INFO ] [MAIN ] Update Progress: 37/2373 symbols completed. AEG took 40.4s. Estimated remaining: 4h 30m 34s. Rate: 8.6 symbols/min [2025-10-09T17:04:20.796718] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-09T17:04:21.596904] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-09T17:04:21.852231] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T17:04:21.936176] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:04:22.396722] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-09T17:04:23.196725] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-09T17:04:23.663804] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T17:04:24.008677] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-09T17:04:24.014059] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-09T17:04:24.796698] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-09T17:04:24.884591] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T17:04:25.596741] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-09T17:04:25.989899] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T17:04:26.384875] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T17:04:26.396718] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-09T17:04:27.196732] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-09T17:04:27.441768] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T17:04:27.996692] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-09T17:04:28.077522] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:04:28.082219] [INFO ] [REMOTE ] AEO: Full fetch complete (77447 records). [2025-10-09T17:04:28.082381] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-09T17:04:28.486887] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-09T17:04:28.487007] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-09T17:04:28.488148] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-09T17:04:28.488250] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-09T17:04:28.490434] [DEBUG] [LOCAL ] AEO: Trimmed 77447 records to 53953 (keeping 200 days of data) [2025-10-09T17:04:28.845385] [DEBUG] [LOCAL ] AEO: Primary data saved (53953 records). [2025-10-09T17:04:28.845526] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-09T17:04:28.846963] [INFO ] [MAIN ] Update Progress: 38/2373 symbols completed. AEO took 31.3s. Estimated remaining: 4h 31m 42s. Rate: 8.6 symbols/min [2025-10-09T17:04:28.939377] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T17:04:28.950172] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-09T17:04:29.492150] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:04:29.596726] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-09T17:04:30.674628] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:04:30.685174] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-09T17:04:31.442317] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T17:04:31.447200] [INFO ] [REMOTE ] AEM: Full fetch complete (77194 records). [2025-10-09T17:04:31.447328] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-09T17:04:31.855439] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-09T17:04:31.855787] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-09T17:04:31.856548] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-09T17:04:31.856592] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-09T17:04:31.858840] [DEBUG] [LOCAL ] AEM: Trimmed 77194 records to 53856 (keeping 200 days of data) [2025-10-09T17:04:32.204577] [DEBUG] [LOCAL ] AEM: Primary data saved (53856 records). [2025-10-09T17:04:32.204789] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-09T17:04:32.206268] [INFO ] [MAIN ] Update Progress: 39/2373 symbols completed. AEM took 38.3s. Estimated remaining: 4h 27m 58s. Rate: 8.7 symbols/min [2025-10-09T17:04:32.324035] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T17:04:32.333664] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-09T17:04:33.887924] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:04:33.899380] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-09T17:04:35.591170] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:04:35.601762] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-09T17:04:37.072559] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T17:04:37.083008] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-09T17:04:38.654075] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T17:04:38.660597] [INFO ] [REMOTE ] AER: Full fetch complete (69574 records). [2025-10-09T17:04:38.660925] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-09T17:04:39.188018] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-09T17:04:39.188122] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-09T17:04:39.188860] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-09T17:04:39.188929] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-09T17:04:39.190395] [DEBUG] [LOCAL ] AER: Trimmed 69574 records to 48578 (keeping 200 days of data) [2025-10-09T17:04:39.529486] [DEBUG] [LOCAL ] AER: Primary data saved (48578 records). [2025-10-09T17:04:39.529676] [INFO ] [MAIN ] AER: Full history saved. [2025-10-09T17:04:39.530803] [INFO ] [MAIN ] Update Progress: 40/2373 symbols completed. AER took 21.3s. Estimated remaining: 4h 28m 16s. Rate: 8.7 symbols/min [2025-10-09T17:04:40.234196] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:40.235139] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:40.241323] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:40.240184] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-09T17:04:40.257477] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-09T17:04:40.264202] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:40.265409] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-09T17:04:40.265606] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-09T17:04:40.265717] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-09T17:04:40.265770] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-09T17:04:40.391613] [DEBUG] [LOCAL ] AFB: Loaded 11448 existing records from primary storage. [2025-10-09T17:04:40.400809] [INFO ] [MAIN ] AFB: Loaded 11448 existing records. [2025-10-09T17:04:40.720392] [DEBUG] [LOCAL ] AESI: Loaded 49557 existing records from primary storage. [2025-10-09T17:04:40.746256] [DEBUG] [LOCAL ] AES: Loaded 53671 existing records from primary storage. [2025-10-09T17:04:40.751597] [INFO ] [MAIN ] AESI: Loaded 49557 existing records. [2025-10-09T17:04:40.764380] [INFO ] [MAIN ] AES: Loaded 53671 existing records. [2025-10-09T17:04:41.119070] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:41.220762] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-09T17:04:41.236884] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-09T17:04:41.278729] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-09T17:04:41.318860] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:41.351107] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-09T17:04:41.350490] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-09T17:04:41.417289] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:41.428110] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-09T17:04:41.444324] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-09T17:04:41.490696] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-09T17:04:41.547386] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:41.511856] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-09T17:04:41.567158] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-09T17:04:41.567698] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-09T17:04:41.595777] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-09T17:04:41.606305] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-09T17:04:41.682426] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:04:41.801361] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-09T17:04:41.831898] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:04:41.837224] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-09T17:04:41.933378] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:04:41.959459] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-09T17:04:41.978222] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-09T17:04:41.991963] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-09T17:04:42.002192] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-09T17:04:42.035326] [INFO ] [MAIN ] Update Progress: 41/2373 symbols completed. AEXA took 2.5s. Estimated remaining: 4h 23m 60s. Rate: 8.8 symbols/min [2025-10-09T17:04:42.579710] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:42.667883] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-09T17:04:42.726999] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:42.723791] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:42.727482] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-09T17:04:42.811027] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:42.811973] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-09T17:04:42.847987] [DEBUG] [LOCAL ] AFG: Loaded 32197 existing records from primary storage. [2025-10-09T17:04:42.848350] [INFO ] [MAIN ] AFG: Loaded 32197 existing records. [2025-10-09T17:04:43.049700] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:43.050006] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-09T17:04:43.050062] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-09T17:04:43.050363] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-09T17:04:43.050424] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-09T17:04:43.428026] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:43.428461] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-09T17:04:43.606097] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T17:04:43.609008] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-09T17:04:44.041942] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T17:04:44.050926] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-09T17:04:44.401695] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T17:04:44.404518] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-09T17:04:44.836624] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:04:44.844689] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-09T17:04:44.844051] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T17:04:44.856875] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-09T17:04:45.124891] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T17:04:45.127608] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-09T17:04:45.521527] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:04:45.530419] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-09T17:04:45.971492] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:04:45.977153] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-09T17:04:46.037852] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T17:04:46.041239] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-09T17:04:46.329252] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:04:46.339789] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-09T17:04:46.963582] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T17:04:46.984583] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T17:04:46.984246] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-09T17:04:47.082610] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:04:47.196765] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-09T17:04:47.645840] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:04:47.946966] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:04:47.996669] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-09T17:04:48.685146] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:04:48.720109] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T17:04:48.796679] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-09T17:04:49.596727] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-09T17:04:49.671707] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T17:04:50.396736] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-09T17:04:50.941938] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:04:51.114050] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T17:04:51.196690] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-09T17:04:51.996721] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-09T17:04:52.691379] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T17:04:52.770127] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T17:04:52.796665] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-09T17:04:53.586940] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T17:04:53.588505] [INFO ] [REMOTE ] AFB: Full fetch complete (16522 records). [2025-10-09T17:04:53.588572] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-09T17:04:53.601783] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-09T17:04:53.949241] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-09T17:04:53.949324] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-09T17:04:53.949566] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-09T17:04:53.949603] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-09T17:04:53.950110] [DEBUG] [LOCAL ] AFB: Trimmed 16522 records to 11507 (keeping 200 days of data) [2025-10-09T17:04:54.027639] [DEBUG] [LOCAL ] AFB: Primary data saved (11507 records). [2025-10-09T17:04:54.027797] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-09T17:04:54.027877] [INFO ] [MAIN ] Update Progress: 42/2373 symbols completed. AFB took 14.5s. Estimated remaining: 4h 28m 41s. Rate: 8.7 symbols/min [2025-10-09T17:04:54.194032] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:54.198756] [DEBUG] [LOCAL ] AFGB: Loaded 2309 existing records from primary storage. [2025-10-09T17:04:54.198915] [INFO ] [MAIN ] AFGB: Loaded 2309 existing records. [2025-10-09T17:04:54.372356] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:54.372556] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-09T17:04:54.372628] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-09T17:04:54.372885] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-09T17:04:54.372953] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-09T17:04:54.403437] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-09T17:04:54.727443] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:55.196679] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-09T17:04:55.460222] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T17:04:55.618830] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-09T17:04:55.870222] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:04:55.996704] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-09T17:04:56.796761] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-09T17:04:57.192036] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T17:04:57.192213] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T17:04:57.596757] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-09T17:04:58.396776] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-09T17:04:58.945742] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T17:04:59.196778] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-09T17:04:59.722490] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T17:04:59.996793] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-09T17:05:00.474352] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T17:05:00.796754] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-09T17:05:01.599522] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-09T17:05:01.603093] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:05:02.093957] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T17:05:02.396762] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-09T17:05:03.104585] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-09T17:05:03.196762] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-09T17:05:03.611959] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T17:05:03.987202] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:05:03.998733] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-09T17:05:04.796742] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-09T17:05:05.596710] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-09T17:05:05.951471] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T17:05:06.122114] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T17:05:06.229171] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T17:05:06.396742] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-09T17:05:07.196712] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-09T17:05:07.996718] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-09T17:05:08.200202] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T17:05:08.453915] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T17:05:08.796719] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-09T17:05:09.067710] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:05:09.093285] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-09T17:05:09.596728] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-09T17:05:10.396726] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-09T17:05:10.783922] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-09T17:05:11.131769] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:05:11.136200] [INFO ] [REMOTE ] AESI: Full fetch complete (70763 records). [2025-10-09T17:05:11.136359] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-09T17:05:11.201801] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-09T17:05:11.538755] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-09T17:05:11.538866] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-09T17:05:11.539551] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-09T17:05:11.539595] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-09T17:05:11.541826] [DEBUG] [LOCAL ] AESI: Trimmed 70763 records to 49944 (keeping 200 days of data) [2025-10-09T17:05:11.544905] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T17:05:11.860758] [DEBUG] [LOCAL ] AESI: Primary data saved (49944 records). [2025-10-09T17:05:11.860909] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-09T17:05:11.860996] [INFO ] [MAIN ] Update Progress: 43/2373 symbols completed. AESI took 32.3s. Estimated remaining: 4h 38m 26s. Rate: 8.4 symbols/min [2025-10-09T17:05:12.008637] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-09T17:05:12.041374] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:12.046263] [DEBUG] [LOCAL ] AFGC: Loaded 2549 existing records from primary storage. [2025-10-09T17:05:12.046412] [INFO ] [MAIN ] AFGC: Loaded 2549 existing records. [2025-10-09T17:05:12.228171] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:12.228386] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-09T17:05:12.228436] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-09T17:05:12.228595] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-09T17:05:12.228693] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-09T17:05:12.601717] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:12.796719] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-09T17:05:13.367565] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T17:05:13.596762] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-09T17:05:14.058732] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T17:05:14.330466] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T17:05:14.396671] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-09T17:05:15.196728] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-09T17:05:15.593635] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T17:05:15.996698] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-09T17:05:16.312503] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T17:05:16.331121] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T17:05:16.796750] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-09T17:05:17.596714] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-09T17:05:18.231996] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T17:05:18.251685] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T17:05:18.396739] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-09T17:05:18.955178] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T17:05:18.956022] [INFO ] [REMOTE ] AFGB: Full fetch complete (3615 records). [2025-10-09T17:05:18.956129] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-09T17:05:19.201888] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-09T17:05:19.341959] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-09T17:05:19.342038] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-09T17:05:19.342170] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-09T17:05:19.342208] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-09T17:05:19.342549] [DEBUG] [LOCAL ] AFGB: Trimmed 3615 records to 2317 (keeping 200 days of data) [2025-10-09T17:05:19.356977] [DEBUG] [LOCAL ] AFGB: Primary data saved (2317 records). [2025-10-09T17:05:19.357051] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-09T17:05:19.357123] [INFO ] [MAIN ] Update Progress: 44/2373 symbols completed. AFGB took 25.3s. Estimated remaining: 4h 38m 36s. Rate: 8.4 symbols/min [2025-10-09T17:05:19.524304] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:19.528721] [DEBUG] [LOCAL ] AFGD: Loaded 1807 existing records from primary storage. [2025-10-09T17:05:19.528876] [INFO ] [MAIN ] AFGD: Loaded 1807 existing records. [2025-10-09T17:05:19.704157] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:19.704406] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-09T17:05:19.704455] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-09T17:05:19.704675] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-09T17:05:19.704737] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-09T17:05:20.001988] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-09T17:05:20.060738] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:20.429117] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T17:05:20.437760] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T17:05:20.440740] [INFO ] [REMOTE ] AFG: Full fetch complete (46219 records). [2025-10-09T17:05:20.440837] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-09T17:05:20.826303] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-09T17:05:20.808327] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-09T17:05:20.827159] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-09T17:05:20.827713] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-09T17:05:20.827791] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-09T17:05:20.829028] [DEBUG] [LOCAL ] AFG: Trimmed 46219 records to 32429 (keeping 200 days of data) [2025-10-09T17:05:21.045874] [DEBUG] [LOCAL ] AFG: Primary data saved (32429 records). [2025-10-09T17:05:21.046004] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-09T17:05:21.046083] [INFO ] [MAIN ] Update Progress: 45/2373 symbols completed. AFG took 38.9s. Estimated remaining: 4h 33m 45s. Rate: 8.5 symbols/min [2025-10-09T17:05:21.214092] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:21.219097] [DEBUG] [LOCAL ] AFGE: Loaded 2427 existing records from primary storage. [2025-10-09T17:05:21.219272] [INFO ] [MAIN ] AFGE: Loaded 2427 existing records. [2025-10-09T17:05:21.311290] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-09T17:05:21.408483] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:21.408747] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-09T17:05:21.408810] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-09T17:05:21.409005] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-09T17:05:21.409069] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-09T17:05:21.603213] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-09T17:05:21.781979] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:22.396708] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-09T17:05:22.924483] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-09T17:05:23.196712] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-09T17:05:23.497469] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T17:05:23.847751] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T17:05:23.996724] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-09T17:05:24.448936] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T17:05:24.796727] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-09T17:05:25.596783] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-09T17:05:26.056880] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T17:05:26.396718] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-09T17:05:26.893925] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T17:05:26.961730] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T17:05:27.196720] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-09T17:05:27.596118] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-09T17:05:27.996765] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-09T17:05:28.438120] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T17:05:28.796719] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-09T17:05:29.304404] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T17:05:29.596754] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-09T17:05:30.040022] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T17:05:30.396731] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-09T17:05:31.196745] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-09T17:05:31.793804] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T17:05:31.996699] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-09T17:05:32.205726] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-09T17:05:32.210502] [INFO ] [REMOTE ] AES: Full fetch complete (77721 records). [2025-10-09T17:05:32.210692] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-09T17:05:32.556480] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T17:05:32.659280] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-09T17:05:32.659356] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-09T17:05:32.660095] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-09T17:05:32.660161] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-09T17:05:32.661487] [DEBUG] [LOCAL ] AES: Trimmed 77721 records to 54060 (keeping 200 days of data) [2025-10-09T17:05:32.839948] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-09T17:05:32.995517] [DEBUG] [LOCAL ] AES: Primary data saved (54060 records). [2025-10-09T17:05:32.995703] [INFO ] [MAIN ] AES: Full history saved. [2025-10-09T17:05:32.995857] [INFO ] [MAIN ] Update Progress: 46/2373 symbols completed. AES took 53.5s. Estimated remaining: 4h 37m 46s. Rate: 8.4 symbols/min [2025-10-09T17:05:33.161323] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:33.212966] [DEBUG] [LOCAL ] AFL: Loaded 53161 existing records from primary storage. [2025-10-09T17:05:33.213292] [INFO ] [MAIN ] AFL: Loaded 53161 existing records. [2025-10-09T17:05:33.386872] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:33.387053] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-09T17:05:33.387097] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-09T17:05:33.387476] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-09T17:05:33.387534] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-09T17:05:33.468350] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T17:05:33.489426] [INFO ] [REMOTE ] AFGC: Full fetch complete (3691 records). [2025-10-09T17:05:33.492019] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-09T17:05:33.617158] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-09T17:05:34.067927] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:34.121705] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-09T17:05:34.121784] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-09T17:05:34.121906] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-09T17:05:34.121946] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-09T17:05:34.122291] [DEBUG] [LOCAL ] AFGC: Trimmed 3691 records to 2560 (keeping 200 days of data) [2025-10-09T17:05:34.138401] [DEBUG] [LOCAL ] AFGC: Primary data saved (2560 records). [2025-10-09T17:05:34.138461] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-09T17:05:34.138535] [INFO ] [MAIN ] Update Progress: 47/2373 symbols completed. AFGC took 22.3s. Estimated remaining: 4h 32m 41s. Rate: 8.5 symbols/min [2025-10-09T17:05:34.312806] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:34.315883] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T17:05:34.369461] [DEBUG] [LOCAL ] AG: Loaded 53642 existing records from primary storage. [2025-10-09T17:05:34.369834] [INFO ] [MAIN ] AG: Loaded 53642 existing records. [2025-10-09T17:05:34.401835] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-09T17:05:34.547764] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:34.547990] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-09T17:05:34.548054] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-09T17:05:34.549428] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-09T17:05:34.549489] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-09T17:05:34.901865] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:34.987341] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T17:05:35.196795] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-09T17:05:35.996733] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-09T17:05:36.796710] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-09T17:05:37.191534] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T17:05:37.291145] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T17:05:37.596734] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-09T17:05:38.052704] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T17:05:38.304349] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-09T17:05:38.396711] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-09T17:05:39.196762] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-09T17:05:39.996707] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-09T17:05:40.158230] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:05:40.310812] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-09T17:05:40.796695] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-09T17:05:41.069197] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T17:05:41.260790] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T17:05:41.596774] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-09T17:05:42.043048] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:05:42.396708] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-09T17:05:43.196786] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-09T17:05:43.522669] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-09T17:05:43.996709] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-09T17:05:44.363894] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T17:05:44.408175] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-09T17:05:44.796714] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-09T17:05:45.596712] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-09T17:05:45.990450] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T17:05:46.396757] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-09T17:05:46.893327] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-09T17:05:47.196733] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-09T17:05:47.990215] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:05:48.000021] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-09T17:05:48.478345] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T17:05:48.479232] [INFO ] [REMOTE ] AFGD: Full fetch complete (3061 records). [2025-10-09T17:05:48.479301] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-09T17:05:48.797684] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-09T17:05:48.873830] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-09T17:05:48.873935] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-09T17:05:48.874090] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-09T17:05:48.874231] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-09T17:05:48.874867] [DEBUG] [LOCAL ] AFGD: Trimmed 3061 records to 1815 (keeping 200 days of data) [2025-10-09T17:05:48.887375] [DEBUG] [LOCAL ] AFGD: Primary data saved (1815 records). [2025-10-09T17:05:48.913470] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-09T17:05:48.916856] [INFO ] [MAIN ] Update Progress: 48/2373 symbols completed. AFGD took 29.6s. Estimated remaining: 4h 38m 49s. Rate: 8.3 symbols/min [2025-10-09T17:05:48.968276] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T17:05:49.119940] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:49.163496] [DEBUG] [LOCAL ] AGCO: Loaded 42343 existing records from primary storage. [2025-10-09T17:05:49.163827] [INFO ] [MAIN ] AGCO: Loaded 42343 existing records. [2025-10-09T17:05:49.350213] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:49.350462] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-09T17:05:49.350509] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-09T17:05:49.351782] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-09T17:05:49.351842] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-09T17:05:49.604843] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-09T17:05:49.735120] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:50.191222] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:05:50.396814] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-09T17:05:51.164450] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T17:05:51.196667] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-09T17:05:51.996717] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-09T17:05:52.411517] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T17:05:52.796698] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-09T17:05:53.190339] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-09T17:05:53.331277] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T17:05:53.596772] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-09T17:05:53.606876] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:05:54.396805] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-09T17:05:55.196731] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-09T17:05:55.931408] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T17:05:55.996710] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-09T17:05:56.045776] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-09T17:05:56.698711] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T17:05:56.796703] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-09T17:05:57.536681] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T17:05:57.596726] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-09T17:05:58.164472] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T17:05:58.396711] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-09T17:05:58.644940] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T17:05:58.847380] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T17:05:59.196720] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-09T17:05:59.996749] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-09T17:06:00.793454] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T17:06:00.803761] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-09T17:06:01.596718] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-09T17:06:02.396687] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-09T17:06:02.473902] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-09T17:06:02.623023] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T17:06:02.835579] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T17:06:02.836302] [INFO ] [REMOTE ] AFGE: Full fetch complete (3445 records). [2025-10-09T17:06:02.836367] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-09T17:06:03.193688] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-09T17:06:03.193811] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-09T17:06:03.193998] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-09T17:06:03.194075] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-09T17:06:03.194581] [DEBUG] [LOCAL ] AFGE: Trimmed 3445 records to 2436 (keeping 200 days of data) [2025-10-09T17:06:03.202806] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-09T17:06:03.212035] [DEBUG] [LOCAL ] AFGE: Primary data saved (2436 records). [2025-10-09T17:06:03.212108] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-09T17:06:03.212195] [INFO ] [MAIN ] Update Progress: 49/2373 symbols completed. AFGE took 42.2s. Estimated remaining: 4h 44m 18s. Rate: 8.2 symbols/min [2025-10-09T17:06:03.386943] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T17:06:03.431130] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:03.449797] [DEBUG] [LOCAL ] AGD: Loaded 18490 existing records from primary storage. [2025-10-09T17:06:03.450033] [INFO ] [MAIN ] AGD: Loaded 18490 existing records. [2025-10-09T17:06:03.624261] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:03.624493] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-09T17:06:03.624570] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-09T17:06:03.625526] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-09T17:06:03.625610] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-09T17:06:03.970353] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:03.996667] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-09T17:06:04.656674] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T17:06:04.796705] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-09T17:06:04.995565] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T17:06:05.596724] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-09T17:06:06.396733] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-09T17:06:06.565915] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T17:06:06.833870] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:06:07.196733] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-09T17:06:07.996725] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-09T17:06:08.644501] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-09T17:06:08.730197] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T17:06:08.796696] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-09T17:06:08.878049] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T17:06:09.596712] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-09T17:06:10.396779] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-09T17:06:11.126462] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-09T17:06:11.131163] [INFO ] [REMOTE ] AG: Full fetch complete (77615 records). [2025-10-09T17:06:11.131291] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-09T17:06:11.200099] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-09T17:06:11.249483] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T17:06:11.272088] [INFO ] [REMOTE ] AFL: Full fetch complete (76519 records). [2025-10-09T17:06:11.295818] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-09T17:06:11.355341] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:06:11.354918] [FATAL] [VALIDATOR ] AFL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:06:11.384554] [FATAL] [MAIN ] AFL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:06:11.463730] [WARN ] [MAIN ] AFL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:06:11.500830] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-09T17:06:11.503423] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-09T17:06:11.503811] [INFO ] [LOCAL ] AFL: Starting deletion of derivative data. [2025-10-09T17:06:11.519848] [DEBUG] [LOCAL ] AFL: Deleted derivative data file. [2025-10-09T17:06:11.543921] [INFO ] [MAIN ] Update Progress: 50/2373 symbols completed. AFL took 38.5s. Estimated remaining: 4h 44m 57s. Rate: 8.2 symbols/min [2025-10-09T17:06:11.678689] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-09T17:06:11.702018] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-09T17:06:11.713091] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-09T17:06:11.713485] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-09T17:06:11.784199] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:11.781038] [DEBUG] [LOCAL ] AG: Trimmed 77615 records to 54032 (keeping 200 days of data) [2025-10-09T17:06:11.997371] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-09T17:06:12.023432] [DEBUG] [LOCAL ] AGI: Loaded 53420 existing records from primary storage. [2025-10-09T17:06:12.024939] [INFO ] [MAIN ] AGI: Loaded 53420 existing records. [2025-10-09T17:06:12.217760] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:12.218821] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-09T17:06:12.219674] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-09T17:06:12.221853] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-09T17:06:12.221931] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-09T17:06:12.670677] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:12.757297] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T17:06:12.789496] [DEBUG] [LOCAL ] AG: Primary data saved (54032 records). [2025-10-09T17:06:12.789626] [INFO ] [MAIN ] AG: Full history saved. [2025-10-09T17:06:12.791035] [INFO ] [MAIN ] Update Progress: 51/2373 symbols completed. AG took 38.7s. Estimated remaining: 4h 40m 11s. Rate: 8.3 symbols/min [2025-10-09T17:06:12.802321] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-09T17:06:12.961308] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:13.012045] [DEBUG] [LOCAL ] AGL: Loaded 52495 existing records from primary storage. [2025-10-09T17:06:13.012369] [INFO ] [MAIN ] AGL: Loaded 52495 existing records. [2025-10-09T17:06:13.190151] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:13.190413] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-09T17:06:13.190469] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-09T17:06:13.191725] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-09T17:06:13.191785] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-09T17:06:13.492853] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:06:13.562635] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:13.596668] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-09T17:06:14.396739] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-09T17:06:14.535557] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T17:06:14.880392] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T17:06:15.196799] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-09T17:06:15.996739] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-09T17:06:16.239465] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T17:06:16.733161] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T17:06:16.796682] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-09T17:06:16.903393] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T17:06:17.470843] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T17:06:17.596727] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-09T17:06:18.396739] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-09T17:06:19.196749] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-09T17:06:19.638181] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T17:06:19.967168] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T17:06:19.996715] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-09T17:06:20.796692] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-09T17:06:20.979094] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T17:06:21.596706] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-09T17:06:21.685500] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T17:06:21.737681] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T17:06:22.396738] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-09T17:06:23.196869] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-09T17:06:23.294070] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T17:06:23.342475] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T17:06:23.996734] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-09T17:06:24.796692] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-09T17:06:24.900199] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:06:25.294207] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T17:06:25.596756] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-09T17:06:25.815684] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T17:06:26.396741] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-09T17:06:27.196693] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-09T17:06:27.353014] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T17:06:27.622009] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:06:27.625482] [INFO ] [REMOTE ] AGCO: Full fetch complete (61418 records). [2025-10-09T17:06:27.625586] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-09T17:06:27.626313] [FATAL] [VALIDATOR ] AGCO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:06:27.626400] [FATAL] [MAIN ] AGCO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:06:27.626445] [WARN ] [MAIN ] AGCO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:06:27.626514] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-09T17:06:27.626604] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-10-09T17:06:27.626685] [INFO ] [LOCAL ] AGCO: Starting deletion of derivative data. [2025-10-09T17:06:27.626891] [DEBUG] [LOCAL ] AGCO: Deleted derivative data file. [2025-10-09T17:06:27.627526] [INFO ] [MAIN ] Update Progress: 52/2373 symbols completed. AGCO took 38.7s. Estimated remaining: 4h 45m 43s. Rate: 8.1 symbols/min [2025-10-09T17:06:27.798062] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:27.810439] [DEBUG] [LOCAL ] AGM: Loaded 10458 existing records from primary storage. [2025-10-09T17:06:27.810682] [INFO ] [MAIN ] AGM: Loaded 10458 existing records. [2025-10-09T17:06:27.984533] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:27.984760] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-09T17:06:27.984810] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-09T17:06:27.985220] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-09T17:06:27.985277] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-09T17:06:28.005212] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-09T17:06:28.345309] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:28.374841] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T17:06:28.377233] [INFO ] [REMOTE ] AGD: Full fetch complete (26053 records). [2025-10-09T17:06:28.377308] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-09T17:06:28.769631] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-09T17:06:28.769764] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-09T17:06:28.770118] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-09T17:06:28.770160] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-09T17:06:28.771125] [DEBUG] [LOCAL ] AGD: Trimmed 26053 records to 18787 (keeping 200 days of data) [2025-10-09T17:06:28.819902] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-09T17:06:28.891531] [DEBUG] [LOCAL ] AGD: Primary data saved (18787 records). [2025-10-09T17:06:28.891707] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-09T17:06:28.891814] [INFO ] [MAIN ] Update Progress: 53/2373 symbols completed. AGD took 25.7s. Estimated remaining: 4h 41m 8s. Rate: 8.3 symbols/min [2025-10-09T17:06:29.068730] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:29.104010] [DEBUG] [LOCAL ] AGO: Loaded 27924 existing records from primary storage. [2025-10-09T17:06:29.104287] [INFO ] [MAIN ] AGO: Loaded 27924 existing records. [2025-10-09T17:06:29.288357] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:29.288731] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-09T17:06:29.288800] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-09T17:06:29.289032] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-09T17:06:29.289089] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-09T17:06:29.597049] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-09T17:06:29.688127] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:29.718210] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:06:30.396701] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-09T17:06:30.551187] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T17:06:30.665869] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T17:06:31.196709] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-09T17:06:31.556966] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:06:31.716751] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T17:06:31.996722] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-09T17:06:32.796753] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-09T17:06:33.596714] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-09T17:06:33.802743] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T17:06:34.273134] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T17:06:34.403988] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-09T17:06:34.423933] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T17:06:35.078372] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:06:35.196673] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-09T17:06:35.996700] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-09T17:06:36.059324] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T17:06:36.796777] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-09T17:06:37.596704] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-09T17:06:37.737359] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:06:37.797577] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:06:38.396709] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-09T17:06:38.433735] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T17:06:39.196730] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-09T17:06:39.996720] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-09T17:06:40.311432] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T17:06:40.387464] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T17:06:40.796716] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-09T17:06:41.596737] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-09T17:06:41.648634] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T17:06:41.894180] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T17:06:42.396734] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-09T17:06:43.196683] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-09T17:06:43.565913] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-09T17:06:43.641674] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T17:06:43.878110] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T17:06:43.996691] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-09T17:06:44.796728] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-09T17:06:45.465186] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:06:45.596731] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-09T17:06:46.358824] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T17:06:46.364983] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T17:06:46.372011] [INFO ] [REMOTE ] AGL: Full fetch complete (75603 records). [2025-10-09T17:06:46.372830] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-09T17:06:46.401968] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-09T17:06:46.790984] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-09T17:06:46.791075] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-09T17:06:46.791828] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-09T17:06:46.791895] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-09T17:06:46.793527] [DEBUG] [LOCAL ] AGL: Trimmed 75603 records to 52884 (keeping 200 days of data) [2025-10-09T17:06:47.091383] [DEBUG] [LOCAL ] AGL: Primary data saved (52884 records). [2025-10-09T17:06:47.091602] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-09T17:06:47.092680] [INFO ] [MAIN ] Update Progress: 54/2373 symbols completed. AGL took 34.3s. Estimated remaining: 4h 48m 50s. Rate: 8.0 symbols/min [2025-10-09T17:06:47.201892] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-09T17:06:47.276357] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:47.276534] [DEBUG] [LOCAL ] AGRO: No existing data file found in primary storage. [2025-10-09T17:06:47.276575] [WARN ] [MAIN ] AGRO: No existing data found, performing full refresh instead. [2025-10-09T17:06:47.276751] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-09T17:06:47.276796] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-09T17:06:47.276840] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-09T17:06:47.276877] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-09T17:06:47.662816] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:47.679206] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T17:06:47.996746] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-09T17:06:48.796766] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-09T17:06:49.136869] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T17:06:49.444545] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T17:06:49.596754] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-09T17:06:49.784828] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T17:06:50.396731] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-09T17:06:50.897613] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:06:51.196736] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-09T17:06:51.729725] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:06:51.996696] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-09T17:06:52.796680] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-09T17:06:53.220084] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T17:06:53.391238] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T17:06:53.596686] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-09T17:06:54.043191] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T17:06:54.396767] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-09T17:06:54.505615] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T17:06:54.507357] [INFO ] [REMOTE ] AGM: Full fetch complete (13028 records). [2025-10-09T17:06:54.507430] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-09T17:06:54.887744] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-09T17:06:54.887854] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-09T17:06:54.888136] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-09T17:06:54.888200] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-09T17:06:54.889081] [DEBUG] [LOCAL ] AGM: Trimmed 13028 records to 10514 (keeping 200 days of data) [2025-10-09T17:06:54.961879] [DEBUG] [LOCAL ] AGM: Primary data saved (10514 records). [2025-10-09T17:06:54.962064] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-09T17:06:54.962178] [INFO ] [MAIN ] Update Progress: 55/2373 symbols completed. AGM took 27.3s. Estimated remaining: 4h 48m 59s. Rate: 8.0 symbols/min [2025-10-09T17:06:55.135622] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:55.171814] [DEBUG] [LOCAL ] AGX: Loaded 33176 existing records from primary storage. [2025-10-09T17:06:55.172098] [INFO ] [MAIN ] AGX: Loaded 33176 existing records. [2025-10-09T17:06:55.202576] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-09T17:06:55.353140] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:55.353369] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-09T17:06:55.353416] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-09T17:06:55.353731] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-09T17:06:55.353790] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-09T17:06:55.704875] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:55.996702] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-09T17:06:56.308662] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T17:06:56.337463] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T17:06:56.796764] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-09T17:06:57.096150] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T17:06:57.596761] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-09T17:06:57.892687] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T17:06:58.396733] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-09T17:06:59.026288] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:06:59.196730] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-09T17:06:59.705557] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T17:06:59.996732] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-09T17:07:00.796679] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-09T17:07:01.127569] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T17:07:01.131104] [INFO ] [REMOTE ] AGO: Full fetch complete (39433 records). [2025-10-09T17:07:01.131243] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-09T17:07:01.255823] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-09T17:07:01.322573] [INFO ] [REMOTE ] AGI: Full fetch complete (76915 records). [2025-10-09T17:07:01.341367] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-09T17:07:01.601745] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-09T17:07:01.684416] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-09T17:07:01.699784] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-09T17:07:01.752519] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-09T17:07:01.758148] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-09T17:07:01.824104] [DEBUG] [LOCAL ] AGO: Trimmed 39433 records to 28116 (keeping 200 days of data) [2025-10-09T17:07:02.012163] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-09T17:07:02.015896] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-09T17:07:02.021137] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-09T17:07:02.022667] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-09T17:07:02.041700] [DEBUG] [LOCAL ] AGI: Trimmed 76915 records to 53810 (keeping 200 days of data) [2025-10-09T17:07:02.188818] [DEBUG] [LOCAL ] AGO: Primary data saved (28116 records). [2025-10-09T17:07:02.189537] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-09T17:07:02.192592] [INFO ] [MAIN ] Update Progress: 56/2373 symbols completed. AGO took 33.3s. Estimated remaining: 4h 48m 41s. Rate: 8.0 symbols/min [2025-10-09T17:07:02.330309] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T17:07:02.404179] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-09T17:07:02.410348] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:02.552876] [DEBUG] [LOCAL ] AHH: Loaded 40772 existing records from primary storage. [2025-10-09T17:07:02.558637] [INFO ] [MAIN ] AHH: Loaded 40772 existing records. [2025-10-09T17:07:02.811376] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:02.813027] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-09T17:07:02.813934] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-09T17:07:02.814798] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-09T17:07:02.814882] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-09T17:07:03.201954] [DEBUG] [LOCAL ] AGI: Primary data saved (53810 records). [2025-10-09T17:07:03.232764] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:03.234331] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T17:07:03.233480] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-09T17:07:03.238086] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-09T17:07:03.243343] [INFO ] [MAIN ] Update Progress: 57/2373 symbols completed. AGI took 51.7s. Estimated remaining: 4h 44m 13s. Rate: 8.1 symbols/min [2025-10-09T17:07:03.412527] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:03.412752] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-09T17:07:03.412800] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-09T17:07:03.412917] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-09T17:07:03.412960] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-09T17:07:03.413002] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-09T17:07:03.413036] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-09T17:07:03.771747] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:03.790927] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T17:07:03.996766] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-09T17:07:04.796798] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-09T17:07:04.970516] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:07:05.347860] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:07:05.596738] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-09T17:07:05.658716] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T17:07:06.396728] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-09T17:07:06.600981] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:07:06.601278] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-09T17:07:06.601380] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:07:06.601427] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-09T17:07:06.601489] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:07:06.601560] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-09T17:07:06.601624] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-09T17:07:06.601696] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-09T17:07:06.601753] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-09T17:07:06.601814] [INFO ] [MAIN ] Update Progress: 58/2373 symbols completed. AHL took 3.4s. Estimated remaining: 4h 41m 26s. Rate: 8.2 symbols/min [2025-10-09T17:07:06.775988] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:06.819794] [DEBUG] [LOCAL ] AHR: Loaded 49109 existing records from primary storage. [2025-10-09T17:07:06.820117] [INFO ] [MAIN ] AHR: Loaded 49109 existing records. [2025-10-09T17:07:07.002582] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:07.003083] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-09T17:07:07.003200] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-09T17:07:07.003750] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-09T17:07:07.003885] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-09T17:07:07.205246] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-09T17:07:07.268823] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:07:07.420590] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:07.996718] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-09T17:07:08.755973] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:07:08.796702] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-09T17:07:09.596710] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-09T17:07:09.805177] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T17:07:10.391125] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T17:07:10.400219] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-09T17:07:10.627700] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T17:07:11.196722] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-09T17:07:11.936509] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T17:07:11.996703] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-09T17:07:12.796701] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-09T17:07:12.838018] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:07:13.596688] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-09T17:07:13.802601] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T17:07:14.396713] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-09T17:07:14.510973] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:07:15.182020] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:07:15.196688] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-09T17:07:15.799578] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:07:15.996781] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-09T17:07:16.463515] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T17:07:16.796728] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-09T17:07:17.214738] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:07:17.596731] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-09T17:07:18.396755] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-09T17:07:18.421553] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T17:07:19.196693] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-09T17:07:19.246001] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T17:07:19.826563] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:07:19.996763] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-09T17:07:20.657609] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:07:20.796733] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-09T17:07:21.596748] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-09T17:07:21.757983] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T17:07:22.054954] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T17:07:22.396773] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-09T17:07:22.546600] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T17:07:23.196778] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-09T17:07:23.996704] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-09T17:07:24.030393] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:07:24.484756] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T17:07:24.487743] [INFO ] [REMOTE ] AGRO: Full fetch complete (49352 records). [2025-10-09T17:07:24.487833] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-09T17:07:24.809795] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-09T17:07:24.861396] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-09T17:07:24.861477] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-09T17:07:24.861990] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-09T17:07:24.862054] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-09T17:07:24.863042] [DEBUG] [LOCAL ] AGRO: Trimmed 49352 records to 33620 (keeping 200 days of data) [2025-10-09T17:07:25.074103] [DEBUG] [LOCAL ] AGRO: Primary data saved (33620 records). [2025-10-09T17:07:25.074224] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-09T17:07:25.074295] [INFO ] [MAIN ] Update Progress: 59/2373 symbols completed. AGRO took 38.0s. Estimated remaining: 4h 48m 37s. Rate: 8.0 symbols/min [2025-10-09T17:07:25.253299] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:25.277370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T17:07:25.290736] [DEBUG] [LOCAL ] AHT: Loaded 6227 existing records from primary storage. [2025-10-09T17:07:25.290937] [INFO ] [MAIN ] AHT: Loaded 6227 existing records. [2025-10-09T17:07:25.460917] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:25.461090] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-09T17:07:25.461138] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-09T17:07:25.461310] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-09T17:07:25.461366] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-09T17:07:25.601906] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-09T17:07:25.814170] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:26.396682] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-09T17:07:26.460536] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T17:07:27.066135] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T17:07:27.196751] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-09T17:07:27.228501] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T17:07:27.996747] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-09T17:07:28.669548] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T17:07:28.796697] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-09T17:07:29.225394] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:07:29.596744] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-09T17:07:30.250675] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T17:07:30.301091] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T17:07:30.396677] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-09T17:07:31.196760] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-09T17:07:31.996694] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-09T17:07:32.228628] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T17:07:32.428370] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T17:07:32.526179] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:07:32.529598] [INFO ] [REMOTE ] AHH: Full fetch complete (59903 records). [2025-10-09T17:07:32.529731] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-09T17:07:32.801859] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-09T17:07:32.918043] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-09T17:07:32.918145] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-09T17:07:32.918769] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-09T17:07:32.918838] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-09T17:07:32.920120] [DEBUG] [LOCAL ] AHH: Trimmed 59903 records to 41015 (keeping 200 days of data) [2025-10-09T17:07:33.163503] [DEBUG] [LOCAL ] AHH: Primary data saved (41015 records). [2025-10-09T17:07:33.163633] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-09T17:07:33.163755] [INFO ] [MAIN ] Update Progress: 60/2373 symbols completed. AHH took 31.0s. Estimated remaining: 4h 48m 53s. Rate: 8.0 symbols/min [2025-10-09T17:07:33.333313] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:33.337472] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T17:07:33.389838] [DEBUG] [LOCAL ] AI: Loaded 53755 existing records from primary storage. [2025-10-09T17:07:33.390162] [INFO ] [MAIN ] AI: Loaded 53755 existing records. [2025-10-09T17:07:33.561182] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:33.561371] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-09T17:07:33.561417] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-09T17:07:33.561687] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-09T17:07:33.561745] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-09T17:07:33.601848] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-09T17:07:33.924153] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:34.396750] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-09T17:07:34.844185] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T17:07:34.846838] [INFO ] [REMOTE ] AGX: Full fetch complete (48602 records). [2025-10-09T17:07:34.846947] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-09T17:07:35.203386] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-09T17:07:35.246363] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-09T17:07:35.246449] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-09T17:07:35.247046] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-09T17:07:35.247110] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-09T17:07:35.248268] [DEBUG] [LOCAL ] AGX: Trimmed 48602 records to 33340 (keeping 200 days of data) [2025-10-09T17:07:35.465163] [DEBUG] [LOCAL ] AGX: Primary data saved (33340 records). [2025-10-09T17:07:35.465307] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-09T17:07:35.465392] [INFO ] [MAIN ] Update Progress: 61/2373 symbols completed. AGX took 40.5s. Estimated remaining: 4h 45m 28s. Rate: 8.1 symbols/min [2025-10-09T17:07:35.631604] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:35.680561] [DEBUG] [LOCAL ] AIG: Loaded 53474 existing records from primary storage. [2025-10-09T17:07:35.680903] [INFO ] [MAIN ] AIG: Loaded 53474 existing records. [2025-10-09T17:07:35.857075] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:35.857296] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-09T17:07:35.857351] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-09T17:07:35.857601] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-09T17:07:35.857698] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-09T17:07:36.004471] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-09T17:07:36.217597] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:36.518902] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T17:07:36.523367] [INFO ] [REMOTE ] AHR: Full fetch complete (70757 records). [2025-10-09T17:07:36.523477] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-09T17:07:36.800768] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-09T17:07:36.816989] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:07:36.941880] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-09T17:07:36.941995] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-09T17:07:36.942879] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-09T17:07:36.942977] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-09T17:07:36.982082] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-09T17:07:36.993901] [DEBUG] [LOCAL ] AHR: Trimmed 70757 records to 49469 (keeping 200 days of data) [2025-10-09T17:07:37.302231] [DEBUG] [LOCAL ] AHR: Primary data saved (49469 records). [2025-10-09T17:07:37.302375] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-09T17:07:37.302470] [INFO ] [MAIN ] Update Progress: 62/2373 symbols completed. AHR took 30.7s. Estimated remaining: 4h 41m 53s. Rate: 8.2 symbols/min [2025-10-09T17:07:37.473349] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:37.473547] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-09T17:07:37.473584] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-09T17:07:37.473724] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-09T17:07:37.473771] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-09T17:07:37.473814] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-09T17:07:37.473846] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-09T17:07:37.609629] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-09T17:07:37.824248] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:38.361006] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:07:38.396694] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-09T17:07:38.659131] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:07:38.659739] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-09T17:07:38.685867] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:07:38.686019] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-09T17:07:38.686087] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:07:38.686172] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-09T17:07:38.686785] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-09T17:07:38.687696] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T17:07:38.687771] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-09T17:07:38.698983] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-09T17:07:38.699041] [INFO ] [MAIN ] Update Progress: 63/2373 symbols completed. AII took 1.4s. Estimated remaining: 4h 38m 9s. Rate: 8.3 symbols/min [2025-10-09T17:07:38.867538] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:38.889994] [DEBUG] [LOCAL ] AIN: Loaded 24522 existing records from primary storage. [2025-10-09T17:07:38.890223] [INFO ] [MAIN ] AIN: Loaded 24522 existing records. [2025-10-09T17:07:39.062564] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:39.062790] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-09T17:07:39.062845] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-09T17:07:39.063036] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-09T17:07:39.063091] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-09T17:07:39.201941] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-09T17:07:39.409575] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:39.996746] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-09T17:07:40.796787] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-09T17:07:40.849980] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T17:07:41.539936] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-09T17:07:41.596705] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-09T17:07:42.396735] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-09T17:07:42.570274] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T17:07:43.196724] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-09T17:07:43.320027] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T17:07:43.478244] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T17:07:43.996754] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-09T17:07:44.685634] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T17:07:44.796722] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-09T17:07:44.914863] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T17:07:45.596724] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-09T17:07:45.839205] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T17:07:46.396719] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-09T17:07:46.941383] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T17:07:47.196712] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-09T17:07:47.494048] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T17:07:47.906121] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T17:07:47.996692] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-09T17:07:48.796716] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-09T17:07:49.596686] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-09T17:07:49.671859] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T17:07:49.950909] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T17:07:50.396801] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-09T17:07:51.196734] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-09T17:07:51.204414] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:07:51.926530] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-09T17:07:51.996732] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-09T17:07:52.398420] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T17:07:52.796722] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-09T17:07:53.596720] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-09T17:07:53.956821] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:07:54.159976] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-09T17:07:54.396796] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-09T17:07:55.196686] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-09T17:07:55.631548] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T17:07:55.772010] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T17:07:55.773113] [INFO ] [REMOTE ] AHT: Full fetch complete (9173 records). [2025-10-09T17:07:55.773182] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-09T17:07:56.002033] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-09T17:07:56.152915] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-09T17:07:56.152995] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-09T17:07:56.153216] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-09T17:07:56.153255] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-09T17:07:56.153723] [DEBUG] [LOCAL ] AHT: Trimmed 9173 records to 6268 (keeping 200 days of data) [2025-10-09T17:07:56.191934] [DEBUG] [LOCAL ] AHT: Primary data saved (6268 records). [2025-10-09T17:07:56.192049] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-09T17:07:56.192131] [INFO ] [MAIN ] Update Progress: 64/2373 symbols completed. AHT took 31.1s. Estimated remaining: 4h 44m 12s. Rate: 8.1 symbols/min [2025-10-09T17:07:56.362354] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:56.378731] [DEBUG] [LOCAL ] AIO: Loaded 13421 existing records from primary storage. [2025-10-09T17:07:56.378991] [INFO ] [MAIN ] AIO: Loaded 13421 existing records. [2025-10-09T17:07:56.570866] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:56.571268] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-09T17:07:56.571348] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-09T17:07:56.571710] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-09T17:07:56.571773] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-09T17:07:56.769998] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-09T17:07:56.806096] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-09T17:07:56.986943] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:57.107324] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T17:07:57.596760] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-09T17:07:58.169457] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T17:07:58.396727] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-09T17:07:59.196766] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-09T17:07:59.474846] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:07:59.996763] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-09T17:08:00.134166] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T17:08:00.199397] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-09T17:08:00.796725] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-09T17:08:01.596730] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-09T17:08:01.680093] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:08:01.726715] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T17:08:02.396740] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-09T17:08:03.196721] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-09T17:08:03.996730] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-09T17:08:04.148285] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-09T17:08:04.175104] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T17:08:04.520750] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T17:08:04.540394] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T17:08:04.796730] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-09T17:08:05.596747] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-09T17:08:06.396705] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-09T17:08:06.596595] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T17:08:07.196710] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-09T17:08:07.233804] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-09T17:08:07.322365] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T17:08:07.996783] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-09T17:08:08.739073] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T17:08:08.796677] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-09T17:08:08.971424] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T17:08:09.596721] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-09T17:08:10.396696] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-09T17:08:10.477188] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T17:08:10.499299] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T17:08:11.196730] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-09T17:08:11.996805] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-09T17:08:12.782443] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-09T17:08:12.787119] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-09T17:08:12.787242] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-09T17:08:12.808854] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-09T17:08:12.951816] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:08:13.097362] [INFO ] [REMOTE ] AIG: Full fetch complete (77383 records). [2025-10-09T17:08:13.110500] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-09T17:08:13.140684] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T17:08:13.353254] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-09T17:08:13.371981] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-09T17:08:13.378057] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-09T17:08:13.383737] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-09T17:08:13.515295] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54145 (keeping 200 days of data) [2025-10-09T17:08:13.616351] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-09T17:08:13.766774] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-09T17:08:13.767147] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-09T17:08:13.769636] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-09T17:08:13.770249] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-09T17:08:13.774592] [DEBUG] [LOCAL ] AIG: Trimmed 77383 records to 53863 (keeping 200 days of data) [2025-10-09T17:08:13.992852] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T17:08:13.998274] [INFO ] [REMOTE ] AIN: Full fetch complete (33550 records). [2025-10-09T17:08:13.999355] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-09T17:08:14.499813] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-09T17:08:14.505225] [DEBUG] [LOCAL ] AI: Primary data saved (54145 records). [2025-10-09T17:08:14.505361] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-09T17:08:14.507045] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-09T17:08:14.507920] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-09T17:08:14.507187] [INFO ] [MAIN ] AI: Full history saved. [2025-10-09T17:08:14.517028] [INFO ] [MAIN ] Update Progress: 65/2373 symbols completed. AI took 41.4s. Estimated remaining: 4h 50m 33s. Rate: 7.9 symbols/min [2025-10-09T17:08:14.519630] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T17:08:14.535350] [DEBUG] [LOCAL ] AIN: Trimmed 33550 records to 24721 (keeping 200 days of data) [2025-10-09T17:08:14.624279] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-09T17:08:14.883349] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:14.926928] [DEBUG] [LOCAL ] AIR: Loaded 28818 existing records from primary storage. [2025-10-09T17:08:14.929728] [INFO ] [MAIN ] AIR: Loaded 28818 existing records. [2025-10-09T17:08:15.126154] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:15.127581] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-09T17:08:15.128994] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-09T17:08:15.130358] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-09T17:08:15.130707] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-09T17:08:15.541708] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:15.582385] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-09T17:08:15.590373] [DEBUG] [LOCAL ] AIN: Primary data saved (24721 records). [2025-10-09T17:08:15.591128] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-09T17:08:15.591341] [INFO ] [MAIN ] Update Progress: 66/2373 symbols completed. AIN took 36.9s. Estimated remaining: 4h 46m 39s. Rate: 8.0 symbols/min [2025-10-09T17:08:15.678845] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T17:08:15.752308] [DEBUG] [LOCAL ] AIG: Primary data saved (53863 records). [2025-10-09T17:08:15.763328] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-09T17:08:15.769900] [INFO ] [MAIN ] Update Progress: 67/2373 symbols completed. AIG took 40.3s. Estimated remaining: 4h 42m 21s. Rate: 8.2 symbols/min [2025-10-09T17:08:15.926736] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:16.006522] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-09T17:08:16.006441] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:16.026971] [DEBUG] [LOCAL ] AIT: Loaded 27109 existing records from primary storage. [2025-10-09T17:08:16.027300] [INFO ] [MAIN ] AIT: Loaded 27109 existing records. [2025-10-09T17:08:16.229577] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:16.230843] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-09T17:08:16.230955] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-09T17:08:16.231570] [DEBUG] [LOCAL ] AIV: Loaded 40918 existing records from primary storage. [2025-10-09T17:08:16.231980] [INFO ] [MAIN ] AIV: Loaded 40918 existing records. [2025-10-09T17:08:16.232034] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-09T17:08:16.232132] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-09T17:08:16.596375] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:16.607115] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-09T17:08:16.636752] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-09T17:08:16.648627] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-09T17:08:16.669343] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-09T17:08:16.899480] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:16.938125] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-09T17:08:17.127507] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:08:17.167626] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:17.138455] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T17:08:17.596715] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-09T17:08:18.367161] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:08:18.396665] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-09T17:08:18.607816] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T17:08:19.196717] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-09T17:08:19.346238] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T17:08:19.843377] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T17:08:19.996739] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-09T17:08:20.796727] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-09T17:08:21.167558] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T17:08:21.596722] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-09T17:08:22.352421] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:08:22.396666] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-09T17:08:22.491456] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:08:22.493142] [INFO ] [REMOTE ] AIO: Full fetch complete (20110 records). [2025-10-09T17:08:22.493224] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-09T17:08:22.849018] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-09T17:08:22.849097] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-09T17:08:22.849390] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-09T17:08:22.849428] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-09T17:08:22.850003] [DEBUG] [LOCAL ] AIO: Trimmed 20110 records to 13483 (keeping 200 days of data) [2025-10-09T17:08:22.933170] [DEBUG] [LOCAL ] AIO: Primary data saved (13483 records). [2025-10-09T17:08:22.933318] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-09T17:08:22.933401] [INFO ] [MAIN ] Update Progress: 68/2373 symbols completed. AIO took 26.7s. Estimated remaining: 4h 42m 8s. Rate: 8.2 symbols/min [2025-10-09T17:08:23.097677] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:23.128202] [DEBUG] [LOCAL ] AIZ: Loaded 29684 existing records from primary storage. [2025-10-09T17:08:23.128523] [INFO ] [MAIN ] AIZ: Loaded 29684 existing records. [2025-10-09T17:08:23.201819] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-09T17:08:23.305795] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:23.305989] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-09T17:08:23.306036] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-09T17:08:23.306292] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-09T17:08:23.306353] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-09T17:08:23.691408] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:23.893859] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T17:08:23.996787] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-09T17:08:24.320851] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T17:08:24.796757] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-09T17:08:25.313978] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T17:08:25.596729] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-09T17:08:26.228339] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:08:26.396755] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-09T17:08:27.196682] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-09T17:08:27.360105] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:08:27.921037] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T17:08:27.996714] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-09T17:08:28.721027] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T17:08:28.796714] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-09T17:08:29.471255] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T17:08:29.596668] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-09T17:08:29.911883] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T17:08:30.396827] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-09T17:08:30.748611] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T17:08:31.196762] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-09T17:08:31.996685] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-09T17:08:32.198185] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:08:32.277689] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T17:08:32.796735] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-09T17:08:33.534787] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T17:08:33.596697] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-09T17:08:34.141169] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T17:08:34.396774] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-09T17:08:35.021000] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:08:35.196717] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-09T17:08:35.864262] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:08:35.996752] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-09T17:08:36.490397] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T17:08:36.796734] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-09T17:08:37.411455] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T17:08:37.596687] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-09T17:08:38.064568] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T17:08:38.396769] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-09T17:08:38.568697] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T17:08:39.196705] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-09T17:08:39.511134] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T17:08:39.996731] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-09T17:08:40.603374] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T17:08:40.796730] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-09T17:08:41.386437] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T17:08:41.596742] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-09T17:08:42.396780] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-09T17:08:42.428911] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:08:42.432319] [INFO ] [REMOTE ] AIR: Full fetch complete (39511 records). [2025-10-09T17:08:42.432447] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-09T17:08:42.433037] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:08:42.433124] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:08:42.433168] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:08:42.433246] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-09T17:08:42.433346] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-09T17:08:42.433400] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-09T17:08:42.433719] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-10-09T17:08:42.433831] [INFO ] [MAIN ] Update Progress: 69/2373 symbols completed. AIR took 27.9s. Estimated remaining: 4h 48m 46s. Rate: 8.0 symbols/min [2025-10-09T17:08:42.611494] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:42.624874] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T17:08:42.634287] [DEBUG] [LOCAL ] AIZN: Loaded 4106 existing records from primary storage. [2025-10-09T17:08:42.634508] [INFO ] [MAIN ] AIZN: Loaded 4106 existing records. [2025-10-09T17:08:42.808259] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:42.808503] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-09T17:08:42.808560] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-09T17:08:42.808761] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-09T17:08:42.808818] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-09T17:08:43.160291] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:43.196679] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-09T17:08:43.996703] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-09T17:08:44.009743] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T17:08:44.095491] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T17:08:44.796760] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-09T17:08:45.226837] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T17:08:45.596687] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-09T17:08:45.690558] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T17:08:46.396695] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-09T17:08:46.623441] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T17:08:46.625577] [INFO ] [REMOTE ] AIT: Full fetch complete (39186 records). [2025-10-09T17:08:46.625677] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-09T17:08:46.997420] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T17:08:47.015291] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-09T17:08:47.015358] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-09T17:08:47.015820] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-09T17:08:47.015887] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-09T17:08:47.016794] [DEBUG] [LOCAL ] AIT: Trimmed 39186 records to 27293 (keeping 200 days of data) [2025-10-09T17:08:47.188843] [DEBUG] [LOCAL ] AIT: Primary data saved (27293 records). [2025-10-09T17:08:47.188983] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-09T17:08:47.189063] [INFO ] [MAIN ] Update Progress: 70/2373 symbols completed. AIT took 31.6s. Estimated remaining: 4h 47m 8s. Rate: 8.0 symbols/min [2025-10-09T17:08:47.201895] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-09T17:08:47.364035] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:47.406566] [DEBUG] [LOCAL ] AJG: Loaded 46653 existing records from primary storage. [2025-10-09T17:08:47.406959] [INFO ] [MAIN ] AJG: Loaded 46653 existing records. [2025-10-09T17:08:47.590132] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:47.590375] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-09T17:08:47.590424] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-09T17:08:47.590759] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-09T17:08:47.590818] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-09T17:08:47.973112] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:47.996736] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-09T17:08:48.636965] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T17:08:48.638065] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:08:48.796730] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-09T17:08:49.371519] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T17:08:49.596724] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-09T17:08:50.396738] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-09T17:08:50.997898] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:08:51.196734] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-09T17:08:51.996701] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-09T17:08:52.044238] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:08:52.126976] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T17:08:52.796719] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-09T17:08:53.596714] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-09T17:08:53.981041] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T17:08:54.256370] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T17:08:54.260404] [INFO ] [REMOTE ] AIV: Full fetch complete (60119 records). [2025-10-09T17:08:54.260518] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-09T17:08:54.400261] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-09T17:08:54.668629] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-09T17:08:54.678683] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-09T17:08:54.680101] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-09T17:08:54.680787] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:08:54.686788] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-09T17:08:54.688597] [DEBUG] [LOCAL ] AIV: Trimmed 60119 records to 41248 (keeping 200 days of data) [2025-10-09T17:08:54.922690] [DEBUG] [LOCAL ] AIV: Primary data saved (41248 records). [2025-10-09T17:08:54.922822] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-09T17:08:54.922898] [INFO ] [MAIN ] Update Progress: 71/2373 symbols completed. AIV took 39.1s. Estimated remaining: 4h 47m 8s. Rate: 8.0 symbols/min [2025-10-09T17:08:55.091053] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:55.091274] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-09T17:08:55.091331] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-09T17:08:55.091487] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-09T17:08:55.091528] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-09T17:08:55.091611] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-09T17:08:55.091689] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-09T17:08:55.163369] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T17:08:55.201802] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-09T17:08:55.476221] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:55.806079] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T17:08:55.996735] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-09T17:08:56.796731] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-09T17:08:57.344782] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T17:08:57.378221] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T17:08:57.596728] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-09T17:08:58.219389] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T17:08:58.396721] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-09T17:08:59.196688] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-09T17:08:59.317372] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:08:59.996727] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-09T17:09:00.796702] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-09T17:09:00.997507] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T17:09:01.365368] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T17:09:01.527436] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T17:09:01.529951] [INFO ] [REMOTE ] AIZ: Full fetch complete (42832 records). [2025-10-09T17:09:01.530081] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-09T17:09:01.601896] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-09T17:09:01.910962] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-09T17:09:01.911045] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-09T17:09:01.911513] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-09T17:09:01.911559] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-09T17:09:01.912545] [DEBUG] [LOCAL ] AIZ: Trimmed 42832 records to 29831 (keeping 200 days of data) [2025-10-09T17:09:02.115547] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-09T17:09:02.121476] [DEBUG] [LOCAL ] AIZ: Primary data saved (29831 records). [2025-10-09T17:09:02.121575] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-09T17:09:02.121671] [INFO ] [MAIN ] Update Progress: 72/2373 symbols completed. AIZ took 39.2s. Estimated remaining: 4h 46m 52s. Rate: 8.0 symbols/min [2025-10-09T17:09:02.295392] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:02.348711] [DEBUG] [LOCAL ] AKR: Loaded 45857 existing records from primary storage. [2025-10-09T17:09:02.349052] [INFO ] [MAIN ] AKR: Loaded 45857 existing records. [2025-10-09T17:09:02.401805] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-09T17:09:02.551774] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:02.552018] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-09T17:09:02.552113] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-09T17:09:02.552394] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-09T17:09:02.552450] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-09T17:09:02.906979] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:02.946214] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T17:09:03.196747] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-09T17:09:03.773028] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T17:09:03.996728] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-09T17:09:04.796729] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-09T17:09:05.270760] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T17:09:05.596701] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-09T17:09:05.640681] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:09:06.396783] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-09T17:09:06.827907] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T17:09:07.209727] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-09T17:09:07.212025] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T17:09:07.965499] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T17:09:07.966549] [INFO ] [REMOTE ] AIZN: Full fetch complete (5932 records). [2025-10-09T17:09:07.966620] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-09T17:09:08.001907] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-09T17:09:08.395863] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-09T17:09:08.395951] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-09T17:09:08.396139] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-09T17:09:08.396202] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-09T17:09:08.396671] [DEBUG] [LOCAL ] AIZN: Trimmed 5932 records to 4137 (keeping 200 days of data) [2025-10-09T17:09:08.425592] [DEBUG] [LOCAL ] AIZN: Primary data saved (4137 records). [2025-10-09T17:09:08.425701] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-09T17:09:08.425790] [INFO ] [MAIN ] Update Progress: 73/2373 symbols completed. AIZN took 26.0s. Estimated remaining: 4h 46m 7s. Rate: 8.0 symbols/min [2025-10-09T17:09:08.631428] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:08.635791] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T17:09:08.679626] [DEBUG] [LOCAL ] AL: Loaded 44474 existing records from primary storage. [2025-10-09T17:09:08.679954] [INFO ] [MAIN ] AL: Loaded 44474 existing records. [2025-10-09T17:09:08.801805] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-09T17:09:08.869009] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:08.869330] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-09T17:09:08.869391] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-09T17:09:08.870195] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-09T17:09:08.870256] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-09T17:09:09.226392] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:09.483777] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T17:09:09.596756] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-09T17:09:10.396762] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-09T17:09:11.196780] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-09T17:09:11.430022] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T17:09:11.538282] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:09:11.559993] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T17:09:11.996738] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-09T17:09:12.796732] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-09T17:09:13.380468] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T17:09:13.596736] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-09T17:09:13.908664] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-09T17:09:14.396683] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-09T17:09:14.424925] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:09:14.796247] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T17:09:15.196724] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-09T17:09:15.779173] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T17:09:15.779885] [INFO ] [REMOTE ] AKA: Full fetch complete (2417 records). [2025-10-09T17:09:15.779953] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-09T17:09:15.963223] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T17:09:15.963440] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:09:15.963502] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:09:15.963583] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-09T17:09:15.963679] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-09T17:09:15.963737] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-09T17:09:15.963782] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-09T17:09:15.963840] [INFO ] [MAIN ] Update Progress: 74/2373 symbols completed. AKA took 21.0s. Estimated remaining: 4h 46m 2s. Rate: 8.0 symbols/min [2025-10-09T17:09:16.001946] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-09T17:09:16.145488] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:16.197807] [DEBUG] [LOCAL ] ALB: Loaded 53288 existing records from primary storage. [2025-10-09T17:09:16.198162] [INFO ] [MAIN ] ALB: Loaded 53288 existing records. [2025-10-09T17:09:16.373174] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:16.373366] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-09T17:09:16.373412] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-09T17:09:16.373693] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-09T17:09:16.373752] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-09T17:09:16.735638] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:16.796728] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-09T17:09:17.603514] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-09T17:09:17.630226] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T17:09:18.179383] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T17:09:18.396739] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-09T17:09:19.196721] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-09T17:09:19.369002] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:09:19.818263] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T17:09:19.996746] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-09T17:09:20.498849] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T17:09:20.796735] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-09T17:09:21.463177] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:09:21.596741] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-09T17:09:22.396692] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-09T17:09:22.428246] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:09:23.052959] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T17:09:23.196744] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-09T17:09:23.996723] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-09T17:09:24.342238] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-09T17:09:24.737899] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:09:24.796739] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-09T17:09:25.230523] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T17:09:25.596728] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-09T17:09:26.396684] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-09T17:09:26.515275] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:09:26.952468] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T17:09:27.196714] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-09T17:09:27.996705] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-09T17:09:28.123137] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:09:28.796686] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-09T17:09:28.822162] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:09:29.050408] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T17:09:29.596711] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-09T17:09:30.249882] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T17:09:30.396750] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-09T17:09:31.196694] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-09T17:09:31.240694] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:09:31.996707] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-09T17:09:32.071042] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T17:09:32.575711] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T17:09:32.796739] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-09T17:09:33.318959] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T17:09:33.596731] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-09T17:09:34.396698] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-09T17:09:34.656175] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T17:09:35.160615] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T17:09:35.196676] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-09T17:09:35.996687] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-09T17:09:36.090272] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:09:36.551509] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:09:36.796697] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-09T17:09:37.498280] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:09:37.596676] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-09T17:09:38.083435] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T17:09:38.396786] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-09T17:09:39.151272] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T17:09:39.155234] [INFO ] [REMOTE ] AJG: Full fetch complete (69094 records). [2025-10-09T17:09:39.155398] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-09T17:09:39.201816] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-09T17:09:39.547295] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-09T17:09:39.547376] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-09T17:09:39.548126] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-09T17:09:39.548193] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-09T17:09:39.549587] [DEBUG] [LOCAL ] AJG: Trimmed 69094 records to 46983 (keeping 200 days of data) [2025-10-09T17:09:39.848191] [DEBUG] [LOCAL ] AJG: Primary data saved (46983 records). [2025-10-09T17:09:39.848322] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-09T17:09:39.849698] [INFO ] [MAIN ] Update Progress: 75/2373 symbols completed. AJG took 52.7s. Estimated remaining: 4h 54m 18s. Rate: 7.8 symbols/min [2025-10-09T17:09:40.003557] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-09T17:09:40.023313] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:40.078567] [DEBUG] [LOCAL ] ALC: Loaded 51032 existing records from primary storage. [2025-10-09T17:09:40.078905] [INFO ] [MAIN ] ALC: Loaded 51032 existing records. [2025-10-09T17:09:40.256452] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:40.256775] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-09T17:09:40.256830] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-09T17:09:40.257043] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-09T17:09:40.257100] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-09T17:09:40.649447] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:40.695274] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:09:40.701286] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-09T17:09:40.713147] [INFO ] [REMOTE ] AKR: Full fetch complete (65240 records). [2025-10-09T17:09:40.713772] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-09T17:09:40.802269] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-09T17:09:41.097296] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-09T17:09:41.097377] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-09T17:09:41.098033] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-09T17:09:41.098097] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-09T17:09:41.099427] [DEBUG] [LOCAL ] AKR: Trimmed 65240 records to 46135 (keeping 200 days of data) [2025-10-09T17:09:41.380114] [DEBUG] [LOCAL ] AKR: Primary data saved (46135 records). [2025-10-09T17:09:41.380246] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-09T17:09:41.381411] [INFO ] [MAIN ] Update Progress: 76/2373 symbols completed. AKR took 39.3s. Estimated remaining: 4h 51m 4s. Rate: 7.9 symbols/min [2025-10-09T17:09:41.554744] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:41.589980] [DEBUG] [LOCAL ] ALE: Loaded 31298 existing records from primary storage. [2025-10-09T17:09:41.590255] [INFO ] [MAIN ] ALE: Loaded 31298 existing records. [2025-10-09T17:09:41.620753] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-09T17:09:41.776745] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T17:09:41.782569] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:41.786327] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-09T17:09:41.786512] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-09T17:09:41.786829] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-09T17:09:41.786891] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-09T17:09:41.818393] [INFO ] [REMOTE ] AL: Full fetch complete (62875 records). [2025-10-09T17:09:41.862558] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-09T17:09:42.432317] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:42.443190] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-09T17:09:42.628824] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-09T17:09:42.628934] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-09T17:09:42.629541] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-09T17:09:42.629583] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-09T17:09:42.630923] [DEBUG] [LOCAL ] AL: Trimmed 62875 records to 44819 (keeping 200 days of data) [2025-10-09T17:09:42.902084] [DEBUG] [LOCAL ] AL: Primary data saved (44819 records). [2025-10-09T17:09:42.902244] [INFO ] [MAIN ] AL: Full history saved. [2025-10-09T17:09:42.902332] [INFO ] [MAIN ] Update Progress: 77/2373 symbols completed. AL took 34.5s. Estimated remaining: 4h 47m 55s. Rate: 8.0 symbols/min [2025-10-09T17:09:42.971361] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-09T17:09:43.196733] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-09T17:09:43.326075] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T17:09:43.457268] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:09:43.996778] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-09T17:09:44.796742] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-09T17:09:45.549226] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T17:09:45.605226] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-09T17:09:45.608210] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-09T17:09:46.091917] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T17:09:46.396797] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-09T17:09:47.001243] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T17:09:47.196740] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-09T17:09:47.996773] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-09T17:09:48.581857] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:09:48.664114] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-09T17:09:48.781533] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T17:09:48.796681] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-09T17:09:49.596766] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-09T17:09:50.396704] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-09T17:09:50.712449] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:09:51.196736] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-09T17:09:51.414328] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T17:09:51.712740] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-09T17:09:51.996761] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-09T17:09:52.728173] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T17:09:52.796685] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-09T17:09:53.276724] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T17:09:53.596718] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-09T17:09:54.321893] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T17:09:54.396745] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-09T17:09:54.811301] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T17:09:55.196733] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-09T17:09:55.996791] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-09T17:09:56.938503] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:09:56.953900] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-09T17:09:56.984675] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:09:57.007454] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-09T17:09:57.012739] [INFO ] [REMOTE ] ALB: Full fetch complete (76892 records). [2025-10-09T17:09:57.012921] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-09T17:09:57.456313] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-09T17:09:57.456458] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-09T17:09:57.457790] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-09T17:09:57.457917] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-09T17:09:57.460484] [DEBUG] [LOCAL ] ALB: Trimmed 76892 records to 53678 (keeping 200 days of data) [2025-10-09T17:09:57.596899] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-09T17:09:57.836773] [DEBUG] [LOCAL ] ALB: Primary data saved (53678 records). [2025-10-09T17:09:57.836979] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-09T17:09:57.837667] [INFO ] [MAIN ] Update Progress: 78/2373 symbols completed. ALB took 41.9s. Estimated remaining: 4h 51m 26s. Rate: 7.9 symbols/min [2025-10-09T17:09:58.598744] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T17:09:58.610422] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-09T17:09:59.162734] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:09:59.196795] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-09T17:10:00.360734] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:10:00.372219] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-09T17:10:00.778006] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T17:10:00.796686] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-09T17:10:05.957563] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (5.59 seconds). [2025-10-09T17:10:05.962104] [INFO ] [REMOTE ] ALC: Full fetch complete (73181 records). [2025-10-09T17:10:05.962228] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-09T17:10:06.374002] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (5.58 seconds). [2025-10-09T17:10:06.423558] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-09T17:10:06.424502] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-09T17:10:06.424562] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-09T17:10:06.425507] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-09T17:10:06.425586] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-09T17:10:06.427238] [DEBUG] [LOCAL ] ALC: Trimmed 73181 records to 51409 (keeping 200 days of data) [2025-10-09T17:10:06.750023] [DEBUG] [LOCAL ] ALC: Primary data saved (51409 records). [2025-10-09T17:10:06.750169] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-09T17:10:06.751149] [INFO ] [MAIN ] Update Progress: 79/2373 symbols completed. ALC took 26.9s. Estimated remaining: 4h 51m 56s. Rate: 7.9 symbols/min [2025-10-09T17:10:07.851606] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:10:07.855079] [INFO ] [REMOTE ] ALE: Full fetch complete (43414 records). [2025-10-09T17:10:07.855171] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-09T17:10:08.224456] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-09T17:10:08.224533] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-09T17:10:08.225193] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-09T17:10:08.225257] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-09T17:10:08.226248] [DEBUG] [LOCAL ] ALE: Trimmed 43414 records to 31566 (keeping 200 days of data) [2025-10-09T17:10:08.418800] [DEBUG] [LOCAL ] ALE: Primary data saved (31566 records). [2025-10-09T17:10:08.418938] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-09T17:10:08.419834] [INFO ] [MAIN ] Update Progress: 80/2373 symbols completed. ALE took 27.0s. Estimated remaining: 4h 48m 57s. Rate: 7.9 symbols/min [2025-10-09T17:10:08.991588] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:09.001958] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:09.139285] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:09.184574] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:09.185483] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-09T17:10:09.185592] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-09T17:10:09.185772] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-09T17:10:09.185827] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-09T17:10:09.185879] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-09T17:10:09.185919] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-09T17:10:09.356553] [DEBUG] [LOCAL ] ALG: Loaded 9862 existing records from primary storage. [2025-10-09T17:10:09.384935] [INFO ] [MAIN ] ALG: Loaded 9862 existing records. [2025-10-09T17:10:09.422581] [DEBUG] [LOCAL ] ALEX: Loaded 31184 existing records from primary storage. [2025-10-09T17:10:09.476211] [INFO ] [MAIN ] ALEX: Loaded 31184 existing records. [2025-10-09T17:10:09.692968] [DEBUG] [LOCAL ] ALIT: Loaded 52779 existing records from primary storage. [2025-10-09T17:10:09.726874] [INFO ] [MAIN ] ALIT: Loaded 52779 existing records. [2025-10-09T17:10:10.365476] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:10.412690] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-09T17:10:10.431824] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:10.418137] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-09T17:10:10.507681] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-09T17:10:10.508426] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-09T17:10:10.562042] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:10.556113] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-09T17:10:10.559181] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:10.562284] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-09T17:10:10.562711] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-09T17:10:10.562940] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-09T17:10:10.563037] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-09T17:10:10.562545] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-09T17:10:10.563149] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-09T17:10:10.656698] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-09T17:10:10.663683] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-09T17:10:11.006786] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:10:11.195968] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-09T17:10:11.310919] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:10:11.380277] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-09T17:10:11.411464] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:10:11.430982] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-09T17:10:11.518161] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-09T17:10:11.667778] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:11.688575] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-09T17:10:11.592401] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-09T17:10:11.702676] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-09T17:10:11.706911] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:11.728839] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-09T17:10:11.727775] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:11.727927] [INFO ] [MAIN ] Update Progress: 81/2373 symbols completed. ALH took 3.3s. Estimated remaining: 4h 46m 49s. Rate: 8.0 symbols/min [2025-10-09T17:10:11.731187] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-09T17:10:11.908674] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:11.959339] [DEBUG] [LOCAL ] ALK: Loaded 53058 existing records from primary storage. [2025-10-09T17:10:11.959699] [INFO ] [MAIN ] ALK: Loaded 53058 existing records. [2025-10-09T17:10:12.132254] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:12.132494] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-09T17:10:12.132541] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-09T17:10:12.132789] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-09T17:10:12.132847] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-09T17:10:12.479619] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:12.479980] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-09T17:10:13.053964] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:10:13.056867] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-09T17:10:13.309079] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:10:13.343819] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-09T17:10:13.346453] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:10:13.357037] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-09T17:10:13.961216] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T17:10:13.964211] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-09T17:10:14.417206] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:10:14.424795] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-09T17:10:15.034714] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:10:15.052223] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-09T17:10:15.053784] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T17:10:15.056854] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-09T17:10:15.102816] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-09T17:10:15.113549] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-09T17:10:15.234247] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T17:10:15.239778] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-09T17:10:16.221170] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:10:16.224902] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-09T17:10:16.675078] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T17:10:16.716445] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-09T17:10:16.719101] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:10:16.727130] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-09T17:10:16.990498] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T17:10:17.001296] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-09T17:10:17.143280] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T17:10:17.146327] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-09T17:10:17.864049] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T17:10:17.866797] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-09T17:10:17.949034] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:10:18.396694] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-09T17:10:18.440940] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T17:10:18.728023] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:10:18.768991] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T17:10:19.196743] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-09T17:10:19.334106] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T17:10:19.996724] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-09T17:10:20.796767] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-09T17:10:20.942370] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:10:21.007432] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:10:21.272614] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T17:10:21.596730] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-09T17:10:22.396769] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-09T17:10:23.147633] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T17:10:23.196677] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-09T17:10:23.456830] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T17:10:23.912402] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T17:10:23.996728] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-09T17:10:24.796754] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-09T17:10:25.413518] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:10:25.489825] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:10:25.490950] [INFO ] [REMOTE ] ALG: Full fetch complete (15615 records). [2025-10-09T17:10:25.491020] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-09T17:10:25.598747] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-09T17:10:25.860591] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-09T17:10:25.860694] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-09T17:10:25.860948] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-09T17:10:25.860989] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-09T17:10:25.861453] [DEBUG] [LOCAL ] ALG: Trimmed 15615 records to 9904 (keeping 200 days of data) [2025-10-09T17:10:25.924568] [DEBUG] [LOCAL ] ALG: Primary data saved (9904 records). [2025-10-09T17:10:25.924727] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-09T17:10:25.924816] [INFO ] [MAIN ] Update Progress: 82/2373 symbols completed. ALG took 17.5s. Estimated remaining: 4h 49m 48s. Rate: 7.9 symbols/min [2025-10-09T17:10:26.103800] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:26.152446] [DEBUG] [LOCAL ] ALL: Loaded 49900 existing records from primary storage. [2025-10-09T17:10:26.152785] [INFO ] [MAIN ] ALL: Loaded 49900 existing records. [2025-10-09T17:10:26.339393] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:26.339675] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-09T17:10:26.339735] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-09T17:10:26.339992] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-09T17:10:26.340049] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-09T17:10:26.406395] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-09T17:10:26.693497] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:27.196814] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-09T17:10:27.291487] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T17:10:27.785868] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:10:27.996687] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-09T17:10:28.331113] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T17:10:28.796718] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-09T17:10:29.596688] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-09T17:10:29.743765] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T17:10:30.226678] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:10:30.396719] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-09T17:10:30.888729] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T17:10:31.196751] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-09T17:10:31.996726] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-09T17:10:32.332157] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T17:10:32.796748] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-09T17:10:33.029720] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T17:10:33.033216] [INFO ] [REMOTE ] ALEX: Full fetch complete (44703 records). [2025-10-09T17:10:33.033440] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-09T17:10:33.152522] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T17:10:33.447898] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-09T17:10:33.448015] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-09T17:10:33.448554] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-09T17:10:33.448596] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-09T17:10:33.449603] [DEBUG] [LOCAL ] ALEX: Trimmed 44703 records to 31426 (keeping 200 days of data) [2025-10-09T17:10:33.602154] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-09T17:10:33.643388] [DEBUG] [LOCAL ] ALEX: Primary data saved (31426 records). [2025-10-09T17:10:33.643526] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-09T17:10:33.643621] [INFO ] [MAIN ] Update Progress: 83/2373 symbols completed. ALEX took 25.2s. Estimated remaining: 4h 49m 44s. Rate: 7.9 symbols/min [2025-10-09T17:10:33.829535] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:33.875371] [DEBUG] [LOCAL ] ALLE: Loaded 44372 existing records from primary storage. [2025-10-09T17:10:33.875783] [INFO ] [MAIN ] ALLE: Loaded 44372 existing records. [2025-10-09T17:10:34.050177] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:34.050443] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-09T17:10:34.050490] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-09T17:10:34.050902] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-09T17:10:34.050959] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-09T17:10:34.399868] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-09T17:10:34.436846] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:34.568289] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T17:10:35.196691] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-09T17:10:35.362709] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:10:35.996744] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-09T17:10:36.136789] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T17:10:36.506049] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:10:36.796739] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-09T17:10:37.596743] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-09T17:10:37.719755] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T17:10:38.396711] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-09T17:10:38.679045] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T17:10:39.196694] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-09T17:10:39.512745] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T17:10:39.996721] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-09T17:10:40.195340] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T17:10:40.566436] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T17:10:40.796737] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-09T17:10:41.596749] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-09T17:10:42.059963] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T17:10:42.122895] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T17:10:42.396720] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-09T17:10:43.196691] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-09T17:10:43.432812] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T17:10:43.437365] [INFO ] [REMOTE ] ALK: Full fetch complete (76836 records). [2025-10-09T17:10:43.437473] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-09T17:10:43.844062] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-09T17:10:43.844250] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-09T17:10:43.845426] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-09T17:10:43.845539] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-09T17:10:43.847207] [DEBUG] [LOCAL ] ALK: Trimmed 76836 records to 53447 (keeping 200 days of data) [2025-10-09T17:10:44.012188] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-09T17:10:44.089277] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T17:10:44.205310] [DEBUG] [LOCAL ] ALK: Primary data saved (53447 records). [2025-10-09T17:10:44.205478] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-09T17:10:44.206418] [INFO ] [MAIN ] Update Progress: 84/2373 symbols completed. ALK took 32.5s. Estimated remaining: 4h 50m 58s. Rate: 7.9 symbols/min [2025-10-09T17:10:44.388067] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:44.440666] [DEBUG] [LOCAL ] ALLY: Loaded 53228 existing records from primary storage. [2025-10-09T17:10:44.441016] [INFO ] [MAIN ] ALLY: Loaded 53228 existing records. [2025-10-09T17:10:44.617558] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:44.617940] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-09T17:10:44.618029] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-09T17:10:44.618414] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-09T17:10:44.618472] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-09T17:10:44.809711] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-09T17:10:44.978090] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:45.024041] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T17:10:45.602472] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-09T17:10:45.604220] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:10:46.396737] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-09T17:10:46.489745] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:10:47.196716] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-09T17:10:47.452372] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-09T17:10:47.996735] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-09T17:10:48.064398] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T17:10:48.796740] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-09T17:10:48.994255] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:10:49.411816] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T17:10:49.417077] [INFO ] [REMOTE ] ALIT: Full fetch complete (76440 records). [2025-10-09T17:10:49.417234] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-09T17:10:49.599786] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-09T17:10:49.825305] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-09T17:10:49.825400] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-09T17:10:49.826162] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-09T17:10:49.826232] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-09T17:10:49.827799] [DEBUG] [LOCAL ] ALIT: Trimmed 76440 records to 53167 (keeping 200 days of data) [2025-10-09T17:10:50.135903] [DEBUG] [LOCAL ] ALIT: Primary data saved (53167 records). [2025-10-09T17:10:50.136045] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-09T17:10:50.137170] [INFO ] [MAIN ] Update Progress: 85/2373 symbols completed. ALIT took 41.7s. Estimated remaining: 4h 50m 5s. Rate: 7.9 symbols/min [2025-10-09T17:10:50.338065] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:50.382180] [DEBUG] [LOCAL ] ALSN: Loaded 43352 existing records from primary storage. [2025-10-09T17:10:50.382476] [INFO ] [MAIN ] ALSN: Loaded 43352 existing records. [2025-10-09T17:10:50.414254] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-09T17:10:50.569061] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:50.569381] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-09T17:10:50.569489] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-09T17:10:50.569781] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-09T17:10:50.569841] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-09T17:10:50.962122] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:50.975814] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-09T17:10:51.019574] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:10:51.196697] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-09T17:10:51.983031] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T17:10:51.996672] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-09T17:10:52.796743] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-09T17:10:53.126494] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-09T17:10:53.267553] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T17:10:53.596742] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-09T17:10:54.406379] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-09T17:10:54.409295] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T17:10:55.196689] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-09T17:10:55.278260] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T17:10:55.998184] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-09T17:10:56.003935] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T17:10:56.796711] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-09T17:10:56.851517] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T17:10:57.306308] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T17:10:57.596745] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-09T17:10:58.396715] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-09T17:10:58.457552] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:10:59.039147] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T17:10:59.196808] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-09T17:10:59.996755] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-09T17:11:00.033985] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T17:11:00.038091] [INFO ] [REMOTE ] ALL: Full fetch complete (72341 records). [2025-10-09T17:11:00.038222] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-09T17:11:00.440908] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-09T17:11:00.440990] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-09T17:11:00.441737] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-09T17:11:00.441839] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-09T17:11:00.443237] [DEBUG] [LOCAL ] ALL: Trimmed 72341 records to 50206 (keeping 200 days of data) [2025-10-09T17:11:00.766948] [DEBUG] [LOCAL ] ALL: Primary data saved (50206 records). [2025-10-09T17:11:00.767092] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-09T17:11:00.768123] [INFO ] [MAIN ] Update Progress: 86/2373 symbols completed. ALL took 34.8s. Estimated remaining: 4h 51m 17s. Rate: 7.9 symbols/min [2025-10-09T17:11:00.799903] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-09T17:11:00.940095] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:00.963577] [DEBUG] [LOCAL ] ALTG: Loaded 23572 existing records from primary storage. [2025-10-09T17:11:00.963870] [INFO ] [MAIN ] ALTG: Loaded 23572 existing records. [2025-10-09T17:11:01.153764] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:01.154110] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-09T17:11:01.154290] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-09T17:11:01.154603] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-09T17:11:01.154708] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-09T17:11:01.286771] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T17:11:01.602021] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-09T17:11:01.651195] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:02.290846] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-09T17:11:02.396715] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-09T17:11:02.445701] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T17:11:02.708233] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T17:11:02.711932] [INFO ] [REMOTE ] ALLE: Full fetch complete (64222 records). [2025-10-09T17:11:02.712142] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-09T17:11:02.713282] [FATAL] [VALIDATOR ] ALLE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:11:02.713438] [FATAL] [MAIN ] ALLE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:11:02.713489] [WARN ] [MAIN ] ALLE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:11:02.713544] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-09T17:11:02.713622] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-09T17:11:02.713708] [INFO ] [LOCAL ] ALLE: Starting deletion of derivative data. [2025-10-09T17:11:02.714088] [DEBUG] [LOCAL ] ALLE: Deleted derivative data file. [2025-10-09T17:11:02.714199] [INFO ] [MAIN ] Update Progress: 87/2373 symbols completed. ALLE took 29.1s. Estimated remaining: 4h 48m 40s. Rate: 7.9 symbols/min [2025-10-09T17:11:02.907244] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:02.920535] [DEBUG] [LOCAL ] ALUR: Loaded 10405 existing records from primary storage. [2025-10-09T17:11:02.920875] [INFO ] [MAIN ] ALUR: Loaded 10405 existing records. [2025-10-09T17:11:03.124386] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:03.124719] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-09T17:11:03.124784] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-09T17:11:03.125053] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-09T17:11:03.125112] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-09T17:11:03.198528] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-09T17:11:03.528457] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:11:03.564870] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:03.996747] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-09T17:11:04.796744] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-09T17:11:04.997819] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T17:11:05.027224] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T17:11:05.596733] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-09T17:11:06.281103] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T17:11:06.396738] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-09T17:11:06.952860] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T17:11:07.196723] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-09T17:11:07.678737] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T17:11:07.996684] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-09T17:11:08.237830] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T17:11:08.796683] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-09T17:11:09.157915] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T17:11:09.596772] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-09T17:11:10.388233] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:11:10.398997] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-09T17:11:10.413402] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T17:11:11.196712] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-09T17:11:11.996684] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-09T17:11:12.078611] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T17:11:12.381282] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T17:11:12.796767] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-09T17:11:13.371809] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:11:13.596773] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-09T17:11:14.110423] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T17:11:14.395346] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T17:11:14.398098] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-09T17:11:15.196698] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-09T17:11:15.802574] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:11:15.996719] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-09T17:11:16.124419] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T17:11:16.796712] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-09T17:11:17.596725] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-09T17:11:17.815255] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T17:11:17.949409] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T17:11:18.077460] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T17:11:18.396751] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-09T17:11:19.196789] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-09T17:11:19.996696] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-09T17:11:20.019372] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T17:11:20.023859] [INFO ] [REMOTE ] ALLY: Full fetch complete (76949 records). [2025-10-09T17:11:20.023975] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-09T17:11:20.363530] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T17:11:20.461105] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-09T17:11:20.461198] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-09T17:11:20.462063] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-09T17:11:20.462132] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-09T17:11:20.463820] [DEBUG] [LOCAL ] ALLY: Trimmed 76949 records to 53617 (keeping 200 days of data) [2025-10-09T17:11:20.812172] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-09T17:11:20.842264] [DEBUG] [LOCAL ] ALLY: Primary data saved (53617 records). [2025-10-09T17:11:20.842430] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-09T17:11:20.843332] [INFO ] [MAIN ] Update Progress: 88/2373 symbols completed. ALLY took 36.6s. Estimated remaining: 4h 53m 6s. Rate: 7.8 symbols/min [2025-10-09T17:11:20.991557] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T17:11:21.074188] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:21.126092] [DEBUG] [LOCAL ] ALV: Loaded 42086 existing records from primary storage. [2025-10-09T17:11:21.126437] [INFO ] [MAIN ] ALV: Loaded 42086 existing records. [2025-10-09T17:11:21.312830] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:21.313817] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-09T17:11:21.313866] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-09T17:11:21.314183] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-09T17:11:21.314240] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-09T17:11:21.602058] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-09T17:11:21.694549] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:21.708548] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T17:11:22.396782] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-09T17:11:22.432990] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T17:11:23.196686] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-09T17:11:23.392572] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T17:11:23.996756] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-09T17:11:24.623078] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:11:24.796749] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-09T17:11:25.137113] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T17:11:25.291759] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T17:11:25.596938] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-09T17:11:26.396773] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-09T17:11:27.091878] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:11:27.196713] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-09T17:11:27.542520] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T17:11:27.996724] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-09T17:11:28.712810] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:11:28.796740] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-09T17:11:29.096622] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T17:11:29.596757] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-09T17:11:30.349672] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:11:30.396723] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-09T17:11:31.204804] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-09T17:11:31.221692] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T17:11:31.499522] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:11:31.501759] [INFO ] [REMOTE ] ALTG: Full fetch complete (33541 records). [2025-10-09T17:11:31.501830] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-09T17:11:31.875781] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-09T17:11:31.875858] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-09T17:11:31.876228] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-09T17:11:31.876266] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-09T17:11:31.877243] [DEBUG] [LOCAL ] ALTG: Trimmed 33541 records to 23737 (keeping 200 days of data) [2025-10-09T17:11:31.964995] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T17:11:31.967346] [INFO ] [REMOTE ] ALUR: Full fetch complete (19922 records). [2025-10-09T17:11:31.968464] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-09T17:11:31.997925] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-09T17:11:32.414376] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-09T17:11:32.415908] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-09T17:11:32.417695] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-09T17:11:32.418094] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-09T17:11:32.418824] [DEBUG] [LOCAL ] ALTG: Primary data saved (23737 records). [2025-10-09T17:11:32.419161] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-09T17:11:32.419269] [INFO ] [MAIN ] Update Progress: 89/2373 symbols completed. ALTG took 31.7s. Estimated remaining: 4h 54m 38s. Rate: 7.8 symbols/min [2025-10-09T17:11:32.419712] [DEBUG] [LOCAL ] ALUR: Trimmed 19922 records to 10452 (keeping 200 days of data) [2025-10-09T17:11:32.627255] [DEBUG] [LOCAL ] ALUR: Primary data saved (10452 records). [2025-10-09T17:11:32.643743] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-09T17:11:32.644748] [INFO ] [MAIN ] Update Progress: 90/2373 symbols completed. ALUR took 29.9s. Estimated remaining: 4h 51m 20s. Rate: 7.8 symbols/min [2025-10-09T17:11:32.700601] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:32.799868] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-09T17:11:32.823075] [DEBUG] [LOCAL ] ALX: Loaded 6520 existing records from primary storage. [2025-10-09T17:11:32.854327] [INFO ] [MAIN ] ALX: Loaded 6520 existing records. [2025-10-09T17:11:32.853815] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:33.058791] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:33.059104] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-09T17:11:33.059158] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-09T17:11:33.059392] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-09T17:11:33.059452] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-09T17:11:33.194247] [DEBUG] [LOCAL ] AM: Loaded 51994 existing records from primary storage. [2025-10-09T17:11:33.228993] [INFO ] [MAIN ] AM: Loaded 51994 existing records. [2025-10-09T17:11:33.595063] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:33.605723] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-09T17:11:33.610953] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-09T17:11:33.638750] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-09T17:11:33.645490] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-09T17:11:33.695764] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:33.740600] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-09T17:11:34.076746] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:34.077940] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T17:11:34.396735] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-09T17:11:34.404723] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T17:11:34.576026] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T17:11:35.196732] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-09T17:11:35.996729] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-09T17:11:36.036375] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:11:36.489615] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T17:11:36.796717] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-09T17:11:37.538498] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T17:11:37.596768] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-09T17:11:38.308925] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:11:38.396738] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-09T17:11:38.946357] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T17:11:38.950353] [INFO ] [REMOTE ] ALSN: Full fetch complete (62252 records). [2025-10-09T17:11:38.950477] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-09T17:11:39.204688] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-09T17:11:39.353114] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-09T17:11:39.353192] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-09T17:11:39.353826] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-09T17:11:39.353888] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-09T17:11:39.355123] [DEBUG] [LOCAL ] ALSN: Trimmed 62252 records to 43701 (keeping 200 days of data) [2025-10-09T17:11:39.623195] [DEBUG] [LOCAL ] ALSN: Primary data saved (43701 records). [2025-10-09T17:11:39.623322] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-09T17:11:39.624455] [INFO ] [MAIN ] Update Progress: 91/2373 symbols completed. ALSN took 49.5s. Estimated remaining: 4h 50m 55s. Rate: 7.8 symbols/min [2025-10-09T17:11:39.795366] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:39.840267] [DEBUG] [LOCAL ] AMBC: Loaded 36338 existing records from primary storage. [2025-10-09T17:11:39.840524] [INFO ] [MAIN ] AMBC: Loaded 36338 existing records. [2025-10-09T17:11:40.001431] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-09T17:11:40.026878] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:40.027169] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-09T17:11:40.028033] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-09T17:11:40.028442] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-09T17:11:40.028597] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-09T17:11:40.220294] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T17:11:40.448610] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:40.524874] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T17:11:40.796728] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-09T17:11:40.867218] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T17:11:41.316614] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-09T17:11:41.596711] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-09T17:11:42.396738] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-09T17:11:43.170026] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T17:11:43.196666] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-09T17:11:43.996722] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-09T17:11:44.037318] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T17:11:44.555621] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:11:44.796725] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-09T17:11:45.596755] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-09T17:11:45.927289] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:11:46.056719] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T17:11:46.396686] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-09T17:11:46.746282] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T17:11:46.894971] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T17:11:47.196704] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-09T17:11:47.996724] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-09T17:11:48.796729] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-09T17:11:49.031570] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T17:11:49.159843] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:11:49.330864] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T17:11:49.596736] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-09T17:11:50.396709] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-09T17:11:50.475195] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T17:11:51.196778] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-09T17:11:51.850261] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T17:11:51.853789] [INFO ] [REMOTE ] ALV: Full fetch complete (61732 records). [2025-10-09T17:11:51.853937] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-09T17:11:52.005951] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-09T17:11:52.208448] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:11:52.261862] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-09T17:11:52.261965] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-09T17:11:52.262686] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-09T17:11:52.262757] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-09T17:11:52.264413] [DEBUG] [LOCAL ] ALV: Trimmed 61732 records to 42387 (keeping 200 days of data) [2025-10-09T17:11:52.545618] [DEBUG] [LOCAL ] ALV: Primary data saved (42387 records). [2025-10-09T17:11:52.545781] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-09T17:11:52.545868] [INFO ] [MAIN ] Update Progress: 92/2373 symbols completed. ALV took 31.7s. Estimated remaining: 4h 52m 58s. Rate: 7.8 symbols/min [2025-10-09T17:11:52.721148] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:52.766504] [DEBUG] [LOCAL ] AMBP: Loaded 44668 existing records from primary storage. [2025-10-09T17:11:52.766871] [INFO ] [MAIN ] AMBP: Loaded 44668 existing records. [2025-10-09T17:11:52.802051] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-09T17:11:52.947138] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:52.947369] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-09T17:11:52.947417] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-09T17:11:52.947791] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-09T17:11:52.947849] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-09T17:11:53.345952] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:53.596784] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-09T17:11:53.701244] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T17:11:53.724767] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T17:11:54.396745] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-09T17:11:54.951848] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T17:11:55.196712] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-09T17:11:55.316239] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T17:11:55.996708] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-09T17:11:56.796742] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-09T17:11:56.853790] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T17:11:57.435031] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T17:11:57.450437] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T17:11:57.596748] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-09T17:11:58.396742] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-09T17:11:59.036342] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:11:59.196718] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-09T17:11:59.885819] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:11:59.887172] [INFO ] [REMOTE ] ALX: Full fetch complete (7483 records). [2025-10-09T17:11:59.887240] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-09T17:12:00.001153] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-09T17:12:00.068073] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T17:12:00.300126] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-09T17:12:00.300239] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-09T17:12:00.300466] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-09T17:12:00.300515] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-09T17:12:00.301045] [DEBUG] [LOCAL ] ALX: Trimmed 7483 records to 6663 (keeping 200 days of data) [2025-10-09T17:12:00.351882] [DEBUG] [LOCAL ] ALX: Primary data saved (6663 records). [2025-10-09T17:12:00.352082] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-09T17:12:00.352184] [INFO ] [MAIN ] Update Progress: 93/2373 symbols completed. ALX took 27.9s. Estimated remaining: 4h 52m 53s. Rate: 7.8 symbols/min [2025-10-09T17:12:00.534954] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:00.535207] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-09T17:12:00.535261] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-09T17:12:00.535388] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-09T17:12:00.535431] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-09T17:12:00.535473] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-09T17:12:00.535508] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-09T17:12:00.805343] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-09T17:12:00.896219] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:01.505015] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T17:12:01.596675] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-09T17:12:01.814489] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:12:01.814737] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-09T17:12:01.814825] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:12:01.814906] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-09T17:12:01.814985] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:12:01.815071] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-09T17:12:01.815151] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-09T17:12:01.815220] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-09T17:12:01.815312] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-09T17:12:01.815393] [INFO ] [MAIN ] Update Progress: 94/2373 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 50m 14s. Rate: 7.9 symbols/min [2025-10-09T17:12:01.994195] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:02.046045] [DEBUG] [LOCAL ] AMC: Loaded 53761 existing records from primary storage. [2025-10-09T17:12:02.046367] [INFO ] [MAIN ] AMC: Loaded 53761 existing records. [2025-10-09T17:12:02.220683] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:02.220871] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-09T17:12:02.221003] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-09T17:12:02.221225] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-09T17:12:02.221281] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-09T17:12:02.398497] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-09T17:12:02.594027] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:02.623037] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T17:12:03.196709] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-09T17:12:03.850481] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:12:03.996737] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-09T17:12:04.796729] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-09T17:12:04.986991] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T17:12:05.596708] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-09T17:12:05.930880] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T17:12:05.961972] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T17:12:06.396730] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-09T17:12:07.196708] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-09T17:12:07.368874] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T17:12:07.996718] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-09T17:12:08.742097] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T17:12:08.796681] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-09T17:12:08.872474] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-09T17:12:09.276846] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T17:12:09.596718] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-09T17:12:09.829815] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T17:12:10.396717] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-09T17:12:11.196977] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-09T17:12:11.857925] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-09T17:12:11.964266] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T17:12:11.996795] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-09T17:12:12.796796] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-09T17:12:13.001449] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:12:13.005942] [INFO ] [REMOTE ] AM: Full fetch complete (75579 records). [2025-10-09T17:12:13.006063] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-09T17:12:13.395472] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-09T17:12:13.395556] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-09T17:12:13.396315] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-09T17:12:13.396379] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-09T17:12:13.397774] [DEBUG] [LOCAL ] AM: Trimmed 75579 records to 52383 (keeping 200 days of data) [2025-10-09T17:12:13.602448] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-09T17:12:13.667043] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T17:12:13.782111] [DEBUG] [LOCAL ] AM: Primary data saved (52383 records). [2025-10-09T17:12:13.782252] [INFO ] [MAIN ] AM: Full history saved. [2025-10-09T17:12:13.783668] [INFO ] [MAIN ] Update Progress: 95/2373 symbols completed. AM took 41.1s. Estimated remaining: 4h 51m 50s. Rate: 7.8 symbols/min [2025-10-09T17:12:13.980995] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:14.034098] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-09T17:12:14.034409] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-09T17:12:14.140780] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:12:14.153810] [INFO ] [REMOTE ] AMBC: Full fetch complete (51489 records). [2025-10-09T17:12:14.164297] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-09T17:12:14.323383] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:14.333948] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-09T17:12:14.334014] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-09T17:12:14.339724] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-09T17:12:14.352021] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-09T17:12:14.401951] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-09T17:12:14.952365] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-09T17:12:14.962784] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-09T17:12:14.981864] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-09T17:12:14.992241] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-09T17:12:15.022751] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:15.023531] [DEBUG] [LOCAL ] AMBC: Trimmed 51489 records to 36609 (keeping 200 days of data) [2025-10-09T17:12:15.220101] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-09T17:12:15.249539] [DEBUG] [LOCAL ] AMBC: Primary data saved (36609 records). [2025-10-09T17:12:15.249715] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-09T17:12:15.250534] [INFO ] [MAIN ] Update Progress: 96/2373 symbols completed. AMBC took 35.6s. Estimated remaining: 4h 49m 15s. Rate: 7.9 symbols/min [2025-10-09T17:12:15.444123] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:15.498488] [DEBUG] [LOCAL ] AME: Loaded 48717 existing records from primary storage. [2025-10-09T17:12:15.498860] [INFO ] [MAIN ] AME: Loaded 48717 existing records. [2025-10-09T17:12:15.674446] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:15.674793] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-09T17:12:15.674868] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-09T17:12:15.675259] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-09T17:12:15.675319] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-09T17:12:16.059227] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:16.062631] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-09T17:12:16.063115] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-09T17:12:16.275741] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T17:12:16.796729] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-09T17:12:16.843601] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:12:17.596691] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-09T17:12:17.773148] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T17:12:18.396781] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-09T17:12:19.196804] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-09T17:12:19.247905] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-09T17:12:19.328417] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T17:12:20.006518] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-09T17:12:20.009271] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T17:12:20.771324] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:12:20.796691] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-09T17:12:21.596685] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-09T17:12:21.754130] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T17:12:22.389118] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:12:22.397844] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-09T17:12:23.196754] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-09T17:12:23.707579] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T17:12:23.864809] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T17:12:23.996724] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-09T17:12:24.796771] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-09T17:12:25.023978] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T17:12:25.348236] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:12:25.596765] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-09T17:12:26.396757] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-09T17:12:27.130255] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T17:12:27.134668] [INFO ] [REMOTE ] AMBP: Full fetch complete (65397 records). [2025-10-09T17:12:27.134861] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-09T17:12:27.198304] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-09T17:12:27.460468] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-09T17:12:27.572468] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-09T17:12:27.572545] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-09T17:12:27.573213] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-09T17:12:27.573276] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-09T17:12:27.574585] [DEBUG] [LOCAL ] AMBP: Trimmed 65397 records to 44975 (keeping 200 days of data) [2025-10-09T17:12:27.812295] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T17:12:27.873714] [DEBUG] [LOCAL ] AMBP: Primary data saved (44975 records). [2025-10-09T17:12:27.873838] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-09T17:12:27.873912] [INFO ] [MAIN ] Update Progress: 97/2373 symbols completed. AMBP took 35.3s. Estimated remaining: 4h 51m 5s. Rate: 7.8 symbols/min [2025-10-09T17:12:28.009691] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-09T17:12:28.041116] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:28.062008] [DEBUG] [LOCAL ] AMG: Loaded 20177 existing records from primary storage. [2025-10-09T17:12:28.062257] [INFO ] [MAIN ] AMG: Loaded 20177 existing records. [2025-10-09T17:12:28.241353] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:28.241541] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-09T17:12:28.241589] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-09T17:12:28.241812] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-09T17:12:28.241870] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-09T17:12:28.583189] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:28.796668] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-09T17:12:29.199702] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T17:12:29.596744] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-09T17:12:29.831310] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:12:29.951921] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:12:30.396747] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-09T17:12:31.196676] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-09T17:12:31.317492] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:12:31.913220] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T17:12:31.996669] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-09T17:12:32.508234] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T17:12:32.796737] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-09T17:12:33.596733] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-09T17:12:34.243329] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T17:12:34.396710] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-09T17:12:34.451239] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-09T17:12:34.475396] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T17:12:35.196754] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-09T17:12:35.775803] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:12:35.996679] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-09T17:12:36.313102] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T17:12:36.796810] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-09T17:12:37.596772] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-09T17:12:37.847313] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T17:12:38.396742] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-09T17:12:38.486329] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T17:12:38.539527] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T17:12:39.196755] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-09T17:12:39.996761] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-09T17:12:40.759981] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-09T17:12:40.796680] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-09T17:12:41.089181] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T17:12:41.596732] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-09T17:12:41.737312] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:12:42.396749] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-09T17:12:43.094940] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:12:43.202763] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-09T17:12:43.222192] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-09T17:12:43.996706] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-09T17:12:44.209590] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T17:12:44.485310] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T17:12:44.489507] [INFO ] [REMOTE ] AME: Full fetch complete (69903 records). [2025-10-09T17:12:44.489630] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-09T17:12:44.801804] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-09T17:12:44.876998] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-09T17:12:44.877091] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-09T17:12:44.877788] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-09T17:12:44.877851] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-09T17:12:44.879359] [DEBUG] [LOCAL ] AME: Trimmed 69903 records to 49074 (keeping 200 days of data) [2025-10-09T17:12:45.191165] [DEBUG] [LOCAL ] AME: Primary data saved (49074 records). [2025-10-09T17:12:45.191302] [INFO ] [MAIN ] AME: Full history saved. [2025-10-09T17:12:45.193079] [INFO ] [MAIN ] Update Progress: 98/2373 symbols completed. AME took 29.9s. Estimated remaining: 4h 54m 41s. Rate: 7.7 symbols/min [2025-10-09T17:12:45.359659] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:45.410096] [DEBUG] [LOCAL ] AMH: Loaded 51757 existing records from primary storage. [2025-10-09T17:12:45.410396] [INFO ] [MAIN ] AMH: Loaded 51757 existing records. [2025-10-09T17:12:45.587419] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:45.587603] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-09T17:12:45.587681] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-09T17:12:45.588008] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-09T17:12:45.588068] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-09T17:12:45.620179] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-09T17:12:45.949996] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:46.130019] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T17:12:46.342512] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-09T17:12:46.346974] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-10-09T17:12:46.347085] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-09T17:12:46.409207] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-09T17:12:46.742784] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-09T17:12:46.742921] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-09T17:12:46.743735] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-09T17:12:46.743803] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-09T17:12:46.745301] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54151 (keeping 200 days of data) [2025-10-09T17:12:47.052150] [DEBUG] [LOCAL ] AMC: Primary data saved (54151 records). [2025-10-09T17:12:47.052297] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-09T17:12:47.053679] [INFO ] [MAIN ] Update Progress: 99/2373 symbols completed. AMC took 45.2s. Estimated remaining: 4h 52m 17s. Rate: 7.8 symbols/min [2025-10-09T17:12:47.222925] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:47.205413] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-09T17:12:47.264172] [DEBUG] [LOCAL ] AMN: Loaded 41756 existing records from primary storage. [2025-10-09T17:12:47.264450] [INFO ] [MAIN ] AMN: Loaded 41756 existing records. [2025-10-09T17:12:47.440126] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:47.440554] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-09T17:12:47.440625] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-09T17:12:47.440959] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-09T17:12:47.441017] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-09T17:12:47.796479] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:47.826828] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-09T17:12:47.996693] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-09T17:12:48.160806] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:12:48.222023] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T17:12:48.796774] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-09T17:12:49.599440] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-09T17:12:49.604490] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T17:12:50.396746] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-09T17:12:50.752901] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T17:12:50.757519] [INFO ] [REMOTE ] AMCR: Full fetch complete (77680 records). [2025-10-09T17:12:50.757713] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-09T17:12:51.195189] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-09T17:12:51.195418] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-09T17:12:51.196459] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-09T17:12:51.196564] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-09T17:12:51.196965] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-09T17:12:51.199793] [DEBUG] [LOCAL ] AMCR: Trimmed 77680 records to 54059 (keeping 200 days of data) [2025-10-09T17:12:51.324218] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:12:51.480823] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:12:51.610533] [DEBUG] [LOCAL ] AMCR: Primary data saved (54059 records). [2025-10-09T17:12:51.610829] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-09T17:12:51.610942] [INFO ] [MAIN ] Update Progress: 100/2373 symbols completed. AMCR took 37.8s. Estimated remaining: 4h 50m 58s. Rate: 7.8 symbols/min [2025-10-09T17:12:51.792265] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:51.830944] [DEBUG] [LOCAL ] AMP: Loaded 31938 existing records from primary storage. [2025-10-09T17:12:51.831322] [INFO ] [MAIN ] AMP: Loaded 31938 existing records. [2025-10-09T17:12:51.998485] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-09T17:12:52.022871] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:52.023333] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-09T17:12:52.023388] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-09T17:12:52.023680] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-09T17:12:52.023744] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-09T17:12:52.408367] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:52.430685] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T17:12:52.796786] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-09T17:12:53.529966] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T17:12:53.596680] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-09T17:12:54.134733] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:12:54.396743] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-09T17:12:55.196702] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-09T17:12:55.413287] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T17:12:55.446970] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:12:55.996735] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-09T17:12:56.796796] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-09T17:12:56.835603] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:12:57.596724] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-09T17:12:57.686870] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T17:12:58.051814] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T17:12:58.396716] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-09T17:12:58.805555] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T17:12:59.196726] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-09T17:12:59.996686] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-09T17:13:00.064889] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T17:13:00.173992] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T17:13:00.175886] [INFO ] [REMOTE ] AMG: Full fetch complete (29709 records). [2025-10-09T17:13:00.175956] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-09T17:13:00.538737] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-09T17:13:00.538840] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-09T17:13:00.539239] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-09T17:13:00.539281] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-09T17:13:00.540165] [DEBUG] [LOCAL ] AMG: Trimmed 29709 records to 20269 (keeping 200 days of data) [2025-10-09T17:13:00.665787] [DEBUG] [LOCAL ] AMG: Primary data saved (20269 records). [2025-10-09T17:13:00.665909] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-09T17:13:00.665983] [INFO ] [MAIN ] Update Progress: 101/2373 symbols completed. AMG took 32.8s. Estimated remaining: 4h 51m 21s. Rate: 7.8 symbols/min [2025-10-09T17:13:00.801788] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-09T17:13:00.848531] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:00.898195] [DEBUG] [LOCAL ] AMPX: Loaded 52318 existing records from primary storage. [2025-10-09T17:13:00.898500] [INFO ] [MAIN ] AMPX: Loaded 52318 existing records. [2025-10-09T17:13:01.073853] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:01.074108] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-09T17:13:01.074168] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-09T17:13:01.074417] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-09T17:13:01.074474] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-09T17:13:01.436149] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:01.465520] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:13:01.596727] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-09T17:13:02.354915] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:13:02.396739] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-09T17:13:03.148159] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T17:13:03.196715] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-09T17:13:03.996742] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-09T17:13:04.172080] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T17:13:04.320891] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T17:13:04.796726] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-09T17:13:05.163431] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:13:05.596698] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-09T17:13:06.371404] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:13:06.396675] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-09T17:13:07.196677] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-09T17:13:07.290195] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T17:13:07.996684] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-09T17:13:08.152848] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:13:08.796730] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-09T17:13:08.838272] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T17:13:09.559438] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:13:09.596664] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-09T17:13:10.380848] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T17:13:10.396731] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-09T17:13:11.196702] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-09T17:13:11.342934] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:13:11.821542] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:13:11.996755] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-09T17:13:12.796741] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-09T17:13:12.942394] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:13:13.596714] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-09T17:13:13.708310] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T17:13:14.396741] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-09T17:13:14.732940] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T17:13:15.003353] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T17:13:15.007788] [INFO ] [REMOTE ] AMH: Full fetch complete (74817 records). [2025-10-09T17:13:15.007895] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-09T17:13:15.204186] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-09T17:13:15.400703] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-09T17:13:15.400796] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-09T17:13:15.401521] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-09T17:13:15.401564] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-09T17:13:15.403066] [DEBUG] [LOCAL ] AMH: Trimmed 74817 records to 52145 (keeping 200 days of data) [2025-10-09T17:13:15.730325] [DEBUG] [LOCAL ] AMH: Primary data saved (52145 records). [2025-10-09T17:13:15.730477] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-09T17:13:15.731370] [INFO ] [MAIN ] Update Progress: 102/2373 symbols completed. AMH took 30.5s. Estimated remaining: 4h 53m 58s. Rate: 7.7 symbols/min [2025-10-09T17:13:15.906241] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:15.943977] [DEBUG] [LOCAL ] AMPY: Loaded 38587 existing records from primary storage. [2025-10-09T17:13:15.944282] [INFO ] [MAIN ] AMPY: Loaded 38587 existing records. [2025-10-09T17:13:16.006614] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-09T17:13:16.124117] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:16.124497] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-09T17:13:16.124573] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-09T17:13:16.124848] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-09T17:13:16.124909] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-09T17:13:16.513796] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-09T17:13:16.519751] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:16.796724] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-09T17:13:16.842803] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T17:13:17.596750] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-09T17:13:17.701356] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T17:13:18.063432] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:13:18.396729] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-09T17:13:18.987776] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:13:18.991438] [INFO ] [REMOTE ] AMN: Full fetch complete (60320 records). [2025-10-09T17:13:18.991529] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-09T17:13:19.205677] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-09T17:13:19.404407] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-09T17:13:19.404522] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-09T17:13:19.405436] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-09T17:13:19.405521] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-09T17:13:19.407190] [DEBUG] [LOCAL ] AMN: Trimmed 60320 records to 42026 (keeping 200 days of data) [2025-10-09T17:13:19.656521] [DEBUG] [LOCAL ] AMN: Primary data saved (42026 records). [2025-10-09T17:13:19.656678] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-09T17:13:19.657217] [INFO ] [MAIN ] Update Progress: 103/2373 symbols completed. AMN took 32.6s. Estimated remaining: 4h 52m 25s. Rate: 7.8 symbols/min [2025-10-09T17:13:19.828513] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:19.860082] [DEBUG] [LOCAL ] AMR: Loaded 29039 existing records from primary storage. [2025-10-09T17:13:19.860395] [INFO ] [MAIN ] AMR: Loaded 29039 existing records. [2025-10-09T17:13:20.001545] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-09T17:13:20.045838] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:20.046399] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-09T17:13:20.046489] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-09T17:13:20.046810] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-09T17:13:20.046868] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-09T17:13:20.370921] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T17:13:20.489708] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:20.520797] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T17:13:20.796710] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-09T17:13:21.292590] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T17:13:21.596717] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-09T17:13:21.828512] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T17:13:22.396774] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-09T17:13:22.747989] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T17:13:23.186788] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T17:13:23.196666] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-09T17:13:23.996743] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-09T17:13:24.039287] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T17:13:24.796736] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-09T17:13:25.321868] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:13:25.596714] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-09T17:13:26.167359] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T17:13:26.396735] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-09T17:13:27.099267] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T17:13:27.196690] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-09T17:13:28.006693] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-09T17:13:28.009273] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:13:28.521485] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T17:13:28.796757] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-09T17:13:29.596817] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-09T17:13:29.812398] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T17:13:30.116179] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T17:13:30.396750] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-09T17:13:31.036969] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T17:13:31.196748] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-09T17:13:31.631334] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T17:13:31.996729] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-09T17:13:32.796749] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-09T17:13:33.448544] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:13:33.573123] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-09T17:13:33.596709] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-09T17:13:33.949192] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T17:13:34.396788] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-09T17:13:35.086452] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T17:13:35.196745] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-09T17:13:35.447816] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:13:35.996717] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-09T17:13:36.796789] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-09T17:13:37.153577] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T17:13:37.156516] [INFO ] [REMOTE ] AMP: Full fetch complete (47425 records). [2025-10-09T17:13:37.156734] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-09T17:13:37.316055] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T17:13:37.583518] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-09T17:13:37.583624] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-09T17:13:37.584189] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-09T17:13:37.584239] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-09T17:13:37.585209] [DEBUG] [LOCAL ] AMP: Trimmed 47425 records to 32147 (keeping 200 days of data) [2025-10-09T17:13:37.644082] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-09T17:13:37.791626] [DEBUG] [LOCAL ] AMP: Primary data saved (32147 records). [2025-10-09T17:13:37.791791] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-09T17:13:37.791873] [INFO ] [MAIN ] Update Progress: 104/2373 symbols completed. AMP took 46.2s. Estimated remaining: 4h 56m 5s. Rate: 7.7 symbols/min [2025-10-09T17:13:37.958277] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:37.998147] [DEBUG] [LOCAL ] AMRC: Loaded 38091 existing records from primary storage. [2025-10-09T17:13:37.998435] [INFO ] [MAIN ] AMRC: Loaded 38091 existing records. [2025-10-09T17:13:38.174251] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:38.174560] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-09T17:13:38.174738] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-09T17:13:38.175001] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-09T17:13:38.175059] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-09T17:13:38.332263] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T17:13:38.416072] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-09T17:13:38.568453] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:39.196752] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-09T17:13:39.612596] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-09T17:13:39.643860] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T17:13:39.996736] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-09T17:13:40.600772] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:13:40.796734] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-09T17:13:41.018497] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T17:13:41.596709] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-09T17:13:41.833481] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T17:13:42.396737] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-09T17:13:42.667089] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T17:13:43.196742] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-09T17:13:43.219003] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T17:13:43.996781] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-09T17:13:44.181841] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T17:13:44.184593] [INFO ] [REMOTE ] AMR: Full fetch complete (40342 records). [2025-10-09T17:13:44.184729] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-09T17:13:44.602840] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-09T17:13:44.602956] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-09T17:13:44.603417] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-09T17:13:44.603460] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-09T17:13:44.604293] [DEBUG] [LOCAL ] AMR: Trimmed 40342 records to 29174 (keeping 200 days of data) [2025-10-09T17:13:44.778119] [DEBUG] [LOCAL ] AMR: Primary data saved (29174 records). [2025-10-09T17:13:44.778255] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-09T17:13:44.778337] [INFO ] [MAIN ] Update Progress: 105/2373 symbols completed. AMR took 25.1s. Estimated remaining: 4h 55m 38s. Rate: 7.7 symbols/min [2025-10-09T17:13:44.802761] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-09T17:13:44.955195] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:44.955426] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-09T17:13:44.955469] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-09T17:13:44.955544] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-09T17:13:44.955582] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-09T17:13:44.955624] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-09T17:13:44.955695] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-09T17:13:45.311545] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:45.332537] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:13:45.596686] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-09T17:13:45.794186] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:13:45.794441] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-09T17:13:45.794530] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:13:45.794577] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-09T17:13:45.794638] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:13:45.794741] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-09T17:13:45.794828] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-09T17:13:45.794876] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-09T17:13:45.794931] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-09T17:13:45.795000] [INFO ] [MAIN ] Update Progress: 106/2373 symbols completed. AMRZ took 1.0s. Estimated remaining: 4h 53m 5s. Rate: 7.7 symbols/min [2025-10-09T17:13:45.960194] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:46.013120] [DEBUG] [LOCAL ] AMT: Loaded 52439 existing records from primary storage. [2025-10-09T17:13:46.013401] [INFO ] [MAIN ] AMT: Loaded 52439 existing records. [2025-10-09T17:13:46.193894] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:46.194090] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-09T17:13:46.194137] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-09T17:13:46.194507] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-09T17:13:46.194566] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-09T17:13:46.401970] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-09T17:13:46.543557] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:47.196705] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-09T17:13:47.268001] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-09T17:13:47.273852] [INFO ] [REMOTE ] AMPX: Full fetch complete (74994 records). [2025-10-09T17:13:47.274035] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-09T17:13:47.708878] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-09T17:13:47.708974] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-09T17:13:47.709847] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-09T17:13:47.709913] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-09T17:13:47.711898] [DEBUG] [LOCAL ] AMPX: Trimmed 74994 records to 52708 (keeping 200 days of data) [2025-10-09T17:13:47.928759] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T17:13:47.950782] [INFO ] [REMOTE ] AMPY: Full fetch complete (52176 records). [2025-10-09T17:13:47.955951] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-09T17:13:47.999491] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-09T17:13:48.478514] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-09T17:13:48.482632] [DEBUG] [LOCAL ] AMPX: Primary data saved (52708 records). [2025-10-09T17:13:48.482991] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-09T17:13:48.484405] [INFO ] [MAIN ] Update Progress: 107/2373 symbols completed. AMPX took 47.8s. Estimated remaining: 4h 51m 10s. Rate: 7.8 symbols/min [2025-10-09T17:13:48.482793] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-09T17:13:48.509243] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-09T17:13:48.548091] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-09T17:13:48.617501] [DEBUG] [LOCAL ] AMPY: Trimmed 52176 records to 38919 (keeping 200 days of data) [2025-10-09T17:13:48.684240] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:48.787884] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:13:48.804495] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-09T17:13:48.836538] [DEBUG] [LOCAL ] AMTB: Loaded 20507 existing records from primary storage. [2025-10-09T17:13:48.836832] [INFO ] [MAIN ] AMTB: Loaded 20507 existing records. [2025-10-09T17:13:49.100730] [DEBUG] [LOCAL ] AMPY: Primary data saved (38919 records). [2025-10-09T17:13:49.116166] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-09T17:13:49.135491] [INFO ] [MAIN ] Update Progress: 108/2373 symbols completed. AMPY took 33.4s. Estimated remaining: 4h 48m 34s. Rate: 7.8 symbols/min [2025-10-09T17:13:49.144878] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:49.205404] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-09T17:13:49.210966] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-09T17:13:49.232343] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-09T17:13:49.242681] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-09T17:13:49.442910] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:49.590852] [DEBUG] [LOCAL ] AMTD: Loaded 3706 existing records from primary storage. [2025-10-09T17:13:49.607625] [INFO ] [MAIN ] AMTD: Loaded 3706 existing records. [2025-10-09T17:13:49.818915] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:49.860703] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-09T17:13:49.892874] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:49.894307] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-09T17:13:49.894389] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-09T17:13:49.894625] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-09T17:13:49.894724] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-09T17:13:50.260975] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:50.290351] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-09T17:13:50.331546] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:13:50.396679] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-09T17:13:51.107701] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T17:13:51.196682] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-09T17:13:51.829272] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:13:51.996689] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-09T17:13:52.078225] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T17:13:52.796732] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-09T17:13:53.433589] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:13:53.477562] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T17:13:53.596703] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-09T17:13:54.396752] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-09T17:13:54.917179] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T17:13:55.196728] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-09T17:13:55.996755] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-09T17:13:56.060026] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T17:13:56.210596] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T17:13:56.641845] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T17:13:56.796723] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-09T17:13:57.375618] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T17:13:57.596703] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-09T17:13:58.396768] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-09T17:13:58.911080] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T17:13:59.074297] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T17:13:59.196712] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-09T17:13:59.996728] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-09T17:14:00.656753] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T17:14:00.796717] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-09T17:14:01.596714] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-09T17:14:01.880855] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T17:14:02.335123] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:14:02.338792] [INFO ] [REMOTE ] AMRC: Full fetch complete (53614 records). [2025-10-09T17:14:02.338932] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-09T17:14:02.401803] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-09T17:14:02.762042] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-09T17:14:02.762683] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-09T17:14:02.762584] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:14:02.763426] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-09T17:14:02.763513] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-09T17:14:02.769512] [DEBUG] [LOCAL ] AMRC: Trimmed 53614 records to 38412 (keeping 200 days of data) [2025-10-09T17:14:03.011667] [DEBUG] [LOCAL ] AMRC: Primary data saved (38412 records). [2025-10-09T17:14:03.011829] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-09T17:14:03.011930] [INFO ] [MAIN ] Update Progress: 109/2373 symbols completed. AMRC took 25.2s. Estimated remaining: 4h 50m 36s. Rate: 7.8 symbols/min [2025-10-09T17:14:03.177605] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:03.205942] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-09T17:14:03.226594] [DEBUG] [LOCAL ] AMTM: Loaded 50653 existing records from primary storage. [2025-10-09T17:14:03.226924] [INFO ] [MAIN ] AMTM: Loaded 50653 existing records. [2025-10-09T17:14:03.400419] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:03.400601] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-09T17:14:03.400670] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-09T17:14:03.400899] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-09T17:14:03.400956] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-09T17:14:03.783941] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:03.996722] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-09T17:14:04.158432] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T17:14:04.292544] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T17:14:04.796748] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-09T17:14:05.261276] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T17:14:05.596730] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-09T17:14:05.859574] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:14:06.104998] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T17:14:06.396773] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-09T17:14:07.196736] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-09T17:14:07.429074] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T17:14:07.996730] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-09T17:14:08.796709] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-09T17:14:09.010568] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T17:14:09.596696] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-09T17:14:09.713335] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:14:09.761856] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T17:14:10.396727] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-09T17:14:11.196686] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-09T17:14:11.463177] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:14:11.535495] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T17:14:11.996731] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-09T17:14:12.645208] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T17:14:12.693516] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T17:14:12.796713] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-09T17:14:13.596712] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-09T17:14:14.396704] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-09T17:14:14.497488] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:14:14.814732] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T17:14:15.196769] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-09T17:14:15.922773] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T17:14:15.942106] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T17:14:15.996679] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-09T17:14:16.796782] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-09T17:14:16.960908] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T17:14:16.963009] [INFO ] [REMOTE ] AMTB: Full fetch complete (29699 records). [2025-10-09T17:14:16.963082] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-09T17:14:17.324674] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-09T17:14:17.324765] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-09T17:14:17.325135] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-09T17:14:17.325175] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-09T17:14:17.326493] [DEBUG] [LOCAL ] AMTB: Trimmed 29699 records to 20610 (keeping 200 days of data) [2025-10-09T17:14:17.463867] [DEBUG] [LOCAL ] AMTB: Primary data saved (20610 records). [2025-10-09T17:14:17.464014] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-09T17:14:17.464110] [INFO ] [MAIN ] Update Progress: 110/2373 symbols completed. AMTB took 29.0s. Estimated remaining: 4h 52m 47s. Rate: 7.7 symbols/min [2025-10-09T17:14:17.602482] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-09T17:14:17.634252] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:17.644557] [DEBUG] [LOCAL ] AMWL: Loaded 9214 existing records from primary storage. [2025-10-09T17:14:17.644866] [INFO ] [MAIN ] AMWL: Loaded 9214 existing records. [2025-10-09T17:14:17.844843] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:17.845058] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-09T17:14:17.845104] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-09T17:14:17.845289] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-09T17:14:17.845345] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-09T17:14:18.194624] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:18.205337] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T17:14:18.396681] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-09T17:14:18.804190] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:14:19.196686] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-09T17:14:19.395967] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T17:14:19.996772] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-09T17:14:20.796731] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-09T17:14:20.863596] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-09T17:14:21.028799] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T17:14:21.596768] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-09T17:14:22.396691] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-09T17:14:22.490625] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T17:14:22.536757] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:14:23.196741] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-09T17:14:23.989376] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:14:23.999867] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-09T17:14:24.571708] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T17:14:24.796695] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-09T17:14:24.901363] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T17:14:25.596735] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-09T17:14:26.174913] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T17:14:26.396702] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-09T17:14:26.836005] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T17:14:27.196734] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-09T17:14:27.988482] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T17:14:27.998595] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-09T17:14:28.188587] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T17:14:28.796724] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-09T17:14:29.415120] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T17:14:29.596691] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-09T17:14:29.756128] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:14:29.760722] [INFO ] [REMOTE ] AMT: Full fetch complete (76028 records). [2025-10-09T17:14:29.760845] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-09T17:14:30.148786] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-09T17:14:30.148874] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-09T17:14:30.149607] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-09T17:14:30.149674] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-09T17:14:30.151083] [DEBUG] [LOCAL ] AMT: Trimmed 76028 records to 52828 (keeping 200 days of data) [2025-10-09T17:14:30.400301] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-09T17:14:30.501507] [DEBUG] [LOCAL ] AMT: Primary data saved (52828 records). [2025-10-09T17:14:30.501677] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-09T17:14:30.502581] [INFO ] [MAIN ] Update Progress: 111/2373 symbols completed. AMT took 44.7s. Estimated remaining: 4h 54m 27s. Rate: 7.7 symbols/min [2025-10-09T17:14:30.668575] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:30.715536] [DEBUG] [LOCAL ] AMX: Loaded 49124 existing records from primary storage. [2025-10-09T17:14:30.715867] [INFO ] [MAIN ] AMX: Loaded 49124 existing records. [2025-10-09T17:14:30.889105] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:30.889339] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-09T17:14:30.889386] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-09T17:14:30.889665] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-09T17:14:30.889724] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-09T17:14:31.211999] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-09T17:14:31.256906] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:31.436570] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T17:14:31.472686] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T17:14:31.988876] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T17:14:31.990110] [INFO ] [REMOTE ] AMTD: Full fetch complete (5607 records). [2025-10-09T17:14:31.990186] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-09T17:14:32.001914] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-09T17:14:32.383112] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-09T17:14:32.383192] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-09T17:14:32.383404] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-09T17:14:32.383468] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-09T17:14:32.383878] [DEBUG] [LOCAL ] AMTD: Trimmed 5607 records to 3770 (keeping 200 days of data) [2025-10-09T17:14:32.409870] [DEBUG] [LOCAL ] AMTD: Primary data saved (3770 records). [2025-10-09T17:14:32.409982] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-09T17:14:32.410117] [INFO ] [MAIN ] Update Progress: 112/2373 symbols completed. AMTD took 43.3s. Estimated remaining: 4h 52m 20s. Rate: 7.7 symbols/min [2025-10-09T17:14:32.614428] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:32.614782] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-10-09T17:14:32.614857] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-10-09T17:14:32.614984] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-09T17:14:32.615028] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-09T17:14:32.615071] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-09T17:14:32.615105] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-09T17:14:32.801014] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-09T17:14:32.806908] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:14:33.014794] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:33.596775] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-09T17:14:34.396695] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-09T17:14:34.560070] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T17:14:34.655638] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T17:14:35.196718] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-09T17:14:35.982901] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T17:14:35.986541] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T17:14:35.996661] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-09T17:14:36.796769] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-09T17:14:37.487473] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:14:37.596757] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-09T17:14:38.396727] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-09T17:14:38.531041] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T17:14:38.753803] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:14:39.194439] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T17:14:39.197050] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-09T17:14:39.996792] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-09T17:14:40.633056] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T17:14:40.796724] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-09T17:14:41.539036] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T17:14:41.540820] [INFO ] [REMOTE ] AMWL: Full fetch complete (14249 records). [2025-10-09T17:14:41.540920] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-09T17:14:41.599871] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-09T17:14:41.941960] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-09T17:14:41.934314] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T17:14:41.942092] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-09T17:14:41.946257] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-09T17:14:41.946334] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-09T17:14:41.946970] [DEBUG] [LOCAL ] AMWL: Trimmed 14249 records to 9317 (keeping 200 days of data) [2025-10-09T17:14:41.947157] [INFO ] [REMOTE ] AMTM: Full fetch complete (73895 records). [2025-10-09T17:14:41.947442] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-09T17:14:42.407681] [DEBUG] [LOCAL ] AMWL: Primary data saved (9317 records). [2025-10-09T17:14:42.426576] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-09T17:14:42.426820] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-09T17:14:42.407564] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-09T17:14:42.427760] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-09T17:14:42.428537] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-09T17:14:42.428741] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-09T17:14:42.428688] [INFO ] [MAIN ] Update Progress: 113/2373 symbols completed. AMWL took 25.0s. Estimated remaining: 4h 52m 58s. Rate: 7.7 symbols/min [2025-10-09T17:14:42.541734] [DEBUG] [LOCAL ] AMTM: Trimmed 73895 records to 51005 (keeping 200 days of data) [2025-10-09T17:14:42.718443] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:42.883830] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-09T17:14:42.888492] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-09T17:14:43.059439] [DEBUG] [LOCAL ] AMTM: Primary data saved (51005 records). [2025-10-09T17:14:43.062892] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-09T17:14:43.063110] [INFO ] [MAIN ] Update Progress: 114/2373 symbols completed. AMTM took 40.1s. Estimated remaining: 4h 50m 28s. Rate: 7.8 symbols/min [2025-10-09T17:14:43.271741] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:43.282772] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-09T17:14:43.288047] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-09T17:14:43.311108] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-09T17:14:43.311221] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-09T17:14:43.351520] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:43.505112] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T17:14:43.536753] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-09T17:14:43.815726] [DEBUG] [LOCAL ] ANF: Loaded 52101 existing records from primary storage. [2025-10-09T17:14:43.820767] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:43.821309] [INFO ] [MAIN ] ANF: Loaded 52101 existing records. [2025-10-09T17:14:44.000597] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-09T17:14:44.022792] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:44.023344] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-09T17:14:44.023476] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-09T17:14:44.024431] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-09T17:14:44.051553] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-09T17:14:44.101346] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T17:14:44.416701] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:44.796783] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-09T17:14:45.143462] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:14:45.596790] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-09T17:14:46.396752] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-09T17:14:46.446672] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-09T17:14:46.567843] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T17:14:47.092584] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T17:14:47.196726] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-09T17:14:47.824420] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:14:47.996815] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-09T17:14:48.796847] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-09T17:14:49.064382] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T17:14:49.596719] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-09T17:14:50.110160] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:14:50.265909] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-09T17:14:50.396787] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-09T17:14:51.049777] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T17:14:51.196700] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-09T17:14:51.996752] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-09T17:14:52.074531] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T17:14:52.796781] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-09T17:14:53.137444] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T17:14:53.371550] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T17:14:53.596770] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-09T17:14:54.396689] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-09T17:14:54.457275] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:14:55.196694] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-09T17:14:55.554704] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T17:14:55.589459] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:14:55.996765] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-09T17:14:56.796784] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-09T17:14:57.550710] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-09T17:14:57.596666] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-09T17:14:57.683159] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T17:14:57.940446] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T17:14:58.396770] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-09T17:14:59.196715] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-09T17:14:59.619740] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:14:59.622446] [INFO ] [REMOTE ] AN: Full fetch complete (47186 records). [2025-10-09T17:14:59.622557] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-09T17:14:59.996830] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-09T17:15:00.034043] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-09T17:15:00.034375] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-09T17:15:00.035025] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-09T17:15:00.035104] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-09T17:15:00.036401] [DEBUG] [LOCAL ] AN: Trimmed 47186 records to 31875 (keeping 200 days of data) [2025-10-09T17:15:00.067200] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-09T17:15:00.268524] [DEBUG] [LOCAL ] AN: Primary data saved (31875 records). [2025-10-09T17:15:00.268695] [INFO ] [MAIN ] AN: Full history saved. [2025-10-09T17:15:00.268798] [INFO ] [MAIN ] Update Progress: 115/2373 symbols completed. AN took 27.9s. Estimated remaining: 4h 53m 27s. Rate: 7.7 symbols/min [2025-10-09T17:15:00.438223] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:00.438436] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-09T17:15:00.438489] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-09T17:15:00.438612] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-09T17:15:00.438684] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-09T17:15:00.438748] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-09T17:15:00.438783] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-09T17:15:00.792911] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:00.796662] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-09T17:15:01.030314] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:15:01.030627] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-09T17:15:01.030747] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:15:01.030856] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-09T17:15:01.030910] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:15:01.030951] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-09T17:15:01.031006] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-09T17:15:01.031040] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-09T17:15:01.031078] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-09T17:15:01.031124] [INFO ] [MAIN ] Update Progress: 116/2373 symbols completed. ANGX took 0.8s. Estimated remaining: 4h 51m 2s. Rate: 7.8 symbols/min [2025-10-09T17:15:01.200843] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:01.219981] [DEBUG] [LOCAL ] ANRO: Loaded 19212 existing records from primary storage. [2025-10-09T17:15:01.220243] [INFO ] [MAIN ] ANRO: Loaded 19212 existing records. [2025-10-09T17:15:01.358183] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-09T17:15:01.451487] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:15:01.451802] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-09T17:15:01.451853] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-09T17:15:01.452080] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-09T17:15:01.452141] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-09T17:15:01.601844] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-09T17:15:01.871537] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:02.269881] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-09T17:15:02.396726] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-09T17:15:03.196696] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-09T17:15:03.995250] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-09T17:15:03.999759] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-09T17:15:04.063527] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T17:15:04.377262] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T17:15:04.796757] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-09T17:15:05.507483] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:15:05.596683] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-09T17:15:06.396723] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-09T17:15:06.595120] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:15:06.777510] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T17:15:07.196734] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-09T17:15:07.996694] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-09T17:15:08.151354] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:15:08.340347] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T17:15:08.796729] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-09T17:15:09.596695] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-09T17:15:09.868534] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:15:10.185049] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:15:10.396736] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-09T17:15:11.196724] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-09T17:15:11.996686] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-09T17:15:12.016547] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T17:15:12.020621] [INFO ] [REMOTE ] AMX: Full fetch complete (70354 records). [2025-10-09T17:15:12.020843] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-09T17:15:12.039549] [FATAL] [VALIDATOR ] AMX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:15:12.049902] [FATAL] [MAIN ] AMX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:15:12.049978] [WARN ] [MAIN ] AMX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:15:12.050267] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-09T17:15:12.050693] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-09T17:15:12.051762] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-09T17:15:12.051820] [INFO ] [LOCAL ] AMX: Starting deletion of derivative data. [2025-10-09T17:15:12.063214] [DEBUG] [LOCAL ] AMX: Deleted derivative data file. [2025-10-09T17:15:12.063880] [INFO ] [MAIN ] Update Progress: 117/2373 symbols completed. AMX took 41.6s. Estimated remaining: 4h 51m 58s. Rate: 7.7 symbols/min [2025-10-09T17:15:12.115014] [DEBUG] [REMOTE ] ANF: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-09T17:15:12.115238] [WARN ] [REMOTE ] ANF: No data returned for month 2025-09 [2025-10-09T17:15:12.115326] [FATAL] [REMOTE ] ANF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:15:12.115397] [FATAL] [MAIN ] ANF: Failed to fetch primary data. [2025-10-09T17:15:12.115459] [WARN ] [MAIN ] ANF: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:15:12.115527] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-09T17:15:12.115586] [DEBUG] [LOCAL ] ANF: No primary data file found to delete. [2025-10-09T17:15:12.115621] [INFO ] [LOCAL ] ANF: Starting deletion of derivative data. [2025-10-09T17:15:12.115837] [DEBUG] [LOCAL ] ANF: Deleted derivative data file. [2025-10-09T17:15:12.115917] [INFO ] [MAIN ] Update Progress: 118/2373 symbols completed. ANF took 29.1s. Estimated remaining: 4h 49m 23s. Rate: 7.8 symbols/min [2025-10-09T17:15:12.416742] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:15:12.796737] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-09T17:15:13.596741] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-09T17:15:14.601751] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T17:15:14.606396] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-09T17:15:14.907358] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-09T17:15:15.196787] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-09T17:15:15.673354] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T17:15:15.996719] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-09T17:15:17.021683] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T17:15:17.026321] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-09T17:15:17.107408] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T17:15:17.596690] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-09T17:15:17.945131] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T17:15:18.396729] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-09T17:15:19.196496] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T17:15:19.199492] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-09T17:15:20.031040] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-09T17:15:20.043800] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-09T17:15:20.338661] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T17:15:20.341428] [INFO ] [REMOTE ] ANRO: Full fetch complete (29609 records). [2025-10-09T17:15:20.341503] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-09T17:15:20.701841] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-09T17:15:20.701929] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-09T17:15:20.702354] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-09T17:15:20.702402] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-09T17:15:20.703277] [DEBUG] [LOCAL ] ANRO: Trimmed 29609 records to 19411 (keeping 200 days of data) [2025-10-09T17:15:20.812069] [DEBUG] [LOCAL ] ANRO: Primary data saved (19411 records). [2025-10-09T17:15:20.812217] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-09T17:15:20.812301] [INFO ] [MAIN ] Update Progress: 119/2373 symbols completed. ANRO took 19.8s. Estimated remaining: 4h 49m 34s. Rate: 7.8 symbols/min [2025-10-09T17:15:22.462764] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-09T17:15:22.474316] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-09T17:15:24.842006] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-09T17:15:24.848810] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-09T17:15:24.849049] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-09T17:15:25.243824] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-09T17:15:25.243905] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-09T17:15:25.244667] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-09T17:15:25.244733] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-09T17:15:25.246196] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 54156 (keeping 200 days of data) [2025-10-09T17:15:25.579865] [DEBUG] [LOCAL ] ANET: Primary data saved (54156 records). [2025-10-09T17:15:25.579991] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-09T17:15:25.581032] [INFO ] [MAIN ] Update Progress: 120/2373 symbols completed. ANET took 43.2s. Estimated remaining: 4h 48m 31s. Rate: 7.8 symbols/min [2025-10-09T17:15:26.272618] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:26.341922] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:26.320454] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:26.343044] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:26.342200] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-10-09T17:15:26.343556] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-10-09T17:15:26.343671] [DEBUG] [LOCAL ] ANVS: No existing data file found in primary storage. [2025-10-09T17:15:26.343795] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-09T17:15:26.343928] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-09T17:15:26.344110] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-09T17:15:26.343860] [WARN ] [MAIN ] ANVS: No existing data found, performing full refresh instead. [2025-10-09T17:15:26.344273] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-09T17:15:26.355371] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-09T17:15:26.344027] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-09T17:15:26.365178] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-09T17:15:26.379858] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-09T17:15:26.379976] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-09T17:15:26.386021] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-09T17:15:26.386089] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-09T17:15:26.400337] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-09T17:15:26.425207] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-09T17:15:26.443519] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-09T17:15:26.490489] [DEBUG] [LOCAL ] AOMR: Loaded 16437 existing records from primary storage. [2025-10-09T17:15:26.495906] [INFO ] [MAIN ] AOMR: Loaded 16437 existing records. [2025-10-09T17:15:27.381474] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:15:27.473556] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-09T17:15:27.522273] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:27.575714] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:27.588785] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-09T17:15:27.593826] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-09T17:15:27.487570] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-09T17:15:27.629850] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:27.630270] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-09T17:15:27.631219] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-09T17:15:27.631282] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-09T17:15:27.901889] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:15:27.904524] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-09T17:15:27.915058] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:15:27.925440] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-09T17:15:27.943470] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:15:27.961261] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-09T17:15:27.961978] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-09T17:15:27.962375] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-09T17:15:27.982390] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-09T17:15:27.982340] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:27.982513] [INFO ] [MAIN ] Update Progress: 121/2373 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 46m 45s. Rate: 7.9 symbols/min [2025-10-09T17:15:27.982780] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-09T17:15:28.149457] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:28.149597] [DEBUG] [LOCAL ] AON: No existing data file found in primary storage. [2025-10-09T17:15:28.149634] [WARN ] [MAIN ] AON: No existing data found, performing full refresh instead. [2025-10-09T17:15:28.149793] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-09T17:15:28.149849] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-09T17:15:28.149894] [DEBUG] [LOCAL ] AON: No primary data file found to delete. [2025-10-09T17:15:28.149926] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-09T17:15:28.495957] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:28.496257] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-09T17:15:29.002419] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:15:29.015387] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-09T17:15:29.016910] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T17:15:29.020065] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-09T17:15:29.053962] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T17:15:29.060075] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-09T17:15:29.765297] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T17:15:29.768088] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-09T17:15:30.226231] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T17:15:30.234969] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-09T17:15:30.265387] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T17:15:30.272982] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-09T17:15:30.337076] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T17:15:30.396668] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-09T17:15:30.880589] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:15:31.196690] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-09T17:15:31.520808] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:15:31.704872] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:15:31.734447] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:15:31.892933] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T17:15:31.996691] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-09T17:15:32.796776] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-09T17:15:32.953719] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T17:15:33.596767] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-09T17:15:34.075308] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T17:15:34.396695] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-09T17:15:34.493212] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T17:15:35.196793] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-09T17:15:35.814687] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T17:15:35.996689] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-09T17:15:36.041973] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T17:15:36.796709] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-09T17:15:37.200382] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T17:15:37.596723] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-09T17:15:38.002107] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T17:15:38.396731] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-09T17:15:39.160462] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T17:15:39.196677] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-09T17:15:39.726483] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T17:15:39.996738] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-09T17:15:40.796683] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-09T17:15:40.949773] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:15:41.355682] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T17:15:41.596725] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-09T17:15:41.760066] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T17:15:42.396770] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-09T17:15:43.196688] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-09T17:15:43.392758] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:15:43.712241] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T17:15:43.996739] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-09T17:15:44.224438] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T17:15:44.796732] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-09T17:15:45.477325] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T17:15:45.596696] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-09T17:15:45.736730] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T17:15:46.396721] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-09T17:15:46.517078] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T17:15:47.196729] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-09T17:15:47.704995] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:15:47.996763] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-09T17:15:48.332990] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T17:15:48.552937] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T17:15:48.796735] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-09T17:15:49.596714] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-09T17:15:50.122987] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:15:50.126169] [INFO ] [REMOTE ] AOD: Full fetch complete (44450 records). [2025-10-09T17:15:50.126267] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-09T17:15:50.402565] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-09T17:15:50.501219] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-09T17:15:50.501303] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-09T17:15:50.501823] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-09T17:15:50.501887] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-09T17:15:50.502900] [DEBUG] [LOCAL ] AOD: Trimmed 44450 records to 30853 (keeping 200 days of data) [2025-10-09T17:15:50.681516] [DEBUG] [LOCAL ] AOD: Primary data saved (30853 records). [2025-10-09T17:15:50.681685] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-09T17:15:50.681777] [INFO ] [MAIN ] Update Progress: 122/2373 symbols completed. AOD took 25.1s. Estimated remaining: 4h 51m 15s. Rate: 7.7 symbols/min [2025-10-09T17:15:50.845534] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:50.874141] [DEBUG] [LOCAL ] AORT: Loaded 29234 existing records from primary storage. [2025-10-09T17:15:50.874401] [INFO ] [MAIN ] AORT: Loaded 29234 existing records. [2025-10-09T17:15:51.073827] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:15:51.074260] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-09T17:15:51.074316] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-09T17:15:51.074706] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-09T17:15:51.074767] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-09T17:15:51.203101] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-09T17:15:51.428258] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T17:15:51.512958] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:51.624842] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T17:15:51.996730] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-09T17:15:52.117101] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T17:15:52.796708] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-09T17:15:52.935393] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T17:15:53.596746] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-09T17:15:53.746778] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T17:15:54.396777] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-09T17:15:54.988876] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T17:15:55.196679] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-09T17:15:55.508883] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T17:15:55.996708] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-09T17:15:56.466828] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T17:15:56.796774] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-09T17:15:56.931012] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T17:15:56.932946] [INFO ] [REMOTE ] AOMR: Full fetch complete (23044 records). [2025-10-09T17:15:56.933072] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-09T17:15:56.933584] [FATAL] [VALIDATOR ] AOMR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:15:56.933727] [FATAL] [MAIN ] AOMR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:15:56.933806] [WARN ] [MAIN ] AOMR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:15:56.933900] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-09T17:15:56.933999] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-09T17:15:56.934048] [INFO ] [LOCAL ] AOMR: Starting deletion of derivative data. [2025-10-09T17:15:56.934285] [DEBUG] [LOCAL ] AOMR: Deleted derivative data file. [2025-10-09T17:15:56.934389] [INFO ] [MAIN ] Update Progress: 123/2373 symbols completed. AOMR took 31.3s. Estimated remaining: 4h 50m 40s. Rate: 7.7 symbols/min [2025-10-09T17:15:57.199403] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:57.199625] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-10-09T17:15:57.199719] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-10-09T17:15:57.199872] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-09T17:15:57.199937] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-09T17:15:57.199998] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-09T17:15:57.200040] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-09T17:15:57.608905] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-09T17:15:57.651316] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:57.735134] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T17:15:58.396726] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-09T17:15:59.062582] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T17:15:59.065908] [INFO ] [REMOTE ] AON: Full fetch complete (64331 records). [2025-10-09T17:15:59.066047] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-09T17:15:59.066754] [FATAL] [VALIDATOR ] AON: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:15:59.066840] [FATAL] [MAIN ] AON: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:15:59.066894] [WARN ] [MAIN ] AON: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:15:59.066981] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-09T17:15:59.067083] [DEBUG] [LOCAL ] AON: No primary data file found to delete. [2025-10-09T17:15:59.067149] [INFO ] [LOCAL ] AON: Starting deletion of derivative data. [2025-10-09T17:15:59.067229] [DEBUG] [LOCAL ] AON: No derivative data file found to delete. [2025-10-09T17:15:59.067328] [INFO ] [MAIN ] Update Progress: 124/2373 symbols completed. AON took 31.1s. Estimated remaining: 4h 48m 50s. Rate: 7.8 symbols/min [2025-10-09T17:15:59.209842] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-09T17:15:59.242574] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:59.251757] [DEBUG] [LOCAL ] AP: Loaded 7216 existing records from primary storage. [2025-10-09T17:15:59.252407] [INFO ] [MAIN ] AP: Loaded 7216 existing records. [2025-10-09T17:15:59.430508] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:15:59.430747] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-09T17:15:59.430817] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-09T17:15:59.431054] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-09T17:15:59.431112] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-09T17:15:59.805463] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:59.918623] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T17:15:59.996740] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-09T17:16:00.258036] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:16:00.260567] [INFO ] [REMOTE ] ANVS: Full fetch complete (36149 records). [2025-10-09T17:16:00.260688] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-09T17:16:00.632245] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-09T17:16:00.632320] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-09T17:16:00.632753] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-09T17:16:00.632816] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-09T17:16:00.633611] [DEBUG] [LOCAL ] ANVS: Trimmed 36149 records to 23421 (keeping 200 days of data) [2025-10-09T17:16:00.768740] [DEBUG] [LOCAL ] ANVS: Primary data saved (23421 records). [2025-10-09T17:16:00.768906] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-09T17:16:00.769025] [INFO ] [MAIN ] Update Progress: 125/2373 symbols completed. ANVS took 35.2s. Estimated remaining: 4h 46m 55s. Rate: 7.8 symbols/min [2025-10-09T17:16:00.802280] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-09T17:16:00.943171] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:00.977916] [DEBUG] [LOCAL ] APAM: Loaded 36012 existing records from primary storage. [2025-10-09T17:16:00.978242] [INFO ] [MAIN ] APAM: Loaded 36012 existing records. [2025-10-09T17:16:01.153310] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:01.153579] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-09T17:16:01.153629] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-09T17:16:01.155139] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-09T17:16:01.155202] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-09T17:16:01.526194] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:01.530814] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T17:16:01.596925] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-09T17:16:01.759572] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:16:02.396737] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-09T17:16:03.003445] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:16:03.196780] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-09T17:16:03.622126] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T17:16:03.996751] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-09T17:16:04.063083] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T17:16:04.796736] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-09T17:16:05.397540] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:16:05.596728] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-09T17:16:06.318123] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T17:16:06.396731] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-09T17:16:06.536597] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:16:07.196741] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-09T17:16:07.996692] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-09T17:16:08.098716] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:16:08.606192] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:16:08.796736] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-09T17:16:09.491684] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T17:16:09.524951] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:16:09.596704] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-09T17:16:10.396705] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-09T17:16:10.950595] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:16:11.196748] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-09T17:16:11.998706] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-09T17:16:12.001056] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-09T17:16:12.057411] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T17:16:12.796809] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-09T17:16:13.387099] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:16:13.600254] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-09T17:16:13.603173] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:16:14.396773] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-09T17:16:15.196703] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-09T17:16:15.336979] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:16:16.003017] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-09T17:16:16.019706] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T17:16:16.617879] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T17:16:16.796755] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-09T17:16:17.419823] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T17:16:17.596698] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-09T17:16:17.709126] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T17:16:18.388445] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T17:16:18.396684] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-09T17:16:19.159391] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T17:16:19.196697] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-09T17:16:19.943846] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T17:16:19.996710] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-09T17:16:20.796761] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-09T17:16:21.449040] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T17:16:21.449958] [INFO ] [REMOTE ] AP: Full fetch complete (8939 records). [2025-10-09T17:16:21.450025] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-09T17:16:21.450399] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:16:21.450478] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:16:21.450522] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:16:21.450588] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-09T17:16:21.450670] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-09T17:16:21.450726] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-10-09T17:16:21.450905] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-10-09T17:16:21.450989] [INFO ] [MAIN ] Update Progress: 126/2373 symbols completed. AP took 22.4s. Estimated remaining: 4h 50m 39s. Rate: 7.7 symbols/min [2025-10-09T17:16:21.604112] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-09T17:16:21.623385] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:21.666110] [DEBUG] [LOCAL ] APD: Loaded 45285 existing records from primary storage. [2025-10-09T17:16:21.666414] [INFO ] [MAIN ] APD: Loaded 45285 existing records. [2025-10-09T17:16:21.848751] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:21.849081] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-09T17:16:21.849144] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-09T17:16:21.850615] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-09T17:16:21.850697] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-09T17:16:22.144031] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-09T17:16:22.258067] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:22.396710] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-09T17:16:22.628854] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T17:16:23.196704] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-09T17:16:23.774575] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:16:23.996725] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-09T17:16:24.368100] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T17:16:24.796745] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-09T17:16:25.123487] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T17:16:25.596716] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-09T17:16:26.396730] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-09T17:16:26.546113] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T17:16:26.572921] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T17:16:27.196716] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-09T17:16:27.755571] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:16:27.996710] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-09T17:16:28.675063] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T17:16:28.796718] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-09T17:16:29.099274] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:16:29.103276] [INFO ] [REMOTE ] AOS: Full fetch complete (70655 records). [2025-10-09T17:16:29.103392] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-09T17:16:29.479722] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-09T17:16:29.479813] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-09T17:16:29.480516] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-09T17:16:29.480561] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-09T17:16:29.481955] [DEBUG] [LOCAL ] AOS: Trimmed 70655 records to 49043 (keeping 200 days of data) [2025-10-09T17:16:29.596895] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-09T17:16:29.791182] [DEBUG] [LOCAL ] AOS: Primary data saved (49043 records). [2025-10-09T17:16:29.791326] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-09T17:16:29.791400] [INFO ] [MAIN ] Update Progress: 127/2373 symbols completed. AOS took 32.9s. Estimated remaining: 4h 50m 42s. Rate: 7.7 symbols/min [2025-10-09T17:16:29.959380] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:30.007974] [DEBUG] [LOCAL ] APG: Loaded 50463 existing records from primary storage. [2025-10-09T17:16:30.008297] [INFO ] [MAIN ] APG: Loaded 50463 existing records. [2025-10-09T17:16:30.186174] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:30.186440] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-09T17:16:30.186612] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-09T17:16:30.193225] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-09T17:16:30.203189] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-09T17:16:30.248315] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T17:16:30.405156] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-09T17:16:30.577599] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:30.828247] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:16:31.196722] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-09T17:16:31.753142] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T17:16:31.755697] [INFO ] [REMOTE ] AORT: Full fetch complete (42044 records). [2025-10-09T17:16:31.755794] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-09T17:16:32.004967] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-09T17:16:32.147883] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-09T17:16:32.148046] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-09T17:16:32.148703] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-09T17:16:32.148787] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-09T17:16:32.149954] [DEBUG] [LOCAL ] AORT: Trimmed 42044 records to 29364 (keeping 200 days of data) [2025-10-09T17:16:32.332399] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T17:16:32.353084] [DEBUG] [LOCAL ] AORT: Primary data saved (29364 records). [2025-10-09T17:16:32.353205] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-09T17:16:32.353284] [INFO ] [MAIN ] Update Progress: 128/2373 symbols completed. AORT took 41.7s. Estimated remaining: 4h 49m 3s. Rate: 7.8 symbols/min [2025-10-09T17:16:32.526488] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:32.579256] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-09T17:16:32.579561] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-09T17:16:32.756838] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:32.757047] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-09T17:16:32.757093] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-09T17:16:32.758576] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-09T17:16:32.758634] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-09T17:16:32.802213] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-09T17:16:33.126082] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:33.596689] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-09T17:16:33.777220] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:16:34.162554] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:16:34.165348] [INFO ] [REMOTE ] APAM: Full fetch complete (51577 records). [2025-10-09T17:16:34.165431] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-09T17:16:34.166360] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:16:34.166447] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:16:34.166490] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:16:34.166556] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-09T17:16:34.166619] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-09T17:16:34.166699] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-09T17:16:34.166947] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-10-09T17:16:34.167620] [INFO ] [MAIN ] Update Progress: 129/2373 symbols completed. APAM took 33.4s. Estimated remaining: 4h 47m 12s. Rate: 7.8 symbols/min [2025-10-09T17:16:34.335421] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:34.392048] [DEBUG] [LOCAL ] APLE: Loaded 51926 existing records from primary storage. [2025-10-09T17:16:34.392352] [INFO ] [MAIN ] APLE: Loaded 51926 existing records. [2025-10-09T17:16:34.403458] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-09T17:16:34.571906] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:34.572133] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-09T17:16:34.572180] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-09T17:16:34.572432] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-09T17:16:34.572489] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-09T17:16:34.956703] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:35.196682] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-09T17:16:35.996703] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-09T17:16:36.049204] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-09T17:16:36.415345] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T17:16:36.796708] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-09T17:16:36.848672] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T17:16:37.463054] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:16:37.596677] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-09T17:16:38.396714] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-09T17:16:38.479706] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:16:39.196718] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-09T17:16:39.247462] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T17:16:39.846605] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:16:39.996730] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-09T17:16:40.796722] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-09T17:16:40.911407] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T17:16:41.557116] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T17:16:41.596679] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-09T17:16:42.396701] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-09T17:16:42.435441] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:16:43.200055] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-09T17:16:43.205419] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:16:43.962927] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:16:43.996668] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-09T17:16:44.796687] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-09T17:16:44.923049] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T17:16:45.596708] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-09T17:16:45.839224] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T17:16:46.396702] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-09T17:16:46.840547] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T17:16:46.875827] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T17:16:47.196775] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-09T17:16:47.938227] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T17:16:47.996701] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-09T17:16:48.680704] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:16:48.796738] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-09T17:16:49.596825] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-09T17:16:49.676051] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:16:50.396755] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-09T17:16:50.701216] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T17:16:51.196773] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-09T17:16:51.423196] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T17:16:51.996699] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-09T17:16:52.155530] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T17:16:52.796681] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-09T17:16:53.013350] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T17:16:53.603851] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-09T17:16:53.629623] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:16:54.396733] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-09T17:16:54.505330] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T17:16:55.196686] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-09T17:16:55.996686] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-09T17:16:56.175560] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-09T17:16:56.796698] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-09T17:16:57.090159] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T17:16:57.387272] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-10-09T17:16:57.596756] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-09T17:16:57.796488] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T17:16:58.270804] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T17:16:58.396681] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-09T17:16:59.196766] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-09T17:16:59.422523] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T17:16:59.609739] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T17:16:59.996736] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-09T17:17:00.549514] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T17:17:00.796718] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-09T17:17:01.596811] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-09T17:17:01.788145] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T17:17:02.396750] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-09T17:17:02.534862] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T17:17:02.538914] [INFO ] [REMOTE ] APD: Full fetch complete (66888 records). [2025-10-09T17:17:02.539013] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-09T17:17:02.930062] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-09T17:17:02.930222] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-09T17:17:02.931084] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-09T17:17:02.931152] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-09T17:17:02.932573] [DEBUG] [LOCAL ] APD: Trimmed 66888 records to 45648 (keeping 200 days of data) [2025-10-09T17:17:03.196834] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-09T17:17:03.285232] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T17:17:03.299593] [DEBUG] [LOCAL ] APD: Primary data saved (45648 records). [2025-10-09T17:17:03.299770] [INFO ] [MAIN ] APD: Full history saved. [2025-10-09T17:17:03.300734] [INFO ] [MAIN ] Update Progress: 130/2373 symbols completed. APD took 41.8s. Estimated remaining: 4h 53m 15s. Rate: 7.6 symbols/min [2025-10-09T17:17:03.477724] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:03.535900] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-09T17:17:03.536251] [INFO ] [MAIN ] APO: Loaded 53383 existing records. [2025-10-09T17:17:03.728080] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:03.728304] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-09T17:17:03.728349] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-09T17:17:03.730008] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-09T17:17:03.730067] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-09T17:17:04.001815] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-09T17:17:04.125579] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:04.415671] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T17:17:04.796771] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-09T17:17:05.092335] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T17:17:05.556454] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T17:17:05.560401] [INFO ] [REMOTE ] APG: Full fetch complete (71425 records). [2025-10-09T17:17:05.560510] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-09T17:17:05.561274] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:17:05.561413] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:17:05.561487] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:17:05.561555] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-09T17:17:05.561621] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-09T17:17:05.561697] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-10-09T17:17:05.561936] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-10-09T17:17:05.562529] [INFO ] [MAIN ] Update Progress: 131/2373 symbols completed. APG took 35.8s. Estimated remaining: 4h 51m 31s. Rate: 7.7 symbols/min [2025-10-09T17:17:05.606221] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-09T17:17:05.734137] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:05.744579] [DEBUG] [LOCAL ] APOS: Loaded 7519 existing records from primary storage. [2025-10-09T17:17:05.744824] [INFO ] [MAIN ] APOS: Loaded 7519 existing records. [2025-10-09T17:17:05.917086] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:05.917284] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-09T17:17:05.917329] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-09T17:17:05.917749] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-09T17:17:05.917809] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-09T17:17:06.266678] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:06.396692] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-09T17:17:06.695340] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T17:17:07.068561] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T17:17:07.196752] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-09T17:17:07.649535] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T17:17:07.996776] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-09T17:17:08.378815] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-09T17:17:08.796748] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-09T17:17:09.338331] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T17:17:09.596709] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-09T17:17:09.809805] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-09T17:17:10.396797] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-09T17:17:11.196689] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-09T17:17:11.404706] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:17:11.930440] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T17:17:11.996674] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-09T17:17:12.075065] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:17:12.079415] [INFO ] [REMOTE ] APLE: Full fetch complete (74401 records). [2025-10-09T17:17:12.079520] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-09T17:17:12.466588] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-09T17:17:12.466698] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-09T17:17:12.467437] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-09T17:17:12.467482] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-09T17:17:12.468921] [DEBUG] [LOCAL ] APLE: Trimmed 74401 records to 52309 (keeping 200 days of data) [2025-10-09T17:17:12.792934] [DEBUG] [LOCAL ] APLE: Primary data saved (52309 records). [2025-10-09T17:17:12.793160] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-09T17:17:12.793976] [INFO ] [MAIN ] Update Progress: 132/2373 symbols completed. APLE took 38.6s. Estimated remaining: 4h 51m 14s. Rate: 7.7 symbols/min [2025-10-09T17:17:12.805103] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-09T17:17:12.978611] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:13.048791] [DEBUG] [LOCAL ] APTV: Loaded 52044 existing records from primary storage. [2025-10-09T17:17:13.049299] [INFO ] [MAIN ] APTV: Loaded 52044 existing records. [2025-10-09T17:17:13.232318] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:13.232678] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-09T17:17:13.232745] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-09T17:17:13.233077] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-09T17:17:13.233136] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-09T17:17:13.608692] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-09T17:17:13.617306] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:13.759540] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:17:13.813612] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:17:14.396816] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-09T17:17:15.154611] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T17:17:15.196712] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-09T17:17:15.803798] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-09T17:17:15.808543] [INFO ] [REMOTE ] APH: Full fetch complete (77691 records). [2025-10-09T17:17:15.808776] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-09T17:17:16.010298] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T17:17:16.007836] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-09T17:17:16.237476] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-09T17:17:16.237559] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-09T17:17:16.238349] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-09T17:17:16.238417] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-09T17:17:16.239866] [DEBUG] [LOCAL ] APH: Trimmed 77691 records to 54081 (keeping 200 days of data) [2025-10-09T17:17:16.586812] [DEBUG] [LOCAL ] APH: Primary data saved (54081 records). [2025-10-09T17:17:16.586967] [INFO ] [MAIN ] APH: Full history saved. [2025-10-09T17:17:16.587050] [INFO ] [MAIN ] Update Progress: 133/2373 symbols completed. APH took 44.2s. Estimated remaining: 4h 49m 58s. Rate: 7.7 symbols/min [2025-10-09T17:17:16.755104] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:16.801392] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-09T17:17:16.803315] [DEBUG] [LOCAL ] AQN: Loaded 51841 existing records from primary storage. [2025-10-09T17:17:16.803635] [INFO ] [MAIN ] AQN: Loaded 51841 existing records. [2025-10-09T17:17:16.982817] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:16.983110] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-09T17:17:16.983165] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-09T17:17:16.983388] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-09T17:17:16.983447] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-09T17:17:17.352565] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:17.596750] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-09T17:17:17.640964] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T17:17:18.013176] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T17:17:18.396750] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-09T17:17:19.196760] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-09T17:17:19.617514] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T17:17:19.996705] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-09T17:17:20.174089] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T17:17:20.608241] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:17:20.623745] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:17:20.796773] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-09T17:17:21.596725] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-09T17:17:22.363168] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T17:17:22.396673] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-09T17:17:22.553239] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:17:23.185634] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T17:17:23.187261] [INFO ] [REMOTE ] APOS: Full fetch complete (10376 records). [2025-10-09T17:17:23.187361] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-09T17:17:23.203724] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-09T17:17:23.668955] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-09T17:17:23.669162] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-09T17:17:23.669418] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-09T17:17:23.669480] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-09T17:17:23.669981] [DEBUG] [LOCAL ] APOS: Trimmed 10376 records to 7556 (keeping 200 days of data) [2025-10-09T17:17:23.716537] [DEBUG] [LOCAL ] APOS: Primary data saved (7556 records). [2025-10-09T17:17:23.716702] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-09T17:17:23.716845] [INFO ] [MAIN ] Update Progress: 134/2373 symbols completed. APOS took 18.2s. Estimated remaining: 4h 49m 40s. Rate: 7.7 symbols/min [2025-10-09T17:17:23.883767] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:23.891142] [DEBUG] [LOCAL ] AQNB: Loaded 4147 existing records from primary storage. [2025-10-09T17:17:23.891331] [INFO ] [MAIN ] AQNB: Loaded 4147 existing records. [2025-10-09T17:17:24.001922] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-09T17:17:24.068429] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:24.068685] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-09T17:17:24.068744] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-09T17:17:24.068951] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-09T17:17:24.069009] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-09T17:17:24.418424] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:24.796721] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-09T17:17:25.451614] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-09T17:17:25.596701] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-09T17:17:25.888738] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T17:17:26.396702] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-09T17:17:26.918835] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-09T17:17:27.162108] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:17:27.196711] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-09T17:17:27.954277] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T17:17:27.996726] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-09T17:17:28.546281] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:17:28.796742] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-09T17:17:29.016254] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T17:17:29.596776] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-09T17:17:30.294345] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:17:30.396751] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-09T17:17:30.816206] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T17:17:31.196677] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-09T17:17:31.708262] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T17:17:31.738090] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T17:17:31.996737] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-09T17:17:32.796718] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-09T17:17:33.596749] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-09T17:17:33.820587] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:17:34.174487] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T17:17:34.396703] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-09T17:17:34.534248] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T17:17:35.014708] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T17:17:35.196747] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-09T17:17:35.774699] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T17:17:35.996733] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-09T17:17:36.796775] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-09T17:17:37.446892] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:17:37.596718] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-09T17:17:38.396772] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-09T17:17:39.079459] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T17:17:39.198184] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-09T17:17:39.201027] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-09T17:17:39.477676] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:17:39.826366] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T17:17:39.996774] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-09T17:17:40.796723] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-09T17:17:41.596791] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-09T17:17:41.853227] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T17:17:41.943754] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-09T17:17:42.396743] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-09T17:17:42.862749] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-09T17:17:42.972602] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T17:17:43.196718] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-09T17:17:43.996731] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-09T17:17:44.524778] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T17:17:44.525841] [INFO ] [REMOTE ] AQNB: Full fetch complete (5557 records). [2025-10-09T17:17:44.525971] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-09T17:17:44.810118] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-09T17:17:44.896253] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-09T17:17:44.896328] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-09T17:17:44.896481] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-09T17:17:44.896520] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-09T17:17:44.896918] [DEBUG] [LOCAL ] AQNB: Trimmed 5557 records to 4155 (keeping 200 days of data) [2025-10-09T17:17:44.922902] [DEBUG] [LOCAL ] AQNB: Primary data saved (4155 records). [2025-10-09T17:17:44.922988] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-09T17:17:44.923060] [INFO ] [MAIN ] Update Progress: 135/2373 symbols completed. AQNB took 21.2s. Estimated remaining: 4h 53m 15s. Rate: 7.6 symbols/min [2025-10-09T17:17:45.092513] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:45.143738] [DEBUG] [LOCAL ] AR: Loaded 53590 existing records from primary storage. [2025-10-09T17:17:45.170217] [INFO ] [MAIN ] AR: Loaded 53590 existing records. [2025-10-09T17:17:45.239855] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T17:17:45.366689] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:45.366916] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-09T17:17:45.366963] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-09T17:17:45.367908] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-09T17:17:45.367981] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-09T17:17:45.604156] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-09T17:17:45.718519] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:46.396693] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-09T17:17:46.540214] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:17:47.196700] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-09T17:17:47.374622] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T17:17:47.996787] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-09T17:17:48.376328] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T17:17:48.624788] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T17:17:48.796714] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-09T17:17:49.596692] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-09T17:17:49.680937] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:17:49.684816] [INFO ] [REMOTE ] APTV: Full fetch complete (75484 records). [2025-10-09T17:17:49.684909] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-09T17:17:49.685681] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:17:49.685770] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:17:49.685813] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:17:49.685878] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-09T17:17:49.685942] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-09T17:17:49.685978] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-09T17:17:49.686185] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-10-09T17:17:49.686731] [INFO ] [MAIN ] Update Progress: 136/2373 symbols completed. APTV took 36.9s. Estimated remaining: 4h 52m 16s. Rate: 7.7 symbols/min [2025-10-09T17:17:49.850535] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:49.850729] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-09T17:17:49.850777] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-09T17:17:49.850884] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-09T17:17:49.850926] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-09T17:17:49.850967] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-09T17:17:49.850998] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-09T17:17:50.200493] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:50.396709] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-09T17:17:50.561175] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:17:51.196760] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-09T17:17:51.357158] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T17:17:51.731829] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T17:17:51.996727] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-09T17:17:52.796708] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-09T17:17:52.920195] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T17:17:53.596695] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-09T17:17:53.691113] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T17:17:53.870406] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:17:54.396728] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-09T17:17:55.196727] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-09T17:17:55.317881] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T17:17:55.690808] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:17:55.996770] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-09T17:17:56.796725] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-09T17:17:56.980600] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T17:17:57.603735] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-09T17:17:57.605483] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T17:17:57.609780] [INFO ] [REMOTE ] AQN: Full fetch complete (74878 records). [2025-10-09T17:17:57.609898] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-09T17:17:57.610854] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:17:57.611244] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:17:57.611331] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:17:57.611407] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-09T17:17:57.611491] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-09T17:17:57.611548] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-09T17:17:57.611763] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-09T17:17:57.611859] [INFO ] [MAIN ] Update Progress: 137/2373 symbols completed. AQN took 41.0s. Estimated remaining: 4h 52m 10s. Rate: 7.7 symbols/min [2025-10-09T17:17:57.795492] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:57.811326] [DEBUG] [LOCAL ] ARDC: Loaded 15046 existing records from primary storage. [2025-10-09T17:17:57.811550] [INFO ] [MAIN ] ARDC: Loaded 15046 existing records. [2025-10-09T17:17:57.988514] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:57.988778] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-09T17:17:57.988829] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-09T17:17:57.989352] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-09T17:17:57.989409] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-09T17:17:58.354632] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:58.397073] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-09T17:17:58.398101] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T17:17:59.196711] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-09T17:17:59.279052] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:17:59.534755] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T17:17:59.996775] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-09T17:18:00.639494] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:18:00.685411] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T17:18:00.796703] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-09T17:18:01.451069] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T17:18:01.596700] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-09T17:18:02.396742] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-09T17:18:02.658166] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T17:18:03.196707] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-09T17:18:03.996713] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-09T17:18:04.371950] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T17:18:04.796689] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-09T17:18:04.982014] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:18:05.078576] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T17:18:05.596703] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-09T17:18:06.396713] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-09T17:18:06.463787] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:18:06.636625] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T17:18:06.641260] [INFO ] [REMOTE ] APO: Full fetch complete (77290 records). [2025-10-09T17:18:06.641369] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-09T17:18:07.043995] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-09T17:18:07.044100] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-09T17:18:07.044870] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-09T17:18:07.044933] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-09T17:18:07.046674] [DEBUG] [LOCAL ] APO: Trimmed 77290 records to 53773 (keeping 200 days of data) [2025-10-09T17:18:07.229719] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-09T17:18:07.382672] [DEBUG] [LOCAL ] APO: Primary data saved (53773 records). [2025-10-09T17:18:07.382829] [INFO ] [MAIN ] APO: Full history saved. [2025-10-09T17:18:07.384046] [INFO ] [MAIN ] Update Progress: 138/2373 symbols completed. APO took 1m 4s. Estimated remaining: 4h 52m 33s. Rate: 7.6 symbols/min [2025-10-09T17:18:07.553524] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:07.585632] [DEBUG] [LOCAL ] ARDT: Loaded 27723 existing records from primary storage. [2025-10-09T17:18:07.585950] [INFO ] [MAIN ] ARDT: Loaded 27723 existing records. [2025-10-09T17:18:07.776897] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:07.777189] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-09T17:18:07.777240] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-09T17:18:07.778032] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-09T17:18:07.778093] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-09T17:18:08.002826] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-09T17:18:08.168872] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T17:18:08.208192] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:08.796702] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-09T17:18:08.990906] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:18:09.296253] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-09T17:18:09.596723] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-09T17:18:10.044163] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T17:18:10.353276] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T17:18:10.396678] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-09T17:18:11.191014] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T17:18:11.196672] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-09T17:18:11.996714] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-09T17:18:12.796700] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-09T17:18:12.934106] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:18:13.596710] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-09T17:18:13.720886] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:18:13.858577] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:18:14.396737] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-09T17:18:14.507717] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T17:18:15.196709] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-09T17:18:15.435023] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T17:18:15.996735] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-09T17:18:16.796754] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-09T17:18:16.946264] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T17:18:16.979520] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T17:18:17.596719] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-09T17:18:18.396698] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-09T17:18:18.675283] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T17:18:19.196700] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-09T17:18:19.460279] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T17:18:19.458538] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:18:19.476204] [INFO ] [REMOTE ] ARDC: Full fetch complete (20988 records). [2025-10-09T17:18:19.476703] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-09T17:18:19.477683] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:18:19.477772] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:18:19.477816] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:18:19.477885] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-09T17:18:19.477949] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-09T17:18:19.478025] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-09T17:18:19.478234] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-09T17:18:19.478332] [INFO ] [MAIN ] Update Progress: 139/2373 symbols completed. ARDC took 21.9s. Estimated remaining: 4h 53m 34s. Rate: 7.6 symbols/min [2025-10-09T17:18:19.642371] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:19.689087] [DEBUG] [LOCAL ] ARE: Loaded 50757 existing records from primary storage. [2025-10-09T17:18:19.689436] [INFO ] [MAIN ] ARE: Loaded 50757 existing records. [2025-10-09T17:18:19.866102] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:19.866302] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-09T17:18:19.866348] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-09T17:18:19.867857] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-09T17:18:19.867918] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-09T17:18:20.003414] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-09T17:18:20.219732] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:20.478004] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T17:18:20.796710] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-09T17:18:21.596687] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-09T17:18:21.751873] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T17:18:21.755824] [INFO ] [REMOTE ] AR: Full fetch complete (77162 records). [2025-10-09T17:18:21.755932] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-09T17:18:21.756720] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:18:21.756811] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:18:21.756854] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:18:21.756894] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-09T17:18:21.756948] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-09T17:18:21.756986] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-09T17:18:21.757153] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-10-09T17:18:21.758172] [INFO ] [MAIN ] Update Progress: 140/2373 symbols completed. AR took 36.8s. Estimated remaining: 4h 51m 56s. Rate: 7.6 symbols/min [2025-10-09T17:18:21.925151] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:21.975380] [DEBUG] [LOCAL ] ARES: Loaded 49647 existing records from primary storage. [2025-10-09T17:18:21.975726] [INFO ] [MAIN ] ARES: Loaded 49647 existing records. [2025-10-09T17:18:22.153972] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:22.154187] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-09T17:18:22.154239] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-09T17:18:22.155858] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-09T17:18:22.155918] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-09T17:18:22.397704] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-09T17:18:22.423853] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:18:22.450444] [INFO ] [REMOTE ] ARCO: Full fetch complete (65210 records). [2025-10-09T17:18:22.462757] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-09T17:18:22.668334] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:22.936180] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-09T17:18:22.936285] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-09T17:18:22.937092] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-09T17:18:22.937256] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-09T17:18:22.938983] [DEBUG] [LOCAL ] ARCO: Trimmed 65210 records to 44723 (keeping 200 days of data) [2025-10-09T17:18:23.040369] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:18:23.206927] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-09T17:18:23.224020] [DEBUG] [LOCAL ] ARCO: Primary data saved (44723 records). [2025-10-09T17:18:23.224154] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-09T17:18:23.224226] [INFO ] [MAIN ] Update Progress: 141/2373 symbols completed. ARCO took 33.5s. Estimated remaining: 4h 50m 8s. Rate: 7.7 symbols/min [2025-10-09T17:18:23.390483] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:23.429589] [DEBUG] [LOCAL ] ARI: Loaded 43669 existing records from primary storage. [2025-10-09T17:18:23.429929] [INFO ] [MAIN ] ARI: Loaded 43669 existing records. [2025-10-09T17:18:23.601584] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:23.601832] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-09T17:18:23.601880] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-09T17:18:23.603125] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-09T17:18:23.603184] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-09T17:18:23.954154] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:23.996670] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-09T17:18:24.041841] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:18:24.796704] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-09T17:18:25.007032] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T17:18:25.596754] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-09T17:18:25.749537] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:18:25.895080] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T17:18:26.396767] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-09T17:18:27.042414] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:18:27.196678] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-09T17:18:27.843103] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:18:27.996691] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-09T17:18:28.796747] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-09T17:18:28.824304] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T17:18:29.451713] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T17:18:29.596694] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-09T17:18:29.860059] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T17:18:30.396724] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-09T17:18:30.857115] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T17:18:31.196710] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-09T17:18:31.996694] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-09T17:18:32.200378] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T17:18:32.695955] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T17:18:32.796720] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-09T17:18:33.266375] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T17:18:33.596709] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-09T17:18:34.396756] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-09T17:18:34.794052] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T17:18:34.792906] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T17:18:35.196703] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-09T17:18:35.835887] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T17:18:35.996671] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-09T17:18:36.187708] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T17:18:36.796710] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-09T17:18:37.596690] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-09T17:18:37.713773] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T17:18:37.998637] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T17:18:38.001549] [INFO ] [REMOTE ] ARDT: Full fetch complete (41603 records). [2025-10-09T17:18:38.001624] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-09T17:18:38.370424] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-09T17:18:38.370508] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-09T17:18:38.370997] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-09T17:18:38.371061] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-09T17:18:38.372095] [DEBUG] [LOCAL ] ARDT: Trimmed 41603 records to 27921 (keeping 200 days of data) [2025-10-09T17:18:38.424365] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-09T17:18:38.550669] [DEBUG] [LOCAL ] ARDT: Primary data saved (27921 records). [2025-10-09T17:18:38.550814] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-09T17:18:38.550896] [INFO ] [MAIN ] Update Progress: 142/2373 symbols completed. ARDT took 31.2s. Estimated remaining: 4h 51m 58s. Rate: 7.6 symbols/min [2025-10-09T17:18:38.722896] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:38.770061] [DEBUG] [LOCAL ] ARIS: Loaded 42358 existing records from primary storage. [2025-10-09T17:18:38.770394] [INFO ] [MAIN ] ARIS: Loaded 42358 existing records. [2025-10-09T17:18:38.948580] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:38.948897] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-09T17:18:38.948990] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-09T17:18:38.949749] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-09T17:18:38.949809] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-09T17:18:39.203865] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-09T17:18:39.324866] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:39.382769] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:18:39.996724] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-09T17:18:40.341772] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:18:40.765048] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T17:18:40.796666] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-09T17:18:41.466330] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T17:18:41.596724] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-09T17:18:42.396691] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-09T17:18:42.542356] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T17:18:43.196746] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-09T17:18:43.288326] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T17:18:43.687699] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T17:18:43.996739] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-09T17:18:44.761373] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T17:18:44.796734] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-09T17:18:45.596708] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-09T17:18:45.675872] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:18:46.371777] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T17:18:46.396667] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-09T17:18:47.196691] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-09T17:18:47.622553] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T17:18:47.936410] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T17:18:47.996728] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-09T17:18:48.796691] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-09T17:18:48.847541] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T17:18:49.198788] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T17:18:49.596727] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-09T17:18:50.095988] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T17:18:50.396689] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-09T17:18:51.081935] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T17:18:51.196681] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-09T17:18:51.996689] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-09T17:18:52.162955] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T17:18:52.796684] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-09T17:18:52.827305] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:18:53.516052] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:18:53.596696] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-09T17:18:54.374072] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T17:18:54.396667] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-09T17:18:55.009276] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T17:18:55.196700] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-09T17:18:55.996693] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-09T17:18:56.014411] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T17:18:56.019536] [INFO ] [REMOTE ] ARE: Full fetch complete (72719 records). [2025-10-09T17:18:56.019677] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-09T17:18:56.434308] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-09T17:18:56.434421] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-09T17:18:56.435445] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-09T17:18:56.435524] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-09T17:18:56.436982] [DEBUG] [LOCAL ] ARE: Trimmed 72719 records to 51142 (keeping 200 days of data) [2025-10-09T17:18:56.721122] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T17:18:56.796671] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-09T17:18:56.800039] [DEBUG] [LOCAL ] ARE: Primary data saved (51142 records). [2025-10-09T17:18:56.800116] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-09T17:18:56.800203] [INFO ] [MAIN ] Update Progress: 143/2373 symbols completed. ARE took 37.3s. Estimated remaining: 4h 54m 32s. Rate: 7.6 symbols/min [2025-10-09T17:18:56.965777] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:56.965953] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-09T17:18:56.965990] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-09T17:18:56.966098] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-09T17:18:56.966139] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-09T17:18:56.966181] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-09T17:18:56.966214] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-09T17:18:57.332481] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:57.355339] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T17:18:57.596772] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-09T17:18:58.396753] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-09T17:18:58.631525] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T17:18:58.636016] [INFO ] [REMOTE ] ARES: Full fetch complete (70929 records). [2025-10-09T17:18:58.636124] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-09T17:18:59.028568] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-09T17:18:59.028746] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-09T17:18:59.029616] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-09T17:18:59.029863] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-09T17:18:59.031391] [DEBUG] [LOCAL ] ARES: Trimmed 70929 records to 50035 (keeping 200 days of data) [2025-10-09T17:18:59.221253] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-09T17:18:59.286225] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:18:59.396682] [DEBUG] [LOCAL ] ARES: Primary data saved (50035 records). [2025-10-09T17:18:59.396821] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-09T17:18:59.397701] [INFO ] [MAIN ] Update Progress: 144/2373 symbols completed. ARES took 37.6s. Estimated remaining: 4h 53m 2s. Rate: 7.6 symbols/min [2025-10-09T17:18:59.578787] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:59.642736] [DEBUG] [LOCAL ] ARMK: Loaded 50319 existing records from primary storage. [2025-10-09T17:18:59.643137] [INFO ] [MAIN ] ARMK: Loaded 50319 existing records. [2025-10-09T17:18:59.826925] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:59.827165] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-09T17:18:59.827212] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-09T17:18:59.827409] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-09T17:18:59.827464] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-09T17:19:00.012699] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-09T17:19:00.205003] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:00.219514] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T17:19:00.796705] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-09T17:19:00.935975] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T17:19:01.596690] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-09T17:19:01.740218] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T17:19:02.136507] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T17:19:02.396755] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-09T17:19:03.196704] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-09T17:19:03.327160] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T17:19:03.497190] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T17:19:03.996725] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-09T17:19:04.803696] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-09T17:19:04.806532] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T17:19:05.261146] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T17:19:05.596735] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-09T17:19:06.071119] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T17:19:06.396735] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-09T17:19:07.126189] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:19:07.196677] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-09T17:19:07.673003] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T17:19:07.677137] [INFO ] [REMOTE ] ARIS: Full fetch complete (61193 records). [2025-10-09T17:19:07.677244] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-09T17:19:08.001950] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-09T17:19:08.079303] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-09T17:19:08.079382] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-09T17:19:08.080055] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-09T17:19:08.080120] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-09T17:19:08.081413] [DEBUG] [LOCAL ] ARIS: Trimmed 61193 records to 42740 (keeping 200 days of data) [2025-10-09T17:19:08.343094] [DEBUG] [LOCAL ] ARIS: Primary data saved (42740 records). [2025-10-09T17:19:08.343225] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-09T17:19:08.344040] [INFO ] [MAIN ] Update Progress: 145/2373 symbols completed. ARIS took 29.8s. Estimated remaining: 4h 53m 10s. Rate: 7.6 symbols/min [2025-10-09T17:19:08.519338] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:08.565396] [DEBUG] [LOCAL ] AROC: Loaded 48975 existing records from primary storage. [2025-10-09T17:19:08.565758] [INFO ] [MAIN ] AROC: Loaded 48975 existing records. [2025-10-09T17:19:08.687791] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:19:08.727462] [INFO ] [REMOTE ] ARI: Full fetch complete (62576 records). [2025-10-09T17:19:08.748103] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-09T17:19:08.769680] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:08.801372] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-09T17:19:08.850505] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-09T17:19:08.861403] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-09T17:19:08.871919] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-09T17:19:08.872199] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-09T17:19:09.510283] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-09T17:19:09.541459] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-09T17:19:09.542414] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-09T17:19:09.541386] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:09.542611] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-09T17:19:09.544613] [DEBUG] [LOCAL ] ARI: Trimmed 62576 records to 43991 (keeping 200 days of data) [2025-10-09T17:19:09.609965] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-09T17:19:09.659879] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T17:19:09.847800] [DEBUG] [LOCAL ] ARI: Primary data saved (43991 records). [2025-10-09T17:19:09.847946] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-09T17:19:09.848567] [INFO ] [MAIN ] Update Progress: 146/2373 symbols completed. ARI took 46.6s. Estimated remaining: 4h 51m 25s. Rate: 7.6 symbols/min [2025-10-09T17:19:10.015697] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:10.015907] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-09T17:19:10.015944] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-09T17:19:10.016056] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-09T17:19:10.016097] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-09T17:19:10.016140] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-09T17:19:10.016216] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-09T17:19:10.378927] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:10.396668] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-09T17:19:10.610936] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T17:19:11.102897] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T17:19:11.196715] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-09T17:19:11.996731] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-09T17:19:12.146419] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:19:12.362375] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T17:19:12.796770] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-09T17:19:13.596706] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-09T17:19:13.768264] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T17:19:14.396714] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-09T17:19:14.480949] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:19:15.196678] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-09T17:19:15.537356] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T17:19:15.905045] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T17:19:15.996675] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-09T17:19:16.796753] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-09T17:19:16.994484] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:19:17.571276] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T17:19:17.596664] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-09T17:19:18.329531] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T17:19:18.396680] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-09T17:19:19.196686] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-09T17:19:19.254221] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T17:19:19.832530] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:19:19.996690] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-09T17:19:20.796697] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-09T17:19:20.996090] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T17:19:21.596704] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-09T17:19:21.736546] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:19:22.107983] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T17:19:22.396775] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-09T17:19:23.108711] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:19:23.196683] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-09T17:19:23.996750] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-09T17:19:24.560412] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-09T17:19:24.716955] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:19:24.796691] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-09T17:19:25.596693] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-09T17:19:25.759287] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T17:19:26.373340] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T17:19:26.396678] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-09T17:19:27.196696] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-09T17:19:27.254785] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T17:19:27.996702] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-09T17:19:28.206669] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T17:19:28.539630] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T17:19:28.796722] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-09T17:19:29.594618] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:19:29.596683] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-09T17:19:30.398058] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:19:30.396994] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-09T17:19:31.196684] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-09T17:19:31.243747] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:19:31.996694] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-09T17:19:32.446213] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-09T17:19:32.501579] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:19:32.796738] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-09T17:19:33.472764] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T17:19:33.476363] [INFO ] [REMOTE ] ARLO: Full fetch complete (62822 records). [2025-10-09T17:19:33.476458] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-09T17:19:33.601883] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-09T17:19:33.869465] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-09T17:19:33.869609] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-09T17:19:33.870918] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-09T17:19:33.870984] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-09T17:19:33.872283] [DEBUG] [LOCAL ] ARLO: Trimmed 62822 records to 43989 (keeping 200 days of data) [2025-10-09T17:19:33.966342] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T17:19:33.972279] [INFO ] [REMOTE ] ARMK: Full fetch complete (72644 records). [2025-10-09T17:19:33.973193] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-09T17:19:34.461267] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-09T17:19:34.457637] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-09T17:19:34.461384] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-09T17:19:34.463664] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-09T17:19:34.473800] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-09T17:19:34.503271] [DEBUG] [LOCAL ] ARMK: Trimmed 72644 records to 50707 (keeping 200 days of data) [2025-10-09T17:19:34.741685] [DEBUG] [LOCAL ] ARLO: Primary data saved (43989 records). [2025-10-09T17:19:34.767780] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-09T17:19:34.769371] [INFO ] [MAIN ] Update Progress: 147/2373 symbols completed. ARLO took 38.0s. Estimated remaining: 4h 55m 36s. Rate: 7.5 symbols/min [2025-10-09T17:19:34.967701] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:35.039855] [DEBUG] [LOCAL ] ARMK: Primary data saved (50707 records). [2025-10-09T17:19:35.040004] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-09T17:19:35.040633] [INFO ] [MAIN ] Update Progress: 148/2373 symbols completed. ARMK took 35.6s. Estimated remaining: 4h 53m 32s. Rate: 7.6 symbols/min [2025-10-09T17:19:35.165929] [DEBUG] [LOCAL ] ARW: Loaded 32823 existing records from primary storage. [2025-10-09T17:19:35.187304] [INFO ] [MAIN ] ARW: Loaded 32823 existing records. [2025-10-09T17:19:35.299307] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:35.311091] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-09T17:19:35.321457] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-09T17:19:35.338012] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-09T17:19:35.353944] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-09T17:19:35.387602] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-09T17:19:35.418027] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:35.418189] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-09T17:19:35.453570] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-09T17:19:35.492117] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-09T17:19:35.518810] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-09T17:19:35.518967] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-09T17:19:35.905121] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-09T17:19:36.075253] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-09T17:19:36.068067] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:36.097838] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-09T17:19:36.223727] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:36.355220] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:19:36.355470] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-09T17:19:36.355569] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:19:36.355637] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-09T17:19:36.355724] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:19:36.355797] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-09T17:19:36.355859] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-09T17:19:36.355895] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-09T17:19:36.355934] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-09T17:19:36.355979] [INFO ] [MAIN ] Update Progress: 149/2373 symbols completed. ARX took 1.3s. Estimated remaining: 4h 51m 45s. Rate: 7.6 symbols/min [2025-10-09T17:19:36.527606] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:36.578722] [DEBUG] [LOCAL ] AS: Loaded 53122 existing records from primary storage. [2025-10-09T17:19:36.579045] [INFO ] [MAIN ] AS: Loaded 53122 existing records. [2025-10-09T17:19:36.784668] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:36.787398] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-09T17:19:36.787487] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-09T17:19:36.788060] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-09T17:19:36.788121] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-09T17:19:36.789212] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-09T17:19:36.801868] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-09T17:19:37.152358] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:37.507709] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:19:37.511919] [INFO ] [REMOTE ] AROC: Full fetch complete (70993 records). [2025-10-09T17:19:37.512022] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-09T17:19:37.605081] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-09T17:19:37.915412] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-09T17:19:37.915496] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-09T17:19:37.916285] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-09T17:19:37.916353] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-09T17:19:37.917768] [DEBUG] [LOCAL ] AROC: Trimmed 70993 records to 49324 (keeping 200 days of data) [2025-10-09T17:19:38.233577] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:19:38.251310] [DEBUG] [LOCAL ] AROC: Primary data saved (49324 records). [2025-10-09T17:19:38.251470] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-09T17:19:38.252487] [INFO ] [MAIN ] Update Progress: 150/2373 symbols completed. AROC took 29.9s. Estimated remaining: 4h 50m 9s. Rate: 7.7 symbols/min [2025-10-09T17:19:38.402834] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-09T17:19:38.420556] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:38.420813] [DEBUG] [LOCAL ] ASA: No existing data file found in primary storage. [2025-10-09T17:19:38.420860] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-10-09T17:19:38.420988] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-09T17:19:38.421029] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-09T17:19:38.421069] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-09T17:19:38.421101] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-09T17:19:38.769504] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:39.196754] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-09T17:19:39.747951] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-09T17:19:39.856340] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T17:19:39.996715] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-09T17:19:40.432179] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:19:40.796766] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-09T17:19:41.432512] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T17:19:41.436996] [INFO ] [REMOTE ] ARR: Full fetch complete (75275 records). [2025-10-09T17:19:41.437143] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-09T17:19:41.610903] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-09T17:19:41.678075] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:19:41.839018] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-09T17:19:41.839096] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-09T17:19:41.839831] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-09T17:19:41.839895] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-09T17:19:41.841266] [DEBUG] [LOCAL ] ARR: Trimmed 75275 records to 52462 (keeping 200 days of data) [2025-10-09T17:19:42.161260] [DEBUG] [LOCAL ] ARR: Primary data saved (52462 records). [2025-10-09T17:19:42.161395] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-09T17:19:42.161478] [INFO ] [MAIN ] Update Progress: 151/2373 symbols completed. ARR took 32.3s. Estimated remaining: 4h 49m 4s. Rate: 7.7 symbols/min [2025-10-09T17:19:42.329474] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:42.379510] [DEBUG] [LOCAL ] ASAN: Loaded 52721 existing records from primary storage. [2025-10-09T17:19:42.379864] [INFO ] [MAIN ] ASAN: Loaded 52721 existing records. [2025-10-09T17:19:42.401842] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-09T17:19:42.560532] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:42.560858] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-09T17:19:42.560914] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-09T17:19:42.561134] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-09T17:19:42.561191] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-09T17:19:42.992890] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:43.020458] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:19:43.196784] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-09T17:19:43.977135] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:19:43.996726] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-09T17:19:44.796764] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-09T17:19:44.809933] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T17:19:45.387713] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-09T17:19:45.596725] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-09T17:19:46.098922] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T17:19:46.388997] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T17:19:46.396670] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-09T17:19:47.196778] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-09T17:19:47.767709] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T17:19:47.842546] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T17:19:47.996721] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-09T17:19:48.689013] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T17:19:48.796701] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-09T17:19:49.601377] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-09T17:19:49.603087] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:19:50.396710] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-09T17:19:51.196689] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-09T17:19:51.379477] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T17:19:51.825848] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:19:51.996697] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-09T17:19:52.031475] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T17:19:52.796735] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-09T17:19:53.194515] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T17:19:53.596720] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-09T17:19:54.044408] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:19:54.396760] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-09T17:19:54.941065] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T17:19:55.182449] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T17:19:55.196673] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-09T17:19:55.941499] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T17:19:55.996675] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-09T17:19:56.796735] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-09T17:19:57.050002] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:19:57.596748] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-09T17:19:58.286824] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T17:19:58.396749] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-09T17:19:58.782765] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T17:19:58.785051] [INFO ] [REMOTE ] ASA: Full fetch complete (19597 records). [2025-10-09T17:19:58.785137] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-09T17:19:59.143634] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-09T17:19:59.143740] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-09T17:19:59.144005] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-09T17:19:59.144053] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-09T17:19:59.144619] [DEBUG] [LOCAL ] ASA: Trimmed 19597 records to 14879 (keeping 200 days of data) [2025-10-09T17:19:59.207937] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-09T17:19:59.233809] [DEBUG] [LOCAL ] ASA: Primary data saved (14879 records). [2025-10-09T17:19:59.233905] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-09T17:19:59.233985] [INFO ] [MAIN ] Update Progress: 152/2373 symbols completed. ASA took 21.0s. Estimated remaining: 4h 51m 11s. Rate: 7.6 symbols/min [2025-10-09T17:19:59.402446] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:59.447822] [DEBUG] [LOCAL ] ASB: Loaded 49541 existing records from primary storage. [2025-10-09T17:19:59.448204] [INFO ] [MAIN ] ASB: Loaded 49541 existing records. [2025-10-09T17:19:59.622207] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:59.622425] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-09T17:19:59.622471] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-09T17:19:59.622808] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-09T17:19:59.622866] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-09T17:19:59.977569] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:59.996663] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-09T17:20:00.172608] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T17:20:00.587547] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T17:20:00.796768] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-09T17:20:01.608619] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-09T17:20:01.616557] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:20:02.260407] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:20:02.396785] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-09T17:20:03.196725] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-09T17:20:03.484487] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T17:20:04.001808] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-09T17:20:04.018206] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T17:20:04.796689] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-09T17:20:04.894985] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:20:05.596751] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-09T17:20:05.931966] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T17:20:05.967976] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T17:20:06.396731] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-09T17:20:06.715824] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T17:20:07.196739] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-09T17:20:07.998349] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-09T17:20:08.003936] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:20:08.796689] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-09T17:20:08.983165] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:20:09.111816] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T17:20:09.114732] [INFO ] [REMOTE ] ARW: Full fetch complete (48008 records). [2025-10-09T17:20:09.114819] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-09T17:20:09.511899] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-09T17:20:09.511978] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-09T17:20:09.512485] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-09T17:20:09.512524] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-09T17:20:09.513456] [DEBUG] [LOCAL ] ARW: Trimmed 48008 records to 33052 (keeping 200 days of data) [2025-10-09T17:20:09.601563] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-09T17:20:09.717334] [DEBUG] [LOCAL ] ARW: Primary data saved (33052 records). [2025-10-09T17:20:09.717471] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-09T17:20:09.717553] [INFO ] [MAIN ] Update Progress: 153/2373 symbols completed. ARW took 34.9s. Estimated remaining: 4h 51m 41s. Rate: 7.6 symbols/min [2025-10-09T17:20:09.895194] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:09.901286] [DEBUG] [LOCAL ] ASBA: Loaded 3456 existing records from primary storage. [2025-10-09T17:20:09.901467] [INFO ] [MAIN ] ASBA: Loaded 3456 existing records. [2025-10-09T17:20:10.100339] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:20:10.100705] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-09T17:20:10.100774] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-09T17:20:10.101003] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-09T17:20:10.101131] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-09T17:20:10.400376] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-09T17:20:10.463577] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:20:10.492876] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:20:11.196682] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-09T17:20:11.643218] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-09T17:20:11.996734] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-09T17:20:12.035263] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:20:12.796788] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-09T17:20:13.596710] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-09T17:20:13.925122] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-09T17:20:13.990420] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T17:20:14.139538] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T17:20:14.396729] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-09T17:20:14.900141] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-09T17:20:15.196744] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-09T17:20:15.241699] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-09T17:20:15.996730] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-09T17:20:16.459776] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T17:20:16.796741] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-09T17:20:17.069401] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:20:17.348271] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:20:17.596794] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-09T17:20:18.396875] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-09T17:20:18.884228] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T17:20:18.954051] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T17:20:19.196742] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-09T17:20:19.996721] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-09T17:20:20.796690] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-09T17:20:20.896271] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T17:20:21.596692] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-09T17:20:21.894948] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T17:20:22.159300] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T17:20:22.396712] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-09T17:20:22.905425] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T17:20:23.196719] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-09T17:20:23.866520] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T17:20:23.996709] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-09T17:20:24.796696] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-09T17:20:24.999717] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:20:25.004351] [INFO ] [REMOTE ] ASAN: Full fetch complete (76527 records). [2025-10-09T17:20:25.004478] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-09T17:20:25.381293] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T17:20:25.415157] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-09T17:20:25.415247] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-09T17:20:25.416003] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-09T17:20:25.416066] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-09T17:20:25.417461] [DEBUG] [LOCAL ] ASAN: Trimmed 76527 records to 53111 (keeping 200 days of data) [2025-10-09T17:20:25.618720] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-09T17:20:25.740879] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T17:20:25.746868] [INFO ] [REMOTE ] AS: Full fetch complete (76561 records). [2025-10-09T17:20:25.747510] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-09T17:20:25.870988] [DEBUG] [LOCAL ] ASAN: Primary data saved (53111 records). [2025-10-09T17:20:25.881349] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-09T17:20:25.900464] [INFO ] [MAIN ] Update Progress: 154/2373 symbols completed. ASAN took 43.7s. Estimated remaining: 4h 53m 33s. Rate: 7.6 symbols/min [2025-10-09T17:20:26.248356] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:26.334998] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-09T17:20:26.335080] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-09T17:20:26.335841] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-09T17:20:26.335924] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-09T17:20:26.338553] [DEBUG] [LOCAL ] AS: Trimmed 76561 records to 53512 (keeping 200 days of data) [2025-10-09T17:20:26.396758] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-09T17:20:26.459979] [DEBUG] [LOCAL ] ASC: Loaded 37471 existing records from primary storage. [2025-10-09T17:20:26.461886] [INFO ] [MAIN ] ASC: Loaded 37471 existing records. [2025-10-09T17:20:26.659569] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:20:26.663502] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-09T17:20:26.665537] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-09T17:20:26.673997] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-09T17:20:26.674064] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-09T17:20:26.990528] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T17:20:27.201480] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-09T17:20:27.221671] [DEBUG] [LOCAL ] AS: Primary data saved (53512 records). [2025-10-09T17:20:27.239126] [INFO ] [MAIN ] AS: Full history saved. [2025-10-09T17:20:27.260433] [INFO ] [MAIN ] Update Progress: 155/2373 symbols completed. AS took 50.9s. Estimated remaining: 4h 51m 51s. Rate: 7.6 symbols/min [2025-10-09T17:20:27.280010] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:20:27.459628] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:27.488749] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:20:27.512315] [DEBUG] [LOCAL ] ASG: Loaded 19553 existing records from primary storage. [2025-10-09T17:20:27.512556] [INFO ] [MAIN ] ASG: Loaded 19553 existing records. [2025-10-09T17:20:27.635435] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T17:20:27.705754] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:20:27.705948] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-09T17:20:27.705996] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-09T17:20:27.706201] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-09T17:20:27.706258] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-09T17:20:28.000022] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-09T17:20:28.079986] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:20:28.348314] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T17:20:28.796786] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-09T17:20:29.596737] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-09T17:20:30.402164] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-09T17:20:30.407600] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T17:20:31.094610] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:20:31.095455] [INFO ] [REMOTE ] ASBA: Full fetch complete (5192 records). [2025-10-09T17:20:31.095525] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-09T17:20:31.200848] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-09T17:20:31.347172] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:20:31.489457] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-09T17:20:31.489541] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-09T17:20:31.489737] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-09T17:20:31.489799] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-09T17:20:31.490159] [DEBUG] [LOCAL ] ASBA: Trimmed 5192 records to 3471 (keeping 200 days of data) [2025-10-09T17:20:31.511364] [DEBUG] [LOCAL ] ASBA: Primary data saved (3471 records). [2025-10-09T17:20:31.511452] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-09T17:20:31.511529] [INFO ] [MAIN ] Update Progress: 156/2373 symbols completed. ASBA took 21.8s. Estimated remaining: 4h 50m 51s. Rate: 7.6 symbols/min [2025-10-09T17:20:31.675767] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:31.701943] [DEBUG] [LOCAL ] ASGI: Loaded 22731 existing records from primary storage. [2025-10-09T17:20:31.702282] [INFO ] [MAIN ] ASGI: Loaded 22731 existing records. [2025-10-09T17:20:31.951512] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:20:31.951775] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-09T17:20:31.951824] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-09T17:20:31.952036] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-09T17:20:31.952092] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-09T17:20:32.004580] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-09T17:20:32.298320] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:20:32.796719] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-09T17:20:32.811868] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T17:20:32.816280] [INFO ] [REMOTE ] ASB: Full fetch complete (71749 records). [2025-10-09T17:20:32.816396] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-09T17:20:33.215438] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-09T17:20:33.215967] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:20:33.216180] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-09T17:20:33.222076] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-09T17:20:33.222141] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-09T17:20:33.223616] [DEBUG] [LOCAL ] ASB: Trimmed 71749 records to 49923 (keeping 200 days of data) [2025-10-09T17:20:33.530959] [DEBUG] [LOCAL ] ASB: Primary data saved (49923 records). [2025-10-09T17:20:33.531108] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-09T17:20:33.531979] [INFO ] [MAIN ] Update Progress: 157/2373 symbols completed. ASB took 34.3s. Estimated remaining: 4h 49m 21s. Rate: 7.7 symbols/min [2025-10-09T17:20:33.596743] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-09T17:20:33.958018] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:20:34.396739] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-09T17:20:34.764955] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T17:20:35.196726] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-09T17:20:35.982220] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T17:20:35.996699] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-09T17:20:36.314946] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T17:20:36.796781] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-09T17:20:37.325584] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T17:20:37.596694] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-09T17:20:37.839384] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T17:20:38.396755] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-09T17:20:38.586207] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T17:20:39.196701] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-09T17:20:39.511115] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:20:39.996695] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-09T17:20:40.370555] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:20:40.796784] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-09T17:20:41.546521] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:20:41.596683] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-09T17:20:41.894721] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T17:20:42.396730] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-09T17:20:43.065044] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:20:43.196682] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-09T17:20:43.586754] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T17:20:43.996726] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-09T17:20:44.406095] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T17:20:44.796712] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-09T17:20:44.833790] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T17:20:45.596731] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-09T17:20:45.704184] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:20:46.396721] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-09T17:20:46.612260] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T17:20:47.196686] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-09T17:20:47.495865] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T17:20:47.809466] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T17:20:47.996711] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-09T17:20:48.796761] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-09T17:20:49.027617] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T17:20:49.596773] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-09T17:20:50.251046] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T17:20:50.396676] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-09T17:20:50.595484] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T17:20:51.196800] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-09T17:20:51.861245] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:20:51.996707] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-09T17:20:52.113045] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T17:20:52.114856] [INFO ] [REMOTE ] ASG: Full fetch complete (30969 records). [2025-10-09T17:20:52.114933] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-09T17:20:52.484715] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-09T17:20:52.484801] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-09T17:20:52.485178] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-09T17:20:52.485218] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-09T17:20:52.485935] [DEBUG] [LOCAL ] ASG: Trimmed 30969 records to 19644 (keeping 200 days of data) [2025-10-09T17:20:52.596859] [DEBUG] [LOCAL ] ASG: Primary data saved (19644 records). [2025-10-09T17:20:52.597054] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-09T17:20:52.597141] [INFO ] [MAIN ] Update Progress: 158/2373 symbols completed. ASG took 25.3s. Estimated remaining: 4h 51m 50s. Rate: 7.6 symbols/min [2025-10-09T17:20:52.796787] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-09T17:20:53.242972] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T17:20:53.534128] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T17:20:53.596680] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-09T17:20:54.396727] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-09T17:20:54.742702] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T17:20:55.196736] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-09T17:20:55.768823] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T17:20:55.772061] [INFO ] [REMOTE ] ASC: Full fetch complete (56330 records). [2025-10-09T17:20:55.772166] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-09T17:20:56.148039] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-09T17:20:56.148150] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-09T17:20:56.149117] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-09T17:20:56.149231] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-09T17:20:56.150461] [DEBUG] [LOCAL ] ASC: Trimmed 56330 records to 37693 (keeping 200 days of data) [2025-10-09T17:20:56.393763] [DEBUG] [LOCAL ] ASC: Primary data saved (37693 records). [2025-10-09T17:20:56.394276] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-09T17:20:56.394969] [INFO ] [MAIN ] Update Progress: 159/2373 symbols completed. ASC took 30.5s. Estimated remaining: 4h 50m 45s. Rate: 7.6 symbols/min [2025-10-09T17:20:56.396637] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T17:20:56.402901] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-09T17:20:57.521083] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T17:20:57.526833] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-09T17:20:58.549994] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T17:20:58.552226] [INFO ] [REMOTE ] ASGI: Full fetch complete (33295 records). [2025-10-09T17:20:58.552317] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-09T17:20:58.918800] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-09T17:20:58.918945] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-09T17:20:58.919353] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-09T17:20:58.919395] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-09T17:20:58.920154] [DEBUG] [LOCAL ] ASGI: Trimmed 33295 records to 22863 (keeping 200 days of data) [2025-10-09T17:20:59.055470] [DEBUG] [LOCAL ] ASGI: Primary data saved (22863 records). [2025-10-09T17:20:59.055600] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-09T17:20:59.055698] [INFO ] [MAIN ] Update Progress: 160/2373 symbols completed. ASGI took 27.5s. Estimated remaining: 4h 49m 25s. Rate: 7.6 symbols/min [2025-10-09T17:20:59.739380] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:59.704976] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:59.782140] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:59.808865] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:59.864253] [DEBUG] [LOCAL ] ASH: Loaded 37603 existing records from primary storage. [2025-10-09T17:20:59.863579] [DEBUG] [LOCAL ] ASIX: Loaded 22842 existing records from primary storage. [2025-10-09T17:20:59.864960] [INFO ] [MAIN ] ASH: Loaded 37603 existing records. [2025-10-09T17:20:59.865166] [INFO ] [MAIN ] ASIX: Loaded 22842 existing records. [2025-10-09T17:20:59.968299] [DEBUG] [LOCAL ] ASGN: Loaded 36282 existing records from primary storage. [2025-10-09T17:21:00.025379] [INFO ] [MAIN ] ASGN: Loaded 36282 existing records. [2025-10-09T17:21:00.152982] [DEBUG] [LOCAL ] ASPN: Loaded 49736 existing records from primary storage. [2025-10-09T17:21:00.278311] [INFO ] [MAIN ] ASPN: Loaded 49736 existing records. [2025-10-09T17:21:00.427588] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:00.382547] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:00.481160] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-09T17:21:00.495838] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-09T17:21:00.501220] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-09T17:21:00.519364] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-09T17:21:00.519538] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-09T17:21:00.524850] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-09T17:21:00.590802] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:00.610499] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-09T17:21:00.572060] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-09T17:21:00.632966] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-09T17:21:00.618866] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-09T17:21:00.757040] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-09T17:21:00.858353] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:00.855028] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-09T17:21:00.926164] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-09T17:21:00.991620] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-09T17:21:01.229139] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-09T17:21:01.252596] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-09T17:21:01.529889] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:01.614957] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-09T17:21:01.781618] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:01.861431] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-09T17:21:02.188483] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:02.184923] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:02.188867] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-09T17:21:02.189883] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-09T17:21:02.908958] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:21:02.912404] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-09T17:21:03.161492] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T17:21:03.168452] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-09T17:21:03.592113] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T17:21:03.596082] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-09T17:21:03.698213] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:21:03.704424] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-09T17:21:04.136071] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T17:21:04.146447] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-09T17:21:04.211746] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T17:21:04.240559] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T17:21:04.796741] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-09T17:21:05.143244] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T17:21:05.527553] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T17:21:05.596686] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-09T17:21:05.872252] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T17:21:06.396704] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-09T17:21:06.789995] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:21:07.196809] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-09T17:21:07.996717] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-09T17:21:08.201601] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T17:21:08.642324] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T17:21:08.796694] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-09T17:21:09.324151] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:21:09.596845] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-09T17:21:10.071622] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T17:21:10.396719] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-09T17:21:11.196705] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-09T17:21:11.301499] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:21:11.540097] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T17:21:11.996746] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-09T17:21:12.309988] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T17:21:12.796771] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-09T17:21:13.454328] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T17:21:13.596682] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-09T17:21:14.068905] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T17:21:14.396748] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-09T17:21:15.196733] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-09T17:21:15.617190] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T17:21:15.984346] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T17:21:15.996684] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-09T17:21:16.716099] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T17:21:16.796687] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-09T17:21:17.385692] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T17:21:17.596714] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-09T17:21:18.396706] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-09T17:21:18.461474] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:21:19.045926] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:21:19.196707] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-09T17:21:19.258100] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T17:21:19.996741] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-09T17:21:20.731517] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T17:21:20.796682] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-09T17:21:21.189023] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T17:21:21.596726] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-09T17:21:22.178189] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T17:21:22.396725] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-09T17:21:23.116464] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T17:21:23.196697] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-09T17:21:23.248277] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T17:21:23.996785] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-09T17:21:24.796744] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-09T17:21:25.098344] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T17:21:25.374374] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T17:21:25.493877] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T17:21:25.596685] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-09T17:21:26.396790] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-09T17:21:26.868984] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T17:21:26.872537] [INFO ] [REMOTE ] ASH: Full fetch complete (55173 records). [2025-10-09T17:21:26.872684] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-09T17:21:27.201868] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-09T17:21:27.277220] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-09T17:21:27.277307] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-09T17:21:27.277962] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-09T17:21:27.278052] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-09T17:21:27.282225] [DEBUG] [LOCAL ] ASH: Trimmed 55173 records to 37885 (keeping 200 days of data) [2025-10-09T17:21:27.517013] [DEBUG] [LOCAL ] ASH: Primary data saved (37885 records). [2025-10-09T17:21:27.517170] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-09T17:21:27.518037] [INFO ] [MAIN ] Update Progress: 161/2373 symbols completed. ASH took 28.4s. Estimated remaining: 4h 54m 1s. Rate: 7.5 symbols/min [2025-10-09T17:21:27.688585] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:27.703248] [DEBUG] [LOCAL ] ASR: Loaded 9328 existing records from primary storage. [2025-10-09T17:21:27.703474] [INFO ] [MAIN ] ASR: Loaded 9328 existing records. [2025-10-09T17:21:27.890902] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:27.891133] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-09T17:21:27.891180] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-09T17:21:27.891554] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-09T17:21:27.891619] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-09T17:21:28.003339] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-09T17:21:28.428587] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:28.496426] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T17:21:28.726732] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T17:21:28.796781] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-09T17:21:28.946540] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T17:21:29.596748] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-09T17:21:30.098825] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T17:21:30.103154] [INFO ] [REMOTE ] ASPN: Full fetch complete (72426 records). [2025-10-09T17:21:30.103256] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-09T17:21:30.401849] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-09T17:21:30.503854] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-09T17:21:30.509394] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-09T17:21:30.510238] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-09T17:21:30.510329] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-09T17:21:30.511265] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T17:21:30.514772] [DEBUG] [LOCAL ] ASPN: Trimmed 72426 records to 50114 (keeping 200 days of data) [2025-10-09T17:21:30.791661] [DEBUG] [LOCAL ] ASPN: Primary data saved (50114 records). [2025-10-09T17:21:30.791805] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-09T17:21:30.791886] [INFO ] [MAIN ] Update Progress: 162/2373 symbols completed. ASPN took 31.7s. Estimated remaining: 4h 52m 48s. Rate: 7.6 symbols/min [2025-10-09T17:21:30.959850] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:31.012200] [DEBUG] [LOCAL ] ASX: Loaded 52863 existing records from primary storage. [2025-10-09T17:21:31.012577] [INFO ] [MAIN ] ASX: Loaded 52863 existing records. [2025-10-09T17:21:31.192858] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:31.193108] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-09T17:21:31.193162] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-09T17:21:31.193364] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-09T17:21:31.193421] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-09T17:21:31.204732] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-09T17:21:31.567745] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:31.710328] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T17:21:31.713151] [INFO ] [REMOTE ] ASIX: Full fetch complete (30479 records). [2025-10-09T17:21:31.713245] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-09T17:21:32.006959] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-09T17:21:32.234830] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-09T17:21:32.234945] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-09T17:21:32.235486] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-09T17:21:32.235570] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-09T17:21:32.236753] [DEBUG] [LOCAL ] ASIX: Trimmed 30479 records to 22989 (keeping 200 days of data) [2025-10-09T17:21:32.397575] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:21:32.443348] [DEBUG] [LOCAL ] ASIX: Primary data saved (22989 records). [2025-10-09T17:21:32.443495] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-09T17:21:32.443589] [INFO ] [MAIN ] Update Progress: 163/2373 symbols completed. ASIX took 33.4s. Estimated remaining: 4h 51m 15s. Rate: 7.6 symbols/min [2025-10-09T17:21:32.621740] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:32.658841] [DEBUG] [LOCAL ] ATEN: Loaded 38823 existing records from primary storage. [2025-10-09T17:21:32.659142] [INFO ] [MAIN ] ATEN: Loaded 38823 existing records. [2025-10-09T17:21:32.804701] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-09T17:21:32.835412] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:32.835628] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-09T17:21:32.835714] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-09T17:21:32.835927] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-09T17:21:32.835985] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-09T17:21:33.186927] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:33.596690] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-09T17:21:33.865838] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:21:34.396692] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-09T17:21:34.459361] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:21:35.144078] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:21:35.196732] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-09T17:21:35.933216] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:21:35.996686] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-09T17:21:36.098895] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T17:21:36.796849] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-09T17:21:37.177365] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T17:21:37.529193] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T17:21:37.596686] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-09T17:21:38.342310] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T17:21:38.396668] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-09T17:21:39.196706] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-09T17:21:39.326589] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T17:21:39.996716] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-09T17:21:40.785174] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T17:21:40.788916] [INFO ] [REMOTE ] ASGN: Full fetch complete (52680 records). [2025-10-09T17:21:40.789013] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-09T17:21:40.802238] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-09T17:21:41.168182] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-09T17:21:41.168267] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-09T17:21:41.168860] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-09T17:21:41.168925] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-09T17:21:41.170110] [DEBUG] [LOCAL ] ASGN: Trimmed 52680 records to 36566 (keeping 200 days of data) [2025-10-09T17:21:41.380390] [DEBUG] [LOCAL ] ASGN: Primary data saved (36566 records). [2025-10-09T17:21:41.380522] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-09T17:21:41.380603] [INFO ] [MAIN ] Update Progress: 164/2373 symbols completed. ASGN took 42.3s. Estimated remaining: 4h 51m 21s. Rate: 7.6 symbols/min [2025-10-09T17:21:41.552372] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:41.584039] [DEBUG] [LOCAL ] ATGE: Loaded 31120 existing records from primary storage. [2025-10-09T17:21:41.584393] [INFO ] [MAIN ] ATGE: Loaded 31120 existing records. [2025-10-09T17:21:41.608711] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-09T17:21:41.767935] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:41.768482] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-09T17:21:41.768552] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-09T17:21:41.768812] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-09T17:21:41.768875] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-09T17:21:41.909530] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T17:21:42.183090] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:42.376711] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:21:42.396695] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-09T17:21:42.562853] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T17:21:43.196720] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-09T17:21:43.946059] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:21:43.996678] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-09T17:21:44.611279] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:21:44.796741] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-09T17:21:45.563390] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T17:21:45.596718] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-09T17:21:46.396690] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-09T17:21:46.495674] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:21:47.054320] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T17:21:47.196700] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-09T17:21:47.213952] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T17:21:47.996717] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-09T17:21:48.796749] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-09T17:21:48.985934] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:21:49.335263] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T17:21:49.384123] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T17:21:49.596765] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-09T17:21:50.396716] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-09T17:21:50.966213] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T17:21:51.196779] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-09T17:21:51.804675] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T17:21:51.996742] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-09T17:21:52.479863] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T17:21:52.796778] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-09T17:21:53.596754] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-09T17:21:53.826798] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T17:21:53.871927] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T17:21:54.396741] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-09T17:21:54.673913] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:21:55.201871] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-09T17:21:55.205482] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:21:55.996732] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-09T17:21:56.796741] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-09T17:21:56.999845] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T17:21:57.001018] [INFO ] [REMOTE ] ASR: Full fetch complete (12385 records). [2025-10-09T17:21:57.001092] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-09T17:21:57.295527] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-09T17:21:57.411417] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-09T17:21:57.411494] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-09T17:21:57.411736] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-09T17:21:57.411798] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-09T17:21:57.412252] [DEBUG] [LOCAL ] ASR: Trimmed 12385 records to 9380 (keeping 200 days of data) [2025-10-09T17:21:57.477242] [DEBUG] [LOCAL ] ASR: Primary data saved (9380 records). [2025-10-09T17:21:57.477372] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-09T17:21:57.477452] [INFO ] [MAIN ] Update Progress: 165/2373 symbols completed. ASR took 30.0s. Estimated remaining: 4h 53m 3s. Rate: 7.5 symbols/min [2025-10-09T17:21:57.601816] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-09T17:21:57.649851] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:57.682013] [DEBUG] [LOCAL ] ATHM: Loaded 31820 existing records from primary storage. [2025-10-09T17:21:57.682295] [INFO ] [MAIN ] ATHM: Loaded 31820 existing records. [2025-10-09T17:21:57.856017] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:57.856224] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-09T17:21:57.856270] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-09T17:21:57.856464] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-09T17:21:57.856520] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-09T17:21:58.216586] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:58.238059] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:21:58.396752] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-09T17:21:59.196761] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-09T17:21:59.258687] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:21:59.872116] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T17:21:59.996693] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-09T17:22:00.796761] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-09T17:22:01.065801] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T17:22:01.183367] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T17:22:01.596931] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-09T17:22:01.918270] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T17:22:02.396721] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-09T17:22:03.103557] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:22:03.196731] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-09T17:22:03.640263] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T17:22:03.643862] [INFO ] [REMOTE ] ATEN: Full fetch complete (56913 records). [2025-10-09T17:22:03.644009] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-09T17:22:04.018558] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-09T17:22:04.039860] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-09T17:22:04.039956] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-09T17:22:04.040584] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-09T17:22:04.040775] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-09T17:22:04.041979] [DEBUG] [LOCAL ] ATEN: Trimmed 56913 records to 39032 (keeping 200 days of data) [2025-10-09T17:22:04.292278] [DEBUG] [LOCAL ] ATEN: Primary data saved (39032 records). [2025-10-09T17:22:04.292436] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-09T17:22:04.293021] [INFO ] [MAIN ] Update Progress: 166/2373 symbols completed. ATEN took 31.8s. Estimated remaining: 4h 52m 39s. Rate: 7.5 symbols/min [2025-10-09T17:22:04.494506] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T17:22:04.506350] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:04.520437] [DEBUG] [LOCAL ] ATHS: Loaded 6780 existing records from primary storage. [2025-10-09T17:22:04.520832] [INFO ] [MAIN ] ATHS: Loaded 6780 existing records. [2025-10-09T17:22:04.715134] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:04.715401] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-09T17:22:04.715482] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-09T17:22:04.715744] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-09T17:22:04.715815] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-09T17:22:04.801952] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-09T17:22:05.085817] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:05.596704] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-09T17:22:05.876253] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T17:22:05.959135] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:22:06.396717] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-09T17:22:06.829355] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:22:07.196743] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-09T17:22:07.996756] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-09T17:22:08.245966] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-09T17:22:08.611191] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T17:22:08.796798] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-09T17:22:08.971063] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T17:22:09.596797] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-09T17:22:09.692875] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T17:22:09.695342] [INFO ] [REMOTE ] ATGE: Full fetch complete (46097 records). [2025-10-09T17:22:09.695420] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-09T17:22:10.073548] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-09T17:22:10.073695] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-09T17:22:10.074707] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-09T17:22:10.074776] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-09T17:22:10.076067] [DEBUG] [LOCAL ] ATGE: Trimmed 46097 records to 31305 (keeping 200 days of data) [2025-10-09T17:22:10.271627] [DEBUG] [LOCAL ] ATGE: Primary data saved (31305 records). [2025-10-09T17:22:10.271826] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-09T17:22:10.273108] [INFO ] [MAIN ] Update Progress: 167/2373 symbols completed. ATGE took 28.9s. Estimated remaining: 4h 52m 5s. Rate: 7.6 symbols/min [2025-10-09T17:22:10.412205] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-09T17:22:10.445481] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:10.510133] [DEBUG] [LOCAL ] ATI: Loaded 51415 existing records from primary storage. [2025-10-09T17:22:10.510483] [INFO ] [MAIN ] ATI: Loaded 51415 existing records. [2025-10-09T17:22:10.699258] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:10.699557] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-09T17:22:10.699619] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-09T17:22:10.699904] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-09T17:22:10.699966] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-09T17:22:11.110688] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:11.196735] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-09T17:22:11.386087] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T17:22:11.392057] [INFO ] [REMOTE ] ASX: Full fetch complete (76586 records). [2025-10-09T17:22:11.392239] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-09T17:22:11.818884] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-09T17:22:11.818986] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-09T17:22:11.819898] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-09T17:22:11.828090] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-09T17:22:11.844276] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T17:22:11.853893] [DEBUG] [LOCAL ] ASX: Trimmed 76586 records to 53246 (keeping 200 days of data) [2025-10-09T17:22:12.043981] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-09T17:22:12.194775] [DEBUG] [LOCAL ] ASX: Primary data saved (53246 records). [2025-10-09T17:22:12.194946] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-09T17:22:12.195043] [INFO ] [MAIN ] Update Progress: 168/2373 symbols completed. ASX took 41.4s. Estimated remaining: 4h 50m 38s. Rate: 7.6 symbols/min [2025-10-09T17:22:12.361675] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:12.395219] [DEBUG] [LOCAL ] ATKR: Loaded 35380 existing records from primary storage. [2025-10-09T17:22:12.395490] [INFO ] [MAIN ] ATKR: Loaded 35380 existing records. [2025-10-09T17:22:12.572599] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:12.572827] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-09T17:22:12.572882] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-09T17:22:12.573101] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-09T17:22:12.573159] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-09T17:22:12.798583] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-09T17:22:12.937500] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:12.966384] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:22:13.574510] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T17:22:13.596490] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:22:13.603855] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-09T17:22:14.396762] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-09T17:22:15.196755] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-09T17:22:15.282186] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:22:15.784244] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T17:22:15.993574] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T17:22:16.001988] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-09T17:22:16.796749] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-09T17:22:17.596726] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-09T17:22:17.637161] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T17:22:18.192454] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:22:18.396773] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-09T17:22:19.084310] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T17:22:19.196727] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-09T17:22:19.319372] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:22:19.996737] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-09T17:22:20.796794] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-09T17:22:20.918627] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T17:22:21.599996] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-09T17:22:21.604956] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T17:22:22.135898] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T17:22:22.396677] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-09T17:22:23.125145] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:22:23.196720] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-09T17:22:23.367360] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T17:22:23.996732] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-09T17:22:24.730410] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:22:24.796696] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-09T17:22:25.596770] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-09T17:22:25.803381] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T17:22:26.273192] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:22:26.317140] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T17:22:26.396748] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-09T17:22:27.196734] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-09T17:22:27.875241] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T17:22:27.996691] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-09T17:22:28.028364] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T17:22:28.734263] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T17:22:28.796728] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-09T17:22:29.596774] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-09T17:22:29.956125] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:22:30.396738] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-09T17:22:30.984623] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T17:22:31.140885] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T17:22:31.196687] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-09T17:22:31.878002] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T17:22:31.996728] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-09T17:22:32.600118] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T17:22:32.796716] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-09T17:22:33.596696] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-09T17:22:33.845673] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:22:34.195514] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T17:22:34.196416] [INFO ] [REMOTE ] ATHS: Full fetch complete (9703 records). [2025-10-09T17:22:34.196484] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-09T17:22:34.401969] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-09T17:22:34.559501] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-09T17:22:34.559588] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-09T17:22:34.559818] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-09T17:22:34.559880] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-09T17:22:34.560294] [DEBUG] [LOCAL ] ATHS: Trimmed 9703 records to 6815 (keeping 200 days of data) [2025-10-09T17:22:34.606275] [DEBUG] [LOCAL ] ATHS: Primary data saved (6815 records). [2025-10-09T17:22:34.606434] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-09T17:22:34.606538] [INFO ] [MAIN ] Update Progress: 169/2373 symbols completed. ATHS took 30.3s. Estimated remaining: 4h 53m 40s. Rate: 7.5 symbols/min [2025-10-09T17:22:34.779196] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:34.824182] [DEBUG] [LOCAL ] ATMU: Loaded 39145 existing records from primary storage. [2025-10-09T17:22:34.824460] [INFO ] [MAIN ] ATMU: Loaded 39145 existing records. [2025-10-09T17:22:34.999867] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:35.000113] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-09T17:22:35.000171] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-09T17:22:35.000386] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-09T17:22:35.000443] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-09T17:22:35.202201] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-09T17:22:35.352605] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:35.996739] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-09T17:22:36.280275] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T17:22:36.631846] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T17:22:36.796733] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-09T17:22:37.505615] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:22:37.596701] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-09T17:22:38.396740] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-09T17:22:38.495220] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T17:22:38.782184] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T17:22:39.196721] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-09T17:22:39.489514] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T17:22:39.492142] [INFO ] [REMOTE ] ATHM: Full fetch complete (50507 records). [2025-10-09T17:22:39.492226] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-09T17:22:39.906544] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-09T17:22:39.906709] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-09T17:22:39.907352] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-09T17:22:39.907421] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-09T17:22:39.908925] [DEBUG] [LOCAL ] ATHM: Trimmed 50507 records to 32029 (keeping 200 days of data) [2025-10-09T17:22:40.009324] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-09T17:22:40.113076] [DEBUG] [LOCAL ] ATHM: Primary data saved (32029 records). [2025-10-09T17:22:40.113217] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-09T17:22:40.114142] [INFO ] [MAIN ] Update Progress: 170/2373 symbols completed. ATHM took 42.6s. Estimated remaining: 4h 52m 59s. Rate: 7.5 symbols/min [2025-10-09T17:22:40.287232] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:40.335119] [DEBUG] [LOCAL ] ATO: Loaded 41855 existing records from primary storage. [2025-10-09T17:22:40.335472] [INFO ] [MAIN ] ATO: Loaded 41855 existing records. [2025-10-09T17:22:40.516397] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:40.516590] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-09T17:22:40.516637] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-09T17:22:40.516889] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-09T17:22:40.516944] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-09T17:22:40.802359] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-09T17:22:40.888524] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:40.922037] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T17:22:41.444029] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T17:22:41.596731] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-09T17:22:42.214957] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T17:22:42.396717] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-09T17:22:42.668922] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T17:22:43.196767] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-09T17:22:43.926598] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T17:22:43.996665] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-09T17:22:44.675608] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T17:22:44.683824] [INFO ] [REMOTE ] ATI: Full fetch complete (73833 records). [2025-10-09T17:22:44.683952] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-09T17:22:44.801971] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-09T17:22:45.071518] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-09T17:22:45.071680] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-09T17:22:45.072480] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-09T17:22:45.072673] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-09T17:22:45.074234] [DEBUG] [LOCAL ] ATI: Trimmed 73833 records to 51732 (keeping 200 days of data) [2025-10-09T17:22:45.324942] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T17:22:45.415120] [DEBUG] [LOCAL ] ATI: Primary data saved (51732 records). [2025-10-09T17:22:45.415279] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-09T17:22:45.416164] [INFO ] [MAIN ] Update Progress: 171/2373 symbols completed. ATI took 35.1s. Estimated remaining: 4h 52m 17s. Rate: 7.5 symbols/min [2025-10-09T17:22:45.580319] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:45.601748] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-09T17:22:45.616442] [DEBUG] [LOCAL ] ATR: Loaded 30573 existing records from primary storage. [2025-10-09T17:22:45.616751] [INFO ] [MAIN ] ATR: Loaded 30573 existing records. [2025-10-09T17:22:45.789179] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:45.789389] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-09T17:22:45.789436] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-09T17:22:45.789683] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-09T17:22:45.789740] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-09T17:22:46.132162] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:46.396720] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-09T17:22:46.761289] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T17:22:47.029436] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:22:47.032493] [INFO ] [REMOTE ] ATKR: Full fetch complete (53472 records). [2025-10-09T17:22:47.032614] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-09T17:22:47.204847] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-09T17:22:47.427945] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-09T17:22:47.428083] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-09T17:22:47.428775] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-09T17:22:47.428855] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-09T17:22:47.445181] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T17:22:47.451351] [DEBUG] [LOCAL ] ATKR: Trimmed 53472 records to 35606 (keeping 200 days of data) [2025-10-09T17:22:47.672051] [DEBUG] [LOCAL ] ATKR: Primary data saved (35606 records). [2025-10-09T17:22:47.672187] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-09T17:22:47.672269] [INFO ] [MAIN ] Update Progress: 172/2373 symbols completed. ATKR took 35.5s. Estimated remaining: 4h 50m 56s. Rate: 7.6 symbols/min [2025-10-09T17:22:47.870570] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:47.888591] [DEBUG] [LOCAL ] ATS: Loaded 17730 existing records from primary storage. [2025-10-09T17:22:47.888913] [INFO ] [MAIN ] ATS: Loaded 17730 existing records. [2025-10-09T17:22:48.001860] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-09T17:22:48.078108] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:48.078314] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-09T17:22:48.078362] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-09T17:22:48.078541] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-09T17:22:48.078600] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-09T17:22:48.438053] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:48.801373] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-09T17:22:48.821272] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T17:22:48.887438] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T17:22:49.588409] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T17:22:49.596674] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-09T17:22:50.396779] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-09T17:22:50.597911] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:22:51.196816] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-09T17:22:51.811859] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:22:51.996749] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-09T17:22:52.796741] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-09T17:22:53.596723] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-09T17:23:05.089025] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (12.29 seconds). [2025-10-09T17:23:05.093074] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-09T17:23:05.237440] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (13.24 seconds). [2025-10-09T17:23:05.246183] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-09T17:23:05.297326] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (14.10 seconds). [2025-10-09T17:23:05.305593] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-09T17:23:05.581114] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (11.98 seconds). [2025-10-09T17:23:05.587891] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-09T17:23:05.814079] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T17:23:05.818521] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-09T17:23:06.475352] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:23:06.483119] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-09T17:23:06.912558] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T17:23:06.919731] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-09T17:23:07.210855] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:23:07.216398] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-09T17:23:07.313918] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-09T17:23:07.322679] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-09T17:23:07.396474] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T17:23:07.404961] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-09T17:23:08.227713] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T17:23:08.273217] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T17:23:08.278300] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-09T17:23:08.279532] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-09T17:23:08.362055] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T17:23:08.371561] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-09T17:23:09.091494] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:23:09.101562] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-09T17:23:09.202102] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T17:23:09.205874] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-09T17:23:09.519736] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T17:23:09.526714] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-09T17:23:10.020466] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T17:23:10.030533] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-09T17:23:10.189332] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T17:23:10.194618] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-09T17:23:10.295487] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T17:23:10.305863] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-09T17:23:10.518374] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:23:10.525332] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-09T17:23:11.204932] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:23:11.209270] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-09T17:23:11.445539] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T17:23:11.458197] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-09T17:23:11.477452] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T17:23:11.493002] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T17:23:11.496921] [INFO ] [REMOTE ] ATMU: Full fetch complete (56639 records). [2025-10-09T17:23:11.497071] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-09T17:23:11.901412] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-09T17:23:11.901527] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-09T17:23:11.902196] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-09T17:23:11.902264] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-09T17:23:11.903593] [DEBUG] [LOCAL ] ATMU: Trimmed 56639 records to 39408 (keeping 200 days of data) [2025-10-09T17:23:11.996973] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-09T17:23:12.135633] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T17:23:12.166797] [DEBUG] [LOCAL ] ATMU: Primary data saved (39408 records). [2025-10-09T17:23:12.166951] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-09T17:23:12.167609] [INFO ] [MAIN ] Update Progress: 173/2373 symbols completed. ATMU took 37.6s. Estimated remaining: 4h 54m 19s. Rate: 7.5 symbols/min [2025-10-09T17:23:12.343779] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:12.389203] [DEBUG] [LOCAL ] ATUS: Loaded 49482 existing records from primary storage. [2025-10-09T17:23:12.389503] [INFO ] [MAIN ] ATUS: Loaded 49482 existing records. [2025-10-09T17:23:12.566866] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:12.567080] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-09T17:23:12.567128] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-09T17:23:12.567355] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-09T17:23:12.567412] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-09T17:23:12.811396] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-09T17:23:12.933848] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:13.063313] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T17:23:13.355247] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T17:23:13.596743] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-09T17:23:13.740070] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T17:23:13.742339] [INFO ] [REMOTE ] ATS: Full fetch complete (25626 records). [2025-10-09T17:23:13.742465] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-09T17:23:14.114021] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-09T17:23:14.114158] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-09T17:23:14.114511] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-09T17:23:14.114556] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-09T17:23:14.115271] [DEBUG] [LOCAL ] ATS: Trimmed 25626 records to 17815 (keeping 200 days of data) [2025-10-09T17:23:14.216904] [DEBUG] [LOCAL ] ATS: Primary data saved (17815 records). [2025-10-09T17:23:14.217043] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-09T17:23:14.217128] [INFO ] [MAIN ] Update Progress: 174/2373 symbols completed. ATS took 26.5s. Estimated remaining: 4h 52m 55s. Rate: 7.5 symbols/min [2025-10-09T17:23:14.399215] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:14.397666] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-09T17:23:14.447574] [DEBUG] [LOCAL ] AU: Loaded 52990 existing records from primary storage. [2025-10-09T17:23:14.447926] [INFO ] [MAIN ] AU: Loaded 52990 existing records. [2025-10-09T17:23:14.623491] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:14.623814] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-09T17:23:14.623914] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-09T17:23:14.624380] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-09T17:23:14.624438] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-09T17:23:14.980772] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:15.196699] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-09T17:23:15.371503] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:23:15.960525] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T17:23:15.996672] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-09T17:23:16.796695] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-09T17:23:16.880701] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:23:17.217360] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:23:17.219959] [INFO ] [REMOTE ] ATR: Full fetch complete (43491 records). [2025-10-09T17:23:17.220040] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-09T17:23:17.220585] [FATAL] [VALIDATOR ] ATR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:23:17.220697] [FATAL] [MAIN ] ATR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:23:17.220766] [WARN ] [MAIN ] ATR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:23:17.220840] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-09T17:23:17.220903] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-09T17:23:17.220939] [INFO ] [LOCAL ] ATR: Starting deletion of derivative data. [2025-10-09T17:23:17.221202] [DEBUG] [LOCAL ] ATR: Deleted derivative data file. [2025-10-09T17:23:17.221865] [INFO ] [MAIN ] Update Progress: 175/2373 symbols completed. ATR took 31.8s. Estimated remaining: 4h 51m 44s. Rate: 7.5 symbols/min [2025-10-09T17:23:17.392362] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:17.444571] [DEBUG] [LOCAL ] AUB: Loaded 46185 existing records from primary storage. [2025-10-09T17:23:17.444889] [INFO ] [MAIN ] AUB: Loaded 46185 existing records. [2025-10-09T17:23:17.602072] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-09T17:23:17.626318] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:17.626551] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-09T17:23:17.626807] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-09T17:23:17.627597] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-09T17:23:17.627694] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-09T17:23:17.997250] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:18.237061] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:23:18.396754] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-09T17:23:19.196741] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-09T17:23:19.282546] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:23:19.996717] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-09T17:23:20.066370] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:23:20.796698] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-09T17:23:20.849736] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T17:23:21.596695] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-09T17:23:21.773336] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T17:23:22.396707] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-09T17:23:22.629538] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T17:23:22.705228] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T17:23:23.196717] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-09T17:23:23.995276] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T17:23:24.003351] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-09T17:23:24.391748] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T17:23:24.796864] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-09T17:23:25.596709] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-09T17:23:25.918303] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T17:23:26.396889] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-09T17:23:26.464971] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T17:23:26.688936] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T17:23:27.196763] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-09T17:23:27.867823] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:23:27.871375] [INFO ] [REMOTE ] ATO: Full fetch complete (60416 records). [2025-10-09T17:23:27.871490] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-09T17:23:28.001829] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-09T17:23:28.269234] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-09T17:23:28.269322] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-09T17:23:28.270005] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-09T17:23:28.270071] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-09T17:23:28.272895] [DEBUG] [LOCAL ] ATO: Trimmed 60416 records to 42098 (keeping 200 days of data) [2025-10-09T17:23:28.546908] [DEBUG] [LOCAL ] ATO: Primary data saved (42098 records). [2025-10-09T17:23:28.547034] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-09T17:23:28.547697] [INFO ] [MAIN ] Update Progress: 176/2373 symbols completed. ATO took 48.4s. Estimated remaining: 4h 52m 18s. Rate: 7.5 symbols/min [2025-10-09T17:23:28.730135] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:28.741303] [DEBUG] [LOCAL ] AUNA: Loaded 5056 existing records from primary storage. [2025-10-09T17:23:28.741564] [INFO ] [MAIN ] AUNA: Loaded 5056 existing records. [2025-10-09T17:23:28.807081] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-09T17:23:29.001394] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:29.001898] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-09T17:23:29.001986] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-09T17:23:29.002521] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-09T17:23:29.002597] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-09T17:23:29.450046] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T17:23:29.628298] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-09T17:23:29.660341] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:29.664681] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T17:23:30.396759] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-09T17:23:30.462445] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:23:31.196738] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-09T17:23:31.634632] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T17:23:31.996751] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-09T17:23:32.050711] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T17:23:32.454079] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T17:23:32.641579] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:23:32.796733] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-09T17:23:33.596719] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-09T17:23:34.272151] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T17:23:34.396697] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-09T17:23:34.821583] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T17:23:34.845828] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T17:23:35.196725] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-09T17:23:35.996717] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-09T17:23:36.796701] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-09T17:23:37.007143] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T17:23:37.596690] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-09T17:23:38.020060] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T17:23:38.213450] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T17:23:38.396682] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-09T17:23:38.505941] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:23:38.866848] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-09T17:23:39.196751] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-09T17:23:39.588497] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T17:23:39.996759] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-09T17:23:40.796732] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-09T17:23:41.465685] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T17:23:41.596760] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-09T17:23:42.198129] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T17:23:42.396774] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-09T17:23:42.472212] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T17:23:43.196759] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-09T17:23:43.888740] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T17:23:43.996767] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-09T17:23:44.693961] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:23:44.796770] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-09T17:23:45.596755] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-09T17:23:45.850287] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T17:23:46.396742] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-09T17:23:46.428766] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:23:46.434054] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T17:23:46.438602] [INFO ] [REMOTE ] ATUS: Full fetch complete (71064 records). [2025-10-09T17:23:46.438761] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-09T17:23:46.820201] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-09T17:23:46.820288] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-09T17:23:46.820998] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-09T17:23:46.821063] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-09T17:23:46.822477] [DEBUG] [LOCAL ] ATUS: Trimmed 71064 records to 49851 (keeping 200 days of data) [2025-10-09T17:23:47.135784] [DEBUG] [LOCAL ] ATUS: Primary data saved (49851 records). [2025-10-09T17:23:47.135944] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-09T17:23:47.137027] [INFO ] [MAIN ] Update Progress: 177/2373 symbols completed. ATUS took 35.0s. Estimated remaining: 4h 54m 22s. Rate: 7.5 symbols/min [2025-10-09T17:23:47.201872] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-09T17:23:47.322736] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:47.367375] [DEBUG] [LOCAL ] AVA: Loaded 39116 existing records from primary storage. [2025-10-09T17:23:47.367695] [INFO ] [MAIN ] AVA: Loaded 39116 existing records. [2025-10-09T17:23:47.545234] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:47.545467] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-09T17:23:47.545515] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-09T17:23:47.545752] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-09T17:23:47.545811] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-09T17:23:47.937704] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:47.996756] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-09T17:23:48.078053] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T17:23:48.796705] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-09T17:23:49.058452] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T17:23:49.379115] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T17:23:49.458471] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T17:23:49.596758] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-09T17:23:50.396726] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-09T17:23:50.988716] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T17:23:51.196757] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-09T17:23:51.908243] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T17:23:51.986910] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T17:23:51.996681] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-09T17:23:52.796749] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-09T17:23:53.596735] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-09T17:23:53.934192] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T17:23:53.939577] [INFO ] [REMOTE ] AU: Full fetch complete (76306 records). [2025-10-09T17:23:53.939786] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-09T17:23:54.305161] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T17:23:54.402085] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-09T17:23:54.401774] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-09T17:23:54.402223] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-09T17:23:54.403385] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-09T17:23:54.404344] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-09T17:23:54.406395] [DEBUG] [LOCAL ] AU: Trimmed 76306 records to 53379 (keeping 200 days of data) [2025-10-09T17:23:54.739764] [DEBUG] [LOCAL ] AU: Primary data saved (53379 records). [2025-10-09T17:23:54.739899] [INFO ] [MAIN ] AU: Full history saved. [2025-10-09T17:23:54.739979] [INFO ] [MAIN ] Update Progress: 178/2373 symbols completed. AU took 40.5s. Estimated remaining: 4h 54m 9s. Rate: 7.5 symbols/min [2025-10-09T17:23:54.921824] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:54.932387] [DEBUG] [LOCAL ] AVAL: Loaded 8653 existing records from primary storage. [2025-10-09T17:23:54.932611] [INFO ] [MAIN ] AVAL: Loaded 8653 existing records. [2025-10-09T17:23:55.120072] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:55.123725] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-09T17:23:55.123820] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-09T17:23:55.124257] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-09T17:23:55.123963] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:23:55.124610] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-09T17:23:55.148171] [INFO ] [REMOTE ] AUNA: Full fetch complete (7793 records). [2025-10-09T17:23:55.211303] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-09T17:23:55.201728] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-09T17:23:55.252995] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T17:23:55.864068] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:55.927502] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-09T17:23:55.927577] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-09T17:23:55.927839] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-09T17:23:55.927899] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-09T17:23:55.928510] [DEBUG] [LOCAL ] AUNA: Trimmed 7793 records to 5085 (keeping 200 days of data) [2025-10-09T17:23:55.958033] [DEBUG] [LOCAL ] AUNA: Primary data saved (5085 records). [2025-10-09T17:23:55.958141] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-09T17:23:55.958219] [INFO ] [MAIN ] Update Progress: 179/2373 symbols completed. AUNA took 27.4s. Estimated remaining: 4h 52m 37s. Rate: 7.5 symbols/min [2025-10-09T17:23:56.001858] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-09T17:23:56.129281] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:56.173315] [DEBUG] [LOCAL ] AVB: Loaded 42092 existing records from primary storage. [2025-10-09T17:23:56.173598] [INFO ] [MAIN ] AVB: Loaded 42092 existing records. [2025-10-09T17:23:56.349021] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:56.349253] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-09T17:23:56.349346] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-09T17:23:56.349566] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-09T17:23:56.349623] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-09T17:23:56.733161] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:56.796733] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-09T17:23:56.880449] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T17:23:57.511989] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T17:23:57.516512] [INFO ] [REMOTE ] AUB: Full fetch complete (65776 records). [2025-10-09T17:23:57.516725] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-09T17:23:57.605464] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-09T17:23:57.906191] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-09T17:23:57.906396] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-09T17:23:57.907162] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-09T17:23:57.907242] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-09T17:23:57.915854] [DEBUG] [LOCAL ] AUB: Trimmed 65776 records to 46506 (keeping 200 days of data) [2025-10-09T17:23:57.929636] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:23:58.240900] [DEBUG] [LOCAL ] AUB: Primary data saved (46506 records). [2025-10-09T17:23:58.241080] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-09T17:23:58.242075] [INFO ] [MAIN ] Update Progress: 180/2373 symbols completed. AUB took 41.0s. Estimated remaining: 4h 51m 19s. Rate: 7.5 symbols/min [2025-10-09T17:23:58.420102] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:58.416462] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-09T17:23:58.420354] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-09T17:23:58.421518] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-09T17:23:58.421684] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-09T17:23:58.421739] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-09T17:23:58.421784] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-09T17:23:58.421817] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-09T17:23:58.823617] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:59.158936] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T17:23:59.196696] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-09T17:23:59.603988] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T17:23:59.996718] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-09T17:24:00.796726] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-09T17:24:00.920897] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:24:01.009069] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:24:01.009387] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-09T17:24:01.009489] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:24:01.009580] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-09T17:24:01.009761] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:24:01.009853] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-09T17:24:01.009935] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-09T17:24:01.010020] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-09T17:24:01.010121] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-09T17:24:01.010232] [INFO ] [MAIN ] Update Progress: 181/2373 symbols completed. AVBC took 2.8s. Estimated remaining: 4h 50m 8s. Rate: 7.6 symbols/min [2025-10-09T17:24:01.192052] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:01.219550] [DEBUG] [LOCAL ] AVD: Loaded 22246 existing records from primary storage. [2025-10-09T17:24:01.219837] [INFO ] [MAIN ] AVD: Loaded 22246 existing records. [2025-10-09T17:24:01.402017] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:01.402298] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-09T17:24:01.402462] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-09T17:24:01.402772] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-09T17:24:01.402832] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-09T17:24:01.601790] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-09T17:24:01.730412] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:24:01.805988] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:02.396736] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-09T17:24:02.490355] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T17:24:03.196740] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-09T17:24:03.877535] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:24:03.996711] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-09T17:24:04.080994] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T17:24:04.796754] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-09T17:24:05.346751] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T17:24:05.596719] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-09T17:24:06.345591] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T17:24:06.396741] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-09T17:24:07.134692] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T17:24:07.196708] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-09T17:24:07.905179] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:24:07.996716] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-09T17:24:08.660301] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:24:08.796716] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-09T17:24:09.291487] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:24:09.596724] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-09T17:24:10.279191] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T17:24:10.329023] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T17:24:10.396696] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-09T17:24:11.196741] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-09T17:24:11.823239] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:24:11.826516] [INFO ] [REMOTE ] AVA: Full fetch complete (55559 records). [2025-10-09T17:24:11.826615] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-09T17:24:12.010790] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-09T17:24:12.243197] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-09T17:24:12.243330] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-09T17:24:12.244136] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-09T17:24:12.244205] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-09T17:24:12.245884] [DEBUG] [LOCAL ] AVA: Trimmed 55559 records to 39336 (keeping 200 days of data) [2025-10-09T17:24:12.497159] [DEBUG] [LOCAL ] AVA: Primary data saved (39336 records). [2025-10-09T17:24:12.497326] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-09T17:24:12.497415] [INFO ] [MAIN ] Update Progress: 182/2373 symbols completed. AVA took 25.4s. Estimated remaining: 4h 50m 43s. Rate: 7.5 symbols/min [2025-10-09T17:24:12.676157] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:12.713579] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:24:12.735748] [DEBUG] [LOCAL ] AVK: Loaded 18294 existing records from primary storage. [2025-10-09T17:24:12.736016] [INFO ] [MAIN ] AVK: Loaded 18294 existing records. [2025-10-09T17:24:12.801995] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-09T17:24:12.911547] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:12.911794] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-09T17:24:12.911845] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-09T17:24:12.912947] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-09T17:24:12.912996] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-09T17:24:13.161205] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T17:24:13.305884] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:13.596685] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-09T17:24:13.900300] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T17:24:14.396684] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-09T17:24:14.759136] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:24:15.196764] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-09T17:24:15.304925] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T17:24:15.996696] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-09T17:24:16.233350] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T17:24:16.796741] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-09T17:24:16.871927] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-09T17:24:17.596749] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-09T17:24:18.364841] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:24:18.396670] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-09T17:24:18.540876] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T17:24:19.196915] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-09T17:24:19.902565] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T17:24:19.996729] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-09T17:24:20.042478] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T17:24:20.686159] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T17:24:20.796721] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-09T17:24:21.245697] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:24:21.596764] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-09T17:24:22.396731] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-09T17:24:23.154473] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T17:24:23.196723] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-09T17:24:23.428635] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T17:24:23.996734] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-09T17:24:24.541184] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:24:24.546204] [INFO ] [REMOTE ] AVB: Full fetch complete (58498 records). [2025-10-09T17:24:24.546351] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-09T17:24:24.547226] [FATAL] [VALIDATOR ] AVB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:24:24.547344] [FATAL] [MAIN ] AVB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:24:24.547417] [WARN ] [MAIN ] AVB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:24:24.547495] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-09T17:24:24.547564] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-09T17:24:24.547610] [INFO ] [LOCAL ] AVB: Starting deletion of derivative data. [2025-10-09T17:24:24.547912] [DEBUG] [LOCAL ] AVB: Deleted derivative data file. [2025-10-09T17:24:24.548418] [INFO ] [MAIN ] Update Progress: 183/2373 symbols completed. AVB took 28.6s. Estimated remaining: 4h 51m 24s. Rate: 7.5 symbols/min [2025-10-09T17:24:24.738373] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:24.776822] [DEBUG] [LOCAL ] AVNS: Loaded 33577 existing records from primary storage. [2025-10-09T17:24:24.777094] [INFO ] [MAIN ] AVNS: Loaded 33577 existing records. [2025-10-09T17:24:24.807108] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-09T17:24:24.958001] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:24.958241] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-09T17:24:24.958318] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-09T17:24:24.958670] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-09T17:24:24.958732] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-09T17:24:25.275157] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T17:24:25.337423] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:25.596737] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-09T17:24:26.044278] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T17:24:26.396698] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-09T17:24:26.578605] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T17:24:27.196760] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-09T17:24:27.310108] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T17:24:27.996694] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-09T17:24:28.204219] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T17:24:28.796749] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-09T17:24:28.899544] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T17:24:29.523764] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T17:24:29.596674] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-09T17:24:30.353428] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T17:24:30.396721] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-09T17:24:31.204438] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-09T17:24:31.208894] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T17:24:31.892423] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:24:31.893727] [INFO ] [REMOTE ] AVAL: Full fetch complete (14695 records). [2025-10-09T17:24:31.893798] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-09T17:24:32.001790] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-09T17:24:32.257044] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-09T17:24:32.257129] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-09T17:24:32.257388] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-09T17:24:32.257427] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-09T17:24:32.257925] [DEBUG] [LOCAL ] AVAL: Trimmed 14695 records to 8696 (keeping 200 days of data) [2025-10-09T17:24:32.310273] [DEBUG] [LOCAL ] AVAL: Primary data saved (8696 records). [2025-10-09T17:24:32.310406] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-09T17:24:32.310505] [INFO ] [MAIN ] Update Progress: 184/2373 symbols completed. AVAL took 37.6s. Estimated remaining: 4h 51m 13s. Rate: 7.5 symbols/min [2025-10-09T17:24:32.481670] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:32.520308] [DEBUG] [LOCAL ] AVNT: Loaded 39051 existing records from primary storage. [2025-10-09T17:24:32.520613] [INFO ] [MAIN ] AVNT: Loaded 39051 existing records. [2025-10-09T17:24:32.726846] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:32.727129] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-09T17:24:32.727187] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-09T17:24:32.727556] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-09T17:24:32.727624] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-09T17:24:32.805763] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-09T17:24:33.102859] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:33.423180] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:24:33.596679] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-09T17:24:33.960786] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T17:24:34.396702] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-09T17:24:35.026348] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T17:24:35.196704] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-09T17:24:35.475560] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T17:24:35.996725] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-09T17:24:36.637459] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T17:24:36.796715] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-09T17:24:37.102390] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T17:24:37.596770] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-09T17:24:38.081238] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T17:24:38.396679] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-09T17:24:38.699348] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T17:24:39.196702] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-09T17:24:39.245570] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T17:24:39.996788] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-09T17:24:40.640855] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T17:24:40.796745] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-09T17:24:41.384916] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:24:41.489761] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:24:41.492049] [INFO ] [REMOTE ] AVK: Full fetch complete (26692 records). [2025-10-09T17:24:41.492124] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-09T17:24:41.601858] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-09T17:24:41.863076] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-09T17:24:41.863206] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-09T17:24:41.863692] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-09T17:24:41.863783] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-09T17:24:41.864777] [DEBUG] [LOCAL ] AVK: Trimmed 26692 records to 18448 (keeping 200 days of data) [2025-10-09T17:24:41.979787] [DEBUG] [LOCAL ] AVK: Primary data saved (18448 records). [2025-10-09T17:24:41.979936] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-09T17:24:41.980040] [INFO ] [MAIN ] Update Progress: 185/2373 symbols completed. AVK took 29.5s. Estimated remaining: 4h 51m 25s. Rate: 7.5 symbols/min [2025-10-09T17:24:42.145368] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:42.195183] [DEBUG] [LOCAL ] AVTR: Loaded 53563 existing records from primary storage. [2025-10-09T17:24:42.195509] [INFO ] [MAIN ] AVTR: Loaded 53563 existing records. [2025-10-09T17:24:42.370466] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:42.370675] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-09T17:24:42.370748] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-09T17:24:42.371011] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-09T17:24:42.371071] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-09T17:24:42.401813] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-09T17:24:42.737952] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:42.911364] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T17:24:43.196693] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-09T17:24:43.593439] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:24:43.996685] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-09T17:24:44.491358] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:24:44.796688] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-09T17:24:45.035912] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T17:24:45.596719] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-09T17:24:45.887590] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:24:46.396713] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-09T17:24:46.998675] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T17:24:47.196687] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-09T17:24:47.906602] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T17:24:47.996711] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-09T17:24:48.439499] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:24:48.796731] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-09T17:24:49.423561] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T17:24:49.596714] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-09T17:24:50.182635] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T17:24:50.396727] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-09T17:24:51.204331] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-09T17:24:51.209146] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T17:24:51.862388] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:24:51.996725] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-09T17:24:52.538504] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T17:24:52.796726] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-09T17:24:53.596711] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-09T17:24:53.703082] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T17:24:54.030265] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:24:54.033418] [INFO ] [REMOTE ] AVNS: Full fetch complete (48312 records). [2025-10-09T17:24:54.033550] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-09T17:24:54.422973] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-09T17:24:54.444399] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-09T17:24:54.444502] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-09T17:24:54.445091] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-09T17:24:54.445240] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-09T17:24:54.446299] [DEBUG] [LOCAL ] AVNS: Trimmed 48312 records to 33765 (keeping 200 days of data) [2025-10-09T17:24:54.651090] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:24:54.654820] [INFO ] [REMOTE ] AVD: Full fetch complete (33138 records). [2025-10-09T17:24:54.655446] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-09T17:24:54.657251] [DEBUG] [LOCAL ] AVNS: Primary data saved (33765 records). [2025-10-09T17:24:54.701880] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-09T17:24:54.702929] [INFO ] [MAIN ] Update Progress: 186/2373 symbols completed. AVNS took 30.2s. Estimated remaining: 4h 52m 13s. Rate: 7.5 symbols/min [2025-10-09T17:24:55.075990] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:55.102060] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-09T17:24:55.107788] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-09T17:24:55.133727] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-09T17:24:55.133810] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-09T17:24:55.133944] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-09T17:24:55.144717] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-09T17:24:55.214263] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-09T17:24:55.323772] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-09T17:24:55.335211] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-09T17:24:55.340817] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-09T17:24:55.346039] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-09T17:24:55.411441] [DEBUG] [LOCAL ] AVD: Trimmed 33138 records to 22339 (keeping 200 days of data) [2025-10-09T17:24:55.673558] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:55.737214] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:24:55.747320] [DEBUG] [LOCAL ] AVD: Primary data saved (22339 records). [2025-10-09T17:24:55.747494] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-09T17:24:55.747591] [INFO ] [MAIN ] Update Progress: 187/2373 symbols completed. AVD took 54.7s. Estimated remaining: 4h 50m 44s. Rate: 7.5 symbols/min [2025-10-09T17:24:55.917903] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:55.942562] [DEBUG] [LOCAL ] AWF: Loaded 24261 existing records from primary storage. [2025-10-09T17:24:55.942861] [INFO ] [MAIN ] AWF: Loaded 24261 existing records. [2025-10-09T17:24:56.005807] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-09T17:24:56.126015] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:56.126258] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-09T17:24:56.126308] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-09T17:24:56.126566] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-09T17:24:56.126624] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-09T17:24:56.481474] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:56.629327] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T17:24:56.796695] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-09T17:24:57.596719] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-09T17:24:57.673347] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T17:24:58.396677] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-09T17:24:58.490685] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T17:24:58.670961] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T17:24:59.196711] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-09T17:24:59.759229] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T17:24:59.996731] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-09T17:25:00.796744] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-09T17:25:00.996316] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T17:25:01.596733] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-09T17:25:01.736286] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T17:25:02.396686] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-09T17:25:02.493013] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T17:25:03.196693] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-09T17:25:03.377912] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T17:25:03.554310] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T17:25:03.996722] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-09T17:25:04.363676] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T17:25:04.796689] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-09T17:25:05.135825] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:25:05.596713] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-09T17:25:06.295591] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T17:25:06.396760] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-09T17:25:06.606063] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T17:25:06.609016] [INFO ] [REMOTE ] AVNT: Full fetch complete (56053 records). [2025-10-09T17:25:06.609113] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-09T17:25:06.609795] [FATAL] [VALIDATOR ] AVNT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:25:06.609896] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:25:06.609970] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:25:06.610060] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-09T17:25:06.610136] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-09T17:25:06.610173] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-10-09T17:25:06.610404] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-10-09T17:25:06.610495] [INFO ] [MAIN ] Update Progress: 188/2373 symbols completed. AVNT took 34.3s. Estimated remaining: 4h 51m 9s. Rate: 7.5 symbols/min [2025-10-09T17:25:06.816518] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:06.849679] [DEBUG] [LOCAL ] AWI: Loaded 25305 existing records from primary storage. [2025-10-09T17:25:06.850073] [INFO ] [MAIN ] AWI: Loaded 25305 existing records. [2025-10-09T17:25:07.049910] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:07.050179] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-09T17:25:07.050234] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-09T17:25:07.050491] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-09T17:25:07.050571] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-09T17:25:07.210938] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-09T17:25:07.429430] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:07.760498] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T17:25:07.996733] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-09T17:25:08.379326] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T17:25:08.796737] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-09T17:25:09.596765] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-09T17:25:09.729543] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T17:25:09.876012] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T17:25:10.396720] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-09T17:25:11.196765] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-09T17:25:11.345216] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T17:25:11.423974] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T17:25:11.996737] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-09T17:25:12.483797] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T17:25:12.796733] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-09T17:25:13.347755] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T17:25:13.596780] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-09T17:25:13.768570] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T17:25:14.396767] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-09T17:25:15.088605] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T17:25:15.196677] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-09T17:25:15.544900] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T17:25:15.996726] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-09T17:25:16.442608] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T17:25:16.796735] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-09T17:25:17.184729] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T17:25:17.596779] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-09T17:25:18.364199] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T17:25:18.396679] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-09T17:25:18.527184] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T17:25:19.196693] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-09T17:25:19.498947] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T17:25:19.996719] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-09T17:25:20.688434] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T17:25:20.796690] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-09T17:25:21.596686] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-09T17:25:21.755584] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:25:21.760225] [INFO ] [REMOTE ] AVTR: Full fetch complete (77442 records). [2025-10-09T17:25:21.760354] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-09T17:25:22.161843] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-09T17:25:22.161960] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-09T17:25:22.162843] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-09T17:25:22.162996] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-09T17:25:22.183061] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:25:22.183212] [DEBUG] [LOCAL ] AVTR: Trimmed 77442 records to 53951 (keeping 200 days of data) [2025-10-09T17:25:22.397886] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-09T17:25:22.520925] [DEBUG] [LOCAL ] AVTR: Primary data saved (53951 records). [2025-10-09T17:25:22.521067] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-09T17:25:22.521907] [INFO ] [MAIN ] Update Progress: 189/2373 symbols completed. AVTR took 40.5s. Estimated remaining: 4h 52m 33s. Rate: 7.5 symbols/min [2025-10-09T17:25:22.698126] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:22.747014] [DEBUG] [LOCAL ] AWK: Loaded 48684 existing records from primary storage. [2025-10-09T17:25:22.747367] [INFO ] [MAIN ] AWK: Loaded 48684 existing records. [2025-10-09T17:25:22.933338] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:22.933730] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-09T17:25:22.933794] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-09T17:25:22.934040] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-09T17:25:22.934166] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-09T17:25:23.062493] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T17:25:23.207129] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-09T17:25:23.339070] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:23.526718] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T17:25:23.996715] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-09T17:25:24.796688] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-09T17:25:24.833250] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T17:25:25.596686] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-09T17:25:25.672204] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:25:25.732468] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T17:25:26.396721] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-09T17:25:27.062341] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:25:27.066231] [INFO ] [REMOTE ] AVY: Full fetch complete (56347 records). [2025-10-09T17:25:27.066328] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-09T17:25:27.212244] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-09T17:25:27.499339] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-09T17:25:27.499454] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-09T17:25:27.500066] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-09T17:25:27.500128] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-09T17:25:27.501204] [DEBUG] [LOCAL ] AVY: Trimmed 56347 records to 37848 (keeping 200 days of data) [2025-10-09T17:25:27.729264] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:25:27.766857] [DEBUG] [LOCAL ] AVY: Primary data saved (37848 records). [2025-10-09T17:25:27.766988] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-09T17:25:27.767059] [INFO ] [MAIN ] Update Progress: 190/2373 symbols completed. AVY took 33.0s. Estimated remaining: 4h 51m 52s. Rate: 7.5 symbols/min [2025-10-09T17:25:27.938945] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:27.959053] [DEBUG] [LOCAL ] AWP: Loaded 21500 existing records from primary storage. [2025-10-09T17:25:27.959334] [INFO ] [MAIN ] AWP: Loaded 21500 existing records. [2025-10-09T17:25:28.001888] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-09T17:25:28.137631] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:28.137901] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-09T17:25:28.137956] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-09T17:25:28.138162] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-09T17:25:28.138219] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-09T17:25:28.495025] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:28.796708] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-09T17:25:29.106205] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T17:25:29.358738] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T17:25:29.596754] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-09T17:25:29.973319] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T17:25:30.396722] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-09T17:25:30.648866] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:25:31.196776] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-09T17:25:31.617170] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T17:25:31.996722] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-09T17:25:32.633603] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T17:25:32.737242] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T17:25:32.796730] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-09T17:25:33.596730] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-09T17:25:34.361085] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T17:25:34.396674] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-09T17:25:34.699823] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:25:34.702143] [INFO ] [REMOTE ] AWF: Full fetch complete (35879 records). [2025-10-09T17:25:34.702223] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-09T17:25:35.078925] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-09T17:25:35.079005] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-09T17:25:35.079455] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-09T17:25:35.079496] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-09T17:25:35.080340] [DEBUG] [LOCAL ] AWF: Trimmed 35879 records to 24414 (keeping 200 days of data) [2025-10-09T17:25:35.196737] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-09T17:25:35.227815] [DEBUG] [LOCAL ] AWF: Primary data saved (24414 records). [2025-10-09T17:25:35.227996] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-09T17:25:35.228113] [INFO ] [MAIN ] Update Progress: 191/2373 symbols completed. AWF took 39.5s. Estimated remaining: 4h 51m 38s. Rate: 7.5 symbols/min [2025-10-09T17:25:35.402620] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:35.425906] [DEBUG] [LOCAL ] AWR: Loaded 22687 existing records from primary storage. [2025-10-09T17:25:35.426217] [INFO ] [MAIN ] AWR: Loaded 22687 existing records. [2025-10-09T17:25:35.624921] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:35.625145] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-09T17:25:35.625194] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-09T17:25:35.625461] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-09T17:25:35.625520] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-09T17:25:36.000904] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:35.997208] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-09T17:25:36.019011] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T17:25:36.057896] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T17:25:36.796734] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-09T17:25:37.054776] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T17:25:37.596738] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-09T17:25:37.785513] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T17:25:38.396764] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-09T17:25:39.196709] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-09T17:25:39.419520] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:25:39.489052] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T17:25:39.996806] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-09T17:25:40.121610] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T17:25:40.796773] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-09T17:25:41.596746] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-09T17:25:41.659629] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:25:41.816265] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T17:25:42.396801] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-09T17:25:42.691437] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T17:25:43.196803] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-09T17:25:43.598840] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T17:25:43.601741] [INFO ] [REMOTE ] AWI: Full fetch complete (35683 records). [2025-10-09T17:25:43.601833] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-09T17:25:43.967520] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-09T17:25:43.967604] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-09T17:25:43.968094] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-09T17:25:43.968158] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-09T17:25:43.968966] [DEBUG] [LOCAL ] AWI: Trimmed 35683 records to 25458 (keeping 200 days of data) [2025-10-09T17:25:44.023455] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-09T17:25:44.135092] [DEBUG] [LOCAL ] AWI: Primary data saved (25458 records). [2025-10-09T17:25:44.135248] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-09T17:25:44.135336] [INFO ] [MAIN ] Update Progress: 192/2373 symbols completed. AWI took 37.5s. Estimated remaining: 4h 51m 40s. Rate: 7.5 symbols/min [2025-10-09T17:25:44.337466] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:44.366012] [DEBUG] [LOCAL ] AX: Loaded 28069 existing records from primary storage. [2025-10-09T17:25:44.366305] [INFO ] [MAIN ] AX: Loaded 28069 existing records. [2025-10-09T17:25:44.555998] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:44.556275] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-09T17:25:44.556393] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-09T17:25:44.556780] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-09T17:25:44.556838] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-09T17:25:44.803230] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-09T17:25:44.920637] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:44.953851] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:25:45.133270] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T17:25:45.596693] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-09T17:25:45.976077] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:25:46.396739] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-09T17:25:47.091265] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T17:25:47.196690] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-09T17:25:47.504744] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T17:25:47.996727] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-09T17:25:48.706972] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T17:25:48.796670] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-09T17:25:49.163826] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T17:25:49.596708] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-09T17:25:50.396686] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-09T17:25:50.624336] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T17:25:50.628896] [INFO ] [REMOTE ] AWK: Full fetch complete (70675 records). [2025-10-09T17:25:50.629031] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-09T17:25:50.817726] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T17:25:51.033411] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-09T17:25:51.033501] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-09T17:25:51.034240] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-09T17:25:51.034306] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-09T17:25:51.035868] [DEBUG] [LOCAL ] AWK: Trimmed 70675 records to 49030 (keeping 200 days of data) [2025-10-09T17:25:51.225328] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-09T17:25:51.356912] [DEBUG] [LOCAL ] AWK: Primary data saved (49030 records). [2025-10-09T17:25:51.357057] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-09T17:25:51.357609] [INFO ] [MAIN ] Update Progress: 193/2373 symbols completed. AWK took 28.8s. Estimated remaining: 4h 51m 23s. Rate: 7.5 symbols/min [2025-10-09T17:25:51.527315] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:51.576169] [DEBUG] [LOCAL ] AXL: Loaded 50517 existing records from primary storage. [2025-10-09T17:25:51.576517] [INFO ] [MAIN ] AXL: Loaded 50517 existing records. [2025-10-09T17:25:51.776928] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:51.778523] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T17:25:51.778683] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-09T17:25:51.785225] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-09T17:25:51.785509] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-09T17:25:51.785583] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-09T17:25:52.003557] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-09T17:25:52.154352] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:52.155534] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T17:25:52.796719] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-09T17:25:53.292701] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T17:25:53.596745] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-09T17:25:54.198962] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T17:25:54.396745] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-09T17:25:55.159148] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:25:55.196665] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-09T17:25:55.410452] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:25:55.996765] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-09T17:25:56.684269] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:25:56.796739] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-09T17:25:56.859259] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T17:25:57.596732] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-09T17:25:58.068283] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T17:25:58.396752] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-09T17:25:59.185114] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:25:59.196680] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-09T17:25:59.471499] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T17:25:59.996790] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-09T17:26:00.796757] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-09T17:26:01.089794] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T17:26:01.156929] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T17:26:01.596764] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-09T17:26:01.854703] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:26:01.856518] [INFO ] [REMOTE ] AWP: Full fetch complete (31893 records). [2025-10-09T17:26:01.856594] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-09T17:26:01.857106] [FATAL] [VALIDATOR ] AWP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:26:01.857222] [FATAL] [MAIN ] AWP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:26:01.857265] [WARN ] [MAIN ] AWP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:26:01.857303] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-09T17:26:01.857357] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-09T17:26:01.857391] [INFO ] [LOCAL ] AWP: Starting deletion of derivative data. [2025-10-09T17:26:01.857827] [DEBUG] [LOCAL ] AWP: Deleted derivative data file. [2025-10-09T17:26:01.857916] [INFO ] [MAIN ] Update Progress: 194/2373 symbols completed. AWP took 34.1s. Estimated remaining: 4h 51m 43s. Rate: 7.5 symbols/min [2025-10-09T17:26:02.023587] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:02.072294] [DEBUG] [LOCAL ] AXP: Loaded 53172 existing records from primary storage. [2025-10-09T17:26:02.072618] [INFO ] [MAIN ] AXP: Loaded 53172 existing records. [2025-10-09T17:26:02.245527] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:02.245731] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-09T17:26:02.245792] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-09T17:26:02.246044] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-09T17:26:02.246108] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-09T17:26:02.401863] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-09T17:26:02.603055] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:02.782129] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T17:26:02.784951] [INFO ] [REMOTE ] AWR: Full fetch complete (32195 records). [2025-10-09T17:26:02.785042] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-09T17:26:03.148374] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-09T17:26:03.148452] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-09T17:26:03.148840] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-09T17:26:03.148901] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-09T17:26:03.149928] [DEBUG] [LOCAL ] AWR: Trimmed 32195 records to 22850 (keeping 200 days of data) [2025-10-09T17:26:03.207347] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-09T17:26:03.298495] [DEBUG] [LOCAL ] AWR: Primary data saved (22850 records). [2025-10-09T17:26:03.298614] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-09T17:26:03.298731] [INFO ] [MAIN ] Update Progress: 195/2373 symbols completed. AWR took 28.1s. Estimated remaining: 4h 50m 21s. Rate: 7.5 symbols/min [2025-10-09T17:26:03.470347] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:03.476812] [DEBUG] [LOCAL ] AXR: Loaded 2986 existing records from primary storage. [2025-10-09T17:26:03.476981] [INFO ] [MAIN ] AXR: Loaded 2986 existing records. [2025-10-09T17:26:03.653763] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:03.654156] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-09T17:26:03.654218] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-09T17:26:03.659607] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-09T17:26:03.666697] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-09T17:26:03.770108] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T17:26:04.006683] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-09T17:26:04.028279] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:04.796716] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-09T17:26:05.313674] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-09T17:26:05.526926] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T17:26:05.596661] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-09T17:26:06.074107] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T17:26:06.396783] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-09T17:26:06.994589] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:26:07.196762] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-09T17:26:07.963754] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T17:26:07.996685] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-09T17:26:08.495720] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-09T17:26:08.587373] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T17:26:08.796813] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-09T17:26:09.596752] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-09T17:26:10.396719] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-09T17:26:10.807269] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-09T17:26:10.918109] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-09T17:26:11.196744] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-09T17:26:11.235368] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T17:26:11.996734] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-09T17:26:12.606760] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T17:26:12.796699] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-09T17:26:13.272543] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-09T17:26:13.596735] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-09T17:26:14.184188] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T17:26:14.292923] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T17:26:14.396749] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-09T17:26:14.876788] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-09T17:26:15.196730] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-09T17:26:15.996716] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-09T17:26:16.588698] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T17:26:16.796726] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-09T17:26:17.596704] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-09T17:26:17.938308] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T17:26:18.396721] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-09T17:26:18.503408] [DEBUG] [REMOTE ] AX: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-09T17:26:18.503762] [WARN ] [REMOTE ] AX: No data returned for month 2025-06 [2025-10-09T17:26:18.503852] [FATAL] [REMOTE ] AX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:26:18.503966] [FATAL] [MAIN ] AX: Failed to fetch primary data. [2025-10-09T17:26:18.504038] [WARN ] [MAIN ] AX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:26:18.504112] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-09T17:26:18.504182] [DEBUG] [LOCAL ] AX: No primary data file found to delete. [2025-10-09T17:26:18.504252] [INFO ] [LOCAL ] AX: Starting deletion of derivative data. [2025-10-09T17:26:18.504455] [DEBUG] [LOCAL ] AX: Deleted derivative data file. [2025-10-09T17:26:18.504543] [INFO ] [MAIN ] Update Progress: 196/2373 symbols completed. AX took 34.4s. Estimated remaining: 4h 51m 33s. Rate: 7.5 symbols/min [2025-10-09T17:26:18.672902] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:18.713334] [DEBUG] [LOCAL ] AXS: Loaded 38632 existing records from primary storage. [2025-10-09T17:26:18.713626] [INFO ] [MAIN ] AXS: Loaded 38632 existing records. [2025-10-09T17:26:18.910478] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:18.910957] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-09T17:26:18.911011] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-09T17:26:18.911233] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-09T17:26:18.911291] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-09T17:26:19.199068] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-09T17:26:19.290775] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (4.09 seconds). [2025-10-09T17:26:19.344869] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:19.398739] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T17:26:19.910436] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T17:26:19.996730] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-09T17:26:20.796728] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-09T17:26:21.117075] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-09T17:26:21.596755] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-09T17:26:21.651934] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:26:22.396727] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-09T17:26:23.196725] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-09T17:26:23.257471] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:26:23.996729] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-09T17:26:24.060018] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:26:24.567207] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:26:24.796731] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-09T17:26:25.353464] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T17:26:25.605588] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-09T17:26:25.624835] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T17:26:26.186489] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T17:26:26.187231] [INFO ] [REMOTE ] AXR: Full fetch complete (4585 records). [2025-10-09T17:26:26.187301] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-09T17:26:26.401802] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-09T17:26:26.583367] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-09T17:26:26.583444] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-09T17:26:26.583575] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-09T17:26:26.583611] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-09T17:26:26.583988] [DEBUG] [LOCAL ] AXR: Trimmed 4585 records to 3001 (keeping 200 days of data) [2025-10-09T17:26:26.601694] [DEBUG] [LOCAL ] AXR: Primary data saved (3001 records). [2025-10-09T17:26:26.601781] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-09T17:26:26.601854] [INFO ] [MAIN ] Update Progress: 197/2373 symbols completed. AXR took 23.3s. Estimated remaining: 4h 51m 26s. Rate: 7.5 symbols/min [2025-10-09T17:26:27.196718] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-09T17:26:27.996702] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-09T17:26:28.093518] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T17:26:28.098245] [INFO ] [REMOTE ] AXL: Full fetch complete (72771 records). [2025-10-09T17:26:28.098358] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-09T17:26:28.499150] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-09T17:26:28.499349] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-09T17:26:28.500305] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-09T17:26:28.500391] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-09T17:26:28.521639] [DEBUG] [LOCAL ] AXL: Trimmed 72771 records to 50878 (keeping 200 days of data) [2025-10-09T17:26:28.523359] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:26:28.806286] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-09T17:26:28.825828] [DEBUG] [LOCAL ] AXL: Primary data saved (50878 records). [2025-10-09T17:26:28.825925] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-09T17:26:28.826444] [INFO ] [MAIN ] Update Progress: 198/2373 symbols completed. AXL took 37.5s. Estimated remaining: 4h 50m 14s. Rate: 7.5 symbols/min [2025-10-09T17:26:30.138715] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-09T17:26:30.151024] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-09T17:26:30.241357] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T17:26:30.396680] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-09T17:26:32.013507] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T17:26:32.022176] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-09T17:26:32.271743] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T17:26:32.283269] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-09T17:26:33.547614] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:26:33.556015] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-09T17:26:34.005410] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T17:26:34.016769] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-09T17:26:35.093378] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T17:26:35.101365] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-09T17:26:36.045986] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-09T17:26:36.049919] [INFO ] [REMOTE ] AXP: Full fetch complete (76522 records). [2025-10-09T17:26:36.050028] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-09T17:26:36.050817] [FATAL] [VALIDATOR ] AXP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:26:36.050909] [FATAL] [MAIN ] AXP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:26:36.050952] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:26:36.050989] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-09T17:26:36.051047] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-10-09T17:26:36.051097] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-10-09T17:26:36.051325] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-10-09T17:26:36.051422] [INFO ] [MAIN ] Update Progress: 199/2373 symbols completed. AXP took 34.2s. Estimated remaining: 4h 49m 57s. Rate: 7.5 symbols/min [2025-10-09T17:26:36.555788] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:26:36.564300] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-09T17:26:38.038745] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:26:38.047361] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-09T17:26:39.578609] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T17:26:39.587196] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-09T17:26:41.057153] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T17:26:41.066023] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-09T17:26:42.557852] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:26:42.562718] [INFO ] [REMOTE ] AXS: Full fetch complete (55739 records). [2025-10-09T17:26:42.562876] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-09T17:26:43.006852] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-09T17:26:43.006939] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-09T17:26:43.007607] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-09T17:26:43.007702] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-09T17:26:43.009035] [DEBUG] [LOCAL ] AXS: Trimmed 55739 records to 38952 (keeping 200 days of data) [2025-10-09T17:26:43.275916] [DEBUG] [LOCAL ] AXS: Primary data saved (38952 records). [2025-10-09T17:26:43.276097] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-09T17:26:43.276204] [INFO ] [MAIN ] Update Progress: 200/2373 symbols completed. AXS took 24.8s. Estimated remaining: 4h 49m 41s. Rate: 7.5 symbols/min [2025-10-09T17:26:43.865292] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:43.989010] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:43.984237] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:44.025782] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:44.034760] [DEBUG] [LOCAL ] AZO: Loaded 11256 existing records from primary storage. [2025-10-09T17:26:44.036873] [INFO ] [MAIN ] AZO: Loaded 11256 existing records. [2025-10-09T17:26:44.182009] [DEBUG] [LOCAL ] AYI: Loaded 25246 existing records from primary storage. [2025-10-09T17:26:44.243903] [INFO ] [MAIN ] AYI: Loaded 25246 existing records. [2025-10-09T17:26:44.274299] [DEBUG] [LOCAL ] AZZ: Loaded 22128 existing records from primary storage. [2025-10-09T17:26:44.278422] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:44.297353] [INFO ] [MAIN ] AZZ: Loaded 22128 existing records. [2025-10-09T17:26:44.297480] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-09T17:26:44.304897] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-09T17:26:44.360208] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-09T17:26:44.360342] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-09T17:26:44.361692] [DEBUG] [LOCAL ] AXTA: Loaded 52183 existing records from primary storage. [2025-10-09T17:26:44.470321] [INFO ] [MAIN ] AXTA: Loaded 52183 existing records. [2025-10-09T17:26:45.061684] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:45.125269] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:45.184690] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:45.199348] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-09T17:26:45.193701] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-09T17:26:45.210277] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-09T17:26:45.215838] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-09T17:26:45.221509] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-09T17:26:45.232225] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-09T17:26:45.235946] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-09T17:26:45.241414] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-09T17:26:45.235676] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-09T17:26:45.289031] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-09T17:26:45.273468] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-09T17:26:45.289291] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-09T17:26:45.533570] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:45.607140] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-09T17:26:46.333250] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:46.343806] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-09T17:26:46.400896] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:46.422978] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-09T17:26:46.491741] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:46.492160] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-09T17:26:46.874697] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:26:46.878348] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-09T17:26:47.233432] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T17:26:47.237638] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-09T17:26:47.701536] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:26:47.707428] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-09T17:26:47.716598] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T17:26:47.719402] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-09T17:26:47.889435] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T17:26:47.899697] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-09T17:26:48.058815] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T17:26:48.063187] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-09T17:26:48.580884] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T17:26:48.583290] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-09T17:26:48.696480] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T17:26:48.706910] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-09T17:26:49.120853] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T17:26:49.125884] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-09T17:26:49.252792] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:26:49.256466] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-09T17:26:49.392362] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:26:49.589974] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T17:26:49.596661] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-09T17:26:49.863480] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T17:26:49.941813] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T17:26:50.396721] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-09T17:26:50.882299] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T17:26:51.151972] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:26:51.196669] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-09T17:26:51.996695] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-09T17:26:52.223690] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T17:26:52.796684] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-09T17:26:52.943023] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T17:26:53.547577] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T17:26:53.596682] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-09T17:26:54.396716] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-09T17:26:54.834961] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T17:26:55.196733] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-09T17:26:55.895826] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:26:55.996696] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-09T17:26:56.070409] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T17:26:56.796698] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-09T17:26:57.151765] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:26:57.596762] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-09T17:26:57.697744] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T17:26:58.396724] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-09T17:26:58.648873] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T17:26:59.196769] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-09T17:26:59.996771] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-09T17:27:00.099979] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T17:27:00.640806] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:27:00.773210] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T17:27:00.796672] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-09T17:27:01.596762] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-09T17:27:01.647424] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T17:27:02.396757] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-09T17:27:02.575960] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T17:27:02.578744] [INFO ] [REMOTE ] AZZ: Full fetch complete (31316 records). [2025-10-09T17:27:02.578835] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-09T17:27:02.946268] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-09T17:27:02.946353] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-09T17:27:02.946799] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-09T17:27:02.946863] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-09T17:27:02.947604] [DEBUG] [LOCAL ] AZZ: Trimmed 31316 records to 22454 (keeping 200 days of data) [2025-10-09T17:27:03.089741] [DEBUG] [LOCAL ] AZZ: Primary data saved (22454 records). [2025-10-09T17:27:03.089910] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-09T17:27:03.090045] [INFO ] [MAIN ] Update Progress: 201/2373 symbols completed. AZZ took 19.8s. Estimated remaining: 4h 51m 41s. Rate: 7.4 symbols/min [2025-10-09T17:27:03.201905] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-09T17:27:03.264522] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:03.264719] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-09T17:27:03.264769] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-09T17:27:03.264880] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-09T17:27:03.264920] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-09T17:27:03.264961] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-09T17:27:03.264992] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-09T17:27:03.627804] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:03.635425] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:27:03.996687] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-09T17:27:04.070363] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T17:27:04.796733] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-09T17:27:05.364941] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:27:05.596683] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-09T17:27:06.193538] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:27:06.396766] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-09T17:27:07.196681] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-09T17:27:07.268525] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:27:07.551833] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:27:07.763492] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T17:27:07.996766] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-09T17:27:08.202416] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:27:08.202756] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-09T17:27:08.202859] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:27:08.202975] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-09T17:27:08.203043] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:27:08.203112] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-09T17:27:08.203176] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-09T17:27:08.203212] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-09T17:27:08.203279] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-09T17:27:08.203348] [INFO ] [MAIN ] Update Progress: 202/2373 symbols completed. B took 5.1s. Estimated remaining: 4h 51m 1s. Rate: 7.5 symbols/min [2025-10-09T17:27:08.370710] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:08.423892] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-09T17:27:08.424227] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-09T17:27:08.596781] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:08.596985] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-09T17:27:08.597030] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-09T17:27:08.597301] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-09T17:27:08.597358] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-09T17:27:08.801869] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-09T17:27:08.994235] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:09.596713] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-09T17:27:09.755628] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:27:09.756995] [INFO ] [REMOTE ] AZO: Full fetch complete (16060 records). [2025-10-09T17:27:09.757062] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-09T17:27:10.113067] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-09T17:27:10.113163] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-09T17:27:10.113465] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-09T17:27:10.113507] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-09T17:27:10.114036] [DEBUG] [LOCAL ] AZO: Trimmed 16060 records to 11333 (keeping 200 days of data) [2025-10-09T17:27:10.185457] [DEBUG] [LOCAL ] AZO: Primary data saved (11333 records). [2025-10-09T17:27:10.185658] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-09T17:27:10.185763] [INFO ] [MAIN ] Update Progress: 203/2373 symbols completed. AZO took 26.9s. Estimated remaining: 4h 49m 48s. Rate: 7.5 symbols/min [2025-10-09T17:27:10.350151] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:10.403587] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-09T17:27:10.406540] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-09T17:27:10.406856] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-09T17:27:10.582740] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:10.582955] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-09T17:27:10.583001] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-09T17:27:10.583771] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-09T17:27:10.583830] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-09T17:27:10.937273] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:11.196736] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-09T17:27:11.689108] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T17:27:11.692089] [INFO ] [REMOTE ] AYI: Full fetch complete (37039 records). [2025-10-09T17:27:11.692233] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-09T17:27:11.998096] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-09T17:27:12.106385] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-09T17:27:12.106561] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-09T17:27:12.107175] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-09T17:27:12.107354] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-09T17:27:12.108430] [DEBUG] [LOCAL ] AYI: Trimmed 37039 records to 25419 (keeping 200 days of data) [2025-10-09T17:27:12.258320] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-09T17:27:12.317384] [DEBUG] [LOCAL ] AYI: Primary data saved (25419 records). [2025-10-09T17:27:12.317539] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-09T17:27:12.317632] [INFO ] [MAIN ] Update Progress: 204/2373 symbols completed. AYI took 29.0s. Estimated remaining: 4h 48m 38s. Rate: 7.5 symbols/min [2025-10-09T17:27:12.507701] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:12.562896] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-09T17:27:12.563276] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-09T17:27:12.758412] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:12.758790] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-09T17:27:12.758886] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-09T17:27:12.759194] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-09T17:27:12.759257] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-09T17:27:12.809566] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-09T17:27:13.162415] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:13.597131] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-09T17:27:13.610941] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-09T17:27:14.010012] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:27:14.396746] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-09T17:27:15.207184] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-09T17:27:15.242711] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-09T17:27:15.996693] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-09T17:27:16.308346] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-09T17:27:16.796750] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-09T17:27:16.958986] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-09T17:27:16.998610] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:27:17.596719] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-09T17:27:18.099963] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-09T17:27:18.396761] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-09T17:27:18.933888] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T17:27:18.978688] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-09T17:27:19.196730] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-09T17:27:19.996730] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-09T17:27:20.796753] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-09T17:27:20.842954] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-09T17:27:21.347595] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-09T17:27:21.596722] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-09T17:27:22.124087] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:27:22.180477] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-09T17:27:22.396722] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-09T17:27:23.196733] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-09T17:27:23.996718] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-09T17:27:24.363956] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-09T17:27:24.455869] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T17:27:24.796736] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-09T17:27:25.596782] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-09T17:27:25.728454] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-09T17:27:26.116664] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-09T17:27:26.396687] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-09T17:27:26.506573] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T17:27:27.196729] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-09T17:27:27.501181] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T17:27:27.996709] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-09T17:27:28.644119] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T17:27:28.649891] [INFO ] [REMOTE ] AXTA: Full fetch complete (75112 records). [2025-10-09T17:27:28.650013] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-09T17:27:28.799714] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-09T17:27:29.058727] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-09T17:27:29.058865] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-09T17:27:29.059628] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-09T17:27:29.059782] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-09T17:27:29.089751] [DEBUG] [LOCAL ] AXTA: Trimmed 75112 records to 52567 (keeping 200 days of data) [2025-10-09T17:27:29.091418] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-09T17:27:29.418234] [DEBUG] [LOCAL ] AXTA: Primary data saved (52567 records). [2025-10-09T17:27:29.418367] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-09T17:27:29.418464] [INFO ] [MAIN ] Update Progress: 205/2373 symbols completed. AXTA took 46.1s. Estimated remaining: 4h 50m 6s. Rate: 7.5 symbols/min [2025-10-09T17:27:29.597204] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-09T17:27:29.597129] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:29.598293] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-10-09T17:27:29.598359] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-10-09T17:27:29.598501] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-09T17:27:29.598574] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-09T17:27:29.598681] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-09T17:27:29.598756] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-09T17:27:29.967384] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:30.189755] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-09T17:27:30.396737] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-09T17:27:31.018237] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-09T17:27:31.196715] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-09T17:27:31.648466] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T17:27:31.996682] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-09T17:27:32.502668] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T17:27:32.796723] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-09T17:27:33.574942] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-09T17:27:33.596683] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-09T17:27:34.396685] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-09T17:27:34.468399] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-09T17:27:34.630743] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T17:27:35.196745] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-09T17:27:35.705355] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T17:27:35.996792] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-09T17:27:36.377223] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-09T17:27:36.785839] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T17:27:36.796677] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-09T17:27:37.596737] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-09T17:27:38.396697] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-09T17:27:38.519402] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T17:27:38.885365] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-09T17:27:39.196714] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-09T17:27:39.996748] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-09T17:27:40.163042] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-09T17:27:40.723351] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-09T17:27:40.796720] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-09T17:27:41.104463] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T17:27:41.214508] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T17:27:41.219217] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-09T17:27:41.219381] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-09T17:27:41.598584] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-09T17:27:41.619386] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-09T17:27:41.619510] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-09T17:27:41.620404] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-09T17:27:41.620679] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-09T17:27:41.622498] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 54180 (keeping 200 days of data) [2025-10-09T17:27:41.775335] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T17:27:42.025438] [DEBUG] [LOCAL ] BA: Primary data saved (54180 records). [2025-10-09T17:27:42.025617] [INFO ] [MAIN ] BA: Full history saved. [2025-10-09T17:27:42.025740] [INFO ] [MAIN ] Update Progress: 206/2373 symbols completed. BA took 33.8s. Estimated remaining: 4h 50m 46s. Rate: 7.5 symbols/min [2025-10-09T17:27:42.192776] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:42.230952] [DEBUG] [LOCAL ] BAK: Loaded 39408 existing records from primary storage. [2025-10-09T17:27:42.231279] [INFO ] [MAIN ] BAK: Loaded 39408 existing records. [2025-10-09T17:27:42.403803] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-09T17:27:42.409625] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:42.410873] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-09T17:27:42.410938] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-09T17:27:42.411130] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-09T17:27:42.411187] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-09T17:27:42.769755] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:43.196774] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-09T17:27:43.996739] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-09T17:27:44.312460] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-09T17:27:44.646776] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-09T17:27:44.796677] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-09T17:27:45.065353] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T17:27:45.596697] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-09T17:27:45.673915] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:27:46.396700] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-09T17:27:46.976419] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T17:27:47.196818] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-09T17:27:47.672849] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-09T17:27:47.996699] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-09T17:27:48.069409] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:27:48.796772] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-09T17:27:49.563543] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-09T17:27:49.568458] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-09T17:27:49.568601] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-09T17:27:49.601794] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-09T17:27:49.976072] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-09T17:27:49.976273] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-09T17:27:49.977114] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-09T17:27:49.977197] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-09T17:27:49.978971] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54210 (keeping 200 days of data) [2025-10-09T17:27:50.131869] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T17:27:50.360523] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-10-09T17:27:50.360820] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-09T17:27:50.361914] [INFO ] [MAIN ] Update Progress: 207/2373 symbols completed. BABA took 40.2s. Estimated remaining: 4h 50m 41s. Rate: 7.5 symbols/min [2025-10-09T17:27:50.405749] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-09T17:27:50.539690] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:50.590919] [DEBUG] [LOCAL ] BALL: Loaded 51825 existing records from primary storage. [2025-10-09T17:27:50.591254] [INFO ] [MAIN ] BALL: Loaded 51825 existing records. [2025-10-09T17:27:50.768006] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:50.768261] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-09T17:27:50.768353] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-09T17:27:50.769962] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-09T17:27:50.770021] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-09T17:27:51.153432] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:51.158663] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-09T17:27:51.186956] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:27:51.187257] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-09T17:27:51.195491] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-09T17:27:51.208349] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-09T17:27:51.587460] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-09T17:27:51.587552] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-09T17:27:51.588456] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-09T17:27:51.588527] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-09T17:27:51.590188] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54198 (keeping 200 days of data) [2025-10-09T17:27:51.934148] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-10-09T17:27:51.934306] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-09T17:27:51.934862] [INFO ] [MAIN ] Update Progress: 208/2373 symbols completed. BAC took 39.6s. Estimated remaining: 4h 49m 26s. Rate: 7.5 symbols/min [2025-10-09T17:27:51.997114] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-09T17:27:52.110150] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:52.110503] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-09T17:27:52.110577] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-09T17:27:52.110848] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-09T17:27:52.110906] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-09T17:27:52.110950] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-09T17:27:52.110984] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-09T17:27:52.473561] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:52.506811] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-09T17:27:52.796733] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-09T17:27:53.133080] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T17:27:53.477141] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:27:53.596682] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-09T17:27:53.673087] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:27:54.396714] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-09T17:27:54.860701] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T17:27:55.196683] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-09T17:27:55.543316] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T17:27:55.996798] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-09T17:27:56.451533] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T17:27:56.796742] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-09T17:27:57.158230] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-09T17:27:57.578534] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T17:27:57.596717] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-09T17:27:58.396758] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-09T17:27:58.913771] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T17:27:59.196777] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-09T17:27:59.873551] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T17:27:59.995329] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:28:00.005001] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-09T17:28:00.796712] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-09T17:28:01.447786] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T17:28:01.596694] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-09T17:28:01.969438] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T17:28:02.396748] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-09T17:28:02.919803] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T17:28:03.196688] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-09T17:28:03.342282] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:28:03.996731] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-09T17:28:04.796689] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-09T17:28:04.908306] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T17:28:05.379415] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T17:28:05.383888] [INFO ] [REMOTE ] BAH: Full fetch complete (74910 records). [2025-10-09T17:28:05.384007] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-09T17:28:05.608975] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-09T17:28:05.787781] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-09T17:28:05.787676] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:28:05.787925] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-09T17:28:05.792187] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-09T17:28:05.792547] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-09T17:28:05.794047] [DEBUG] [LOCAL ] BAH: Trimmed 74910 records to 52055 (keeping 200 days of data) [2025-10-09T17:28:06.128110] [DEBUG] [LOCAL ] BAH: Primary data saved (52055 records). [2025-10-09T17:28:06.128268] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-09T17:28:06.128345] [INFO ] [MAIN ] Update Progress: 209/2373 symbols completed. BAH took 36.7s. Estimated remaining: 4h 50m 22s. Rate: 7.5 symbols/min [2025-10-09T17:28:06.332267] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:06.393016] [DEBUG] [LOCAL ] BAM: Loaded 52011 existing records from primary storage. [2025-10-09T17:28:06.393522] [INFO ] [MAIN ] BAM: Loaded 52011 existing records. [2025-10-09T17:28:06.406993] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-09T17:28:06.626345] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:06.626674] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-09T17:28:06.626754] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-09T17:28:06.628753] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-09T17:28:06.628875] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-09T17:28:07.121813] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T17:28:07.200307] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-09T17:28:07.261527] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:07.297720] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T17:28:07.996755] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-09T17:28:08.346335] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T17:28:08.796737] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-09T17:28:09.297294] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:28:09.596718] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-09T17:28:10.033549] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T17:28:10.163606] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T17:28:10.396720] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-09T17:28:11.196768] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-09T17:28:11.750870] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T17:28:11.950032] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:28:11.996757] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-09T17:28:12.796407] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-09T17:28:12.797751] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-09T17:28:12.798494] [INFO ] [REMOTE ] BALY: Full fetch complete (16667 records). [2025-10-09T17:28:12.798594] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-09T17:28:12.800021] [FATAL] [VALIDATOR ] BALY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:28:12.800176] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:28:12.800261] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:28:12.800350] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-09T17:28:12.800450] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-09T17:28:12.800584] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-09T17:28:12.800680] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-09T17:28:12.800764] [INFO ] [MAIN ] Update Progress: 210/2373 symbols completed. BALY took 20.9s. Estimated remaining: 4h 49m 59s. Rate: 7.5 symbols/min [2025-10-09T17:28:12.979404] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:13.035214] [DEBUG] [LOCAL ] BANC: Loaded 51277 existing records from primary storage. [2025-10-09T17:28:13.035593] [INFO ] [MAIN ] BANC: Loaded 51277 existing records. [2025-10-09T17:28:13.222245] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:13.222474] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-09T17:28:13.222521] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-09T17:28:13.224053] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-09T17:28:13.224114] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-09T17:28:13.588162] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:13.596668] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-09T17:28:14.201834] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T17:28:14.396718] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-09T17:28:15.196742] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-09T17:28:15.411516] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T17:28:15.793811] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:28:15.996756] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-09T17:28:16.796712] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-09T17:28:17.079733] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T17:28:17.596701] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-09T17:28:17.630019] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T17:28:18.131263] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:28:18.396709] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-09T17:28:18.935767] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T17:28:19.196740] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-09T17:28:19.917883] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T17:28:19.921802] [INFO ] [REMOTE ] BAK: Full fetch complete (57070 records). [2025-10-09T17:28:19.921959] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-09T17:28:20.001824] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-09T17:28:20.325133] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-09T17:28:20.325216] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-09T17:28:20.325836] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-09T17:28:20.325900] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-09T17:28:20.327024] [DEBUG] [LOCAL ] BAK: Trimmed 57070 records to 39681 (keeping 200 days of data) [2025-10-09T17:28:20.558152] [DEBUG] [LOCAL ] BAK: Primary data saved (39681 records). [2025-10-09T17:28:20.558315] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-09T17:28:20.558414] [INFO ] [MAIN ] Update Progress: 211/2373 symbols completed. BAK took 38.5s. Estimated remaining: 4h 49m 48s. Rate: 7.5 symbols/min [2025-10-09T17:28:20.760337] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:20.787043] [DEBUG] [LOCAL ] BAP: Loaded 25923 existing records from primary storage. [2025-10-09T17:28:20.787339] [INFO ] [MAIN ] BAP: Loaded 25923 existing records. [2025-10-09T17:28:20.810583] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-09T17:28:20.925881] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:28:21.017878] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:21.018163] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-09T17:28:21.018227] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-09T17:28:21.019185] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-09T17:28:21.019250] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-09T17:28:21.379253] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:21.601962] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-09T17:28:21.607541] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T17:28:22.396770] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-09T17:28:22.512877] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T17:28:22.519996] [INFO ] [REMOTE ] BALL: Full fetch complete (75373 records). [2025-10-09T17:28:22.520119] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-09T17:28:22.919508] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-09T17:28:22.919615] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-09T17:28:22.920687] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-09T17:28:22.920756] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-09T17:28:22.922418] [DEBUG] [LOCAL ] BALL: Trimmed 75373 records to 52213 (keeping 200 days of data) [2025-10-09T17:28:23.159757] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:28:23.200915] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-09T17:28:23.274098] [DEBUG] [LOCAL ] BALL: Primary data saved (52213 records). [2025-10-09T17:28:23.274214] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-09T17:28:23.274849] [INFO ] [MAIN ] Update Progress: 212/2373 symbols completed. BALL took 32.9s. Estimated remaining: 4h 48m 46s. Rate: 7.5 symbols/min [2025-10-09T17:28:23.520303] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:23.558320] [DEBUG] [LOCAL ] BARK: Loaded 37978 existing records from primary storage. [2025-10-09T17:28:23.558615] [INFO ] [MAIN ] BARK: Loaded 37978 existing records. [2025-10-09T17:28:23.740215] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:23.740438] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-09T17:28:23.740484] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-09T17:28:23.741538] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-09T17:28:23.741596] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-09T17:28:23.997028] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-09T17:28:24.107828] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:24.186416] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T17:28:24.548288] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T17:28:24.796731] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-09T17:28:25.596705] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-09T17:28:25.744595] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:28:25.886213] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T17:28:26.396715] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-09T17:28:27.196683] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-09T17:28:27.268179] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:28:27.996736] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-09T17:28:28.222854] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T17:28:28.329375] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T17:28:28.796784] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-09T17:28:29.596902] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-09T17:28:30.103750] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T17:28:30.141189] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-09T17:28:30.396766] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-09T17:28:31.017557] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T17:28:31.196730] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-09T17:28:31.996689] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-09T17:28:32.340081] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T17:28:32.412196] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:28:32.796720] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-09T17:28:33.596696] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-09T17:28:33.653938] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:28:34.115977] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T17:28:34.396749] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-09T17:28:34.999143] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T17:28:35.196732] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-09T17:28:35.996711] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-09T17:28:36.340503] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T17:28:36.591940] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T17:28:36.796721] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-09T17:28:37.596755] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-09T17:28:37.730343] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:28:38.200190] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T17:28:38.396730] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-09T17:28:38.961141] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T17:28:39.196719] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-09T17:28:39.354563] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T17:28:39.996761] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-09T17:28:40.796695] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-09T17:28:41.193367] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-09T17:28:41.397858] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:28:41.601783] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-09T17:28:41.611040] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T17:28:42.396719] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-09T17:28:43.196725] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-09T17:28:43.288476] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T17:28:43.293792] [INFO ] [REMOTE ] BAM: Full fetch complete (74558 records). [2025-10-09T17:28:43.293914] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-09T17:28:43.715823] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-09T17:28:43.715984] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-09T17:28:43.716765] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-09T17:28:43.716828] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-09T17:28:43.718322] [DEBUG] [LOCAL ] BAM: Trimmed 74558 records to 52387 (keeping 200 days of data) [2025-10-09T17:28:44.008192] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-09T17:28:44.057414] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:28:44.107213] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T17:28:44.106380] [DEBUG] [LOCAL ] BAM: Primary data saved (52387 records). [2025-10-09T17:28:44.112970] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-09T17:28:44.114977] [INFO ] [MAIN ] Update Progress: 213/2373 symbols completed. BAM took 38.0s. Estimated remaining: 4h 50m 48s. Rate: 7.4 symbols/min [2025-10-09T17:28:44.296091] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:44.352404] [DEBUG] [LOCAL ] BAX: Loaded 53504 existing records from primary storage. [2025-10-09T17:28:44.352796] [INFO ] [MAIN ] BAX: Loaded 53504 existing records. [2025-10-09T17:28:44.537136] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:44.537355] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-09T17:28:44.537403] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-09T17:28:44.539187] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-09T17:28:44.539250] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-09T17:28:44.801949] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-09T17:28:44.905133] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:45.341949] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:28:45.596743] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-09T17:28:45.974457] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T17:28:46.396747] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-09T17:28:47.196706] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-09T17:28:47.328804] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T17:28:47.533691] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T17:28:47.996719] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-09T17:28:48.796738] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-09T17:28:49.060223] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:28:49.596710] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-09T17:28:49.902397] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T17:28:50.145521] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:28:50.396752] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-09T17:28:51.196700] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-09T17:28:51.320735] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:28:51.741457] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:28:51.748030] [INFO ] [REMOTE ] BANC: Full fetch complete (74329 records). [2025-10-09T17:28:51.748203] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-09T17:28:52.004354] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-09T17:28:52.139154] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-09T17:28:52.139244] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-09T17:28:52.140011] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-09T17:28:52.140079] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-09T17:28:52.141514] [DEBUG] [LOCAL ] BANC: Trimmed 74329 records to 51663 (keeping 200 days of data) [2025-10-09T17:28:52.469104] [DEBUG] [LOCAL ] BANC: Primary data saved (51663 records). [2025-10-09T17:28:52.469346] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-09T17:28:52.469940] [INFO ] [MAIN ] Update Progress: 214/2373 symbols completed. BANC took 39.7s. Estimated remaining: 4h 50m 43s. Rate: 7.4 symbols/min [2025-10-09T17:28:52.615966] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T17:28:52.667313] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:52.717027] [DEBUG] [LOCAL ] BB: Loaded 52939 existing records from primary storage. [2025-10-09T17:28:52.717335] [INFO ] [MAIN ] BB: Loaded 52939 existing records. [2025-10-09T17:28:52.805080] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-09T17:28:52.895964] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:52.896205] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-09T17:28:52.896275] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-09T17:28:52.897838] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-09T17:28:52.897900] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-09T17:28:53.245763] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:53.596716] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-09T17:28:53.754456] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T17:28:53.836799] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T17:28:54.396706] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-09T17:28:55.196888] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-09T17:28:55.747206] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-09T17:28:55.996696] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-09T17:28:56.033409] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:28:56.350058] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T17:28:56.352218] [INFO ] [REMOTE ] BAP: Full fetch complete (37310 records). [2025-10-09T17:28:56.352288] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-09T17:28:56.722541] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-09T17:28:56.722620] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-09T17:28:56.723117] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-09T17:28:56.723178] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-09T17:28:56.724145] [DEBUG] [LOCAL ] BAP: Trimmed 37310 records to 26069 (keeping 200 days of data) [2025-10-09T17:28:56.811999] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-09T17:28:56.883277] [DEBUG] [LOCAL ] BAP: Primary data saved (26069 records). [2025-10-09T17:28:56.883404] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-09T17:28:56.883515] [INFO ] [MAIN ] Update Progress: 215/2373 symbols completed. BAP took 36.3s. Estimated remaining: 4h 49m 58s. Rate: 7.4 symbols/min [2025-10-09T17:28:57.049375] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:57.103226] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-09T17:28:57.103589] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-09T17:28:57.284580] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:57.284877] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-09T17:28:57.284954] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-09T17:28:57.285205] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-09T17:28:57.285277] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-09T17:28:57.605688] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-09T17:28:57.646726] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:57.814863] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T17:28:58.060226] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T17:28:58.063461] [INFO ] [REMOTE ] BARK: Full fetch complete (55970 records). [2025-10-09T17:28:58.063555] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-09T17:28:58.401835] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-09T17:28:58.454194] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-09T17:28:58.454273] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-09T17:28:58.454977] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-09T17:28:58.455042] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-09T17:28:58.456220] [DEBUG] [LOCAL ] BARK: Trimmed 55970 records to 38242 (keeping 200 days of data) [2025-10-09T17:28:58.670526] [DEBUG] [LOCAL ] BARK: Primary data saved (38242 records). [2025-10-09T17:28:58.670687] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-09T17:28:58.671270] [INFO ] [MAIN ] Update Progress: 216/2373 symbols completed. BARK took 35.4s. Estimated remaining: 4h 48m 47s. Rate: 7.5 symbols/min [2025-10-09T17:28:58.844625] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:58.893394] [DEBUG] [LOCAL ] BBAR: Loaded 41817 existing records from primary storage. [2025-10-09T17:28:58.893854] [INFO ] [MAIN ] BBAR: Loaded 41817 existing records. [2025-10-09T17:28:59.146478] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:59.147063] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-09T17:28:59.147148] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-09T17:28:59.148564] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-09T17:28:59.148676] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-09T17:28:59.201998] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-09T17:28:59.679288] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T17:28:59.768662] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:59.996767] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-09T17:29:00.796742] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-09T17:29:01.010111] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-09T17:29:01.450383] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-09T17:29:01.596673] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-09T17:29:01.749714] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T17:29:02.026457] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T17:29:02.396786] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-09T17:29:03.196714] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-09T17:29:03.580025] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T17:29:03.993696] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:29:04.003744] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-09T17:29:04.787740] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T17:29:04.796934] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-09T17:29:05.596729] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-09T17:29:06.396711] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-09T17:29:06.491358] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-09T17:29:06.646776] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T17:29:07.196684] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-09T17:29:07.256811] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T17:29:07.601478] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T17:29:07.996730] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-09T17:29:08.765628] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T17:29:08.796721] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-09T17:29:09.181960] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T17:29:09.596733] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-09T17:29:10.396769] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-09T17:29:11.085989] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T17:29:11.196742] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-09T17:29:11.360953] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-09T17:29:11.816104] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:29:11.996727] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-09T17:29:12.702308] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:29:12.796701] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-09T17:29:13.596743] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-09T17:29:13.980562] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T17:29:14.396696] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-09T17:29:14.678836] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-09T17:29:15.196692] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-09T17:29:15.704159] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T17:29:15.996736] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-09T17:29:16.064122] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T17:29:16.555124] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:29:16.559919] [INFO ] [REMOTE ] BAX: Full fetch complete (77440 records). [2025-10-09T17:29:16.560079] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-09T17:29:16.801863] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-09T17:29:16.993160] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-09T17:29:16.993252] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-09T17:29:16.994049] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-09T17:29:16.994111] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-09T17:29:16.995605] [DEBUG] [LOCAL ] BAX: Trimmed 77440 records to 53893 (keeping 200 days of data) [2025-10-09T17:29:17.322194] [DEBUG] [LOCAL ] BAX: Primary data saved (53893 records). [2025-10-09T17:29:17.322360] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-09T17:29:17.322491] [INFO ] [MAIN ] Update Progress: 217/2373 symbols completed. BAX took 33.2s. Estimated remaining: 4h 50m 25s. Rate: 7.4 symbols/min [2025-10-09T17:29:17.489242] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:17.541371] [DEBUG] [LOCAL ] BBD: Loaded 53245 existing records from primary storage. [2025-10-09T17:29:17.541720] [INFO ] [MAIN ] BBD: Loaded 53245 existing records. [2025-10-09T17:29:17.602928] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-09T17:29:17.717229] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:17.717456] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-09T17:29:17.717504] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-09T17:29:17.717814] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-09T17:29:17.717872] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-09T17:29:18.062254] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:18.396800] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-09T17:29:18.602040] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-09T17:29:18.762535] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T17:29:19.194626] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:29:19.202873] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-09T17:29:19.996739] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-09T17:29:20.168501] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:29:20.796798] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-09T17:29:21.048570] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T17:29:21.528064] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T17:29:21.596676] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-09T17:29:22.225807] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T17:29:22.396707] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-09T17:29:23.196721] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-09T17:29:23.377943] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T17:29:23.382014] [INFO ] [REMOTE ] BBAR: Full fetch complete (61047 records). [2025-10-09T17:29:23.382122] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-09T17:29:23.779362] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-09T17:29:23.779484] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-09T17:29:23.780260] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-09T17:29:23.780327] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-09T17:29:23.781597] [DEBUG] [LOCAL ] BBAR: Trimmed 61047 records to 42187 (keeping 200 days of data) [2025-10-09T17:29:23.999457] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-09T17:29:24.047614] [DEBUG] [LOCAL ] BBAR: Primary data saved (42187 records). [2025-10-09T17:29:24.047783] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-09T17:29:24.049457] [INFO ] [MAIN ] Update Progress: 218/2373 symbols completed. BBAR took 25.4s. Estimated remaining: 4h 50m 3s. Rate: 7.4 symbols/min [2025-10-09T17:29:24.181127] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T17:29:24.262668] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:24.295320] [DEBUG] [LOCAL ] BBDC: Loaded 33016 existing records from primary storage. [2025-10-09T17:29:24.295586] [INFO ] [MAIN ] BBDC: Loaded 33016 existing records. [2025-10-09T17:29:24.483733] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:24.483965] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-09T17:29:24.484014] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-09T17:29:24.484273] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-09T17:29:24.484331] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-09T17:29:24.808185] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-09T17:29:24.857932] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:25.172415] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T17:29:25.596748] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-09T17:29:26.396745] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-09T17:29:26.456080] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T17:29:26.542919] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-09T17:29:27.196771] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-09T17:29:27.657421] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T17:29:27.741498] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-09T17:29:27.996759] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-09T17:29:28.796695] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-09T17:29:28.983818] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:29:29.399568] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:29:29.596696] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-09T17:29:30.396749] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-09T17:29:31.196687] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-09T17:29:31.343426] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-09T17:29:31.707534] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-09T17:29:31.711985] [INFO ] [REMOTE ] BB: Full fetch complete (76985 records). [2025-10-09T17:29:31.712094] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-09T17:29:31.868816] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:29:32.005130] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-09T17:29:32.126173] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-09T17:29:32.126251] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-09T17:29:32.127064] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-09T17:29:32.127128] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-09T17:29:32.128533] [DEBUG] [LOCAL ] BB: Trimmed 76985 records to 53323 (keeping 200 days of data) [2025-10-09T17:29:32.432527] [DEBUG] [LOCAL ] BB: Primary data saved (53323 records). [2025-10-09T17:29:32.432695] [INFO ] [MAIN ] BB: Full history saved. [2025-10-09T17:29:32.433588] [INFO ] [MAIN ] Update Progress: 219/2373 symbols completed. BB took 40.0s. Estimated remaining: 4h 49m 58s. Rate: 7.4 symbols/min [2025-10-09T17:29:32.600048] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:32.600289] [DEBUG] [LOCAL ] BBDO: No existing data file found in primary storage. [2025-10-09T17:29:32.600344] [WARN ] [MAIN ] BBDO: No existing data found, performing full refresh instead. [2025-10-09T17:29:32.600483] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-09T17:29:32.600549] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-09T17:29:32.600599] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-09T17:29:32.600631] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-09T17:29:32.805472] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-09T17:29:32.969059] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:33.256717] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-09T17:29:33.596784] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-09T17:29:34.309954] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T17:29:34.396683] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-09T17:29:34.547255] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T17:29:34.913707] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-09T17:29:35.196750] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-09T17:29:35.996731] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-09T17:29:36.029748] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:29:36.656296] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T17:29:36.796703] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-09T17:29:37.596780] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-09T17:29:38.097238] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-09T17:29:38.396730] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-09T17:29:38.985965] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-09T17:29:39.035839] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T17:29:39.196733] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-09T17:29:39.996718] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-09T17:29:40.566796] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T17:29:40.644999] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-09T17:29:40.796740] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-09T17:29:41.439181] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:29:41.596703] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-09T17:29:42.396728] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-09T17:29:42.839360] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T17:29:43.196737] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-09T17:29:43.288162] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-09T17:29:43.292592] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-09T17:29:43.292739] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-09T17:29:43.685121] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-09T17:29:43.685225] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-09T17:29:43.686045] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-09T17:29:43.686111] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-09T17:29:43.687581] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-10-09T17:29:43.996403] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-10-09T17:29:43.996548] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-09T17:29:43.996629] [INFO ] [MAIN ] Update Progress: 220/2373 symbols completed. BBAI took 47.1s. Estimated remaining: 4h 50m 24s. Rate: 7.4 symbols/min [2025-10-09T17:29:44.008770] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-09T17:29:44.173265] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:44.193860] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T17:29:44.215038] [DEBUG] [LOCAL ] BBN: Loaded 18059 existing records from primary storage. [2025-10-09T17:29:44.215305] [INFO ] [MAIN ] BBN: Loaded 18059 existing records. [2025-10-09T17:29:44.429506] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:44.429874] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-09T17:29:44.429930] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-09T17:29:44.432564] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T17:29:44.432633] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-09T17:29:44.432899] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-09T17:29:44.695389] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T17:29:44.801196] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-09T17:29:44.805834] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:45.596770] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-09T17:29:46.151736] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:29:46.396727] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-09T17:29:46.667158] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T17:29:47.196751] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-09T17:29:47.957551] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T17:29:47.996665] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-09T17:29:48.508167] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T17:29:48.796728] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-09T17:29:48.909055] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T17:29:49.470721] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:29:49.596728] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-09T17:29:50.396756] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-09T17:29:50.520452] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T17:29:51.196841] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-09T17:29:51.996833] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-09T17:29:52.247936] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T17:29:52.253128] [INFO ] [REMOTE ] BBD: Full fetch complete (77108 records). [2025-10-09T17:29:52.253328] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-09T17:29:52.676106] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-09T17:29:52.676345] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-09T17:29:52.677307] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-09T17:29:52.677572] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-09T17:29:52.689164] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:29:52.693977] [DEBUG] [LOCAL ] BBD: Trimmed 77108 records to 53631 (keeping 200 days of data) [2025-10-09T17:29:52.696106] [INFO ] [REMOTE ] BBDC: Full fetch complete (48525 records). [2025-10-09T17:29:52.696424] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-09T17:29:52.804583] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-09T17:29:52.883747] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T17:29:53.344497] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-09T17:29:53.349136] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-09T17:29:53.351905] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-09T17:29:53.351990] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-09T17:29:53.365009] [DEBUG] [LOCAL ] BBDC: Trimmed 48525 records to 33271 (keeping 200 days of data) [2025-10-09T17:29:53.610305] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-09T17:29:53.643543] [DEBUG] [LOCAL ] BBD: Primary data saved (53631 records). [2025-10-09T17:29:53.644306] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-09T17:29:53.644885] [INFO ] [MAIN ] Update Progress: 221/2373 symbols completed. BBD took 36.3s. Estimated remaining: 4h 50m 31s. Rate: 7.4 symbols/min [2025-10-09T17:29:53.843692] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:53.845524] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-09T17:29:53.845601] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-09T17:29:53.845798] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-09T17:29:53.845875] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-09T17:29:53.847037] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-09T17:29:53.847421] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-09T17:29:53.919919] [DEBUG] [LOCAL ] BBDC: Primary data saved (33271 records). [2025-10-09T17:29:53.932299] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-09T17:29:53.962732] [INFO ] [MAIN ] Update Progress: 222/2373 symbols completed. BBDC took 29.9s. Estimated remaining: 4h 49m 8s. Rate: 7.4 symbols/min [2025-10-09T17:29:54.159311] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T17:29:54.371604] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T17:29:54.402992] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-09T17:29:54.402896] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:54.472312] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:54.478896] [DEBUG] [LOCAL ] BBU: Loaded 5128 existing records from primary storage. [2025-10-09T17:29:54.479260] [INFO ] [MAIN ] BBU: Loaded 5128 existing records. [2025-10-09T17:29:54.675210] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:54.675499] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-09T17:29:54.675552] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-09T17:29:54.675813] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-09T17:29:54.675877] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-09T17:29:55.045807] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:55.196712] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-09T17:29:55.440942] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T17:29:55.891503] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T17:29:55.996749] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-09T17:29:56.590822] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T17:29:56.796721] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-09T17:29:57.596730] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-09T17:29:57.794406] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:29:57.794834] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-09T17:29:57.794971] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:29:57.795055] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-09T17:29:57.795129] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:29:57.795217] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-09T17:29:57.795294] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-09T17:29:57.795333] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-09T17:29:57.795389] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-09T17:29:57.795460] [INFO ] [MAIN ] Update Progress: 223/2373 symbols completed. BBT took 4.2s. Estimated remaining: 4h 48m 19s. Rate: 7.5 symbols/min [2025-10-09T17:29:57.949207] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T17:29:58.022226] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:58.037612] [DEBUG] [LOCAL ] BBUC: Loaded 13474 existing records from primary storage. [2025-10-09T17:29:58.037863] [INFO ] [MAIN ] BBUC: Loaded 13474 existing records. [2025-10-09T17:29:58.251146] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:58.251384] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-09T17:29:58.251432] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-09T17:29:58.251699] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-09T17:29:58.251759] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-09T17:29:58.401862] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-09T17:29:58.630834] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:59.196773] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-09T17:29:59.550252] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T17:29:59.772368] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T17:29:59.996739] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-09T17:30:00.796743] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-09T17:30:01.015168] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T17:30:01.596815] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-09T17:30:01.758965] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T17:30:02.248177] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T17:30:02.396729] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-09T17:30:03.055011] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T17:30:03.196744] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-09T17:30:03.992323] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T17:30:03.996666] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-09T17:30:04.796686] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-09T17:30:04.960419] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:30:05.349246] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:30:05.596745] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-09T17:30:06.396708] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-09T17:30:06.744764] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T17:30:07.194774] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T17:30:07.196667] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-09T17:30:07.849703] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T17:30:07.996745] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-09T17:30:08.456815] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T17:30:08.796730] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-09T17:30:09.574228] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T17:30:09.596735] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-09T17:30:09.981852] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-09T17:30:10.396731] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-09T17:30:11.196721] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-09T17:30:11.497819] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:30:11.499516] [INFO ] [REMOTE ] BBN: Full fetch complete (26018 records). [2025-10-09T17:30:11.499590] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-09T17:30:11.893184] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-09T17:30:11.898058] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-09T17:30:11.899038] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-09T17:30:11.899837] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-09T17:30:11.900106] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T17:30:11.904009] [DEBUG] [LOCAL ] BBN: Trimmed 26018 records to 18140 (keeping 200 days of data) [2025-10-09T17:30:11.996696] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-09T17:30:12.026790] [DEBUG] [LOCAL ] BBN: Primary data saved (18140 records). [2025-10-09T17:30:12.026938] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-09T17:30:12.027020] [INFO ] [MAIN ] Update Progress: 224/2373 symbols completed. BBN took 28.0s. Estimated remaining: 4h 49m 10s. Rate: 7.4 symbols/min [2025-10-09T17:30:12.206070] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:12.255080] [DEBUG] [LOCAL ] BBVA: Loaded 49165 existing records from primary storage. [2025-10-09T17:30:12.255454] [INFO ] [MAIN ] BBVA: Loaded 49165 existing records. [2025-10-09T17:30:12.431083] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:12.431278] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-09T17:30:12.431371] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-09T17:30:12.431709] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-09T17:30:12.431768] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-09T17:30:12.540224] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T17:30:12.798827] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-09T17:30:12.811724] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:13.596732] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-09T17:30:13.646688] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T17:30:14.274450] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T17:30:14.396721] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-09T17:30:15.150109] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T17:30:15.151544] [INFO ] [REMOTE ] BBU: Full fetch complete (6967 records). [2025-10-09T17:30:15.151613] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-09T17:30:15.152021] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:30:15.152103] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:30:15.152146] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:30:15.152184] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-09T17:30:15.152239] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-09T17:30:15.152274] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-09T17:30:15.152547] [DEBUG] [LOCAL ] BBU: Deleted derivative data file. [2025-10-09T17:30:15.152635] [INFO ] [MAIN ] Update Progress: 225/2373 symbols completed. BBU took 21.2s. Estimated remaining: 4h 48m 15s. Rate: 7.5 symbols/min [2025-10-09T17:30:15.205076] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-09T17:30:15.321538] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:15.348193] [DEBUG] [LOCAL ] BBW: Loaded 27086 existing records from primary storage. [2025-10-09T17:30:15.348461] [INFO ] [MAIN ] BBW: Loaded 27086 existing records. [2025-10-09T17:30:15.524245] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:15.524489] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-09T17:30:15.524535] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-09T17:30:15.524793] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-09T17:30:15.524850] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-09T17:30:15.872883] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:15.996730] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-09T17:30:16.796709] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-09T17:30:16.881222] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T17:30:17.233766] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T17:30:17.596719] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-09T17:30:18.345231] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:30:18.387537] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:30:18.396670] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-09T17:30:19.131521] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T17:30:19.196681] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-09T17:30:19.824665] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:30:19.996723] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-09T17:30:20.605071] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T17:30:20.796725] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-09T17:30:21.596722] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-09T17:30:21.700832] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T17:30:22.312196] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:30:22.313302] [INFO ] [REMOTE ] BBDO: Full fetch complete (7573 records). [2025-10-09T17:30:22.313371] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-09T17:30:22.401899] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-09T17:30:22.700729] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-09T17:30:22.700816] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-09T17:30:22.701025] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-09T17:30:22.701065] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-09T17:30:22.701453] [DEBUG] [LOCAL ] BBDO: Trimmed 7573 records to 5042 (keeping 200 days of data) [2025-10-09T17:30:22.730851] [DEBUG] [LOCAL ] BBDO: Primary data saved (5042 records). [2025-10-09T17:30:22.730948] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-09T17:30:22.731016] [INFO ] [MAIN ] Update Progress: 226/2373 symbols completed. BBDO took 50.3s. Estimated remaining: 4h 48m 2s. Rate: 7.5 symbols/min [2025-10-09T17:30:22.898765] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:22.953277] [DEBUG] [LOCAL ] BBWI: Loaded 53582 existing records from primary storage. [2025-10-09T17:30:22.953601] [INFO ] [MAIN ] BBWI: Loaded 53582 existing records. [2025-10-09T17:30:23.131700] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:23.131932] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-09T17:30:23.131980] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-09T17:30:23.132194] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-09T17:30:23.132252] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-09T17:30:23.205280] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-09T17:30:23.490399] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:23.996683] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-09T17:30:24.112598] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T17:30:24.567158] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-09T17:30:24.796705] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-09T17:30:25.360853] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T17:30:25.596692] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-09T17:30:25.994786] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T17:30:26.396765] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-09T17:30:27.196708] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-09T17:30:27.230334] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T17:30:27.232336] [INFO ] [REMOTE ] BBUC: Full fetch complete (18467 records). [2025-10-09T17:30:27.232451] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-09T17:30:27.576718] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T17:30:27.719873] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-09T17:30:27.719961] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-09T17:30:27.720302] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-09T17:30:27.720345] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-09T17:30:27.720938] [DEBUG] [LOCAL ] BBUC: Trimmed 18467 records to 13573 (keeping 200 days of data) [2025-10-09T17:30:27.812415] [DEBUG] [LOCAL ] BBUC: Primary data saved (13573 records). [2025-10-09T17:30:27.812568] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-09T17:30:27.812678] [INFO ] [MAIN ] Update Progress: 227/2373 symbols completed. BBUC took 30.0s. Estimated remaining: 4h 47m 26s. Rate: 7.5 symbols/min [2025-10-09T17:30:27.981743] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:27.996679] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-09T17:30:28.033689] [DEBUG] [LOCAL ] BBY: Loaded 53453 existing records from primary storage. [2025-10-09T17:30:28.034039] [INFO ] [MAIN ] BBY: Loaded 53453 existing records. [2025-10-09T17:30:28.212387] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:28.212675] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-09T17:30:28.212738] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-09T17:30:28.212981] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-09T17:30:28.213041] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-09T17:30:28.582826] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:28.599698] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T17:30:28.796714] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-09T17:30:29.575791] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T17:30:29.596664] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-09T17:30:29.713244] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T17:30:30.396784] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-09T17:30:30.978379] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T17:30:31.196700] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-09T17:30:31.996690] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-09T17:30:32.110001] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T17:30:32.752723] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T17:30:32.796695] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-09T17:30:32.882412] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:30:33.596698] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-09T17:30:33.971985] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T17:30:34.396735] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-09T17:30:35.196764] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-09T17:30:35.240533] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:30:35.996679] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-09T17:30:36.102912] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T17:30:36.347992] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T17:30:36.796714] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-09T17:30:37.596739] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-09T17:30:37.840392] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T17:30:37.967591] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T17:30:38.396778] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-09T17:30:39.196796] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-09T17:30:39.264320] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:30:39.763354] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T17:30:39.996713] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-09T17:30:40.764312] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T17:30:40.796677] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-09T17:30:41.596766] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-09T17:30:41.812163] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T17:30:42.396698] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-09T17:30:42.523388] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:30:42.956590] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T17:30:43.196712] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-09T17:30:43.996732] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-09T17:30:44.248102] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:30:44.628895] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T17:30:44.796767] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-09T17:30:45.596738] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-09T17:30:45.795297] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:30:45.798499] [INFO ] [REMOTE ] BBW: Full fetch complete (39602 records). [2025-10-09T17:30:45.798585] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-09T17:30:46.217031] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-09T17:30:46.217137] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-09T17:30:46.217662] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-09T17:30:46.217741] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-09T17:30:46.218709] [DEBUG] [LOCAL ] BBW: Trimmed 39602 records to 27318 (keeping 200 days of data) [2025-10-09T17:30:46.390965] [DEBUG] [LOCAL ] BBW: Primary data saved (27318 records). [2025-10-09T17:30:46.391106] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-09T17:30:46.391194] [INFO ] [MAIN ] Update Progress: 228/2373 symbols completed. BBW took 31.2s. Estimated remaining: 4h 48m 57s. Rate: 7.4 symbols/min [2025-10-09T17:30:46.425217] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-09T17:30:46.592887] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:46.646012] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T17:30:46.673834] [DEBUG] [LOCAL ] BC: Loaded 44121 existing records from primary storage. [2025-10-09T17:30:46.674231] [INFO ] [MAIN ] BC: Loaded 44121 existing records. [2025-10-09T17:30:46.895116] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:46.895341] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-09T17:30:46.895391] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-09T17:30:46.895784] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-09T17:30:46.895842] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-09T17:30:47.206285] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-09T17:30:47.342210] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:47.996796] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-09T17:30:48.383458] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T17:30:48.796749] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-09T17:30:49.232327] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (3.64 seconds). [2025-10-09T17:30:49.596706] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-09T17:30:50.584719] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:30:50.596203] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-09T17:30:50.959758] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T17:30:51.196743] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-09T17:30:51.961518] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (4.76 seconds). [2025-10-09T17:30:51.996673] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-09T17:30:52.858396] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:30:52.869044] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-09T17:30:53.462031] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:30:53.466471] [INFO ] [REMOTE ] BBWI: Full fetch complete (77441 records). [2025-10-09T17:30:53.466589] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-09T17:30:53.759286] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (5.76 seconds). [2025-10-09T17:30:53.779716] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-09T17:30:53.905967] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-09T17:30:53.906060] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-09T17:30:53.906927] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-09T17:30:53.906995] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-09T17:30:53.908453] [DEBUG] [LOCAL ] BBWI: Trimmed 77441 records to 53972 (keeping 200 days of data) [2025-10-09T17:30:54.248926] [DEBUG] [LOCAL ] BBWI: Primary data saved (53972 records). [2025-10-09T17:30:54.249069] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-09T17:30:54.249787] [INFO ] [MAIN ] Update Progress: 229/2373 symbols completed. BBWI took 31.5s. Estimated remaining: 4h 48m 47s. Rate: 7.4 symbols/min [2025-10-09T17:30:54.420125] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:54.457376] [DEBUG] [LOCAL ] BCAT: Loaded 34116 existing records from primary storage. [2025-10-09T17:30:54.457633] [INFO ] [MAIN ] BCAT: Loaded 34116 existing records. [2025-10-09T17:30:54.641869] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:54.642162] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-09T17:30:54.642252] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-09T17:30:54.642543] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-09T17:30:54.642605] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-09T17:30:54.947137] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-09T17:30:54.992188] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-09T17:30:55.069703] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:55.196665] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-09T17:30:55.402445] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (4.81 seconds). [2025-10-09T17:30:55.996715] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-09T17:30:56.610752] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-10-09T17:30:56.638602] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T17:30:56.642843] [INFO ] [REMOTE ] BBVA: Full fetch complete (71604 records). [2025-10-09T17:30:56.642984] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-09T17:30:56.799709] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-09T17:30:57.043859] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-09T17:30:57.043954] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-09T17:30:57.044767] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-09T17:30:57.044832] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-09T17:30:57.046239] [DEBUG] [LOCAL ] BBVA: Trimmed 71604 records to 49530 (keeping 200 days of data) [2025-10-09T17:30:57.358009] [DEBUG] [LOCAL ] BBVA: Primary data saved (49530 records). [2025-10-09T17:30:57.358196] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-09T17:30:57.358377] [INFO ] [MAIN ] Update Progress: 230/2373 symbols completed. BBVA took 45.3s. Estimated remaining: 4h 47m 53s. Rate: 7.4 symbols/min [2025-10-09T17:30:57.506181] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-09T17:30:57.583188] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:57.599932] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-09T17:30:57.614084] [DEBUG] [LOCAL ] BCC: Loaded 28199 existing records from primary storage. [2025-10-09T17:30:57.614377] [INFO ] [MAIN ] BCC: Loaded 28199 existing records. [2025-10-09T17:30:57.795168] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:57.795563] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-09T17:30:57.795697] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-09T17:30:57.806530] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-09T17:30:57.824081] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-09T17:30:57.857730] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:30:58.200538] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:58.396716] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-09T17:30:58.536290] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T17:30:58.851026] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T17:30:59.196740] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-09T17:30:59.607901] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:30:59.996718] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-09T17:31:00.390282] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:31:00.796780] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-09T17:31:01.596851] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-09T17:31:01.805757] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T17:31:02.396757] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-09T17:31:02.467270] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:31:02.596621] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T17:31:03.196713] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-09T17:31:03.996734] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-09T17:31:04.151049] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:31:04.536324] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T17:31:04.796749] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-09T17:31:05.131040] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T17:31:05.596770] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-09T17:31:06.396763] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-09T17:31:06.620278] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-09T17:31:06.625070] [INFO ] [REMOTE ] BBY: Full fetch complete (77229 records). [2025-10-09T17:31:06.625234] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-09T17:31:07.027167] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-09T17:31:07.027319] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-09T17:31:07.028489] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-09T17:31:07.028599] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-09T17:31:07.030377] [DEBUG] [LOCAL ] BBY: Trimmed 77229 records to 53840 (keeping 200 days of data) [2025-10-09T17:31:07.146071] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:31:07.239003] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-09T17:31:07.293192] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T17:31:07.419138] [DEBUG] [LOCAL ] BBY: Primary data saved (53840 records). [2025-10-09T17:31:07.419291] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-09T17:31:07.419403] [INFO ] [MAIN ] Update Progress: 231/2373 symbols completed. BBY took 39.6s. Estimated remaining: 4h 48m 3s. Rate: 7.4 symbols/min [2025-10-09T17:31:07.588396] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:07.640693] [DEBUG] [LOCAL ] BCE: Loaded 52209 existing records from primary storage. [2025-10-09T17:31:07.641060] [INFO ] [MAIN ] BCE: Loaded 52209 existing records. [2025-10-09T17:31:07.818588] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:07.818850] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-09T17:31:07.818907] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-09T17:31:07.819301] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-09T17:31:07.819364] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-09T17:31:08.007130] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-09T17:31:08.175673] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:08.796778] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-09T17:31:08.980904] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:31:09.440160] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T17:31:09.596712] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-09T17:31:10.396781] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-09T17:31:10.687446] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T17:31:10.915366] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-09T17:31:11.196788] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-09T17:31:11.996760] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-09T17:31:12.700635] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T17:31:12.796671] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-09T17:31:13.058409] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T17:31:13.458981] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (3.06 seconds). [2025-10-09T17:31:13.596730] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-09T17:31:14.356508] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T17:31:14.396747] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-09T17:31:15.031956] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T17:31:15.196734] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-09T17:31:15.735303] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:31:15.738324] [INFO ] [REMOTE ] BCAT: Full fetch complete (50009 records). [2025-10-09T17:31:15.738416] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-09T17:31:16.004290] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-09T17:31:16.122864] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-09T17:31:16.122943] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-09T17:31:16.123507] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-09T17:31:16.123547] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-09T17:31:16.124609] [DEBUG] [LOCAL ] BCAT: Trimmed 50009 records to 34322 (keeping 200 days of data) [2025-10-09T17:31:16.337400] [DEBUG] [LOCAL ] BCAT: Primary data saved (34322 records). [2025-10-09T17:31:16.337564] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-09T17:31:16.338172] [INFO ] [MAIN ] Update Progress: 232/2373 symbols completed. BCAT took 22.1s. Estimated remaining: 4h 48m 3s. Rate: 7.4 symbols/min [2025-10-09T17:31:16.515534] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:16.515759] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-10-09T17:31:16.515827] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-10-09T17:31:16.516101] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-09T17:31:16.516165] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-09T17:31:16.516308] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-09T17:31:16.516352] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-09T17:31:16.642079] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T17:31:16.803391] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-09T17:31:16.913249] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:17.596715] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-09T17:31:17.783964] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T17:31:18.043764] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T17:31:18.396772] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-09T17:31:19.069476] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:31:19.196720] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-09T17:31:19.681984] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:31:19.984463] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:31:19.996684] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-09T17:31:20.796770] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-09T17:31:21.457533] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:31:21.596725] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-09T17:31:22.169899] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T17:31:22.396733] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-09T17:31:23.134877] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T17:31:23.196721] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-09T17:31:23.956626] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T17:31:23.996680] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-09T17:31:24.093608] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T17:31:24.796721] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-09T17:31:25.473241] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T17:31:25.476670] [INFO ] [REMOTE ] BC: Full fetch complete (63603 records). [2025-10-09T17:31:25.476794] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-09T17:31:25.601838] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-09T17:31:25.877892] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-09T17:31:25.878130] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-09T17:31:25.878882] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-09T17:31:25.878948] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-09T17:31:25.880362] [DEBUG] [LOCAL ] BC: Trimmed 63603 records to 44402 (keeping 200 days of data) [2025-10-09T17:31:26.118464] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:31:26.180465] [DEBUG] [LOCAL ] BC: Primary data saved (44402 records). [2025-10-09T17:31:26.180616] [INFO ] [MAIN ] BC: Full history saved. [2025-10-09T17:31:26.181247] [INFO ] [MAIN ] Update Progress: 233/2373 symbols completed. BC took 39.8s. Estimated remaining: 4h 48m 11s. Rate: 7.4 symbols/min [2025-10-09T17:31:26.360638] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:26.390144] [DEBUG] [LOCAL ] BCO: Loaded 25786 existing records from primary storage. [2025-10-09T17:31:26.390437] [INFO ] [MAIN ] BCO: Loaded 25786 existing records. [2025-10-09T17:31:26.403187] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-09T17:31:26.593147] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:26.593405] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-09T17:31:26.593453] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-09T17:31:26.593708] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-09T17:31:26.593770] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-09T17:31:26.942769] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:27.196697] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-09T17:31:27.664486] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T17:31:27.996722] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-09T17:31:28.242342] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-09T17:31:28.260901] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:31:28.264151] [INFO ] [REMOTE ] BCC: Full fetch complete (40940 records). [2025-10-09T17:31:28.264299] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-09T17:31:28.653703] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-09T17:31:28.653804] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-09T17:31:28.654306] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-09T17:31:28.654347] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-09T17:31:28.655387] [DEBUG] [LOCAL ] BCC: Trimmed 40940 records to 28437 (keeping 200 days of data) [2025-10-09T17:31:28.800908] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-09T17:31:28.832949] [DEBUG] [LOCAL ] BCC: Primary data saved (28437 records). [2025-10-09T17:31:28.833072] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-09T17:31:28.833157] [INFO ] [MAIN ] Update Progress: 234/2373 symbols completed. BCC took 31.5s. Estimated remaining: 4h 47m 13s. Rate: 7.4 symbols/min [2025-10-09T17:31:29.008150] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:29.062475] [DEBUG] [LOCAL ] BCS: Loaded 53444 existing records from primary storage. [2025-10-09T17:31:29.062842] [INFO ] [MAIN ] BCS: Loaded 53444 existing records. [2025-10-09T17:31:29.266543] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:29.266934] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-09T17:31:29.266992] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-09T17:31:29.267405] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-09T17:31:29.267481] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-09T17:31:29.580502] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T17:31:29.601937] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-09T17:31:29.665346] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:30.396730] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-09T17:31:30.627239] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T17:31:30.685328] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T17:31:31.196793] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-09T17:31:31.641731] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T17:31:31.996760] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-09T17:31:32.796696] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-09T17:31:33.165096] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T17:31:33.287462] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T17:31:33.596776] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-09T17:31:34.396683] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-09T17:31:34.495603] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:31:34.553147] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T17:31:35.196718] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-09T17:31:35.996711] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-09T17:31:36.151542] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:31:36.796733] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-09T17:31:36.877862] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T17:31:37.331088] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T17:31:37.596739] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-09T17:31:38.380084] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T17:31:38.396670] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-09T17:31:38.714729] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T17:31:39.196785] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-09T17:31:39.996754] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-09T17:31:40.210044] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T17:31:40.332274] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T17:31:40.796770] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-09T17:31:41.154639] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:31:41.596756] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-09T17:31:42.396726] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-09T17:31:42.435844] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T17:31:42.935753] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T17:31:43.196737] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-09T17:31:43.407756] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:31:43.996799] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-09T17:31:44.796796] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-09T17:31:45.260954] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T17:31:45.449619] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-09T17:31:45.596751] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-09T17:31:46.396696] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-09T17:31:46.507282] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:31:46.711520] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T17:31:47.196689] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-09T17:31:47.282348] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T17:31:47.996736] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-09T17:31:48.805181] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-09T17:31:48.826956] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:31:49.596694] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-09T17:31:49.817854] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T17:31:49.900908] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T17:31:50.396697] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-09T17:31:50.804546] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T17:31:50.807860] [INFO ] [REMOTE ] BCH: Full fetch complete (41118 records). [2025-10-09T17:31:50.807946] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-09T17:31:51.196123] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-09T17:31:51.196226] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-09T17:31:51.196751] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-09T17:31:51.196916] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-09T17:31:51.196811] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-09T17:31:51.198779] [DEBUG] [LOCAL ] BCH: Trimmed 41118 records to 30038 (keeping 200 days of data) [2025-10-09T17:31:51.372729] [DEBUG] [LOCAL ] BCH: Primary data saved (30038 records). [2025-10-09T17:31:51.372869] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-09T17:31:51.372943] [INFO ] [MAIN ] Update Progress: 235/2373 symbols completed. BCH took 35.0s. Estimated remaining: 4h 49m 17s. Rate: 7.4 symbols/min [2025-10-09T17:31:51.540991] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:51.570912] [DEBUG] [LOCAL ] BCSF: Loaded 27944 existing records from primary storage. [2025-10-09T17:31:51.571176] [INFO ] [MAIN ] BCSF: Loaded 27944 existing records. [2025-10-09T17:31:51.763626] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:51.763873] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-09T17:31:51.763921] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-09T17:31:51.764134] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-09T17:31:51.764190] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-09T17:31:52.001867] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-09T17:31:52.148886] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:52.183484] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T17:31:52.248744] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T17:31:52.796715] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-09T17:31:53.596799] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-09T17:31:54.115178] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T17:31:54.396786] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-09T17:31:54.592080] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T17:31:54.998547] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T17:31:55.196730] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-09T17:31:55.996731] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-09T17:31:56.040029] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T17:31:56.796718] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-09T17:31:56.913601] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T17:31:56.918030] [INFO ] [REMOTE ] BCE: Full fetch complete (75947 records). [2025-10-09T17:31:56.918138] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-09T17:31:57.158227] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:31:57.324926] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-09T17:31:57.325010] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-09T17:31:57.325784] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-09T17:31:57.325850] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-09T17:31:57.327395] [DEBUG] [LOCAL ] BCE: Trimmed 75947 records to 52590 (keeping 200 days of data) [2025-10-09T17:31:57.614532] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-09T17:31:57.661635] [DEBUG] [LOCAL ] BCE: Primary data saved (52590 records). [2025-10-09T17:31:57.661779] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-09T17:31:57.663041] [INFO ] [MAIN ] Update Progress: 236/2373 symbols completed. BCE took 50.2s. Estimated remaining: 4h 48m 52s. Rate: 7.4 symbols/min [2025-10-09T17:31:57.833638] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:57.857850] [DEBUG] [LOCAL ] BCX: Loaded 21636 existing records from primary storage. [2025-10-09T17:31:57.858173] [INFO ] [MAIN ] BCX: Loaded 21636 existing records. [2025-10-09T17:31:58.074265] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:58.074532] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-09T17:31:58.074592] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-09T17:31:58.074907] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-09T17:31:58.074966] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-09T17:31:58.410589] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-09T17:31:58.466983] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:58.696720] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T17:31:58.733950] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T17:31:59.196718] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-09T17:31:59.620604] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T17:31:59.996724] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-09T17:32:00.551676] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T17:32:00.796744] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-09T17:32:01.596795] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-09T17:32:01.877877] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T17:32:01.882010] [INFO ] [REMOTE ] BCS: Full fetch complete (76943 records). [2025-10-09T17:32:01.882191] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-09T17:32:01.883109] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:32:01.883246] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:32:01.883323] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:32:01.883399] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-09T17:32:01.883481] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-09T17:32:01.883554] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-10-09T17:32:01.883858] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-10-09T17:32:01.883962] [INFO ] [MAIN ] Update Progress: 237/2373 symbols completed. BCS took 33.1s. Estimated remaining: 4h 48m 9s. Rate: 7.4 symbols/min [2025-10-09T17:32:02.306043] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T17:32:02.396729] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-09T17:32:02.562475] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T17:32:02.564823] [INFO ] [REMOTE ] BCO: Full fetch complete (36377 records). [2025-10-09T17:32:02.564967] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-09T17:32:02.952518] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-09T17:32:02.952704] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-09T17:32:02.953248] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-09T17:32:02.953293] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-09T17:32:02.954091] [DEBUG] [LOCAL ] BCO: Trimmed 36377 records to 25899 (keeping 200 days of data) [2025-10-09T17:32:03.127375] [DEBUG] [LOCAL ] BCO: Primary data saved (25899 records). [2025-10-09T17:32:03.127521] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-09T17:32:03.127605] [INFO ] [MAIN ] Update Progress: 238/2373 symbols completed. BCO took 36.9s. Estimated remaining: 4h 46m 60s. Rate: 7.4 symbols/min [2025-10-09T17:32:03.196755] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-09T17:32:03.730931] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T17:32:03.996755] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-09T17:32:04.020108] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T17:32:04.796797] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-09T17:32:05.157590] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:32:05.596707] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-09T17:32:05.887774] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T17:32:06.396745] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-09T17:32:06.439991] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T17:32:07.196767] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-09T17:32:07.539949] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T17:32:07.996716] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-09T17:32:08.262923] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T17:32:08.796776] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-09T17:32:09.007019] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:32:09.596684] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-09T17:32:09.653236] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T17:32:10.396762] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-09T17:32:10.873165] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T17:32:11.196748] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-09T17:32:11.315528] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:32:11.996753] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-09T17:32:11.997186] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:32:12.796778] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-09T17:32:13.216680] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:32:13.219805] [INFO ] [REMOTE ] BCSF: Full fetch complete (38974 records). [2025-10-09T17:32:13.219882] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-09T17:32:13.587807] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-09T17:32:13.587895] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-09T17:32:13.588370] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-09T17:32:13.588431] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-09T17:32:13.589262] [DEBUG] [LOCAL ] BCSF: Trimmed 38974 records to 28234 (keeping 200 days of data) [2025-10-09T17:32:13.766922] [DEBUG] [LOCAL ] BCSF: Primary data saved (28234 records). [2025-10-09T17:32:13.767051] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-09T17:32:13.767556] [INFO ] [MAIN ] Update Progress: 239/2373 symbols completed. BCSF took 22.4s. Estimated remaining: 4h 47m 15s. Rate: 7.4 symbols/min [2025-10-09T17:32:14.124424] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:32:14.130394] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-09T17:32:14.912009] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T17:32:14.916434] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-09T17:32:15.964416] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:32:15.971467] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-09T17:32:17.072189] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:32:17.074528] [INFO ] [REMOTE ] BCX: Full fetch complete (33575 records). [2025-10-09T17:32:17.074617] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-09T17:32:17.475049] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-09T17:32:17.475133] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-09T17:32:17.475563] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-09T17:32:17.475603] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-09T17:32:17.476510] [DEBUG] [LOCAL ] BCX: Trimmed 33575 records to 21780 (keeping 200 days of data) [2025-10-09T17:32:17.617950] [DEBUG] [LOCAL ] BCX: Primary data saved (21780 records). [2025-10-09T17:32:17.618113] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-09T17:32:17.618200] [INFO ] [MAIN ] Update Progress: 240/2373 symbols completed. BCX took 20.0s. Estimated remaining: 4h 46m 29s. Rate: 7.4 symbols/min [2025-10-09T17:32:18.373186] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:18.368484] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:18.335701] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:18.367693] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:18.414606] [DEBUG] [LOCAL ] BDJ: Loaded 29178 existing records from primary storage. [2025-10-09T17:32:18.435500] [INFO ] [MAIN ] BDJ: Loaded 29178 existing records. [2025-10-09T17:32:18.487449] [DEBUG] [LOCAL ] BDC: Loaded 24540 existing records from primary storage. [2025-10-09T17:32:18.515045] [INFO ] [MAIN ] BDC: Loaded 24540 existing records. [2025-10-09T17:32:18.597035] [DEBUG] [LOCAL ] BDX: Loaded 52250 existing records from primary storage. [2025-10-09T17:32:18.608970] [INFO ] [MAIN ] BDX: Loaded 52250 existing records. [2025-10-09T17:32:18.686137] [DEBUG] [LOCAL ] BDN: Loaded 47560 existing records from primary storage. [2025-10-09T17:32:18.836012] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:18.768837] [INFO ] [MAIN ] BDN: Loaded 47560 existing records. [2025-10-09T17:32:18.904240] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-09T17:32:18.909675] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-09T17:32:18.937023] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-09T17:32:19.022932] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-09T17:32:19.098378] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:19.152017] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-09T17:32:19.200852] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-09T17:32:19.252826] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-09T17:32:19.253002] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-09T17:32:19.331480] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:19.449163] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:19.459704] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-09T17:32:19.470160] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-09T17:32:19.490957] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-09T17:32:19.485762] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-09T17:32:19.574203] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-09T17:32:19.588132] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-09T17:32:19.559568] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-09T17:32:19.669089] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-09T17:32:20.381981] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:20.426723] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-09T17:32:20.611121] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:20.666505] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-09T17:32:20.882894] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:20.906597] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-09T17:32:20.943847] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:20.944178] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-09T17:32:21.893491] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T17:32:21.900368] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-09T17:32:21.980360] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:32:21.986927] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-09T17:32:22.323210] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:32:22.332869] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-09T17:32:22.442344] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T17:32:22.453161] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-09T17:32:22.698323] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T17:32:22.703359] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-09T17:32:23.218807] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T17:32:23.225359] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-09T17:32:24.193792] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T17:32:24.204504] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-09T17:32:24.222116] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T17:32:24.260887] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:32:24.512292] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:32:24.796743] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-09T17:32:25.596680] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-09T17:32:25.859904] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T17:32:26.051857] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T17:32:26.396779] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-09T17:32:27.124571] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:32:27.196706] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-09T17:32:27.596460] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T17:32:27.996730] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-09T17:32:28.262483] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T17:32:28.796785] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-09T17:32:29.596694] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-09T17:32:29.680586] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T17:32:30.183140] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:32:30.396722] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-09T17:32:30.465276] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:32:31.196684] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-09T17:32:31.996736] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-09T17:32:32.143331] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:32:32.796737] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-09T17:32:33.022863] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T17:32:33.209838] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:32:33.596777] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-09T17:32:34.050392] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T17:32:34.396759] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-09T17:32:35.196710] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-09T17:32:35.247689] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T17:32:35.996707] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-09T17:32:36.374165] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T17:32:36.375193] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T17:32:36.796727] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-09T17:32:37.249396] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T17:32:37.596732] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-09T17:32:37.695419] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T17:32:38.396758] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-09T17:32:38.899156] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T17:32:39.196751] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-09T17:32:39.996795] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-09T17:32:40.108502] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:32:40.407986] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T17:32:40.796710] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-09T17:32:41.180354] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T17:32:41.596711] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-09T17:32:42.396688] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-09T17:32:42.488382] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T17:32:42.875625] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-09T17:32:43.196718] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-09T17:32:43.914807] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T17:32:43.996684] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-09T17:32:44.518155] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T17:32:44.521072] [INFO ] [REMOTE ] BDJ: Full fetch complete (43010 records). [2025-10-09T17:32:44.521158] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-09T17:32:44.801843] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-09T17:32:44.889182] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-09T17:32:44.889262] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-09T17:32:44.889795] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-09T17:32:44.889859] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-09T17:32:44.890740] [DEBUG] [LOCAL ] BDJ: Trimmed 43010 records to 29460 (keeping 200 days of data) [2025-10-09T17:32:45.060493] [DEBUG] [LOCAL ] BDJ: Primary data saved (29460 records). [2025-10-09T17:32:45.060638] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-09T17:32:45.061600] [INFO ] [MAIN ] Update Progress: 241/2373 symbols completed. BDJ took 27.4s. Estimated remaining: 4h 49m 12s. Rate: 7.4 symbols/min [2025-10-09T17:32:45.231699] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:45.287259] [DEBUG] [LOCAL ] BE: Loaded 53659 existing records from primary storage. [2025-10-09T17:32:45.287674] [INFO ] [MAIN ] BE: Loaded 53659 existing records. [2025-10-09T17:32:45.469445] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:45.469756] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-09T17:32:45.469901] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-09T17:32:45.470195] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-09T17:32:45.470254] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-09T17:32:45.606703] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-09T17:32:45.931420] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T17:32:46.003334] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:46.402903] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-09T17:32:46.416576] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T17:32:46.560619] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:32:46.565258] [INFO ] [REMOTE ] BDC: Full fetch complete (35825 records). [2025-10-09T17:32:46.565536] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-09T17:32:46.982058] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-09T17:32:46.982139] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-09T17:32:46.982615] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-09T17:32:46.982684] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-09T17:32:46.983462] [DEBUG] [LOCAL ] BDC: Trimmed 35825 records to 24705 (keeping 200 days of data) [2025-10-09T17:32:47.138808] [DEBUG] [LOCAL ] BDC: Primary data saved (24705 records). [2025-10-09T17:32:47.138942] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-09T17:32:47.139021] [INFO ] [MAIN ] Update Progress: 242/2373 symbols completed. BDC took 29.5s. Estimated remaining: 4h 48m 11s. Rate: 7.4 symbols/min [2025-10-09T17:32:47.201996] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-09T17:32:47.311350] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:47.311556] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-09T17:32:47.311600] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-09T17:32:47.311741] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-09T17:32:47.311786] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-09T17:32:47.311829] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-09T17:32:47.311864] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-09T17:32:47.690395] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:47.996693] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-09T17:32:48.278056] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:32:48.560438] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T17:32:48.796855] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-09T17:32:49.361197] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-09T17:32:49.596776] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-09T17:32:50.396731] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-09T17:32:50.731330] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-09T17:32:51.196684] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-09T17:32:51.637693] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T17:32:51.714634] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:32:51.996794] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-09T17:32:52.796779] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-09T17:32:52.983520] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:32:53.066619] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-09T17:32:53.596693] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-09T17:32:53.822536] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T17:32:53.908636] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-09T17:32:54.396697] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-09T17:32:54.822340] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T17:32:55.196753] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-09T17:32:55.996694] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-09T17:32:56.418589] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T17:32:56.796730] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-09T17:32:57.074234] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T17:32:57.137808] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T17:32:57.596722] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-09T17:32:58.396688] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-09T17:32:59.196692] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-09T17:32:59.277875] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:32:59.281967] [INFO ] [REMOTE ] BDN: Full fetch complete (69222 records). [2025-10-09T17:32:59.282083] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-09T17:32:59.645265] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:32:59.667111] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-09T17:32:59.667170] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-09T17:32:59.667940] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-09T17:32:59.668022] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-09T17:32:59.669281] [DEBUG] [LOCAL ] BDN: Trimmed 69222 records to 47913 (keeping 200 days of data) [2025-10-09T17:32:59.945449] [DEBUG] [LOCAL ] BDN: Primary data saved (47913 records). [2025-10-09T17:32:59.945616] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-09T17:32:59.946309] [INFO ] [MAIN ] Update Progress: 243/2373 symbols completed. BDN took 42.3s. Estimated remaining: 4h 48m 44s. Rate: 7.4 symbols/min [2025-10-09T17:33:00.009032] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-09T17:33:00.116129] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:00.167970] [DEBUG] [LOCAL ] BEKE: Loaded 53231 existing records from primary storage. [2025-10-09T17:33:00.168314] [INFO ] [MAIN ] BEKE: Loaded 53231 existing records. [2025-10-09T17:33:00.350442] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T17:33:00.350325] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:00.351843] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-09T17:33:00.351923] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-09T17:33:00.352361] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-09T17:33:00.352437] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-09T17:33:00.725084] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:00.761363] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-09T17:33:00.796706] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-09T17:33:01.596715] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-09T17:33:02.396738] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-09T17:33:02.623196] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-09T17:33:02.825994] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-09T17:33:03.103295] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T17:33:03.107679] [INFO ] [REMOTE ] BDX: Full fetch complete (75580 records). [2025-10-09T17:33:03.107815] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-09T17:33:03.203063] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-09T17:33:03.492064] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-09T17:33:03.492146] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-09T17:33:03.492944] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-09T17:33:03.493009] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-09T17:33:03.494453] [DEBUG] [LOCAL ] BDX: Trimmed 75580 records to 52620 (keeping 200 days of data) [2025-10-09T17:33:03.843190] [DEBUG] [LOCAL ] BDX: Primary data saved (52620 records). [2025-10-09T17:33:03.843360] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-09T17:33:03.844399] [INFO ] [MAIN ] Update Progress: 244/2373 symbols completed. BDX took 46.2s. Estimated remaining: 4h 47m 59s. Rate: 7.4 symbols/min [2025-10-09T17:33:04.021832] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:04.017686] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-09T17:33:04.022066] [DEBUG] [LOCAL ] BEN: No existing data file found in primary storage. [2025-10-09T17:33:04.022329] [WARN ] [MAIN ] BEN: No existing data found, performing full refresh instead. [2025-10-09T17:33:04.023275] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-09T17:33:04.023323] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-09T17:33:04.023368] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-10-09T17:33:04.023402] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-09T17:33:04.467802] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:04.796703] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-09T17:33:05.161704] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T17:33:05.596695] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-09T17:33:05.816487] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T17:33:06.396683] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-09T17:33:06.779821] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-09T17:33:06.784956] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T17:33:07.196682] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-09T17:33:07.474213] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T17:33:07.996722] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-09T17:33:08.720579] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T17:33:08.796673] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-09T17:33:09.596732] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-09T17:33:10.184543] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T17:33:10.266734] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T17:33:10.267403] [INFO ] [REMOTE ] BEDU: Full fetch complete (1419 records). [2025-10-09T17:33:10.267468] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-09T17:33:10.406612] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-09T17:33:10.448477] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-09T17:33:10.449427] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:33:10.449545] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:33:10.449606] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-09T17:33:10.449830] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-09T17:33:10.449987] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-09T17:33:10.450138] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-09T17:33:10.450239] [INFO ] [MAIN ] Update Progress: 245/2373 symbols completed. BEDU took 23.3s. Estimated remaining: 4h 47m 38s. Rate: 7.4 symbols/min [2025-10-09T17:33:10.670560] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:10.691492] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-09T17:33:10.745836] [DEBUG] [LOCAL ] BEP: Loaded 38922 existing records from primary storage. [2025-10-09T17:33:10.746243] [INFO ] [MAIN ] BEP: Loaded 38922 existing records. [2025-10-09T17:33:10.930277] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:10.930501] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-09T17:33:10.930549] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-09T17:33:10.930816] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-09T17:33:10.930875] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-09T17:33:11.206010] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-09T17:33:11.293055] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:11.996698] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-09T17:33:12.165266] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:33:12.796722] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-09T17:33:13.212119] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T17:33:13.282477] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:33:13.596692] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-09T17:33:14.396685] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-09T17:33:14.821295] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T17:33:15.077130] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T17:33:15.196782] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-09T17:33:15.999894] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-09T17:33:16.006201] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:33:16.383814] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:33:16.796773] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-09T17:33:17.596801] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-09T17:33:17.895520] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T17:33:18.304265] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T17:33:18.396677] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-09T17:33:19.196690] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-09T17:33:19.397108] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:33:19.996773] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-09T17:33:20.781769] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:33:20.782241] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-09T17:33:20.796938] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-09T17:33:20.797175] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-09T17:33:20.798393] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-09T17:33:21.250409] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-09T17:33:21.250506] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-09T17:33:21.251447] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-09T17:33:21.251515] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-09T17:33:21.253146] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54049 (keeping 200 days of data) [2025-10-09T17:33:21.517567] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T17:33:21.599062] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-09T17:33:21.655868] [DEBUG] [LOCAL ] BE: Primary data saved (54049 records). [2025-10-09T17:33:21.656017] [INFO ] [MAIN ] BE: Full history saved. [2025-10-09T17:33:21.656667] [INFO ] [MAIN ] Update Progress: 246/2373 symbols completed. BE took 36.6s. Estimated remaining: 4h 47m 56s. Rate: 7.4 symbols/min [2025-10-09T17:33:21.845406] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:21.845578] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-10-09T17:33:21.845665] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-10-09T17:33:21.845810] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-09T17:33:21.845865] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-09T17:33:21.845917] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-09T17:33:21.845952] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-09T17:33:22.296720] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:22.333830] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:33:22.396737] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-09T17:33:23.196727] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-09T17:33:23.296815] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T17:33:23.959131] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:33:23.996792] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-09T17:33:24.696077] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T17:33:24.796761] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-09T17:33:25.243548] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T17:33:25.596732] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-09T17:33:26.396752] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-09T17:33:26.556484] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T17:33:27.079593] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T17:33:27.196680] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-09T17:33:27.965556] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:33:27.996693] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-09T17:33:28.552684] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T17:33:28.796793] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-09T17:33:29.401151] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T17:33:29.596734] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-09T17:33:30.203890] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T17:33:30.396733] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-09T17:33:31.196705] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-09T17:33:31.467906] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:33:31.715217] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:33:31.996802] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-09T17:33:32.483274] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:33:32.796796] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-09T17:33:33.316267] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:33:33.596744] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-09T17:33:34.235407] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:33:34.396682] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-09T17:33:35.196700] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-09T17:33:35.239714] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:33:35.996705] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-09T17:33:36.112055] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T17:33:36.116500] [INFO ] [REMOTE ] BEN: Full fetch complete (76911 records). [2025-10-09T17:33:36.116626] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-09T17:33:36.539474] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-09T17:33:36.539576] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-09T17:33:36.540384] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-09T17:33:36.540450] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-09T17:33:36.542244] [DEBUG] [LOCAL ] BEN: Trimmed 76911 records to 53434 (keeping 200 days of data) [2025-10-09T17:33:36.746228] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T17:33:36.779438] [INFO ] [REMOTE ] BEP: Full fetch complete (58683 records). [2025-10-09T17:33:36.782775] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-09T17:33:36.802208] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-09T17:33:37.229854] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-09T17:33:37.230039] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-09T17:33:37.230807] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-09T17:33:37.230890] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-09T17:33:37.297246] [DEBUG] [LOCAL ] BEP: Trimmed 58683 records to 39259 (keeping 200 days of data) [2025-10-09T17:33:37.406044] [DEBUG] [LOCAL ] BEN: Primary data saved (53434 records). [2025-10-09T17:33:37.406619] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-09T17:33:37.406801] [INFO ] [MAIN ] Update Progress: 247/2373 symbols completed. BEN took 33.6s. Estimated remaining: 4h 48m 54s. Rate: 7.4 symbols/min [2025-10-09T17:33:37.589544] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:37.600848] [DEBUG] [LOCAL ] BEPH: Loaded 5349 existing records from primary storage. [2025-10-09T17:33:37.601295] [INFO ] [MAIN ] BEPH: Loaded 5349 existing records. [2025-10-09T17:33:37.894346] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:37.895845] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-09T17:33:37.895929] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-09T17:33:37.898627] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-09T17:33:37.899012] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-09T17:33:38.122466] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-09T17:33:38.221854] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-09T17:33:38.324993] [DEBUG] [LOCAL ] BEP: Primary data saved (39259 records). [2025-10-09T17:33:38.330847] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-09T17:33:38.341858] [INFO ] [MAIN ] Update Progress: 248/2373 symbols completed. BEP took 27.9s. Estimated remaining: 4h 47m 44s. Rate: 7.4 symbols/min [2025-10-09T17:33:38.566637] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:38.567455] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-09T17:33:38.716376] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T17:33:38.809588] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:38.818845] [DEBUG] [LOCAL ] BEPI: Loaded 3606 existing records from primary storage. [2025-10-09T17:33:38.819135] [INFO ] [MAIN ] BEPI: Loaded 3606 existing records. [2025-10-09T17:33:39.065363] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:39.065736] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-09T17:33:39.065811] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-09T17:33:39.066066] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-09T17:33:39.066139] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-09T17:33:39.201837] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-09T17:33:39.589308] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:39.888125] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T17:33:39.992600] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T17:33:40.002948] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-09T17:33:40.311768] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T17:33:40.488665] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-09T17:33:40.796718] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-09T17:33:41.360472] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T17:33:41.596808] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-09T17:33:42.079291] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T17:33:42.396719] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-09T17:33:42.862271] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T17:33:43.196767] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-09T17:33:43.866132] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:33:43.996780] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-09T17:33:44.479229] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T17:33:44.796758] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-09T17:33:45.430982] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T17:33:45.596736] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-09T17:33:46.396752] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-09T17:33:47.028302] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T17:33:47.196696] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-09T17:33:47.365266] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T17:33:47.370116] [INFO ] [REMOTE ] BEKE: Full fetch complete (77189 records). [2025-10-09T17:33:47.370305] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-09T17:33:47.753918] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T17:33:47.782032] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-09T17:33:47.782180] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-09T17:33:47.783108] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-09T17:33:47.783173] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-09T17:33:47.784538] [DEBUG] [LOCAL ] BEKE: Trimmed 77189 records to 53617 (keeping 200 days of data) [2025-10-09T17:33:47.998720] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-09T17:33:48.112674] [DEBUG] [LOCAL ] BEKE: Primary data saved (53617 records). [2025-10-09T17:33:48.112813] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-09T17:33:48.113569] [INFO ] [MAIN ] Update Progress: 249/2373 symbols completed. BEKE took 48.2s. Estimated remaining: 4h 47m 50s. Rate: 7.4 symbols/min [2025-10-09T17:33:48.279620] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:48.286130] [DEBUG] [LOCAL ] BEPJ: Loaded 3132 existing records from primary storage. [2025-10-09T17:33:48.286323] [INFO ] [MAIN ] BEPJ: Loaded 3132 existing records. [2025-10-09T17:33:48.445091] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T17:33:48.481831] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:48.481981] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-09T17:33:48.482078] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-09T17:33:48.482278] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-09T17:33:48.482336] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-09T17:33:48.802138] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-09T17:33:48.842507] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:49.419106] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T17:33:49.596706] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-09T17:33:50.396743] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-09T17:33:50.553862] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T17:33:50.554891] [INFO ] [REMOTE ] BEPH: Full fetch complete (7649 records). [2025-10-09T17:33:50.554960] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-09T17:33:50.906680] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-09T17:33:50.906771] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-09T17:33:50.906979] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-09T17:33:50.907017] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-09T17:33:50.907410] [DEBUG] [LOCAL ] BEPH: Trimmed 7649 records to 5383 (keeping 200 days of data) [2025-10-09T17:33:50.940218] [DEBUG] [LOCAL ] BEPH: Primary data saved (5383 records). [2025-10-09T17:33:50.940319] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-09T17:33:50.940394] [INFO ] [MAIN ] Update Progress: 250/2373 symbols completed. BEPH took 13.5s. Estimated remaining: 4h 46m 57s. Rate: 7.4 symbols/min [2025-10-09T17:33:51.049977] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T17:33:51.112827] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:51.147857] [DEBUG] [LOCAL ] BFAM: Loaded 33473 existing records from primary storage. [2025-10-09T17:33:51.148164] [INFO ] [MAIN ] BFAM: Loaded 33473 existing records. [2025-10-09T17:33:51.201901] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-09T17:33:51.340288] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:51.340572] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-09T17:33:51.340620] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-09T17:33:51.340848] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-09T17:33:51.340904] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-09T17:33:51.702066] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:51.926155] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T17:33:51.996684] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-09T17:33:52.421876] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T17:33:52.796739] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-09T17:33:53.596720] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-09T17:33:54.160673] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T17:33:54.208383] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:33:54.396734] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-09T17:33:54.848913] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T17:33:55.196724] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-09T17:33:55.996763] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-09T17:33:56.338678] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:33:56.796782] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-09T17:33:57.554084] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T17:33:57.596673] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-09T17:33:58.103990] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:33:58.396710] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-09T17:33:58.963775] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T17:33:59.196692] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-09T17:33:59.267545] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T17:33:59.530926] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-09T17:33:59.996726] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-09T17:34:00.472522] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T17:34:00.796727] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-09T17:34:01.358106] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T17:34:01.596755] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-09T17:34:02.126111] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T17:34:02.396793] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-09T17:34:03.196719] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-09T17:34:03.636016] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T17:34:03.996717] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-09T17:34:04.385454] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:34:04.796686] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-09T17:34:04.842378] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T17:34:05.596714] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-09T17:34:06.156475] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:34:06.287879] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T17:34:06.396713] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-09T17:34:07.196725] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-09T17:34:07.468256] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T17:34:07.513636] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-09T17:34:07.996717] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-09T17:34:08.796719] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-09T17:34:08.903550] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:34:09.350572] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T17:34:09.596714] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-09T17:34:09.974496] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T17:34:10.396730] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-09T17:34:11.196714] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-09T17:34:11.536318] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T17:34:11.759565] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:34:11.764012] [INFO ] [REMOTE ] BEPC: Full fetch complete (68675 records). [2025-10-09T17:34:11.764174] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-09T17:34:12.001869] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-09T17:34:12.164582] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-09T17:34:12.164696] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-09T17:34:12.165463] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-09T17:34:12.165518] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-09T17:34:12.166944] [DEBUG] [LOCAL ] BEPC: Trimmed 68675 records to 46858 (keeping 200 days of data) [2025-10-09T17:34:12.460741] [DEBUG] [LOCAL ] BEPC: Primary data saved (46858 records). [2025-10-09T17:34:12.460885] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-09T17:34:12.460959] [INFO ] [MAIN ] Update Progress: 251/2373 symbols completed. BEPC took 50.8s. Estimated remaining: 4h 48m 42s. Rate: 7.4 symbols/min [2025-10-09T17:34:12.629891] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:12.670863] [DEBUG] [LOCAL ] BFH: Loaded 41446 existing records from primary storage. [2025-10-09T17:34:12.671207] [INFO ] [MAIN ] BFH: Loaded 41446 existing records. [2025-10-09T17:34:12.752231] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T17:34:12.777889] [INFO ] [REMOTE ] BEPI: Full fetch complete (4834 records). [2025-10-09T17:34:12.778020] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-09T17:34:12.801823] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-09T17:34:12.992809] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:13.003482] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-09T17:34:13.008722] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-09T17:34:13.057246] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-09T17:34:13.108919] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-09T17:34:13.415271] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-09T17:34:13.441305] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-09T17:34:13.468311] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-09T17:34:13.480005] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-09T17:34:13.536523] [DEBUG] [LOCAL ] BEPI: Trimmed 4834 records to 3623 (keeping 200 days of data) [2025-10-09T17:34:13.602228] [DEBUG] [LOCAL ] BEPI: Primary data saved (3623 records). [2025-10-09T17:34:13.602625] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-09T17:34:13.613112] [INFO ] [MAIN ] Update Progress: 252/2373 symbols completed. BEPI took 35.3s. Estimated remaining: 4h 47m 35s. Rate: 7.4 symbols/min [2025-10-09T17:34:13.602385] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-09T17:34:13.660069] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:13.863276] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:13.890554] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T17:34:13.904155] [DEBUG] [LOCAL ] BFK: Loaded 13712 existing records from primary storage. [2025-10-09T17:34:13.904399] [INFO ] [MAIN ] BFK: Loaded 13712 existing records. [2025-10-09T17:34:14.090003] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T17:34:14.093697] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:14.095715] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-09T17:34:14.095771] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-09T17:34:14.096063] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-09T17:34:14.096122] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-09T17:34:14.401816] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-09T17:34:14.458206] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:14.781131] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-09T17:34:15.196769] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-09T17:34:15.919014] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T17:34:15.996768] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-09T17:34:16.796727] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-09T17:34:17.172161] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T17:34:17.278364] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T17:34:17.596741] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-09T17:34:17.989714] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T17:34:17.990406] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4458 records). [2025-10-09T17:34:17.990472] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-09T17:34:17.990846] [FATAL] [VALIDATOR ] BEPJ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:34:17.990927] [FATAL] [MAIN ] BEPJ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:34:17.990990] [WARN ] [MAIN ] BEPJ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:34:17.991061] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-09T17:34:17.991123] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-10-09T17:34:17.991158] [INFO ] [LOCAL ] BEPJ: Starting deletion of derivative data. [2025-10-09T17:34:17.991405] [DEBUG] [LOCAL ] BEPJ: Deleted derivative data file. [2025-10-09T17:34:17.991535] [INFO ] [MAIN ] Update Progress: 253/2373 symbols completed. BEPJ took 29.9s. Estimated remaining: 4h 46m 55s. Rate: 7.4 symbols/min [2025-10-09T17:34:18.156157] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:18.205137] [DEBUG] [LOCAL ] BFLY: Loaded 51825 existing records from primary storage. [2025-10-09T17:34:18.205448] [INFO ] [MAIN ] BFLY: Loaded 51825 existing records. [2025-10-09T17:34:18.405343] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-09T17:34:18.405245] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:18.405804] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-09T17:34:18.405877] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-09T17:34:18.406833] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-09T17:34:18.406898] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-09T17:34:18.759477] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:19.196742] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-09T17:34:19.851401] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:34:19.996688] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-09T17:34:20.088786] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T17:34:20.477479] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T17:34:20.796772] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-09T17:34:21.596712] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-09T17:34:22.015706] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T17:34:22.396686] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-09T17:34:22.874232] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T17:34:23.107255] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T17:34:23.196733] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-09T17:34:23.996745] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-09T17:34:24.207539] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T17:34:24.796727] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-09T17:34:25.602203] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-09T17:34:25.621485] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:34:25.816466] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T17:34:26.396699] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-09T17:34:26.890474] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T17:34:26.893673] [INFO ] [REMOTE ] BFAM: Full fetch complete (46964 records). [2025-10-09T17:34:26.893758] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-09T17:34:27.201892] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-09T17:34:27.275358] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-09T17:34:27.275436] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-09T17:34:27.276015] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-09T17:34:27.276078] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-09T17:34:27.277175] [DEBUG] [LOCAL ] BFAM: Trimmed 46964 records to 33733 (keeping 200 days of data) [2025-10-09T17:34:27.374054] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T17:34:27.496782] [DEBUG] [LOCAL ] BFAM: Primary data saved (33733 records). [2025-10-09T17:34:27.496936] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-09T17:34:27.497038] [INFO ] [MAIN ] Update Progress: 254/2373 symbols completed. BFAM took 36.6s. Estimated remaining: 4h 46m 59s. Rate: 7.4 symbols/min [2025-10-09T17:34:27.663015] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:27.663156] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-10-09T17:34:27.663193] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-10-09T17:34:27.663297] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-09T17:34:27.663337] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-09T17:34:27.663376] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-09T17:34:27.663406] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-09T17:34:28.011341] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:28.006718] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-09T17:34:28.796687] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-09T17:34:29.032104] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T17:34:29.480261] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T17:34:29.596726] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-09T17:34:29.820199] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:34:30.344220] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T17:34:30.396733] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-09T17:34:30.888881] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T17:34:31.196707] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-09T17:34:31.996725] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-09T17:34:32.803941] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-09T17:34:32.809936] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:34:32.949401] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T17:34:33.534944] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T17:34:33.596775] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-09T17:34:34.396709] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-09T17:34:35.139943] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T17:34:35.196677] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-09T17:34:35.300300] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T17:34:35.765110] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T17:34:35.996728] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-09T17:34:36.796709] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-09T17:34:37.492314] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T17:34:37.596679] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-09T17:34:37.928711] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T17:34:38.372527] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T17:34:38.396668] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-09T17:34:39.167216] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T17:34:39.196675] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-09T17:34:39.996687] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-09T17:34:40.006278] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T17:34:40.796766] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-09T17:34:41.588173] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T17:34:41.596672] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-09T17:34:41.651172] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T17:34:42.347599] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T17:34:42.348976] [INFO ] [REMOTE ] BFS: Full fetch complete (12737 records). [2025-10-09T17:34:42.349116] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-09T17:34:42.349707] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:34:42.349798] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:34:42.349879] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:34:42.349964] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-09T17:34:42.350047] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-09T17:34:42.350087] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-09T17:34:42.350144] [DEBUG] [LOCAL ] BFS: No derivative data file found to delete. [2025-10-09T17:34:42.350223] [INFO ] [MAIN ] Update Progress: 255/2373 symbols completed. BFS took 14.9s. Estimated remaining: 4h 47m 46s. Rate: 7.4 symbols/min [2025-10-09T17:34:42.401812] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-09T17:34:42.520246] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:42.534676] [DEBUG] [LOCAL ] BFZ: Loaded 11932 existing records from primary storage. [2025-10-09T17:34:42.534906] [INFO ] [MAIN ] BFZ: Loaded 11932 existing records. [2025-10-09T17:34:42.712096] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:42.712356] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-09T17:34:42.712411] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-09T17:34:42.712834] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-09T17:34:42.712894] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-09T17:34:43.078092] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:43.196702] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-09T17:34:43.996689] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-09T17:34:44.073558] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T17:34:44.285680] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T17:34:44.796722] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-09T17:34:45.253232] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T17:34:45.561409] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T17:34:45.596748] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-09T17:34:46.396687] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-09T17:34:46.470909] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T17:34:47.189494] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T17:34:47.196783] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-09T17:34:47.996801] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-09T17:34:48.151069] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T17:34:48.796720] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-09T17:34:49.490540] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:34:49.492588] [INFO ] [REMOTE ] BFK: Full fetch complete (19035 records). [2025-10-09T17:34:49.492706] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-09T17:34:49.600578] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-09T17:34:49.765855] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T17:34:49.923572] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-09T17:34:49.923690] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-09T17:34:49.924071] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-09T17:34:49.924116] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-09T17:34:49.924926] [DEBUG] [LOCAL ] BFK: Trimmed 19035 records to 13777 (keeping 200 days of data) [2025-10-09T17:34:50.013687] [DEBUG] [LOCAL ] BFK: Primary data saved (13777 records). [2025-10-09T17:34:50.013835] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-09T17:34:50.013920] [INFO ] [MAIN ] Update Progress: 256/2373 symbols completed. BFK took 36.4s. Estimated remaining: 4h 47m 34s. Rate: 7.4 symbols/min [2025-10-09T17:34:50.194362] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:50.242595] [DEBUG] [LOCAL ] BG: Loaded 50428 existing records from primary storage. [2025-10-09T17:34:50.242927] [INFO ] [MAIN ] BG: Loaded 50428 existing records. [2025-10-09T17:34:50.401061] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-09T17:34:50.423758] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:50.425067] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-09T17:34:50.425171] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-09T17:34:50.430763] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-09T17:34:50.435442] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-09T17:34:50.448583] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T17:34:50.794354] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:51.196735] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-09T17:34:51.939164] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T17:34:51.996690] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-09T17:34:52.129723] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T17:34:52.796761] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-09T17:34:53.205489] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T17:34:53.596721] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-09T17:34:54.396797] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-09T17:34:54.606059] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T17:34:54.689540] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:34:55.196719] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-09T17:34:55.996736] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-09T17:34:56.177887] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T17:34:56.522841] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T17:34:56.796693] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-09T17:34:56.857331] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T17:34:57.596722] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-09T17:34:58.396708] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-09T17:34:58.726988] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T17:34:59.196712] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-09T17:34:59.386383] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T17:34:59.389888] [INFO ] [REMOTE ] BFH: Full fetch complete (59679 records). [2025-10-09T17:34:59.390020] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-09T17:34:59.771141] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-09T17:34:59.771218] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-09T17:34:59.771870] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-09T17:34:59.771932] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-09T17:34:59.773196] [DEBUG] [LOCAL ] BFH: Trimmed 59679 records to 41731 (keeping 200 days of data) [2025-10-09T17:34:59.996749] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-09T17:35:00.035624] [DEBUG] [LOCAL ] BFH: Primary data saved (41731 records). [2025-10-09T17:35:00.035764] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-09T17:35:00.036576] [INFO ] [MAIN ] Update Progress: 257/2373 symbols completed. BFH took 47.6s. Estimated remaining: 4h 47m 41s. Rate: 7.4 symbols/min [2025-10-09T17:35:00.149855] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T17:35:00.226299] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:00.246022] [DEBUG] [LOCAL ] BGB: Loaded 17893 existing records from primary storage. [2025-10-09T17:35:00.246261] [INFO ] [MAIN ] BGB: Loaded 17893 existing records. [2025-10-09T17:35:00.432450] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:00.432803] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-09T17:35:00.432892] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-09T17:35:00.442328] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-09T17:35:00.455058] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-09T17:35:00.533835] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-09T17:35:00.805677] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-09T17:35:00.825867] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:01.596742] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-09T17:35:01.688571] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T17:35:01.914355] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T17:35:02.396707] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-09T17:35:02.830308] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T17:35:03.196781] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-09T17:35:03.996700] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-09T17:35:04.221673] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T17:35:04.486123] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T17:35:04.796689] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-09T17:35:05.596699] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-09T17:35:05.652880] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T17:35:05.759926] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T17:35:06.261981] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T17:35:06.396701] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-09T17:35:07.189199] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T17:35:07.196664] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-09T17:35:07.996710] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-09T17:35:08.796714] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-09T17:35:09.080389] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T17:35:09.155126] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T17:35:09.158970] [INFO ] [REMOTE ] BFLY: Full fetch complete (74934 records). [2025-10-09T17:35:09.159070] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-09T17:35:09.159853] [FATAL] [VALIDATOR ] BFLY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:35:09.159944] [FATAL] [MAIN ] BFLY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:35:09.159987] [WARN ] [MAIN ] BFLY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:35:09.160051] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-09T17:35:09.160113] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-09T17:35:09.160151] [INFO ] [LOCAL ] BFLY: Starting deletion of derivative data. [2025-10-09T17:35:09.160373] [DEBUG] [LOCAL ] BFLY: Deleted derivative data file. [2025-10-09T17:35:09.160674] [INFO ] [MAIN ] Update Progress: 258/2373 symbols completed. BFLY took 51.2s. Estimated remaining: 4h 47m 41s. Rate: 7.4 symbols/min [2025-10-09T17:35:09.325560] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:09.345019] [DEBUG] [LOCAL ] BGH: Loaded 17188 existing records from primary storage. [2025-10-09T17:35:09.345253] [INFO ] [MAIN ] BGH: Loaded 17188 existing records. [2025-10-09T17:35:09.521998] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:09.522197] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-09T17:35:09.522243] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-09T17:35:09.522397] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-09T17:35:09.522435] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-09T17:35:09.601940] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-09T17:35:09.878969] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:10.033896] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T17:35:10.396734] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-09T17:35:10.669610] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T17:35:10.670982] [INFO ] [REMOTE ] BFZ: Full fetch complete (17716 records). [2025-10-09T17:35:10.671075] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-09T17:35:11.055055] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-09T17:35:11.055134] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-09T17:35:11.055463] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-09T17:35:11.055502] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-09T17:35:11.056050] [DEBUG] [LOCAL ] BFZ: Trimmed 17716 records to 11992 (keeping 200 days of data) [2025-10-09T17:35:11.133579] [DEBUG] [LOCAL ] BFZ: Primary data saved (11992 records). [2025-10-09T17:35:11.133733] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-09T17:35:11.133835] [INFO ] [MAIN ] Update Progress: 259/2373 symbols completed. BFZ took 28.8s. Estimated remaining: 4h 46m 42s. Rate: 7.4 symbols/min [2025-10-09T17:35:11.201407] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-09T17:35:11.313694] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:11.328473] [DEBUG] [LOCAL ] BGR: Loaded 13572 existing records from primary storage. [2025-10-09T17:35:11.328717] [INFO ] [MAIN ] BGR: Loaded 13572 existing records. [2025-10-09T17:35:11.459272] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T17:35:11.529681] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:11.529920] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-09T17:35:11.529970] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-09T17:35:11.530170] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-09T17:35:11.530232] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-09T17:35:11.896446] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:11.996677] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-09T17:35:12.301501] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T17:35:12.796688] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-09T17:35:13.014186] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T17:35:13.596679] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-09T17:35:13.967677] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:35:14.400974] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-09T17:35:14.401999] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T17:35:15.055293] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T17:35:15.196794] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-09T17:35:15.996724] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-09T17:35:16.121301] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T17:35:16.796700] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-09T17:35:16.966416] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T17:35:17.477021] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T17:35:17.596706] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-09T17:35:18.396761] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-09T17:35:18.476483] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T17:35:19.196687] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-09T17:35:19.345787] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T17:35:19.843466] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T17:35:19.996728] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-09T17:35:20.796774] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-09T17:35:21.600098] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-09T17:35:21.607181] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:35:21.628446] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T17:35:22.396688] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-09T17:35:22.570508] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T17:35:22.572683] [INFO ] [REMOTE ] BGB: Full fetch complete (26991 records). [2025-10-09T17:35:22.572758] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-09T17:35:22.938823] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-09T17:35:22.938909] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-09T17:35:22.939311] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-09T17:35:22.939353] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-09T17:35:22.940200] [DEBUG] [LOCAL ] BGB: Trimmed 26991 records to 18011 (keeping 200 days of data) [2025-10-09T17:35:23.050780] [DEBUG] [LOCAL ] BGB: Primary data saved (18011 records). [2025-10-09T17:35:23.050924] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-09T17:35:23.051005] [INFO ] [MAIN ] Update Progress: 260/2373 symbols completed. BGB took 23.0s. Estimated remaining: 4h 47m 5s. Rate: 7.4 symbols/min [2025-10-09T17:35:23.202092] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-09T17:35:23.225184] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:23.274254] [DEBUG] [LOCAL ] BGS: Loaded 50497 existing records from primary storage. [2025-10-09T17:35:23.274542] [INFO ] [MAIN ] BGS: Loaded 50497 existing records. [2025-10-09T17:35:23.457209] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:23.457449] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-09T17:35:23.457499] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-09T17:35:23.457811] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-09T17:35:23.457872] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-09T17:35:23.821583] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:23.996736] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-09T17:35:24.265375] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:35:24.287483] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T17:35:24.726608] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T17:35:24.796682] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-09T17:35:25.596714] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-09T17:35:25.647792] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T17:35:26.396724] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-09T17:35:27.196710] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-09T17:35:27.315291] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T17:35:27.338540] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-09T17:35:27.996722] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-09T17:35:28.796690] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-09T17:35:28.840152] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T17:35:28.960870] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:35:29.402162] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T17:35:29.596794] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-09T17:35:30.396769] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-09T17:35:31.196687] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-09T17:35:31.474583] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:35:31.512531] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T17:35:31.996686] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-09T17:35:32.034749] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T17:35:32.036241] [INFO ] [REMOTE ] BGR: Full fetch complete (20157 records). [2025-10-09T17:35:32.036311] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-09T17:35:32.427287] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-09T17:35:32.427404] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-09T17:35:32.428147] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-09T17:35:32.428213] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-09T17:35:32.429076] [DEBUG] [LOCAL ] BGR: Trimmed 20157 records to 13650 (keeping 200 days of data) [2025-10-09T17:35:32.523754] [DEBUG] [LOCAL ] BGR: Primary data saved (13650 records). [2025-10-09T17:35:32.523916] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-09T17:35:32.524107] [INFO ] [MAIN ] Update Progress: 261/2373 symbols completed. BGR took 21.4s. Estimated remaining: 4h 47m 8s. Rate: 7.4 symbols/min [2025-10-09T17:35:32.712875] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:32.722204] [DEBUG] [LOCAL ] BGSF: Loaded 7730 existing records from primary storage. [2025-10-09T17:35:32.722395] [INFO ] [MAIN ] BGSF: Loaded 7730 existing records. [2025-10-09T17:35:32.800242] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-09T17:35:32.900504] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:32.900865] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-09T17:35:32.900923] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-09T17:35:32.901150] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-09T17:35:32.901211] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-09T17:35:33.012861] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T17:35:33.265026] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:33.596725] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-09T17:35:34.396685] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-09T17:35:34.562177] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T17:35:34.593608] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T17:35:35.049384] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T17:35:35.196752] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-09T17:35:35.996777] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-09T17:35:36.179604] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T17:35:36.774588] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T17:35:36.796691] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-09T17:35:37.596690] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-09T17:35:37.739244] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-09T17:35:38.011346] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T17:35:38.396735] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-09T17:35:39.196736] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-09T17:35:39.388055] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T17:35:39.996796] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-09T17:35:40.796738] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-09T17:35:40.945607] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:35:41.358526] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T17:35:41.577419] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T17:35:41.596694] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-09T17:35:41.931913] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-09T17:35:42.396718] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-09T17:35:42.854178] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T17:35:43.196720] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-09T17:35:43.996713] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-09T17:35:44.796694] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-09T17:35:45.000303] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:35:45.004525] [INFO ] [REMOTE ] BG: Full fetch complete (72731 records). [2025-10-09T17:35:45.004684] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-09T17:35:45.113510] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T17:35:45.133531] [INFO ] [REMOTE ] BGH: Full fetch complete (22719 records). [2025-10-09T17:35:45.143894] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-09T17:35:45.609815] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-09T17:35:45.750448] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-09T17:35:45.777702] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-09T17:35:45.779014] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T17:35:45.778714] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-09T17:35:45.839413] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-09T17:35:45.840997] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-09T17:35:45.841169] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-09T17:35:45.841448] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-09T17:35:45.841723] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-09T17:35:45.842794] [DEBUG] [LOCAL ] BGH: Trimmed 22719 records to 17324 (keeping 200 days of data) [2025-10-09T17:35:45.842705] [DEBUG] [LOCAL ] BG: Trimmed 72731 records to 50781 (keeping 200 days of data) [2025-10-09T17:35:46.257565] [DEBUG] [LOCAL ] BG: Primary data saved (50781 records). [2025-10-09T17:35:46.258471] [INFO ] [MAIN ] BG: Full history saved. [2025-10-09T17:35:46.258903] [INFO ] [MAIN ] Update Progress: 262/2373 symbols completed. BG took 56.2s. Estimated remaining: 4h 47m 44s. Rate: 7.3 symbols/min [2025-10-09T17:35:46.400218] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-09T17:35:46.428475] [DEBUG] [LOCAL ] BGH: Primary data saved (17324 records). [2025-10-09T17:35:46.457248] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-09T17:35:46.457138] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:46.457413] [INFO ] [MAIN ] Update Progress: 263/2373 symbols completed. BGH took 37.3s. Estimated remaining: 4h 46m 32s. Rate: 7.4 symbols/min [2025-10-09T17:35:46.605025] [DEBUG] [LOCAL ] BGT: Loaded 16621 existing records from primary storage. [2025-10-09T17:35:46.652308] [INFO ] [MAIN ] BGT: Loaded 16621 existing records. [2025-10-09T17:35:46.652199] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:46.820901] [DEBUG] [LOCAL ] BGX: Loaded 11113 existing records from primary storage. [2025-10-09T17:35:46.832010] [INFO ] [MAIN ] BGX: Loaded 11113 existing records. [2025-10-09T17:35:46.852542] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:46.918827] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-09T17:35:46.931438] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-09T17:35:46.958799] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-09T17:35:46.969359] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-09T17:35:47.128262] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:47.153738] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-09T17:35:47.154204] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-09T17:35:47.180496] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-09T17:35:47.195544] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-09T17:35:47.436241] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T17:35:47.477188] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-09T17:35:47.602684] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:47.767937] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-09T17:35:47.875877] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:47.996681] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-09T17:35:48.185775] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T17:35:48.796749] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-09T17:35:48.901131] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T17:35:49.596700] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-09T17:35:49.836461] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T17:35:50.396723] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-09T17:35:51.151050] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:35:51.196671] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-09T17:35:51.231314] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T17:35:51.996720] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-09T17:35:52.395771] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T17:35:52.796714] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-09T17:35:53.596685] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-09T17:35:53.712736] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T17:35:53.913775] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T17:35:53.915748] [INFO ] [REMOTE ] BGSF: Full fetch complete (9320 records). [2025-10-09T17:35:53.915819] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-09T17:35:54.290519] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-09T17:35:54.290628] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-09T17:35:54.290998] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-09T17:35:54.291075] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-09T17:35:54.291596] [DEBUG] [LOCAL ] BGSF: Trimmed 9320 records to 7799 (keeping 200 days of data) [2025-10-09T17:35:54.337705] [DEBUG] [LOCAL ] BGSF: Primary data saved (7799 records). [2025-10-09T17:35:54.337818] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-09T17:35:54.337900] [INFO ] [MAIN ] Update Progress: 264/2373 symbols completed. BGSF took 21.8s. Estimated remaining: 4h 46m 22s. Rate: 7.4 symbols/min [2025-10-09T17:35:54.401856] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-09T17:35:54.459345] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T17:35:54.567996] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:54.591092] [DEBUG] [LOCAL ] BGY: Loaded 21967 existing records from primary storage. [2025-10-09T17:35:54.591482] [INFO ] [MAIN ] BGY: Loaded 21967 existing records. [2025-10-09T17:35:54.793476] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:54.793806] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-09T17:35:54.793869] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-09T17:35:54.794122] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-09T17:35:54.794180] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-09T17:35:55.148759] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:55.196691] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-09T17:35:55.466341] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:35:55.996686] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-09T17:35:56.055444] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T17:35:56.796720] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-09T17:35:57.596791] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-09T17:35:57.774943] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T17:35:57.933545] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T17:35:58.351950] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:35:58.396694] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-09T17:35:59.196765] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-09T17:35:59.996691] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-09T17:36:00.055001] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:36:00.083454] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T17:36:00.796713] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-09T17:36:00.925258] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T17:36:01.596714] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-09T17:36:02.396698] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-09T17:36:02.802089] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T17:36:03.175312] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T17:36:03.196672] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-09T17:36:03.317231] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-09T17:36:03.748485] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T17:36:03.996712] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-09T17:36:04.796744] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-09T17:36:04.891028] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T17:36:05.596701] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-09T17:36:06.188570] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:36:06.204617] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T17:36:06.396712] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-09T17:36:07.196624] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-09T17:36:07.410341] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T17:36:07.996742] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-09T17:36:08.182570] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T17:36:08.796734] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-09T17:36:08.990317] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T17:36:09.596759] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-09T17:36:09.659539] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T17:36:10.396726] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-09T17:36:11.176929] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T17:36:11.196675] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-09T17:36:11.320911] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T17:36:11.996688] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-09T17:36:12.308383] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T17:36:12.796706] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-09T17:36:13.140024] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T17:36:13.141961] [INFO ] [REMOTE ] BGX: Full fetch complete (16398 records). [2025-10-09T17:36:13.142035] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-09T17:36:13.504587] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-09T17:36:13.504763] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-09T17:36:13.505107] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-09T17:36:13.505158] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-09T17:36:13.505687] [DEBUG] [LOCAL ] BGX: Trimmed 16398 records to 11222 (keeping 200 days of data) [2025-10-09T17:36:13.575273] [DEBUG] [LOCAL ] BGX: Primary data saved (11222 records). [2025-10-09T17:36:13.575409] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-09T17:36:13.575506] [INFO ] [MAIN ] Update Progress: 265/2373 symbols completed. BGX took 27.1s. Estimated remaining: 4h 47m 42s. Rate: 7.3 symbols/min [2025-10-09T17:36:13.605969] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-09T17:36:13.749434] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:13.766061] [DEBUG] [LOCAL ] BH: Loaded 16182 existing records from primary storage. [2025-10-09T17:36:13.766292] [INFO ] [MAIN ] BH: Loaded 16182 existing records. [2025-10-09T17:36:13.959091] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:13.959319] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-09T17:36:13.959374] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-09T17:36:13.959591] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-09T17:36:13.959681] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-09T17:36:14.335928] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:14.396690] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-09T17:36:14.580450] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T17:36:14.725132] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T17:36:15.167008] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T17:36:15.196678] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-09T17:36:15.996728] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-09T17:36:16.259176] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T17:36:16.796697] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-09T17:36:17.132570] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T17:36:17.596686] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-09T17:36:17.866201] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T17:36:18.396719] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-09T17:36:18.423123] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T17:36:19.196730] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-09T17:36:19.403901] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:36:19.996694] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-09T17:36:20.198682] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T17:36:20.755538] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T17:36:20.796681] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-09T17:36:21.596675] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-09T17:36:21.907692] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T17:36:22.392308] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-09T17:36:22.393976] [INFO ] [REMOTE ] BGT: Full fetch complete (24266 records). [2025-10-09T17:36:22.394066] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-09T17:36:22.405320] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-09T17:36:22.787883] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-09T17:36:22.788018] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-09T17:36:22.788487] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-09T17:36:22.788554] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-09T17:36:22.789472] [DEBUG] [LOCAL ] BGT: Trimmed 24266 records to 16689 (keeping 200 days of data) [2025-10-09T17:36:22.892406] [DEBUG] [LOCAL ] BGT: Primary data saved (16689 records). [2025-10-09T17:36:22.892558] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-09T17:36:22.892677] [INFO ] [MAIN ] Update Progress: 266/2373 symbols completed. BGT took 36.6s. Estimated remaining: 4h 47m 43s. Rate: 7.3 symbols/min [2025-10-09T17:36:23.070800] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:23.104274] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T17:36:23.121141] [DEBUG] [LOCAL ] BHC: Loaded 46776 existing records from primary storage. [2025-10-09T17:36:23.121485] [INFO ] [MAIN ] BHC: Loaded 46776 existing records. [2025-10-09T17:36:23.201875] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-09T17:36:23.304808] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:23.305035] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-09T17:36:23.305085] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-09T17:36:23.305386] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-09T17:36:23.305447] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-09T17:36:23.677393] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:23.996724] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-09T17:36:24.251114] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:36:24.253373] [INFO ] [REMOTE ] BGY: Full fetch complete (33014 records). [2025-10-09T17:36:24.253447] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-09T17:36:24.637370] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-09T17:36:24.637482] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-09T17:36:24.638017] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-09T17:36:24.638080] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-09T17:36:24.638966] [DEBUG] [LOCAL ] BGY: Trimmed 33014 records to 22233 (keeping 200 days of data) [2025-10-09T17:36:24.771122] [DEBUG] [LOCAL ] BGY: Primary data saved (22233 records). [2025-10-09T17:36:24.771248] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-09T17:36:24.771330] [INFO ] [MAIN ] Update Progress: 267/2373 symbols completed. BGY took 30.4s. Estimated remaining: 4h 46m 45s. Rate: 7.3 symbols/min [2025-10-09T17:36:24.801817] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-09T17:36:24.882983] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T17:36:24.957611] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:24.981320] [DEBUG] [LOCAL ] BHE: Loaded 24052 existing records from primary storage. [2025-10-09T17:36:24.981573] [INFO ] [MAIN ] BHE: Loaded 24052 existing records. [2025-10-09T17:36:25.158808] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:25.158994] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-09T17:36:25.159040] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-09T17:36:25.159222] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-09T17:36:25.159279] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-09T17:36:25.523611] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:25.596673] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-09T17:36:26.405293] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-09T17:36:26.410356] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T17:36:26.865519] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:36:27.182449] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T17:36:27.196665] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-09T17:36:27.996697] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-09T17:36:28.122470] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T17:36:28.796737] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-09T17:36:29.333607] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T17:36:29.596706] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-09T17:36:29.896027] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T17:36:30.396694] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-09T17:36:30.656348] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:36:31.196723] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-09T17:36:31.885246] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:36:31.889869] [INFO ] [REMOTE ] BGS: Full fetch complete (72492 records). [2025-10-09T17:36:31.890038] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-09T17:36:31.997036] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-09T17:36:32.446174] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T17:36:32.471396] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-09T17:36:32.478540] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-09T17:36:32.480631] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-09T17:36:32.480766] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-09T17:36:32.482771] [DEBUG] [LOCAL ] BGS: Trimmed 72492 records to 50853 (keeping 200 days of data) [2025-10-09T17:36:32.796944] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-09T17:36:32.905505] [DEBUG] [LOCAL ] BGS: Primary data saved (50853 records). [2025-10-09T17:36:32.905689] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-09T17:36:32.906809] [INFO ] [MAIN ] Update Progress: 268/2373 symbols completed. BGS took 1m 10s. Estimated remaining: 4h 46m 36s. Rate: 7.3 symbols/min [2025-10-09T17:36:33.088804] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:33.115045] [DEBUG] [LOCAL ] BHK: Loaded 23435 existing records from primary storage. [2025-10-09T17:36:33.115285] [INFO ] [MAIN ] BHK: Loaded 23435 existing records. [2025-10-09T17:36:33.260286] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T17:36:33.323340] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:33.323581] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-09T17:36:33.323636] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-09T17:36:33.323976] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-09T17:36:33.324049] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-09T17:36:33.602016] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-09T17:36:33.675287] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:34.049163] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:36:34.396701] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-09T17:36:35.022568] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T17:36:35.196700] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-09T17:36:35.500351] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T17:36:35.996726] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-09T17:36:36.096816] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T17:36:36.796729] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-09T17:36:37.439096] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:36:37.596738] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-09T17:36:37.764285] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T17:36:38.396750] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-09T17:36:39.196698] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-09T17:36:39.293565] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T17:36:39.349020] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:36:39.996734] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-09T17:36:40.546569] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:36:40.797677] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-09T17:36:40.799560] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T17:36:41.596688] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-09T17:36:41.752497] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T17:36:42.396746] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-09T17:36:42.630744] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T17:36:43.196712] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-09T17:36:43.945869] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T17:36:43.996675] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-09T17:36:44.408559] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T17:36:44.796689] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-09T17:36:45.520458] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T17:36:45.596682] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-09T17:36:45.873477] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T17:36:46.396722] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-09T17:36:46.925540] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T17:36:47.196687] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-09T17:36:47.393527] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T17:36:47.828350] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T17:36:47.830018] [INFO ] [REMOTE ] BH: Full fetch complete (19670 records). [2025-10-09T17:36:47.830087] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-09T17:36:47.998171] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-09T17:36:48.229872] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-09T17:36:48.229951] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-09T17:36:48.230346] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-09T17:36:48.230389] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-09T17:36:48.231001] [DEBUG] [LOCAL ] BH: Trimmed 19670 records to 16265 (keeping 200 days of data) [2025-10-09T17:36:48.328109] [DEBUG] [LOCAL ] BH: Primary data saved (16265 records). [2025-10-09T17:36:48.328258] [INFO ] [MAIN ] BH: Full history saved. [2025-10-09T17:36:48.328341] [INFO ] [MAIN ] Update Progress: 269/2373 symbols completed. BH took 34.8s. Estimated remaining: 4h 47m 25s. Rate: 7.3 symbols/min [2025-10-09T17:36:48.506030] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:48.554163] [DEBUG] [LOCAL ] BHP: Loaded 53372 existing records from primary storage. [2025-10-09T17:36:48.554507] [INFO ] [MAIN ] BHP: Loaded 53372 existing records. [2025-10-09T17:36:48.739438] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:48.739719] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-09T17:36:48.739776] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-09T17:36:48.740064] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-09T17:36:48.740135] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-09T17:36:48.799300] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-09T17:36:49.135769] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:49.136313] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T17:36:49.596772] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-09T17:36:50.396684] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-09T17:36:50.481906] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T17:36:50.537822] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T17:36:50.539911] [INFO ] [REMOTE ] BHE: Full fetch complete (36375 records). [2025-10-09T17:36:50.539991] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-09T17:36:50.917556] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-09T17:36:50.917634] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-09T17:36:50.918175] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-09T17:36:50.918236] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-09T17:36:50.919051] [DEBUG] [LOCAL ] BHE: Trimmed 36375 records to 24178 (keeping 200 days of data) [2025-10-09T17:36:51.065971] [DEBUG] [LOCAL ] BHE: Primary data saved (24178 records). [2025-10-09T17:36:51.066102] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-09T17:36:51.066182] [INFO ] [MAIN ] Update Progress: 270/2373 symbols completed. BHE took 26.3s. Estimated remaining: 4h 46m 34s. Rate: 7.3 symbols/min [2025-10-09T17:36:51.206692] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-09T17:36:51.240135] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:51.257097] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T17:36:51.280028] [DEBUG] [LOCAL ] BHR: Loaded 21855 existing records from primary storage. [2025-10-09T17:36:51.280274] [INFO ] [MAIN ] BHR: Loaded 21855 existing records. [2025-10-09T17:36:51.456947] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:51.457195] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-09T17:36:51.457248] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-09T17:36:51.457489] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-09T17:36:51.457546] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-09T17:36:51.821093] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:51.996694] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-09T17:36:52.796731] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-09T17:36:52.878131] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T17:36:53.215973] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T17:36:53.596765] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-09T17:36:54.396758] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-09T17:36:54.484304] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:36:55.196751] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-09T17:36:55.468741] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:36:55.502568] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T17:36:55.996721] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-09T17:36:56.269243] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T17:36:56.796713] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-09T17:36:57.605681] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-09T17:36:57.639537] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T17:36:58.292879] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:36:58.396682] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-09T17:36:58.863896] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T17:36:59.196771] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-09T17:36:59.996687] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-09T17:37:00.027607] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:37:00.031722] [INFO ] [REMOTE ] BHC: Full fetch complete (67107 records). [2025-10-09T17:37:00.031846] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-09T17:37:00.446871] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-09T17:37:00.447559] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T17:37:00.447915] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-09T17:37:00.454425] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-09T17:37:00.454620] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-09T17:37:00.456242] [DEBUG] [LOCAL ] BHC: Trimmed 67107 records to 47131 (keeping 200 days of data) [2025-10-09T17:37:00.722732] [DEBUG] [LOCAL ] BHC: Primary data saved (47131 records). [2025-10-09T17:37:00.722870] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-09T17:37:00.722951] [INFO ] [MAIN ] Update Progress: 271/2373 symbols completed. BHC took 37.8s. Estimated remaining: 4h 46m 37s. Rate: 7.3 symbols/min [2025-10-09T17:37:00.797588] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-09T17:37:00.895863] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:00.896032] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-09T17:37:00.896070] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-09T17:37:00.896236] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-09T17:37:00.896278] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-09T17:37:00.896322] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-09T17:37:00.896354] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-09T17:37:01.189338] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:37:01.273602] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:01.596714] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-09T17:37:01.877438] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T17:37:02.396736] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-09T17:37:03.196688] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-09T17:37:03.477056] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T17:37:03.480351] [INFO ] [REMOTE ] BHK: Full fetch complete (30588 records). [2025-10-09T17:37:03.480475] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-09T17:37:03.617316] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T17:37:03.897157] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-09T17:37:03.897237] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-09T17:37:03.897667] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-09T17:37:03.897728] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-09T17:37:03.898485] [DEBUG] [LOCAL ] BHK: Trimmed 30588 records to 23537 (keeping 200 days of data) [2025-10-09T17:37:03.996811] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-09T17:37:04.046826] [DEBUG] [LOCAL ] BHK: Primary data saved (23537 records). [2025-10-09T17:37:04.046988] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-09T17:37:04.047077] [INFO ] [MAIN ] Update Progress: 272/2373 symbols completed. BHK took 31.1s. Estimated remaining: 4h 45m 52s. Rate: 7.3 symbols/min [2025-10-09T17:37:04.218096] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:04.265865] [DEBUG] [LOCAL ] BHVN: Loaded 50190 existing records from primary storage. [2025-10-09T17:37:04.266224] [INFO ] [MAIN ] BHVN: Loaded 50190 existing records. [2025-10-09T17:37:04.440608] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T17:37:04.466937] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:04.472999] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-09T17:37:04.473058] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-09T17:37:04.473435] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-09T17:37:04.473494] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-09T17:37:04.798928] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-09T17:37:04.822108] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:05.596738] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-09T17:37:05.790176] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:37:05.971000] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-09T17:37:05.987408] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T17:37:06.396734] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-09T17:37:07.196731] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-09T17:37:07.973394] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:37:07.996694] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-09T17:37:08.066757] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:37:08.796721] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-09T17:37:09.283845] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T17:37:09.596725] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-09T17:37:09.805468] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:37:10.396769] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-09T17:37:11.196688] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-09T17:37:11.333694] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T17:37:11.392461] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T17:37:11.996821] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-09T17:37:12.313312] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-09T17:37:12.394970] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T17:37:12.796800] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-09T17:37:13.182768] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-09T17:37:13.596796] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-09T17:37:14.396759] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-09T17:37:15.196686] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-09T17:37:15.480532] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T17:37:15.543713] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T17:37:15.996739] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-09T17:37:16.146065] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T17:37:16.796718] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-09T17:37:17.596754] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-09T17:37:18.026633] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T17:37:18.035146] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-09T17:37:18.396686] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-09T17:37:18.473386] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T17:37:19.196743] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-09T17:37:19.996698] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-09T17:37:20.271259] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:37:20.368582] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T17:37:20.796742] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-09T17:37:21.507408] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:37:21.596723] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-09T17:37:21.815849] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T17:37:21.818555] [INFO ] [REMOTE ] BHR: Full fetch complete (31243 records). [2025-10-09T17:37:21.818631] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-09T17:37:22.186985] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-09T17:37:22.187081] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-09T17:37:22.187516] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-09T17:37:22.187559] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-09T17:37:22.188985] [DEBUG] [LOCAL ] BHR: Trimmed 31243 records to 22080 (keeping 200 days of data) [2025-10-09T17:37:22.327505] [DEBUG] [LOCAL ] BHR: Primary data saved (22080 records). [2025-10-09T17:37:22.327632] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-09T17:37:22.327765] [INFO ] [MAIN ] Update Progress: 273/2373 symbols completed. BHR took 31.3s. Estimated remaining: 4h 47m 1s. Rate: 7.3 symbols/min [2025-10-09T17:37:22.402733] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-09T17:37:22.509703] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:22.566589] [DEBUG] [LOCAL ] BILL: Loaded 52405 existing records from primary storage. [2025-10-09T17:37:22.566970] [INFO ] [MAIN ] BILL: Loaded 52405 existing records. [2025-10-09T17:37:22.745263] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:22.746117] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-09T17:37:22.746175] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-09T17:37:22.746409] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-09T17:37:22.746467] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-09T17:37:22.823390] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T17:37:23.113896] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:23.141500] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T17:37:23.196673] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-09T17:37:23.996702] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-09T17:37:24.796783] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-09T17:37:25.012204] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T17:37:25.596714] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-09T17:37:25.838959] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T17:37:26.040662] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T17:37:26.396743] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-09T17:37:26.647291] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T17:37:26.731417] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T17:37:27.196801] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-09T17:37:27.996781] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-09T17:37:28.592773] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T17:37:28.796696] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-09T17:37:28.938936] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T17:37:29.229299] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T17:37:29.596709] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-09T17:37:30.036711] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T17:37:30.396781] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-09T17:37:31.196762] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-09T17:37:31.996746] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-09T17:37:32.220355] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T17:37:32.559327] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T17:37:32.560105] [INFO ] [REMOTE ] BHV: Full fetch complete (1381 records). [2025-10-09T17:37:32.560173] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-09T17:37:32.744513] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-09T17:37:32.744744] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:37:32.744817] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:37:32.744931] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-09T17:37:32.745006] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-09T17:37:32.745045] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-09T17:37:32.745099] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-09T17:37:32.745182] [INFO ] [MAIN ] Update Progress: 274/2373 symbols completed. BHV took 32.0s. Estimated remaining: 4h 47m 10s. Rate: 7.3 symbols/min [2025-10-09T17:37:32.809055] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-09T17:37:32.989149] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:33.015912] [DEBUG] [LOCAL ] BIO: Loaded 24324 existing records from primary storage. [2025-10-09T17:37:33.016269] [INFO ] [MAIN ] BIO: Loaded 24324 existing records. [2025-10-09T17:37:33.150863] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-09T17:37:33.189941] [INFO ] [REMOTE ] BHP: Full fetch complete (77267 records). [2025-10-09T17:37:33.199811] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-09T17:37:33.221332] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:33.298855] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-09T17:37:33.310489] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-09T17:37:33.334101] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-09T17:37:33.349830] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-09T17:37:33.607078] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-09T17:37:34.015606] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-09T17:37:34.047457] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-09T17:37:34.048334] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-09T17:37:34.048415] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-09T17:37:34.047403] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:34.050056] [DEBUG] [LOCAL ] BHP: Trimmed 77267 records to 53762 (keeping 200 days of data) [2025-10-09T17:37:34.385449] [DEBUG] [LOCAL ] BHP: Primary data saved (53762 records). [2025-10-09T17:37:34.385584] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-09T17:37:34.386194] [INFO ] [MAIN ] Update Progress: 275/2373 symbols completed. BHP took 46.1s. Estimated remaining: 4h 46m 12s. Rate: 7.3 symbols/min [2025-10-09T17:37:34.417323] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-09T17:37:34.562988] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:34.605350] [DEBUG] [LOCAL ] BIP: Loaded 39333 existing records from primary storage. [2025-10-09T17:37:34.605680] [INFO ] [MAIN ] BIP: Loaded 39333 existing records. [2025-10-09T17:37:34.791990] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:34.792310] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-09T17:37:34.792479] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-09T17:37:34.792735] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-09T17:37:34.792793] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-09T17:37:34.940105] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-09T17:37:35.201022] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-09T17:37:35.274576] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:35.288227] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T17:37:35.321995] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T17:37:35.996783] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-09T17:37:36.796698] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-09T17:37:37.260194] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T17:37:37.596690] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-09T17:37:37.735137] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T17:37:37.749546] [INFO ] [REMOTE ] BHVN: Full fetch complete (70113 records). [2025-10-09T17:37:37.750636] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T17:37:37.750235] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-09T17:37:38.149141] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-09T17:37:38.149227] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-09T17:37:38.150712] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-09T17:37:38.150778] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-09T17:37:38.152230] [DEBUG] [LOCAL ] BHVN: Trimmed 70113 records to 50578 (keeping 200 days of data) [2025-10-09T17:37:38.396718] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-09T17:37:38.469558] [DEBUG] [LOCAL ] BHVN: Primary data saved (50578 records). [2025-10-09T17:37:38.469736] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-09T17:37:38.470366] [INFO ] [MAIN ] Update Progress: 276/2373 symbols completed. BHVN took 34.4s. Estimated remaining: 4h 45m 32s. Rate: 7.3 symbols/min [2025-10-09T17:37:38.675245] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:38.719314] [DEBUG] [LOCAL ] BIPC: Loaded 41294 existing records from primary storage. [2025-10-09T17:37:38.719677] [INFO ] [MAIN ] BIPC: Loaded 41294 existing records. [2025-10-09T17:37:38.931918] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:38.932225] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-09T17:37:38.932303] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-09T17:37:38.932588] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-09T17:37:38.932702] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-09T17:37:39.207396] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-09T17:37:39.280612] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:37:39.369762] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:39.996750] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-09T17:37:40.158465] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T17:37:40.438999] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T17:37:40.796773] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-09T17:37:41.335441] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T17:37:41.596682] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-09T17:37:42.026895] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T17:37:42.396717] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-09T17:37:42.963487] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:37:43.196721] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-09T17:37:43.996724] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-09T17:37:44.212216] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:37:44.398056] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T17:37:44.796736] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-09T17:37:45.409937] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:37:45.596714] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-09T17:37:46.396749] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-09T17:37:46.474970] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:37:47.130446] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:37:47.196734] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-09T17:37:47.990752] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:37:47.998760] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-09T17:37:48.796756] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-09T17:37:49.189399] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T17:37:49.596728] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-09T17:37:49.733525] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T17:37:49.960055] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T17:37:50.396736] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-09T17:37:51.180821] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T17:37:51.196668] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-09T17:37:51.596045] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T17:37:51.996712] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-09T17:37:52.679274] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:37:52.796686] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-09T17:37:53.344328] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T17:37:53.596716] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-09T17:37:54.260870] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T17:37:54.396740] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-09T17:37:55.031566] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T17:37:55.196737] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-09T17:37:55.996693] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-09T17:37:56.118698] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T17:37:56.543684] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T17:37:56.796895] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-09T17:37:56.796812] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:37:57.596716] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-09T17:37:58.396800] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-09T17:37:58.487506] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T17:37:59.024525] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T17:37:59.196679] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-09T17:37:59.586356] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T17:37:59.996760] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-09T17:38:00.796689] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-09T17:38:01.051690] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-09T17:38:01.056173] [INFO ] [REMOTE ] BILL: Full fetch complete (75888 records). [2025-10-09T17:38:01.056296] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-09T17:38:01.372177] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T17:38:01.473626] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-09T17:38:01.473751] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-09T17:38:01.474568] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-09T17:38:01.474611] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-09T17:38:01.476260] [DEBUG] [LOCAL ] BILL: Trimmed 75888 records to 52792 (keeping 200 days of data) [2025-10-09T17:38:01.642812] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-09T17:38:01.785452] [DEBUG] [LOCAL ] BILL: Primary data saved (52792 records). [2025-10-09T17:38:01.785596] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-09T17:38:01.786776] [INFO ] [MAIN ] Update Progress: 277/2373 symbols completed. BILL took 39.5s. Estimated remaining: 4h 47m 19s. Rate: 7.3 symbols/min [2025-10-09T17:38:02.396728] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-09T17:38:02.561275] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T17:38:02.604689] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T17:38:03.196744] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-09T17:38:03.973747] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T17:38:03.996692] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-09T17:38:04.671240] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T17:38:04.796678] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-09T17:38:05.063187] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T17:38:05.596714] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-09T17:38:06.396701] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-09T17:38:06.592457] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:38:06.596925] [INFO ] [REMOTE ] BIP: Full fetch complete (56966 records). [2025-10-09T17:38:06.597081] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-09T17:38:06.997493] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-09T17:38:06.997597] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-09T17:38:06.998420] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-09T17:38:06.998539] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-09T17:38:06.999830] [DEBUG] [LOCAL ] BIP: Trimmed 56966 records to 39590 (keeping 200 days of data) [2025-10-09T17:38:07.127612] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T17:38:07.139342] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T17:38:07.152824] [INFO ] [REMOTE ] BIO: Full fetch complete (33951 records). [2025-10-09T17:38:07.157217] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-09T17:38:07.161190] [FATAL] [VALIDATOR ] BIO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:38:07.161976] [FATAL] [MAIN ] BIO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:38:07.163152] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:38:07.166279] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-09T17:38:07.166906] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-09T17:38:07.170523] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-10-09T17:38:07.176220] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-10-09T17:38:07.176347] [INFO ] [MAIN ] Update Progress: 278/2373 symbols completed. BIO took 34.4s. Estimated remaining: 4h 46m 49s. Rate: 7.3 symbols/min [2025-10-09T17:38:07.224765] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-09T17:38:07.295819] [DEBUG] [LOCAL ] BIP: Primary data saved (39590 records). [2025-10-09T17:38:07.295990] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-09T17:38:07.296524] [INFO ] [MAIN ] Update Progress: 279/2373 symbols completed. BIP took 32.9s. Estimated remaining: 4h 45m 40s. Rate: 7.3 symbols/min [2025-10-09T17:38:08.618424] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:38:08.621727] [INFO ] [REMOTE ] BIPC: Full fetch complete (59680 records). [2025-10-09T17:38:08.621848] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-09T17:38:08.622539] [FATAL] [VALIDATOR ] BIPC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:38:08.622631] [FATAL] [MAIN ] BIPC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:38:08.622719] [WARN ] [MAIN ] BIPC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:38:08.622763] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-09T17:38:08.622820] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-09T17:38:08.622852] [INFO ] [LOCAL ] BIPC: Starting deletion of derivative data. [2025-10-09T17:38:08.623066] [DEBUG] [LOCAL ] BIPC: Deleted derivative data file. [2025-10-09T17:38:08.623486] [INFO ] [MAIN ] Update Progress: 280/2373 symbols completed. BIPC took 30.2s. Estimated remaining: 4h 44m 41s. Rate: 7.4 symbols/min [2025-10-09T17:38:09.234971] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:09.332021] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:09.393826] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:09.421732] [DEBUG] [LOCAL ] BIPI: Loaded 3152 existing records from primary storage. [2025-10-09T17:38:09.425337] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:09.426039] [INFO ] [MAIN ] BIPI: Loaded 3152 existing records. [2025-10-09T17:38:09.498057] [DEBUG] [LOCAL ] BIPJ: Loaded 3153 existing records from primary storage. [2025-10-09T17:38:09.506071] [DEBUG] [LOCAL ] BIPH: Loaded 2566 existing records from primary storage. [2025-10-09T17:38:09.512416] [INFO ] [MAIN ] BIPH: Loaded 2566 existing records. [2025-10-09T17:38:09.524138] [INFO ] [MAIN ] BIPJ: Loaded 3153 existing records. [2025-10-09T17:38:09.870962] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:09.941593] [DEBUG] [LOCAL ] BIRK: Loaded 50994 existing records from primary storage. [2025-10-09T17:38:09.957456] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-09T17:38:09.984350] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-09T17:38:09.984236] [INFO ] [MAIN ] BIRK: Loaded 50994 existing records. [2025-10-09T17:38:09.973400] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:10.086695] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:10.100081] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-09T17:38:10.100329] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-09T17:38:10.081309] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-09T17:38:10.111486] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-09T17:38:10.121348] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-09T17:38:10.130358] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-09T17:38:10.150075] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-09T17:38:10.160457] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-09T17:38:10.216306] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-09T17:38:10.207790] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-09T17:38:10.638082] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:10.763943] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-09T17:38:10.823214] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-09T17:38:10.983246] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-09T17:38:11.020027] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-09T17:38:11.136854] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:11.150184] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-09T17:38:11.399328] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:11.425337] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-09T17:38:11.587628] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:11.615527] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-09T17:38:11.731532] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:11.731873] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-09T17:38:12.081179] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T17:38:12.083193] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-09T17:38:12.318982] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T17:38:12.320695] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-09T17:38:12.397342] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T17:38:12.541577] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T17:38:12.635933] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-09T17:38:12.796756] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-09T17:38:13.103269] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:38:13.271581] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T17:38:13.596697] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-09T17:38:14.229716] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T17:38:14.396807] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-09T17:38:15.196773] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-09T17:38:15.812239] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T17:38:15.996692] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-09T17:38:16.164273] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T17:38:16.572755] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T17:38:16.796719] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-09T17:38:17.233041] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T17:38:17.596714] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-09T17:38:18.396770] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-09T17:38:19.052071] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T17:38:19.164888] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:38:19.196703] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-09T17:38:19.785293] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T17:38:19.996724] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-09T17:38:20.414531] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-09T17:38:20.796707] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-09T17:38:21.249257] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:38:21.596705] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-09T17:38:22.121762] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T17:38:22.396736] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-09T17:38:22.948663] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T17:38:23.196735] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-09T17:38:23.747163] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T17:38:23.996715] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-09T17:38:24.560449] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T17:38:24.796721] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-09T17:38:25.342453] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:38:25.596714] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-09T17:38:26.396731] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-09T17:38:27.045718] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T17:38:27.196700] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-09T17:38:27.326214] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T17:38:27.730933] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T17:38:27.996741] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-09T17:38:28.409857] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-09T17:38:28.796710] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-09T17:38:29.236147] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T17:38:29.596704] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-09T17:38:30.396726] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-09T17:38:30.948355] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T17:38:31.197269] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-09T17:38:31.200445] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T17:38:31.741215] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T17:38:31.996732] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-09T17:38:32.749301] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T17:38:32.796697] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-09T17:38:33.246836] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T17:38:33.248173] [INFO ] [REMOTE ] BIPI: Full fetch complete (4953 records). [2025-10-09T17:38:33.248290] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-09T17:38:33.602234] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-09T17:38:33.795612] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-09T17:38:33.795804] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-09T17:38:33.796251] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-09T17:38:33.796336] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-09T17:38:33.797446] [DEBUG] [LOCAL ] BIPI: Trimmed 4953 records to 3170 (keeping 200 days of data) [2025-10-09T17:38:33.833024] [DEBUG] [LOCAL ] BIPI: Primary data saved (3170 records). [2025-10-09T17:38:33.833306] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-09T17:38:33.833494] [INFO ] [MAIN ] Update Progress: 281/2373 symbols completed. BIPI took 25.2s. Estimated remaining: 4h 46m 40s. Rate: 7.3 symbols/min [2025-10-09T17:38:34.071991] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:34.103739] [DEBUG] [LOCAL ] BIT: Loaded 23233 existing records from primary storage. [2025-10-09T17:38:34.104148] [INFO ] [MAIN ] BIT: Loaded 23233 existing records. [2025-10-09T17:38:34.309899] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T17:38:34.337018] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:34.337237] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-09T17:38:34.337286] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-09T17:38:34.337492] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-09T17:38:34.337550] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-09T17:38:34.402277] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-09T17:38:34.716202] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:35.196768] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-09T17:38:35.996720] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-09T17:38:36.407055] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:38:36.796729] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-09T17:38:37.375909] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-09T17:38:37.376889] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4368 records). [2025-10-09T17:38:37.376968] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-09T17:38:37.608886] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-09T17:38:37.770067] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-09T17:38:37.770472] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-09T17:38:37.770701] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-09T17:38:37.770776] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-09T17:38:37.771301] [DEBUG] [LOCAL ] BIPJ: Trimmed 4368 records to 3177 (keeping 200 days of data) [2025-10-09T17:38:37.792424] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:38:37.807130] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3177 records). [2025-10-09T17:38:37.807308] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-09T17:38:37.807471] [INFO ] [MAIN ] Update Progress: 282/2373 symbols completed. BIPJ took 29.2s. Estimated remaining: 4h 45m 60s. Rate: 7.3 symbols/min [2025-10-09T17:38:37.979742] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:38.020743] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T17:38:38.084160] [DEBUG] [LOCAL ] BJ: Loaded 51508 existing records from primary storage. [2025-10-09T17:38:38.084553] [INFO ] [MAIN ] BJ: Loaded 51508 existing records. [2025-10-09T17:38:38.180187] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T17:38:38.269964] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:38.270248] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-09T17:38:38.270299] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-09T17:38:38.270553] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-09T17:38:38.270613] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-09T17:38:38.408493] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-09T17:38:38.626130] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:38.903350] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T17:38:39.196738] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-09T17:38:39.996732] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-09T17:38:40.703937] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:38:40.796703] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-09T17:38:41.253404] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T17:38:41.598110] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-09T17:38:41.601430] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T17:38:42.396697] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-09T17:38:42.534896] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:38:42.753686] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T17:38:42.754429] [INFO ] [REMOTE ] BIPH: Full fetch complete (4179 records). [2025-10-09T17:38:42.754496] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-09T17:38:43.103076] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-09T17:38:43.103156] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-09T17:38:43.103294] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-09T17:38:43.103333] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-09T17:38:43.103710] [DEBUG] [LOCAL ] BIPH: Trimmed 4179 records to 2577 (keeping 200 days of data) [2025-10-09T17:38:43.120364] [DEBUG] [LOCAL ] BIPH: Primary data saved (2577 records). [2025-10-09T17:38:43.120436] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-09T17:38:43.120507] [INFO ] [MAIN ] Update Progress: 283/2373 symbols completed. BIPH took 34.5s. Estimated remaining: 4h 45m 30s. Rate: 7.3 symbols/min [2025-10-09T17:38:43.201898] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-09T17:38:43.290979] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:43.344512] [DEBUG] [LOCAL ] BK: Loaded 53532 existing records from primary storage. [2025-10-09T17:38:43.344848] [INFO ] [MAIN ] BK: Loaded 53532 existing records. [2025-10-09T17:38:43.530290] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:43.530566] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-09T17:38:43.530670] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-09T17:38:43.531072] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-09T17:38:43.531137] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-09T17:38:43.887126] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:43.996684] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-09T17:38:44.244847] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T17:38:44.796732] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-09T17:38:45.531711] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T17:38:45.602999] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-09T17:38:45.606570] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:38:46.396751] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-09T17:38:47.196721] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-09T17:38:47.561189] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T17:38:47.996719] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-09T17:38:48.180699] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T17:38:48.796682] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-09T17:38:48.849038] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T17:38:49.143682] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T17:38:49.596702] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-09T17:38:50.267293] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:38:50.396677] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-09T17:38:51.196704] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-09T17:38:51.415467] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T17:38:51.996692] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-09T17:38:52.111379] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T17:38:52.427147] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:38:52.796713] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-09T17:38:53.316947] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T17:38:53.596722] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-09T17:38:54.398218] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-09T17:38:54.401232] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T17:38:55.196693] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-09T17:38:55.499082] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T17:38:55.996727] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-09T17:38:56.045455] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T17:38:56.748166] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:38:56.796673] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-09T17:38:57.062237] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T17:38:57.596716] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-09T17:38:58.405490] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-09T17:38:58.410821] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T17:38:59.196719] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-09T17:38:59.506053] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T17:38:59.878509] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:38:59.883126] [INFO ] [REMOTE ] BIRK: Full fetch complete (73049 records). [2025-10-09T17:38:59.883281] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-09T17:39:00.001828] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-09T17:39:00.307971] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-09T17:39:00.308076] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-09T17:39:00.308963] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-09T17:39:00.309031] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-09T17:39:00.310566] [DEBUG] [LOCAL ] BIRK: Trimmed 73049 records to 51374 (keeping 200 days of data) [2025-10-09T17:39:00.628423] [DEBUG] [LOCAL ] BIRK: Primary data saved (51374 records). [2025-10-09T17:39:00.628571] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-09T17:39:00.629547] [INFO ] [MAIN ] Update Progress: 284/2373 symbols completed. BIRK took 52.0s. Estimated remaining: 4h 46m 31s. Rate: 7.3 symbols/min [2025-10-09T17:39:00.814175] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-09T17:39:00.814065] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:00.861575] [DEBUG] [LOCAL ] BKD: Loaded 50322 existing records from primary storage. [2025-10-09T17:39:00.861920] [INFO ] [MAIN ] BKD: Loaded 50322 existing records. [2025-10-09T17:39:01.072541] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:01.073021] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-09T17:39:01.073137] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-09T17:39:01.073398] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-09T17:39:01.073476] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-09T17:39:01.230494] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T17:39:01.510970] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:01.522268] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T17:39:01.596690] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-09T17:39:02.277786] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T17:39:02.396670] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-09T17:39:03.179917] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:39:03.196657] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-09T17:39:03.996704] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-09T17:39:04.331938] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T17:39:04.537279] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T17:39:04.796772] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-09T17:39:05.229127] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:39:05.596719] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-09T17:39:06.396686] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-09T17:39:06.546713] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T17:39:06.578169] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T17:39:07.196785] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-09T17:39:07.964952] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:39:07.996722] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-09T17:39:08.401730] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T17:39:08.404438] [INFO ] [REMOTE ] BIT: Full fetch complete (31844 records). [2025-10-09T17:39:08.404510] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-09T17:39:08.791843] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-09T17:39:08.791955] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-09T17:39:08.792398] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-09T17:39:08.792444] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-09T17:39:08.793267] [DEBUG] [LOCAL ] BIT: Trimmed 31844 records to 23392 (keeping 200 days of data) [2025-10-09T17:39:08.847213] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-09T17:39:08.936106] [DEBUG] [LOCAL ] BIT: Primary data saved (23392 records). [2025-10-09T17:39:08.936244] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-09T17:39:08.936325] [INFO ] [MAIN ] Update Progress: 285/2373 symbols completed. BIT took 35.1s. Estimated remaining: 4h 46m 23s. Rate: 7.3 symbols/min [2025-10-09T17:39:09.100628] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:09.134856] [DEBUG] [LOCAL ] BKE: Loaded 33971 existing records from primary storage. [2025-10-09T17:39:09.135134] [INFO ] [MAIN ] BKE: Loaded 33971 existing records. [2025-10-09T17:39:09.307826] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:09.308051] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-09T17:39:09.308101] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-09T17:39:09.308328] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-09T17:39:09.308413] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-09T17:39:09.601879] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-09T17:39:09.663847] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:09.834829] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T17:39:10.396694] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-09T17:39:10.510071] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T17:39:11.196771] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-09T17:39:11.394577] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:39:11.766469] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T17:39:11.996738] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-09T17:39:12.319019] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T17:39:12.796730] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-09T17:39:13.415872] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T17:39:13.420493] [INFO ] [REMOTE ] BJ: Full fetch complete (74030 records). [2025-10-09T17:39:13.420700] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-09T17:39:13.600613] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-09T17:39:13.819727] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-09T17:39:13.819812] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-09T17:39:13.820564] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-09T17:39:13.820604] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-09T17:39:13.821956] [DEBUG] [LOCAL ] BJ: Trimmed 74030 records to 51896 (keeping 200 days of data) [2025-10-09T17:39:14.138244] [DEBUG] [LOCAL ] BJ: Primary data saved (51896 records). [2025-10-09T17:39:14.138476] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-09T17:39:14.139024] [INFO ] [MAIN ] Update Progress: 286/2373 symbols completed. BJ took 36.3s. Estimated remaining: 4h 45m 53s. Rate: 7.3 symbols/min [2025-10-09T17:39:14.312987] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:14.349455] [DEBUG] [LOCAL ] BKH: Loaded 36923 existing records from primary storage. [2025-10-09T17:39:14.349770] [INFO ] [MAIN ] BKH: Loaded 36923 existing records. [2025-10-09T17:39:14.402744] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-09T17:39:14.533170] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:14.533452] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-09T17:39:14.548865] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-09T17:39:14.559297] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-09T17:39:14.559432] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-09T17:39:14.605970] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T17:39:14.947837] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:15.196737] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-09T17:39:15.239490] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:39:15.996731] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-09T17:39:16.084851] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:39:16.089344] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-10-09T17:39:16.089461] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-09T17:39:16.475209] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-09T17:39:16.475293] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-09T17:39:16.476094] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-09T17:39:16.476161] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-09T17:39:16.477608] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 53922 (keeping 200 days of data) [2025-10-09T17:39:16.800750] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-09T17:39:16.829867] [DEBUG] [LOCAL ] BK: Primary data saved (53922 records). [2025-10-09T17:39:16.830028] [INFO ] [MAIN ] BK: Full history saved. [2025-10-09T17:39:16.830952] [INFO ] [MAIN ] Update Progress: 287/2373 symbols completed. BK took 33.7s. Estimated remaining: 4h 45m 4s. Rate: 7.3 symbols/min [2025-10-09T17:39:16.994579] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T17:39:17.052699] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:17.091424] [DEBUG] [LOCAL ] BKKT: Loaded 35721 existing records from primary storage. [2025-10-09T17:39:17.091811] [INFO ] [MAIN ] BKKT: Loaded 35721 existing records. [2025-10-09T17:39:17.273278] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:17.273545] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-09T17:39:17.273597] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-09T17:39:17.273940] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-09T17:39:17.274041] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-09T17:39:17.567658] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T17:39:17.601786] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-09T17:39:17.668180] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:18.215922] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T17:39:18.396721] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-09T17:39:19.196762] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-09T17:39:19.301847] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T17:39:19.996682] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-09T17:39:20.456556] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T17:39:20.482092] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:39:20.796772] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-09T17:39:21.596689] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-09T17:39:21.631321] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T17:39:22.176588] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T17:39:22.396708] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-09T17:39:22.906635] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T17:39:23.196723] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-09T17:39:23.663469] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T17:39:23.996777] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-09T17:39:24.697138] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:39:24.796766] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-09T17:39:25.176122] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T17:39:25.596779] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-09T17:39:26.193162] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:39:26.396786] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-09T17:39:27.126798] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T17:39:27.196682] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-09T17:39:27.805600] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:39:27.996712] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-09T17:39:28.414135] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T17:39:28.796712] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-09T17:39:29.467369] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:39:29.471773] [INFO ] [REMOTE ] BKD: Full fetch complete (71794 records). [2025-10-09T17:39:29.471893] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-09T17:39:29.612025] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-09T17:39:29.872793] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-09T17:39:29.872952] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-09T17:39:29.873872] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-09T17:39:29.873941] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-09T17:39:29.875434] [DEBUG] [LOCAL ] BKD: Trimmed 71794 records to 50711 (keeping 200 days of data) [2025-10-09T17:39:30.103318] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T17:39:30.197878] [DEBUG] [LOCAL ] BKD: Primary data saved (50711 records). [2025-10-09T17:39:30.198058] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-09T17:39:30.198780] [INFO ] [MAIN ] Update Progress: 288/2373 symbols completed. BKD took 29.6s. Estimated remaining: 4h 45m 34s. Rate: 7.3 symbols/min [2025-10-09T17:39:30.366682] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:30.378161] [DEBUG] [LOCAL ] BKN: Loaded 7681 existing records from primary storage. [2025-10-09T17:39:30.378419] [INFO ] [MAIN ] BKN: Loaded 7681 existing records. [2025-10-09T17:39:30.402233] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-09T17:39:30.569908] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:30.570228] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-09T17:39:30.570289] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-09T17:39:30.570792] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-09T17:39:30.570859] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-09T17:39:30.959316] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:31.020154] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T17:39:31.196687] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-09T17:39:31.948792] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T17:39:31.957240] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T17:39:31.996664] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-09T17:39:32.796709] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-09T17:39:33.488542] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T17:39:33.596728] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-09T17:39:34.194180] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T17:39:34.396704] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-09T17:39:34.472447] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T17:39:35.196719] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-09T17:39:35.647315] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T17:39:35.996750] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-09T17:39:36.730815] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:39:36.796718] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-09T17:39:37.565703] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T17:39:37.596730] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-09T17:39:38.220814] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:39:38.396764] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-09T17:39:39.002043] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T17:39:39.005034] [INFO ] [REMOTE ] BKE: Full fetch complete (50099 records). [2025-10-09T17:39:39.005166] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-09T17:39:39.205470] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-09T17:39:39.388165] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-09T17:39:39.388251] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-09T17:39:39.388898] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-09T17:39:39.388964] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-09T17:39:39.390134] [DEBUG] [LOCAL ] BKE: Trimmed 50099 records to 34235 (keeping 200 days of data) [2025-10-09T17:39:39.604192] [DEBUG] [LOCAL ] BKE: Primary data saved (34235 records). [2025-10-09T17:39:39.604355] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-09T17:39:39.604473] [INFO ] [MAIN ] Update Progress: 289/2373 symbols completed. BKE took 30.7s. Estimated remaining: 4h 45m 34s. Rate: 7.3 symbols/min [2025-10-09T17:39:39.780744] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:39.799725] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T17:39:39.810945] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T17:39:39.853992] [DEBUG] [LOCAL ] BKSY: Loaded 48470 existing records from primary storage. [2025-10-09T17:39:39.854309] [INFO ] [MAIN ] BKSY: Loaded 48470 existing records. [2025-10-09T17:39:40.003699] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-09T17:39:40.045555] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:40.045814] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-09T17:39:40.045892] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-09T17:39:40.046167] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-09T17:39:40.046270] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-09T17:39:40.404812] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:40.796761] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-09T17:39:41.522609] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:39:41.596677] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-09T17:39:42.396780] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-09T17:39:42.624620] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T17:39:43.146271] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:39:43.196680] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-09T17:39:43.996746] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-09T17:39:44.136620] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:39:44.527290] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T17:39:44.796692] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-09T17:39:44.881273] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T17:39:45.596709] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-09T17:39:46.404141] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-09T17:39:46.409474] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T17:39:46.953019] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:39:47.196757] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-09T17:39:47.996744] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-09T17:39:48.107862] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T17:39:48.427607] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:39:48.430935] [INFO ] [REMOTE ] BKH: Full fetch complete (52555 records). [2025-10-09T17:39:48.431026] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-09T17:39:48.805866] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-09T17:39:48.809539] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-09T17:39:48.809601] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-09T17:39:48.810267] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-09T17:39:48.810432] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-09T17:39:48.811569] [DEBUG] [LOCAL ] BKH: Trimmed 52555 records to 37211 (keeping 200 days of data) [2025-10-09T17:39:49.042119] [DEBUG] [LOCAL ] BKH: Primary data saved (37211 records). [2025-10-09T17:39:49.042247] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-09T17:39:49.042813] [INFO ] [MAIN ] Update Progress: 290/2373 symbols completed. BKH took 34.9s. Estimated remaining: 4h 45m 34s. Rate: 7.3 symbols/min [2025-10-09T17:39:49.239274] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:49.260109] [DEBUG] [LOCAL ] BKT: Loaded 11941 existing records from primary storage. [2025-10-09T17:39:49.260382] [INFO ] [MAIN ] BKT: Loaded 11941 existing records. [2025-10-09T17:39:49.457216] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:49.457396] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-09T17:39:49.457444] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-09T17:39:49.457621] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-09T17:39:49.457707] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-09T17:39:49.606913] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-09T17:39:49.822530] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:49.975312] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-09T17:39:50.214021] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T17:39:50.396683] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-09T17:39:50.662793] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T17:39:51.100011] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T17:39:51.196718] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-09T17:39:51.996729] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-09T17:39:52.783123] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:39:52.796674] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-09T17:39:53.596713] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-09T17:39:54.037883] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-09T17:39:54.042173] [INFO ] [REMOTE ] BKKT: Full fetch complete (50730 records). [2025-10-09T17:39:54.042278] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-09T17:39:54.340330] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T17:39:54.399347] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-09T17:39:54.455731] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-09T17:39:54.455825] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-09T17:39:54.456473] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-09T17:39:54.456520] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-09T17:39:54.457989] [DEBUG] [LOCAL ] BKKT: Trimmed 50730 records to 36101 (keeping 200 days of data) [2025-10-09T17:39:54.674310] [DEBUG] [LOCAL ] BKKT: Primary data saved (36101 records). [2025-10-09T17:39:54.674443] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-09T17:39:54.674522] [INFO ] [MAIN ] Update Progress: 291/2373 symbols completed. BKKT took 37.8s. Estimated remaining: 4h 45m 8s. Rate: 7.3 symbols/min [2025-10-09T17:39:54.875402] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:54.877310] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T17:39:54.922750] [DEBUG] [LOCAL ] BKU: Loaded 41680 existing records from primary storage. [2025-10-09T17:39:54.923088] [INFO ] [MAIN ] BKU: Loaded 41680 existing records. [2025-10-09T17:39:55.109541] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:55.109761] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-09T17:39:55.109813] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-09T17:39:55.110027] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-09T17:39:55.110085] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-09T17:39:55.203179] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-09T17:39:55.422254] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T17:39:55.498861] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:55.996749] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-09T17:39:56.807794] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-09T17:39:56.810876] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T17:39:57.291062] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T17:39:57.339024] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T17:39:57.596729] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-09T17:39:58.375953] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T17:39:58.396665] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-09T17:39:59.028040] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:39:59.196699] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-09T17:39:59.875903] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T17:39:59.996718] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-09T17:40:00.781985] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T17:40:00.796681] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-09T17:40:01.596837] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-09T17:40:01.625524] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T17:40:02.396752] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-09T17:40:02.439558] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T17:40:02.440609] [INFO ] [REMOTE ] BKN: Full fetch complete (11636 records). [2025-10-09T17:40:02.440757] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-09T17:40:02.818716] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-09T17:40:02.818814] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-09T17:40:02.819128] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-09T17:40:02.819168] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-09T17:40:02.819599] [DEBUG] [LOCAL ] BKN: Trimmed 11636 records to 7712 (keeping 200 days of data) [2025-10-09T17:40:02.867886] [DEBUG] [LOCAL ] BKN: Primary data saved (7712 records). [2025-10-09T17:40:02.868003] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-09T17:40:02.868092] [INFO ] [MAIN ] Update Progress: 292/2373 symbols completed. BKN took 32.7s. Estimated remaining: 4h 44m 59s. Rate: 7.3 symbols/min [2025-10-09T17:40:03.038660] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:03.067552] [DEBUG] [LOCAL ] BKV: Loaded 29885 existing records from primary storage. [2025-10-09T17:40:03.067841] [INFO ] [MAIN ] BKV: Loaded 29885 existing records. [2025-10-09T17:40:03.205196] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-09T17:40:03.245021] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:03.245222] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-09T17:40:03.245268] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-09T17:40:03.245523] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-09T17:40:03.245579] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-09T17:40:03.597902] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:03.901907] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T17:40:03.996684] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-09T17:40:04.156372] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T17:40:04.648492] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T17:40:04.796707] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-09T17:40:05.596742] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-09T17:40:06.015717] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T17:40:06.233073] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T17:40:06.396767] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-09T17:40:07.196733] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-09T17:40:07.996764] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-09T17:40:08.141108] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T17:40:08.796763] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-09T17:40:08.825611] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T17:40:09.137843] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T17:40:09.596682] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-09T17:40:10.045947] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T17:40:10.355186] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T17:40:10.396668] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-09T17:40:11.196723] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-09T17:40:11.482607] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:40:11.996771] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-09T17:40:12.480501] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T17:40:12.796787] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-09T17:40:13.596722] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-09T17:40:14.089884] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-09T17:40:14.264066] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T17:40:14.396723] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-09T17:40:14.615615] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T17:40:15.196800] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-09T17:40:15.996741] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-09T17:40:16.098961] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T17:40:16.644906] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T17:40:16.796708] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-09T17:40:17.219737] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:40:17.222433] [INFO ] [REMOTE ] BKT: Full fetch complete (15883 records). [2025-10-09T17:40:17.222515] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-09T17:40:17.629620] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-09T17:40:17.619319] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-09T17:40:17.631193] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-09T17:40:17.631614] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-09T17:40:17.631708] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-09T17:40:17.632468] [DEBUG] [LOCAL ] BKT: Trimmed 15883 records to 12044 (keeping 200 days of data) [2025-10-09T17:40:17.706189] [DEBUG] [LOCAL ] BKT: Primary data saved (12044 records). [2025-10-09T17:40:17.706311] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-09T17:40:17.706443] [INFO ] [MAIN ] Update Progress: 293/2373 symbols completed. BKT took 28.7s. Estimated remaining: 4h 45m 38s. Rate: 7.3 symbols/min [2025-10-09T17:40:17.870523] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:17.907164] [DEBUG] [LOCAL ] BLCO: Loaded 35542 existing records from primary storage. [2025-10-09T17:40:17.907463] [INFO ] [MAIN ] BLCO: Loaded 35542 existing records. [2025-10-09T17:40:18.079873] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:18.080068] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-09T17:40:18.080115] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-09T17:40:18.080347] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-09T17:40:18.080404] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-09T17:40:18.409715] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-09T17:40:18.442763] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:18.472623] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T17:40:18.968052] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T17:40:19.196797] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-09T17:40:19.996789] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-09T17:40:20.546978] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-09T17:40:20.552027] [INFO ] [REMOTE ] BKSY: Full fetch complete (69993 records). [2025-10-09T17:40:20.552146] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-09T17:40:20.704607] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:40:20.801912] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-09T17:40:20.985078] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-09T17:40:20.985190] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-09T17:40:20.986048] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-09T17:40:20.986129] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-09T17:40:21.006184] [DEBUG] [LOCAL ] BKSY: Trimmed 69993 records to 48849 (keeping 200 days of data) [2025-10-09T17:40:21.007132] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:40:21.327148] [DEBUG] [LOCAL ] BKSY: Primary data saved (48849 records). [2025-10-09T17:40:21.327382] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-09T17:40:21.327514] [INFO ] [MAIN ] Update Progress: 294/2373 symbols completed. BKSY took 41.7s. Estimated remaining: 4h 44m 57s. Rate: 7.3 symbols/min [2025-10-09T17:40:21.517213] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:21.517394] [DEBUG] [LOCAL ] BLD: No existing data file found in primary storage. [2025-10-09T17:40:21.517450] [WARN ] [MAIN ] BLD: No existing data found, performing full refresh instead. [2025-10-09T17:40:21.517560] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-09T17:40:21.517600] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-09T17:40:21.517662] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-09T17:40:21.517718] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-09T17:40:21.601807] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-09T17:40:21.905694] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:21.925268] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T17:40:22.396718] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-09T17:40:23.016806] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T17:40:23.196705] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-09T17:40:23.770519] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:40:23.996743] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-09T17:40:24.744211] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:40:24.796736] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-09T17:40:24.900117] [DEBUG] [REMOTE ] BLD: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-09T17:40:24.900434] [WARN ] [REMOTE ] BLD: No data returned for month 2025-01 [2025-10-09T17:40:24.900537] [FATAL] [REMOTE ] BLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:40:24.900669] [FATAL] [MAIN ] BLD: Failed to fetch primary data. [2025-10-09T17:40:24.900739] [WARN ] [MAIN ] BLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:40:24.900815] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-09T17:40:24.900899] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-09T17:40:24.900968] [INFO ] [LOCAL ] BLD: Starting deletion of derivative data. [2025-10-09T17:40:24.901039] [DEBUG] [LOCAL ] BLD: No derivative data file found to delete. [2025-10-09T17:40:24.901092] [INFO ] [MAIN ] Update Progress: 295/2373 symbols completed. BLD took 3.6s. Estimated remaining: 4h 44m 16s. Rate: 7.3 symbols/min [2025-10-09T17:40:25.092721] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:25.144778] [DEBUG] [LOCAL ] BLDR: Loaded 51707 existing records from primary storage. [2025-10-09T17:40:25.145070] [INFO ] [MAIN ] BLDR: Loaded 51707 existing records. [2025-10-09T17:40:25.314848] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T17:40:25.364162] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:25.364344] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-09T17:40:25.364389] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-09T17:40:25.364690] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-09T17:40:25.364748] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-09T17:40:25.601847] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-09T17:40:25.717513] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:26.396719] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-09T17:40:27.079871] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:40:27.196747] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-09T17:40:27.996686] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-09T17:40:28.040565] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:40:28.801841] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-09T17:40:28.818498] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T17:40:29.463711] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:40:29.596713] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-09T17:40:30.300210] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T17:40:30.396700] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-09T17:40:31.168146] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:40:31.196708] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-09T17:40:31.996752] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-09T17:40:32.265100] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T17:40:32.788350] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T17:40:32.796601] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-09T17:40:32.980222] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T17:40:33.596725] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-09T17:40:34.177706] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:40:34.396733] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-09T17:40:35.196696] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-09T17:40:35.231407] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T17:40:35.794822] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:40:35.996716] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-09T17:40:36.617994] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:40:36.796718] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-09T17:40:37.496304] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:40:37.596712] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-09T17:40:37.990153] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T17:40:38.396728] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-09T17:40:38.991312] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:40:38.995268] [INFO ] [REMOTE ] BKU: Full fetch complete (60215 records). [2025-10-09T17:40:38.995384] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-09T17:40:39.201911] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-09T17:40:39.400087] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-09T17:40:39.400168] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-09T17:40:39.400846] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-09T17:40:39.400911] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-09T17:40:39.402171] [DEBUG] [LOCAL ] BKU: Trimmed 60215 records to 42027 (keeping 200 days of data) [2025-10-09T17:40:39.671701] [DEBUG] [LOCAL ] BKU: Primary data saved (42027 records). [2025-10-09T17:40:39.671838] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-09T17:40:39.673037] [INFO ] [MAIN ] Update Progress: 296/2373 symbols completed. BKU took 45.0s. Estimated remaining: 4h 44m 54s. Rate: 7.3 symbols/min [2025-10-09T17:40:39.862330] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:39.880104] [DEBUG] [LOCAL ] BLE: Loaded 14063 existing records from primary storage. [2025-10-09T17:40:39.880353] [INFO ] [MAIN ] BLE: Loaded 14063 existing records. [2025-10-09T17:40:39.999380] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-09T17:40:40.077385] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:40.078985] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-09T17:40:40.079302] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-09T17:40:40.079699] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-09T17:40:40.079763] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-09T17:40:40.458448] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-09T17:40:40.499619] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:40.600797] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T17:40:40.796727] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-09T17:40:41.239905] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:40:41.596715] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-09T17:40:41.940675] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T17:40:42.396748] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-09T17:40:43.196756] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-09T17:40:43.487468] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T17:40:43.546715] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T17:40:43.996682] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-09T17:40:44.438039] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T17:40:44.796771] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-09T17:40:45.188145] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T17:40:45.191438] [INFO ] [REMOTE ] BLCO: Full fetch complete (52256 records). [2025-10-09T17:40:45.191677] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-09T17:40:45.583456] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-09T17:40:45.583545] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-09T17:40:45.584164] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-09T17:40:45.584227] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-09T17:40:45.585263] [DEBUG] [LOCAL ] BLCO: Trimmed 52256 records to 35773 (keeping 200 days of data) [2025-10-09T17:40:45.635062] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-09T17:40:45.719142] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:40:45.825827] [DEBUG] [LOCAL ] BLCO: Primary data saved (35773 records). [2025-10-09T17:40:45.826006] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-09T17:40:45.826894] [INFO ] [MAIN ] Update Progress: 297/2373 symbols completed. BLCO took 28.1s. Estimated remaining: 4h 44m 31s. Rate: 7.3 symbols/min [2025-10-09T17:40:45.992480] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:46.027392] [DEBUG] [LOCAL ] BLK: Loaded 34039 existing records from primary storage. [2025-10-09T17:40:46.027879] [INFO ] [MAIN ] BLK: Loaded 34039 existing records. [2025-10-09T17:40:46.200668] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:46.200949] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-09T17:40:46.200997] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-09T17:40:46.201258] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-09T17:40:46.201315] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-09T17:40:46.407973] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-09T17:40:46.558389] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:47.196703] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-09T17:40:47.232276] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T17:40:47.648080] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T17:40:47.996722] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-09T17:40:48.108595] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T17:40:48.112187] [INFO ] [REMOTE ] BKV: Full fetch complete (44798 records). [2025-10-09T17:40:48.112284] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-09T17:40:48.521359] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-09T17:40:48.521444] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-09T17:40:48.522062] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-09T17:40:48.522128] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-09T17:40:48.523141] [DEBUG] [LOCAL ] BKV: Trimmed 44798 records to 30121 (keeping 200 days of data) [2025-10-09T17:40:48.699774] [DEBUG] [LOCAL ] BKV: Primary data saved (30121 records). [2025-10-09T17:40:48.699920] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-09T17:40:48.700006] [INFO ] [MAIN ] Update Progress: 298/2373 symbols completed. BKV took 45.8s. Estimated remaining: 4h 43m 46s. Rate: 7.3 symbols/min [2025-10-09T17:40:48.797437] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-09T17:40:48.868954] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:48.911530] [DEBUG] [LOCAL ] BLND: Loaded 49201 existing records from primary storage. [2025-10-09T17:40:48.911936] [INFO ] [MAIN ] BLND: Loaded 49201 existing records. [2025-10-09T17:40:49.088559] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:49.088925] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-09T17:40:49.088975] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-09T17:40:49.089217] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-09T17:40:49.089274] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-09T17:40:49.450168] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:49.495320] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T17:40:49.596691] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-09T17:40:50.396685] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-09T17:40:50.690406] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T17:40:51.196746] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-09T17:40:51.369430] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T17:40:51.594235] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-09T17:40:51.996722] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-09T17:40:52.754896] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T17:40:52.796681] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-09T17:40:53.596683] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-09T17:40:53.683677] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:40:54.396796] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-09T17:40:54.603282] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T17:40:55.133419] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:40:55.137828] [INFO ] [REMOTE ] BLDR: Full fetch complete (74508 records). [2025-10-09T17:40:55.137961] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-09T17:40:55.202734] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-09T17:40:55.553021] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T17:40:55.552475] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-09T17:40:55.553144] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-09T17:40:55.558463] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-09T17:40:55.558533] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-09T17:40:55.559822] [DEBUG] [LOCAL ] BLDR: Trimmed 74508 records to 52091 (keeping 200 days of data) [2025-10-09T17:40:55.885071] [DEBUG] [LOCAL ] BLDR: Primary data saved (52091 records). [2025-10-09T17:40:55.885216] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-09T17:40:55.885298] [INFO ] [MAIN ] Update Progress: 299/2373 symbols completed. BLDR took 31.0s. Estimated remaining: 4h 43m 30s. Rate: 7.3 symbols/min [2025-10-09T17:40:56.001910] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-09T17:40:56.071966] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:56.072193] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-09T17:40:56.072240] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-09T17:40:56.072350] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-09T17:40:56.072392] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-09T17:40:56.072432] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-09T17:40:56.072502] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-09T17:40:56.427508] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:56.796689] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-09T17:40:57.057040] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:40:57.302453] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T17:40:57.596706] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-09T17:40:57.788122] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T17:40:58.396732] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-09T17:40:59.181098] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T17:40:59.196724] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-09T17:41:00.001811] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-09T17:41:00.021902] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T17:41:00.201762] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:41:00.234879] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:41:00.235174] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-09T17:41:00.235263] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:41:00.235332] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-09T17:41:00.235398] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:41:00.235468] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-09T17:41:00.235552] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-09T17:41:00.235607] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-09T17:41:00.235678] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-09T17:41:00.235743] [INFO ] [MAIN ] Update Progress: 300/2373 symbols completed. BLSH took 4.4s. Estimated remaining: 4h 42m 56s. Rate: 7.3 symbols/min [2025-10-09T17:41:00.408121] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:00.423511] [DEBUG] [LOCAL ] BLW: Loaded 13372 existing records from primary storage. [2025-10-09T17:41:00.423805] [INFO ] [MAIN ] BLW: Loaded 13372 existing records. [2025-10-09T17:41:00.601455] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:00.601690] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-09T17:41:00.601763] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-09T17:41:00.601974] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-09T17:41:00.602031] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-09T17:41:00.801805] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-09T17:41:00.966697] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:01.596690] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-09T17:41:01.663472] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T17:41:02.396725] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-09T17:41:03.196692] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-09T17:41:03.295045] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:41:03.779497] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T17:41:03.996701] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-09T17:41:04.085349] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T17:41:04.796694] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-09T17:41:05.103976] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T17:41:05.596690] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-09T17:41:05.714257] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:41:06.259453] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T17:41:06.396716] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-09T17:41:07.199109] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-09T17:41:07.202237] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T17:41:07.996729] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-09T17:41:08.712023] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:41:08.796763] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-09T17:41:09.596682] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-09T17:41:09.856278] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T17:41:10.396691] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-09T17:41:10.503297] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:41:10.562723] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T17:41:11.196799] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-09T17:41:11.996793] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-09T17:41:12.085461] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:41:12.087584] [INFO ] [REMOTE ] BLE: Full fetch complete (20041 records). [2025-10-09T17:41:12.087704] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-09T17:41:12.314165] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T17:41:12.518403] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-09T17:41:12.518496] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-09T17:41:12.518899] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-09T17:41:12.518963] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-09T17:41:12.519684] [DEBUG] [LOCAL ] BLE: Trimmed 20041 records to 14158 (keeping 200 days of data) [2025-10-09T17:41:12.605626] [DEBUG] [LOCAL ] BLE: Primary data saved (14158 records). [2025-10-09T17:41:12.605793] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-09T17:41:12.605882] [INFO ] [MAIN ] Update Progress: 301/2373 symbols completed. BLE took 32.9s. Estimated remaining: 4h 43m 16s. Rate: 7.3 symbols/min [2025-10-09T17:41:12.776766] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:12.793600] [DEBUG] [LOCAL ] BLX: Loaded 15620 existing records from primary storage. [2025-10-09T17:41:12.793844] [INFO ] [MAIN ] BLX: Loaded 15620 existing records. [2025-10-09T17:41:12.804887] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-09T17:41:12.975995] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:12.976268] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-09T17:41:12.976391] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-09T17:41:12.976569] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-09T17:41:12.976609] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-09T17:41:13.087525] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T17:41:13.342786] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:13.596696] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-09T17:41:14.355204] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T17:41:14.396666] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-09T17:41:14.538850] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T17:41:15.196733] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-09T17:41:15.864462] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:41:15.996693] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-09T17:41:16.118760] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:41:16.796695] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-09T17:41:17.586319] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:41:17.597132] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-09T17:41:18.256015] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:41:18.396748] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-09T17:41:18.415100] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T17:41:19.196719] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-09T17:41:19.827776] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T17:41:19.987336] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T17:41:19.996665] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-09T17:41:20.796740] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-09T17:41:20.943080] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T17:41:21.596729] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-09T17:41:22.393704] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:41:22.396685] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-09T17:41:22.433054] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T17:41:23.196762] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-09T17:41:23.837754] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T17:41:23.840892] [INFO ] [REMOTE ] BLK: Full fetch complete (52483 records). [2025-10-09T17:41:23.840992] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-09T17:41:23.998726] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-09T17:41:24.254258] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-09T17:41:24.254350] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-09T17:41:24.255046] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-09T17:41:24.255116] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-09T17:41:24.256354] [DEBUG] [LOCAL ] BLK: Trimmed 52483 records to 34297 (keeping 200 days of data) [2025-10-09T17:41:24.485476] [DEBUG] [LOCAL ] BLK: Primary data saved (34297 records). [2025-10-09T17:41:24.485610] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-09T17:41:24.486151] [INFO ] [MAIN ] Update Progress: 302/2373 symbols completed. BLK took 38.7s. Estimated remaining: 4h 43m 33s. Rate: 7.3 symbols/min [2025-10-09T17:41:24.618774] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T17:41:24.659894] [INFO ] [REMOTE ] BLND: Full fetch complete (72201 records). [2025-10-09T17:41:24.675151] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-09T17:41:24.677826] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:24.801236] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-09T17:41:25.020458] [DEBUG] [LOCAL ] BMA: Loaded 35575 existing records from primary storage. [2025-10-09T17:41:25.057299] [INFO ] [MAIN ] BMA: Loaded 35575 existing records. [2025-10-09T17:41:25.158292] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-09T17:41:25.169851] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-09T17:41:25.193757] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-09T17:41:25.211424] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-09T17:41:25.298001] [DEBUG] [LOCAL ] BLND: Trimmed 72201 records to 49568 (keeping 200 days of data) [2025-10-09T17:41:25.326699] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:25.328503] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T17:41:25.330262] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-09T17:41:25.378023] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-09T17:41:25.413568] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-09T17:41:25.414009] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-09T17:41:25.598256] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-09T17:41:25.833553] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T17:41:25.937450] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:26.015457] [DEBUG] [LOCAL ] BLND: Primary data saved (49568 records). [2025-10-09T17:41:26.015598] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-09T17:41:26.016581] [INFO ] [MAIN ] Update Progress: 303/2373 symbols completed. BLND took 37.3s. Estimated remaining: 4h 42m 39s. Rate: 7.3 symbols/min [2025-10-09T17:41:26.193417] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:26.207508] [DEBUG] [LOCAL ] BME: Loaded 11075 existing records from primary storage. [2025-10-09T17:41:26.207775] [INFO ] [MAIN ] BME: Loaded 11075 existing records. [2025-10-09T17:41:26.398173] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-09T17:41:26.401407] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:26.402513] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-09T17:41:26.402593] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-09T17:41:26.410189] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-09T17:41:26.412395] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:41:26.412509] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-09T17:41:26.788888] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:27.196760] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-09T17:41:27.810968] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:41:27.996673] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-09T17:41:28.014934] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T17:41:28.796799] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-09T17:41:29.418452] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T17:41:29.596721] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-09T17:41:29.675755] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T17:41:30.396744] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-09T17:41:30.399909] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T17:41:31.196695] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-09T17:41:31.238768] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T17:41:31.996760] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-09T17:41:32.195976] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T17:41:32.796776] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-09T17:41:32.921342] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T17:41:33.596747] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-09T17:41:33.847881] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:41:33.850066] [INFO ] [REMOTE ] BLW: Full fetch complete (19386 records). [2025-10-09T17:41:33.850136] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-09T17:41:34.214546] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-09T17:41:34.214757] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-09T17:41:34.215221] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-09T17:41:34.215264] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-09T17:41:34.215856] [DEBUG] [LOCAL ] BLW: Trimmed 19386 records to 13433 (keeping 200 days of data) [2025-10-09T17:41:34.299304] [DEBUG] [LOCAL ] BLW: Primary data saved (13433 records). [2025-10-09T17:41:34.299454] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-09T17:41:34.299542] [INFO ] [MAIN ] Update Progress: 304/2373 symbols completed. BLW took 34.1s. Estimated remaining: 4h 42m 32s. Rate: 7.3 symbols/min [2025-10-09T17:41:34.401706] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-09T17:41:34.480283] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:34.508264] [DEBUG] [LOCAL ] BMEZ: Loaded 26610 existing records from primary storage. [2025-10-09T17:41:34.508517] [INFO ] [MAIN ] BMEZ: Loaded 26610 existing records. [2025-10-09T17:41:34.617890] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T17:41:34.701272] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:34.701496] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-09T17:41:34.701543] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-09T17:41:34.701830] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-09T17:41:34.701888] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-09T17:41:35.094708] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:35.196684] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-09T17:41:35.216079] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T17:41:35.996828] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-09T17:41:36.621071] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:41:36.802700] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-09T17:41:36.803792] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:41:37.596770] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-09T17:41:38.169983] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T17:41:38.222908] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:41:38.396712] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-09T17:41:39.196693] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-09T17:41:39.666284] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T17:41:39.979764] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T17:41:39.996667] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-09T17:41:40.796704] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-09T17:41:40.805976] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T17:41:41.596769] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-09T17:41:42.190522] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T17:41:42.396811] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-09T17:41:42.897264] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T17:41:43.196709] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-09T17:41:43.518492] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:41:43.996707] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-09T17:41:44.078994] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T17:41:44.796701] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-09T17:41:44.937886] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T17:41:45.596729] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-09T17:41:45.908201] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:41:46.396716] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-09T17:41:46.485193] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:41:46.486915] [INFO ] [REMOTE ] BLX: Full fetch complete (22508 records). [2025-10-09T17:41:46.486985] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-09T17:41:46.860196] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-09T17:41:46.860287] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-09T17:41:46.860672] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-09T17:41:46.860735] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-09T17:41:46.861331] [DEBUG] [LOCAL ] BLX: Trimmed 22508 records to 15705 (keeping 200 days of data) [2025-10-09T17:41:46.960111] [DEBUG] [LOCAL ] BLX: Primary data saved (15705 records). [2025-10-09T17:41:46.960265] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-09T17:41:46.960357] [INFO ] [MAIN ] Update Progress: 305/2373 symbols completed. BLX took 34.4s. Estimated remaining: 4h 42m 54s. Rate: 7.3 symbols/min [2025-10-09T17:41:47.131462] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:47.153996] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T17:41:47.171633] [DEBUG] [LOCAL ] BMI: Loaded 24334 existing records from primary storage. [2025-10-09T17:41:47.172497] [INFO ] [MAIN ] BMI: Loaded 24334 existing records. [2025-10-09T17:41:47.201818] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-09T17:41:47.349619] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:47.349977] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-09T17:41:47.350035] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-09T17:41:47.350543] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-09T17:41:47.350601] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-09T17:41:47.698259] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:47.996762] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-09T17:41:48.471811] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T17:41:48.796682] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-09T17:41:49.130047] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:41:49.596751] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-09T17:41:49.918949] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T17:41:50.396688] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-09T17:41:50.402692] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T17:41:50.404321] [INFO ] [REMOTE ] BME: Full fetch complete (15998 records). [2025-10-09T17:41:50.404408] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-09T17:41:50.766432] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-09T17:41:50.766510] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-09T17:41:50.766853] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-09T17:41:50.766914] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-09T17:41:50.767507] [DEBUG] [LOCAL ] BME: Trimmed 15998 records to 11174 (keeping 200 days of data) [2025-10-09T17:41:50.837442] [DEBUG] [LOCAL ] BME: Primary data saved (11174 records). [2025-10-09T17:41:50.837576] [INFO ] [MAIN ] BME: Full history saved. [2025-10-09T17:41:50.837680] [INFO ] [MAIN ] Update Progress: 306/2373 symbols completed. BME took 24.8s. Estimated remaining: 4h 42m 16s. Rate: 7.3 symbols/min [2025-10-09T17:41:51.003471] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:51.008500] [DEBUG] [LOCAL ] BMN: Loaded 2586 existing records from primary storage. [2025-10-09T17:41:51.008672] [INFO ] [MAIN ] BMN: Loaded 2586 existing records. [2025-10-09T17:41:51.182867] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:51.183081] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-09T17:41:51.183152] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-09T17:41:51.183386] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-09T17:41:51.183456] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-09T17:41:51.203784] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-09T17:41:51.552762] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:51.570883] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:41:51.996767] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-09T17:41:52.566485] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T17:41:52.668591] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:41:52.796735] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-09T17:41:53.163569] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-09T17:41:53.596722] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-09T17:41:54.396719] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-09T17:41:54.961616] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T17:41:55.196681] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-09T17:41:55.608630] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T17:41:55.694525] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T17:41:55.996732] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-09T17:41:56.796702] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-09T17:41:57.082674] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T17:41:57.596687] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-09T17:41:57.833083] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T17:41:58.396704] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-09T17:41:59.096936] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:41:59.196678] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-09T17:41:59.555567] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T17:41:59.996732] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-09T17:42:00.487752] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T17:42:00.667788] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:42:00.671445] [INFO ] [REMOTE ] BMA: Full fetch complete (51471 records). [2025-10-09T17:42:00.671540] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-09T17:42:00.801788] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-09T17:42:01.066977] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-09T17:42:01.067060] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-09T17:42:01.067724] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-09T17:42:01.067788] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-09T17:42:01.068962] [DEBUG] [LOCAL ] BMA: Trimmed 51471 records to 35935 (keeping 200 days of data) [2025-10-09T17:42:01.294480] [DEBUG] [LOCAL ] BMA: Primary data saved (35935 records). [2025-10-09T17:42:01.294633] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-09T17:42:01.294757] [INFO ] [MAIN ] Update Progress: 307/2373 symbols completed. BMA took 36.8s. Estimated remaining: 4h 42m 24s. Rate: 7.3 symbols/min [2025-10-09T17:42:01.472483] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:01.512316] [DEBUG] [LOCAL ] BMO: Loaded 41139 existing records from primary storage. [2025-10-09T17:42:01.512810] [INFO ] [MAIN ] BMO: Loaded 41139 existing records. [2025-10-09T17:42:01.601941] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-09T17:42:01.694431] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:01.694706] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-09T17:42:01.694765] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-09T17:42:01.695003] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-09T17:42:01.695062] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-09T17:42:02.061564] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:02.076101] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T17:42:02.117851] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T17:42:02.396728] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-09T17:42:03.196740] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-09T17:42:03.996706] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-09T17:42:04.082701] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:42:04.157567] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T17:42:04.690380] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T17:42:04.796750] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-09T17:42:05.596791] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-09T17:42:05.818362] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T17:42:06.061824] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T17:42:06.396712] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-09T17:42:06.910508] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T17:42:07.196714] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-09T17:42:07.996731] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-09T17:42:08.181937] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:42:08.497766] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T17:42:08.796736] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-09T17:42:09.282776] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T17:42:09.596710] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-09T17:42:10.396690] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-09T17:42:10.700016] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T17:42:10.939160] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T17:42:10.939976] [INFO ] [REMOTE ] BMN: Full fetch complete (3704 records). [2025-10-09T17:42:10.940043] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-09T17:42:11.201834] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-09T17:42:11.307574] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-09T17:42:11.307673] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-09T17:42:11.307813] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-09T17:42:11.307854] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-09T17:42:11.308216] [DEBUG] [LOCAL ] BMN: Trimmed 3704 records to 2597 (keeping 200 days of data) [2025-10-09T17:42:11.324257] [DEBUG] [LOCAL ] BMN: Primary data saved (2597 records). [2025-10-09T17:42:11.324323] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-09T17:42:11.324394] [INFO ] [MAIN ] Update Progress: 308/2373 symbols completed. BMN took 20.5s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-09T17:42:11.491339] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:11.542251] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-09T17:42:11.542562] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-09T17:42:11.722562] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:11.722807] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-09T17:42:11.722911] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-09T17:42:11.723233] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-09T17:42:11.723294] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-09T17:42:11.996798] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-09T17:42:12.090700] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:12.531739] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:42:12.796768] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-09T17:42:13.525044] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T17:42:13.596738] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-09T17:42:13.851631] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T17:42:14.396718] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-09T17:42:15.196745] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-09T17:42:15.354000] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:42:15.613585] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T17:42:15.996831] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-09T17:42:16.796762] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-09T17:42:17.056163] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:42:17.600427] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-09T17:42:17.603243] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:42:17.658559] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T17:42:18.397147] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-09T17:42:18.503383] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T17:42:19.196828] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-09T17:42:19.996751] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-09T17:42:20.339610] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T17:42:20.358244] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T17:42:20.360571] [INFO ] [REMOTE ] BMI: Full fetch complete (33036 records). [2025-10-09T17:42:20.360698] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-09T17:42:20.732846] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-09T17:42:20.732922] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-09T17:42:20.733348] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-09T17:42:20.733389] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-09T17:42:20.734156] [DEBUG] [LOCAL ] BMI: Trimmed 33036 records to 24507 (keeping 200 days of data) [2025-10-09T17:42:20.798711] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-09T17:42:20.890713] [DEBUG] [LOCAL ] BMI: Primary data saved (24507 records). [2025-10-09T17:42:20.890856] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-09T17:42:20.890955] [INFO ] [MAIN ] Update Progress: 309/2373 symbols completed. BMI took 33.9s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-09T17:42:21.059023] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:21.059259] [DEBUG] [LOCAL ] BN: No existing data file found in primary storage. [2025-10-09T17:42:21.059311] [WARN ] [MAIN ] BN: No existing data found, performing full refresh instead. [2025-10-09T17:42:21.059421] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-09T17:42:21.059483] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-09T17:42:21.059525] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-09T17:42:21.059559] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-09T17:42:21.414568] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:21.442188] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T17:42:21.596705] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-09T17:42:22.180109] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T17:42:22.396747] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-09T17:42:23.196751] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-09T17:42:23.439211] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T17:42:23.996679] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-09T17:42:24.225404] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T17:42:24.231868] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40632 records). [2025-10-09T17:42:24.232010] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-09T17:42:24.619631] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-09T17:42:24.644624] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-09T17:42:24.645017] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-09T17:42:24.645831] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-09T17:42:24.645894] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-09T17:42:24.646736] [DEBUG] [LOCAL ] BMEZ: Trimmed 40632 records to 26718 (keeping 200 days of data) [2025-10-09T17:42:24.801864] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-09T17:42:24.814953] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26718 records). [2025-10-09T17:42:24.815029] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-09T17:42:24.815107] [INFO ] [MAIN ] Update Progress: 310/2373 symbols completed. BMEZ took 50.5s. Estimated remaining: 4h 41m 52s. Rate: 7.3 symbols/min [2025-10-09T17:42:24.982961] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:25.011481] [DEBUG] [LOCAL ] BNED: Loaded 29154 existing records from primary storage. [2025-10-09T17:42:25.011806] [INFO ] [MAIN ] BNED: Loaded 29154 existing records. [2025-10-09T17:42:25.196040] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:25.196274] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-09T17:42:25.196325] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-09T17:42:25.196599] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-09T17:42:25.196691] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-09T17:42:25.562134] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:25.584726] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T17:42:25.596680] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-09T17:42:26.358796] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T17:42:26.396731] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-09T17:42:27.034484] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:42:27.196735] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-09T17:42:27.974801] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:42:27.996669] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-09T17:42:28.796736] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-09T17:42:29.176700] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T17:42:29.205536] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T17:42:29.596754] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-09T17:42:30.406670] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-09T17:42:30.412380] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T17:42:30.747533] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T17:42:31.196733] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-09T17:42:31.803090] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T17:42:31.996732] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-09T17:42:32.796731] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-09T17:42:33.288511] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T17:42:33.330782] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:42:33.596727] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-09T17:42:34.173699] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T17:42:34.396757] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-09T17:42:34.742267] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T17:42:35.196719] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-09T17:42:35.838345] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T17:42:35.996765] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-09T17:42:36.796683] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-09T17:42:36.961772] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T17:42:37.226520] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T17:42:37.596735] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-09T17:42:38.396693] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-09T17:42:38.847740] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T17:42:39.011696] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T17:42:39.015248] [INFO ] [REMOTE ] BMO: Full fetch complete (59584 records). [2025-10-09T17:42:39.015357] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-09T17:42:39.197892] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-09T17:42:39.404567] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-09T17:42:39.404675] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-09T17:42:39.405357] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-09T17:42:39.405403] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-09T17:42:39.406622] [DEBUG] [LOCAL ] BMO: Trimmed 59584 records to 41397 (keeping 200 days of data) [2025-10-09T17:42:39.668202] [DEBUG] [LOCAL ] BMO: Primary data saved (41397 records). [2025-10-09T17:42:39.668343] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-09T17:42:39.668923] [INFO ] [MAIN ] Update Progress: 311/2373 symbols completed. BMO took 38.4s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-09T17:42:39.848166] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:39.857456] [DEBUG] [LOCAL ] BNH: Loaded 5238 existing records from primary storage. [2025-10-09T17:42:39.857803] [INFO ] [MAIN ] BNH: Loaded 5238 existing records. [2025-10-09T17:42:40.005445] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-09T17:42:40.048228] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:40.049328] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-09T17:42:40.049455] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-09T17:42:40.049747] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-09T17:42:40.049815] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-09T17:42:40.280406] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T17:42:40.483332] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:40.802466] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-09T17:42:40.825108] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:42:41.420583] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T17:42:41.596737] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-09T17:42:42.396707] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-09T17:42:42.692851] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T17:42:42.911119] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T17:42:43.196738] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-09T17:42:43.804373] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-09T17:42:43.996725] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-09T17:42:44.732563] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T17:42:44.796685] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-09T17:42:45.596690] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-09T17:42:46.108544] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T17:42:46.265188] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:42:46.396694] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-09T17:42:47.036276] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:42:47.196716] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-09T17:42:47.996699] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-09T17:42:48.399064] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T17:42:48.437691] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:42:48.796784] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-09T17:42:49.288021] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T17:42:49.596777] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-09T17:42:50.216410] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-09T17:42:50.396747] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-09T17:42:50.750891] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T17:42:51.078018] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T17:42:51.196707] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-09T17:42:51.765390] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T17:42:51.996717] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-09T17:42:52.686605] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T17:42:52.796677] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-09T17:42:53.596708] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-09T17:42:53.671039] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T17:42:53.675795] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-09T17:42:53.675978] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-09T17:42:54.089364] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-09T17:42:54.089461] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-09T17:42:54.090301] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-09T17:42:54.090369] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-09T17:42:54.091858] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54147 (keeping 200 days of data) [2025-10-09T17:42:54.409497] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-09T17:42:54.436550] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-10-09T17:42:54.436768] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-09T17:42:54.437553] [INFO ] [MAIN ] Update Progress: 312/2373 symbols completed. BMY took 43.1s. Estimated remaining: 4h 43m 3s. Rate: 7.3 symbols/min [2025-10-09T17:42:54.620179] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:54.626219] [DEBUG] [LOCAL ] BNJ: Loaded 2673 existing records from primary storage. [2025-10-09T17:42:54.626448] [INFO ] [MAIN ] BNJ: Loaded 2673 existing records. [2025-10-09T17:42:54.814092] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:54.814398] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-09T17:42:54.814460] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-09T17:42:54.814674] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-09T17:42:54.814733] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-09T17:42:55.016896] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:42:55.197138] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-09T17:42:55.223364] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:55.858711] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T17:42:56.004552] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-09T17:42:56.006587] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T17:42:56.011604] [INFO ] [REMOTE ] BN: Full fetch complete (76706 records). [2025-10-09T17:42:56.011755] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-09T17:42:56.421299] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-09T17:42:56.421389] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-09T17:42:56.422296] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-09T17:42:56.422361] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-09T17:42:56.423851] [DEBUG] [LOCAL ] BN: Trimmed 76706 records to 53376 (keeping 200 days of data) [2025-10-09T17:42:56.767880] [DEBUG] [LOCAL ] BN: Primary data saved (53376 records). [2025-10-09T17:42:56.768059] [INFO ] [MAIN ] BN: Full history saved. [2025-10-09T17:42:56.768221] [INFO ] [MAIN ] Update Progress: 313/2373 symbols completed. BN took 35.9s. Estimated remaining: 4h 42m 16s. Rate: 7.3 symbols/min [2025-10-09T17:42:56.800841] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-09T17:42:56.950810] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:56.995087] [DEBUG] [LOCAL ] BNL: Loaded 47176 existing records from primary storage. [2025-10-09T17:42:56.995489] [INFO ] [MAIN ] BNL: Loaded 47176 existing records. [2025-10-09T17:42:57.181528] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:57.182328] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T17:42:57.182486] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-09T17:42:57.184500] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-09T17:42:57.184842] [INFO ] [REMOTE ] BNED: Full fetch complete (43130 records). [2025-10-09T17:42:57.184902] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-09T17:42:57.184961] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-09T17:42:57.185157] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-09T17:42:57.602743] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-09T17:42:57.602682] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:42:57.920508] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:57.951680] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-09T17:42:57.951755] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-09T17:42:57.952318] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-09T17:42:57.952359] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-09T17:42:57.953309] [DEBUG] [LOCAL ] BNED: Trimmed 43130 records to 29262 (keeping 200 days of data) [2025-10-09T17:42:58.117365] [DEBUG] [LOCAL ] BNED: Primary data saved (29262 records). [2025-10-09T17:42:58.117503] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-09T17:42:58.117597] [INFO ] [MAIN ] Update Progress: 314/2373 symbols completed. BNED took 33.3s. Estimated remaining: 4h 41m 22s. Rate: 7.3 symbols/min [2025-10-09T17:42:58.284015] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:58.284194] [DEBUG] [LOCAL ] BNS: No existing data file found in primary storage. [2025-10-09T17:42:58.284249] [WARN ] [MAIN ] BNS: No existing data found, performing full refresh instead. [2025-10-09T17:42:58.284357] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-09T17:42:58.284398] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-09T17:42:58.284458] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-10-09T17:42:58.284527] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-09T17:42:58.401800] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-09T17:42:58.578329] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T17:42:58.661941] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:59.016150] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T17:42:59.196722] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-09T17:42:59.996770] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-09T17:43:00.516095] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T17:43:00.796683] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-09T17:43:00.998344] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T17:43:01.385423] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T17:43:01.596775] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-09T17:43:02.080344] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T17:43:02.396738] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-09T17:43:03.196718] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-09T17:43:03.742313] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:43:03.996684] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-09T17:43:04.098159] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T17:43:04.549402] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T17:43:04.796703] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-09T17:43:05.596714] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-09T17:43:06.067219] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T17:43:06.396742] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-09T17:43:06.449582] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T17:43:07.090734] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T17:43:07.196713] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-09T17:43:07.996791] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-09T17:43:08.506155] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T17:43:08.669541] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:43:08.796721] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-09T17:43:09.382169] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T17:43:09.383516] [INFO ] [REMOTE ] BNH: Full fetch complete (6948 records). [2025-10-09T17:43:09.383607] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-09T17:43:09.601963] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-09T17:43:09.769397] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-09T17:43:09.769477] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-09T17:43:09.769748] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-09T17:43:09.769811] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-09T17:43:09.770204] [DEBUG] [LOCAL ] BNH: Trimmed 6948 records to 5264 (keeping 200 days of data) [2025-10-09T17:43:09.803271] [DEBUG] [LOCAL ] BNH: Primary data saved (5264 records). [2025-10-09T17:43:09.803370] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-09T17:43:09.803461] [INFO ] [MAIN ] Update Progress: 315/2373 symbols completed. BNH took 30.1s. Estimated remaining: 4h 41m 37s. Rate: 7.3 symbols/min [2025-10-09T17:43:09.981245] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:09.987348] [DEBUG] [LOCAL ] BNT: Loaded 3347 existing records from primary storage. [2025-10-09T17:43:09.987506] [INFO ] [MAIN ] BNT: Loaded 3347 existing records. [2025-10-09T17:43:10.178989] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-09T17:43:10.178787] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:10.180741] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-09T17:43:10.180804] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-09T17:43:10.180964] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-09T17:43:10.181023] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-09T17:43:10.402021] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-09T17:43:10.556288] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:10.915130] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T17:43:11.196721] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-09T17:43:11.741728] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T17:43:11.996767] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-09T17:43:12.564246] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T17:43:12.796816] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-09T17:43:13.596718] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-09T17:43:14.397502] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-09T17:43:14.403339] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T17:43:14.958967] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T17:43:14.961605] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T17:43:15.196689] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-09T17:43:15.996766] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-09T17:43:16.368293] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T17:43:16.730831] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:43:16.796691] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-09T17:43:17.596695] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-09T17:43:18.156281] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T17:43:18.338619] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T17:43:18.396676] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-09T17:43:19.196715] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-09T17:43:19.861056] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-09T17:43:19.996698] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-09T17:43:20.035850] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T17:43:20.796746] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-09T17:43:21.405921] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T17:43:21.406839] [INFO ] [REMOTE ] BNJ: Full fetch complete (4205 records). [2025-10-09T17:43:21.406914] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-09T17:43:21.600430] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-09T17:43:21.808624] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T17:43:21.839560] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-09T17:43:21.839754] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-09T17:43:21.839908] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-09T17:43:21.840221] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-09T17:43:21.840596] [DEBUG] [LOCAL ] BNJ: Trimmed 4205 records to 2684 (keeping 200 days of data) [2025-10-09T17:43:21.857253] [DEBUG] [LOCAL ] BNJ: Primary data saved (2684 records). [2025-10-09T17:43:21.857313] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-09T17:43:21.857405] [INFO ] [MAIN ] Update Progress: 316/2373 symbols completed. BNJ took 27.4s. Estimated remaining: 4h 41m 54s. Rate: 7.3 symbols/min [2025-10-09T17:43:22.024326] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:22.033744] [DEBUG] [LOCAL ] BNY: Loaded 7144 existing records from primary storage. [2025-10-09T17:43:22.033976] [INFO ] [MAIN ] BNY: Loaded 7144 existing records. [2025-10-09T17:43:22.210233] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:22.210535] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-09T17:43:22.210593] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-09T17:43:22.210938] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-09T17:43:22.210995] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-09T17:43:22.396775] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-09T17:43:22.557464] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:23.068682] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T17:43:23.196728] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-09T17:43:23.417269] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T17:43:23.644731] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:43:23.996778] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-09T17:43:24.566098] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T17:43:24.796783] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-09T17:43:25.119156] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-09T17:43:25.596709] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-09T17:43:26.396784] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-09T17:43:26.502429] [DEBUG] [REMOTE ] BNY: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-09T17:43:26.502733] [WARN ] [REMOTE ] BNY: No data returned for month 2024-12 [2025-10-09T17:43:26.502833] [FATAL] [REMOTE ] BNY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:43:26.502897] [FATAL] [MAIN ] BNY: Failed to fetch primary data. [2025-10-09T17:43:26.502958] [WARN ] [MAIN ] BNY: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:43:26.503026] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-09T17:43:26.503088] [DEBUG] [LOCAL ] BNY: No primary data file found to delete. [2025-10-09T17:43:26.503125] [INFO ] [LOCAL ] BNY: Starting deletion of derivative data. [2025-10-09T17:43:26.503386] [DEBUG] [LOCAL ] BNY: Deleted derivative data file. [2025-10-09T17:43:26.503479] [INFO ] [MAIN ] Update Progress: 317/2373 symbols completed. BNY took 4.6s. Estimated remaining: 4h 41m 22s. Rate: 7.3 symbols/min [2025-10-09T17:43:27.196722] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-09T17:43:27.473811] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T17:43:27.935247] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T17:43:27.996731] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-09T17:43:28.796832] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-09T17:43:29.306123] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T17:43:29.307111] [INFO ] [REMOTE ] BNT: Full fetch complete (4518 records). [2025-10-09T17:43:29.307182] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-09T17:43:29.597113] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-09T17:43:29.681508] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-09T17:43:29.681783] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-09T17:43:29.682084] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-09T17:43:29.682229] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-09T17:43:29.682832] [DEBUG] [LOCAL ] BNT: Trimmed 4518 records to 3368 (keeping 200 days of data) [2025-10-09T17:43:29.704186] [DEBUG] [LOCAL ] BNT: Primary data saved (3368 records). [2025-10-09T17:43:29.704313] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-09T17:43:29.704485] [INFO ] [MAIN ] Update Progress: 318/2373 symbols completed. BNT took 19.9s. Estimated remaining: 4h 40m 42s. Rate: 7.3 symbols/min [2025-10-09T17:43:29.784923] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:43:30.396764] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-09T17:43:31.357333] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:43:31.367808] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-09T17:43:31.918407] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:43:31.996676] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-09T17:43:32.964864] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:43:32.975326] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-09T17:43:33.760610] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:43:33.771967] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-09T17:43:34.407219] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T17:43:34.417585] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-09T17:43:35.223280] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T17:43:35.234569] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-09T17:43:35.991409] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T17:43:35.995907] [INFO ] [REMOTE ] BNL: Full fetch complete (67094 records). [2025-10-09T17:43:35.996078] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-09T17:43:36.401270] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-09T17:43:36.401354] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-09T17:43:36.402105] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-09T17:43:36.402171] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-09T17:43:36.403462] [DEBUG] [LOCAL ] BNL: Trimmed 67094 records to 47534 (keeping 200 days of data) [2025-10-09T17:43:36.694101] [DEBUG] [LOCAL ] BNL: Primary data saved (47534 records). [2025-10-09T17:43:36.694267] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-09T17:43:36.695196] [INFO ] [MAIN ] Update Progress: 319/2373 symbols completed. BNL took 39.9s. Estimated remaining: 4h 40m 26s. Rate: 7.3 symbols/min [2025-10-09T17:43:36.871991] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T17:43:36.883307] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-09T17:43:38.338106] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T17:43:38.342435] [INFO ] [REMOTE ] BNS: Full fetch complete (74350 records). [2025-10-09T17:43:38.342544] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-09T17:43:38.740055] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-09T17:43:38.740148] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-09T17:43:38.741185] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-09T17:43:38.741257] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-09T17:43:38.743001] [DEBUG] [LOCAL ] BNS: Trimmed 74350 records to 51843 (keeping 200 days of data) [2025-10-09T17:43:39.068687] [DEBUG] [LOCAL ] BNS: Primary data saved (51843 records). [2025-10-09T17:43:39.068855] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-09T17:43:39.068956] [INFO ] [MAIN ] Update Progress: 320/2373 symbols completed. BNS took 41.0s. Estimated remaining: 4h 39m 40s. Rate: 7.3 symbols/min [2025-10-09T17:43:39.738541] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:39.786400] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:39.763152] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:39.783485] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:39.828444] [DEBUG] [LOCAL ] BOE: Loaded 18088 existing records from primary storage. [2025-10-09T17:43:39.853476] [DEBUG] [LOCAL ] BOC: Loaded 18353 existing records from primary storage. [2025-10-09T17:43:39.853677] [INFO ] [MAIN ] BOE: Loaded 18088 existing records. [2025-10-09T17:43:39.852242] [DEBUG] [LOCAL ] BOH: Loaded 30374 existing records from primary storage. [2025-10-09T17:43:39.854318] [DEBUG] [LOCAL ] BOND: Loaded 32252 existing records from primary storage. [2025-10-09T17:43:39.859737] [INFO ] [MAIN ] BOC: Loaded 18353 existing records. [2025-10-09T17:43:39.866173] [INFO ] [MAIN ] BOH: Loaded 30374 existing records. [2025-10-09T17:43:39.887492] [INFO ] [MAIN ] BOND: Loaded 32252 existing records. [2025-10-09T17:43:40.533697] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:40.546050] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:40.598922] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-09T17:43:40.599208] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-09T17:43:40.603437] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:40.603737] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-09T17:43:40.598715] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:40.599143] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-09T17:43:40.604346] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-09T17:43:40.604156] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-09T17:43:40.604656] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-09T17:43:40.604597] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-09T17:43:40.604972] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-09T17:43:40.605134] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-09T17:43:40.605245] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-09T17:43:40.605205] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-09T17:43:40.610898] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-09T17:43:40.635225] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-09T17:43:40.656125] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-09T17:43:40.670492] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-09T17:43:41.985851] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:41.981959] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:42.001687] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-09T17:43:42.012254] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-09T17:43:42.083942] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:42.106906] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-09T17:43:42.111098] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:42.111393] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-09T17:43:43.141138] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T17:43:43.145402] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-09T17:43:43.203590] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T17:43:43.209480] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-09T17:43:43.276466] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T17:43:43.281568] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-09T17:43:43.595907] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T17:43:43.602612] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-09T17:43:43.848421] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T17:43:43.852468] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-09T17:43:44.337529] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:43:44.342212] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-09T17:43:44.536032] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:43:44.794817] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:43:44.798589] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-09T17:43:44.891930] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T17:43:45.294505] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:43:45.596720] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-09T17:43:45.815752] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T17:43:46.396688] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-09T17:43:46.599568] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T17:43:47.196716] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-09T17:43:47.472675] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T17:43:47.996684] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-09T17:43:48.207864] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:43:48.796684] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-09T17:43:49.130184] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T17:43:49.596706] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-09T17:43:50.209760] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T17:43:50.312429] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T17:43:50.396727] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-09T17:43:51.196726] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-09T17:43:51.772976] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:43:51.996846] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-09T17:43:51.997952] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T17:43:52.796675] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-09T17:43:53.261706] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T17:43:53.596740] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-09T17:43:53.952905] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:43:54.396715] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-09T17:43:55.031850] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:43:55.196686] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-09T17:43:55.336741] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T17:43:55.996700] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-09T17:43:56.280709] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T17:43:56.796713] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-09T17:43:57.371580] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T17:43:57.446379] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T17:43:57.596702] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-09T17:43:58.396751] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-09T17:43:58.469434] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T17:43:59.196741] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-09T17:43:59.393561] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T17:43:59.887703] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T17:43:59.996786] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-09T17:44:00.796727] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-09T17:44:01.344974] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T17:44:01.596771] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-09T17:44:01.854188] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:44:01.856094] [INFO ] [REMOTE ] BOC: Full fetch complete (25720 records). [2025-10-09T17:44:01.856170] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-09T17:44:02.223536] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-09T17:44:02.223624] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-09T17:44:02.224045] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-09T17:44:02.224097] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-09T17:44:02.224885] [DEBUG] [LOCAL ] BOC: Trimmed 25720 records to 18567 (keeping 200 days of data) [2025-10-09T17:44:02.335237] [DEBUG] [LOCAL ] BOC: Primary data saved (18567 records). [2025-10-09T17:44:02.335394] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-09T17:44:02.335479] [INFO ] [MAIN ] Update Progress: 321/2373 symbols completed. BOC took 23.3s. Estimated remaining: 4h 41m 8s. Rate: 7.3 symbols/min [2025-10-09T17:44:02.401815] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-09T17:44:02.507331] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:02.546175] [DEBUG] [LOCAL ] BOOT: Loaded 40139 existing records from primary storage. [2025-10-09T17:44:02.546465] [INFO ] [MAIN ] BOOT: Loaded 40139 existing records. [2025-10-09T17:44:02.727619] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:02.727892] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-09T17:44:02.728015] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-09T17:44:02.728249] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-09T17:44:02.728308] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-09T17:44:03.107473] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:03.130421] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:44:03.196710] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-09T17:44:03.879518] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T17:44:03.996721] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-09T17:44:04.535115] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T17:44:04.796781] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-09T17:44:05.324110] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:44:05.327684] [INFO ] [REMOTE ] BOND: Full fetch complete (46445 records). [2025-10-09T17:44:05.327859] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-09T17:44:05.601965] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-09T17:44:05.814557] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-09T17:44:05.814688] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-09T17:44:05.815371] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-09T17:44:05.815418] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-09T17:44:05.816596] [DEBUG] [LOCAL ] BOND: Trimmed 46445 records to 32491 (keeping 200 days of data) [2025-10-09T17:44:05.951755] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T17:44:06.054005] [DEBUG] [LOCAL ] BOND: Primary data saved (32491 records). [2025-10-09T17:44:06.054141] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-09T17:44:06.054225] [INFO ] [MAIN ] Update Progress: 322/2373 symbols completed. BOND took 27.0s. Estimated remaining: 4h 40m 32s. Rate: 7.3 symbols/min [2025-10-09T17:44:06.219811] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:06.266072] [DEBUG] [LOCAL ] BORR: Loaded 51092 existing records from primary storage. [2025-10-09T17:44:06.266376] [INFO ] [MAIN ] BORR: Loaded 51092 existing records. [2025-10-09T17:44:06.404901] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-09T17:44:06.445914] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:06.446222] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-09T17:44:06.446271] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-09T17:44:06.446761] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-09T17:44:06.446819] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-09T17:44:06.820379] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T17:44:06.819849] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:07.196764] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-09T17:44:07.829182] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:44:07.996776] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-09T17:44:08.613905] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:44:08.630852] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:44:08.796741] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-09T17:44:09.596712] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-09T17:44:10.396689] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-09T17:44:10.411360] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:44:10.768359] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T17:44:11.196774] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-09T17:44:11.440727] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T17:44:11.996774] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-09T17:44:12.801897] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-09T17:44:12.820051] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T17:44:13.555979] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T17:44:13.596680] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-09T17:44:13.671492] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T17:44:14.396742] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-09T17:44:15.196708] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-09T17:44:15.265721] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T17:44:15.422663] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T17:44:15.426214] [INFO ] [REMOTE ] BOE: Full fetch complete (26724 records). [2025-10-09T17:44:15.426338] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-09T17:44:15.806991] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-09T17:44:15.807069] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-09T17:44:15.807438] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-09T17:44:15.807477] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-09T17:44:15.808156] [DEBUG] [LOCAL ] BOE: Trimmed 26724 records to 18227 (keeping 200 days of data) [2025-10-09T17:44:15.916926] [DEBUG] [LOCAL ] BOE: Primary data saved (18227 records). [2025-10-09T17:44:15.917059] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-09T17:44:15.917139] [INFO ] [MAIN ] Update Progress: 323/2373 symbols completed. BOE took 36.8s. Estimated remaining: 4h 40m 34s. Rate: 7.3 symbols/min [2025-10-09T17:44:16.004691] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-09T17:44:16.087762] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:16.109824] [DEBUG] [LOCAL ] BOW: Loaded 23766 existing records from primary storage. [2025-10-09T17:44:16.110072] [INFO ] [MAIN ] BOW: Loaded 23766 existing records. [2025-10-09T17:44:16.294681] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:16.295959] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:44:16.296252] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-09T17:44:16.298639] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-09T17:44:16.299496] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-09T17:44:16.299451] [INFO ] [REMOTE ] BOH: Full fetch complete (44742 records). [2025-10-09T17:44:16.299775] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-09T17:44:16.299692] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-09T17:44:16.798363] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-09T17:44:16.961578] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:17.046347] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-09T17:44:17.046443] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-09T17:44:17.047145] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-09T17:44:17.047218] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-09T17:44:17.048427] [DEBUG] [LOCAL ] BOH: Trimmed 44742 records to 30612 (keeping 200 days of data) [2025-10-09T17:44:17.300161] [DEBUG] [LOCAL ] BOH: Primary data saved (30612 records). [2025-10-09T17:44:17.300371] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-09T17:44:17.300472] [INFO ] [MAIN ] Update Progress: 324/2373 symbols completed. BOH took 38.2s. Estimated remaining: 4h 39m 43s. Rate: 7.3 symbols/min [2025-10-09T17:44:17.471913] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:17.519242] [DEBUG] [LOCAL ] BOX: Loaded 50230 existing records from primary storage. [2025-10-09T17:44:17.519609] [INFO ] [MAIN ] BOX: Loaded 50230 existing records. [2025-10-09T17:44:17.599011] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-09T17:44:17.698726] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:17.699008] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-09T17:44:17.699132] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-09T17:44:17.699844] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-09T17:44:17.699910] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-09T17:44:17.898097] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T17:44:18.095490] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:18.396722] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-09T17:44:18.760264] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-09T17:44:18.824402] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T17:44:19.196766] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-09T17:44:19.835624] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T17:44:20.002091] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-09T17:44:20.015460] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:44:20.796777] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-09T17:44:21.596717] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-09T17:44:21.878181] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T17:44:22.396697] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-09T17:44:22.407024] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T17:44:22.494539] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:44:23.196725] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-09T17:44:23.996710] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-09T17:44:24.052842] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T17:44:24.558155] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T17:44:24.796752] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-09T17:44:25.596708] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-09T17:44:25.745629] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T17:44:26.312206] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T17:44:26.396735] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-09T17:44:26.608035] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:44:27.196730] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-09T17:44:27.690313] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T17:44:27.996737] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-09T17:44:28.774888] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T17:44:28.796667] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-09T17:44:29.598475] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-09T17:44:29.601563] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T17:44:30.396772] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-09T17:44:30.566848] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T17:44:30.902848] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T17:44:31.196780] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-09T17:44:31.996736] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-09T17:44:32.057377] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T17:44:32.098887] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T17:44:32.796725] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-09T17:44:33.596763] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-09T17:44:33.881413] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:44:33.905521] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T17:44:34.396716] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-09T17:44:35.185608] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:44:35.196666] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-09T17:44:35.488154] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T17:44:35.996722] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-09T17:44:36.796709] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-09T17:44:37.107533] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T17:44:37.296153] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T17:44:37.452133] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T17:44:37.596737] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-09T17:44:38.396726] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-09T17:44:39.196748] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-09T17:44:39.270933] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T17:44:39.899398] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:44:39.996694] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-09T17:44:40.506593] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T17:44:40.509943] [INFO ] [REMOTE ] BOW: Full fetch complete (32106 records). [2025-10-09T17:44:40.510027] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-09T17:44:40.801850] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-09T17:44:40.903413] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-09T17:44:40.903512] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-09T17:44:40.903965] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-09T17:44:40.904027] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-09T17:44:40.904783] [DEBUG] [LOCAL ] BOW: Trimmed 32106 records to 23981 (keeping 200 days of data) [2025-10-09T17:44:41.046002] [DEBUG] [LOCAL ] BOW: Primary data saved (23981 records). [2025-10-09T17:44:41.046148] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-09T17:44:41.046233] [INFO ] [MAIN ] Update Progress: 325/2373 symbols completed. BOW took 25.1s. Estimated remaining: 4h 41m 12s. Rate: 7.3 symbols/min [2025-10-09T17:44:41.214212] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:41.264481] [DEBUG] [LOCAL ] BP: Loaded 53709 existing records from primary storage. [2025-10-09T17:44:41.272760] [INFO ] [MAIN ] BP: Loaded 53709 existing records. [2025-10-09T17:44:41.273022] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T17:44:41.339263] [INFO ] [REMOTE ] BOOT: Full fetch complete (60013 records). [2025-10-09T17:44:41.355789] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-09T17:44:41.571227] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:41.586808] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-09T17:44:41.592013] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-09T17:44:41.597253] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-09T17:44:41.612633] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-09T17:44:41.625327] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-09T17:44:42.169273] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-09T17:44:42.172913] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-09T17:44:42.179360] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-09T17:44:42.184761] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-09T17:44:42.256096] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:42.257097] [DEBUG] [LOCAL ] BOOT: Trimmed 60013 records to 40347 (keeping 200 days of data) [2025-10-09T17:44:42.381511] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T17:44:42.396627] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-09T17:44:42.570159] [DEBUG] [LOCAL ] BOOT: Primary data saved (40347 records). [2025-10-09T17:44:42.570315] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-09T17:44:42.571089] [INFO ] [MAIN ] Update Progress: 326/2373 symbols completed. BOOT took 40.2s. Estimated remaining: 4h 40m 22s. Rate: 7.3 symbols/min [2025-10-09T17:44:42.760125] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:42.794725] [DEBUG] [LOCAL ] BR: Loaded 34795 existing records from primary storage. [2025-10-09T17:44:42.795019] [INFO ] [MAIN ] BR: Loaded 34795 existing records. [2025-10-09T17:44:42.973746] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:42.973947] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-09T17:44:42.973992] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-09T17:44:42.974186] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-09T17:44:42.974242] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-09T17:44:43.202379] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-09T17:44:43.362058] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:43.380772] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T17:44:43.384944] [INFO ] [REMOTE ] BORR: Full fetch complete (74570 records). [2025-10-09T17:44:43.385046] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-09T17:44:43.771541] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-09T17:44:43.771770] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-09T17:44:43.772617] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-09T17:44:43.772710] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-09T17:44:43.774204] [DEBUG] [LOCAL ] BORR: Trimmed 74570 records to 51475 (keeping 200 days of data) [2025-10-09T17:44:43.997046] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-09T17:44:44.071316] [DEBUG] [LOCAL ] BORR: Primary data saved (51475 records). [2025-10-09T17:44:44.071579] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-09T17:44:44.071818] [INFO ] [MAIN ] Update Progress: 327/2373 symbols completed. BORR took 38.0s. Estimated remaining: 4h 39m 32s. Rate: 7.3 symbols/min [2025-10-09T17:44:44.209511] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T17:44:44.282113] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:44.330346] [DEBUG] [LOCAL ] BRBR: Loaded 51454 existing records from primary storage. [2025-10-09T17:44:44.330677] [INFO ] [MAIN ] BRBR: Loaded 51454 existing records. [2025-10-09T17:44:44.508860] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:44.509110] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-09T17:44:44.509172] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-09T17:44:44.509445] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-09T17:44:44.509517] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-09T17:44:44.804336] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-09T17:44:44.884807] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:45.116777] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T17:44:45.173871] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T17:44:45.596754] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-09T17:44:46.369394] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:44:46.396680] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-09T17:44:47.196695] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-09T17:44:47.672002] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T17:44:47.996684] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-09T17:44:48.079181] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T17:44:48.783020] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T17:44:48.796665] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-09T17:44:49.596685] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-09T17:44:49.692215] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T17:44:50.370246] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T17:44:50.396679] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-09T17:44:50.596923] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:44:51.196744] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-09T17:44:51.937980] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T17:44:51.996691] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-09T17:44:52.796722] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-09T17:44:53.092435] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T17:44:53.596700] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-09T17:44:53.657182] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T17:44:54.396728] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-09T17:44:54.626959] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T17:44:54.851357] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:44:55.196734] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-09T17:44:55.996713] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-09T17:44:56.561877] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-09T17:44:56.796805] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-09T17:44:56.940514] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T17:44:57.176162] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T17:44:57.596792] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-09T17:44:58.405530] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-09T17:44:58.429268] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:44:58.917347] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T17:44:59.196735] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-09T17:44:59.700563] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T17:44:59.704955] [INFO ] [REMOTE ] BOX: Full fetch complete (72092 records). [2025-10-09T17:44:59.705087] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-09T17:45:00.001818] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-09T17:45:00.111325] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-09T17:45:00.111405] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-09T17:45:00.112219] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-09T17:45:00.112286] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-09T17:45:00.113822] [DEBUG] [LOCAL ] BOX: Trimmed 72092 records to 50568 (keeping 200 days of data) [2025-10-09T17:45:00.416670] [DEBUG] [LOCAL ] BOX: Primary data saved (50568 records). [2025-10-09T17:45:00.416979] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-09T17:45:00.425586] [INFO ] [MAIN ] Update Progress: 328/2373 symbols completed. BOX took 43.1s. Estimated remaining: 4h 40m 14s. Rate: 7.3 symbols/min [2025-10-09T17:45:00.517879] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T17:45:00.620213] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:00.641090] [DEBUG] [LOCAL ] BRC: Loaded 18784 existing records from primary storage. [2025-10-09T17:45:00.641347] [INFO ] [MAIN ] BRC: Loaded 18784 existing records. [2025-10-09T17:45:00.801376] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-09T17:45:00.823206] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:00.824424] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-09T17:45:00.824523] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-09T17:45:00.824805] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-09T17:45:00.824875] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-09T17:45:01.178792] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:01.596766] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-09T17:45:02.149972] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-09T17:45:02.210292] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T17:45:02.396750] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-09T17:45:02.879149] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T17:45:03.196765] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-09T17:45:03.977025] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T17:45:03.996677] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-09T17:45:04.796727] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-09T17:45:05.475476] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-09T17:45:05.603984] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-09T17:45:05.608949] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T17:45:05.891955] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T17:45:06.396732] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-09T17:45:07.196785] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-09T17:45:07.460742] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:45:07.873437] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T17:45:07.996770] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-09T17:45:08.796728] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-09T17:45:09.190917] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T17:45:09.284255] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T17:45:09.287198] [INFO ] [REMOTE ] BR: Full fetch complete (49248 records). [2025-10-09T17:45:09.287289] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-09T17:45:09.287958] [FATAL] [VALIDATOR ] BR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:45:09.288048] [FATAL] [MAIN ] BR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:45:09.288091] [WARN ] [MAIN ] BR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:45:09.288208] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-09T17:45:09.288271] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-10-09T17:45:09.288330] [INFO ] [LOCAL ] BR: Starting deletion of derivative data. [2025-10-09T17:45:09.288573] [DEBUG] [LOCAL ] BR: Deleted derivative data file. [2025-10-09T17:45:09.289317] [INFO ] [MAIN ] Update Progress: 329/2373 symbols completed. BR took 26.7s. Estimated remaining: 4h 40m 10s. Rate: 7.3 symbols/min [2025-10-09T17:45:09.468232] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:09.512420] [DEBUG] [LOCAL ] BRCC: Loaded 40168 existing records from primary storage. [2025-10-09T17:45:09.512811] [INFO ] [MAIN ] BRCC: Loaded 40168 existing records. [2025-10-09T17:45:09.607232] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-09T17:45:09.705726] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:09.713940] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T17:45:09.713482] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-09T17:45:09.718786] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-09T17:45:09.719106] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-09T17:45:09.719179] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-09T17:45:10.067487] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:10.396764] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-09T17:45:10.951780] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T17:45:11.196714] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-09T17:45:11.996686] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-09T17:45:12.088252] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:45:12.796764] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-09T17:45:13.421004] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T17:45:13.576549] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T17:45:13.596666] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-09T17:45:14.041755] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:45:14.396745] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-09T17:45:15.196723] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-09T17:45:15.949598] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T17:45:15.996680] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-09T17:45:16.065320] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-09T17:45:16.796736] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-09T17:45:17.160917] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:45:17.588762] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-09T17:45:17.599552] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-09T17:45:18.396752] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-09T17:45:18.642458] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-09T17:45:19.028184] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T17:45:19.196713] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-09T17:45:19.740491] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T17:45:19.996744] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-09T17:45:20.796748] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-09T17:45:20.984011] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T17:45:20.988515] [INFO ] [REMOTE ] BRBR: Full fetch complete (72343 records). [2025-10-09T17:45:20.988668] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-09T17:45:21.402614] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-09T17:45:21.402868] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-09T17:45:21.403800] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-09T17:45:21.403972] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-09T17:45:21.405374] [DEBUG] [LOCAL ] BRBR: Trimmed 72343 records to 51836 (keeping 200 days of data) [2025-10-09T17:45:21.531413] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T17:45:21.608998] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-09T17:45:21.748142] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T17:45:21.770209] [DEBUG] [LOCAL ] BRBR: Primary data saved (51836 records). [2025-10-09T17:45:21.770334] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-09T17:45:21.770450] [INFO ] [MAIN ] Update Progress: 330/2373 symbols completed. BRBR took 37.7s. Estimated remaining: 4h 40m 28s. Rate: 7.3 symbols/min [2025-10-09T17:45:21.940911] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:21.941099] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-09T17:45:21.941155] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-09T17:45:21.941285] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-09T17:45:21.941340] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-09T17:45:21.941397] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-09T17:45:21.941434] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-09T17:45:22.297201] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:22.396691] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-09T17:45:23.203734] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-09T17:45:23.208756] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:45:23.996725] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-09T17:45:24.110402] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T17:45:24.796733] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-09T17:45:25.361115] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-09T17:45:25.366813] [INFO ] [REMOTE ] BP: Full fetch complete (77761 records). [2025-10-09T17:45:25.366997] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-09T17:45:25.601840] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-09T17:45:25.707572] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:45:25.829522] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-09T17:45:25.829612] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-09T17:45:25.830586] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-09T17:45:25.830698] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-09T17:45:25.832272] [DEBUG] [LOCAL ] BP: Trimmed 77761 records to 54099 (keeping 200 days of data) [2025-10-09T17:45:26.180851] [DEBUG] [LOCAL ] BP: Primary data saved (54099 records). [2025-10-09T17:45:26.181017] [INFO ] [MAIN ] BP: Full history saved. [2025-10-09T17:45:26.181883] [INFO ] [MAIN ] Update Progress: 331/2373 symbols completed. BP took 45.1s. Estimated remaining: 4h 39m 56s. Rate: 7.3 symbols/min [2025-10-09T17:45:26.362132] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:26.396686] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-09T17:45:26.415934] [DEBUG] [LOCAL ] BROS: Loaded 53299 existing records from primary storage. [2025-10-09T17:45:26.416301] [INFO ] [MAIN ] BROS: Loaded 53299 existing records. [2025-10-09T17:45:26.599680] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:26.600088] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-09T17:45:26.600250] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-09T17:45:26.600814] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-09T17:45:26.611926] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-09T17:45:26.612828] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T17:45:26.796714] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-09T17:45:27.037434] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:27.196723] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-09T17:45:27.661531] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T17:45:27.996744] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-09T17:45:28.097694] [DEBUG] [REMOTE ] BRC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-09T17:45:28.098031] [WARN ] [REMOTE ] BRC: No data returned for month 2025-06 [2025-10-09T17:45:28.098145] [FATAL] [REMOTE ] BRC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:45:28.098255] [FATAL] [MAIN ] BRC: Failed to fetch primary data. [2025-10-09T17:45:28.098323] [WARN ] [MAIN ] BRC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:45:28.098394] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-09T17:45:28.098497] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-10-09T17:45:28.098559] [INFO ] [LOCAL ] BRC: Starting deletion of derivative data. [2025-10-09T17:45:28.098774] [DEBUG] [LOCAL ] BRC: Deleted derivative data file. [2025-10-09T17:45:28.098861] [INFO ] [MAIN ] Update Progress: 332/2373 symbols completed. BRC took 27.7s. Estimated remaining: 4h 39m 9s. Rate: 7.3 symbols/min [2025-10-09T17:45:28.267795] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:28.268002] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-09T17:45:28.268051] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-09T17:45:28.268163] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-09T17:45:28.268206] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-09T17:45:28.268248] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-09T17:45:28.268280] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-09T17:45:28.642281] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:28.796725] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-09T17:45:29.119475] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T17:45:29.596735] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-09T17:45:30.396711] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-09T17:45:30.480348] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T17:45:30.638178] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:45:30.638606] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-09T17:45:30.638728] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:45:30.638781] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-09T17:45:30.638843] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:45:30.638919] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-09T17:45:30.639022] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-09T17:45:30.639078] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-09T17:45:30.639120] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-09T17:45:30.639169] [INFO ] [MAIN ] Update Progress: 333/2373 symbols completed. BRSL took 2.5s. Estimated remaining: 4h 38m 26s. Rate: 7.3 symbols/min [2025-10-09T17:45:30.813350] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:30.840843] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T17:45:30.880825] [DEBUG] [LOCAL ] BRSP: Loaded 36626 existing records from primary storage. [2025-10-09T17:45:30.881107] [INFO ] [MAIN ] BRSP: Loaded 36626 existing records. [2025-10-09T17:45:31.062235] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:31.062467] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-09T17:45:31.062514] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-09T17:45:31.062769] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-09T17:45:31.062825] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-09T17:45:31.201917] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-09T17:45:31.415672] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:31.996751] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-09T17:45:32.796784] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-09T17:45:33.004756] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T17:45:33.259214] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T17:45:33.262312] [INFO ] [REMOTE ] BRCC: Full fetch complete (57181 records). [2025-10-09T17:45:33.262421] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-09T17:45:33.263107] [FATAL] [VALIDATOR ] BRCC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:45:33.263197] [FATAL] [MAIN ] BRCC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:45:33.263241] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:45:33.263279] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-09T17:45:33.263334] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-09T17:45:33.263369] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-10-09T17:45:33.263554] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-10-09T17:45:33.264098] [INFO ] [MAIN ] Update Progress: 334/2373 symbols completed. BRCC took 24.0s. Estimated remaining: 4h 37m 44s. Rate: 7.3 symbols/min [2025-10-09T17:45:33.437930] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:33.447145] [DEBUG] [LOCAL ] BRT: Loaded 4995 existing records from primary storage. [2025-10-09T17:45:33.447372] [INFO ] [MAIN ] BRT: Loaded 4995 existing records. [2025-10-09T17:45:33.606897] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-09T17:45:33.627202] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:33.627409] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-09T17:45:33.627456] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-09T17:45:33.627588] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-09T17:45:33.627662] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-09T17:45:33.980919] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:34.063337] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:45:34.396726] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-09T17:45:35.092191] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T17:45:35.196707] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-09T17:45:35.228899] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T17:45:35.996757] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-09T17:45:36.497958] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T17:45:36.796727] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-09T17:45:37.596718] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-09T17:45:37.924549] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-09T17:45:38.216378] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T17:45:38.396783] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-09T17:45:38.474318] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T17:45:38.774916] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-09T17:45:39.196724] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-09T17:45:39.996719] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-09T17:45:40.629402] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T17:45:40.796704] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-09T17:45:41.596688] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-09T17:45:42.099568] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-09T17:45:42.192372] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T17:45:42.249710] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T17:45:42.396709] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-09T17:45:43.196784] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-09T17:45:43.916804] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T17:45:43.996682] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-09T17:45:44.796682] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-09T17:45:45.142717] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T17:45:45.300536] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:45:45.596692] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-09T17:45:45.610886] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:45:46.396722] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-09T17:45:46.951937] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T17:45:47.196702] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-09T17:45:47.592784] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T17:45:47.996715] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-09T17:45:48.796716] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-09T17:45:48.930699] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T17:45:49.132247] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T17:45:49.596714] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-09T17:45:49.658847] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:45:50.396719] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-09T17:45:51.179232] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T17:45:51.196675] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-09T17:45:51.996735] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-09T17:45:52.456878] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-09T17:45:52.492698] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:45:52.534276] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T17:45:52.796713] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-09T17:45:53.446493] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T17:45:53.596695] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-09T17:45:54.396726] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-09T17:45:55.196692] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-09T17:45:55.592379] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T17:45:55.758222] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T17:45:55.996754] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-09T17:45:56.338539] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T17:45:56.342586] [INFO ] [REMOTE ] BRO: Full fetch complete (74036 records). [2025-10-09T17:45:56.342735] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-09T17:45:56.343620] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:45:56.343739] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:45:56.343785] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:45:56.343854] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-09T17:45:56.343946] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-09T17:45:56.344006] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-10-09T17:45:56.344052] [DEBUG] [LOCAL ] BRO: No derivative data file found to delete. [2025-10-09T17:45:56.344126] [INFO ] [MAIN ] Update Progress: 335/2373 symbols completed. BRO took 34.6s. Estimated remaining: 4h 39m 7s. Rate: 7.3 symbols/min [2025-10-09T17:45:56.536471] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:56.557935] [DEBUG] [LOCAL ] BRW: Loaded 20738 existing records from primary storage. [2025-10-09T17:45:56.558216] [INFO ] [MAIN ] BRW: Loaded 20738 existing records. [2025-10-09T17:45:56.755731] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:56.755918] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-09T17:45:56.755966] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-09T17:45:56.756183] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-09T17:45:56.756243] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-09T17:45:56.803754] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-09T17:45:57.141771] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:57.596727] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-09T17:45:58.025420] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-09T17:45:58.249171] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T17:45:58.250312] [INFO ] [REMOTE ] BRT: Full fetch complete (6885 records). [2025-10-09T17:45:58.250381] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-09T17:45:58.383053] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T17:45:58.405678] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-09T17:45:58.639154] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-09T17:45:58.639255] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-09T17:45:58.639441] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-09T17:45:58.639483] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-09T17:45:58.639942] [DEBUG] [LOCAL ] BRT: Trimmed 6885 records to 5083 (keeping 200 days of data) [2025-10-09T17:45:58.672291] [DEBUG] [LOCAL ] BRT: Primary data saved (5083 records). [2025-10-09T17:45:58.672429] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-09T17:45:58.672529] [INFO ] [MAIN ] Update Progress: 336/2373 symbols completed. BRT took 25.4s. Estimated remaining: 4h 38m 23s. Rate: 7.3 symbols/min [2025-10-09T17:45:58.838756] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:58.888363] [DEBUG] [LOCAL ] BRX: Loaded 51779 existing records from primary storage. [2025-10-09T17:45:58.888748] [INFO ] [MAIN ] BRX: Loaded 51779 existing records. [2025-10-09T17:45:59.067012] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:59.067241] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-09T17:45:59.067291] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-09T17:45:59.067564] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-09T17:45:59.067625] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-09T17:45:59.205117] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-09T17:45:59.427728] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:59.728331] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T17:45:59.996792] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-09T17:46:00.243630] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T17:46:00.796776] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-09T17:46:01.596738] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-09T17:46:01.817554] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T17:46:02.396683] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-09T17:46:02.575784] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T17:46:03.122293] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T17:46:03.196725] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-09T17:46:03.962551] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T17:46:03.996701] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-09T17:46:04.750556] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-09T17:46:04.757122] [INFO ] [REMOTE ] BROS: Full fetch complete (77076 records). [2025-10-09T17:46:04.757305] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-09T17:46:04.801853] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-09T17:46:05.097581] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T17:46:05.186075] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-09T17:46:05.186157] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-09T17:46:05.186970] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-09T17:46:05.187036] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-09T17:46:05.188518] [DEBUG] [LOCAL ] BROS: Trimmed 77076 records to 53689 (keeping 200 days of data) [2025-10-09T17:46:05.511270] [DEBUG] [LOCAL ] BROS: Primary data saved (53689 records). [2025-10-09T17:46:05.511416] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-09T17:46:05.512242] [INFO ] [MAIN ] Update Progress: 337/2373 symbols completed. BROS took 39.3s. Estimated remaining: 4h 38m 7s. Rate: 7.3 symbols/min [2025-10-09T17:46:05.601798] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-09T17:46:05.681699] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:05.714344] [DEBUG] [LOCAL ] BSAC: Loaded 32782 existing records from primary storage. [2025-10-09T17:46:05.714621] [INFO ] [MAIN ] BSAC: Loaded 32782 existing records. [2025-10-09T17:46:05.896682] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:05.896998] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-09T17:46:05.897226] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-09T17:46:05.897581] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-09T17:46:05.906024] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-09T17:46:06.017114] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T17:46:06.356928] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:06.396796] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-09T17:46:07.196774] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-09T17:46:07.401279] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T17:46:07.589549] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T17:46:07.996741] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-09T17:46:08.495553] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:46:08.796755] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-09T17:46:08.933619] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T17:46:09.596788] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-09T17:46:09.791185] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T17:46:10.396766] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-09T17:46:11.011958] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:46:11.196685] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-09T17:46:11.619197] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:46:11.622535] [INFO ] [REMOTE ] BRSP: Full fetch complete (54258 records). [2025-10-09T17:46:11.622624] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-09T17:46:12.001264] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-09T17:46:12.037510] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-09T17:46:12.037612] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-09T17:46:12.038307] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-09T17:46:12.038370] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-09T17:46:12.039796] [DEBUG] [LOCAL ] BRSP: Trimmed 54258 records to 36934 (keeping 200 days of data) [2025-10-09T17:46:12.261623] [DEBUG] [LOCAL ] BRSP: Primary data saved (36934 records). [2025-10-09T17:46:12.261810] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-09T17:46:12.262735] [INFO ] [MAIN ] Update Progress: 338/2373 symbols completed. BRSP took 41.6s. Estimated remaining: 4h 37m 50s. Rate: 7.3 symbols/min [2025-10-09T17:46:12.482197] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:12.519624] [DEBUG] [LOCAL ] BSBR: Loaded 35362 existing records from primary storage. [2025-10-09T17:46:12.519974] [INFO ] [MAIN ] BSBR: Loaded 35362 existing records. [2025-10-09T17:46:12.745972] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:12.746315] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-09T17:46:12.746512] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-09T17:46:12.757720] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-09T17:46:12.779135] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-09T17:46:12.809929] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-09T17:46:12.838175] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:46:13.170856] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:13.266097] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T17:46:13.596725] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-09T17:46:14.079507] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T17:46:14.396761] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-09T17:46:15.009745] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T17:46:15.196730] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-09T17:46:15.762676] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-09T17:46:15.996708] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-09T17:46:16.148694] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T17:46:16.796725] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-09T17:46:16.983078] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T17:46:17.596808] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-09T17:46:18.233362] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T17:46:18.396687] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-09T17:46:18.488742] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-09T17:46:19.196711] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-09T17:46:19.956541] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T17:46:19.996673] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-09T17:46:20.589970] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T17:46:20.796725] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-09T17:46:21.331078] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T17:46:21.576996] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T17:46:21.596681] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-09T17:46:22.396690] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-09T17:46:22.773975] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T17:46:23.196733] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-09T17:46:23.774749] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:46:23.996726] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-09T17:46:24.433223] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:46:24.796758] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-09T17:46:25.317822] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T17:46:25.596709] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-09T17:46:25.751556] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:46:26.396730] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-09T17:46:26.811150] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T17:46:26.813977] [INFO ] [REMOTE ] BRW: Full fetch complete (30313 records). [2025-10-09T17:46:26.814068] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-09T17:46:26.814597] [FATAL] [VALIDATOR ] BRW: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:46:26.814712] [FATAL] [MAIN ] BRW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:46:26.814761] [WARN ] [MAIN ] BRW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:46:26.814831] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-09T17:46:26.814919] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-09T17:46:26.814979] [INFO ] [LOCAL ] BRW: Starting deletion of derivative data. [2025-10-09T17:46:26.815224] [DEBUG] [LOCAL ] BRW: Deleted derivative data file. [2025-10-09T17:46:26.815324] [INFO ] [MAIN ] Update Progress: 339/2373 symbols completed. BRW took 30.5s. Estimated remaining: 4h 38m 20s. Rate: 7.3 symbols/min [2025-10-09T17:46:26.991039] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:27.001449] [DEBUG] [LOCAL ] BSL: Loaded 8181 existing records from primary storage. [2025-10-09T17:46:27.001680] [INFO ] [MAIN ] BSL: Loaded 8181 existing records. [2025-10-09T17:46:27.175619] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:27.175841] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-09T17:46:27.175889] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-09T17:46:27.176083] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-09T17:46:27.176141] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-09T17:46:27.207251] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-09T17:46:27.537255] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:27.996694] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-09T17:46:28.105779] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T17:46:28.515845] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T17:46:28.796728] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-09T17:46:29.000570] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T17:46:29.596783] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-09T17:46:30.298834] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T17:46:30.396689] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-09T17:46:30.936228] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T17:46:31.196749] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-09T17:46:31.996708] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-09T17:46:32.052983] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:46:32.554160] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T17:46:32.796751] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-09T17:46:32.932105] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T17:46:32.934822] [INFO ] [REMOTE ] BSAC: Full fetch complete (43947 records). [2025-10-09T17:46:32.934906] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-09T17:46:32.935614] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:46:32.935733] [FATAL] [MAIN ] BSAC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:46:32.935806] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:46:32.935889] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-09T17:46:32.935972] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-09T17:46:32.936031] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-10-09T17:46:32.936196] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-10-09T17:46:32.936867] [INFO ] [MAIN ] Update Progress: 340/2373 symbols completed. BSAC took 27.4s. Estimated remaining: 4h 37m 59s. Rate: 7.3 symbols/min [2025-10-09T17:46:33.159914] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:33.199338] [DEBUG] [LOCAL ] BSM: Loaded 32179 existing records from primary storage. [2025-10-09T17:46:33.199631] [INFO ] [MAIN ] BSM: Loaded 32179 existing records. [2025-10-09T17:46:33.383799] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:33.384071] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-09T17:46:33.384130] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-09T17:46:33.384379] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-09T17:46:33.384442] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-09T17:46:33.607617] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-09T17:46:33.834887] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:34.185082] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T17:46:34.389689] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-09T17:46:34.396676] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-09T17:46:35.133368] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:46:35.196671] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-09T17:46:35.996732] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-09T17:46:36.058370] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T17:46:36.796744] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-09T17:46:37.281484] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T17:46:37.518412] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T17:46:37.596722] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-09T17:46:38.396784] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-09T17:46:38.659625] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T17:46:39.196719] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-09T17:46:39.996688] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-09T17:46:40.071469] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T17:46:40.395589] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T17:46:40.757302] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:46:40.796675] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-09T17:46:41.404145] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T17:46:41.596705] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-09T17:46:42.396771] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-09T17:46:42.617152] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T17:46:43.196708] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-09T17:46:43.283492] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T17:46:43.996734] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-09T17:46:44.760179] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T17:46:44.764599] [INFO ] [REMOTE ] BRX: Full fetch complete (74951 records). [2025-10-09T17:46:44.764759] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-09T17:46:44.801836] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-09T17:46:45.178615] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-09T17:46:45.178788] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-09T17:46:45.179578] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-09T17:46:45.179626] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-09T17:46:45.181082] [DEBUG] [LOCAL ] BRX: Trimmed 74951 records to 52155 (keeping 200 days of data) [2025-10-09T17:46:45.429818] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:46:45.561597] [DEBUG] [LOCAL ] BRX: Primary data saved (52155 records). [2025-10-09T17:46:45.561781] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-09T17:46:45.562676] [INFO ] [MAIN ] Update Progress: 341/2373 symbols completed. BRX took 46.9s. Estimated remaining: 4h 38m 17s. Rate: 7.3 symbols/min [2025-10-09T17:46:45.601777] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-09T17:46:45.775481] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:45.798502] [DEBUG] [LOCAL ] BST: Loaded 18984 existing records from primary storage. [2025-10-09T17:46:45.798806] [INFO ] [MAIN ] BST: Loaded 18984 existing records. [2025-10-09T17:46:46.016612] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:46.016875] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-09T17:46:46.016958] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-09T17:46:46.017213] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-09T17:46:46.017271] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-09T17:46:46.371124] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:46.396664] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-09T17:46:46.461936] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T17:46:47.011586] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T17:46:47.196683] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-09T17:46:47.528946] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:46:47.967877] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T17:46:47.996671] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-09T17:46:48.598436] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T17:46:48.796715] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-09T17:46:49.596685] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-09T17:46:49.838610] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T17:46:50.396728] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-09T17:46:50.823080] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T17:46:51.196700] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-09T17:46:51.501298] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T17:46:51.944151] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T17:46:51.996672] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-09T17:46:52.796724] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-09T17:46:52.841745] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T17:46:53.596758] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-09T17:46:54.198769] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:46:54.396730] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-09T17:46:54.486225] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:46:54.487558] [INFO ] [REMOTE ] BSL: Full fetch complete (12725 records). [2025-10-09T17:46:54.487630] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-09T17:46:54.859183] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-09T17:46:54.859273] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-09T17:46:54.859577] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-09T17:46:54.859618] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-09T17:46:54.860154] [DEBUG] [LOCAL ] BSL: Trimmed 12725 records to 8276 (keeping 200 days of data) [2025-10-09T17:46:54.911347] [DEBUG] [LOCAL ] BSL: Primary data saved (8276 records). [2025-10-09T17:46:54.911496] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-09T17:46:54.911588] [INFO ] [MAIN ] Update Progress: 342/2373 symbols completed. BSL took 28.1s. Estimated remaining: 4h 38m 16s. Rate: 7.3 symbols/min [2025-10-09T17:46:55.077530] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:55.100877] [DEBUG] [LOCAL ] BSTZ: Loaded 24965 existing records from primary storage. [2025-10-09T17:46:55.101125] [INFO ] [MAIN ] BSTZ: Loaded 24965 existing records. [2025-10-09T17:46:55.198202] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-09T17:46:55.280766] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:55.281137] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-09T17:46:55.281198] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-09T17:46:55.281441] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-09T17:46:55.281502] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-09T17:46:55.467594] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T17:46:55.655873] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:55.996768] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-09T17:46:56.317139] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T17:46:56.796791] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-09T17:46:57.213715] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T17:46:57.596748] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-09T17:46:57.803872] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:46:58.396780] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-09T17:46:58.834386] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:46:59.196809] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-09T17:46:59.362269] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T17:46:59.996687] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-09T17:47:00.320834] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T17:47:00.796730] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-09T17:47:01.355890] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:47:01.359032] [INFO ] [REMOTE ] BSBR: Full fetch complete (50573 records). [2025-10-09T17:47:01.359122] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-09T17:47:01.603203] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-09T17:47:01.743036] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-09T17:47:01.743116] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-09T17:47:01.743713] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-09T17:47:01.743775] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-09T17:47:01.744865] [DEBUG] [LOCAL ] BSBR: Trimmed 50573 records to 35593 (keeping 200 days of data) [2025-10-09T17:47:01.950389] [DEBUG] [LOCAL ] BSBR: Primary data saved (35593 records). [2025-10-09T17:47:01.950529] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-09T17:47:01.951577] [INFO ] [MAIN ] Update Progress: 343/2373 symbols completed. BSBR took 49.7s. Estimated remaining: 4h 38m 0s. Rate: 7.3 symbols/min [2025-10-09T17:47:02.133487] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:02.139306] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-09T17:47:02.139417] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-09T17:47:02.140556] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T17:47:02.140002] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-09T17:47:02.146561] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-09T17:47:02.146926] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-09T17:47:02.146971] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-09T17:47:02.401987] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-09T17:47:02.501117] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:03.035039] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:47:03.037558] [INFO ] [REMOTE ] BSM: Full fetch complete (46845 records). [2025-10-09T17:47:03.037676] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-09T17:47:03.038502] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:47:03.038605] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:47:03.038715] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:47:03.038814] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-09T17:47:03.038895] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-09T17:47:03.038935] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-09T17:47:03.039233] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-10-09T17:47:03.039534] [INFO ] [MAIN ] Update Progress: 344/2373 symbols completed. BSM took 30.1s. Estimated remaining: 4h 37m 10s. Rate: 7.3 symbols/min [2025-10-09T17:47:03.204224] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-09T17:47:03.206820] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:03.218402] [DEBUG] [LOCAL ] BTA: Loaded 5488 existing records from primary storage. [2025-10-09T17:47:03.218738] [INFO ] [MAIN ] BTA: Loaded 5488 existing records. [2025-10-09T17:47:03.401463] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:03.401772] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-09T17:47:03.401827] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-09T17:47:03.402007] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-09T17:47:03.402064] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-09T17:47:03.775149] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:03.785292] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:47:03.996689] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-09T17:47:04.535186] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:47:04.768899] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T17:47:04.796678] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-09T17:47:05.534746] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:47:05.596697] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-09T17:47:06.396717] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-09T17:47:07.196729] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-09T17:47:07.491629] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T17:47:07.528571] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:47:07.627955] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T17:47:07.996768] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-09T17:47:08.796745] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-09T17:47:08.862306] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:47:09.386145] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-09T17:47:09.596700] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-09T17:47:10.396764] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-09T17:47:10.881005] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T17:47:11.027786] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T17:47:11.196728] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-09T17:47:11.996737] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-09T17:47:12.451132] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T17:47:12.796716] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-09T17:47:13.596698] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-09T17:47:13.758318] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:47:13.779918] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T17:47:14.396761] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-09T17:47:14.613828] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T17:47:15.114626] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T17:47:15.196759] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-09T17:47:15.682036] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-09T17:47:15.996745] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-09T17:47:16.796772] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-09T17:47:17.176947] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T17:47:17.596745] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-09T17:47:17.847027] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T17:47:18.168073] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T17:47:18.396731] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-09T17:47:19.086501] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T17:47:19.196742] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-09T17:47:19.799100] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T17:47:19.996733] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-09T17:47:20.628534] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T17:47:20.796701] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-09T17:47:21.596693] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-09T17:47:21.620765] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T17:47:21.622582] [INFO ] [REMOTE ] BST: Full fetch complete (28668 records). [2025-10-09T17:47:21.622674] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-09T17:47:21.988460] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-09T17:47:21.988543] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-09T17:47:21.989012] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-09T17:47:21.989126] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-09T17:47:21.990141] [DEBUG] [LOCAL ] BST: Trimmed 28668 records to 19081 (keeping 200 days of data) [2025-10-09T17:47:22.108321] [DEBUG] [LOCAL ] BST: Primary data saved (19081 records). [2025-10-09T17:47:22.108480] [INFO ] [MAIN ] BST: Full history saved. [2025-10-09T17:47:22.108568] [INFO ] [MAIN ] Update Progress: 345/2373 symbols completed. BST took 36.5s. Estimated remaining: 4h 38m 6s. Rate: 7.3 symbols/min [2025-10-09T17:47:22.278357] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:22.295906] [DEBUG] [LOCAL ] BTCM: Loaded 16133 existing records from primary storage. [2025-10-09T17:47:22.296156] [INFO ] [MAIN ] BTCM: Loaded 16133 existing records. [2025-10-09T17:47:22.401913] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-09T17:47:22.477380] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:22.477735] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-09T17:47:22.477790] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-09T17:47:22.478002] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-09T17:47:22.478059] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-09T17:47:22.832775] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:22.897404] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T17:47:23.196723] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-09T17:47:23.996773] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-09T17:47:24.190275] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T17:47:24.441818] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T17:47:24.796687] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-09T17:47:24.895837] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T17:47:25.545520] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T17:47:25.546556] [INFO ] [REMOTE ] BTA: Full fetch complete (9513 records). [2025-10-09T17:47:25.546624] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-09T17:47:25.607033] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-09T17:47:25.904357] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-09T17:47:25.904435] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-09T17:47:25.904677] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-09T17:47:25.904738] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-09T17:47:25.905138] [DEBUG] [LOCAL ] BTA: Trimmed 9513 records to 5536 (keeping 200 days of data) [2025-10-09T17:47:25.937842] [DEBUG] [LOCAL ] BTA: Primary data saved (5536 records). [2025-10-09T17:47:25.937959] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-09T17:47:25.938051] [INFO ] [MAIN ] Update Progress: 346/2373 symbols completed. BTA took 22.9s. Estimated remaining: 4h 37m 32s. Rate: 7.3 symbols/min [2025-10-09T17:47:26.104148] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:26.157727] [DEBUG] [LOCAL ] BTE: Loaded 52713 existing records from primary storage. [2025-10-09T17:47:26.158061] [INFO ] [MAIN ] BTE: Loaded 52713 existing records. [2025-10-09T17:47:26.357792] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:26.358789] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T17:47:26.358900] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-09T17:47:26.361668] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-09T17:47:26.361900] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-09T17:47:26.361956] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-09T17:47:26.401955] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-09T17:47:26.722665] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:27.196723] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-09T17:47:27.655481] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T17:47:27.657975] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36637 records). [2025-10-09T17:47:27.658055] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-09T17:47:27.658621] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:47:27.658735] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:47:27.658804] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:47:27.658901] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-09T17:47:27.658972] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-09T17:47:27.659009] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-10-09T17:47:27.659200] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-10-09T17:47:27.659335] [INFO ] [MAIN ] Update Progress: 347/2373 symbols completed. BSTZ took 32.7s. Estimated remaining: 4h 36m 46s. Rate: 7.3 symbols/min [2025-10-09T17:47:27.832106] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:27.887339] [DEBUG] [LOCAL ] BTI: Loaded 53576 existing records from primary storage. [2025-10-09T17:47:27.887680] [INFO ] [MAIN ] BTI: Loaded 53576 existing records. [2025-10-09T17:47:28.001870] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-09T17:47:28.067312] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:28.067599] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-09T17:47:28.067710] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-09T17:47:28.067986] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-09T17:47:28.068043] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-09T17:47:28.419517] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:28.796704] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-09T17:47:29.130443] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:47:29.596709] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-09T17:47:30.075552] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-09T17:47:30.325741] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T17:47:30.396690] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-09T17:47:30.674563] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T17:47:31.196733] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-09T17:47:31.996711] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-09T17:47:32.144424] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T17:47:32.328789] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:47:32.608806] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T17:47:32.796781] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-09T17:47:33.490178] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T17:47:33.596697] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-09T17:47:34.396714] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-09T17:47:35.196699] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-09T17:47:35.467191] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:47:35.506014] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:47:35.912559] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T17:47:35.996687] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-09T17:47:36.683136] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T17:47:36.796723] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-09T17:47:37.596720] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-09T17:47:38.396687] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-09T17:47:38.613212] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T17:47:39.196713] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-09T17:47:39.492907] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T17:47:39.862517] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:47:39.996728] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-09T17:47:40.796721] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-09T17:47:41.102281] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T17:47:41.596707] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-09T17:47:41.840734] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T17:47:42.362528] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:47:42.396677] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-09T17:47:42.829242] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:47:43.196755] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-09T17:47:43.735744] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T17:47:43.996717] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-09T17:47:44.518401] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:47:44.796736] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-09T17:47:45.596736] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-09T17:47:45.712980] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T17:47:45.926798] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T17:47:45.929087] [INFO ] [REMOTE ] BTCM: Full fetch complete (19641 records). [2025-10-09T17:47:45.929166] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-09T17:47:46.315694] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-09T17:47:46.315792] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-09T17:47:46.316160] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-09T17:47:46.316202] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-09T17:47:46.316826] [DEBUG] [LOCAL ] BTCM: Trimmed 19641 records to 16265 (keeping 200 days of data) [2025-10-09T17:47:46.397217] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-09T17:47:46.408706] [DEBUG] [LOCAL ] BTCM: Primary data saved (16265 records). [2025-10-09T17:47:46.408807] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-09T17:47:46.408887] [INFO ] [MAIN ] Update Progress: 348/2373 symbols completed. BTCM took 24.3s. Estimated remaining: 4h 37m 39s. Rate: 7.3 symbols/min [2025-10-09T17:47:46.574081] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:46.584521] [DEBUG] [LOCAL ] BTO: Loaded 8691 existing records from primary storage. [2025-10-09T17:47:46.584920] [INFO ] [MAIN ] BTO: Loaded 8691 existing records. [2025-10-09T17:47:46.757058] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:46.757271] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-09T17:47:46.757318] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-09T17:47:46.757524] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-09T17:47:46.757581] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-09T17:47:47.168081] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:47.198366] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-09T17:47:47.201527] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T17:47:47.876287] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T17:47:47.903367] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T17:47:47.996720] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-09T17:47:48.794608] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T17:47:48.797092] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-09T17:47:49.596696] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-09T17:47:50.396700] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-09T17:47:50.554886] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T17:47:51.166585] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T17:47:51.196812] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-09T17:47:51.450414] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:47:51.996737] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-09T17:47:52.796686] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-09T17:47:52.810097] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:47:53.573513] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T17:47:53.596670] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-09T17:47:54.127218] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T17:47:54.380437] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T17:47:54.396679] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-09T17:47:55.147764] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:47:55.196761] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-09T17:47:55.996747] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-09T17:47:56.715071] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:47:56.719764] [INFO ] [REMOTE ] BSX: Full fetch complete (77699 records). [2025-10-09T17:47:56.719911] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-09T17:47:56.800801] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-09T17:47:57.149598] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-09T17:47:57.149888] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-09T17:47:57.150884] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-09T17:47:57.150969] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-09T17:47:57.181864] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T17:47:57.182024] [DEBUG] [LOCAL ] BSX: Trimmed 77699 records to 54078 (keeping 200 days of data) [2025-10-09T17:47:57.540150] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-10-09T17:47:57.540305] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-09T17:47:57.540382] [INFO ] [MAIN ] Update Progress: 349/2373 symbols completed. BSX took 55.6s. Estimated remaining: 4h 37m 47s. Rate: 7.3 symbols/min [2025-10-09T17:47:57.601852] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-09T17:47:57.714596] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:47:57.737950] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:57.738468] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-09T17:47:57.738526] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-09T17:47:57.738677] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-09T17:47:57.738733] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-09T17:47:57.738779] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-09T17:47:57.738813] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-09T17:47:58.121698] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:58.396770] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-09T17:47:58.896897] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T17:47:58.914393] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-09T17:47:59.196750] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-09T17:47:59.996722] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-09T17:48:00.796737] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-09T17:48:01.100708] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T17:48:01.493930] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T17:48:01.596718] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-09T17:48:01.670832] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T17:48:02.396723] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-09T17:48:03.208940] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-09T17:48:03.214637] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T17:48:03.772061] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T17:48:03.996730] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-09T17:48:04.796787] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-09T17:48:04.838685] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:48:04.842675] [INFO ] [REMOTE ] BTE: Full fetch complete (75746 records). [2025-10-09T17:48:04.842782] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-09T17:48:04.843539] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:48:04.843628] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:48:04.843716] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:48:04.843790] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-09T17:48:04.843853] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-09T17:48:04.843890] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-09T17:48:04.844073] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-09T17:48:04.844430] [INFO ] [MAIN ] Update Progress: 350/2373 symbols completed. BTE took 38.9s. Estimated remaining: 4h 37m 34s. Rate: 7.3 symbols/min [2025-10-09T17:48:04.958065] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T17:48:05.028058] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:05.028276] [DEBUG] [LOCAL ] BTU: No existing data file found in primary storage. [2025-10-09T17:48:05.028331] [WARN ] [MAIN ] BTU: No existing data found, performing full refresh instead. [2025-10-09T17:48:05.028452] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-09T17:48:05.028496] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-09T17:48:05.028538] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-09T17:48:05.028572] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-09T17:48:05.385108] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:05.596733] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-09T17:48:06.338285] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T17:48:06.339513] [INFO ] [REMOTE ] BTO: Full fetch complete (13121 records). [2025-10-09T17:48:06.339581] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-09T17:48:06.403429] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-09T17:48:06.718661] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-09T17:48:06.718844] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-09T17:48:06.719338] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-09T17:48:06.719449] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-09T17:48:06.732142] [DEBUG] [LOCAL ] BTO: Trimmed 13121 records to 8777 (keeping 200 days of data) [2025-10-09T17:48:06.778414] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T17:48:06.815488] [DEBUG] [LOCAL ] BTO: Primary data saved (8777 records). [2025-10-09T17:48:06.815603] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-09T17:48:06.815747] [INFO ] [MAIN ] Update Progress: 351/2373 symbols completed. BTO took 20.4s. Estimated remaining: 4h 36m 50s. Rate: 7.3 symbols/min [2025-10-09T17:48:06.987777] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:06.987976] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-09T17:48:06.988026] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-09T17:48:06.988161] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-09T17:48:06.988213] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-09T17:48:06.988286] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-09T17:48:06.988333] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-09T17:48:07.205181] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-09T17:48:07.362513] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:07.996684] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-09T17:48:08.200921] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:48:08.202791] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T17:48:08.214782] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-09T17:48:08.214973] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:48:08.215132] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-09T17:48:08.215200] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:48:08.215271] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-09T17:48:08.215349] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-09T17:48:08.215406] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-09T17:48:08.215451] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-09T17:48:08.215495] [INFO ] [MAIN ] Update Progress: 352/2373 symbols completed. BTX took 1.4s. Estimated remaining: 4h 36m 2s. Rate: 7.3 symbols/min [2025-10-09T17:48:08.378443] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:08.400447] [DEBUG] [LOCAL ] BTZ: Loaded 22689 existing records from primary storage. [2025-10-09T17:48:08.400717] [INFO ] [MAIN ] BTZ: Loaded 22689 existing records. [2025-10-09T17:48:08.572230] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:08.572461] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-09T17:48:08.572509] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-09T17:48:08.572743] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-09T17:48:08.572800] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-09T17:48:08.806449] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-09T17:48:08.943518] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:09.161372] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-09T17:48:09.596709] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-09T17:48:10.386862] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:48:10.397892] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-09T17:48:11.196694] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-09T17:48:11.403553] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:48:11.460882] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-09T17:48:11.465461] [INFO ] [REMOTE ] BTI: Full fetch complete (77467 records). [2025-10-09T17:48:11.465621] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-09T17:48:11.901415] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-09T17:48:11.901508] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-09T17:48:11.902321] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-09T17:48:11.902386] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-09T17:48:11.903974] [DEBUG] [LOCAL ] BTI: Trimmed 77467 records to 53966 (keeping 200 days of data) [2025-10-09T17:48:11.998202] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-09T17:48:12.245430] [DEBUG] [LOCAL ] BTI: Primary data saved (53966 records). [2025-10-09T17:48:12.245576] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-09T17:48:12.245713] [INFO ] [MAIN ] Update Progress: 353/2373 symbols completed. BTI took 44.6s. Estimated remaining: 4h 35m 30s. Rate: 7.3 symbols/min [2025-10-09T17:48:12.418008] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:12.466550] [DEBUG] [LOCAL ] BUD: Loaded 52698 existing records from primary storage. [2025-10-09T17:48:12.466919] [INFO ] [MAIN ] BUD: Loaded 52698 existing records. [2025-10-09T17:48:12.642158] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:12.642573] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-09T17:48:12.642665] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-09T17:48:12.643005] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-09T17:48:12.643062] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-09T17:48:12.813560] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-09T17:48:13.021264] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:13.052473] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T17:48:13.073016] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:48:13.596690] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-09T17:48:13.913537] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T17:48:14.396727] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-09T17:48:15.196759] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-09T17:48:15.344812] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:48:15.985602] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-09T17:48:15.998048] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-09T17:48:16.391864] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T17:48:16.796750] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-09T17:48:17.596805] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-09T17:48:17.632388] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T17:48:17.933811] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T17:48:18.396735] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-09T17:48:19.196743] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-09T17:48:19.550480] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T17:48:19.590050] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T17:48:19.996692] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-09T17:48:20.155968] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:48:20.796748] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-09T17:48:21.068379] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T17:48:21.596691] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-09T17:48:21.894933] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T17:48:22.396731] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-09T17:48:23.196758] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-09T17:48:23.521075] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T17:48:23.651814] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T17:48:23.996737] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-09T17:48:24.753083] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T17:48:24.796680] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-09T17:48:25.022679] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T17:48:25.596694] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-09T17:48:25.663956] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:48:26.396730] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-09T17:48:27.184777] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:48:27.196673] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-09T17:48:27.583428] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-09T17:48:27.996682] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-09T17:48:28.157181] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T17:48:28.796705] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-09T17:48:29.596744] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-09T17:48:29.799941] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:48:30.396691] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-09T17:48:30.644204] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T17:48:30.680287] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T17:48:31.196766] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-09T17:48:31.996682] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-09T17:48:32.238022] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T17:48:32.257105] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T17:48:32.796778] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-09T17:48:33.505128] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:48:33.596680] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-09T17:48:33.791970] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T17:48:33.794606] [INFO ] [REMOTE ] BTZ: Full fetch complete (33584 records). [2025-10-09T17:48:33.794713] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-09T17:48:34.166170] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-09T17:48:34.166261] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-09T17:48:34.166736] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-09T17:48:34.166799] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-09T17:48:34.167509] [DEBUG] [LOCAL ] BTZ: Trimmed 33584 records to 22883 (keeping 200 days of data) [2025-10-09T17:48:34.303725] [DEBUG] [LOCAL ] BTZ: Primary data saved (22883 records). [2025-10-09T17:48:34.303856] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-09T17:48:34.303947] [INFO ] [MAIN ] Update Progress: 354/2373 symbols completed. BTZ took 26.1s. Estimated remaining: 4h 36m 41s. Rate: 7.3 symbols/min [2025-10-09T17:48:34.402717] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-09T17:48:34.471811] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:34.485084] [DEBUG] [LOCAL ] BUI: Loaded 11839 existing records from primary storage. [2025-10-09T17:48:34.485284] [INFO ] [MAIN ] BUI: Loaded 11839 existing records. [2025-10-09T17:48:34.665378] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:34.665602] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-09T17:48:34.665678] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-09T17:48:34.665915] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-09T17:48:34.665976] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-09T17:48:35.015168] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:35.196696] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-09T17:48:35.496201] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T17:48:35.996688] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-09T17:48:36.133870] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:48:36.155378] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T17:48:36.796727] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-09T17:48:37.596748] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-09T17:48:37.967187] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T17:48:38.402831] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-09T17:48:38.406418] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:48:38.764297] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T17:48:39.042844] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T17:48:39.196714] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-09T17:48:39.996753] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-09T17:48:40.060150] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T17:48:40.796715] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-09T17:48:41.596722] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-09T17:48:41.653382] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T17:48:41.655183] [INFO ] [REMOTE ] BTT: Full fetch complete (23482 records). [2025-10-09T17:48:41.655338] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-09T17:48:42.059926] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-09T17:48:42.060226] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-09T17:48:42.060718] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-09T17:48:42.060829] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-09T17:48:42.071982] [DEBUG] [LOCAL ] BTT: Trimmed 23482 records to 15974 (keeping 200 days of data) [2025-10-09T17:48:42.093157] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T17:48:42.202411] [DEBUG] [LOCAL ] BTT: Primary data saved (15974 records). [2025-10-09T17:48:42.202589] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-09T17:48:42.202706] [INFO ] [MAIN ] Update Progress: 355/2373 symbols completed. BTT took 44.7s. Estimated remaining: 4h 36m 31s. Rate: 7.3 symbols/min [2025-10-09T17:48:42.380488] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:42.381209] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T17:48:42.404750] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-09T17:48:42.425468] [DEBUG] [LOCAL ] BUR: Loaded 45195 existing records from primary storage. [2025-10-09T17:48:42.425799] [INFO ] [MAIN ] BUR: Loaded 45195 existing records. [2025-10-09T17:48:42.611554] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:42.611814] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-09T17:48:42.611866] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-09T17:48:42.612111] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-09T17:48:42.612173] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-09T17:48:42.991728] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:43.196805] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-09T17:48:43.980094] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T17:48:43.996691] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-09T17:48:44.710112] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:48:44.796716] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-09T17:48:45.596700] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-09T17:48:45.877136] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T17:48:46.262888] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:48:46.298573] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T17:48:46.396711] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-09T17:48:47.196712] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-09T17:48:47.996685] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-09T17:48:48.068008] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T17:48:48.156893] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:48:48.160962] [INFO ] [REMOTE ] BTU: Full fetch complete (76652 records). [2025-10-09T17:48:48.161069] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-09T17:48:48.162079] [FATAL] [VALIDATOR ] BTU: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:48:48.162172] [FATAL] [MAIN ] BTU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:48:48.162216] [WARN ] [MAIN ] BTU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:48:48.162282] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-09T17:48:48.162347] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-09T17:48:48.162382] [INFO ] [LOCAL ] BTU: Starting deletion of derivative data. [2025-10-09T17:48:48.162421] [DEBUG] [LOCAL ] BTU: No derivative data file found to delete. [2025-10-09T17:48:48.162479] [INFO ] [MAIN ] Update Progress: 356/2373 symbols completed. BTU took 43.3s. Estimated remaining: 4h 36m 10s. Rate: 7.3 symbols/min [2025-10-09T17:48:48.330318] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:48.371457] [DEBUG] [LOCAL ] BURL: Loaded 45738 existing records from primary storage. [2025-10-09T17:48:48.371780] [INFO ] [MAIN ] BURL: Loaded 45738 existing records. [2025-10-09T17:48:48.573117] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:48.573323] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-09T17:48:48.573370] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-09T17:48:48.573608] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-09T17:48:48.573700] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-09T17:48:48.801931] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-09T17:48:48.950213] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:49.596738] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-09T17:48:49.797043] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:48:49.801578] [INFO ] [REMOTE ] BUD: Full fetch complete (76456 records). [2025-10-09T17:48:49.801712] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-09T17:48:50.195855] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-09T17:48:50.196108] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-09T17:48:50.197051] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-09T17:48:50.197164] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-09T17:48:50.198694] [DEBUG] [LOCAL ] BUD: Trimmed 76456 records to 53080 (keeping 200 days of data) [2025-10-09T17:48:50.312605] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T17:48:50.399452] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-09T17:48:50.550622] [DEBUG] [LOCAL ] BUD: Primary data saved (53080 records). [2025-10-09T17:48:50.550788] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-09T17:48:50.550893] [INFO ] [MAIN ] Update Progress: 357/2373 symbols completed. BUD took 38.3s. Estimated remaining: 4h 35m 29s. Rate: 7.3 symbols/min [2025-10-09T17:48:51.145990] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:48:51.196686] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-09T17:48:51.853022] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T17:48:51.996771] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-09T17:48:52.414003] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T17:48:52.802619] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-09T17:48:52.806546] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:48:53.596776] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-09T17:48:54.406424] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-09T17:48:54.409564] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T17:48:55.079859] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T17:48:55.196725] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-09T17:48:55.279725] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T17:48:55.996736] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-09T17:48:56.158814] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T17:48:56.796763] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-09T17:48:57.547894] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:48:57.596678] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-09T17:48:58.396836] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-09T17:48:58.487978] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T17:48:58.770625] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:48:59.048518] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T17:48:59.196762] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-09T17:48:59.996748] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-09T17:49:00.722213] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T17:49:00.796684] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-09T17:49:00.902341] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:49:01.596778] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-09T17:49:01.741782] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:49:01.744120] [INFO ] [REMOTE ] BUI: Full fetch complete (16484 records). [2025-10-09T17:49:01.744212] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-09T17:49:02.129234] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-09T17:49:02.129342] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-09T17:49:02.129689] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-09T17:49:02.129751] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-09T17:49:02.130271] [DEBUG] [LOCAL ] BUI: Trimmed 16484 records to 11912 (keeping 200 days of data) [2025-10-09T17:49:02.200424] [DEBUG] [LOCAL ] BUI: Primary data saved (11912 records). [2025-10-09T17:49:02.200556] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-09T17:49:02.200635] [INFO ] [MAIN ] Update Progress: 358/2373 symbols completed. BUI took 27.9s. Estimated remaining: 4h 35m 40s. Rate: 7.3 symbols/min [2025-10-09T17:49:02.396745] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-09T17:49:03.205415] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T17:49:03.215639] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-09T17:49:04.341344] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T17:49:04.351988] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-09T17:49:04.805924] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T17:49:04.815812] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-09T17:49:05.865952] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:49:05.875986] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-09T17:49:06.384956] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T17:49:06.388839] [INFO ] [REMOTE ] BUR: Full fetch complete (63655 records). [2025-10-09T17:49:06.388980] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-09T17:49:06.774853] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-09T17:49:06.774948] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-09T17:49:06.775750] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-09T17:49:06.775822] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-09T17:49:06.777244] [DEBUG] [LOCAL ] BUR: Trimmed 63655 records to 45527 (keeping 200 days of data) [2025-10-09T17:49:07.059765] [DEBUG] [LOCAL ] BUR: Primary data saved (45527 records). [2025-10-09T17:49:07.059903] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-09T17:49:07.060882] [INFO ] [MAIN ] Update Progress: 359/2373 symbols completed. BUR took 24.9s. Estimated remaining: 4h 35m 13s. Rate: 7.3 symbols/min [2025-10-09T17:49:07.449278] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:49:07.458862] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-09T17:49:09.067796] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:49:09.077867] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-09T17:49:10.673887] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:49:10.683506] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-09T17:49:12.259452] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T17:49:12.269275] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-09T17:49:13.959382] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T17:49:13.963176] [INFO ] [REMOTE ] BURL: Full fetch complete (65644 records). [2025-10-09T17:49:13.963311] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-09T17:49:14.353591] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-09T17:49:14.353766] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-09T17:49:14.354480] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-09T17:49:14.354525] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-09T17:49:14.355873] [DEBUG] [LOCAL ] BURL: Trimmed 65644 records to 46039 (keeping 200 days of data) [2025-10-09T17:49:14.634881] [DEBUG] [LOCAL ] BURL: Primary data saved (46039 records). [2025-10-09T17:49:14.635025] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-09T17:49:14.635545] [INFO ] [MAIN ] Update Progress: 360/2373 symbols completed. BURL took 26.5s. Estimated remaining: 4h 35m 1s. Rate: 7.3 symbols/min [2025-10-09T17:49:15.194132] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:15.337413] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:15.302590] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:15.340225] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:15.356105] [DEBUG] [LOCAL ] BUXX: Loaded 15250 existing records from primary storage. [2025-10-09T17:49:15.356678] [INFO ] [MAIN ] BUXX: Loaded 15250 existing records. [2025-10-09T17:49:15.591011] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:15.603155] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-09T17:49:15.603809] [DEBUG] [LOCAL ] BVN: Loaded 44059 existing records from primary storage. [2025-10-09T17:49:15.613909] [INFO ] [MAIN ] BVN: Loaded 44059 existing records. [2025-10-09T17:49:15.614051] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-09T17:49:15.621561] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-09T17:49:15.621514] [DEBUG] [LOCAL ] BV: Loaded 38524 existing records from primary storage. [2025-10-09T17:49:15.645230] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-09T17:49:15.666095] [INFO ] [MAIN ] BV: Loaded 38524 existing records. [2025-10-09T17:49:15.694875] [DEBUG] [LOCAL ] BW: Loaded 40183 existing records from primary storage. [2025-10-09T17:49:15.853322] [INFO ] [MAIN ] BW: Loaded 40183 existing records. [2025-10-09T17:49:16.205880] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:16.267249] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-09T17:49:16.328060] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-09T17:49:16.399676] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:16.430515] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-09T17:49:16.452883] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-09T17:49:16.463330] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-09T17:49:16.474316] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:16.552905] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-09T17:49:16.514557] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-09T17:49:16.577295] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-09T17:49:16.604260] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-09T17:49:16.634292] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:16.640078] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-09T17:49:16.640360] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-09T17:49:16.644092] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-09T17:49:16.672230] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-09T17:49:17.550199] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:17.577560] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-09T17:49:17.621821] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:17.694232] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T17:49:17.668164] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-09T17:49:17.699773] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:17.703332] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-09T17:49:17.703817] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-09T17:49:18.490873] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T17:49:18.493809] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-09T17:49:18.776264] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T17:49:18.783601] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-09T17:49:18.914244] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:49:18.923785] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-09T17:49:19.052489] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T17:49:19.055336] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-09T17:49:19.352832] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T17:49:19.362106] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-09T17:49:19.901255] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T17:49:19.904607] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-09T17:49:19.935353] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T17:49:19.941936] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-09T17:49:20.125269] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T17:49:20.133945] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-09T17:49:20.548831] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T17:49:20.557115] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-09T17:49:20.959063] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T17:49:20.963994] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-09T17:49:21.132413] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:49:21.406587] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T17:49:21.596776] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-09T17:49:21.978801] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T17:49:22.005288] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T17:49:22.396821] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-09T17:49:23.105607] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T17:49:23.196732] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-09T17:49:24.000524] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-09T17:49:24.005412] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:49:24.626005] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:49:24.708796] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T17:49:24.796689] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-09T17:49:25.596744] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-09T17:49:25.695534] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T17:49:26.396736] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-09T17:49:26.952705] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T17:49:27.196733] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-09T17:49:27.904260] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T17:49:27.996686] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-09T17:49:28.045086] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T17:49:28.796694] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-09T17:49:28.835374] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T17:49:29.596734] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-09T17:49:30.260339] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T17:49:30.396717] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-09T17:49:30.789521] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T17:49:31.196736] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-09T17:49:31.212824] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T17:49:31.214445] [INFO ] [REMOTE ] BUXX: Full fetch complete (20430 records). [2025-10-09T17:49:31.214521] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-09T17:49:31.573977] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-09T17:49:31.574058] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-09T17:49:31.574408] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-09T17:49:31.574447] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-09T17:49:31.575021] [DEBUG] [LOCAL ] BUXX: Trimmed 20430 records to 15346 (keeping 200 days of data) [2025-10-09T17:49:31.674039] [DEBUG] [LOCAL ] BUXX: Primary data saved (15346 records). [2025-10-09T17:49:31.674185] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-09T17:49:31.674294] [INFO ] [MAIN ] Update Progress: 361/2373 symbols completed. BUXX took 17.0s. Estimated remaining: 4h 35m 43s. Rate: 7.3 symbols/min [2025-10-09T17:49:31.845283] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:31.894667] [DEBUG] [LOCAL ] BWA: Loaded 52154 existing records from primary storage. [2025-10-09T17:49:31.894998] [INFO ] [MAIN ] BWA: Loaded 52154 existing records. [2025-10-09T17:49:32.001804] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-09T17:49:32.082131] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:32.082336] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-09T17:49:32.082409] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-09T17:49:32.082766] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-09T17:49:32.082827] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-09T17:49:32.448505] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:32.471590] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T17:49:32.796768] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-09T17:49:33.562756] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T17:49:33.596673] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-09T17:49:34.247891] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:49:34.396766] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-09T17:49:34.749893] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T17:49:35.196705] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-09T17:49:35.859845] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:49:35.996720] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-09T17:49:36.414197] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T17:49:36.796752] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-09T17:49:37.476486] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T17:49:37.596679] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-09T17:49:38.396687] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-09T17:49:38.538174] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:49:38.606674] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T17:49:39.196716] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-09T17:49:40.006995] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-09T17:49:40.012256] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T17:49:40.329892] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T17:49:40.333366] [INFO ] [REMOTE ] BV: Full fetch complete (54458 records). [2025-10-09T17:49:40.333471] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-09T17:49:40.704314] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-09T17:49:40.704396] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-09T17:49:40.705032] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-09T17:49:40.705096] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-09T17:49:40.706221] [DEBUG] [LOCAL ] BV: Trimmed 54458 records to 38789 (keeping 200 days of data) [2025-10-09T17:49:40.800300] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-09T17:49:40.939007] [DEBUG] [LOCAL ] BV: Primary data saved (38789 records). [2025-10-09T17:49:40.939164] [INFO ] [MAIN ] BV: Full history saved. [2025-10-09T17:49:40.940017] [INFO ] [MAIN ] Update Progress: 362/2373 symbols completed. BV took 26.3s. Estimated remaining: 4h 35m 40s. Rate: 7.3 symbols/min [2025-10-09T17:49:41.106414] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:41.122421] [DEBUG] [LOCAL ] BWG: Loaded 12634 existing records from primary storage. [2025-10-09T17:49:41.122677] [INFO ] [MAIN ] BWG: Loaded 12634 existing records. [2025-10-09T17:49:41.299944] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:41.300149] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-09T17:49:41.300198] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-09T17:49:41.300442] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-09T17:49:41.300503] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-09T17:49:41.598735] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-09T17:49:41.684095] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:41.714321] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T17:49:42.396676] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-09T17:49:42.783132] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T17:49:42.787282] [INFO ] [REMOTE ] BVN: Full fetch complete (62866 records). [2025-10-09T17:49:42.787411] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-09T17:49:43.179345] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-09T17:49:43.179582] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-09T17:49:43.180405] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-09T17:49:43.180481] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-09T17:49:43.181867] [DEBUG] [LOCAL ] BVN: Trimmed 62866 records to 44431 (keeping 200 days of data) [2025-10-09T17:49:43.234720] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-09T17:49:43.278280] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:49:43.304697] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:49:43.483097] [DEBUG] [LOCAL ] BVN: Primary data saved (44431 records). [2025-10-09T17:49:43.483233] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-09T17:49:43.484148] [INFO ] [MAIN ] Update Progress: 363/2373 symbols completed. BVN took 28.8s. Estimated remaining: 4h 35m 0s. Rate: 7.3 symbols/min [2025-10-09T17:49:43.649225] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:43.683092] [DEBUG] [LOCAL ] BWLP: Loaded 32306 existing records from primary storage. [2025-10-09T17:49:43.683353] [INFO ] [MAIN ] BWLP: Loaded 32306 existing records. [2025-10-09T17:49:43.857055] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:43.857257] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-09T17:49:43.857304] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-09T17:49:43.857561] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-09T17:49:43.857619] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-09T17:49:44.001867] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-09T17:49:44.215812] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:44.796680] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-09T17:49:44.848284] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T17:49:45.263929] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T17:49:45.596737] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-09T17:49:46.389964] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T17:49:46.398521] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-09T17:49:47.196699] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-09T17:49:47.327816] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T17:49:47.874436] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T17:49:47.996744] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-09T17:49:48.041018] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T17:49:48.796731] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-09T17:49:49.068197] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:49:49.596736] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-09T17:49:50.217433] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T17:49:50.396712] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-09T17:49:50.932579] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:49:51.196719] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-09T17:49:51.996729] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-09T17:49:52.034359] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T17:49:52.477357] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T17:49:52.560884] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T17:49:52.796789] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-09T17:49:53.596808] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-09T17:49:54.272010] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:49:54.396736] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-09T17:49:55.196773] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-09T17:49:55.259301] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:49:55.760350] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T17:49:55.996714] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-09T17:49:56.120469] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T17:49:56.796726] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-09T17:49:57.596772] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-09T17:49:57.653948] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:49:58.396733] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-09T17:49:58.565700] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T17:49:58.569751] [INFO ] [REMOTE ] BW: Full fetch complete (58906 records). [2025-10-09T17:49:58.569843] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-09T17:49:58.961456] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-09T17:49:58.961550] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-09T17:49:58.962283] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-09T17:49:58.962346] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-09T17:49:58.963773] [DEBUG] [LOCAL ] BW: Trimmed 58906 records to 40536 (keeping 200 days of data) [2025-10-09T17:49:59.197790] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-09T17:49:59.196605] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T17:49:59.239498] [DEBUG] [LOCAL ] BW: Primary data saved (40536 records). [2025-10-09T17:49:59.239621] [INFO ] [MAIN ] BW: Full history saved. [2025-10-09T17:49:59.239746] [INFO ] [MAIN ] Update Progress: 364/2373 symbols completed. BW took 44.6s. Estimated remaining: 4h 35m 34s. Rate: 7.3 symbols/min [2025-10-09T17:49:59.406463] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:59.415558] [DEBUG] [LOCAL ] BWMX: Loaded 7690 existing records from primary storage. [2025-10-09T17:49:59.415750] [INFO ] [MAIN ] BWMX: Loaded 7690 existing records. [2025-10-09T17:49:59.599007] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:59.599203] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-09T17:49:59.599249] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-09T17:49:59.599425] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-09T17:49:59.599482] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-09T17:49:59.972480] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:59.999875] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-09T17:50:00.005020] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:50:00.024298] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T17:50:00.796716] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-09T17:50:00.833268] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T17:50:01.596725] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-09T17:50:01.991294] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T17:50:02.396690] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-09T17:50:03.074406] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T17:50:03.196783] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-09T17:50:03.208086] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T17:50:03.996732] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-09T17:50:04.796713] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-09T17:50:04.943796] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T17:50:05.062327] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:50:05.423729] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T17:50:05.596702] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-09T17:50:06.396732] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-09T17:50:07.188900] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T17:50:07.199464] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-09T17:50:07.860672] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:50:07.996742] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-09T17:50:08.206473] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:50:08.796726] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-09T17:50:09.456974] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T17:50:09.461463] [INFO ] [REMOTE ] BWA: Full fetch complete (75698 records). [2025-10-09T17:50:09.461571] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-09T17:50:09.590537] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T17:50:09.600975] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-09T17:50:09.870008] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-09T17:50:09.870092] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-09T17:50:09.870895] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-09T17:50:09.870960] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-09T17:50:09.872357] [DEBUG] [LOCAL ] BWA: Trimmed 75698 records to 52541 (keeping 200 days of data) [2025-10-09T17:50:10.200050] [DEBUG] [LOCAL ] BWA: Primary data saved (52541 records). [2025-10-09T17:50:10.200223] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-09T17:50:10.200336] [INFO ] [MAIN ] Update Progress: 365/2373 symbols completed. BWA took 38.5s. Estimated remaining: 4h 35m 41s. Rate: 7.3 symbols/min [2025-10-09T17:50:10.309030] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T17:50:10.379828] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:10.386512] [DEBUG] [LOCAL ] BWNB: Loaded 4255 existing records from primary storage. [2025-10-09T17:50:10.386748] [INFO ] [MAIN ] BWNB: Loaded 4255 existing records. [2025-10-09T17:50:10.406481] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-09T17:50:10.563847] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:10.564031] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-09T17:50:10.564083] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-09T17:50:10.564258] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-09T17:50:10.564315] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-09T17:50:10.913394] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:11.196726] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-09T17:50:11.860350] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T17:50:11.998912] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-09T17:50:12.002934] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:50:12.664086] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:50:12.796734] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-09T17:50:13.253063] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T17:50:13.596713] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-09T17:50:14.366352] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T17:50:14.396760] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-09T17:50:15.196687] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-09T17:50:15.664539] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T17:50:15.692342] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T17:50:15.996758] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-09T17:50:16.796723] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-09T17:50:16.802497] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T17:50:16.803959] [INFO ] [REMOTE ] BWG: Full fetch complete (17767 records). [2025-10-09T17:50:16.804030] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-09T17:50:16.804498] [FATAL] [VALIDATOR ] BWG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:50:16.804580] [FATAL] [MAIN ] BWG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:50:16.804673] [WARN ] [MAIN ] BWG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:50:16.804748] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-09T17:50:16.804811] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-10-09T17:50:16.804858] [INFO ] [LOCAL ] BWG: Starting deletion of derivative data. [2025-10-09T17:50:16.805116] [DEBUG] [LOCAL ] BWG: Deleted derivative data file. [2025-10-09T17:50:16.805221] [INFO ] [MAIN ] Update Progress: 366/2373 symbols completed. BWG took 35.9s. Estimated remaining: 4h 35m 23s. Rate: 7.3 symbols/min [2025-10-09T17:50:16.983778] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:16.991588] [DEBUG] [LOCAL ] BWSN: Loaded 5147 existing records from primary storage. [2025-10-09T17:50:16.991818] [INFO ] [MAIN ] BWSN: Loaded 5147 existing records. [2025-10-09T17:50:17.168718] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:17.168934] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-09T17:50:17.168990] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-09T17:50:17.169160] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-09T17:50:17.169216] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-09T17:50:17.563501] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:17.570726] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T17:50:17.596712] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-09T17:50:18.103808] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T17:50:18.396735] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-09T17:50:18.967681] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T17:50:19.196733] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-09T17:50:19.996684] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-09T17:50:20.219731] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T17:50:20.796779] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-09T17:50:21.319739] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-09T17:50:21.333141] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:50:21.336377] [INFO ] [REMOTE ] BWLP: Full fetch complete (48058 records). [2025-10-09T17:50:21.336461] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-09T17:50:21.601924] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-09T17:50:21.734543] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-09T17:50:21.734626] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-09T17:50:21.735399] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-09T17:50:21.735466] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-09T17:50:21.736488] [DEBUG] [LOCAL ] BWLP: Trimmed 48058 records to 32641 (keeping 200 days of data) [2025-10-09T17:50:21.935509] [DEBUG] [LOCAL ] BWLP: Primary data saved (32641 records). [2025-10-09T17:50:21.935692] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-09T17:50:21.936733] [INFO ] [MAIN ] Update Progress: 367/2373 symbols completed. BWLP took 38.5s. Estimated remaining: 4h 34m 58s. Rate: 7.3 symbols/min [2025-10-09T17:50:22.109227] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:22.162488] [DEBUG] [LOCAL ] BWXT: Loaded 46822 existing records from primary storage. [2025-10-09T17:50:22.162806] [INFO ] [MAIN ] BWXT: Loaded 46822 existing records. [2025-10-09T17:50:22.343367] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:22.343595] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-09T17:50:22.343677] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-09T17:50:22.344930] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-09T17:50:22.344991] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-09T17:50:22.401852] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-09T17:50:22.512825] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T17:50:22.730090] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:23.196683] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-09T17:50:23.321042] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T17:50:23.996745] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-09T17:50:24.049502] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T17:50:24.796765] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-09T17:50:25.214076] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T17:50:25.596735] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-09T17:50:25.738980] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:50:25.991582] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T17:50:26.396716] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-09T17:50:27.196771] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-09T17:50:27.636760] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T17:50:27.996689] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-09T17:50:28.109176] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T17:50:28.393365] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T17:50:28.796719] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-09T17:50:29.412543] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T17:50:29.413839] [INFO ] [REMOTE ] BWMX: Full fetch complete (10099 records). [2025-10-09T17:50:29.413912] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-09T17:50:29.601923] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-09T17:50:29.777412] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-09T17:50:29.777491] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-09T17:50:29.777751] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-09T17:50:29.777812] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-09T17:50:29.778277] [DEBUG] [LOCAL ] BWMX: Trimmed 10099 records to 7763 (keeping 200 days of data) [2025-10-09T17:50:29.825381] [DEBUG] [LOCAL ] BWMX: Primary data saved (7763 records). [2025-10-09T17:50:29.825509] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-09T17:50:29.825591] [INFO ] [MAIN ] Update Progress: 368/2373 symbols completed. BWMX took 30.6s. Estimated remaining: 4h 34m 48s. Rate: 7.3 symbols/min [2025-10-09T17:50:29.990204] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:30.041878] [DEBUG] [LOCAL ] BX: Loaded 53479 existing records from primary storage. [2025-10-09T17:50:30.042217] [INFO ] [MAIN ] BX: Loaded 53479 existing records. [2025-10-09T17:50:30.212927] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:30.213155] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-09T17:50:30.213201] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-09T17:50:30.214022] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-09T17:50:30.214081] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-09T17:50:30.404534] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-09T17:50:30.567518] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:31.032040] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T17:50:31.093366] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T17:50:31.196706] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-09T17:50:31.650005] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T17:50:31.996732] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-09T17:50:32.400083] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-09T17:50:32.796745] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-09T17:50:33.529787] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T17:50:33.596712] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-09T17:50:34.268352] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T17:50:34.396725] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-09T17:50:35.175217] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T17:50:35.196672] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-09T17:50:35.840093] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T17:50:35.996753] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-09T17:50:36.796805] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-09T17:50:37.596700] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-09T17:50:37.950681] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T17:50:38.037771] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T17:50:38.396706] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-09T17:50:38.470795] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:50:39.196757] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-09T17:50:39.996679] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-09T17:50:40.091122] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T17:50:40.524491] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T17:50:40.525511] [INFO ] [REMOTE ] BWNB: Full fetch complete (5664 records). [2025-10-09T17:50:40.525704] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-09T17:50:40.798242] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-09T17:50:40.923344] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-09T17:50:40.917095] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T17:50:40.923497] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-09T17:50:40.932544] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-09T17:50:40.932727] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-09T17:50:40.933515] [DEBUG] [LOCAL ] BWNB: Trimmed 5664 records to 4267 (keeping 200 days of data) [2025-10-09T17:50:40.960309] [DEBUG] [LOCAL ] BWNB: Primary data saved (4267 records). [2025-10-09T17:50:40.960412] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-09T17:50:40.960494] [INFO ] [MAIN ] Update Progress: 369/2373 symbols completed. BWNB took 30.8s. Estimated remaining: 4h 34m 56s. Rate: 7.3 symbols/min [2025-10-09T17:50:41.125240] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:41.139479] [DEBUG] [LOCAL ] BXC: Loaded 13686 existing records from primary storage. [2025-10-09T17:50:41.139735] [INFO ] [MAIN ] BXC: Loaded 13686 existing records. [2025-10-09T17:50:41.295443] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T17:50:41.333958] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:41.334191] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-09T17:50:41.334262] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-09T17:50:41.334832] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-09T17:50:41.334892] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-09T17:50:41.603114] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-09T17:50:41.685624] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:42.396721] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-09T17:50:42.861589] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T17:50:43.196694] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-09T17:50:43.271557] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T17:50:43.775536] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T17:50:43.776532] [INFO ] [REMOTE ] BWSN: Full fetch complete (6242 records). [2025-10-09T17:50:43.776600] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-09T17:50:44.001855] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-09T17:50:44.138674] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-09T17:50:44.138764] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-09T17:50:44.138941] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-09T17:50:44.138979] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-09T17:50:44.139349] [DEBUG] [LOCAL ] BWSN: Trimmed 6242 records to 5154 (keeping 200 days of data) [2025-10-09T17:50:44.170854] [DEBUG] [LOCAL ] BWSN: Primary data saved (5154 records). [2025-10-09T17:50:44.170964] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-09T17:50:44.171081] [INFO ] [MAIN ] Update Progress: 370/2373 symbols completed. BWSN took 27.4s. Estimated remaining: 4h 34m 20s. Rate: 7.3 symbols/min [2025-10-09T17:50:44.337684] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:44.383427] [DEBUG] [LOCAL ] BXMT: Loaded 47172 existing records from primary storage. [2025-10-09T17:50:44.383767] [INFO ] [MAIN ] BXMT: Loaded 47172 existing records. [2025-10-09T17:50:44.582058] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:44.582343] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-09T17:50:44.582398] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-09T17:50:44.583793] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-09T17:50:44.583857] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-09T17:50:44.801838] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-09T17:50:44.946336] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:45.596797] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-09T17:50:45.817933] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T17:50:46.396759] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-09T17:50:46.427148] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T17:50:46.677748] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T17:50:47.196778] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-09T17:50:47.949683] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T17:50:47.996744] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-09T17:50:48.202578] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T17:50:48.450405] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T17:50:48.796716] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-09T17:50:49.596715] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-09T17:50:50.396774] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-09T17:50:50.509412] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T17:50:50.919630] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-09T17:50:51.196747] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-09T17:50:51.996741] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-09T17:50:52.144226] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T17:50:52.796698] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-09T17:50:52.978834] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T17:50:53.521603] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T17:50:53.596736] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-09T17:50:54.396727] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-09T17:50:54.773534] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T17:50:55.101202] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T17:50:55.196738] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-09T17:50:55.867663] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:50:55.996711] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-09T17:50:56.422495] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T17:50:56.796744] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-09T17:50:57.596730] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-09T17:50:57.992975] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T17:50:58.176400] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T17:50:58.396837] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-09T17:50:59.023418] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:50:59.196750] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-09T17:50:59.996692] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-09T17:51:00.112502] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T17:51:00.399857] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T17:51:00.796733] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-09T17:51:01.515389] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T17:51:01.596702] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-09T17:51:02.396719] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-09T17:51:02.796717] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-09T17:51:03.197695] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-09T17:51:03.210614] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T17:51:03.296397] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T17:51:03.996777] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-09T17:51:04.796741] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-09T17:51:05.233669] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-09T17:51:05.238151] [INFO ] [REMOTE ] BWXT: Full fetch complete (67605 records). [2025-10-09T17:51:05.238274] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-09T17:51:05.598825] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-09T17:51:05.705097] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-09T17:51:05.705188] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-09T17:51:05.706006] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-09T17:51:05.706071] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-09T17:51:05.707423] [DEBUG] [LOCAL ] BWXT: Trimmed 67605 records to 47178 (keeping 200 days of data) [2025-10-09T17:51:05.845892] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T17:51:05.852293] [INFO ] [REMOTE ] BX: Full fetch complete (77406 records). [2025-10-09T17:51:05.852987] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-09T17:51:06.381858] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-09T17:51:06.383777] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-09T17:51:06.385094] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-09T17:51:06.385467] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-09T17:51:06.390130] [DEBUG] [LOCAL ] BX: Trimmed 77406 records to 53869 (keeping 200 days of data) [2025-10-09T17:51:06.514156] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:51:06.528801] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-09T17:51:06.596787] [DEBUG] [LOCAL ] BWXT: Primary data saved (47178 records). [2025-10-09T17:51:06.597397] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-09T17:51:06.598790] [INFO ] [MAIN ] Update Progress: 371/2373 symbols completed. BWXT took 44.7s. Estimated remaining: 4h 35m 29s. Rate: 7.3 symbols/min [2025-10-09T17:51:06.760117] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T17:51:06.801918] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:06.931174] [DEBUG] [LOCAL ] BXMX: Loaded 19532 existing records from primary storage. [2025-10-09T17:51:06.933710] [INFO ] [MAIN ] BXMX: Loaded 19532 existing records. [2025-10-09T17:51:07.198262] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-09T17:51:07.198169] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:07.200826] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-09T17:51:07.201428] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-09T17:51:07.203266] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-09T17:51:07.204373] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-09T17:51:07.559260] [DEBUG] [LOCAL ] BX: Primary data saved (53869 records). [2025-10-09T17:51:07.567850] [INFO ] [MAIN ] BX: Full history saved. [2025-10-09T17:51:07.589554] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:07.585972] [INFO ] [MAIN ] Update Progress: 372/2373 symbols completed. BX took 37.8s. Estimated remaining: 4h 34m 42s. Rate: 7.3 symbols/min [2025-10-09T17:51:07.777838] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:07.830004] [DEBUG] [LOCAL ] BXP: Loaded 49803 existing records from primary storage. [2025-10-09T17:51:07.830375] [INFO ] [MAIN ] BXP: Loaded 49803 existing records. [2025-10-09T17:51:07.998559] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-09T17:51:08.022356] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:08.022960] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-09T17:51:08.023019] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-09T17:51:08.024515] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-09T17:51:08.024579] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-09T17:51:08.339921] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T17:51:08.468187] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T17:51:08.501913] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:08.796675] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-09T17:51:08.876082] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:51:09.596705] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-09T17:51:10.263819] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T17:51:10.396749] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-09T17:51:10.490932] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T17:51:11.196761] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-09T17:51:11.453769] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:51:11.996737] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-09T17:51:12.629683] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:51:12.796704] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-09T17:51:12.817024] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T17:51:12.819003] [INFO ] [REMOTE ] BXC: Full fetch complete (18132 records). [2025-10-09T17:51:12.819087] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-09T17:51:13.205619] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-09T17:51:13.205728] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-09T17:51:13.206105] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-09T17:51:13.206145] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-09T17:51:13.206722] [DEBUG] [LOCAL ] BXC: Trimmed 18132 records to 13770 (keeping 200 days of data) [2025-10-09T17:51:13.287381] [DEBUG] [LOCAL ] BXC: Primary data saved (13770 records). [2025-10-09T17:51:13.287524] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-09T17:51:13.287609] [INFO ] [MAIN ] Update Progress: 373/2373 symbols completed. BXC took 32.3s. Estimated remaining: 4h 34m 20s. Rate: 7.3 symbols/min [2025-10-09T17:51:13.456151] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:13.504160] [DEBUG] [LOCAL ] BXSL: Loaded 47831 existing records from primary storage. [2025-10-09T17:51:13.504535] [INFO ] [MAIN ] BXSL: Loaded 47831 existing records. [2025-10-09T17:51:13.604231] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-09T17:51:13.647565] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T17:51:13.710581] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:13.710799] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-09T17:51:13.710869] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-09T17:51:13.711637] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-09T17:51:13.711731] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-09T17:51:14.055261] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:14.396715] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-09T17:51:15.196703] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-09T17:51:15.272086] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:51:15.996724] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-09T17:51:16.324990] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:51:16.764392] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T17:51:16.796714] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-09T17:51:16.949824] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T17:51:17.561702] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:51:17.596678] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-09T17:51:18.396717] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-09T17:51:18.771745] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T17:51:19.196719] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-09T17:51:19.636536] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:51:19.996739] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-09T17:51:20.730983] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:51:20.796716] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-09T17:51:21.596685] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-09T17:51:21.664813] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T17:51:22.199264] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T17:51:22.396692] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-09T17:51:22.469870] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:51:23.196746] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-09T17:51:23.591161] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:51:23.996734] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-09T17:51:24.597425] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:51:24.796718] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-09T17:51:25.463348] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:51:25.467486] [INFO ] [REMOTE ] BXMT: Full fetch complete (69717 records). [2025-10-09T17:51:25.467576] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-09T17:51:25.605749] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-09T17:51:25.861419] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-09T17:51:25.861553] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-09T17:51:25.862384] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-09T17:51:25.862450] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-09T17:51:25.863916] [DEBUG] [LOCAL ] BXMT: Trimmed 69717 records to 47558 (keeping 200 days of data) [2025-10-09T17:51:26.170208] [DEBUG] [LOCAL ] BXMT: Primary data saved (47558 records). [2025-10-09T17:51:26.170474] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-09T17:51:26.171253] [INFO ] [MAIN ] Update Progress: 374/2373 symbols completed. BXMT took 42.0s. Estimated remaining: 4h 34m 36s. Rate: 7.3 symbols/min [2025-10-09T17:51:26.371412] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:26.374802] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T17:51:26.397961] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-09T17:51:26.400170] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:51:26.421130] [DEBUG] [LOCAL ] BY: Loaded 21660 existing records from primary storage. [2025-10-09T17:51:26.421382] [INFO ] [MAIN ] BY: Loaded 21660 existing records. [2025-10-09T17:51:26.593897] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:26.594154] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-09T17:51:26.594201] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-09T17:51:26.594451] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-09T17:51:26.594508] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-09T17:51:26.945422] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:27.196719] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-09T17:51:27.900272] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:51:27.922619] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T17:51:27.996667] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-09T17:51:28.796759] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-09T17:51:28.906129] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T17:51:29.464886] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T17:51:29.596704] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-09T17:51:30.396738] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-09T17:51:30.524600] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T17:51:31.196764] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-09T17:51:31.996751] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-09T17:51:32.081863] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:51:32.084342] [INFO ] [REMOTE ] BXMX: Full fetch complete (28775 records). [2025-10-09T17:51:32.084445] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-09T17:51:32.220054] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:51:32.500722] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-09T17:51:32.500808] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-09T17:51:32.501237] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-09T17:51:32.501277] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-09T17:51:32.502803] [DEBUG] [LOCAL ] BXMX: Trimmed 28775 records to 19639 (keeping 200 days of data) [2025-10-09T17:51:32.626373] [DEBUG] [LOCAL ] BXMX: Primary data saved (19639 records). [2025-10-09T17:51:32.626519] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-09T17:51:32.626601] [INFO ] [MAIN ] Update Progress: 375/2373 symbols completed. BXMX took 26.0s. Estimated remaining: 4h 34m 19s. Rate: 7.3 symbols/min [2025-10-09T17:51:32.793255] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:32.793418] [DEBUG] [LOCAL ] BYD: No existing data file found in primary storage. [2025-10-09T17:51:32.793500] [WARN ] [MAIN ] BYD: No existing data found, performing full refresh instead. [2025-10-09T17:51:32.793628] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-09T17:51:32.793706] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-09T17:51:32.793759] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-09T17:51:32.793792] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-09T17:51:32.804716] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-09T17:51:33.167236] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:33.181271] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T17:51:33.596701] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-09T17:51:34.184846] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:51:34.396786] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-09T17:51:35.201783] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-09T17:51:35.207165] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T17:51:35.619101] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T17:51:35.996728] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-09T17:51:36.546448] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T17:51:36.796793] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-09T17:51:37.068392] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T17:51:37.596777] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-09T17:51:37.796639] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T17:51:38.396725] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-09T17:51:39.196728] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-09T17:51:39.602227] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T17:51:39.996691] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-09T17:51:40.132120] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:51:40.299971] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T17:51:40.796718] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-09T17:51:41.399501] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:51:41.596716] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-09T17:51:42.251163] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T17:51:42.396695] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-09T17:51:43.169691] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:51:43.196681] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-09T17:51:43.696849] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:51:43.996730] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-09T17:51:44.796688] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-09T17:51:44.988593] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:51:45.596705] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-09T17:51:45.821582] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T17:51:45.860004] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T17:51:46.396798] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-09T17:51:47.136503] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:51:47.140435] [INFO ] [REMOTE ] BXP: Full fetch complete (71408 records). [2025-10-09T17:51:47.140571] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-09T17:51:47.141451] [FATAL] [VALIDATOR ] BXP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:51:47.141558] [FATAL] [MAIN ] BXP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:51:47.141604] [WARN ] [MAIN ] BXP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:51:47.141707] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-09T17:51:47.141804] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-09T17:51:47.141877] [INFO ] [LOCAL ] BXP: Starting deletion of derivative data. [2025-10-09T17:51:47.142395] [DEBUG] [LOCAL ] BXP: Deleted derivative data file. [2025-10-09T17:51:47.142810] [INFO ] [MAIN ] Update Progress: 376/2373 symbols completed. BXP took 39.6s. Estimated remaining: 4h 34m 44s. Rate: 7.3 symbols/min [2025-10-09T17:51:47.199694] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-09T17:51:47.322560] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:47.336904] [DEBUG] [LOCAL ] BYM: Loaded 11961 existing records from primary storage. [2025-10-09T17:51:47.337144] [INFO ] [MAIN ] BYM: Loaded 11961 existing records. [2025-10-09T17:51:47.519616] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:47.519903] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-09T17:51:47.520084] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-09T17:51:47.525877] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-09T17:51:47.534241] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-09T17:51:47.567719] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:51:47.891811] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:47.996669] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-09T17:51:48.796684] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-09T17:51:48.835404] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T17:51:49.077072] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T17:51:49.596693] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-09T17:51:49.655605] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T17:51:50.396718] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-09T17:51:50.512504] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:51:51.196715] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-09T17:51:51.921839] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T17:51:51.996702] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-09T17:51:52.274599] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T17:51:52.279026] [INFO ] [REMOTE ] BXSL: Full fetch complete (69621 records). [2025-10-09T17:51:52.279134] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-09T17:51:52.663491] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-09T17:51:52.663586] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-09T17:51:52.664394] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-09T17:51:52.664454] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-09T17:51:52.665810] [DEBUG] [LOCAL ] BXSL: Trimmed 69621 records to 48220 (keeping 200 days of data) [2025-10-09T17:51:52.843144] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-09T17:51:52.968773] [DEBUG] [LOCAL ] BXSL: Primary data saved (48220 records). [2025-10-09T17:51:52.968924] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-09T17:51:52.969035] [INFO ] [MAIN ] Update Progress: 377/2373 symbols completed. BXSL took 39.7s. Estimated remaining: 4h 34m 23s. Rate: 7.3 symbols/min [2025-10-09T17:51:53.139328] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:53.173376] [DEBUG] [LOCAL ] BZH: Loaded 32393 existing records from primary storage. [2025-10-09T17:51:53.173686] [INFO ] [MAIN ] BZH: Loaded 32393 existing records. [2025-10-09T17:51:53.363548] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:53.363823] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-09T17:51:53.363871] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-09T17:51:53.364835] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-09T17:51:53.364894] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-09T17:51:53.609452] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-09T17:51:53.727696] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:53.751980] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T17:51:53.870990] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T17:51:54.396726] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-09T17:51:54.688172] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T17:51:55.196727] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-09T17:51:55.325465] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T17:51:55.996771] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-09T17:51:56.438280] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T17:51:56.796733] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-09T17:51:57.286465] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T17:51:57.596711] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-09T17:51:57.898937] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T17:51:58.219430] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T17:51:58.396771] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-09T17:51:59.196695] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-09T17:51:59.267037] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T17:51:59.269329] [INFO ] [REMOTE ] BY: Full fetch complete (29577 records). [2025-10-09T17:51:59.269426] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-09T17:51:59.712355] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-09T17:51:59.712467] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-09T17:51:59.713011] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-09T17:51:59.713093] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-09T17:51:59.714081] [DEBUG] [LOCAL ] BY: Trimmed 29577 records to 21764 (keeping 200 days of data) [2025-10-09T17:51:59.869276] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T17:51:59.873512] [DEBUG] [LOCAL ] BY: Primary data saved (21764 records). [2025-10-09T17:51:59.873964] [INFO ] [MAIN ] BY: Full history saved. [2025-10-09T17:51:59.874392] [INFO ] [MAIN ] Update Progress: 378/2373 symbols completed. BY took 33.7s. Estimated remaining: 4h 34m 7s. Rate: 7.3 symbols/min [2025-10-09T17:52:00.001987] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-09T17:52:00.046386] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:00.095527] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-09T17:52:00.095872] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-09T17:52:00.268318] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:00.268556] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-09T17:52:00.268606] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-09T17:52:00.270262] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-09T17:52:00.270367] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-09T17:52:00.632320] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:00.796735] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-09T17:52:01.523052] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T17:52:01.596738] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-09T17:52:02.396772] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-09T17:52:02.790424] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T17:52:03.069277] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T17:52:03.196702] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-09T17:52:03.693320] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:52:03.996708] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-09T17:52:04.661713] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:52:04.796691] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-09T17:52:05.416136] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:52:05.596695] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-09T17:52:06.142474] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T17:52:06.375103] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:52:06.396672] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-09T17:52:07.196718] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-09T17:52:07.996699] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-09T17:52:08.127169] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:52:08.699938] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T17:52:08.796741] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-09T17:52:09.503549] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:52:09.596774] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-09T17:52:10.396686] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-09T17:52:10.484422] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T17:52:10.672624] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T17:52:11.196719] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-09T17:52:11.982924] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T17:52:11.996670] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-09T17:52:12.796725] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-09T17:52:13.108504] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T17:52:13.600228] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-09T17:52:13.601849] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:52:13.633538] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T17:52:13.637354] [INFO ] [REMOTE ] BYD: Full fetch complete (65126 records). [2025-10-09T17:52:13.637453] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-09T17:52:14.053946] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-09T17:52:14.054042] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-09T17:52:14.054771] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-09T17:52:14.054834] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-09T17:52:14.056090] [DEBUG] [LOCAL ] BYD: Trimmed 65126 records to 45181 (keeping 200 days of data) [2025-10-09T17:52:14.345875] [DEBUG] [LOCAL ] BYD: Primary data saved (45181 records). [2025-10-09T17:52:14.346008] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-09T17:52:14.346080] [INFO ] [MAIN ] Update Progress: 379/2373 symbols completed. BYD took 41.7s. Estimated remaining: 4h 34m 32s. Rate: 7.3 symbols/min [2025-10-09T17:52:14.402710] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-09T17:52:14.521383] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:14.540183] [DEBUG] [LOCAL ] CAAP: Loaded 19804 existing records from primary storage. [2025-10-09T17:52:14.540420] [INFO ] [MAIN ] CAAP: Loaded 19804 existing records. [2025-10-09T17:52:14.721090] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:14.721294] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-09T17:52:14.721341] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-09T17:52:14.722212] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-09T17:52:14.722270] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-09T17:52:15.076367] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:15.196732] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-09T17:52:15.315395] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:52:15.332037] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T17:52:15.333554] [INFO ] [REMOTE ] BYM: Full fetch complete (17915 records). [2025-10-09T17:52:15.333629] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-09T17:52:15.708529] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-09T17:52:15.708612] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-09T17:52:15.708973] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-09T17:52:15.709037] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-09T17:52:15.709623] [DEBUG] [LOCAL ] BYM: Trimmed 17915 records to 12051 (keeping 200 days of data) [2025-10-09T17:52:15.784923] [DEBUG] [LOCAL ] BYM: Primary data saved (12051 records). [2025-10-09T17:52:15.785092] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-09T17:52:15.785184] [INFO ] [MAIN ] Update Progress: 380/2373 symbols completed. BYM took 28.6s. Estimated remaining: 4h 33m 48s. Rate: 7.3 symbols/min [2025-10-09T17:52:15.967697] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:15.985481] [DEBUG] [LOCAL ] CABO: Loaded 16872 existing records from primary storage. [2025-10-09T17:52:15.985761] [INFO ] [MAIN ] CABO: Loaded 16872 existing records. [2025-10-09T17:52:16.007298] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-09T17:52:16.173092] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:16.173322] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-09T17:52:16.173378] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-09T17:52:16.174140] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-09T17:52:16.174200] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-09T17:52:16.535018] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:16.551357] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T17:52:16.796733] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-09T17:52:17.597351] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T17:52:17.597078] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-09T17:52:18.088613] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-09T17:52:18.396750] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-09T17:52:18.802903] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:52:19.196753] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-09T17:52:19.915121] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T17:52:19.996678] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-09T17:52:20.785493] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-09T17:52:20.796895] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-09T17:52:20.807223] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T17:52:21.596698] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-09T17:52:22.273258] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T17:52:22.396674] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-09T17:52:22.581863] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T17:52:23.196699] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-09T17:52:23.672223] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T17:52:23.996712] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-09T17:52:24.651549] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T17:52:24.677190] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T17:52:24.796710] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-09T17:52:25.596690] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-09T17:52:25.700453] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T17:52:26.396696] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-09T17:52:26.605702] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:52:27.196690] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-09T17:52:27.356029] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:52:27.996721] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-09T17:52:28.554953] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:52:28.796681] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-09T17:52:28.830934] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T17:52:29.596705] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-09T17:52:30.396779] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-09T17:52:30.552845] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T17:52:31.079592] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-09T17:52:31.196715] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-09T17:52:31.533134] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T17:52:31.536080] [INFO ] [REMOTE ] BZH: Full fetch complete (47007 records). [2025-10-09T17:52:31.536179] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-09T17:52:31.917229] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-09T17:52:31.917329] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-09T17:52:31.917987] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-09T17:52:31.918050] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-09T17:52:31.919116] [DEBUG] [LOCAL ] BZH: Trimmed 47007 records to 32653 (keeping 200 days of data) [2025-10-09T17:52:32.001704] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-09T17:52:32.108506] [DEBUG] [LOCAL ] BZH: Primary data saved (32653 records). [2025-10-09T17:52:32.108663] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-09T17:52:32.108763] [INFO ] [MAIN ] Update Progress: 381/2373 symbols completed. BZH took 39.1s. Estimated remaining: 4h 34m 22s. Rate: 7.3 symbols/min [2025-10-09T17:52:32.278635] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:32.301238] [DEBUG] [LOCAL ] CACI: Loaded 23827 existing records from primary storage. [2025-10-09T17:52:32.301489] [INFO ] [MAIN ] CACI: Loaded 23827 existing records. [2025-10-09T17:52:32.479501] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:32.479775] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-09T17:52:32.479825] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-09T17:52:32.480634] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-09T17:52:32.480726] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-09T17:52:32.802361] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-09T17:52:32.840499] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:33.002769] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T17:52:33.193757] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-09T17:52:33.198583] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-09T17:52:33.198782] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-09T17:52:33.590238] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-09T17:52:33.590333] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-09T17:52:33.591185] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-09T17:52:33.591257] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-09T17:52:33.592869] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54130 (keeping 200 days of data) [2025-10-09T17:52:33.651096] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-09T17:52:33.941317] [DEBUG] [LOCAL ] C: Primary data saved (54130 records). [2025-10-09T17:52:33.941528] [INFO ] [MAIN ] C: Full history saved. [2025-10-09T17:52:33.942324] [INFO ] [MAIN ] Update Progress: 382/2373 symbols completed. C took 34.1s. Estimated remaining: 4h 33m 40s. Rate: 7.3 symbols/min [2025-10-09T17:52:34.113173] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T17:52:34.135680] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:34.183171] [DEBUG] [LOCAL ] CADE: Loaded 49166 existing records from primary storage. [2025-10-09T17:52:34.183487] [INFO ] [MAIN ] CADE: Loaded 49166 existing records. [2025-10-09T17:52:34.358997] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:34.359191] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-09T17:52:34.359237] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-09T17:52:34.360790] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-09T17:52:34.360849] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-09T17:52:34.402115] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-09T17:52:34.768769] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:34.769951] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T17:52:35.196721] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-09T17:52:35.238542] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T17:52:35.819860] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T17:52:35.996708] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-09T17:52:36.796720] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-09T17:52:37.079041] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:52:37.596710] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-09T17:52:38.070168] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:52:38.396821] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-09T17:52:38.400457] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T17:52:39.196746] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-09T17:52:40.001247] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-09T17:52:40.003556] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T17:52:40.529249] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:52:40.796792] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-09T17:52:41.248774] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T17:52:41.596766] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-09T17:52:42.129512] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T17:52:42.352320] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T17:52:42.396667] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-09T17:52:43.171963] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T17:52:43.173386] [INFO ] [REMOTE ] CABO: Full fetch complete (23124 records). [2025-10-09T17:52:43.173458] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-09T17:52:43.202306] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-09T17:52:43.536801] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-09T17:52:43.536882] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-09T17:52:43.537317] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-09T17:52:43.537382] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-09T17:52:43.538039] [DEBUG] [LOCAL ] CABO: Trimmed 23124 records to 16965 (keeping 200 days of data) [2025-10-09T17:52:43.662391] [DEBUG] [LOCAL ] CABO: Primary data saved (16965 records). [2025-10-09T17:52:43.662612] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-09T17:52:43.662738] [INFO ] [MAIN ] Update Progress: 383/2373 symbols completed. CABO took 27.9s. Estimated remaining: 4h 33m 39s. Rate: 7.3 symbols/min [2025-10-09T17:52:43.829882] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:43.868438] [DEBUG] [LOCAL ] CAE: Loaded 39208 existing records from primary storage. [2025-10-09T17:52:43.868741] [INFO ] [MAIN ] CAE: Loaded 39208 existing records. [2025-10-09T17:52:44.001789] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-09T17:52:44.057462] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:44.057669] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-09T17:52:44.057748] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-09T17:52:44.058986] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-09T17:52:44.059048] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-09T17:52:44.430471] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:44.435878] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:52:44.438050] [INFO ] [REMOTE ] CAAP: Full fetch complete (27788 records). [2025-10-09T17:52:44.438121] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-09T17:52:44.805579] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-09T17:52:44.819781] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-09T17:52:44.819865] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-09T17:52:44.820360] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-09T17:52:44.820415] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-09T17:52:44.821161] [DEBUG] [LOCAL ] CAAP: Trimmed 27788 records to 19969 (keeping 200 days of data) [2025-10-09T17:52:44.941028] [DEBUG] [LOCAL ] CAAP: Primary data saved (19969 records). [2025-10-09T17:52:44.941175] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-09T17:52:44.941257] [INFO ] [MAIN ] Update Progress: 384/2373 symbols completed. CAAP took 30.6s. Estimated remaining: 4h 32m 55s. Rate: 7.3 symbols/min [2025-10-09T17:52:45.120987] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:45.126215] [DEBUG] [LOCAL ] CAF: Loaded 3399 existing records from primary storage. [2025-10-09T17:52:45.126408] [INFO ] [MAIN ] CAF: Loaded 3399 existing records. [2025-10-09T17:52:45.315747] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:45.315982] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-09T17:52:45.316034] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-09T17:52:45.316333] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-09T17:52:45.316394] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-09T17:52:45.599896] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-09T17:52:45.679704] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:45.700792] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:52:46.396686] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-09T17:52:46.823272] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-09T17:52:47.109500] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:52:47.196717] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-09T17:52:47.931844] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:52:47.996681] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-09T17:52:48.042961] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T17:52:48.796754] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-09T17:52:49.252449] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T17:52:49.596766] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-09T17:52:50.169942] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T17:52:50.195191] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T17:52:50.396754] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-09T17:52:51.196764] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-09T17:52:51.766529] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T17:52:51.996789] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-09T17:52:52.630469] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:52:52.796758] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-09T17:52:53.321498] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T17:52:53.596722] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-09T17:52:54.175887] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:52:54.396677] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-09T17:52:54.587231] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:52:54.747922] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T17:52:55.196753] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-09T17:52:55.732419] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T17:52:55.996752] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-09T17:52:56.796777] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-09T17:52:57.185763] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T17:52:57.596810] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-09T17:52:57.877187] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:52:58.357774] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:52:58.396721] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-09T17:52:59.045487] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T17:52:59.196723] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-09T17:52:59.666322] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T17:52:59.996727] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-09T17:53:00.796738] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-09T17:53:01.596705] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-09T17:53:01.707681] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:53:02.328864] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:53:02.396746] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-09T17:53:02.999246] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T17:53:03.196770] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-09T17:53:03.557585] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:53:03.996716] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-09T17:53:04.796718] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-09T17:53:04.850029] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T17:53:05.354976] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T17:53:05.381038] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:53:05.596714] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-09T17:53:06.396733] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-09T17:53:06.837816] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T17:53:07.196722] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-09T17:53:07.579001] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T17:53:07.996778] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-09T17:53:08.796723] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-09T17:53:08.949380] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:53:08.951179] [INFO ] [REMOTE ] CACI: Full fetch complete (38487 records). [2025-10-09T17:53:08.951249] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-09T17:53:09.167285] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T17:53:09.381827] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-09T17:53:09.381744] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T17:53:09.383079] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-09T17:53:09.383860] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-09T17:53:09.383921] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-09T17:53:09.384637] [DEBUG] [LOCAL ] CACI: Trimmed 38487 records to 23891 (keeping 200 days of data) [2025-10-09T17:53:09.528449] [DEBUG] [LOCAL ] CACI: Primary data saved (23891 records). [2025-10-09T17:53:09.528588] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-09T17:53:09.528700] [INFO ] [MAIN ] Update Progress: 385/2373 symbols completed. CACI took 37.4s. Estimated remaining: 4h 34m 11s. Rate: 7.3 symbols/min [2025-10-09T17:53:09.601950] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-09T17:53:09.698196] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:09.751402] [DEBUG] [LOCAL ] CAG: Loaded 53664 existing records from primary storage. [2025-10-09T17:53:09.751714] [INFO ] [MAIN ] CAG: Loaded 53664 existing records. [2025-10-09T17:53:09.926329] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:09.926595] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-09T17:53:09.926665] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-09T17:53:09.926957] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-09T17:53:09.927016] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-09T17:53:10.276724] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:10.280603] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T17:53:10.396671] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-09T17:53:11.196727] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-09T17:53:11.996841] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-09T17:53:12.321137] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T17:53:12.801818] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-09T17:53:12.816464] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T17:53:13.299679] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T17:53:13.300508] [INFO ] [REMOTE ] CAF: Full fetch complete (5536 records). [2025-10-09T17:53:13.300574] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-09T17:53:13.300955] [FATAL] [VALIDATOR ] CAF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:53:13.301037] [FATAL] [MAIN ] CAF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:53:13.301124] [WARN ] [MAIN ] CAF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:53:13.301208] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-09T17:53:13.301286] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-09T17:53:13.301337] [INFO ] [LOCAL ] CAF: Starting deletion of derivative data. [2025-10-09T17:53:13.301593] [DEBUG] [LOCAL ] CAF: Deleted derivative data file. [2025-10-09T17:53:13.301744] [INFO ] [MAIN ] Update Progress: 386/2373 symbols completed. CAF took 28.4s. Estimated remaining: 4h 33m 40s. Rate: 7.3 symbols/min [2025-10-09T17:53:13.473024] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:13.503080] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T17:53:13.558613] [DEBUG] [LOCAL ] CAH: Loaded 51469 existing records from primary storage. [2025-10-09T17:53:13.558935] [INFO ] [MAIN ] CAH: Loaded 51469 existing records. [2025-10-09T17:53:13.601884] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-09T17:53:13.735113] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:13.735300] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-09T17:53:13.735346] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-09T17:53:13.735815] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-09T17:53:13.735873] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-09T17:53:14.088001] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:14.396721] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-09T17:53:15.196720] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-09T17:53:15.257467] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T17:53:15.996739] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-09T17:53:16.245359] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T17:53:16.796749] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-09T17:53:16.880956] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:53:17.596686] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-09T17:53:17.661356] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T17:53:17.665871] [INFO ] [REMOTE ] CADE: Full fetch complete (70145 records). [2025-10-09T17:53:17.666018] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-09T17:53:18.054315] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-09T17:53:18.054521] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-09T17:53:18.055377] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-09T17:53:18.055551] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-09T17:53:18.057134] [DEBUG] [LOCAL ] CADE: Trimmed 70145 records to 49553 (keeping 200 days of data) [2025-10-09T17:53:18.313240] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T17:53:18.398523] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-09T17:53:18.410080] [DEBUG] [LOCAL ] CADE: Primary data saved (49553 records). [2025-10-09T17:53:18.410212] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-09T17:53:18.411352] [INFO ] [MAIN ] Update Progress: 387/2373 symbols completed. CADE took 44.5s. Estimated remaining: 4h 33m 15s. Rate: 7.3 symbols/min [2025-10-09T17:53:18.580509] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:18.623076] [DEBUG] [LOCAL ] CAL: Loaded 43047 existing records from primary storage. [2025-10-09T17:53:18.623369] [INFO ] [MAIN ] CAL: Loaded 43047 existing records. [2025-10-09T17:53:18.801401] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:18.801629] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-09T17:53:18.801717] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-09T17:53:18.801974] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-09T17:53:18.802035] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-09T17:53:19.160174] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:19.196671] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-09T17:53:19.350291] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T17:53:19.996691] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-09T17:53:20.250612] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T17:53:20.796730] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-09T17:53:20.830625] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T17:53:21.596699] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-09T17:53:21.857719] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T17:53:22.149857] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:53:22.396735] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-09T17:53:22.867492] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T17:53:23.196744] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-09T17:53:23.455341] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:53:23.996741] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-09T17:53:24.782210] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T17:53:24.796677] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-09T17:53:24.988728] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T17:53:25.596729] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-09T17:53:26.396748] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-09T17:53:26.686139] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T17:53:27.026565] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:53:27.030131] [INFO ] [REMOTE ] CAE: Full fetch complete (56175 records). [2025-10-09T17:53:27.030225] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-09T17:53:27.215379] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-09T17:53:27.407397] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-09T17:53:27.407489] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-09T17:53:27.408185] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-09T17:53:27.408253] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-09T17:53:27.409476] [DEBUG] [LOCAL ] CAE: Trimmed 56175 records to 39472 (keeping 200 days of data) [2025-10-09T17:53:27.635819] [DEBUG] [LOCAL ] CAE: Primary data saved (39472 records). [2025-10-09T17:53:27.635964] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-09T17:53:27.636049] [INFO ] [MAIN ] Update Progress: 388/2373 symbols completed. CAE took 44.0s. Estimated remaining: 4h 33m 12s. Rate: 7.3 symbols/min [2025-10-09T17:53:27.802550] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:27.836698] [DEBUG] [LOCAL ] CALX: Loaded 37736 existing records from primary storage. [2025-10-09T17:53:27.836980] [INFO ] [MAIN ] CALX: Loaded 37736 existing records. [2025-10-09T17:53:28.012799] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-09T17:53:28.016602] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:28.017926] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-09T17:53:28.018043] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-09T17:53:28.019327] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-09T17:53:28.019392] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-09T17:53:28.190478] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T17:53:28.420160] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:28.796676] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-09T17:53:29.261533] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T17:53:29.596688] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-09T17:53:29.721807] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T17:53:30.030179] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T17:53:30.396799] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-09T17:53:31.088224] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T17:53:31.196677] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-09T17:53:31.996686] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-09T17:53:32.491128] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T17:53:32.796684] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-09T17:53:32.939302] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:53:33.014600] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T17:53:33.596710] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-09T17:53:34.208743] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T17:53:34.396672] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-09T17:53:34.981579] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T17:53:35.196713] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-09T17:53:35.996758] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-09T17:53:36.391715] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T17:53:36.712638] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:53:36.796714] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-09T17:53:37.465409] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:53:37.596750] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-09T17:53:38.396824] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-09T17:53:38.648539] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T17:53:39.196690] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-09T17:53:39.505781] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T17:53:39.841694] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T17:53:39.996687] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-09T17:53:40.796685] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-09T17:53:41.150199] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T17:53:41.201491] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T17:53:41.596739] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-09T17:53:42.179569] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:53:42.396760] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-09T17:53:43.196689] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-09T17:53:43.405538] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-09T17:53:43.410445] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-09T17:53:43.410582] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-09T17:53:43.819393] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:53:43.851039] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-09T17:53:43.851421] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-09T17:53:43.852303] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-09T17:53:43.852491] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-09T17:53:43.853938] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 54054 (keeping 200 days of data) [2025-10-09T17:53:44.036750] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-09T17:53:44.196929] [DEBUG] [LOCAL ] CAG: Primary data saved (54054 records). [2025-10-09T17:53:44.197117] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-09T17:53:44.197255] [INFO ] [MAIN ] Update Progress: 389/2373 symbols completed. CAG took 34.7s. Estimated remaining: 4h 33m 46s. Rate: 7.2 symbols/min [2025-10-09T17:53:44.385589] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:44.408899] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T17:53:44.437304] [DEBUG] [LOCAL ] CANG: Loaded 26953 existing records from primary storage. [2025-10-09T17:53:44.437584] [INFO ] [MAIN ] CANG: Loaded 26953 existing records. [2025-10-09T17:53:44.625369] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:44.625625] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-09T17:53:44.625738] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-09T17:53:44.626573] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-09T17:53:44.626633] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-09T17:53:44.811143] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-09T17:53:45.011729] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:45.403172] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T17:53:45.596713] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-09T17:53:45.977832] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T17:53:46.396723] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-09T17:53:46.898781] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:53:47.196773] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-09T17:53:47.825174] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:53:47.828846] [INFO ] [REMOTE ] CAL: Full fetch complete (61773 records). [2025-10-09T17:53:47.828958] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-09T17:53:48.003217] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-09T17:53:48.243189] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-09T17:53:48.243268] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-09T17:53:48.243976] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-09T17:53:48.244040] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-09T17:53:48.245207] [DEBUG] [LOCAL ] CAL: Trimmed 61773 records to 43336 (keeping 200 days of data) [2025-10-09T17:53:48.513352] [DEBUG] [LOCAL ] CAL: Primary data saved (43336 records). [2025-10-09T17:53:48.513509] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-09T17:53:48.514093] [INFO ] [MAIN ] Update Progress: 390/2373 symbols completed. CAL took 30.1s. Estimated remaining: 4h 33m 18s. Rate: 7.3 symbols/min [2025-10-09T17:53:48.687827] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:48.696613] [DEBUG] [LOCAL ] CAPL: Loaded 5700 existing records from primary storage. [2025-10-09T17:53:48.696862] [INFO ] [MAIN ] CAPL: Loaded 5700 existing records. [2025-10-09T17:53:48.796776] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-09T17:53:48.901739] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:48.903783] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:53:48.903888] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-09T17:53:48.912840] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-09T17:53:48.913691] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-09T17:53:48.913753] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-09T17:53:49.281223] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:49.396839] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:53:49.401251] [INFO ] [REMOTE ] CAH: Full fetch complete (74587 records). [2025-10-09T17:53:49.401367] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-09T17:53:49.607531] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-09T17:53:49.823433] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-09T17:53:49.823552] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-09T17:53:49.824448] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-09T17:53:49.824513] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-09T17:53:49.826072] [DEBUG] [LOCAL ] CAH: Trimmed 74587 records to 51836 (keeping 200 days of data) [2025-10-09T17:53:50.164000] [DEBUG] [LOCAL ] CAH: Primary data saved (51836 records). [2025-10-09T17:53:50.164149] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-09T17:53:50.165321] [INFO ] [MAIN ] Update Progress: 391/2373 symbols completed. CAH took 36.9s. Estimated remaining: 4h 32m 36s. Rate: 7.3 symbols/min [2025-10-09T17:53:50.335937] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:50.390423] [DEBUG] [LOCAL ] CARR: Loaded 53597 existing records from primary storage. [2025-10-09T17:53:50.390878] [INFO ] [MAIN ] CARR: Loaded 53597 existing records. [2025-10-09T17:53:50.408034] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-09T17:53:50.421624] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:53:50.595048] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:50.595260] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-09T17:53:50.595306] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-09T17:53:50.596625] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-09T17:53:50.596717] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-09T17:53:50.957252] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:51.125740] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T17:53:51.196671] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-09T17:53:51.419408] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:53:51.996688] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-09T17:53:52.714918] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T17:53:52.796674] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-09T17:53:52.983252] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T17:53:53.596694] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-09T17:53:53.688980] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T17:53:54.396731] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-09T17:53:55.196704] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-09T17:53:55.549102] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T17:53:55.996722] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-09T17:53:56.119299] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-09T17:53:56.400321] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T17:53:56.796742] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-09T17:53:57.175852] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T17:53:57.596778] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-09T17:53:58.396757] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-09T17:53:58.493478] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T17:53:58.557288] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:53:59.196762] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-09T17:53:59.769324] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T17:53:59.772302] [INFO ] [REMOTE ] CALX: Full fetch complete (53980 records). [2025-10-09T17:53:59.772385] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-09T17:54:00.001735] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-09T17:54:00.124161] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T17:54:00.194467] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-09T17:54:00.194542] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-09T17:54:00.195188] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-09T17:54:00.195250] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-09T17:54:00.196325] [DEBUG] [LOCAL ] CALX: Trimmed 53980 records to 37960 (keeping 200 days of data) [2025-10-09T17:54:00.413999] [DEBUG] [LOCAL ] CALX: Primary data saved (37960 records). [2025-10-09T17:54:00.414135] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-09T17:54:00.414728] [INFO ] [MAIN ] Update Progress: 392/2373 symbols completed. CALX took 32.8s. Estimated remaining: 4h 32m 38s. Rate: 7.3 symbols/min [2025-10-09T17:54:00.582139] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:00.621616] [DEBUG] [LOCAL ] CARS: Loaded 39698 existing records from primary storage. [2025-10-09T17:54:00.621917] [INFO ] [MAIN ] CARS: Loaded 39698 existing records. [2025-10-09T17:54:00.727359] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T17:54:00.801978] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-09T17:54:00.806246] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:00.807286] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-09T17:54:00.807375] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-09T17:54:00.807722] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-09T17:54:00.807782] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-09T17:54:01.155421] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:01.596787] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-09T17:54:02.004695] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T17:54:02.396740] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-09T17:54:02.530884] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T17:54:03.196745] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-09T17:54:03.500392] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T17:54:03.996715] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-09T17:54:04.717038] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T17:54:04.732308] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T17:54:04.796734] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-09T17:54:05.596774] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-09T17:54:06.396710] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-09T17:54:06.653863] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T17:54:06.765084] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T17:54:07.196726] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-09T17:54:07.716112] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T17:54:07.851830] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T17:54:07.996764] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-09T17:54:08.578377] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T17:54:08.796725] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-09T17:54:09.596718] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-09T17:54:10.131098] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T17:54:10.396719] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-09T17:54:10.549344] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:54:11.050135] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T17:54:11.196728] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-09T17:54:11.996782] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-09T17:54:12.796696] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-09T17:54:13.133614] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T17:54:13.380352] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T17:54:13.551686] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:54:13.596671] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-09T17:54:14.396727] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-09T17:54:15.196778] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-09T17:54:15.390362] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:54:15.996690] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-09T17:54:16.051373] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T17:54:16.247372] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:54:16.250350] [INFO ] [REMOTE ] CANG: Full fetch complete (40014 records). [2025-10-09T17:54:16.250439] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-09T17:54:16.709531] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-09T17:54:16.709745] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-09T17:54:16.710347] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-09T17:54:16.710392] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-09T17:54:16.711434] [DEBUG] [LOCAL ] CANG: Trimmed 40014 records to 27185 (keeping 200 days of data) [2025-10-09T17:54:16.796753] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-09T17:54:16.867087] [DEBUG] [LOCAL ] CANG: Primary data saved (27185 records). [2025-10-09T17:54:16.867222] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-09T17:54:16.867306] [INFO ] [MAIN ] Update Progress: 393/2373 symbols completed. CANG took 32.7s. Estimated remaining: 4h 33m 11s. Rate: 7.2 symbols/min [2025-10-09T17:54:17.032141] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:17.082441] [DEBUG] [LOCAL ] CAT: Loaded 52918 existing records from primary storage. [2025-10-09T17:54:17.082849] [INFO ] [MAIN ] CAT: Loaded 52918 existing records. [2025-10-09T17:54:17.271058] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:17.271420] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-09T17:54:17.271564] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-09T17:54:17.272046] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-09T17:54:17.272247] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-09T17:54:17.481905] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T17:54:17.599027] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-09T17:54:17.678998] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:18.228310] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T17:54:18.271024] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:54:18.396710] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-09T17:54:19.196706] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-09T17:54:19.996703] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-09T17:54:20.287025] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T17:54:20.796722] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-09T17:54:21.237353] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T17:54:21.305124] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:54:21.506114] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T17:54:21.507228] [INFO ] [REMOTE ] CAPL: Full fetch complete (8722 records). [2025-10-09T17:54:21.507299] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-09T17:54:21.601903] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-09T17:54:21.885118] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-09T17:54:21.885201] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-09T17:54:21.885442] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-09T17:54:21.885482] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-09T17:54:21.885962] [DEBUG] [LOCAL ] CAPL: Trimmed 8722 records to 5748 (keeping 200 days of data) [2025-10-09T17:54:21.922808] [DEBUG] [LOCAL ] CAPL: Primary data saved (5748 records). [2025-10-09T17:54:21.922931] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-09T17:54:21.923015] [INFO ] [MAIN ] Update Progress: 394/2373 symbols completed. CAPL took 33.4s. Estimated remaining: 4h 32m 46s. Rate: 7.3 symbols/min [2025-10-09T17:54:22.095198] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:22.104684] [DEBUG] [LOCAL ] CATO: Loaded 6871 existing records from primary storage. [2025-10-09T17:54:22.104905] [INFO ] [MAIN ] CATO: Loaded 6871 existing records. [2025-10-09T17:54:22.279732] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:22.279953] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-09T17:54:22.280005] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-09T17:54:22.280192] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-09T17:54:22.280248] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-09T17:54:22.401912] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-09T17:54:22.652126] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:23.196726] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-09T17:54:23.762503] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-09T17:54:23.796883] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T17:54:23.996718] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-09T17:54:24.411152] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:54:24.796733] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-09T17:54:25.516323] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T17:54:25.567790] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T17:54:25.596669] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-09T17:54:26.396718] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-09T17:54:26.934082] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T17:54:26.961811] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T17:54:27.196724] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-09T17:54:27.996729] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-09T17:54:28.778466] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T17:54:28.796665] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-09T17:54:29.172395] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T17:54:29.251624] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T17:54:29.596722] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-09T17:54:30.396722] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-09T17:54:31.062375] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:54:31.071277] [INFO ] [REMOTE ] CARS: Full fetch complete (55764 records). [2025-10-09T17:54:31.071508] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-09T17:54:31.201901] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-09T17:54:31.598449] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-09T17:54:31.598792] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-09T17:54:31.599673] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-09T17:54:31.599740] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-09T17:54:31.601461] [DEBUG] [LOCAL ] CARS: Trimmed 55764 records to 40024 (keeping 200 days of data) [2025-10-09T17:54:31.875830] [DEBUG] [LOCAL ] CARS: Primary data saved (40024 records). [2025-10-09T17:54:31.875965] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-09T17:54:31.876507] [INFO ] [MAIN ] Update Progress: 395/2373 symbols completed. CARS took 31.5s. Estimated remaining: 4h 32m 46s. Rate: 7.3 symbols/min [2025-10-09T17:54:32.001824] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-09T17:54:32.049436] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:32.101767] [DEBUG] [LOCAL ] CAVA: Loaded 53555 existing records from primary storage. [2025-10-09T17:54:32.102139] [INFO ] [MAIN ] CAVA: Loaded 53555 existing records. [2025-10-09T17:54:32.283375] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:32.283851] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-09T17:54:32.283927] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-09T17:54:32.294917] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-09T17:54:32.312416] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-09T17:54:32.408715] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-09T17:54:32.550450] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T17:54:32.696678] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:32.796723] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-09T17:54:33.252980] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-09T17:54:33.596778] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-09T17:54:34.396729] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-09T17:54:34.564796] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T17:54:34.569430] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-09T17:54:34.569571] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-09T17:54:34.983252] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-09T17:54:34.983352] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-09T17:54:34.984314] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-09T17:54:34.984389] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-09T17:54:34.986116] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53987 (keeping 200 days of data) [2025-10-09T17:54:35.216554] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T17:54:35.215273] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-09T17:54:35.371227] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:54:35.372952] [DEBUG] [LOCAL ] CARR: Primary data saved (53987 records). [2025-10-09T17:54:35.383985] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-09T17:54:35.385030] [INFO ] [MAIN ] Update Progress: 396/2373 symbols completed. CARR took 45.2s. Estimated remaining: 4h 32m 14s. Rate: 7.3 symbols/min [2025-10-09T17:54:35.569094] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:35.619442] [DEBUG] [LOCAL ] CB: Loaded 49934 existing records from primary storage. [2025-10-09T17:54:35.619812] [INFO ] [MAIN ] CB: Loaded 49934 existing records. [2025-10-09T17:54:35.795474] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:35.795774] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-09T17:54:35.795830] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-09T17:54:35.796045] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-09T17:54:35.796101] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-09T17:54:36.001988] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-09T17:54:36.154799] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:36.796787] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-09T17:54:37.139885] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T17:54:37.596701] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-09T17:54:37.809570] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:54:38.396724] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-09T17:54:38.443834] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T17:54:38.523787] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T17:54:39.196731] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-09T17:54:39.966475] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T17:54:39.996699] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-09T17:54:40.084487] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T17:54:40.715436] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T17:54:40.796726] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-09T17:54:41.596794] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-09T17:54:42.120720] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T17:54:42.396750] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-09T17:54:43.120713] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:54:43.122262] [INFO ] [REMOTE ] CATO: Full fetch complete (11006 records). [2025-10-09T17:54:43.122359] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-09T17:54:43.201865] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-09T17:54:43.503137] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-09T17:54:43.503255] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-09T17:54:43.503570] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-09T17:54:43.503614] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-09T17:54:43.504347] [DEBUG] [LOCAL ] CATO: Trimmed 11006 records to 6908 (keeping 200 days of data) [2025-10-09T17:54:43.546346] [DEBUG] [LOCAL ] CATO: Primary data saved (6908 records). [2025-10-09T17:54:43.546685] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-09T17:54:43.546830] [INFO ] [MAIN ] Update Progress: 397/2373 symbols completed. CATO took 21.6s. Estimated remaining: 4h 32m 6s. Rate: 7.3 symbols/min [2025-10-09T17:54:43.718293] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-09T17:54:43.996763] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-09T17:54:44.796771] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-09T17:54:45.242399] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-09T17:54:45.596690] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-09T17:54:45.935705] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T17:54:46.049472] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:54:46.396768] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-09T17:54:47.196815] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-09T17:54:47.716580] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-09T17:54:48.005527] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-09T17:54:48.024495] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T17:54:48.796793] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-09T17:54:49.003537] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T17:54:49.596692] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-09T17:54:49.771737] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T17:54:50.396736] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-09T17:54:50.829022] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T17:54:51.196779] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-09T17:54:51.587535] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T17:54:51.996738] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-09T17:54:52.263251] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:54:52.603618] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T17:54:52.796794] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-09T17:54:53.596730] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-09T17:54:54.313634] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-09T17:54:54.396680] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-09T17:54:54.479823] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:54:55.196749] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-09T17:54:55.752303] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-09T17:54:55.996715] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-09T17:54:56.357856] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T17:54:56.362429] [INFO ] [REMOTE ] CAT: Full fetch complete (76687 records). [2025-10-09T17:54:56.362552] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-09T17:54:56.761327] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-09T17:54:56.761463] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-09T17:54:56.762371] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-09T17:54:56.762494] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-09T17:54:56.764029] [DEBUG] [LOCAL ] CAT: Trimmed 76687 records to 53301 (keeping 200 days of data) [2025-10-09T17:54:57.113106] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T17:54:57.126889] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-09T17:54:57.144040] [DEBUG] [LOCAL ] CAT: Primary data saved (53301 records). [2025-10-09T17:54:57.144298] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-09T17:54:57.144399] [INFO ] [MAIN ] Update Progress: 398/2373 symbols completed. CAT took 40.3s. Estimated remaining: 4h 32m 24s. Rate: 7.3 symbols/min [2025-10-09T17:54:57.652628] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T17:54:57.664809] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-09T17:54:58.818150] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:54:58.828955] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-09T17:54:59.790873] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-09T17:54:59.802709] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-09T17:55:00.239754] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T17:55:00.250875] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-09T17:55:01.974873] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-09T17:55:01.987544] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-09T17:55:02.069622] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-09T17:55:02.073953] [INFO ] [REMOTE ] CB: Full fetch complete (72590 records). [2025-10-09T17:55:02.074095] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-09T17:55:02.476474] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-09T17:55:02.476571] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-09T17:55:02.477402] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-09T17:55:02.477469] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-09T17:55:02.479015] [DEBUG] [LOCAL ] CB: Trimmed 72590 records to 50296 (keeping 200 days of data) [2025-10-09T17:55:02.798612] [DEBUG] [LOCAL ] CB: Primary data saved (50296 records). [2025-10-09T17:55:02.798775] [INFO ] [MAIN ] CB: Full history saved. [2025-10-09T17:55:02.799710] [INFO ] [MAIN ] Update Progress: 399/2373 symbols completed. CB took 27.4s. Estimated remaining: 4h 32m 3s. Rate: 7.3 symbols/min [2025-10-09T17:55:03.681774] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T17:55:03.685909] [INFO ] [REMOTE ] CAVA: Full fetch complete (76932 records). [2025-10-09T17:55:03.686038] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-09T17:55:03.686813] [FATAL] [VALIDATOR ] CAVA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:55:03.686901] [FATAL] [MAIN ] CAVA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:55:03.686946] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:55:03.686984] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-09T17:55:03.687057] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-09T17:55:03.687127] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-10-09T17:55:03.687375] [DEBUG] [LOCAL ] CAVA: Deleted derivative data file. [2025-10-09T17:55:03.687685] [INFO ] [MAIN ] Update Progress: 400/2373 symbols completed. CAVA took 31.8s. Estimated remaining: 4h 31m 18s. Rate: 7.3 symbols/min [2025-10-09T17:55:04.191948] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:04.403442] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:04.414442] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:04.439040] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:04.439891] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-09T17:55:04.439965] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-09T17:55:04.440123] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-09T17:55:04.440181] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-09T17:55:04.440227] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-09T17:55:04.440263] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-09T17:55:04.514151] [DEBUG] [LOCAL ] CBL: Loaded 16262 existing records from primary storage. [2025-10-09T17:55:04.541945] [INFO ] [MAIN ] CBL: Loaded 16262 existing records. [2025-10-09T17:55:04.568628] [DEBUG] [LOCAL ] CBNA: Loaded 2896 existing records from primary storage. [2025-10-09T17:55:04.612302] [INFO ] [MAIN ] CBNA: Loaded 2896 existing records. [2025-10-09T17:55:04.592408] [DEBUG] [LOCAL ] CBAN: Loaded 10649 existing records from primary storage. [2025-10-09T17:55:04.665431] [INFO ] [MAIN ] CBAN: Loaded 10649 existing records. [2025-10-09T17:55:05.293956] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:05.302184] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:05.322164] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-09T17:55:05.350409] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:05.350553] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-09T17:55:05.384055] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-09T17:55:05.384226] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-09T17:55:05.384005] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-09T17:55:05.403389] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-09T17:55:05.407380] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-09T17:55:05.401192] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-09T17:55:05.407310] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:05.404217] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-09T17:55:05.428054] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-09T17:55:05.428152] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-09T17:55:05.433672] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-09T17:55:05.434424] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-09T17:55:05.794811] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:55:05.895798] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-09T17:55:06.042298] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:55:06.163300] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-09T17:55:06.278226] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:55:06.299748] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-09T17:55:06.321262] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-09T17:55:06.357613] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-09T17:55:06.357869] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-09T17:55:06.381278] [INFO ] [MAIN ] Update Progress: 401/2373 symbols completed. CBO took 2.7s. Estimated remaining: 4h 30m 42s. Rate: 7.3 symbols/min [2025-10-09T17:55:06.460384] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:06.535997] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:06.523302] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-09T17:55:06.586923] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:06.595573] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-09T17:55:06.550400] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-09T17:55:06.726292] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:06.726481] [DEBUG] [LOCAL ] CBRE: No existing data file found in primary storage. [2025-10-09T17:55:06.726537] [WARN ] [MAIN ] CBRE: No existing data found, performing full refresh instead. [2025-10-09T17:55:06.726675] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-09T17:55:06.726731] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-09T17:55:06.726775] [DEBUG] [LOCAL ] CBRE: No primary data file found to delete. [2025-10-09T17:55:06.726808] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-09T17:55:07.086463] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:07.086826] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-09T17:55:07.359625] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T17:55:07.361304] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-09T17:55:07.480194] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:55:07.482564] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-09T17:55:07.825059] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T17:55:07.830220] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-09T17:55:07.933770] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T17:55:07.996721] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-09T17:55:08.047827] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T17:55:08.316250] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T17:55:08.747795] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T17:55:08.796695] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-09T17:55:08.901134] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:55:09.596779] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-09T17:55:10.100845] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-09T17:55:10.157395] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T17:55:10.396728] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-09T17:55:10.975037] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T17:55:11.196766] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-09T17:55:11.996694] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-09T17:55:12.139595] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:55:12.536552] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T17:55:12.796762] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-09T17:55:13.596696] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-09T17:55:13.723869] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T17:55:13.941003] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T17:55:14.396769] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-09T17:55:14.849136] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T17:55:15.196744] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-09T17:55:15.996755] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-09T17:55:16.251671] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T17:55:16.796742] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-09T17:55:17.416681] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:55:17.596726] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-09T17:55:17.818722] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T17:55:18.396745] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-09T17:55:19.196704] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-09T17:55:19.313759] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T17:55:19.314147] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T17:55:19.823301] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:55:19.996689] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-09T17:55:20.796768] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-09T17:55:21.444801] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T17:55:21.596693] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-09T17:55:21.663511] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T17:55:22.355553] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T17:55:22.396678] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-09T17:55:23.197694] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-09T17:55:23.252585] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T17:55:23.996747] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-09T17:55:24.616844] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:55:24.798124] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-09T17:55:24.799258] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T17:55:25.596738] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-09T17:55:26.016539] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T17:55:26.397347] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-09T17:55:26.403002] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:55:27.196752] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-09T17:55:27.208429] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:55:27.672780] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T17:55:27.674129] [INFO ] [REMOTE ] CBNA: Full fetch complete (4470 records). [2025-10-09T17:55:27.674230] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-09T17:55:28.008137] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-09T17:55:28.050521] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-09T17:55:28.050611] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-09T17:55:28.050791] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-09T17:55:28.050850] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-09T17:55:28.051201] [DEBUG] [LOCAL ] CBNA: Trimmed 4470 records to 2910 (keeping 200 days of data) [2025-10-09T17:55:28.070706] [DEBUG] [LOCAL ] CBNA: Primary data saved (2910 records). [2025-10-09T17:55:28.070820] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-09T17:55:28.070941] [INFO ] [MAIN ] Update Progress: 402/2373 symbols completed. CBNA took 24.4s. Estimated remaining: 4h 31m 40s. Rate: 7.3 symbols/min [2025-10-09T17:55:28.236455] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:28.268859] [DEBUG] [LOCAL ] CBT: Loaded 30800 existing records from primary storage. [2025-10-09T17:55:28.269130] [INFO ] [MAIN ] CBT: Loaded 30800 existing records. [2025-10-09T17:55:28.446473] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:28.446792] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-09T17:55:28.446844] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-09T17:55:28.447116] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-09T17:55:28.447175] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-09T17:55:28.809732] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-09T17:55:28.815462] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:29.073322] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T17:55:29.074587] [INFO ] [REMOTE ] CBAN: Full fetch complete (16082 records). [2025-10-09T17:55:29.074686] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-09T17:55:29.432273] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-09T17:55:29.432357] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-09T17:55:29.432729] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-09T17:55:29.432790] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-09T17:55:29.433265] [DEBUG] [LOCAL ] CBAN: Trimmed 16082 records to 10711 (keeping 200 days of data) [2025-10-09T17:55:29.496737] [DEBUG] [LOCAL ] CBAN: Primary data saved (10711 records). [2025-10-09T17:55:29.496866] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-09T17:55:29.496945] [INFO ] [MAIN ] Update Progress: 403/2373 symbols completed. CBAN took 25.8s. Estimated remaining: 4h 30m 58s. Rate: 7.3 symbols/min [2025-10-09T17:55:29.601843] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-09T17:55:29.666903] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:29.688300] [DEBUG] [LOCAL ] CBU: Loaded 22520 existing records from primary storage. [2025-10-09T17:55:29.688537] [INFO ] [MAIN ] CBU: Loaded 22520 existing records. [2025-10-09T17:55:29.865678] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:29.865883] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-09T17:55:29.865931] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-09T17:55:29.866187] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-09T17:55:29.866246] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-09T17:55:30.294135] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:30.396797] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-09T17:55:30.670793] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:55:30.709132] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T17:55:31.196718] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-09T17:55:31.637632] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T17:55:31.996694] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-09T17:55:32.369301] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T17:55:32.796737] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-09T17:55:33.558636] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T17:55:33.596700] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-09T17:55:33.737105] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T17:55:34.391058] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T17:55:34.396665] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-09T17:55:35.196764] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-09T17:55:35.411997] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T17:55:35.996768] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-09T17:55:36.523328] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T17:55:36.796795] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-09T17:55:37.596735] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-09T17:55:37.630537] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T17:55:37.902715] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:55:38.396782] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-09T17:55:38.919058] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T17:55:39.196697] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-09T17:55:39.595554] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T17:55:39.996713] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-09T17:55:40.796708] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-09T17:55:41.066001] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T17:55:41.070305] [INFO ] [REMOTE ] CBRE: Full fetch complete (73756 records). [2025-10-09T17:55:41.070464] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-09T17:55:41.525790] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:55:41.529597] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-09T17:55:41.540548] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-09T17:55:41.541415] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-09T17:55:41.541671] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-09T17:55:41.543340] [DEBUG] [LOCAL ] CBRE: Trimmed 73756 records to 50764 (keeping 200 days of data) [2025-10-09T17:55:41.596957] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-09T17:55:41.852451] [DEBUG] [LOCAL ] CBRE: Primary data saved (50764 records). [2025-10-09T17:55:41.852579] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-09T17:55:41.852670] [INFO ] [MAIN ] Update Progress: 404/2373 symbols completed. CBRE took 35.4s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-09T17:55:41.972915] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T17:55:42.046357] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:42.046558] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-09T17:55:42.046613] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-09T17:55:42.046776] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-09T17:55:42.046831] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-09T17:55:42.046877] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-09T17:55:42.046911] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-09T17:55:42.416186] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:42.412199] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-09T17:55:42.428940] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T17:55:43.196737] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-09T17:55:43.441921] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T17:55:43.996707] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-09T17:55:44.621827] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:55:44.796720] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-09T17:55:45.030736] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T17:55:45.596714] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-09T17:55:45.851757] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T17:55:46.261090] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-09T17:55:46.396693] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-09T17:55:46.585388] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:55:46.585743] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-09T17:55:46.585856] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:55:46.585924] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-09T17:55:46.585989] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:55:46.586062] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-09T17:55:46.586124] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-09T17:55:46.586161] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-09T17:55:46.586200] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-09T17:55:46.586247] [INFO ] [MAIN ] Update Progress: 405/2373 symbols completed. CBX took 4.7s. Estimated remaining: 4h 30m 45s. Rate: 7.3 symbols/min [2025-10-09T17:55:46.754162] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:46.785685] [DEBUG] [LOCAL ] CBZ: Loaded 34023 existing records from primary storage. [2025-10-09T17:55:46.785959] [INFO ] [MAIN ] CBZ: Loaded 34023 existing records. [2025-10-09T17:55:46.967475] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:46.967771] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-09T17:55:46.967827] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-09T17:55:46.968060] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-09T17:55:46.968120] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-09T17:55:47.201883] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-09T17:55:47.320680] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:47.996716] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-09T17:55:48.451811] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T17:55:48.796742] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-09T17:55:48.911954] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:55:49.596771] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-09T17:55:50.031783] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T17:55:50.252896] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T17:55:50.254748] [INFO ] [REMOTE ] CBL: Full fetch complete (25380 records). [2025-10-09T17:55:50.254835] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-09T17:55:50.401827] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-09T17:55:50.634556] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-09T17:55:50.634638] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-09T17:55:50.635137] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-09T17:55:50.635256] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-09T17:55:50.635956] [DEBUG] [LOCAL ] CBL: Trimmed 25380 records to 16385 (keeping 200 days of data) [2025-10-09T17:55:50.734342] [DEBUG] [LOCAL ] CBL: Primary data saved (16385 records). [2025-10-09T17:55:50.734479] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-09T17:55:50.734558] [INFO ] [MAIN ] Update Progress: 406/2373 symbols completed. CBL took 47.0s. Estimated remaining: 4h 30m 17s. Rate: 7.3 symbols/min [2025-10-09T17:55:50.901672] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:50.952151] [DEBUG] [LOCAL ] CC: Loaded 52993 existing records from primary storage. [2025-10-09T17:55:50.952461] [INFO ] [MAIN ] CC: Loaded 52993 existing records. [2025-10-09T17:55:51.133013] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:51.133222] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-09T17:55:51.133270] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-09T17:55:51.133540] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-09T17:55:51.133599] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-09T17:55:51.201825] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-09T17:55:51.507016] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:51.687864] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T17:55:51.996711] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-09T17:55:52.356571] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T17:55:52.796757] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-09T17:55:53.302918] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T17:55:53.596690] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-09T17:55:53.902712] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T17:55:54.396723] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-09T17:55:54.719101] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:55:55.196743] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-09T17:55:55.474388] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T17:55:55.996735] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-09T17:55:56.494904] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:55:56.796746] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-09T17:55:57.082342] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:55:57.596756] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-09T17:55:58.104016] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T17:55:58.396727] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-09T17:55:58.663409] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T17:55:58.665731] [INFO ] [REMOTE ] CBU: Full fetch complete (32296 records). [2025-10-09T17:55:58.665807] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-09T17:55:59.046998] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-09T17:55:59.047077] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-09T17:55:59.047579] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-09T17:55:59.047665] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-09T17:55:59.048509] [DEBUG] [LOCAL ] CBU: Trimmed 32296 records to 22667 (keeping 200 days of data) [2025-10-09T17:55:59.190022] [DEBUG] [LOCAL ] CBU: Primary data saved (22667 records). [2025-10-09T17:55:59.190152] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-09T17:55:59.190230] [INFO ] [MAIN ] Update Progress: 407/2373 symbols completed. CBU took 29.7s. Estimated remaining: 4h 30m 9s. Rate: 7.3 symbols/min [2025-10-09T17:55:59.203105] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-09T17:55:59.367095] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:59.420166] [DEBUG] [LOCAL ] CCI: Loaded 53132 existing records from primary storage. [2025-10-09T17:55:59.420485] [INFO ] [MAIN ] CCI: Loaded 53132 existing records. [2025-10-09T17:55:59.605814] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:59.606031] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-09T17:55:59.606082] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-09T17:55:59.606460] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-09T17:55:59.606518] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-09T17:55:59.725172] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:55:59.754448] [INFO ] [REMOTE ] CBT: Full fetch complete (45636 records). [2025-10-09T17:55:59.778664] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-09T17:55:59.998172] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-09T17:56:00.302466] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:00.420776] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-09T17:56:00.420859] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-09T17:56:00.421403] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-09T17:56:00.421443] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-09T17:56:00.422388] [DEBUG] [LOCAL ] CBT: Trimmed 45636 records to 31037 (keeping 200 days of data) [2025-10-09T17:56:00.617682] [DEBUG] [LOCAL ] CBT: Primary data saved (31037 records). [2025-10-09T17:56:00.617850] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-09T17:56:00.619053] [INFO ] [MAIN ] Update Progress: 408/2373 symbols completed. CBT took 32.5s. Estimated remaining: 4h 29m 28s. Rate: 7.3 symbols/min [2025-10-09T17:56:00.787094] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:00.787248] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-09T17:56:00.787290] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-09T17:56:00.787396] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-09T17:56:00.787437] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-09T17:56:00.787477] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-09T17:56:00.787510] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-09T17:56:00.818704] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-09T17:56:01.151291] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:01.398961] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-09T17:56:01.596697] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-09T17:56:01.622619] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T17:56:02.396721] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-09T17:56:02.973864] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-09T17:56:03.196691] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-09T17:56:03.267086] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:56:03.570146] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-09T17:56:03.631826] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T17:56:03.996711] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-09T17:56:04.796729] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-09T17:56:05.369952] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T17:56:05.596707] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-09T17:56:06.056363] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T17:56:06.396765] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-09T17:56:06.827115] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T17:56:06.888677] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T17:56:07.196749] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-09T17:56:07.996696] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-09T17:56:08.425865] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:56:08.796739] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-09T17:56:09.596769] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-09T17:56:09.802638] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:56:09.949639] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T17:56:10.338561] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T17:56:10.396720] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-09T17:56:11.196732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-09T17:56:11.515448] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-09T17:56:11.990335] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:56:11.999913] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-09T17:56:12.463039] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T17:56:12.796774] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-09T17:56:13.096037] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T17:56:13.596716] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-09T17:56:14.396724] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-09T17:56:14.859492] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T17:56:14.923576] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:56:14.926561] [INFO ] [REMOTE ] CBZ: Full fetch complete (45474 records). [2025-10-09T17:56:14.926709] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-09T17:56:14.927398] [FATAL] [VALIDATOR ] CBZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:56:14.927503] [FATAL] [MAIN ] CBZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:56:14.927547] [WARN ] [MAIN ] CBZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:56:14.927611] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-09T17:56:14.927734] [DEBUG] [LOCAL ] CBZ: No primary data file found to delete. [2025-10-09T17:56:14.927793] [INFO ] [LOCAL ] CBZ: Starting deletion of derivative data. [2025-10-09T17:56:14.928102] [DEBUG] [LOCAL ] CBZ: Deleted derivative data file. [2025-10-09T17:56:14.928704] [INFO ] [MAIN ] Update Progress: 409/2373 symbols completed. CBZ took 28.3s. Estimated remaining: 4h 29m 49s. Rate: 7.3 symbols/min [2025-10-09T17:56:15.150360] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:15.171815] [DEBUG] [LOCAL ] CCIF: Loaded 15666 existing records from primary storage. [2025-10-09T17:56:15.172151] [INFO ] [MAIN ] CCIF: Loaded 15666 existing records. [2025-10-09T17:56:15.202199] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-09T17:56:15.433377] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:15.433794] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-09T17:56:15.433872] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-09T17:56:15.434258] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-09T17:56:15.434334] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-09T17:56:15.648213] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T17:56:16.002783] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-09T17:56:16.012853] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:16.796716] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-09T17:56:17.293794] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T17:56:17.596695] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-09T17:56:18.027234] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T17:56:18.396720] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-09T17:56:19.196703] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-09T17:56:19.279878] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:56:19.557940] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T17:56:19.592057] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T17:56:19.996725] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-09T17:56:20.497636] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T17:56:20.498478] [INFO ] [REMOTE ] CCIA: Full fetch complete (2150 records). [2025-10-09T17:56:20.498549] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-09T17:56:20.679414] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T17:56:20.679626] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:56:20.679735] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:56:20.679831] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-09T17:56:20.679912] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-09T17:56:20.679952] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-09T17:56:20.679993] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-09T17:56:20.680050] [INFO ] [MAIN ] Update Progress: 410/2373 symbols completed. CCIA took 20.1s. Estimated remaining: 4h 29m 29s. Rate: 7.3 symbols/min [2025-10-09T17:56:20.801904] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-09T17:56:20.858157] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:20.915297] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-10-09T17:56:20.915605] [INFO ] [MAIN ] CCJ: Loaded 53675 existing records. [2025-10-09T17:56:21.093240] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:21.093443] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-09T17:56:21.093539] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-09T17:56:21.093820] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-09T17:56:21.093880] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-09T17:56:21.452594] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:21.596722] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-09T17:56:21.782198] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T17:56:22.396732] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-09T17:56:23.206745] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-09T17:56:23.229443] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:56:23.996740] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-09T17:56:24.157189] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:56:24.489888] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T17:56:24.796715] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-09T17:56:25.547153] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T17:56:25.596719] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-09T17:56:26.396690] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-09T17:56:26.832672] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T17:56:27.196695] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-09T17:56:27.309499] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T17:56:27.528014] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T17:56:27.996717] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-09T17:56:28.648030] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T17:56:28.796776] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-09T17:56:29.597305] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-09T17:56:29.600413] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:56:30.396741] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-09T17:56:30.800110] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-09T17:56:30.922600] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T17:56:31.196773] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-09T17:56:31.996701] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-09T17:56:32.055564] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T17:56:32.796776] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-09T17:56:33.212248] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T17:56:33.596702] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-09T17:56:33.929399] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T17:56:34.396762] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-09T17:56:34.598285] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T17:56:35.184728] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:56:35.196718] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-09T17:56:35.470113] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T17:56:35.996760] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-09T17:56:36.796701] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-09T17:56:37.065151] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T17:56:37.413325] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:56:37.596715] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-09T17:56:37.817334] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T17:56:38.396772] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-09T17:56:39.196704] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-09T17:56:39.246531] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T17:56:39.251746] [INFO ] [REMOTE ] CC: Full fetch complete (75718 records). [2025-10-09T17:56:39.251888] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-09T17:56:39.688069] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-09T17:56:39.688154] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-09T17:56:39.689417] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-09T17:56:39.689530] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-09T17:56:39.691354] [DEBUG] [LOCAL ] CC: Trimmed 75718 records to 53381 (keeping 200 days of data) [2025-10-09T17:56:40.013407] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-09T17:56:40.063443] [DEBUG] [LOCAL ] CC: Primary data saved (53381 records). [2025-10-09T17:56:40.063563] [INFO ] [MAIN ] CC: Full history saved. [2025-10-09T17:56:40.063676] [INFO ] [MAIN ] Update Progress: 411/2373 symbols completed. CC took 49.3s. Estimated remaining: 4h 30m 14s. Rate: 7.3 symbols/min [2025-10-09T17:56:40.237023] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:40.281998] [DEBUG] [LOCAL ] CCK: Loaded 46300 existing records from primary storage. [2025-10-09T17:56:40.282429] [INFO ] [MAIN ] CCK: Loaded 46300 existing records. [2025-10-09T17:56:40.461335] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:40.461615] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-09T17:56:40.461739] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-09T17:56:40.462092] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-09T17:56:40.462164] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-09T17:56:40.594742] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T17:56:40.681783] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T17:56:40.796677] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-09T17:56:40.875210] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:41.028853] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T17:56:41.033811] [INFO ] [REMOTE ] CCI: Full fetch complete (76981 records). [2025-10-09T17:56:41.034006] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-09T17:56:41.432843] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-09T17:56:41.432936] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-09T17:56:41.433854] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-09T17:56:41.433924] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-09T17:56:41.435476] [DEBUG] [LOCAL ] CCI: Trimmed 76981 records to 53516 (keeping 200 days of data) [2025-10-09T17:56:41.619316] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-09T17:56:41.777443] [DEBUG] [LOCAL ] CCI: Primary data saved (53516 records). [2025-10-09T17:56:41.777584] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-09T17:56:41.778382] [INFO ] [MAIN ] Update Progress: 412/2373 symbols completed. CCI took 42.6s. Estimated remaining: 4h 29m 35s. Rate: 7.3 symbols/min [2025-10-09T17:56:41.946464] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:41.999089] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-09T17:56:41.999401] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-09T17:56:42.175409] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:42.175667] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-09T17:56:42.175730] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-09T17:56:42.175971] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-09T17:56:42.176031] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-09T17:56:42.413777] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-09T17:56:42.537166] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:43.196730] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-09T17:56:43.860036] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-09T17:56:43.895075] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T17:56:43.996666] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-09T17:56:44.796754] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-09T17:56:44.908454] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (4.11 seconds). [2025-10-09T17:56:45.506039] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T17:56:45.596679] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-09T17:56:45.717616] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-09T17:56:46.396735] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-09T17:56:46.869743] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T17:56:46.947590] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-09T17:56:47.196686] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-09T17:56:47.996731] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-09T17:56:48.733270] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-09T17:56:48.796695] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-09T17:56:48.827219] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T17:56:49.596742] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-09T17:56:49.848397] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T17:56:50.396811] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-09T17:56:50.572281] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T17:56:51.206775] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-09T17:56:51.212380] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T17:56:51.513166] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:56:51.996744] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-09T17:56:52.796721] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-09T17:56:52.980511] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T17:56:53.444132] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-09T17:56:53.596723] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-09T17:56:54.396712] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-09T17:56:54.641409] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T17:56:55.196762] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-09T17:56:55.996772] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-09T17:56:56.193870] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-09T17:56:56.327499] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T17:56:56.364940] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:56:56.796737] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-09T17:56:56.937994] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T17:56:56.939597] [INFO ] [REMOTE ] CCIF: Full fetch complete (21938 records). [2025-10-09T17:56:56.939696] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-09T17:56:57.303263] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-09T17:56:57.303340] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-09T17:56:57.303731] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-09T17:56:57.303792] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-09T17:56:57.304339] [DEBUG] [LOCAL ] CCIF: Trimmed 21938 records to 15738 (keeping 200 days of data) [2025-10-09T17:56:57.396236] [DEBUG] [LOCAL ] CCIF: Primary data saved (15738 records). [2025-10-09T17:56:57.396380] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-09T17:56:57.396469] [INFO ] [MAIN ] Update Progress: 413/2373 symbols completed. CCIF took 42.5s. Estimated remaining: 4h 30m 1s. Rate: 7.3 symbols/min [2025-10-09T17:56:57.570693] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:57.596758] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-09T17:56:57.613370] [DEBUG] [LOCAL ] CCO: Loaded 48014 existing records from primary storage. [2025-10-09T17:56:57.613700] [INFO ] [MAIN ] CCO: Loaded 48014 existing records. [2025-10-09T17:56:57.798532] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:57.798770] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-09T17:56:57.798854] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-09T17:56:57.799127] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-09T17:56:57.799194] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-09T17:56:58.167099] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:58.396726] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-09T17:56:58.901283] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-09T17:56:58.905812] [INFO ] [REMOTE ] CCJ: Full fetch complete (77683 records). [2025-10-09T17:56:58.905919] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-09T17:56:59.201990] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-09T17:56:59.327722] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-09T17:56:59.327840] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-09T17:56:59.328778] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-09T17:56:59.328886] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-09T17:56:59.353969] [DEBUG] [LOCAL ] CCJ: Trimmed 77683 records to 54065 (keeping 200 days of data) [2025-10-09T17:56:59.355795] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:56:59.681947] [DEBUG] [LOCAL ] CCJ: Primary data saved (54065 records). [2025-10-09T17:56:59.682082] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-09T17:56:59.682988] [INFO ] [MAIN ] Update Progress: 414/2373 symbols completed. CCJ took 39.0s. Estimated remaining: 4h 29m 25s. Rate: 7.3 symbols/min [2025-10-09T17:56:59.851475] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:59.863313] [DEBUG] [LOCAL ] CCRD: Loaded 9219 existing records from primary storage. [2025-10-09T17:56:59.863529] [INFO ] [MAIN ] CCRD: Loaded 9219 existing records. [2025-10-09T17:57:00.011457] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-09T17:57:00.052704] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:00.052930] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-09T17:57:00.052997] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-09T17:57:00.053246] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-09T17:57:00.053319] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-09T17:57:00.420681] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:00.793206] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-09T17:57:00.803869] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-09T17:57:00.942444] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:57:01.446290] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T17:57:01.596685] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-09T17:57:01.772018] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T17:57:02.234000] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T17:57:02.396722] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-09T17:57:03.196776] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-09T17:57:03.890797] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:57:03.996712] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-09T17:57:04.796748] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-09T17:57:04.973418] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T17:57:05.305677] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T17:57:05.596717] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-09T17:57:06.089412] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T17:57:06.396717] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-09T17:57:07.003830] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T17:57:07.007749] [INFO ] [REMOTE ] CCK: Full fetch complete (67589 records). [2025-10-09T17:57:07.007856] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-09T17:57:07.202302] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-09T17:57:07.403440] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-09T17:57:07.403527] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-09T17:57:07.404277] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-09T17:57:07.404341] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-09T17:57:07.405725] [DEBUG] [LOCAL ] CCK: Trimmed 67589 records to 46656 (keeping 200 days of data) [2025-10-09T17:57:07.535871] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T17:57:07.727170] [DEBUG] [LOCAL ] CCK: Primary data saved (46656 records). [2025-10-09T17:57:07.727320] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-09T17:57:07.727421] [INFO ] [MAIN ] Update Progress: 415/2373 symbols completed. CCK took 27.7s. Estimated remaining: 4h 29m 16s. Rate: 7.3 symbols/min [2025-10-09T17:57:07.895327] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:07.904300] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T17:57:07.929209] [DEBUG] [LOCAL ] CCS: Loaded 30228 existing records from primary storage. [2025-10-09T17:57:07.929489] [INFO ] [MAIN ] CCS: Loaded 30228 existing records. [2025-10-09T17:57:08.001874] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-09T17:57:08.115186] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:08.115414] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-09T17:57:08.115463] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-09T17:57:08.115749] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-09T17:57:08.115807] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-09T17:57:08.473257] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:08.796748] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-09T17:57:09.596784] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-09T17:57:09.924277] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T17:57:10.057541] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T17:57:10.212294] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T17:57:10.396739] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-09T17:57:11.196790] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-09T17:57:11.996702] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T17:57:11.996770] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-09T17:57:12.796832] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-09T17:57:12.804041] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-09T17:57:12.928800] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T17:57:13.596734] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-09T17:57:13.722957] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T17:57:14.396698] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-09T17:57:14.911635] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T17:57:15.196709] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-09T17:57:15.996721] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-09T17:57:16.503230] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:57:16.531173] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T17:57:16.771888] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-09T17:57:16.796691] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-09T17:57:17.596707] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-09T17:57:18.396685] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-09T17:57:18.489835] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T17:57:19.196717] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-09T17:57:19.355602] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:57:19.996677] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-09T17:57:20.000023] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-09T17:57:20.471246] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T17:57:20.796688] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-09T17:57:20.997996] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T17:57:21.596715] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-09T17:57:22.396731] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-09T17:57:22.955928] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T17:57:23.129797] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-09T17:57:23.134307] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-09T17:57:23.134425] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-09T17:57:23.201839] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-09T17:57:23.552284] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-09T17:57:23.552383] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-09T17:57:23.553607] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-09T17:57:23.553708] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-09T17:57:23.555709] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54190 (keeping 200 days of data) [2025-10-09T17:57:23.913490] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:57:24.009234] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-09T17:57:24.095274] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-10-09T17:57:24.095482] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-09T17:57:24.096362] [INFO ] [MAIN ] Update Progress: 416/2373 symbols completed. CCL took 42.3s. Estimated remaining: 4h 29m 45s. Rate: 7.3 symbols/min [2025-10-09T17:57:24.329195] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:24.361834] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:57:24.392824] [DEBUG] [LOCAL ] CCU: Loaded 22832 existing records from primary storage. [2025-10-09T17:57:24.393251] [INFO ] [MAIN ] CCU: Loaded 22832 existing records. [2025-10-09T17:57:24.593490] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:24.593763] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-09T17:57:24.593820] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-09T17:57:24.594319] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-09T17:57:24.594378] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-09T17:57:24.801862] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-09T17:57:24.945945] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:25.596757] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-09T17:57:25.662693] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T17:57:25.714897] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:57:26.396793] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-09T17:57:26.719356] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T17:57:27.196752] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-09T17:57:27.736051] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T17:57:27.996748] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-09T17:57:28.229062] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T17:57:28.582131] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T17:57:28.796769] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-09T17:57:29.596806] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-09T17:57:30.083385] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T17:57:30.396727] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-09T17:57:30.891070] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T17:57:31.196733] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-09T17:57:31.422990] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T17:57:31.958251] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T17:57:31.959400] [INFO ] [REMOTE ] CCRD: Full fetch complete (11851 records). [2025-10-09T17:57:31.959471] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-09T17:57:32.001931] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-09T17:57:32.314358] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-09T17:57:32.314431] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-09T17:57:32.314682] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-09T17:57:32.314743] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-09T17:57:32.315176] [DEBUG] [LOCAL ] CCRD: Trimmed 11851 records to 9287 (keeping 200 days of data) [2025-10-09T17:57:32.368634] [DEBUG] [LOCAL ] CCRD: Primary data saved (9287 records). [2025-10-09T17:57:32.368778] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-09T17:57:32.368858] [INFO ] [MAIN ] Update Progress: 417/2373 symbols completed. CCRD took 32.7s. Estimated remaining: 4h 29m 37s. Rate: 7.3 symbols/min [2025-10-09T17:57:32.539618] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:32.539790] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-09T17:57:32.539889] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-09T17:57:32.539970] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-09T17:57:32.540008] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-09T17:57:32.540048] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-09T17:57:32.540080] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-09T17:57:32.806365] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-09T17:57:32.890397] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:32.995301] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T17:57:33.596754] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-09T17:57:34.229308] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:57:34.396752] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-09T17:57:34.793793] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-09T17:57:35.201783] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-09T17:57:35.214223] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T17:57:35.735301] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-09T17:57:35.996786] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-09T17:57:36.796809] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-09T17:57:37.596686] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-09T17:57:37.758149] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:57:37.764380] [INFO ] [REMOTE ] CCO: Full fetch complete (66838 records). [2025-10-09T17:57:37.764597] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-09T17:57:38.161412] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-09T17:57:38.161526] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-09T17:57:38.162426] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-09T17:57:38.162509] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-09T17:57:38.179600] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:57:38.185823] [DEBUG] [LOCAL ] CCO: Trimmed 66838 records to 48377 (keeping 200 days of data) [2025-10-09T17:57:38.396746] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-09T17:57:38.455045] [DEBUG] [LOCAL ] CCO: Primary data saved (48377 records). [2025-10-09T17:57:38.455163] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-09T17:57:38.455684] [INFO ] [MAIN ] Update Progress: 418/2373 symbols completed. CCO took 41.1s. Estimated remaining: 4h 29m 19s. Rate: 7.3 symbols/min [2025-10-09T17:57:38.639797] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T17:57:38.639455] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:38.643447] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-09T17:57:38.644828] [INFO ] [REMOTE ] CCS: Full fetch complete (44918 records). [2025-10-09T17:57:38.644906] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-09T17:57:39.015624] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-09T17:57:39.047179] [INFO ] [MAIN ] CDE: Loaded 53642 existing records. [2025-10-09T17:57:39.148246] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-09T17:57:39.159406] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-09T17:57:39.170579] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-09T17:57:39.178480] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-09T17:57:39.197250] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-09T17:57:39.231441] [DEBUG] [LOCAL ] CCS: Trimmed 44918 records to 30479 (keeping 200 days of data) [2025-10-09T17:57:39.323830] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:39.353708] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-09T17:57:39.357570] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-09T17:57:39.361954] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-09T17:57:39.362026] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-09T17:57:39.570179] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T17:57:39.745705] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:39.809281] [DEBUG] [LOCAL ] CCS: Primary data saved (30479 records). [2025-10-09T17:57:39.809419] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-09T17:57:39.809519] [INFO ] [MAIN ] Update Progress: 419/2373 symbols completed. CCS took 32.1s. Estimated remaining: 4h 28m 38s. Rate: 7.3 symbols/min [2025-10-09T17:57:39.983414] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:39.994302] [DEBUG] [LOCAL ] CDLR: Loaded 9863 existing records from primary storage. [2025-10-09T17:57:39.994496] [INFO ] [MAIN ] CDLR: Loaded 9863 existing records. [2025-10-09T17:57:40.005513] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-09T17:57:40.184229] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:40.184406] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-09T17:57:40.184453] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-09T17:57:40.184630] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-09T17:57:40.184721] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-09T17:57:40.553494] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:40.796746] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-09T17:57:41.262107] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T17:57:41.341173] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T17:57:41.596701] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-09T17:57:42.184629] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T17:57:42.396730] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-09T17:57:42.697232] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-09T17:57:43.196777] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-09T17:57:43.996788] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-09T17:57:44.796688] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-09T17:57:45.050528] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T17:57:45.169796] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-09T17:57:45.173697] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T17:57:45.596734] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-09T17:57:46.396688] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-09T17:57:46.710599] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T17:57:46.793495] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-09T17:57:47.196717] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-09T17:57:47.927382] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T17:57:47.996745] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-09T17:57:48.521462] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T17:57:48.796802] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-09T17:57:49.596732] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-09T17:57:49.823350] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:57:49.823696] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-09T17:57:49.823810] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:57:49.823906] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-09T17:57:49.823970] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:57:49.824043] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-09T17:57:49.824108] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-09T17:57:49.824151] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-09T17:57:49.824204] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-09T17:57:49.824291] [INFO ] [MAIN ] Update Progress: 420/2373 symbols completed. CCZ took 17.5s. Estimated remaining: 4h 28m 38s. Rate: 7.3 symbols/min [2025-10-09T17:57:50.003952] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:50.063977] [DEBUG] [LOCAL ] CDP: Loaded 42533 existing records from primary storage. [2025-10-09T17:57:50.064978] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T17:57:50.069991] [INFO ] [MAIN ] CDP: Loaded 42533 existing records. [2025-10-09T17:57:50.256901] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:50.257116] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-09T17:57:50.257163] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-09T17:57:50.257413] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-09T17:57:50.257469] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-09T17:57:50.401868] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-09T17:57:50.634351] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:51.011237] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T17:57:51.196787] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-09T17:57:51.996790] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-09T17:57:52.678924] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T17:57:52.779716] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:57:52.796678] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-09T17:57:53.596688] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-09T17:57:54.149855] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T17:57:54.396737] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-09T17:57:54.568563] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T17:57:55.196720] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-09T17:57:55.666705] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T17:57:55.992711] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T17:57:56.002623] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-09T17:57:56.735529] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T17:57:56.796704] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-09T17:57:57.558072] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T17:57:57.596679] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-09T17:57:58.396725] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-09T17:57:58.571086] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T17:57:58.572854] [INFO ] [REMOTE ] CDLR: Full fetch complete (13596 records). [2025-10-09T17:57:58.572928] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-09T17:57:59.002633] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-09T17:57:59.002748] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-09T17:57:59.003089] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-09T17:57:59.003132] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-09T17:57:59.003824] [DEBUG] [LOCAL ] CDLR: Trimmed 13596 records to 9990 (keeping 200 days of data) [2025-10-09T17:57:59.070951] [DEBUG] [LOCAL ] CDLR: Primary data saved (9990 records). [2025-10-09T17:57:59.071095] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-09T17:57:59.071182] [INFO ] [MAIN ] Update Progress: 421/2373 symbols completed. CDLR took 19.3s. Estimated remaining: 4h 28m 35s. Rate: 7.3 symbols/min [2025-10-09T17:57:59.201965] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-09T17:57:59.271150] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:59.295337] [DEBUG] [LOCAL ] CDRE: Loaded 24629 existing records from primary storage. [2025-10-09T17:57:59.295609] [INFO ] [MAIN ] CDRE: Loaded 24629 existing records. [2025-10-09T17:57:59.476689] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:59.476928] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-09T17:57:59.476983] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-09T17:57:59.477194] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-09T17:57:59.477251] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-09T17:57:59.835698] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:59.996738] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-09T17:58:00.295261] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T17:58:00.603324] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T17:58:00.605116] [INFO ] [REMOTE ] CCU: Full fetch complete (32381 records). [2025-10-09T17:58:00.605203] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-09T17:58:00.806883] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-09T17:58:00.994861] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-09T17:58:00.994953] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-09T17:58:00.995427] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-09T17:58:00.995469] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-09T17:58:00.996601] [DEBUG] [LOCAL ] CCU: Trimmed 32381 records to 22934 (keeping 200 days of data) [2025-10-09T17:58:01.137543] [DEBUG] [LOCAL ] CCU: Primary data saved (22934 records). [2025-10-09T17:58:01.137704] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-09T17:58:01.137798] [INFO ] [MAIN ] Update Progress: 422/2373 symbols completed. CCU took 37.0s. Estimated remaining: 4h 27m 58s. Rate: 7.3 symbols/min [2025-10-09T17:58:01.316253] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:01.333852] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T17:58:01.388766] [DEBUG] [LOCAL ] CE: Loaded 51448 existing records from primary storage. [2025-10-09T17:58:01.389081] [INFO ] [MAIN ] CE: Loaded 51448 existing records. [2025-10-09T17:58:01.576338] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:01.576558] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-09T17:58:01.576612] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-09T17:58:01.576883] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-09T17:58:01.576942] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-09T17:58:01.601940] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-09T17:58:01.941736] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:02.396782] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-09T17:58:02.441425] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T17:58:03.196714] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-09T17:58:03.689683] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-09T17:58:03.996691] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-09T17:58:04.257826] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:58:04.550517] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:58:04.796774] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-09T17:58:05.596746] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-09T17:58:05.922405] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:58:06.007172] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:58:06.396751] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-09T17:58:07.196684] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-09T17:58:07.324456] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T17:58:07.772926] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T17:58:07.996734] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-09T17:58:08.487677] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T17:58:08.796745] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-09T17:58:09.153041] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:58:09.596723] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-09T17:58:10.396705] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-09T17:58:10.593872] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T17:58:10.712175] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T17:58:11.196852] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-09T17:58:11.538324] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T17:58:11.996782] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-09T17:58:12.552780] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T17:58:12.796707] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-09T17:58:13.596718] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-09T17:58:13.677277] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T17:58:14.280292] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:58:14.396721] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-09T17:58:15.195567] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:58:15.205509] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-09T17:58:15.964197] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:58:15.996727] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-09T17:58:16.463574] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T17:58:16.796734] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-09T17:58:17.596774] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-09T17:58:17.962083] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T17:58:18.396774] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-09T17:58:18.627235] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T17:58:18.682016] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T17:58:19.196768] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-09T17:58:19.996777] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-09T17:58:20.507013] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T17:58:20.572807] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T17:58:20.796730] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-09T17:58:20.980102] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T17:58:21.596780] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-09T17:58:22.428430] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-09T17:58:22.450738] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T17:58:22.776292] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T17:58:23.196786] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-09T17:58:23.996745] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-09T17:58:24.478938] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-09T17:58:24.785062] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T17:58:24.796678] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-09T17:58:24.876968] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T17:58:24.879917] [INFO ] [REMOTE ] CDRE: Full fetch complete (35035 records). [2025-10-09T17:58:24.880107] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-09T17:58:25.305577] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-09T17:58:25.305705] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-09T17:58:25.306403] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-09T17:58:25.306458] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-09T17:58:25.307541] [DEBUG] [LOCAL ] CDRE: Trimmed 35035 records to 24827 (keeping 200 days of data) [2025-10-09T17:58:25.457207] [DEBUG] [LOCAL ] CDRE: Primary data saved (24827 records). [2025-10-09T17:58:25.457340] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-09T17:58:25.457418] [INFO ] [MAIN ] Update Progress: 423/2373 symbols completed. CDRE took 26.4s. Estimated remaining: 4h 29m 4s. Rate: 7.2 symbols/min [2025-10-09T17:58:25.607382] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-09T17:58:25.641295] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:25.650122] [DEBUG] [LOCAL ] CEE: Loaded 5614 existing records from primary storage. [2025-10-09T17:58:25.650372] [INFO ] [MAIN ] CEE: Loaded 5614 existing records. [2025-10-09T17:58:25.836847] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:25.837059] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-09T17:58:25.837107] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-09T17:58:25.837292] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-09T17:58:25.837349] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-09T17:58:26.194077] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:26.231885] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:58:26.396710] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-09T17:58:27.196699] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-09T17:58:27.224952] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T17:58:27.244108] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T17:58:27.996719] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-09T17:58:28.687163] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T17:58:28.796689] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-09T17:58:29.227975] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T17:58:29.596716] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-09T17:58:30.117611] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:58:30.396749] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-09T17:58:31.196727] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-09T17:58:31.912605] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T17:58:31.916332] [INFO ] [REMOTE ] CDP: Full fetch complete (61742 records). [2025-10-09T17:58:31.916428] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-09T17:58:32.006699] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-09T17:58:32.032844] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-09T17:58:32.054283] [INFO ] [REMOTE ] CDE: Full fetch complete (77596 records). [2025-10-09T17:58:32.100560] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-09T17:58:32.620889] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-09T17:58:32.627221] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-09T17:58:32.633895] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-09T17:58:32.639122] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-09T17:58:32.702849] [DEBUG] [LOCAL ] CDP: Trimmed 61742 records to 42803 (keeping 200 days of data) [2025-10-09T17:58:32.748392] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:58:32.770149] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-09T17:58:32.770486] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-09T17:58:32.772166] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-09T17:58:32.772313] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-09T17:58:32.773881] [DEBUG] [LOCAL ] CDE: Trimmed 77596 records to 54032 (keeping 200 days of data) [2025-10-09T17:58:32.878628] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-09T17:58:32.978544] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T17:58:32.987448] [INFO ] [REMOTE ] CE: Full fetch complete (74756 records). [2025-10-09T17:58:32.991318] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-09T17:58:33.529248] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-09T17:58:33.531463] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-09T17:58:33.532835] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-09T17:58:33.533507] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-09T17:58:33.540720] [DEBUG] [LOCAL ] CE: Trimmed 74756 records to 51809 (keeping 200 days of data) [2025-10-09T17:58:33.782072] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T17:58:33.791890] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-09T17:58:34.072892] [DEBUG] [LOCAL ] CDE: Primary data saved (54032 records). [2025-10-09T17:58:34.081884] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-09T17:58:34.086935] [INFO ] [MAIN ] Update Progress: 424/2373 symbols completed. CDE took 55.6s. Estimated remaining: 4h 28m 57s. Rate: 7.2 symbols/min [2025-10-09T17:58:34.085946] [DEBUG] [LOCAL ] CDP: Primary data saved (42803 records). [2025-10-09T17:58:34.091303] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-09T17:58:34.094822] [INFO ] [MAIN ] Update Progress: 425/2373 symbols completed. CDP took 44.3s. Estimated remaining: 4h 28m 11s. Rate: 7.3 symbols/min [2025-10-09T17:58:34.495832] [DEBUG] [LOCAL ] CE: Primary data saved (51809 records). [2025-10-09T17:58:34.537006] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:34.541182] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:34.541347] [INFO ] [MAIN ] CE: Full history saved. [2025-10-09T17:58:34.542589] [INFO ] [MAIN ] Update Progress: 426/2373 symbols completed. CE took 33.4s. Estimated remaining: 4h 27m 27s. Rate: 7.3 symbols/min [2025-10-09T17:58:34.729885] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:34.756184] [DEBUG] [LOCAL ] CEPU: Loaded 25995 existing records from primary storage. [2025-10-09T17:58:34.757147] [INFO ] [MAIN ] CEPU: Loaded 25995 existing records. [2025-10-09T17:58:34.873454] [DEBUG] [LOCAL ] CF: Loaded 52155 existing records from primary storage. [2025-10-09T17:58:34.903480] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:58:34.901975] [INFO ] [MAIN ] CF: Loaded 52155 existing records. [2025-10-09T17:58:35.003471] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-09T17:58:35.104118] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:35.131575] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-09T17:58:35.131755] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-09T17:58:35.132131] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-09T17:58:35.179665] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-09T17:58:35.269333] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:35.296340] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-09T17:58:35.318144] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-09T17:58:35.325206] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-09T17:58:35.332309] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-09T17:58:35.361225] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-09T17:58:35.349925] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-09T17:58:36.035476] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T17:58:36.088186] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-09T17:58:36.097781] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:36.150960] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:36.146622] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-09T17:58:36.164076] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-09T17:58:36.180258] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-09T17:58:36.181376] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-09T17:58:36.186816] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-09T17:58:36.393585] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:36.651229] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:36.796722] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-09T17:58:36.836259] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:58:37.428722] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T17:58:37.596736] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-09T17:58:38.257438] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-09T17:58:38.396735] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-09T17:58:38.614879] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T17:58:39.196784] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-09T17:58:39.712271] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T17:58:39.996768] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-09T17:58:40.796729] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-09T17:58:41.012346] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T17:58:41.596759] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-09T17:58:41.681495] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:58:42.264810] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:58:42.313960] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T17:58:42.396754] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-09T17:58:43.196757] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-09T17:58:43.985458] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:58:43.996669] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-09T17:58:44.408967] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T17:58:44.796702] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-09T17:58:45.512770] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T17:58:45.596705] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-09T17:58:46.396742] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-09T17:58:46.511743] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:58:47.075912] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:58:47.196723] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-09T17:58:47.468951] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T17:58:47.996725] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-09T17:58:48.796691] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-09T17:58:48.811401] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T17:58:49.020519] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:58:49.596719] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-09T17:58:50.182421] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T17:58:50.396697] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-09T17:58:50.486159] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T17:58:50.952555] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T17:58:50.953505] [INFO ] [REMOTE ] CEE: Full fetch complete (10166 records). [2025-10-09T17:58:50.953575] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-09T17:58:51.201908] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-09T17:58:51.318086] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-09T17:58:51.318168] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-09T17:58:51.318432] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-09T17:58:51.318469] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-09T17:58:51.318985] [DEBUG] [LOCAL ] CEE: Trimmed 10166 records to 5657 (keeping 200 days of data) [2025-10-09T17:58:51.352260] [DEBUG] [LOCAL ] CEE: Primary data saved (5657 records). [2025-10-09T17:58:51.352378] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-09T17:58:51.352462] [INFO ] [MAIN ] Update Progress: 427/2373 symbols completed. CEE took 25.9s. Estimated remaining: 4h 27m 58s. Rate: 7.3 symbols/min [2025-10-09T17:58:51.518002] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:51.518168] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-09T17:58:51.518204] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-09T17:58:51.518337] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-09T17:58:51.518377] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-09T17:58:51.518418] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-09T17:58:51.518489] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-09T17:58:51.865944] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:51.996699] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-09T17:58:52.191616] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:58:52.191962] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-09T17:58:52.192059] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:58:52.192110] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-09T17:58:52.192170] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:58:52.192244] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-09T17:58:52.192323] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-09T17:58:52.192366] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-09T17:58:52.192431] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-09T17:58:52.192500] [INFO ] [MAIN ] Update Progress: 428/2373 symbols completed. CFND took 0.8s. Estimated remaining: 4h 27m 16s. Rate: 7.3 symbols/min [2025-10-09T17:58:52.360180] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:52.395834] [DEBUG] [LOCAL ] CFR: Loaded 32900 existing records from primary storage. [2025-10-09T17:58:52.396122] [INFO ] [MAIN ] CFR: Loaded 32900 existing records. [2025-10-09T17:58:52.576727] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:52.576959] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-09T17:58:52.577006] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-09T17:58:52.577345] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-09T17:58:52.577418] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-09T17:58:52.809301] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-09T17:58:52.940957] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:52.971607] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T17:58:53.596722] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-09T17:58:54.224447] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:58:54.396725] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-09T17:58:55.041830] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T17:58:55.196714] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-09T17:58:55.534994] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T17:58:55.996714] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-09T17:58:56.796692] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-09T17:58:57.060828] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:58:57.174970] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T17:58:57.596729] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-09T17:58:58.396806] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-09T17:58:58.672888] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T17:58:58.881626] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T17:58:59.196715] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-09T17:58:59.996748] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-09T17:59:00.047459] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T17:59:00.796750] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-09T17:59:01.048479] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T17:59:01.341307] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:59:01.596729] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-09T17:59:01.942773] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T17:59:02.396764] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-09T17:59:03.053149] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T17:59:03.196682] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-09T17:59:03.608779] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T17:59:03.996814] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-09T17:59:04.635837] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:59:04.796733] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-09T17:59:05.596859] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-09T17:59:05.766807] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T17:59:06.200252] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:59:06.396733] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-09T17:59:06.954151] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:59:06.956938] [INFO ] [REMOTE ] CEPU: Full fetch complete (39379 records). [2025-10-09T17:59:06.957027] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-09T17:59:07.206611] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-09T17:59:07.350379] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-09T17:59:07.350460] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-09T17:59:07.351032] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-09T17:59:07.351096] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-09T17:59:07.352063] [DEBUG] [LOCAL ] CEPU: Trimmed 39379 records to 26302 (keeping 200 days of data) [2025-10-09T17:59:07.515217] [DEBUG] [LOCAL ] CEPU: Primary data saved (26302 records). [2025-10-09T17:59:07.515368] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-09T17:59:07.515452] [INFO ] [MAIN ] Update Progress: 429/2373 symbols completed. CEPU took 33.4s. Estimated remaining: 4h 27m 39s. Rate: 7.3 symbols/min [2025-10-09T17:59:07.683410] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:07.721318] [DEBUG] [LOCAL ] CGAU: Loaded 43077 existing records from primary storage. [2025-10-09T17:59:07.721622] [INFO ] [MAIN ] CGAU: Loaded 43077 existing records. [2025-10-09T17:59:07.925675] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:07.925914] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-09T17:59:07.925967] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-09T17:59:07.926205] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-09T17:59:07.926282] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-09T17:59:08.002186] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-09T17:59:08.281844] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T17:59:08.296774] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-09T17:59:08.316770] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-09T17:59:08.316638] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:08.759022] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-09T17:59:08.759150] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-09T17:59:08.760637] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-09T17:59:08.760759] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-09T17:59:08.762898] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54013 (keeping 200 days of data) [2025-10-09T17:59:08.850887] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-09T17:59:09.304301] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:59:09.334393] [DEBUG] [LOCAL ] CFG: Primary data saved (54013 records). [2025-10-09T17:59:09.334730] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-09T17:59:09.335513] [INFO ] [MAIN ] Update Progress: 430/2373 symbols completed. CFG took 34.8s. Estimated remaining: 4h 27m 2s. Rate: 7.3 symbols/min [2025-10-09T17:59:09.526198] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-09T17:59:09.601896] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-09T17:59:09.630774] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:09.635563] [DEBUG] [LOCAL ] CGV: Loaded 1395 existing records from primary storage. [2025-10-09T17:59:09.635810] [INFO ] [MAIN ] CGV: Loaded 1395 existing records. [2025-10-09T17:59:09.867319] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:09.867541] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-09T17:59:09.867590] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-09T17:59:09.867834] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-09T17:59:09.867927] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-09T17:59:10.332521] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:10.396713] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-09T17:59:10.537337] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:59:10.972738] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T17:59:11.196698] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-09T17:59:11.318078] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T17:59:11.698338] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-09T17:59:11.996756] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-09T17:59:12.796715] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-09T17:59:13.337635] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T17:59:13.596726] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-09T17:59:14.198525] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:59:14.396724] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-09T17:59:15.028482] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T17:59:15.196722] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-09T17:59:15.996767] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-09T17:59:16.272172] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:59:16.430456] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T17:59:16.605532] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:59:16.796735] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-09T17:59:17.596711] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-09T17:59:18.027289] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T17:59:18.396721] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-09T17:59:18.506318] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T17:59:19.196735] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-09T17:59:19.996697] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-09T17:59:20.492287] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-09T17:59:20.615983] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T17:59:20.620172] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:59:20.796782] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-09T17:59:21.596715] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-09T17:59:21.971401] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T17:59:21.974108] [INFO ] [REMOTE ] CFR: Full fetch complete (48238 records). [2025-10-09T17:59:21.974223] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-09T17:59:22.087745] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T17:59:22.370994] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-09T17:59:22.371098] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-09T17:59:22.371735] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-09T17:59:22.371799] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-09T17:59:22.372918] [DEBUG] [LOCAL ] CFR: Trimmed 48238 records to 33080 (keeping 200 days of data) [2025-10-09T17:59:22.430256] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-09T17:59:22.586080] [DEBUG] [LOCAL ] CFR: Primary data saved (33080 records). [2025-10-09T17:59:22.586231] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-09T17:59:22.586316] [INFO ] [MAIN ] Update Progress: 431/2373 symbols completed. CFR took 30.4s. Estimated remaining: 4h 27m 16s. Rate: 7.3 symbols/min [2025-10-09T17:59:22.752029] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:22.752230] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-09T17:59:22.752270] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-09T17:59:22.752385] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-09T17:59:22.752427] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-09T17:59:22.752469] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-09T17:59:22.752501] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-09T17:59:23.104507] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:23.196750] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-09T17:59:23.996764] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-09T17:59:24.168055] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T17:59:24.415459] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T17:59:24.489621] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:59:24.796762] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-09T17:59:25.596723] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-09T17:59:26.284041] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T17:59:26.355482] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T17:59:26.396677] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-09T17:59:27.196751] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-09T17:59:27.428357] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T17:59:27.996749] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-09T17:59:28.614132] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T17:59:28.796738] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-09T17:59:29.106692] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:59:29.596736] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-09T17:59:30.396719] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-09T17:59:30.633846] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T17:59:30.662558] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T17:59:31.196791] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-09T17:59:31.749913] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T17:59:32.001812] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-09T17:59:32.010292] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:59:32.796772] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-09T17:59:33.596766] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-09T17:59:33.684746] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:59:33.689247] [INFO ] [REMOTE ] CF: Full fetch complete (75267 records). [2025-10-09T17:59:33.689419] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-09T17:59:34.019758] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T17:59:34.103124] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-09T17:59:34.103211] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-09T17:59:34.104029] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-09T17:59:34.104093] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-09T17:59:34.107154] [DEBUG] [LOCAL ] CF: Trimmed 75267 records to 52500 (keeping 200 days of data) [2025-10-09T17:59:34.405113] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-09T17:59:34.426528] [DEBUG] [LOCAL ] CF: Primary data saved (52500 records). [2025-10-09T17:59:34.426745] [INFO ] [MAIN ] CF: Full history saved. [2025-10-09T17:59:34.426839] [INFO ] [MAIN ] Update Progress: 432/2373 symbols completed. CF took 1m 0s. Estimated remaining: 4h 27m 24s. Rate: 7.3 symbols/min [2025-10-09T17:59:34.598469] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:34.649694] [DEBUG] [LOCAL ] CHD: Loaded 52208 existing records from primary storage. [2025-10-09T17:59:34.650021] [INFO ] [MAIN ] CHD: Loaded 52208 existing records. [2025-10-09T17:59:34.835819] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:34.836030] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-09T17:59:34.836079] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-09T17:59:34.836316] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-09T17:59:34.836373] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-09T17:59:35.114113] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T17:59:35.205606] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-09T17:59:35.214473] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:35.320080] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T17:59:35.996773] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-09T17:59:36.422310] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T17:59:36.520677] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T17:59:36.796742] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-09T17:59:37.596727] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-09T17:59:37.951982] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T17:59:38.209749] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:59:38.396763] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-09T17:59:39.196733] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-09T17:59:39.996679] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-09T17:59:40.034509] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T17:59:40.328892] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T17:59:40.394437] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T17:59:40.395156] [INFO ] [REMOTE ] CGV: Full fetch complete (2269 records). [2025-10-09T17:59:40.395224] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-09T17:59:40.740673] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-09T17:59:40.740762] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-09T17:59:40.740868] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-09T17:59:40.740906] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-09T17:59:40.741271] [DEBUG] [LOCAL ] CGV: Trimmed 2269 records to 1399 (keeping 200 days of data) [2025-10-09T17:59:40.750326] [DEBUG] [LOCAL ] CGV: Primary data saved (1399 records). [2025-10-09T17:59:40.750388] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-09T17:59:40.750457] [INFO ] [MAIN ] Update Progress: 433/2373 symbols completed. CGV took 31.4s. Estimated remaining: 4h 27m 7s. Rate: 7.3 symbols/min [2025-10-09T17:59:40.801893] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-09T17:59:40.928355] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:40.948399] [DEBUG] [LOCAL ] CHE: Loaded 15279 existing records from primary storage. [2025-10-09T17:59:40.948692] [INFO ] [MAIN ] CHE: Loaded 15279 existing records. [2025-10-09T17:59:41.123938] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:41.124177] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-09T17:59:41.124233] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-09T17:59:41.124479] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-09T17:59:41.124536] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-09T17:59:41.477333] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:41.596699] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-09T17:59:41.725579] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:59:42.396703] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-09T17:59:43.008855] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:59:43.196766] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-09T17:59:43.286392] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T17:59:43.996760] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-09T17:59:44.796690] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-09T17:59:44.915274] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T17:59:45.596694] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-09T17:59:45.786080] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:59:46.052853] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T17:59:46.055263] [INFO ] [REMOTE ] CHCT: Full fetch complete (34793 records). [2025-10-09T17:59:46.055337] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-09T17:59:46.406792] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-09T17:59:46.448377] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-09T17:59:46.448467] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-09T17:59:46.449180] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-09T17:59:46.449248] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-09T17:59:46.450251] [DEBUG] [LOCAL ] CHCT: Trimmed 34793 records to 24068 (keeping 200 days of data) [2025-10-09T17:59:46.600083] [DEBUG] [LOCAL ] CHCT: Primary data saved (24068 records). [2025-10-09T17:59:46.600233] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-09T17:59:46.600335] [INFO ] [MAIN ] Update Progress: 434/2373 symbols completed. CHCT took 24.0s. Estimated remaining: 4h 26m 48s. Rate: 7.3 symbols/min [2025-10-09T17:59:46.782186] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:46.782436] [DEBUG] [LOCAL ] CHGG: No existing data file found in primary storage. [2025-10-09T17:59:46.782529] [WARN ] [MAIN ] CHGG: No existing data found, performing full refresh instead. [2025-10-09T17:59:46.782680] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-09T17:59:46.782736] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-09T17:59:46.782782] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-09T17:59:46.782816] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-09T17:59:47.163662] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:47.195017] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T17:59:47.205436] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-09T17:59:47.797425] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:59:47.801799] [INFO ] [REMOTE ] CGAU: Full fetch complete (61027 records). [2025-10-09T17:59:47.801912] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-09T17:59:48.006346] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-09T17:59:48.217785] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-09T17:59:48.217913] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-09T17:59:48.219256] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-09T17:59:48.219677] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-09T17:59:48.219571] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T17:59:48.224828] [DEBUG] [LOCAL ] CGAU: Trimmed 61027 records to 43452 (keeping 200 days of data) [2025-10-09T17:59:48.477075] [DEBUG] [LOCAL ] CGAU: Primary data saved (43452 records). [2025-10-09T17:59:48.477214] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-09T17:59:48.477736] [INFO ] [MAIN ] Update Progress: 435/2373 symbols completed. CGAU took 41.0s. Estimated remaining: 4h 26m 11s. Rate: 7.3 symbols/min [2025-10-09T17:59:48.645223] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:48.686161] [DEBUG] [LOCAL ] CHH: Loaded 32293 existing records from primary storage. [2025-10-09T17:59:48.686457] [INFO ] [MAIN ] CHH: Loaded 32293 existing records. [2025-10-09T17:59:48.801856] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-09T17:59:48.866036] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:48.866450] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-09T17:59:48.866517] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-09T17:59:48.866774] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-09T17:59:48.866833] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-09T17:59:49.225597] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:49.596733] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-09T17:59:49.983451] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T17:59:50.396688] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-09T17:59:50.730297] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:59:51.033490] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T17:59:51.196733] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-09T17:59:51.853353] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T17:59:51.996672] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-09T17:59:52.325075] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:59:52.796702] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-09T17:59:53.485326] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T17:59:53.596696] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-09T17:59:54.120840] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T17:59:54.396697] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-09T17:59:54.541196] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:59:55.196756] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-09T17:59:55.996686] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-09T17:59:56.080495] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T17:59:56.640618] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T17:59:56.796705] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-09T17:59:57.596756] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-09T17:59:57.771282] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T17:59:57.848972] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T17:59:58.396692] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-09T17:59:58.420573] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T17:59:59.196776] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-09T17:59:59.996772] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-09T18:00:00.434804] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T18:00:00.796775] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-09T18:00:01.138759] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-09T18:00:01.216921] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:00:01.596864] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-09T18:00:01.971566] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T18:00:02.396745] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-09T18:00:03.196688] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-09T18:00:03.410801] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T18:00:03.853521] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-09T18:00:03.858256] [INFO ] [REMOTE ] CHD: Full fetch complete (74456 records). [2025-10-09T18:00:03.858436] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-09T18:00:04.001811] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-09T18:00:04.273174] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-09T18:00:04.273318] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-09T18:00:04.274274] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-09T18:00:04.274388] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-09T18:00:04.276436] [DEBUG] [LOCAL ] CHD: Trimmed 74456 records to 52580 (keeping 200 days of data) [2025-10-09T18:00:04.359289] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T18:00:04.638961] [DEBUG] [LOCAL ] CHD: Primary data saved (52580 records). [2025-10-09T18:00:04.639108] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-09T18:00:04.640786] [INFO ] [MAIN ] Update Progress: 436/2373 symbols completed. CHD took 30.2s. Estimated remaining: 4h 26m 38s. Rate: 7.3 symbols/min [2025-10-09T18:00:04.802731] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-09T18:00:04.821199] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:04.844994] [DEBUG] [LOCAL ] CHMI: Loaded 21661 existing records from primary storage. [2025-10-09T18:00:04.845240] [INFO ] [MAIN ] CHMI: Loaded 21661 existing records. [2025-10-09T18:00:05.021488] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:05.021715] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-09T18:00:05.021770] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-09T18:00:05.022058] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-09T18:00:05.022125] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-09T18:00:05.379971] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:05.596736] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-09T18:00:06.015606] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T18:00:06.165421] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:00:06.396713] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-09T18:00:06.530094] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T18:00:07.196717] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-09T18:00:07.531253] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T18:00:07.996719] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-09T18:00:08.230508] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T18:00:08.711600] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T18:00:08.796713] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-09T18:00:09.596703] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-09T18:00:10.078047] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T18:00:10.396714] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-09T18:00:10.488466] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T18:00:11.196673] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-09T18:00:11.596078] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T18:00:11.996763] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-09T18:00:12.247046] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T18:00:12.796728] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-09T18:00:13.596752] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-09T18:00:13.661527] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T18:00:13.979002] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T18:00:14.396771] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-09T18:00:14.821272] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:00:15.197501] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-09T18:00:15.199208] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-09T18:00:15.201333] [INFO ] [REMOTE ] CHE: Full fetch complete (20066 records). [2025-10-09T18:00:15.201425] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-09T18:00:15.201982] [FATAL] [VALIDATOR ] CHE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:00:15.202108] [FATAL] [MAIN ] CHE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:00:15.202192] [WARN ] [MAIN ] CHE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:00:15.202285] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-09T18:00:15.202389] [DEBUG] [LOCAL ] CHE: No primary data file found to delete. [2025-10-09T18:00:15.202453] [INFO ] [LOCAL ] CHE: Starting deletion of derivative data. [2025-10-09T18:00:15.202809] [DEBUG] [LOCAL ] CHE: Deleted derivative data file. [2025-10-09T18:00:15.202932] [INFO ] [MAIN ] Update Progress: 437/2373 symbols completed. CHE took 34.5s. Estimated remaining: 4h 26m 40s. Rate: 7.3 symbols/min [2025-10-09T18:00:15.996711] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-09T18:00:16.576726] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:00:16.796761] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-09T18:00:17.584811] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:00:17.596690] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-09T18:00:18.022942] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T18:00:18.396724] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-09T18:00:19.196741] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-09T18:00:19.806572] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T18:00:19.809843] [INFO ] [REMOTE ] CHH: Full fetch complete (47142 records). [2025-10-09T18:00:19.809938] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-09T18:00:20.137305] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-09T18:00:20.224906] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-09T18:00:20.242587] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-09T18:00:20.242677] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-09T18:00:20.243284] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-09T18:00:20.243326] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-09T18:00:20.244341] [DEBUG] [LOCAL ] CHH: Trimmed 47142 records to 32538 (keeping 200 days of data) [2025-10-09T18:00:20.363891] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:00:20.476253] [DEBUG] [LOCAL ] CHH: Primary data saved (32538 records). [2025-10-09T18:00:20.476401] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-09T18:00:20.477177] [INFO ] [MAIN ] Update Progress: 438/2373 symbols completed. CHH took 32.0s. Estimated remaining: 4h 26m 19s. Rate: 7.3 symbols/min [2025-10-09T18:00:20.796766] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-09T18:00:21.967478] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T18:00:21.972345] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-09T18:00:22.229984] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T18:00:22.396759] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-09T18:00:23.076739] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T18:00:23.196759] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-09T18:00:23.941188] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:00:23.996669] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-09T18:00:24.396372] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T18:00:24.796684] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-09T18:00:24.929516] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T18:00:24.931394] [INFO ] [REMOTE ] CHMI: Full fetch complete (31671 records). [2025-10-09T18:00:24.931467] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-09T18:00:24.932037] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:00:24.932125] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:00:24.932180] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:00:24.932265] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-09T18:00:24.932340] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-09T18:00:24.932390] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-10-09T18:00:24.932606] [DEBUG] [LOCAL ] CHMI: Deleted derivative data file. [2025-10-09T18:00:24.932749] [INFO ] [MAIN ] Update Progress: 439/2373 symbols completed. CHMI took 20.3s. Estimated remaining: 4h 25m 54s. Rate: 7.3 symbols/min [2025-10-09T18:00:26.507389] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T18:00:26.517840] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-09T18:00:28.266031] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:00:28.270505] [INFO ] [REMOTE ] CHGG: Full fetch complete (70386 records). [2025-10-09T18:00:28.270706] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-09T18:00:28.652420] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-09T18:00:28.652502] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-09T18:00:28.653310] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-09T18:00:28.653376] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-09T18:00:28.654742] [DEBUG] [LOCAL ] CHGG: Trimmed 70386 records to 48154 (keeping 200 days of data) [2025-10-09T18:00:28.930292] [DEBUG] [LOCAL ] CHGG: Primary data saved (48154 records). [2025-10-09T18:00:28.930431] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-09T18:00:28.930516] [INFO ] [MAIN ] Update Progress: 440/2373 symbols completed. CHGG took 42.3s. Estimated remaining: 4h 25m 27s. Rate: 7.3 symbols/min [2025-10-09T18:00:29.591224] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:29.629812] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:29.645251] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-09T18:00:29.645403] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-09T18:00:29.684992] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-09T18:00:29.685234] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-09T18:00:29.682103] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:29.685667] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-09T18:00:29.685739] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-09T18:00:29.687467] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-09T18:00:29.686825] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:29.687393] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-09T18:00:29.687783] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-09T18:00:29.688025] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-09T18:00:29.711908] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-09T18:00:29.721692] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-09T18:00:29.765079] [DEBUG] [LOCAL ] CHN: Loaded 4753 existing records from primary storage. [2025-10-09T18:00:29.819153] [INFO ] [MAIN ] CHN: Loaded 4753 existing records. [2025-10-09T18:00:30.345907] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-09T18:00:30.339380] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:30.397578] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-09T18:00:30.422098] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-09T18:00:30.467756] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-09T18:00:30.554680] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-09T18:00:30.559950] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-09T18:00:30.882473] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:30.946268] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:30.960457] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-09T18:00:31.019669] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-09T18:00:31.053930] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:31.054187] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-09T18:00:31.077691] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-09T18:00:31.082254] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-09T18:00:31.082487] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-09T18:00:31.476898] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:31.503192] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-09T18:00:31.695117] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:31.695411] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-09T18:00:32.226884] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T18:00:32.228778] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-09T18:00:32.324114] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T18:00:32.328035] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-09T18:00:32.883545] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:00:32.885543] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-09T18:00:33.224004] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T18:00:33.227789] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-09T18:00:33.487328] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T18:00:33.489533] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-09T18:00:33.537582] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-09T18:00:33.596688] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-09T18:00:33.680348] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T18:00:33.989634] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T18:00:34.106822] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T18:00:34.396743] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-09T18:00:35.016908] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T18:00:35.196763] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-09T18:00:35.740273] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-09T18:00:35.948518] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T18:00:35.996683] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-09T18:00:36.580985] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T18:00:36.796683] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-09T18:00:37.596726] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-09T18:00:38.396735] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-09T18:00:38.828475] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-09T18:00:39.196745] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-09T18:00:39.240549] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T18:00:39.708318] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-09T18:00:39.996734] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-09T18:00:40.501768] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T18:00:40.796736] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-09T18:00:40.961968] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T18:00:41.341322] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T18:00:41.596747] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-09T18:00:42.396756] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-09T18:00:42.770890] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T18:00:43.196715] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-09T18:00:43.996706] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-09T18:00:44.012061] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T18:00:44.397832] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T18:00:44.796689] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-09T18:00:45.187358] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:00:45.386717] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:00:45.387556] [INFO ] [REMOTE ] CHN: Full fetch complete (7404 records). [2025-10-09T18:00:45.387623] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-09T18:00:45.602889] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-09T18:00:45.743961] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-09T18:00:45.744029] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-09T18:00:45.744220] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-09T18:00:45.744257] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-09T18:00:45.744629] [DEBUG] [LOCAL ] CHN: Trimmed 7404 records to 4772 (keeping 200 days of data) [2025-10-09T18:00:45.776293] [DEBUG] [LOCAL ] CHN: Primary data saved (4772 records). [2025-10-09T18:00:45.776405] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-09T18:00:45.776513] [INFO ] [MAIN ] Update Progress: 441/2373 symbols completed. CHN took 16.8s. Estimated remaining: 4h 25m 56s. Rate: 7.3 symbols/min [2025-10-09T18:00:45.943253] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:45.992835] [DEBUG] [LOCAL ] CI: Loaded 49812 existing records from primary storage. [2025-10-09T18:00:45.993143] [INFO ] [MAIN ] CI: Loaded 49812 existing records. [2025-10-09T18:00:46.167113] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:46.167334] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-09T18:00:46.167382] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-09T18:00:46.167821] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-09T18:00:46.167907] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-09T18:00:46.404136] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-09T18:00:46.520497] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:47.196726] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-09T18:00:47.788053] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-09T18:00:47.815992] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T18:00:47.996708] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-09T18:00:48.308582] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T18:00:48.796760] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-09T18:00:49.596748] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-09T18:00:49.787721] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T18:00:50.396738] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-09T18:00:50.451531] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T18:00:50.700722] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T18:00:51.196714] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-09T18:00:51.996686] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-09T18:00:52.196304] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T18:00:52.303520] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T18:00:52.796712] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-09T18:00:53.442861] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:00:53.596724] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-09T18:00:54.402816] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-09T18:00:54.422041] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:00:54.658259] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T18:00:55.196764] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-09T18:00:56.010842] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-09T18:00:56.013744] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T18:00:56.080103] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T18:00:56.082123] [INFO ] [REMOTE ] CHT: Full fetch complete (27547 records). [2025-10-09T18:00:56.082200] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-09T18:00:56.442763] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-09T18:00:56.442846] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-09T18:00:56.443297] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-09T18:00:56.443337] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-09T18:00:56.444051] [DEBUG] [LOCAL ] CHT: Trimmed 27547 records to 19652 (keeping 200 days of data) [2025-10-09T18:00:56.563442] [DEBUG] [LOCAL ] CHT: Primary data saved (19652 records). [2025-10-09T18:00:56.563598] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-09T18:00:56.563698] [INFO ] [MAIN ] Update Progress: 442/2373 symbols completed. CHT took 27.6s. Estimated remaining: 4h 25m 59s. Rate: 7.3 symbols/min [2025-10-09T18:00:56.735250] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:56.751826] [DEBUG] [LOCAL ] CIA: Loaded 16834 existing records from primary storage. [2025-10-09T18:00:56.752069] [INFO ] [MAIN ] CIA: Loaded 16834 existing records. [2025-10-09T18:00:56.805174] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-09T18:00:56.927940] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:56.928158] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-09T18:00:56.928204] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-09T18:00:56.928388] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-09T18:00:56.928445] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-09T18:00:57.270676] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:57.596702] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-09T18:00:57.710512] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T18:00:58.396745] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-09T18:00:58.491330] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:00:59.104189] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-09T18:00:59.196746] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-09T18:00:59.843417] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T18:00:59.996691] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-09T18:01:00.179564] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:01:00.796768] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-09T18:01:01.596759] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-09T18:01:01.917044] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:01:01.964050] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T18:01:02.396739] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-09T18:01:03.196734] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-09T18:01:03.544162] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T18:01:03.996701] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-09T18:01:04.506943] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T18:01:04.796715] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-09T18:01:05.001775] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:01:05.004790] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T18:01:05.596722] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-09T18:01:06.396737] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-09T18:01:06.522783] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T18:01:06.810548] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T18:01:07.196717] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-09T18:01:08.001875] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-09T18:01:08.021198] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T18:01:08.425828] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T18:01:08.796700] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-09T18:01:09.162138] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T18:01:09.596945] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-09T18:01:10.396756] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-09T18:01:10.776521] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T18:01:11.196710] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-09T18:01:11.385228] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T18:01:11.807313] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-09T18:01:11.996798] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-09T18:01:12.796792] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-09T18:01:13.383347] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T18:01:13.551182] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T18:01:13.596695] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-09T18:01:14.067141] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-09T18:01:14.071617] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-10-09T18:01:14.071758] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-09T18:01:14.401891] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-09T18:01:14.489255] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-09T18:01:14.489332] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-09T18:01:14.490198] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-09T18:01:14.490261] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-09T18:01:14.491812] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 54043 (keeping 200 days of data) [2025-10-09T18:01:14.593796] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T18:01:14.834138] [DEBUG] [LOCAL ] CHWY: Primary data saved (54043 records). [2025-10-09T18:01:14.834278] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-09T18:01:14.834362] [INFO ] [MAIN ] Update Progress: 443/2373 symbols completed. CHWY took 45.9s. Estimated remaining: 4h 26m 35s. Rate: 7.2 symbols/min [2025-10-09T18:01:15.014009] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:15.054388] [DEBUG] [LOCAL ] CIB: Loaded 30591 existing records from primary storage. [2025-10-09T18:01:15.054709] [INFO ] [MAIN ] CIB: Loaded 30591 existing records. [2025-10-09T18:01:15.201831] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-09T18:01:15.242761] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:01:15.242999] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-09T18:01:15.243056] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-09T18:01:15.243308] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-09T18:01:15.243367] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-09T18:01:15.658994] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:15.943306] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:01:15.996677] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-09T18:01:16.180342] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:01:16.796753] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-09T18:01:16.891858] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T18:01:16.893447] [INFO ] [REMOTE ] CIA: Full fetch complete (23507 records). [2025-10-09T18:01:16.893520] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-09T18:01:17.258279] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-09T18:01:17.258358] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-09T18:01:17.258790] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-09T18:01:17.258866] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-09T18:01:17.259580] [DEBUG] [LOCAL ] CIA: Trimmed 23507 records to 16925 (keeping 200 days of data) [2025-10-09T18:01:17.351140] [DEBUG] [LOCAL ] CIA: Primary data saved (16925 records). [2025-10-09T18:01:17.351271] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-09T18:01:17.351351] [INFO ] [MAIN ] Update Progress: 444/2373 symbols completed. CIA took 20.8s. Estimated remaining: 4h 26m 1s. Rate: 7.3 symbols/min [2025-10-09T18:01:17.518975] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:17.519161] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-09T18:01:17.519203] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-09T18:01:17.519324] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-09T18:01:17.519365] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-09T18:01:17.519405] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-09T18:01:17.519436] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-09T18:01:17.601951] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-09T18:01:17.885516] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:18.193399] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T18:01:18.197013] [INFO ] [REMOTE ] CHPT: Full fetch complete (72112 records). [2025-10-09T18:01:18.197126] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-09T18:01:18.399638] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-09T18:01:18.601068] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-09T18:01:18.601153] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-09T18:01:18.601965] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-09T18:01:18.602030] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-09T18:01:18.603536] [DEBUG] [LOCAL ] CHPT: Trimmed 72112 records to 48419 (keeping 200 days of data) [2025-10-09T18:01:18.721967] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:01:18.924625] [DEBUG] [LOCAL ] CHPT: Primary data saved (48419 records). [2025-10-09T18:01:18.924796] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-09T18:01:18.924874] [INFO ] [MAIN ] Update Progress: 445/2373 symbols completed. CHPT took 50.0s. Estimated remaining: 4h 25m 24s. Rate: 7.3 symbols/min [2025-10-09T18:01:19.099339] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:19.099508] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-09T18:01:19.099546] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-09T18:01:19.099687] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-09T18:01:19.099774] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-09T18:01:19.099850] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-09T18:01:19.099898] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-09T18:01:19.199816] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-09T18:01:19.466262] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:19.996701] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-09T18:01:20.122574] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T18:01:20.182411] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:01:20.544309] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T18:01:20.796701] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-09T18:01:21.596780] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-09T18:01:22.070317] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T18:01:22.307162] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T18:01:22.311343] [INFO ] [REMOTE ] CI: Full fetch complete (71873 records). [2025-10-09T18:01:22.311473] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-09T18:01:22.312464] [FATAL] [VALIDATOR ] CI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:01:22.312575] [FATAL] [MAIN ] CI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:01:22.312690] [WARN ] [MAIN ] CI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:01:22.312783] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-09T18:01:22.312871] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-09T18:01:22.312952] [INFO ] [LOCAL ] CI: Starting deletion of derivative data. [2025-10-09T18:01:22.313258] [DEBUG] [LOCAL ] CI: Deleted derivative data file. [2025-10-09T18:01:22.313388] [INFO ] [MAIN ] Update Progress: 446/2373 symbols completed. CI took 36.5s. Estimated remaining: 4h 24m 55s. Rate: 7.3 symbols/min [2025-10-09T18:01:22.401830] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-09T18:01:22.527064] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:22.533976] [DEBUG] [LOCAL ] CIF: Loaded 4097 existing records from primary storage. [2025-10-09T18:01:22.534142] [INFO ] [MAIN ] CIF: Loaded 4097 existing records. [2025-10-09T18:01:22.730519] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:01:22.730761] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-09T18:01:22.730815] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-09T18:01:22.731028] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-09T18:01:22.731086] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-09T18:01:23.086782] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:23.196729] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-09T18:01:23.922463] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T18:01:23.996709] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-09T18:01:24.151818] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T18:01:24.600306] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:01:24.796726] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-09T18:01:25.356328] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:01:25.596706] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-09T18:01:26.284467] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T18:01:26.396721] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-09T18:01:26.680285] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-09T18:01:27.196727] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-09T18:01:27.605266] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T18:01:27.996731] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-09T18:01:28.796762] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-09T18:01:29.217846] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:01:29.438497] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:01:29.596712] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-09T18:01:30.396721] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-09T18:01:30.877384] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T18:01:30.905926] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T18:01:31.196775] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-09T18:01:31.491257] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-09T18:01:31.996744] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-09T18:01:32.756849] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T18:01:32.796736] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-09T18:01:33.436090] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T18:01:33.596714] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-09T18:01:34.190963] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T18:01:34.396689] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-09T18:01:35.196767] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-09T18:01:35.996723] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-09T18:01:36.041597] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T18:01:36.515094] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-09T18:01:36.538146] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:01:36.796737] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-09T18:01:37.596772] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-09T18:01:38.012829] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T18:01:38.396709] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-09T18:01:38.443735] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:01:39.196721] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-09T18:01:39.620455] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T18:01:39.630860] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:01:39.996770] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-09T18:01:40.796778] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-09T18:01:41.596767] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-09T18:01:41.723712] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:01:41.946173] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T18:01:42.184212] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T18:01:42.396776] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-09T18:01:43.058412] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-09T18:01:43.196736] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-09T18:01:43.996718] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-09T18:01:44.446667] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T18:01:44.796763] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-09T18:01:45.085352] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T18:01:45.130998] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T18:01:45.596759] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-09T18:01:46.396764] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-09T18:01:47.015575] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T18:01:47.016997] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T18:01:47.196673] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-09T18:01:47.996758] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-09T18:01:48.623354] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:01:48.624176] [INFO ] [REMOTE ] CIF: Full fetch complete (6586 records). [2025-10-09T18:01:48.624244] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-09T18:01:48.818194] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-09T18:01:49.006891] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-09T18:01:49.007099] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-09T18:01:49.007310] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-09T18:01:49.007384] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-09T18:01:49.008099] [DEBUG] [LOCAL ] CIF: Trimmed 6586 records to 4108 (keeping 200 days of data) [2025-10-09T18:01:49.059029] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T18:01:49.072623] [DEBUG] [LOCAL ] CIF: Primary data saved (4108 records). [2025-10-09T18:01:49.073180] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-09T18:01:49.073272] [INFO ] [MAIN ] Update Progress: 447/2373 symbols completed. CIF took 26.8s. Estimated remaining: 4h 26m 6s. Rate: 7.2 symbols/min [2025-10-09T18:01:49.238223] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:49.277450] [DEBUG] [LOCAL ] CIG: Loaded 43848 existing records from primary storage. [2025-10-09T18:01:49.277768] [INFO ] [MAIN ] CIG: Loaded 43848 existing records. [2025-10-09T18:01:49.359363] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T18:01:49.381494] [INFO ] [REMOTE ] CICB: Full fetch complete (1991 records). [2025-10-09T18:01:49.381602] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-09T18:01:49.382049] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:01:49.382157] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:01:49.382203] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:01:49.382242] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-09T18:01:49.387963] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-09T18:01:49.403730] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-09T18:01:49.422331] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-09T18:01:49.434812] [INFO ] [MAIN ] Update Progress: 448/2373 symbols completed. CICB took 32.1s. Estimated remaining: 4h 25m 24s. Rate: 7.3 symbols/min [2025-10-09T18:01:49.508962] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:01:49.542909] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-09T18:01:49.559959] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-09T18:01:49.571520] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-09T18:01:49.582099] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-09T18:01:49.603235] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-09T18:01:49.711221] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:49.716577] [DEBUG] [LOCAL ] CII: No existing data file found in primary storage. [2025-10-09T18:01:49.723553] [WARN ] [MAIN ] CII: No existing data found, performing full refresh instead. [2025-10-09T18:01:49.728927] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-09T18:01:49.750721] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-09T18:01:49.772455] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-09T18:01:49.810094] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-09T18:01:50.310973] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:50.408458] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-09T18:01:50.414418] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:51.196740] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-09T18:01:51.421967] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T18:01:51.793952] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T18:01:51.996694] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-09T18:01:52.202477] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T18:01:52.796768] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-09T18:01:53.397887] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T18:01:53.596688] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-09T18:01:53.795433] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:01:54.396719] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-09T18:01:54.760146] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:01:54.762852] [INFO ] [REMOTE ] CIB: Full fetch complete (44582 records). [2025-10-09T18:01:54.762997] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-09T18:01:55.151254] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-09T18:01:55.151588] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T18:01:55.151728] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-09T18:01:55.155956] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-09T18:01:55.156023] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-09T18:01:55.156924] [DEBUG] [LOCAL ] CIB: Trimmed 44582 records to 30800 (keeping 200 days of data) [2025-10-09T18:01:55.206801] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-09T18:01:55.341768] [DEBUG] [LOCAL ] CIB: Primary data saved (30800 records). [2025-10-09T18:01:55.341903] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-09T18:01:55.341984] [INFO ] [MAIN ] Update Progress: 449/2373 symbols completed. CIB took 40.5s. Estimated remaining: 4h 25m 5s. Rate: 7.3 symbols/min [2025-10-09T18:01:55.514363] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:55.514546] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-10-09T18:01:55.514606] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-10-09T18:01:55.514759] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-09T18:01:55.514802] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-09T18:01:55.514842] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-09T18:01:55.514873] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-09T18:01:55.865821] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:55.996704] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-09T18:01:56.796751] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-09T18:01:57.244860] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T18:01:57.545081] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:01:57.596667] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-09T18:01:58.396686] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-09T18:01:58.478355] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T18:01:59.061414] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:01:59.196686] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-09T18:01:59.296711] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T18:01:59.996723] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-09T18:02:00.703126] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T18:02:00.796715] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-09T18:02:01.052449] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T18:02:01.596703] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-09T18:02:02.039548] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T18:02:02.396897] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-09T18:02:03.051814] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T18:02:03.055805] [INFO ] [REMOTE ] CIEN: Full fetch complete (75173 records). [2025-10-09T18:02:03.055931] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-09T18:02:03.056751] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:02:03.056843] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:02:03.056889] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:02:03.056932] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-09T18:02:03.056991] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-09T18:02:03.057029] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-09T18:02:03.057096] [DEBUG] [LOCAL ] CIEN: No derivative data file found to delete. [2025-10-09T18:02:03.057219] [INFO ] [MAIN ] Update Progress: 450/2373 symbols completed. CIEN took 44.1s. Estimated remaining: 4h 24m 55s. Rate: 7.3 symbols/min [2025-10-09T18:02:03.206395] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-09T18:02:03.243172] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:03.249703] [DEBUG] [LOCAL ] CIMN: Loaded 2733 existing records from primary storage. [2025-10-09T18:02:03.250203] [INFO ] [MAIN ] CIMN: Loaded 2733 existing records. [2025-10-09T18:02:03.364350] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:02:03.445413] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:03.445722] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-09T18:02:03.445782] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-09T18:02:03.445983] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-09T18:02:03.446040] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-09T18:02:03.814779] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:03.996718] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-09T18:02:04.796694] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-09T18:02:04.889329] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T18:02:05.392116] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:02:05.552745] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T18:02:05.596663] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-09T18:02:06.396704] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-09T18:02:06.861252] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T18:02:07.146118] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:02:07.196687] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-09T18:02:07.653314] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T18:02:07.996786] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-09T18:02:08.775423] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T18:02:08.796703] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-09T18:02:09.596695] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-09T18:02:09.659900] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T18:02:10.020022] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:02:10.396719] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-09T18:02:10.961610] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T18:02:11.196754] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-09T18:02:11.996746] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-09T18:02:12.251720] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T18:02:12.796754] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-09T18:02:13.286576] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T18:02:13.501701] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T18:02:13.596712] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-09T18:02:14.396849] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-09T18:02:15.196704] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-09T18:02:15.493522] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T18:02:15.816495] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T18:02:15.996724] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-09T18:02:16.034045] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T18:02:16.796725] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-09T18:02:17.370308] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T18:02:17.455915] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T18:02:17.596699] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-09T18:02:18.396696] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-09T18:02:18.462107] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T18:02:18.464241] [INFO ] [REMOTE ] CII: Full fetch complete (22959 records). [2025-10-09T18:02:18.464351] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-09T18:02:18.857454] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-09T18:02:18.857541] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-09T18:02:18.857987] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-09T18:02:18.858051] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-09T18:02:18.858706] [DEBUG] [LOCAL ] CII: Trimmed 22959 records to 15402 (keeping 200 days of data) [2025-10-09T18:02:18.930062] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T18:02:18.958760] [DEBUG] [LOCAL ] CII: Primary data saved (15402 records). [2025-10-09T18:02:18.958909] [INFO ] [MAIN ] CII: Full history saved. [2025-10-09T18:02:18.959020] [INFO ] [MAIN ] Update Progress: 451/2373 symbols completed. CII took 29.5s. Estimated remaining: 4h 25m 19s. Rate: 7.2 symbols/min [2025-10-09T18:02:19.124181] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:19.124331] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-09T18:02:19.124368] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-09T18:02:19.124475] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-09T18:02:19.124516] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-09T18:02:19.124556] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-09T18:02:19.124588] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-09T18:02:19.201885] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-09T18:02:19.482019] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:19.996723] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-09T18:02:20.721255] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T18:02:20.796734] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-09T18:02:20.889781] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:02:21.596715] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-09T18:02:22.062117] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:02:22.111738] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:02:22.396774] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-09T18:02:23.196742] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-09T18:02:23.717993] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T18:02:23.996756] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-09T18:02:24.025232] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:02:24.452942] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T18:02:24.796705] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-09T18:02:25.596723] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-09T18:02:26.386902] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:02:26.396675] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-09T18:02:26.926615] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T18:02:27.196725] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-09T18:02:27.372134] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:02:27.631418] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T18:02:27.632264] [INFO ] [REMOTE ] CIMN: Full fetch complete (3915 records). [2025-10-09T18:02:27.632332] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-09T18:02:27.632699] [FATAL] [VALIDATOR ] CIMN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:02:27.632782] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:02:27.632825] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:02:27.632862] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-09T18:02:27.632940] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-09T18:02:27.632994] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-10-09T18:02:27.633207] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-10-09T18:02:27.633294] [INFO ] [MAIN ] Update Progress: 452/2373 symbols completed. CIMN took 24.6s. Estimated remaining: 4h 25m 12s. Rate: 7.2 symbols/min [2025-10-09T18:02:27.799421] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:27.799612] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-09T18:02:27.799690] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-09T18:02:27.799806] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-09T18:02:27.799847] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-09T18:02:27.799918] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-09T18:02:27.799961] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-09T18:02:28.001919] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-09T18:02:28.152922] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:28.796686] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-09T18:02:29.596750] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-09T18:02:29.742827] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:02:30.102795] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T18:02:30.180465] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T18:02:30.396726] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-09T18:02:31.088145] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T18:02:31.196729] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-09T18:02:31.473969] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-09T18:02:31.996761] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-09T18:02:32.188722] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:02:32.188957] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-09T18:02:32.189056] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:02:32.189135] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-09T18:02:32.189202] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:02:32.189274] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-09T18:02:32.189372] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-09T18:02:32.189416] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-09T18:02:32.189473] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-09T18:02:32.189542] [INFO ] [MAIN ] Update Progress: 453/2373 symbols completed. CIMP took 4.6s. Estimated remaining: 4h 24m 48s. Rate: 7.3 symbols/min [2025-10-09T18:02:32.354839] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:32.373319] [DEBUG] [LOCAL ] CINT: Loaded 19416 existing records from primary storage. [2025-10-09T18:02:32.373550] [INFO ] [MAIN ] CINT: Loaded 19416 existing records. [2025-10-09T18:02:32.553425] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:32.553666] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-09T18:02:32.553727] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-09T18:02:32.553958] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-09T18:02:32.554016] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-09T18:02:32.801833] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-09T18:02:32.916772] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:33.596770] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-09T18:02:34.164373] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T18:02:34.396763] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-09T18:02:34.656116] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T18:02:35.196758] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-09T18:02:35.820680] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T18:02:35.830950] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T18:02:35.834722] [INFO ] [REMOTE ] CIM: Full fetch complete (54998 records). [2025-10-09T18:02:35.834869] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-09T18:02:36.000078] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-09T18:02:36.245545] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-09T18:02:36.245630] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-09T18:02:36.246356] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-09T18:02:36.246408] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-09T18:02:36.247497] [DEBUG] [LOCAL ] CIM: Trimmed 54998 records to 37987 (keeping 200 days of data) [2025-10-09T18:02:36.486984] [DEBUG] [LOCAL ] CIM: Primary data saved (37987 records). [2025-10-09T18:02:36.487471] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-09T18:02:36.487704] [INFO ] [MAIN ] Update Progress: 454/2373 symbols completed. CIM took 41.1s. Estimated remaining: 4h 24m 23s. Rate: 7.3 symbols/min [2025-10-09T18:02:36.675491] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:36.695068] [DEBUG] [LOCAL ] CIO: Loaded 20422 existing records from primary storage. [2025-10-09T18:02:36.695316] [INFO ] [MAIN ] CIO: Loaded 20422 existing records. [2025-10-09T18:02:36.808084] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-09T18:02:36.895152] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:36.895369] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-09T18:02:36.895417] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-09T18:02:36.895678] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-09T18:02:36.895739] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-09T18:02:37.030309] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T18:02:37.327984] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:37.596963] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-09T18:02:38.396723] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-09T18:02:38.585550] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T18:02:38.589798] [INFO ] [REMOTE ] CIG: Full fetch complete (61438 records). [2025-10-09T18:02:38.589936] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-09T18:02:38.883062] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T18:02:38.926378] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T18:02:39.027151] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-09T18:02:39.027247] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-09T18:02:39.028011] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-09T18:02:39.028075] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-09T18:02:39.029381] [DEBUG] [LOCAL ] CIG: Trimmed 61438 records to 44200 (keeping 200 days of data) [2025-10-09T18:02:39.202472] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-09T18:02:39.300008] [DEBUG] [LOCAL ] CIG: Primary data saved (44200 records). [2025-10-09T18:02:39.300151] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-09T18:02:39.300235] [INFO ] [MAIN ] Update Progress: 455/2373 symbols completed. CIG took 50.2s. Estimated remaining: 4h 23m 52s. Rate: 7.3 symbols/min [2025-10-09T18:02:39.467893] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:39.468126] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-09T18:02:39.468169] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-09T18:02:39.468280] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-09T18:02:39.468322] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-09T18:02:39.468362] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-09T18:02:39.468393] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-09T18:02:39.903776] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:40.001861] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-09T18:02:40.013131] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T18:02:40.796693] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-09T18:02:41.435254] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T18:02:41.603715] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-09T18:02:41.608268] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T18:02:42.211203] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T18:02:42.396795] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-09T18:02:43.196708] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-09T18:02:43.370377] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T18:02:43.996721] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-09T18:02:44.275483] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:02:44.796768] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-09T18:02:44.815118] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T18:02:45.596779] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-09T18:02:45.853914] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T18:02:46.396730] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-09T18:02:46.628485] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T18:02:47.155843] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T18:02:47.156765] [INFO ] [REMOTE ] CIMO: Full fetch complete (5180 records). [2025-10-09T18:02:47.156835] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-09T18:02:47.201984] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-09T18:02:47.336408] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T18:02:47.336616] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:02:47.336703] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:02:47.336773] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-09T18:02:47.336834] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-09T18:02:47.336869] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-09T18:02:47.336934] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-09T18:02:47.337012] [INFO ] [MAIN ] Update Progress: 456/2373 symbols completed. CIMO took 28.4s. Estimated remaining: 4h 23m 43s. Rate: 7.3 symbols/min [2025-10-09T18:02:47.501965] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:47.573497] [DEBUG] [LOCAL ] CIVI: Loaded 52615 existing records from primary storage. [2025-10-09T18:02:47.573856] [INFO ] [MAIN ] CIVI: Loaded 52615 existing records. [2025-10-09T18:02:47.750554] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:47.750770] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-09T18:02:47.750817] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-09T18:02:47.751246] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-09T18:02:47.751303] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-09T18:02:47.998806] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-09T18:02:48.109713] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:48.208739] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T18:02:48.796678] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-09T18:02:49.179714] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T18:02:49.579497] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:02:49.596670] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-09T18:02:50.275443] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T18:02:50.396730] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-09T18:02:51.196688] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-09T18:02:51.387887] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T18:02:51.996680] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-09T18:02:52.013021] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T18:02:52.796712] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-09T18:02:53.589376] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T18:02:53.596962] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-09T18:02:53.608388] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T18:02:54.396805] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-09T18:02:55.196805] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-09T18:02:55.467635] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T18:02:55.474233] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T18:02:55.987339] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T18:02:55.996701] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-09T18:02:56.796701] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-09T18:02:57.215217] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:02:57.512393] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T18:02:57.596771] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-09T18:02:58.396719] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-09T18:02:58.821599] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T18:02:58.825022] [INFO ] [REMOTE ] CINT: Full fetch complete (27460 records). [2025-10-09T18:02:58.825184] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-09T18:02:59.204569] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-09T18:02:59.206442] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-09T18:02:59.207514] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-09T18:02:59.208051] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-09T18:02:59.208119] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-09T18:02:59.208999] [DEBUG] [LOCAL ] CINT: Trimmed 27460 records to 19687 (keeping 200 days of data) [2025-10-09T18:02:59.326267] [DEBUG] [LOCAL ] CINT: Primary data saved (19687 records). [2025-10-09T18:02:59.326430] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-09T18:02:59.326516] [INFO ] [MAIN ] Update Progress: 457/2373 symbols completed. CINT took 27.1s. Estimated remaining: 4h 23m 50s. Rate: 7.3 symbols/min [2025-10-09T18:02:59.499280] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:59.519093] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T18:02:59.577196] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-09T18:02:59.577535] [INFO ] [MAIN ] CL: Loaded 53648 existing records. [2025-10-09T18:02:59.753099] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:59.753310] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-09T18:02:59.753358] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-09T18:02:59.753600] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-09T18:02:59.753688] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-09T18:02:59.997343] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-09T18:03:00.110325] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:00.198688] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T18:03:00.796738] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-09T18:03:01.587524] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T18:03:01.597214] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-09T18:03:02.396751] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-09T18:03:02.556603] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:03:02.662718] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T18:03:03.196706] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-09T18:03:03.959940] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T18:03:03.996671] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-09T18:03:04.776900] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T18:03:04.796670] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-09T18:03:05.596780] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-09T18:03:05.999888] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T18:03:06.396681] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-09T18:03:06.598954] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T18:03:06.721539] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T18:03:07.196742] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-09T18:03:07.996691] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-09T18:03:08.094898] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:03:08.527400] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T18:03:08.615100] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T18:03:08.796737] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-09T18:03:09.596709] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-09T18:03:10.396683] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-09T18:03:10.744358] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T18:03:10.751045] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T18:03:10.765350] [INFO ] [REMOTE ] CIO: Full fetch complete (29218 records). [2025-10-09T18:03:10.765796] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-09T18:03:11.164564] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-09T18:03:11.164662] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-09T18:03:11.165111] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-09T18:03:11.165154] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-09T18:03:11.165924] [DEBUG] [LOCAL ] CIO: Trimmed 29218 records to 20663 (keeping 200 days of data) [2025-10-09T18:03:11.212825] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-09T18:03:11.286167] [DEBUG] [LOCAL ] CIO: Primary data saved (20663 records). [2025-10-09T18:03:11.286602] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-09T18:03:11.286730] [INFO ] [MAIN ] Update Progress: 458/2373 symbols completed. CIO took 34.8s. Estimated remaining: 4h 23m 57s. Rate: 7.3 symbols/min [2025-10-09T18:03:11.458771] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:11.491741] [DEBUG] [LOCAL ] CLB: Loaded 33007 existing records from primary storage. [2025-10-09T18:03:11.492011] [INFO ] [MAIN ] CLB: Loaded 33007 existing records. [2025-10-09T18:03:11.680979] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:11.681351] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-09T18:03:11.681424] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-09T18:03:11.686852] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-09T18:03:11.695666] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-09T18:03:11.696142] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T18:03:12.001788] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-09T18:03:12.057564] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:12.796688] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-09T18:03:12.853199] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T18:03:13.292963] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T18:03:13.596741] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-09T18:03:14.396751] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-09T18:03:14.532591] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T18:03:15.071963] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T18:03:15.196726] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-09T18:03:15.548053] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T18:03:15.996762] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-09T18:03:16.796716] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-09T18:03:17.032922] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T18:03:17.034038] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T18:03:17.047851] [INFO ] [REMOTE ] CION: Full fetch complete (40306 records). [2025-10-09T18:03:17.048533] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-09T18:03:17.050093] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:03:17.050204] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:03:17.050293] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:03:17.050381] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-09T18:03:17.050457] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-09T18:03:17.050508] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-09T18:03:17.050559] [DEBUG] [LOCAL ] CION: No derivative data file found to delete. [2025-10-09T18:03:17.050634] [INFO ] [MAIN ] Update Progress: 459/2373 symbols completed. CION took 37.8s. Estimated remaining: 4h 23m 39s. Rate: 7.3 symbols/min [2025-10-09T18:03:17.249961] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:17.265310] [DEBUG] [LOCAL ] CLCO: Loaded 12762 existing records from primary storage. [2025-10-09T18:03:17.265549] [INFO ] [MAIN ] CLCO: Loaded 12762 existing records. [2025-10-09T18:03:17.486044] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:17.486298] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-09T18:03:17.486347] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-09T18:03:17.486600] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-09T18:03:17.486697] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-09T18:03:17.600221] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-09T18:03:17.881270] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:18.353458] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T18:03:18.396682] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-09T18:03:18.644255] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:03:19.196732] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-09T18:03:19.625113] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T18:03:19.996735] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-09T18:03:20.796695] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-09T18:03:20.842934] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T18:03:21.596748] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-09T18:03:21.682887] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T18:03:22.019732] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T18:03:22.396778] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-09T18:03:23.196690] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-09T18:03:23.259719] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:03:23.656431] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:03:23.996752] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-09T18:03:24.796712] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-09T18:03:24.959955] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:03:25.596700] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-09T18:03:25.772154] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T18:03:26.300830] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:03:26.396678] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-09T18:03:27.196701] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-09T18:03:27.244228] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T18:03:27.661858] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T18:03:27.996707] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-09T18:03:28.266357] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T18:03:28.796711] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-09T18:03:29.596689] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-09T18:03:29.869912] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T18:03:29.874753] [INFO ] [REMOTE ] CL: Full fetch complete (77620 records). [2025-10-09T18:03:29.874894] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-09T18:03:30.288062] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-09T18:03:30.288154] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-09T18:03:30.289006] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-09T18:03:30.289070] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-09T18:03:30.290598] [DEBUG] [LOCAL ] CL: Trimmed 77620 records to 54038 (keeping 200 days of data) [2025-10-09T18:03:30.396827] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-09T18:03:30.537260] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:03:30.543233] [INFO ] [REMOTE ] CIVI: Full fetch complete (75746 records). [2025-10-09T18:03:30.547046] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-09T18:03:30.890242] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:03:31.052965] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-09T18:03:31.053361] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-09T18:03:31.054619] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-09T18:03:31.055195] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-09T18:03:31.061383] [DEBUG] [LOCAL ] CIVI: Trimmed 75746 records to 53005 (keeping 200 days of data) [2025-10-09T18:03:31.196906] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-09T18:03:31.263659] [DEBUG] [LOCAL ] CL: Primary data saved (54038 records). [2025-10-09T18:03:31.289703] [INFO ] [MAIN ] CL: Full history saved. [2025-10-09T18:03:31.291188] [INFO ] [MAIN ] Update Progress: 460/2373 symbols completed. CL took 32.0s. Estimated remaining: 4h 23m 55s. Rate: 7.2 symbols/min [2025-10-09T18:03:31.487825] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:31.516100] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:03:31.619128] [DEBUG] [LOCAL ] CIVI: Primary data saved (53005 records). [2025-10-09T18:03:31.626374] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-09T18:03:31.627750] [INFO ] [MAIN ] Update Progress: 461/2373 symbols completed. CIVI took 44.3s. Estimated remaining: 4h 23m 14s. Rate: 7.3 symbols/min [2025-10-09T18:03:31.700551] [DEBUG] [LOCAL ] CLDT: Loaded 25381 existing records from primary storage. [2025-10-09T18:03:31.722620] [INFO ] [MAIN ] CLDT: Loaded 25381 existing records. [2025-10-09T18:03:31.946705] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:31.962846] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-10-09T18:03:31.962926] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-10-09T18:03:31.964888] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-09T18:03:31.965526] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-09T18:03:31.983564] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-09T18:03:31.987728] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:31.987863] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-09T18:03:31.988036] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-09T18:03:31.988105] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-09T18:03:32.001769] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-09T18:03:32.033568] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-09T18:03:32.061111] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-09T18:03:32.659666] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:32.736715] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:32.755548] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T18:03:32.796716] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-09T18:03:33.240360] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T18:03:33.596734] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-09T18:03:33.889407] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T18:03:34.396754] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-09T18:03:34.751921] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T18:03:35.196743] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-09T18:03:35.996696] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-09T18:03:36.029117] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T18:03:36.187920] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T18:03:36.796673] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-09T18:03:36.880155] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:03:37.596738] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-09T18:03:38.403040] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-09T18:03:38.425139] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:03:38.645611] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T18:03:39.196812] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-09T18:03:39.613272] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T18:03:39.616141] [INFO ] [REMOTE ] CLB: Full fetch complete (46579 records). [2025-10-09T18:03:39.616227] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-09T18:03:39.906764] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-09T18:03:40.006266] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-09T18:03:40.023579] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-09T18:03:40.023721] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-09T18:03:40.024355] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-09T18:03:40.024400] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-09T18:03:40.025459] [DEBUG] [LOCAL ] CLB: Trimmed 46579 records to 33260 (keeping 200 days of data) [2025-10-09T18:03:40.231993] [DEBUG] [LOCAL ] CLB: Primary data saved (33260 records). [2025-10-09T18:03:40.232134] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-09T18:03:40.232408] [INFO ] [MAIN ] Update Progress: 462/2373 symbols completed. CLB took 28.9s. Estimated remaining: 4h 23m 7s. Rate: 7.3 symbols/min [2025-10-09T18:03:40.402703] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:40.431896] [DEBUG] [LOCAL ] CLH: Loaded 27621 existing records from primary storage. [2025-10-09T18:03:40.432161] [INFO ] [MAIN ] CLH: Loaded 27621 existing records. [2025-10-09T18:03:40.609030] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:40.609317] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-09T18:03:40.609373] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-09T18:03:40.609585] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-09T18:03:40.609670] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-09T18:03:40.796849] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-09T18:03:40.975312] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:41.134038] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T18:03:41.596776] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-09T18:03:41.927266] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T18:03:42.396753] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-09T18:03:42.579937] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T18:03:42.968275] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T18:03:43.196731] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-09T18:03:43.996723] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-09T18:03:44.795411] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T18:03:44.797782] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-09T18:03:45.043830] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T18:03:45.596774] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-09T18:03:46.269811] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T18:03:46.396685] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-09T18:03:47.196771] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-09T18:03:47.531752] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T18:03:47.623898] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T18:03:47.813595] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T18:03:47.996841] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-09T18:03:48.796727] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-09T18:03:49.596719] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-09T18:03:50.132368] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T18:03:50.167407] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-09T18:03:50.396691] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-09T18:03:50.655468] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T18:03:51.196714] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-09T18:03:51.413171] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T18:03:51.996752] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-09T18:03:52.796710] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-09T18:03:52.950046] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:03:53.152035] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:03:53.154458] [INFO ] [REMOTE ] CLCO: Full fetch complete (22617 records). [2025-10-09T18:03:53.154566] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-09T18:03:53.546250] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-09T18:03:53.546334] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-09T18:03:53.546816] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-09T18:03:53.546879] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-09T18:03:53.547491] [DEBUG] [LOCAL ] CLCO: Trimmed 22617 records to 12916 (keeping 200 days of data) [2025-10-09T18:03:53.604940] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-09T18:03:53.628952] [DEBUG] [LOCAL ] CLCO: Primary data saved (12916 records). [2025-10-09T18:03:53.629150] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-09T18:03:53.629245] [INFO ] [MAIN ] Update Progress: 463/2373 symbols completed. CLCO took 36.6s. Estimated remaining: 4h 23m 20s. Rate: 7.3 symbols/min [2025-10-09T18:03:53.811761] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:53.824600] [DEBUG] [LOCAL ] CLPR: Loaded 10563 existing records from primary storage. [2025-10-09T18:03:53.824871] [INFO ] [MAIN ] CLPR: Loaded 10563 existing records. [2025-10-09T18:03:54.011466] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:54.011696] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-09T18:03:54.011756] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-09T18:03:54.012020] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-09T18:03:54.012078] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-09T18:03:54.382662] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T18:03:54.399400] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-09T18:03:54.405920] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:55.196725] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-09T18:03:55.299449] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:03:55.419048] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T18:03:55.996771] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-09T18:03:56.379293] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T18:03:56.796745] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-09T18:03:57.155358] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T18:03:57.596781] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-09T18:03:57.988477] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T18:03:58.306972] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T18:03:58.396717] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-09T18:03:59.196725] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-09T18:03:59.457306] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T18:03:59.459939] [INFO ] [REMOTE ] CLDT: Full fetch complete (37222 records). [2025-10-09T18:03:59.460013] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-09T18:03:59.835060] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-09T18:03:59.835139] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-09T18:03:59.835708] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-09T18:03:59.835770] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-09T18:03:59.836522] [DEBUG] [LOCAL ] CLDT: Trimmed 37222 records to 25582 (keeping 200 days of data) [2025-10-09T18:03:59.981850] [DEBUG] [LOCAL ] CLDT: Primary data saved (25582 records). [2025-10-09T18:03:59.981986] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-09T18:03:59.982066] [INFO ] [MAIN ] Update Progress: 464/2373 symbols completed. CLDT took 28.7s. Estimated remaining: 4h 23m 4s. Rate: 7.3 symbols/min [2025-10-09T18:04:00.002468] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-09T18:04:00.184577] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:00.184803] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-10-09T18:04:00.184847] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-10-09T18:04:00.184964] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-09T18:04:00.185006] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-09T18:04:00.185047] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-09T18:04:00.185078] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-09T18:04:00.551760] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:00.574722] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:04:00.796693] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-09T18:04:00.951291] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T18:04:01.596710] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-09T18:04:01.941847] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T18:04:02.396720] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-09T18:04:03.186900] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T18:04:03.196675] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-09T18:04:03.942746] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-09T18:04:03.996682] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-09T18:04:04.146991] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T18:04:04.796757] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-09T18:04:05.351116] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T18:04:05.596673] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-09T18:04:05.716756] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T18:04:06.399503] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-09T18:04:06.402479] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T18:04:07.196725] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-09T18:04:07.996696] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-09T18:04:08.237699] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T18:04:08.796741] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-09T18:04:08.981789] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T18:04:09.210906] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T18:04:09.596747] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-09T18:04:10.396722] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-09T18:04:10.746596] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-09T18:04:10.751298] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-09T18:04:10.751413] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-09T18:04:11.163267] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-09T18:04:11.163415] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-09T18:04:11.164303] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-09T18:04:11.164525] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-09T18:04:11.166254] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 54131 (keeping 200 days of data) [2025-10-09T18:04:11.221674] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-09T18:04:11.281775] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T18:04:11.323915] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:04:11.541825] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-10-09T18:04:11.541929] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-09T18:04:11.542000] [INFO ] [MAIN ] Update Progress: 465/2373 symbols completed. CLF took 39.9s. Estimated remaining: 4h 23m 9s. Rate: 7.3 symbols/min [2025-10-09T18:04:11.708150] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:11.760829] [DEBUG] [LOCAL ] CLVT: Loaded 51982 existing records from primary storage. [2025-10-09T18:04:11.761160] [INFO ] [MAIN ] CLVT: Loaded 51982 existing records. [2025-10-09T18:04:11.938445] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:11.938686] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-09T18:04:11.938743] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-09T18:04:11.939029] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-09T18:04:11.939086] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-09T18:04:12.001919] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-09T18:04:12.288066] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:12.470969] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:04:12.796707] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-09T18:04:13.596833] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-09T18:04:13.755460] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T18:04:13.970673] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T18:04:14.396750] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-09T18:04:15.158918] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:04:15.196664] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-09T18:04:15.996728] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-09T18:04:16.462180] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-09T18:04:16.775116] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T18:04:16.793302] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T18:04:16.796708] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-09T18:04:17.407679] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T18:04:17.596700] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-09T18:04:18.396714] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-09T18:04:18.746099] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T18:04:19.196825] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-09T18:04:19.724037] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T18:04:19.819115] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T18:04:19.996721] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-09T18:04:20.689363] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T18:04:20.690512] [INFO ] [REMOTE ] CLPR: Full fetch complete (16668 records). [2025-10-09T18:04:20.690579] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-09T18:04:20.801817] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-09T18:04:21.051890] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-09T18:04:21.051997] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-09T18:04:21.052375] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-09T18:04:21.052434] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-09T18:04:21.052994] [DEBUG] [LOCAL ] CLPR: Trimmed 16668 records to 10621 (keeping 200 days of data) [2025-10-09T18:04:21.114813] [DEBUG] [LOCAL ] CLPR: Primary data saved (10621 records). [2025-10-09T18:04:21.114942] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-09T18:04:21.115021] [INFO ] [MAIN ] Update Progress: 466/2373 symbols completed. CLPR took 27.5s. Estimated remaining: 4h 23m 6s. Rate: 7.2 symbols/min [2025-10-09T18:04:21.279892] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:21.300723] [DEBUG] [LOCAL ] CLW: Loaded 21669 existing records from primary storage. [2025-10-09T18:04:21.300946] [INFO ] [MAIN ] CLW: Loaded 21669 existing records. [2025-10-09T18:04:21.473399] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:21.473578] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-09T18:04:21.473623] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-09T18:04:21.473895] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-09T18:04:21.473952] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-09T18:04:21.614857] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-09T18:04:21.830470] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:21.985005] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:04:21.987502] [INFO ] [REMOTE ] CLH: Full fetch complete (41804 records). [2025-10-09T18:04:21.987574] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-09T18:04:22.353254] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-09T18:04:22.353329] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-09T18:04:22.353839] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-09T18:04:22.353909] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-09T18:04:22.354724] [DEBUG] [LOCAL ] CLH: Trimmed 41804 records to 27839 (keeping 200 days of data) [2025-10-09T18:04:22.405120] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-09T18:04:22.522198] [DEBUG] [LOCAL ] CLH: Primary data saved (27839 records). [2025-10-09T18:04:22.522325] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-09T18:04:22.522404] [INFO ] [MAIN ] Update Progress: 467/2373 symbols completed. CLH took 42.3s. Estimated remaining: 4h 22m 30s. Rate: 7.3 symbols/min [2025-10-09T18:04:22.692868] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:22.751100] [DEBUG] [LOCAL ] CLX: Loaded 51594 existing records from primary storage. [2025-10-09T18:04:22.751395] [INFO ] [MAIN ] CLX: Loaded 51594 existing records. [2025-10-09T18:04:22.929836] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:22.930018] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-09T18:04:22.930086] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-09T18:04:22.930546] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-09T18:04:22.930604] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-09T18:04:23.201584] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-09T18:04:23.282327] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:23.969008] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:04:23.996666] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-09T18:04:24.042905] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-09T18:04:24.796697] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-09T18:04:24.842323] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T18:04:25.317020] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:04:25.596750] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-09T18:04:26.396766] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-09T18:04:26.527978] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:04:26.876411] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:04:27.196718] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-09T18:04:27.996738] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-09T18:04:28.267026] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T18:04:28.796723] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-09T18:04:28.889091] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T18:04:29.140034] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T18:04:29.596694] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-09T18:04:30.396680] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-09T18:04:30.623970] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T18:04:31.044636] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-09T18:04:31.196690] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-09T18:04:31.847071] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:04:31.996717] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-09T18:04:32.796714] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-09T18:04:32.989715] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T18:04:33.523277] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T18:04:33.596741] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-09T18:04:34.396678] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-09T18:04:34.513308] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T18:04:35.196678] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-09T18:04:35.589393] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:04:35.996750] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-09T18:04:36.194954] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-09T18:04:36.796756] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-09T18:04:37.305316] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T18:04:37.596689] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-09T18:04:37.671611] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:04:38.396760] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-09T18:04:38.564672] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T18:04:38.743086] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T18:04:39.196732] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-09T18:04:40.006691] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-09T18:04:40.026895] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:04:40.796693] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-09T18:04:41.003720] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T18:04:41.596764] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-09T18:04:42.307553] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-09T18:04:42.396698] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-09T18:04:42.442927] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:04:42.705275] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T18:04:43.196728] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-09T18:04:43.996723] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-09T18:04:44.251545] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T18:04:44.256196] [INFO ] [REMOTE ] CLS: Full fetch complete (77470 records). [2025-10-09T18:04:44.256319] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-09T18:04:44.674553] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-09T18:04:44.674632] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-09T18:04:44.675618] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-09T18:04:44.675821] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-09T18:04:44.677421] [DEBUG] [LOCAL ] CLS: Trimmed 77470 records to 53980 (keeping 200 days of data) [2025-10-09T18:04:44.800379] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-09T18:04:45.039764] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T18:04:45.059616] [DEBUG] [LOCAL ] CLS: Primary data saved (53980 records). [2025-10-09T18:04:45.059779] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-09T18:04:45.059897] [INFO ] [MAIN ] Update Progress: 468/2373 symbols completed. CLS took 45.1s. Estimated remaining: 4h 23m 20s. Rate: 7.2 symbols/min [2025-10-09T18:04:45.245975] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:45.291518] [DEBUG] [LOCAL ] CM: Loaded 48747 existing records from primary storage. [2025-10-09T18:04:45.291836] [INFO ] [MAIN ] CM: Loaded 48747 existing records. [2025-10-09T18:04:45.482310] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:45.482628] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-09T18:04:45.482794] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-09T18:04:45.483244] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-09T18:04:45.483302] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-09T18:04:45.599131] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-09T18:04:45.804792] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T18:04:45.912439] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:45.944589] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:04:46.396741] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-09T18:04:47.196683] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-09T18:04:47.237290] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T18:04:47.256353] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T18:04:47.996763] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-09T18:04:48.796720] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-09T18:04:48.833834] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T18:04:48.838607] [INFO ] [REMOTE ] CLVT: Full fetch complete (75227 records). [2025-10-09T18:04:48.838769] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-09T18:04:49.227548] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-09T18:04:49.227624] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-09T18:04:49.228420] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-09T18:04:49.228484] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-09T18:04:49.230097] [DEBUG] [LOCAL ] CLVT: Trimmed 75227 records to 52362 (keeping 200 days of data) [2025-10-09T18:04:49.516901] [DEBUG] [LOCAL ] CLVT: Primary data saved (52362 records). [2025-10-09T18:04:49.517035] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-09T18:04:49.518120] [INFO ] [MAIN ] Update Progress: 469/2373 symbols completed. CLVT took 38.0s. Estimated remaining: 4h 22m 56s. Rate: 7.2 symbols/min [2025-10-09T18:04:49.622470] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-09T18:04:49.698033] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:49.732305] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:04:49.751157] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T18:04:49.754600] [INFO ] [REMOTE ] CLW: Full fetch complete (34465 records). [2025-10-09T18:04:49.754722] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-09T18:04:49.961295] [DEBUG] [LOCAL ] CMA: Loaded 49919 existing records from primary storage. [2025-10-09T18:04:49.984699] [INFO ] [MAIN ] CMA: Loaded 49919 existing records. [2025-10-09T18:04:50.352385] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:50.375476] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-09T18:04:50.382836] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-09T18:04:50.399497] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-09T18:04:50.400850] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-09T18:04:50.405117] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-09T18:04:50.446913] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-09T18:04:50.472632] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-09T18:04:50.488397] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-09T18:04:50.499566] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-09T18:04:50.528172] [DEBUG] [LOCAL ] CLW: Trimmed 34465 records to 21847 (keeping 200 days of data) [2025-10-09T18:04:50.919497] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:50.923496] [DEBUG] [LOCAL ] CLW: Primary data saved (21847 records). [2025-10-09T18:04:50.923693] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-09T18:04:50.923825] [INFO ] [MAIN ] Update Progress: 470/2373 symbols completed. CLW took 29.8s. Estimated remaining: 4h 22m 20s. Rate: 7.3 symbols/min [2025-10-09T18:04:51.130447] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:51.156435] [DEBUG] [LOCAL ] CMBT: Loaded 24761 existing records from primary storage. [2025-10-09T18:04:51.156905] [INFO ] [MAIN ] CMBT: Loaded 24761 existing records. [2025-10-09T18:04:51.211377] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-09T18:04:51.374779] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:51.375155] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-09T18:04:51.375244] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-09T18:04:51.384827] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-09T18:04:51.390204] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-09T18:04:51.461520] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T18:04:51.854106] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:51.996704] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-09T18:04:52.188251] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T18:04:52.796721] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-09T18:04:53.116355] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T18:04:53.496213] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T18:04:53.596683] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-09T18:04:53.930268] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T18:04:54.396725] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-09T18:04:55.060913] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:04:55.196689] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-09T18:04:55.253634] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:04:55.996735] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-09T18:04:56.796733] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-09T18:04:56.857018] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T18:04:57.596776] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-09T18:04:57.626029] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T18:04:58.396706] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-09T18:04:58.709746] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-09T18:04:58.714131] [INFO ] [REMOTE ] CLX: Full fetch complete (73241 records). [2025-10-09T18:04:58.714233] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-09T18:04:59.113425] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-09T18:04:59.113540] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-09T18:04:59.114506] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-09T18:04:59.114614] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-09T18:04:59.116285] [DEBUG] [LOCAL ] CLX: Trimmed 73241 records to 51973 (keeping 200 days of data) [2025-10-09T18:04:59.202980] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-09T18:04:59.264200] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:04:59.515895] [DEBUG] [LOCAL ] CLX: Primary data saved (51973 records). [2025-10-09T18:04:59.516026] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-09T18:04:59.516129] [INFO ] [MAIN ] Update Progress: 471/2373 symbols completed. CLX took 37.0s. Estimated remaining: 4h 22m 13s. Rate: 7.3 symbols/min [2025-10-09T18:04:59.711592] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:59.780198] [DEBUG] [LOCAL ] CMC: Loaded 45379 existing records from primary storage. [2025-10-09T18:04:59.781580] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:04:59.791688] [INFO ] [MAIN ] CMC: Loaded 45379 existing records. [2025-10-09T18:04:59.972066] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:59.972245] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-09T18:04:59.972291] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-09T18:04:59.972548] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-09T18:04:59.972606] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-09T18:05:00.002735] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-09T18:05:00.230859] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T18:05:00.341278] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:00.796695] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-09T18:05:01.596734] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-09T18:05:01.904461] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T18:05:02.047820] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T18:05:02.396764] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-09T18:05:03.196707] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-09T18:05:03.268226] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T18:05:03.569724] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T18:05:03.996782] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-09T18:05:04.796686] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-09T18:05:05.132852] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T18:05:05.144207] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T18:05:05.596732] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-09T18:05:06.396714] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-09T18:05:06.469950] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T18:05:07.196685] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-09T18:05:07.254443] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T18:05:07.944535] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T18:05:07.996669] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-09T18:05:08.385184] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:05:08.796701] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-09T18:05:09.388925] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T18:05:09.596734] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-09T18:05:09.757471] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:05:10.396744] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-09T18:05:11.196703] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-09T18:05:11.311276] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T18:05:11.996689] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-09T18:05:12.143517] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:05:12.188884] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T18:05:12.796783] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-09T18:05:13.596687] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-09T18:05:13.820282] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:05:14.396788] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-09T18:05:14.592884] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T18:05:14.771093] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T18:05:15.196771] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-09T18:05:15.996673] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-09T18:05:16.356818] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T18:05:16.796696] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-09T18:05:17.023513] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:05:17.596737] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-09T18:05:17.834227] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T18:05:18.396768] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-09T18:05:18.803536] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-09T18:05:18.807841] [INFO ] [REMOTE ] CM: Full fetch complete (69583 records). [2025-10-09T18:05:18.807987] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-09T18:05:19.199298] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-09T18:05:19.240632] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-09T18:05:19.240865] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-09T18:05:19.241811] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-09T18:05:19.242061] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-09T18:05:19.253999] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T18:05:19.259014] [INFO ] [REMOTE ] CMBT: Full fetch complete (31618 records). [2025-10-09T18:05:19.259118] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-09T18:05:19.259400] [DEBUG] [LOCAL ] CM: Trimmed 69583 records to 49101 (keeping 200 days of data) [2025-10-09T18:05:19.744303] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-09T18:05:19.745293] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-09T18:05:19.747132] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-09T18:05:19.747459] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-09T18:05:19.752586] [DEBUG] [LOCAL ] CMBT: Trimmed 31618 records to 25145 (keeping 200 days of data) [2025-10-09T18:05:19.994320] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T18:05:20.011567] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-09T18:05:20.103883] [DEBUG] [LOCAL ] CMBT: Primary data saved (25145 records). [2025-10-09T18:05:20.104605] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-09T18:05:20.104755] [INFO ] [MAIN ] Update Progress: 472/2373 symbols completed. CMBT took 29.2s. Estimated remaining: 4h 22m 54s. Rate: 7.2 symbols/min [2025-10-09T18:05:20.348260] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:20.351402] [DEBUG] [LOCAL ] CM: Primary data saved (49101 records). [2025-10-09T18:05:20.351998] [INFO ] [MAIN ] CM: Full history saved. [2025-10-09T18:05:20.352531] [INFO ] [MAIN ] Update Progress: 473/2373 symbols completed. CM took 35.3s. Estimated remaining: 4h 22m 13s. Rate: 7.2 symbols/min [2025-10-09T18:05:20.452404] [DEBUG] [LOCAL ] CMCM: Loaded 4735 existing records from primary storage. [2025-10-09T18:05:20.466280] [INFO ] [MAIN ] CMCM: Loaded 4735 existing records. [2025-10-09T18:05:20.687907] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:20.721079] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-09T18:05:20.721176] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-09T18:05:20.721328] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-09T18:05:20.721404] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-09T18:05:20.721473] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-09T18:05:20.743626] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-09T18:05:20.743484] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:05:20.744123] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-09T18:05:20.765002] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-09T18:05:20.787265] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-09T18:05:20.807772] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-09T18:05:21.280298] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:21.297935] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-09T18:05:21.437347] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-09T18:05:21.527999] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:21.596685] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-09T18:05:21.660119] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:05:21.660493] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-09T18:05:21.660582] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:05:21.660628] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-09T18:05:21.660715] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:05:21.660786] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-09T18:05:21.660849] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-09T18:05:21.660884] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-09T18:05:21.660923] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-09T18:05:21.660972] [INFO ] [MAIN ] Update Progress: 474/2373 symbols completed. CMDB took 1.3s. Estimated remaining: 4h 21m 37s. Rate: 7.3 symbols/min [2025-10-09T18:05:21.865526] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:21.866438] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T18:05:21.928689] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-09T18:05:21.929090] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-09T18:05:22.102659] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:05:22.102905] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-09T18:05:22.102952] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-09T18:05:22.103173] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-09T18:05:22.103231] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-09T18:05:22.401977] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-09T18:05:22.463054] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:23.196750] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-09T18:05:23.382707] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T18:05:23.682112] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T18:05:23.996746] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-09T18:05:24.796757] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-09T18:05:25.342788] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T18:05:25.574538] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-09T18:05:25.596668] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-09T18:05:25.991737] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:05:26.396727] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-09T18:05:27.160586] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T18:05:27.196666] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-09T18:05:27.537948] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T18:05:27.652412] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T18:05:27.996733] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-09T18:05:28.796707] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-09T18:05:29.596754] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-09T18:05:29.894608] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:05:30.396692] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-09T18:05:30.838896] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-09T18:05:31.196749] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-09T18:05:31.521449] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-09T18:05:31.996718] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-09T18:05:32.796750] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-09T18:05:33.266456] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (5.27 seconds). [2025-10-09T18:05:33.596699] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-09T18:05:33.859009] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (4.26 seconds). [2025-10-09T18:05:33.863059] [INFO ] [REMOTE ] CMA: Full fetch complete (72724 records). [2025-10-09T18:05:33.863177] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-09T18:05:33.864042] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:05:33.864133] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:05:33.864177] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:05:33.864242] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-09T18:05:33.864348] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-09T18:05:33.864400] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-10-09T18:05:33.864703] [DEBUG] [LOCAL ] CMA: Deleted derivative data file. [2025-10-09T18:05:33.865917] [INFO ] [MAIN ] Update Progress: 475/2373 symbols completed. CMA took 44.3s. Estimated remaining: 4h 21m 45s. Rate: 7.3 symbols/min [2025-10-09T18:05:33.940789] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T18:05:34.057095] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:34.085416] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T18:05:34.130346] [DEBUG] [LOCAL ] CMI: Loaded 41656 existing records from primary storage. [2025-10-09T18:05:34.130685] [INFO ] [MAIN ] CMI: Loaded 41656 existing records. [2025-10-09T18:05:34.313264] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:05:34.313505] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-09T18:05:34.313552] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-09T18:05:34.313853] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-09T18:05:34.313911] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-09T18:05:34.401909] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-09T18:05:34.704142] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:35.196759] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-09T18:05:35.780105] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-09T18:05:35.996695] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-09T18:05:36.236721] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T18:05:36.240303] [INFO ] [REMOTE ] CMC: Full fetch complete (66503 records). [2025-10-09T18:05:36.240431] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-09T18:05:36.241159] [FATAL] [VALIDATOR ] CMC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:05:36.241278] [FATAL] [MAIN ] CMC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:05:36.241323] [WARN ] [MAIN ] CMC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:05:36.241363] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-09T18:05:36.241418] [DEBUG] [LOCAL ] CMC: No primary data file found to delete. [2025-10-09T18:05:36.241454] [INFO ] [LOCAL ] CMC: Starting deletion of derivative data. [2025-10-09T18:05:36.241680] [DEBUG] [LOCAL ] CMC: Deleted derivative data file. [2025-10-09T18:05:36.241777] [INFO ] [MAIN ] Update Progress: 476/2373 symbols completed. CMC took 36.7s. Estimated remaining: 4h 21m 13s. Rate: 7.3 symbols/min [2025-10-09T18:05:36.410496] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:36.444277] [DEBUG] [LOCAL ] CMP: Loaded 36066 existing records from primary storage. [2025-10-09T18:05:36.444572] [INFO ] [MAIN ] CMP: Loaded 36066 existing records. [2025-10-09T18:05:36.567890] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T18:05:36.626584] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:05:36.626951] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-09T18:05:36.627110] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-09T18:05:36.627361] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-09T18:05:36.627419] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-09T18:05:36.804567] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-09T18:05:37.012078] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:37.013559] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T18:05:37.596757] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-09T18:05:37.625082] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T18:05:38.396727] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-09T18:05:38.862148] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T18:05:38.963359] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T18:05:39.196709] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-09T18:05:39.995191] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T18:05:39.998618] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-09T18:05:40.796709] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-09T18:05:41.274866] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T18:05:41.596753] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-09T18:05:42.088359] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T18:05:42.089369] [INFO ] [REMOTE ] CMCM: Full fetch complete (6851 records). [2025-10-09T18:05:42.089438] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-09T18:05:42.401871] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-09T18:05:42.459475] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-09T18:05:42.459558] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-09T18:05:42.459789] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-09T18:05:42.459852] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-09T18:05:42.460331] [DEBUG] [LOCAL ] CMCM: Trimmed 6851 records to 4766 (keeping 200 days of data) [2025-10-09T18:05:42.488416] [DEBUG] [LOCAL ] CMCM: Primary data saved (4766 records). [2025-10-09T18:05:42.488562] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-09T18:05:42.488672] [INFO ] [MAIN ] Update Progress: 477/2373 symbols completed. CMCM took 22.4s. Estimated remaining: 4h 20m 57s. Rate: 7.3 symbols/min [2025-10-09T18:05:42.992958] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T18:05:43.196702] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-09T18:05:43.802816] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:05:43.996699] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-09T18:05:44.298459] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:05:44.796774] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-09T18:05:45.334940] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T18:05:45.596785] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-09T18:05:46.396778] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-09T18:05:47.012703] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-09T18:05:47.119226] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:05:47.196669] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-09T18:05:47.996750] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-09T18:05:48.184071] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:05:48.659594] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T18:05:48.796760] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-09T18:05:49.596799] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-09T18:05:49.727932] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T18:05:50.319367] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T18:05:50.396673] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-09T18:05:51.083187] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:05:51.196723] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-09T18:05:51.627933] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:05:51.996741] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-09T18:05:52.796780] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-09T18:05:53.527753] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-09T18:05:53.596731] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-09T18:05:53.936960] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T18:05:53.946862] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T18:05:54.396714] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-09T18:05:55.196784] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-09T18:05:55.776545] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-09T18:05:55.953333] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T18:05:55.996714] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-09T18:05:56.729874] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:05:56.796721] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-09T18:05:57.596711] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-09T18:05:57.679922] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:05:57.683609] [INFO ] [REMOTE ] CMI: Full fetch complete (60185 records). [2025-10-09T18:05:57.683742] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-09T18:05:58.110721] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-09T18:05:58.118475] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-09T18:05:58.129775] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-09T18:05:58.132205] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-09T18:05:58.134757] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:05:58.134866] [DEBUG] [LOCAL ] CMI: Trimmed 60185 records to 41934 (keeping 200 days of data) [2025-10-09T18:05:58.398943] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-09T18:05:58.404853] [DEBUG] [LOCAL ] CMI: Primary data saved (41934 records). [2025-10-09T18:05:58.405681] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-09T18:05:58.406820] [INFO ] [MAIN ] Update Progress: 478/2373 symbols completed. CMI took 24.5s. Estimated remaining: 4h 21m 19s. Rate: 7.3 symbols/min [2025-10-09T18:05:59.907270] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T18:05:59.916291] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-09T18:05:59.951673] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-09T18:05:59.996677] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-09T18:06:00.782007] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T18:06:00.786588] [INFO ] [REMOTE ] CMG: Full fetch complete (77796 records). [2025-10-09T18:06:00.786745] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-09T18:06:01.184339] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-09T18:06:01.184477] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-09T18:06:01.185462] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-09T18:06:01.185567] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-09T18:06:01.187154] [DEBUG] [LOCAL ] CMG: Trimmed 77796 records to 54111 (keeping 200 days of data) [2025-10-09T18:06:01.517190] [DEBUG] [LOCAL ] CMG: Primary data saved (54111 records). [2025-10-09T18:06:01.517328] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-09T18:06:01.517887] [INFO ] [MAIN ] Update Progress: 479/2373 symbols completed. CMG took 39.9s. Estimated remaining: 4h 20m 50s. Rate: 7.3 symbols/min [2025-10-09T18:06:01.571181] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:06:01.578313] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-09T18:06:02.568790] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T18:06:02.578453] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-09T18:06:03.764565] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T18:06:03.767300] [INFO ] [REMOTE ] CMP: Full fetch complete (51955 records). [2025-10-09T18:06:03.767386] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-09T18:06:04.169072] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-09T18:06:04.169157] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-09T18:06:04.169870] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-09T18:06:04.169938] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-09T18:06:04.171129] [DEBUG] [LOCAL ] CMP: Trimmed 51955 records to 36351 (keeping 200 days of data) [2025-10-09T18:06:04.388318] [DEBUG] [LOCAL ] CMP: Primary data saved (36351 records). [2025-10-09T18:06:04.388457] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-09T18:06:04.388554] [INFO ] [MAIN ] Update Progress: 480/2373 symbols completed. CMP took 28.1s. Estimated remaining: 4h 20m 21s. Rate: 7.3 symbols/min [2025-10-09T18:06:04.954638] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:05.070245] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:05.092882] [DEBUG] [LOCAL ] CMRE: No existing data file found in primary storage. [2025-10-09T18:06:05.156138] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:05.160012] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:05.156277] [WARN ] [MAIN ] CMRE: No existing data found, performing full refresh instead. [2025-10-09T18:06:05.161559] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-09T18:06:05.162263] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-09T18:06:05.162854] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-09T18:06:05.162966] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-09T18:06:05.248120] [DEBUG] [LOCAL ] CMSA: Loaded 3509 existing records from primary storage. [2025-10-09T18:06:05.282166] [INFO ] [MAIN ] CMSA: Loaded 3509 existing records. [2025-10-09T18:06:05.596052] [DEBUG] [LOCAL ] CMS: Loaded 52610 existing records from primary storage. [2025-10-09T18:06:05.627053] [INFO ] [MAIN ] CMS: Loaded 52610 existing records. [2025-10-09T18:06:05.606416] [DEBUG] [LOCAL ] CMPO: Loaded 38977 existing records from primary storage. [2025-10-09T18:06:05.750260] [INFO ] [MAIN ] CMPO: Loaded 38977 existing records. [2025-10-09T18:06:05.790803] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:05.823528] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-09T18:06:05.894122] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-09T18:06:05.962731] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-09T18:06:06.020186] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-09T18:06:06.070916] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:06.113859] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-09T18:06:06.206506] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:06.243571] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-09T18:06:06.286055] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-09T18:06:06.314263] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:06.330031] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-09T18:06:06.345278] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-09T18:06:06.329942] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-09T18:06:06.350567] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-09T18:06:06.367440] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-09T18:06:06.402322] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-09T18:06:06.982551] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:07.000233] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-09T18:06:07.275426] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:07.285997] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-09T18:06:07.343017] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:07.343443] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-09T18:06:07.641335] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:06:07.642313] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T18:06:07.649739] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-09T18:06:07.650471] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-09T18:06:08.217808] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T18:06:08.219360] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-09T18:06:08.550523] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T18:06:08.558969] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-09T18:06:08.613077] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-09T18:06:08.796701] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-09T18:06:09.059545] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T18:06:09.094784] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:06:09.265298] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T18:06:09.596735] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-09T18:06:09.792016] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T18:06:10.396743] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-09T18:06:11.202866] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-09T18:06:11.222161] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:06:11.454485] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T18:06:11.996777] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-09T18:06:12.647285] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T18:06:12.796714] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-09T18:06:13.596702] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-09T18:06:13.794623] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T18:06:13.997963] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-09T18:06:14.291187] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:06:14.396703] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-09T18:06:15.196769] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-09T18:06:15.996698] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-09T18:06:16.091907] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:06:16.796690] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-09T18:06:16.851807] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:06:17.467815] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T18:06:17.596765] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-09T18:06:18.206961] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T18:06:18.396685] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-09T18:06:19.028566] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:06:19.196752] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-09T18:06:19.906835] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:06:19.996698] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-09T18:06:20.796686] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-09T18:06:21.117759] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T18:06:21.484864] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T18:06:21.596664] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-09T18:06:21.617064] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T18:06:22.396726] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-09T18:06:22.992099] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:06:23.196745] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-09T18:06:23.983130] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:06:23.996664] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-09T18:06:24.585505] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:06:24.796705] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-09T18:06:25.596686] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-09T18:06:25.683090] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:06:25.897803] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:06:25.900991] [INFO ] [REMOTE ] CMPO: Full fetch complete (58637 records). [2025-10-09T18:06:25.901084] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-09T18:06:26.273532] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-09T18:06:26.273608] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-09T18:06:26.274283] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-09T18:06:26.274346] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-09T18:06:26.275457] [DEBUG] [LOCAL ] CMPO: Trimmed 58637 records to 39261 (keeping 200 days of data) [2025-10-09T18:06:26.396762] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-09T18:06:26.515746] [DEBUG] [LOCAL ] CMPO: Primary data saved (39261 records). [2025-10-09T18:06:26.515924] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-09T18:06:26.516017] [INFO ] [MAIN ] Update Progress: 481/2373 symbols completed. CMPO took 22.1s. Estimated remaining: 4h 21m 7s. Rate: 7.2 symbols/min [2025-10-09T18:06:26.704868] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:26.712480] [DEBUG] [LOCAL ] CMSC: Loaded 5006 existing records from primary storage. [2025-10-09T18:06:26.712711] [INFO ] [MAIN ] CMSC: Loaded 5006 existing records. [2025-10-09T18:06:26.910792] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:26.911233] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-09T18:06:26.911349] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-09T18:06:26.911558] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-09T18:06:26.911616] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-09T18:06:27.036419] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T18:06:27.056234] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T18:06:27.201832] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-09T18:06:27.308824] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:27.996715] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-09T18:06:28.529149] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T18:06:28.658575] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T18:06:28.796691] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-09T18:06:29.596722] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-09T18:06:30.396691] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-09T18:06:30.574850] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:06:30.727798] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T18:06:31.117846] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T18:06:31.196728] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-09T18:06:31.996756] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-09T18:06:32.764027] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T18:06:32.796748] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-09T18:06:33.031631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:06:33.110528] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-09T18:06:33.596721] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-09T18:06:34.004263] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-09T18:06:34.396745] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-09T18:06:35.196737] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-09T18:06:35.772889] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:06:35.996785] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-09T18:06:36.549233] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T18:06:36.723744] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T18:06:36.727564] [INFO ] [REMOTE ] CMS: Full fetch complete (75600 records). [2025-10-09T18:06:36.727705] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-09T18:06:36.728498] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:06:36.728587] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:06:36.728630] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:06:36.728718] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-09T18:06:36.728800] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-09T18:06:36.728852] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-09T18:06:36.729086] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-09T18:06:36.729182] [INFO ] [MAIN ] Update Progress: 482/2373 symbols completed. CMS took 32.3s. Estimated remaining: 4h 21m 6s. Rate: 7.2 symbols/min [2025-10-09T18:06:36.801900] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-09T18:06:36.901760] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:36.911000] [DEBUG] [LOCAL ] CMSD: Loaded 8001 existing records from primary storage. [2025-10-09T18:06:36.911175] [INFO ] [MAIN ] CMSD: Loaded 8001 existing records. [2025-10-09T18:06:37.117180] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:37.117388] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-09T18:06:37.117434] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-09T18:06:37.117632] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-09T18:06:37.117724] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-09T18:06:37.483244] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:37.487850] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T18:06:37.596678] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-09T18:06:38.099672] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T18:06:38.100489] [INFO ] [REMOTE ] CMSA: Full fetch complete (5060 records). [2025-10-09T18:06:38.100563] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-09T18:06:38.101035] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:06:38.101100] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:06:38.101138] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:06:38.101180] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-09T18:06:38.101236] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-09T18:06:38.101337] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-10-09T18:06:38.101491] [DEBUG] [LOCAL ] CMSA: Deleted derivative data file. [2025-10-09T18:06:38.101593] [INFO ] [MAIN ] Update Progress: 483/2373 symbols completed. CMSA took 33.7s. Estimated remaining: 4h 20m 31s. Rate: 7.3 symbols/min [2025-10-09T18:06:38.272762] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:38.310824] [DEBUG] [LOCAL ] CMTG: Loaded 36233 existing records from primary storage. [2025-10-09T18:06:38.311126] [INFO ] [MAIN ] CMTG: Loaded 36233 existing records. [2025-10-09T18:06:38.401893] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-09T18:06:38.495056] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:38.495238] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-09T18:06:38.495287] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-09T18:06:38.495587] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-09T18:06:38.495678] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-09T18:06:38.843063] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:39.196679] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-09T18:06:39.547634] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T18:06:39.996732] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-09T18:06:40.733686] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T18:06:40.796772] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-09T18:06:41.192516] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T18:06:41.554899] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T18:06:41.596780] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-09T18:06:42.396780] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-09T18:06:42.922849] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T18:06:43.196757] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-09T18:06:43.754505] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T18:06:43.996698] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-09T18:06:44.620103] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T18:06:44.796690] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-09T18:06:44.844824] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T18:06:45.596692] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-09T18:06:45.998493] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T18:06:46.001812] [INFO ] [REMOTE ] CMRE: Full fetch complete (50565 records). [2025-10-09T18:06:46.001923] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-09T18:06:46.275436] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T18:06:46.391524] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-09T18:06:46.391610] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-09T18:06:46.392271] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-09T18:06:46.392336] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-09T18:06:46.393409] [DEBUG] [LOCAL ] CMRE: Trimmed 50565 records to 35870 (keeping 200 days of data) [2025-10-09T18:06:46.396692] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-09T18:06:46.627627] [DEBUG] [LOCAL ] CMRE: Primary data saved (35870 records). [2025-10-09T18:06:46.627800] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-09T18:06:46.627937] [INFO ] [MAIN ] Update Progress: 484/2373 symbols completed. CMRE took 42.2s. Estimated remaining: 4h 20m 24s. Rate: 7.3 symbols/min [2025-10-09T18:06:46.795392] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:46.803632] [DEBUG] [LOCAL ] CMU: Loaded 6347 existing records from primary storage. [2025-10-09T18:06:46.803850] [INFO ] [MAIN ] CMU: Loaded 6347 existing records. [2025-10-09T18:06:46.983949] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:46.984221] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-09T18:06:46.984302] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-09T18:06:46.984514] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-09T18:06:46.984571] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-09T18:06:47.089473] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T18:06:47.201899] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-09T18:06:47.342802] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:47.996715] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-09T18:06:48.512416] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T18:06:48.627967] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T18:06:48.796706] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-09T18:06:49.480613] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T18:06:49.596668] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-09T18:06:49.996790] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T18:06:50.396744] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-09T18:06:51.196720] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-09T18:06:51.826833] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T18:06:51.937232] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:06:51.996720] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-09T18:06:52.738956] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T18:06:52.796674] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-09T18:06:53.426660] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:06:53.596734] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-09T18:06:54.396730] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-09T18:06:54.827115] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T18:06:55.189265] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T18:06:55.196670] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-09T18:06:55.808594] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T18:06:55.996715] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-09T18:06:56.728419] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T18:06:56.796682] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-09T18:06:57.422476] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:06:57.423619] [INFO ] [REMOTE ] CMSC: Full fetch complete (7126 records). [2025-10-09T18:06:57.423738] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-09T18:06:57.601793] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-09T18:06:57.876004] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-09T18:06:57.876082] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-09T18:06:57.876283] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-09T18:06:57.876323] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-09T18:06:57.876834] [DEBUG] [LOCAL ] CMSC: Trimmed 7126 records to 5017 (keeping 200 days of data) [2025-10-09T18:06:57.911561] [DEBUG] [LOCAL ] CMSC: Primary data saved (5017 records). [2025-10-09T18:06:57.911696] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-09T18:06:57.911811] [INFO ] [MAIN ] Update Progress: 485/2373 symbols completed. CMSC took 31.4s. Estimated remaining: 4h 20m 27s. Rate: 7.2 symbols/min [2025-10-09T18:06:58.114274] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:58.147971] [DEBUG] [LOCAL ] CNA: Loaded 32849 existing records from primary storage. [2025-10-09T18:06:58.148283] [INFO ] [MAIN ] CNA: Loaded 32849 existing records. [2025-10-09T18:06:58.340467] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:58.340712] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-09T18:06:58.340770] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-09T18:06:58.341107] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-09T18:06:58.341165] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-09T18:06:58.401945] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-09T18:06:58.690016] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:59.097573] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T18:06:59.156325] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T18:06:59.196670] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-09T18:06:59.996691] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-09T18:07:00.155915] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:07:00.796787] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-09T18:07:00.807224] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T18:07:01.540792] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T18:07:01.596707] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-09T18:07:02.231486] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:07:02.396760] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-09T18:07:03.039490] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T18:07:03.196709] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-09T18:07:03.994879] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T18:07:03.997588] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-09T18:07:04.590100] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:07:04.591230] [INFO ] [REMOTE ] CMSD: Full fetch complete (12092 records). [2025-10-09T18:07:04.591299] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-09T18:07:04.805206] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-09T18:07:04.964235] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-09T18:07:04.964313] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-09T18:07:04.964600] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-09T18:07:04.964639] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-09T18:07:04.965125] [DEBUG] [LOCAL ] CMSD: Trimmed 12092 records to 8044 (keeping 200 days of data) [2025-10-09T18:07:05.014660] [DEBUG] [LOCAL ] CMSD: Primary data saved (8044 records). [2025-10-09T18:07:05.014799] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-09T18:07:05.014884] [INFO ] [MAIN ] Update Progress: 486/2373 symbols completed. CMSD took 28.3s. Estimated remaining: 4h 20m 14s. Rate: 7.3 symbols/min [2025-10-09T18:07:05.188203] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:05.238815] [DEBUG] [LOCAL ] CNC: Loaded 53755 existing records from primary storage. [2025-10-09T18:07:05.239193] [INFO ] [MAIN ] CNC: Loaded 53755 existing records. [2025-10-09T18:07:05.349089] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T18:07:05.420153] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:05.420384] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-09T18:07:05.420442] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-09T18:07:05.420838] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-09T18:07:05.420898] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-09T18:07:05.604759] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-09T18:07:05.781470] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:06.396721] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-09T18:07:07.107288] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:07:07.196759] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-09T18:07:07.996694] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-09T18:07:08.346865] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T18:07:08.463562] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T18:07:08.796732] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-09T18:07:08.886029] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:07:09.596771] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-09T18:07:10.384512] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T18:07:10.396684] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-09T18:07:10.502052] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:07:11.121509] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T18:07:11.196704] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-09T18:07:11.996718] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-09T18:07:12.147623] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T18:07:12.796685] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-09T18:07:13.596689] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-09T18:07:13.812766] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:07:14.107026] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:07:14.396715] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-09T18:07:14.627079] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T18:07:15.196720] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-09T18:07:15.699400] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T18:07:15.702168] [INFO ] [REMOTE ] CMTG: Full fetch complete (53444 records). [2025-10-09T18:07:15.702246] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-09T18:07:16.005167] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-09T18:07:16.102778] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-09T18:07:16.102864] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-09T18:07:16.103592] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-09T18:07:16.103636] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-09T18:07:16.104790] [DEBUG] [LOCAL ] CMTG: Trimmed 53444 records to 36441 (keeping 200 days of data) [2025-10-09T18:07:16.324857] [DEBUG] [LOCAL ] CMTG: Primary data saved (36441 records). [2025-10-09T18:07:16.324991] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-09T18:07:16.325085] [INFO ] [MAIN ] Update Progress: 487/2373 symbols completed. CMTG took 38.2s. Estimated remaining: 4h 20m 18s. Rate: 7.2 symbols/min [2025-10-09T18:07:16.498765] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:16.511503] [DEBUG] [LOCAL ] CNF: Loaded 10508 existing records from primary storage. [2025-10-09T18:07:16.511750] [INFO ] [MAIN ] CNF: Loaded 10508 existing records. [2025-10-09T18:07:16.714744] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:16.716355] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:07:16.718944] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-09T18:07:16.723238] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-09T18:07:16.723712] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-09T18:07:16.723769] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-09T18:07:16.801792] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-09T18:07:16.958076] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T18:07:17.114935] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:17.596725] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-09T18:07:18.396741] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-09T18:07:18.709602] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T18:07:18.785245] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:07:19.016919] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:07:19.196710] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-09T18:07:19.996781] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-09T18:07:20.482773] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:07:20.578845] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T18:07:20.796718] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-09T18:07:21.369928] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T18:07:21.370855] [INFO ] [REMOTE ] CMU: Full fetch complete (9566 records). [2025-10-09T18:07:21.370924] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-09T18:07:21.602438] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-09T18:07:21.775023] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-09T18:07:21.775112] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-09T18:07:21.775427] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-09T18:07:21.775467] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-09T18:07:21.776000] [DEBUG] [LOCAL ] CMU: Trimmed 9566 records to 6361 (keeping 200 days of data) [2025-10-09T18:07:21.823638] [DEBUG] [LOCAL ] CMU: Primary data saved (6361 records). [2025-10-09T18:07:21.823850] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-09T18:07:21.823966] [INFO ] [MAIN ] Update Progress: 488/2373 symbols completed. CMU took 35.2s. Estimated remaining: 4h 19m 59s. Rate: 7.3 symbols/min [2025-10-09T18:07:21.994290] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:22.047697] [DEBUG] [LOCAL ] CNH: Loaded 53551 existing records from primary storage. [2025-10-09T18:07:22.048056] [INFO ] [MAIN ] CNH: Loaded 53551 existing records. [2025-10-09T18:07:22.220089] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:22.220309] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-09T18:07:22.220356] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-09T18:07:22.220601] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-09T18:07:22.220694] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-09T18:07:22.403791] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-09T18:07:22.568375] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:23.196699] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-09T18:07:23.306312] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T18:07:23.738070] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T18:07:23.996686] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-09T18:07:24.236797] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T18:07:24.796780] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-09T18:07:25.189398] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-09T18:07:25.397123] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:07:25.596726] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-09T18:07:26.021321] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-09T18:07:26.396723] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-09T18:07:27.161738] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T18:07:27.196678] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-09T18:07:27.766317] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T18:07:27.996702] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-09T18:07:28.744148] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T18:07:28.796707] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-09T18:07:29.505981] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:07:29.596764] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-09T18:07:30.396791] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-09T18:07:31.151233] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T18:07:31.196707] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-09T18:07:31.494463] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T18:07:31.996734] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-09T18:07:32.796710] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-09T18:07:32.924458] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:07:33.334105] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:07:33.596810] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-09T18:07:33.774959] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:07:34.396754] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-09T18:07:35.196684] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-09T18:07:35.302250] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:07:35.398720] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T18:07:35.996720] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-09T18:07:36.583945] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:07:36.796694] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-09T18:07:37.326824] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T18:07:37.596725] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-09T18:07:38.042357] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T18:07:38.045388] [INFO ] [REMOTE ] CNA: Full fetch complete (45710 records). [2025-10-09T18:07:38.045491] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-09T18:07:38.401960] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-09T18:07:38.446999] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-09T18:07:38.447097] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-09T18:07:38.447768] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-09T18:07:38.447836] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-09T18:07:38.449211] [DEBUG] [LOCAL ] CNA: Trimmed 45710 records to 33082 (keeping 200 days of data) [2025-10-09T18:07:38.658485] [DEBUG] [LOCAL ] CNA: Primary data saved (33082 records). [2025-10-09T18:07:38.658635] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-09T18:07:38.658770] [INFO ] [MAIN ] Update Progress: 489/2373 symbols completed. CNA took 40.7s. Estimated remaining: 4h 20m 23s. Rate: 7.2 symbols/min [2025-10-09T18:07:38.831347] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:38.831579] [DEBUG] [LOCAL ] CNI: No existing data file found in primary storage. [2025-10-09T18:07:38.831635] [WARN ] [MAIN ] CNI: No existing data found, performing full refresh instead. [2025-10-09T18:07:38.831778] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-09T18:07:38.831822] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-09T18:07:38.831864] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-09T18:07:38.831896] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-09T18:07:39.198131] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-09T18:07:39.201584] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:39.486049] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T18:07:39.858823] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T18:07:39.860082] [INFO ] [REMOTE ] CNF: Full fetch complete (13175 records). [2025-10-09T18:07:39.860173] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-09T18:07:40.001814] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-09T18:07:40.261487] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-09T18:07:40.261570] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-09T18:07:40.261914] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-09T18:07:40.261976] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-09T18:07:40.262476] [DEBUG] [LOCAL ] CNF: Trimmed 13175 records to 10597 (keeping 200 days of data) [2025-10-09T18:07:40.336316] [DEBUG] [LOCAL ] CNF: Primary data saved (10597 records). [2025-10-09T18:07:40.336466] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-09T18:07:40.336554] [INFO ] [MAIN ] Update Progress: 490/2373 symbols completed. CNF took 24.0s. Estimated remaining: 4h 19m 50s. Rate: 7.2 symbols/min [2025-10-09T18:07:40.511079] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:40.561157] [DEBUG] [LOCAL ] CNK: Loaded 52888 existing records from primary storage. [2025-10-09T18:07:40.561476] [INFO ] [MAIN ] CNK: Loaded 52888 existing records. [2025-10-09T18:07:40.752515] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:40.752905] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-09T18:07:40.753023] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-09T18:07:40.753329] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-09T18:07:40.753388] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-09T18:07:40.807341] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-09T18:07:41.118387] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:41.151782] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-09T18:07:41.509379] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T18:07:41.596726] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-09T18:07:42.396710] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-09T18:07:42.621749] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:07:43.196715] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-09T18:07:43.805380] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-09T18:07:43.884443] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T18:07:43.996708] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-09T18:07:44.702119] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T18:07:44.796686] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-09T18:07:45.202599] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:07:45.596766] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-09T18:07:46.396722] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-09T18:07:46.992215] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-09T18:07:47.196711] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-09T18:07:47.250456] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T18:07:47.996685] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-09T18:07:48.078976] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T18:07:48.788477] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T18:07:48.798685] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-09T18:07:49.294497] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T18:07:49.596768] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-09T18:07:50.396744] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-09T18:07:50.555521] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T18:07:51.196729] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-09T18:07:51.251745] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T18:07:51.996771] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-09T18:07:52.572606] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-09T18:07:52.578298] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-10-09T18:07:52.578445] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-09T18:07:52.799258] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-09T18:07:53.077200] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-09T18:07:53.077320] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-09T18:07:53.078393] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-09T18:07:53.078562] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-09T18:07:53.092927] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 54145 (keeping 200 days of data) [2025-10-09T18:07:53.119768] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:07:53.547095] [DEBUG] [LOCAL ] CNC: Primary data saved (54145 records). [2025-10-09T18:07:53.547264] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-09T18:07:53.547946] [INFO ] [MAIN ] Update Progress: 491/2373 symbols completed. CNC took 48.5s. Estimated remaining: 4h 20m 0s. Rate: 7.2 symbols/min [2025-10-09T18:07:53.611554] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-09T18:07:53.726147] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:53.771077] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:07:53.830531] [DEBUG] [LOCAL ] CNM: Loaded 51046 existing records from primary storage. [2025-10-09T18:07:53.830893] [INFO ] [MAIN ] CNM: Loaded 51046 existing records. [2025-10-09T18:07:54.003798] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:54.004031] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-09T18:07:54.004079] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-09T18:07:54.004413] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-09T18:07:54.004470] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-09T18:07:54.371710] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:54.396701] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-09T18:07:54.581118] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T18:07:55.196725] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-09T18:07:55.502357] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T18:07:55.996734] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-09T18:07:56.411151] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T18:07:56.503784] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:07:56.796762] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-09T18:07:57.596739] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-09T18:07:57.703660] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:07:58.396721] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-09T18:07:58.538332] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T18:07:59.144106] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T18:07:59.196716] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-09T18:07:59.996691] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-09T18:08:00.251829] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T18:08:00.796723] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-09T18:08:01.028973] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T18:08:01.596734] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-09T18:08:02.038839] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T18:08:02.103893] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:08:02.108366] [INFO ] [REMOTE ] CNH: Full fetch complete (77540 records). [2025-10-09T18:08:02.108482] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-09T18:08:02.398555] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-09T18:08:02.494389] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-09T18:08:02.494468] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-09T18:08:02.495353] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-09T18:08:02.495418] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-09T18:08:02.496916] [DEBUG] [LOCAL ] CNH: Trimmed 77540 records to 53941 (keeping 200 days of data) [2025-10-09T18:08:02.826458] [DEBUG] [LOCAL ] CNH: Primary data saved (53941 records). [2025-10-09T18:08:02.826620] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-09T18:08:02.827564] [INFO ] [MAIN ] Update Progress: 492/2373 symbols completed. CNH took 41.0s. Estimated remaining: 4h 19m 56s. Rate: 7.2 symbols/min [2025-10-09T18:08:02.995691] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:03.066724] [DEBUG] [LOCAL ] CNMD: Loaded 32106 existing records from primary storage. [2025-10-09T18:08:03.068506] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T18:08:03.068632] [INFO ] [MAIN ] CNMD: Loaded 32106 existing records. [2025-10-09T18:08:03.201865] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-09T18:08:03.264927] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:03.265123] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-09T18:08:03.265170] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-09T18:08:03.265448] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-09T18:08:03.265508] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-09T18:08:03.635927] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:03.996725] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-09T18:08:04.328909] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T18:08:04.436129] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T18:08:04.796742] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-09T18:08:05.600763] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-09T18:08:05.606361] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T18:08:06.396758] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-09T18:08:06.585060] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T18:08:06.589351] [INFO ] [REMOTE ] CNI: Full fetch complete (74579 records). [2025-10-09T18:08:06.589495] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-09T18:08:07.013985] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-09T18:08:07.014070] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-09T18:08:07.015088] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-09T18:08:07.015157] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-09T18:08:07.017318] [DEBUG] [LOCAL ] CNI: Trimmed 74579 records to 52058 (keeping 200 days of data) [2025-10-09T18:08:07.205546] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-09T18:08:07.353793] [DEBUG] [LOCAL ] CNI: Primary data saved (52058 records). [2025-10-09T18:08:07.353929] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-09T18:08:07.354004] [INFO ] [MAIN ] Update Progress: 493/2373 symbols completed. CNI took 28.7s. Estimated remaining: 4h 19m 33s. Rate: 7.2 symbols/min [2025-10-09T18:08:07.539380] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:07.558732] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T18:08:07.602770] [DEBUG] [LOCAL ] CNNE: Loaded 36255 existing records from primary storage. [2025-10-09T18:08:07.603051] [INFO ] [MAIN ] CNNE: Loaded 36255 existing records. [2025-10-09T18:08:07.780382] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:07.780715] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-09T18:08:07.780793] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-09T18:08:07.781162] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-09T18:08:07.781221] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-09T18:08:08.017420] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-09T18:08:08.024886] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T18:08:08.183201] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:08.203083] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T18:08:08.796704] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-09T18:08:09.596754] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-09T18:08:09.781411] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T18:08:09.906637] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T18:08:10.396714] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-09T18:08:11.087815] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T18:08:11.196767] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-09T18:08:11.440940] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:08:11.996733] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-09T18:08:12.646630] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:08:12.796759] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-09T18:08:13.416361] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T18:08:13.421314] [INFO ] [REMOTE ] CNK: Full fetch complete (75470 records). [2025-10-09T18:08:13.421584] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-09T18:08:13.422797] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:08:13.422929] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:08:13.423014] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:08:13.423129] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-09T18:08:13.423244] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-09T18:08:13.423327] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-10-09T18:08:13.423731] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-10-09T18:08:13.423872] [INFO ] [MAIN ] Update Progress: 494/2373 symbols completed. CNK took 33.1s. Estimated remaining: 4h 19m 16s. Rate: 7.2 symbols/min [2025-10-09T18:08:13.599698] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-09T18:08:13.602717] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:13.645624] [DEBUG] [LOCAL ] CNO: Loaded 40837 existing records from primary storage. [2025-10-09T18:08:13.645982] [INFO ] [MAIN ] CNO: Loaded 40837 existing records. [2025-10-09T18:08:13.822788] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:13.823007] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-09T18:08:13.823056] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-09T18:08:13.823381] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-09T18:08:13.823437] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-09T18:08:14.104500] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T18:08:14.267415] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:14.396737] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-09T18:08:14.849097] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T18:08:15.177175] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:08:15.196686] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-09T18:08:15.996792] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-09T18:08:16.276284] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:08:16.796717] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-09T18:08:17.374374] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:08:17.596744] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-09T18:08:18.398251] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-09T18:08:18.401464] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T18:08:19.044488] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T18:08:19.196773] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-09T18:08:19.851424] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:08:19.996719] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-09T18:08:20.389227] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T18:08:20.796727] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-09T18:08:21.251373] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T18:08:21.596742] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-09T18:08:22.121222] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:08:22.396700] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-09T18:08:22.990689] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T18:08:23.196718] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-09T18:08:23.996754] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-09T18:08:24.110267] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:08:24.601306] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T18:08:24.796721] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-09T18:08:25.299888] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T18:08:25.596740] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-09T18:08:26.249588] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T18:08:26.396693] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-09T18:08:26.801264] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T18:08:27.196717] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-09T18:08:27.858772] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T18:08:27.996752] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-09T18:08:28.796693] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-09T18:08:28.892683] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T18:08:28.897016] [INFO ] [REMOTE ] CNM: Full fetch complete (73612 records). [2025-10-09T18:08:28.897140] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-09T18:08:29.311114] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-09T18:08:29.323420] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-09T18:08:29.324441] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-09T18:08:29.324564] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-09T18:08:29.326507] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T18:08:29.335321] [DEBUG] [LOCAL ] CNM: Trimmed 73612 records to 51430 (keeping 200 days of data) [2025-10-09T18:08:29.614489] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-09T18:08:29.659048] [DEBUG] [LOCAL ] CNM: Primary data saved (51430 records). [2025-10-09T18:08:29.659202] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-09T18:08:29.659806] [INFO ] [MAIN ] Update Progress: 495/2373 symbols completed. CNM took 36.1s. Estimated remaining: 4h 19m 38s. Rate: 7.2 symbols/min [2025-10-09T18:08:29.864099] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:29.882917] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:08:29.942204] [DEBUG] [LOCAL ] CNP: Loaded 53476 existing records from primary storage. [2025-10-09T18:08:29.942542] [INFO ] [MAIN ] CNP: Loaded 53476 existing records. [2025-10-09T18:08:30.157215] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:30.157484] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-09T18:08:30.157535] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-09T18:08:30.157796] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-09T18:08:30.157876] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-09T18:08:30.401963] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-09T18:08:30.575544] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:30.982163] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T18:08:31.196713] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-09T18:08:31.809302] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T18:08:31.812518] [INFO ] [REMOTE ] CNNE: Full fetch complete (50230 records). [2025-10-09T18:08:31.812604] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-09T18:08:32.001873] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-09T18:08:32.192480] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-09T18:08:32.192559] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-09T18:08:32.193263] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-09T18:08:32.193326] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-09T18:08:32.194592] [DEBUG] [LOCAL ] CNNE: Trimmed 50230 records to 36507 (keeping 200 days of data) [2025-10-09T18:08:32.421610] [DEBUG] [LOCAL ] CNNE: Primary data saved (36507 records). [2025-10-09T18:08:32.421778] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-09T18:08:32.421865] [INFO ] [MAIN ] Update Progress: 496/2373 symbols completed. CNNE took 25.1s. Estimated remaining: 4h 19m 9s. Rate: 7.2 symbols/min [2025-10-09T18:08:32.590156] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:32.642084] [DEBUG] [LOCAL ] CNQ: Loaded 53577 existing records from primary storage. [2025-10-09T18:08:32.642411] [INFO ] [MAIN ] CNQ: Loaded 53577 existing records. [2025-10-09T18:08:32.802101] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-09T18:08:32.822695] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:32.823018] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-09T18:08:32.823074] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-09T18:08:32.823340] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-09T18:08:32.823398] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-09T18:08:33.230140] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:33.234144] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T18:08:33.282620] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T18:08:33.596777] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-09T18:08:34.072480] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T18:08:34.396717] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-09T18:08:35.196743] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-09T18:08:35.241253] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:08:35.461510] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:08:35.996729] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-09T18:08:36.796691] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-09T18:08:37.064982] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T18:08:37.104372] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:08:37.596716] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-09T18:08:38.260083] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T18:08:38.396702] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-09T18:08:38.868182] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T18:08:39.196731] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-09T18:08:39.678321] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:08:39.996759] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-09T18:08:40.437042] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:08:40.439812] [INFO ] [REMOTE ] CNMD: Full fetch complete (47180 records). [2025-10-09T18:08:40.439900] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-09T18:08:40.803973] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-09T18:08:40.831104] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-09T18:08:40.831180] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-09T18:08:40.831868] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-09T18:08:40.832016] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-09T18:08:40.833231] [DEBUG] [LOCAL ] CNMD: Trimmed 47180 records to 32304 (keeping 200 days of data) [2025-10-09T18:08:41.045569] [DEBUG] [LOCAL ] CNMD: Primary data saved (32304 records). [2025-10-09T18:08:41.045738] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-09T18:08:41.046777] [INFO ] [MAIN ] Update Progress: 497/2373 symbols completed. CNMD took 38.2s. Estimated remaining: 4h 19m 2s. Rate: 7.2 symbols/min [2025-10-09T18:08:41.221503] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:41.221711] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-09T18:08:41.221762] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-09T18:08:41.221881] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-09T18:08:41.221924] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-09T18:08:41.221994] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-09T18:08:41.222056] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-09T18:08:41.598864] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:41.598967] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-09T18:08:41.722602] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:08:42.408676] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-09T18:08:42.411074] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T18:08:42.603499] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:08:42.603814] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-09T18:08:42.603902] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:08:42.603949] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-09T18:08:42.603984] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:08:42.604020] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-09T18:08:42.604075] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-09T18:08:42.604128] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-09T18:08:42.604197] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-09T18:08:42.604248] [INFO ] [MAIN ] Update Progress: 498/2373 symbols completed. CNR took 1.6s. Estimated remaining: 4h 18m 28s. Rate: 7.3 symbols/min [2025-10-09T18:08:42.774784] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:42.797110] [DEBUG] [LOCAL ] CNS: Loaded 20802 existing records from primary storage. [2025-10-09T18:08:42.797376] [INFO ] [MAIN ] CNS: Loaded 20802 existing records. [2025-10-09T18:08:42.974532] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:42.974811] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-09T18:08:42.974879] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-09T18:08:42.975190] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-09T18:08:42.975271] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-09T18:08:43.198594] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-09T18:08:43.337680] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:43.409702] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:08:43.996794] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-09T18:08:44.402624] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:08:44.796686] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-09T18:08:45.125707] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T18:08:45.596737] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-09T18:08:45.814996] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T18:08:46.396746] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-09T18:08:47.196746] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-09T18:08:47.355079] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T18:08:47.996748] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-09T18:08:48.148291] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T18:08:48.369585] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:08:48.796701] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-09T18:08:49.596679] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-09T18:08:49.650611] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:08:50.154101] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:08:50.157794] [INFO ] [REMOTE ] CNO: Full fetch complete (60616 records). [2025-10-09T18:08:50.157933] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-09T18:08:50.408994] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-09T18:08:50.545019] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-09T18:08:50.545108] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-09T18:08:50.546745] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-09T18:08:50.546827] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-09T18:08:50.548237] [DEBUG] [LOCAL ] CNO: Trimmed 60616 records to 41137 (keeping 200 days of data) [2025-10-09T18:08:50.814317] [DEBUG] [LOCAL ] CNO: Primary data saved (41137 records). [2025-10-09T18:08:50.814446] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-09T18:08:50.814557] [INFO ] [MAIN ] Update Progress: 499/2373 symbols completed. CNO took 37.4s. Estimated remaining: 4h 18m 20s. Rate: 7.3 symbols/min [2025-10-09T18:08:50.993410] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:50.993620] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-09T18:08:50.993748] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-09T18:08:50.993869] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-09T18:08:50.993912] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-09T18:08:50.993957] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-09T18:08:50.993989] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-09T18:08:51.203550] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-09T18:08:51.390811] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:51.420987] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T18:08:51.845106] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T18:08:51.996699] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-09T18:08:52.420531] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T18:08:52.796692] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-09T18:08:53.596686] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-09T18:08:53.823778] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T18:08:54.396725] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-09T18:08:54.494446] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T18:08:54.527176] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T18:08:55.196728] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-09T18:08:55.944524] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T18:08:55.996676] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-09T18:08:56.796678] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-09T18:08:57.063571] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T18:08:57.596737] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-09T18:08:57.890760] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T18:08:58.396687] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-09T18:08:58.547741] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T18:08:58.811062] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:08:59.196758] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-09T18:08:59.996725] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-09T18:09:00.163463] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T18:09:00.796744] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-09T18:09:00.930024] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:09:01.126956] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T18:09:01.596761] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-09T18:09:02.396721] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-09T18:09:02.496368] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T18:09:02.657477] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T18:09:03.196716] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-09T18:09:03.976321] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T18:09:03.996678] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-09T18:09:04.276712] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T18:09:04.796704] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-09T18:09:05.596688] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-09T18:09:05.746017] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:09:05.751878] [INFO ] [REMOTE ] CNP: Full fetch complete (77365 records). [2025-10-09T18:09:05.752010] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-09T18:09:06.125121] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T18:09:06.241705] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-09T18:09:06.241828] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-09T18:09:06.243016] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-09T18:09:06.243090] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-09T18:09:06.244676] [DEBUG] [LOCAL ] CNP: Trimmed 77365 records to 53863 (keeping 200 days of data) [2025-10-09T18:09:06.428719] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-09T18:09:06.586110] [DEBUG] [LOCAL ] CNP: Primary data saved (53863 records). [2025-10-09T18:09:06.586258] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-09T18:09:06.586881] [INFO ] [MAIN ] Update Progress: 500/2373 symbols completed. CNP took 36.9s. Estimated remaining: 4h 18m 40s. Rate: 7.2 symbols/min [2025-10-09T18:09:06.752219] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:06.791779] [DEBUG] [LOCAL ] CODI: Loaded 40636 existing records from primary storage. [2025-10-09T18:09:06.792079] [INFO ] [MAIN ] CODI: Loaded 40636 existing records. [2025-10-09T18:09:06.964409] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:09:06.964615] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-09T18:09:06.964690] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-09T18:09:06.964959] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-09T18:09:06.965015] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-09T18:09:07.206464] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-09T18:09:07.356234] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:07.386073] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T18:09:07.996712] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-09T18:09:08.048388] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T18:09:08.113314] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T18:09:08.796717] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-09T18:09:09.439148] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T18:09:09.443634] [INFO ] [REMOTE ] CNQ: Full fetch complete (77554 records). [2025-10-09T18:09:09.443785] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-09T18:09:09.599859] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-09T18:09:09.847600] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-09T18:09:09.847771] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-09T18:09:09.848769] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-09T18:09:09.848836] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-09T18:09:09.850414] [DEBUG] [LOCAL ] CNQ: Trimmed 77554 records to 53967 (keeping 200 days of data) [2025-10-09T18:09:09.967797] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:09:10.207999] [DEBUG] [LOCAL ] CNQ: Primary data saved (53967 records). [2025-10-09T18:09:10.208148] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-09T18:09:10.208242] [INFO ] [MAIN ] Update Progress: 501/2373 symbols completed. CNQ took 37.8s. Estimated remaining: 4h 18m 14s. Rate: 7.2 symbols/min [2025-10-09T18:09:10.374206] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:10.403583] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-09T18:09:10.427508] [DEBUG] [LOCAL ] COF: Loaded 53612 existing records from primary storage. [2025-10-09T18:09:10.429849] [INFO ] [MAIN ] COF: Loaded 53612 existing records. [2025-10-09T18:09:10.608698] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:09:10.608991] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-09T18:09:10.609051] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-09T18:09:10.609526] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-09T18:09:10.609585] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-09T18:09:10.981076] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:09:10.984850] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:11.196684] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-09T18:09:11.482325] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:09:11.485134] [INFO ] [REMOTE ] CNS: Full fetch complete (30386 records). [2025-10-09T18:09:11.485217] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-09T18:09:11.868498] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-09T18:09:11.868587] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-09T18:09:11.869107] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-09T18:09:11.869171] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-09T18:09:11.869984] [DEBUG] [LOCAL ] CNS: Trimmed 30386 records to 20993 (keeping 200 days of data) [2025-10-09T18:09:11.998200] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-09T18:09:12.002602] [DEBUG] [LOCAL ] CNS: Primary data saved (20993 records). [2025-10-09T18:09:12.002771] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-09T18:09:12.002862] [INFO ] [MAIN ] Update Progress: 502/2373 symbols completed. CNS took 29.4s. Estimated remaining: 4h 17m 42s. Rate: 7.3 symbols/min [2025-10-09T18:09:12.169606] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:12.221117] [DEBUG] [LOCAL ] COHR: Loaded 53371 existing records from primary storage. [2025-10-09T18:09:12.221524] [INFO ] [MAIN ] COHR: Loaded 53371 existing records. [2025-10-09T18:09:12.397685] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:09:12.397985] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-09T18:09:12.398036] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-09T18:09:12.398278] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-09T18:09:12.398335] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-09T18:09:12.709729] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T18:09:12.775215] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:12.796671] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-09T18:09:13.596740] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-09T18:09:13.955368] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T18:09:14.396769] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-09T18:09:14.678862] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T18:09:15.045729] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T18:09:15.196690] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-09T18:09:15.996737] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-09T18:09:16.372286] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T18:09:16.796798] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-09T18:09:16.876467] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T18:09:17.546270] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:09:17.596692] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-09T18:09:18.396775] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-09T18:09:18.616369] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:09:18.818956] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:09:19.196724] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-09T18:09:19.996690] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-09T18:09:20.322716] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-09T18:09:20.769779] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T18:09:20.796678] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-09T18:09:21.508695] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:09:21.596675] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-09T18:09:22.396690] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-09T18:09:22.564911] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:09:23.196716] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-09T18:09:23.504987] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:09:23.996741] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-09T18:09:24.142606] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:09:24.434084] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:09:24.796771] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-09T18:09:25.596687] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-09T18:09:26.135989] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T18:09:26.222910] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T18:09:26.396671] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-09T18:09:26.826615] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T18:09:27.196756] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-09T18:09:27.820969] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T18:09:27.996796] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-09T18:09:28.410191] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:09:28.796740] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-09T18:09:29.275228] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T18:09:29.279509] [INFO ] [REMOTE ] CNX: Full fetch complete (74710 records). [2025-10-09T18:09:29.279615] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-09T18:09:29.606469] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-09T18:09:29.663687] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-09T18:09:29.663774] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-09T18:09:29.664588] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-09T18:09:29.664629] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-09T18:09:29.666206] [DEBUG] [LOCAL ] CNX: Trimmed 74710 records to 51694 (keeping 200 days of data) [2025-10-09T18:09:29.963660] [DEBUG] [LOCAL ] CNX: Primary data saved (51694 records). [2025-10-09T18:09:29.963794] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-09T18:09:29.963876] [INFO ] [MAIN ] Update Progress: 503/2373 symbols completed. CNX took 39.1s. Estimated remaining: 4h 18m 9s. Rate: 7.2 symbols/min [2025-10-09T18:09:30.131308] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:30.181236] [DEBUG] [LOCAL ] COLD: Loaded 52250 existing records from primary storage. [2025-10-09T18:09:30.181756] [INFO ] [MAIN ] COLD: Loaded 52250 existing records. [2025-10-09T18:09:30.355285] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:09:30.355458] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-09T18:09:30.355504] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-09T18:09:30.355747] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-09T18:09:30.355803] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-09T18:09:30.408982] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-09T18:09:30.720045] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:30.914057] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-09T18:09:31.196709] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-09T18:09:31.342181] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T18:09:31.996722] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-09T18:09:32.291419] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T18:09:32.744136] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:09:32.796679] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-09T18:09:33.596736] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-09T18:09:33.803701] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T18:09:34.396697] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-09T18:09:34.423486] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:09:35.196741] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-09T18:09:35.346125] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T18:09:35.996802] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-09T18:09:36.305589] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-09T18:09:36.796908] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-09T18:09:37.068193] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T18:09:37.564714] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T18:09:37.596681] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-09T18:09:38.389369] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:09:38.400340] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-09T18:09:38.951953] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:09:39.196784] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-09T18:09:39.568151] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T18:09:39.996706] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-09T18:09:40.796718] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-09T18:09:41.146443] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T18:09:41.328666] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T18:09:41.596711] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-09T18:09:42.396725] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-09T18:09:43.096552] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-09T18:09:43.196694] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-09T18:09:43.285064] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T18:09:43.996707] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-09T18:09:44.352414] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-09T18:09:44.796714] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-09T18:09:45.155075] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-09T18:09:45.600688] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-09T18:09:45.606374] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T18:09:46.396749] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-09T18:09:46.442971] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T18:09:46.447453] [INFO ] [REMOTE ] COF: Full fetch complete (77446 records). [2025-10-09T18:09:46.447559] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-09T18:09:46.861515] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-09T18:09:46.861596] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-09T18:09:46.862443] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-09T18:09:46.862507] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-09T18:09:46.863920] [DEBUG] [LOCAL ] COF: Trimmed 77446 records to 54002 (keeping 200 days of data) [2025-10-09T18:09:47.197677] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-09T18:09:47.227144] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T18:09:47.247717] [DEBUG] [LOCAL ] COF: Primary data saved (54002 records). [2025-10-09T18:09:47.247836] [INFO ] [MAIN ] COF: Full history saved. [2025-10-09T18:09:47.247949] [INFO ] [MAIN ] Update Progress: 504/2373 symbols completed. COF took 37.0s. Estimated remaining: 4h 18m 35s. Rate: 7.2 symbols/min [2025-10-09T18:09:47.419601] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:47.419802] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-09T18:09:47.419859] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-09T18:09:47.419967] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-09T18:09:47.420010] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-09T18:09:47.420051] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-09T18:09:47.420125] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-09T18:09:47.808213] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:47.840846] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T18:09:47.996723] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-09T18:09:48.796716] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-09T18:09:49.459594] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-09T18:09:49.464130] [INFO ] [REMOTE ] COHR: Full fetch complete (77175 records). [2025-10-09T18:09:49.464252] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-09T18:09:49.603836] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-09T18:09:49.874850] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-09T18:09:49.875039] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-09T18:09:49.876030] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-09T18:09:49.876192] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-09T18:09:49.909539] [DEBUG] [LOCAL ] COHR: Trimmed 77175 records to 53761 (keeping 200 days of data) [2025-10-09T18:09:49.911728] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T18:09:50.254635] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T18:09:50.265026] [DEBUG] [LOCAL ] COHR: Primary data saved (53761 records). [2025-10-09T18:09:50.265602] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-09T18:09:50.266569] [INFO ] [MAIN ] Update Progress: 505/2373 symbols completed. COHR took 38.3s. Estimated remaining: 4h 18m 7s. Rate: 7.2 symbols/min [2025-10-09T18:09:50.266720] [INFO ] [REMOTE ] CODI: Full fetch complete (51691 records). [2025-10-09T18:09:50.278842] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-09T18:09:50.406077] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-09T18:09:50.617337] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:50.642020] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-09T18:09:50.647230] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-09T18:09:50.654342] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-09T18:09:50.669619] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-09T18:09:50.670225] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-09T18:09:50.682054] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-09T18:09:51.171579] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-09T18:09:51.186236] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-09T18:09:51.197982] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-09T18:09:51.207444] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-09T18:09:51.264359] [DEBUG] [LOCAL ] CODI: Trimmed 51691 records to 40992 (keeping 200 days of data) [2025-10-09T18:09:51.417283] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:51.446894] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-09T18:09:51.620548] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T18:09:51.669582] [DEBUG] [LOCAL ] CODI: Primary data saved (40992 records). [2025-10-09T18:09:51.669792] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-09T18:09:51.670494] [INFO ] [MAIN ] Update Progress: 506/2373 symbols completed. CODI took 45.1s. Estimated remaining: 4h 17m 33s. Rate: 7.2 symbols/min [2025-10-09T18:09:51.811403] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T18:09:51.919093] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:51.919282] [DEBUG] [LOCAL ] COOK: No existing data file found in primary storage. [2025-10-09T18:09:51.919323] [WARN ] [MAIN ] COOK: No existing data found, performing full refresh instead. [2025-10-09T18:09:51.919432] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-09T18:09:51.919474] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-09T18:09:51.919514] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-09T18:09:51.919546] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-09T18:09:52.001867] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-09T18:09:52.270525] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:52.796696] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-09T18:09:52.915800] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T18:09:53.489531] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T18:09:53.596718] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-09T18:09:54.241749] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:09:54.396723] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-09T18:09:55.044979] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T18:09:55.196739] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-09T18:09:55.996704] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-09T18:09:56.122916] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T18:09:56.639994] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:09:56.796712] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-09T18:09:56.889681] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:09:57.596720] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-09T18:09:58.396754] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-09T18:09:58.540000] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:09:59.053564] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T18:09:59.196686] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-09T18:09:59.390007] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T18:09:59.394438] [INFO ] [REMOTE ] COLD: Full fetch complete (74478 records). [2025-10-09T18:09:59.394552] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-09T18:09:59.788075] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-09T18:09:59.788170] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-09T18:09:59.789420] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-09T18:09:59.789489] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-09T18:09:59.791261] [DEBUG] [LOCAL ] COLD: Trimmed 74478 records to 52638 (keeping 200 days of data) [2025-10-09T18:10:00.005467] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-09T18:10:00.126719] [DEBUG] [LOCAL ] COLD: Primary data saved (52638 records). [2025-10-09T18:10:00.126866] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-09T18:10:00.126951] [INFO ] [MAIN ] Update Progress: 507/2373 symbols completed. COLD took 30.2s. Estimated remaining: 4h 17m 25s. Rate: 7.2 symbols/min [2025-10-09T18:10:00.296676] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:00.296891] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-10-09T18:10:00.296942] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-10-09T18:10:00.297065] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-09T18:10:00.297106] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-09T18:10:00.297148] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-09T18:10:00.297179] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-09T18:10:00.663000] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:00.796724] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-09T18:10:00.818138] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T18:10:01.170785] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-09T18:10:01.596719] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-09T18:10:02.396814] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-09T18:10:02.714972] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T18:10:03.196705] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-09T18:10:03.227522] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T18:10:03.940797] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T18:10:03.996680] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-09T18:10:04.796776] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-09T18:10:05.112594] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-09T18:10:05.511751] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T18:10:05.596718] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-09T18:10:06.396682] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-09T18:10:06.608834] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:10:06.685250] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T18:10:07.196725] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-09T18:10:07.900395] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:10:07.996711] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-09T18:10:08.796726] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-09T18:10:08.985023] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T18:10:09.064132] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T18:10:09.596776] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-09T18:10:10.008557] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:10:10.396774] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-09T18:10:10.774502] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T18:10:11.196794] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-09T18:10:11.996760] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-09T18:10:12.229761] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T18:10:12.796710] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-09T18:10:13.100240] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T18:10:13.282460] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T18:10:13.596753] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-09T18:10:14.396746] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-09T18:10:14.955216] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:10:15.126711] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-09T18:10:15.196671] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-09T18:10:15.996693] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-09T18:10:16.020471] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T18:10:16.796794] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-09T18:10:16.814018] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T18:10:17.341402] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-09T18:10:17.596730] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-09T18:10:18.320423] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:10:18.396745] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-09T18:10:19.196692] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-09T18:10:19.511639] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T18:10:19.874235] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T18:10:19.996728] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-09T18:10:20.796795] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-09T18:10:21.596699] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-09T18:10:21.683382] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-09T18:10:21.688038] [INFO ] [REMOTE ] COMP: Full fetch complete (77196 records). [2025-10-09T18:10:21.688157] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-09T18:10:22.085881] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-09T18:10:22.085969] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-09T18:10:22.086831] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-09T18:10:22.086898] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-09T18:10:22.088622] [DEBUG] [LOCAL ] COMP: Trimmed 77196 records to 53792 (keeping 200 days of data) [2025-10-09T18:10:22.393369] [DEBUG] [LOCAL ] COMP: Primary data saved (53792 records). [2025-10-09T18:10:22.393505] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-09T18:10:22.393579] [INFO ] [MAIN ] Update Progress: 508/2373 symbols completed. COMP took 35.1s. Estimated remaining: 4h 18m 8s. Rate: 7.2 symbols/min [2025-10-09T18:10:22.537596] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:10:22.589526] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:22.569154] [INFO ] [REMOTE ] CON: Full fetch complete (56699 records). [2025-10-09T18:10:22.589819] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-09T18:10:22.944379] [DEBUG] [LOCAL ] COR: Loaded 46781 existing records from primary storage. [2025-10-09T18:10:22.972613] [INFO ] [MAIN ] COR: Loaded 46781 existing records. [2025-10-09T18:10:23.102513] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-09T18:10:23.117028] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-09T18:10:23.133856] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-09T18:10:23.139208] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-09T18:10:23.199391] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:10:23.200263] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-09T18:10:23.200441] [DEBUG] [LOCAL ] CON: Trimmed 56699 records to 39099 (keeping 200 days of data) [2025-10-09T18:10:23.205977] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-09T18:10:23.215331] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-09T18:10:23.216630] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T18:10:23.215891] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-09T18:10:23.360122] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-09T18:10:23.382000] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (3.39 seconds). [2025-10-09T18:10:23.473298] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-09T18:10:23.761210] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:23.911233] [DEBUG] [LOCAL ] CON: Primary data saved (39099 records). [2025-10-09T18:10:23.911409] [INFO ] [MAIN ] CON: Full history saved. [2025-10-09T18:10:23.911491] [INFO ] [MAIN ] Update Progress: 509/2373 symbols completed. CON took 33.6s. Estimated remaining: 4h 17m 35s. Rate: 7.2 symbols/min [2025-10-09T18:10:24.006387] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-09T18:10:24.090934] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:24.091106] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-09T18:10:24.091144] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-09T18:10:24.091254] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-09T18:10:24.091297] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-09T18:10:24.091337] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-09T18:10:24.091370] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-09T18:10:24.459177] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T18:10:24.518119] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:24.796747] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-09T18:10:25.596697] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-09T18:10:25.773813] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-09T18:10:25.866279] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T18:10:26.396682] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-09T18:10:26.559762] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:10:26.776147] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:10:26.778721] [INFO ] [REMOTE ] COOK: Full fetch complete (32719 records). [2025-10-09T18:10:26.778813] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-09T18:10:27.159152] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-09T18:10:27.159270] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-09T18:10:27.159811] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-09T18:10:27.159876] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-09T18:10:27.160771] [DEBUG] [LOCAL ] COOK: Trimmed 32719 records to 24658 (keeping 200 days of data) [2025-10-09T18:10:27.205634] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-09T18:10:27.303968] [DEBUG] [LOCAL ] COOK: Primary data saved (24658 records). [2025-10-09T18:10:27.304124] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-09T18:10:27.304240] [INFO ] [MAIN ] Update Progress: 510/2373 symbols completed. COOK took 35.6s. Estimated remaining: 4h 17m 9s. Rate: 7.2 symbols/min [2025-10-09T18:10:27.476367] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:27.523099] [DEBUG] [LOCAL ] COUR: Loaded 49053 existing records from primary storage. [2025-10-09T18:10:27.523409] [INFO ] [MAIN ] COUR: Loaded 49053 existing records. [2025-10-09T18:10:27.697617] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:10:27.697842] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-09T18:10:27.697956] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-09T18:10:27.698172] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-09T18:10:27.698229] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-09T18:10:27.998625] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-09T18:10:28.185973] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:28.238168] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T18:10:28.700555] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T18:10:28.796785] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-09T18:10:29.596707] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-09T18:10:29.666328] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T18:10:30.396766] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-09T18:10:30.628192] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T18:10:31.196685] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-09T18:10:31.271054] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:10:31.981044] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:10:31.996665] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-09T18:10:32.796772] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-09T18:10:33.100050] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T18:10:33.596736] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-09T18:10:33.757243] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T18:10:34.397054] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-09T18:10:34.400117] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T18:10:35.196710] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-09T18:10:35.322688] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T18:10:35.869694] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T18:10:35.874332] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-09T18:10:35.874490] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-09T18:10:36.001798] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-09T18:10:36.278585] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-09T18:10:36.278738] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-09T18:10:36.279814] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-09T18:10:36.279896] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-09T18:10:36.310053] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:10:36.308579] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54117 (keeping 200 days of data) [2025-10-09T18:10:36.654544] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-10-09T18:10:36.654718] [INFO ] [MAIN ] COP: Full history saved. [2025-10-09T18:10:36.654821] [INFO ] [MAIN ] Update Progress: 511/2373 symbols completed. COP took 36.5s. Estimated remaining: 4h 17m 5s. Rate: 7.2 symbols/min [2025-10-09T18:10:36.804666] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-09T18:10:36.823077] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:36.823334] [DEBUG] [LOCAL ] CP: No existing data file found in primary storage. [2025-10-09T18:10:36.823989] [WARN ] [MAIN ] CP: No existing data found, performing full refresh instead. [2025-10-09T18:10:36.824101] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-09T18:10:36.824143] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-09T18:10:36.824184] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-09T18:10:36.824225] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-09T18:10:37.178985] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:37.596762] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-09T18:10:37.744756] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:10:38.396755] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-09T18:10:38.535571] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:10:39.196782] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-09T18:10:39.415187] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T18:10:39.996776] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-09T18:10:40.042904] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:10:40.796699] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-09T18:10:40.882864] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T18:10:41.596712] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-09T18:10:41.704419] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:10:42.396684] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-09T18:10:42.630393] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T18:10:43.196685] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-09T18:10:43.451177] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T18:10:43.996727] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-09T18:10:44.120288] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:10:44.663626] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T18:10:44.796714] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-09T18:10:45.549836] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T18:10:45.596699] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-09T18:10:46.396761] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-09T18:10:46.598630] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T18:10:46.673288] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T18:10:47.196722] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-09T18:10:47.996710] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-09T18:10:48.133103] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T18:10:48.789751] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:10:48.798813] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-09T18:10:49.601912] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-09T18:10:49.617407] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T18:10:50.396704] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-09T18:10:50.688733] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T18:10:51.108970] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T18:10:51.196709] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-09T18:10:51.996690] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-09T18:10:52.151033] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T18:10:52.796792] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-09T18:10:53.474714] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-09T18:10:53.596698] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-09T18:10:54.396721] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-09T18:10:55.386876] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-09T18:10:55.398025] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-09T18:10:55.481950] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T18:10:55.505871] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (3.51 seconds). [2025-10-09T18:10:55.996768] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-09T18:10:56.290517] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T18:10:56.796694] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-09T18:10:56.843942] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:10:56.848388] [INFO ] [REMOTE ] COUR: Full fetch complete (70861 records). [2025-10-09T18:10:56.848501] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-09T18:10:57.239686] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-09T18:10:57.239776] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-09T18:10:57.240663] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-09T18:10:57.240726] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-09T18:10:57.242086] [DEBUG] [LOCAL ] COUR: Trimmed 70861 records to 49416 (keeping 200 days of data) [2025-10-09T18:10:57.550017] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T18:10:57.574450] [DEBUG] [LOCAL ] COUR: Primary data saved (49416 records). [2025-10-09T18:10:57.574568] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-09T18:10:57.575155] [INFO ] [MAIN ] Update Progress: 512/2373 symbols completed. COUR took 30.3s. Estimated remaining: 4h 17m 42s. Rate: 7.2 symbols/min [2025-10-09T18:10:57.604191] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-09T18:10:57.746013] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:57.777400] [DEBUG] [LOCAL ] CPA: Loaded 28240 existing records from primary storage. [2025-10-09T18:10:57.777718] [INFO ] [MAIN ] CPA: Loaded 28240 existing records. [2025-10-09T18:10:57.960121] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:10:57.960328] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-09T18:10:57.960416] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-09T18:10:57.960838] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-09T18:10:57.960899] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-09T18:10:58.325181] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:58.362217] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T18:10:58.366127] [INFO ] [REMOTE ] COR: Full fetch complete (68587 records). [2025-10-09T18:10:58.366269] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-09T18:10:58.401793] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-09T18:10:58.777312] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-09T18:10:58.777407] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-09T18:10:58.778247] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-09T18:10:58.778315] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-09T18:10:58.779772] [DEBUG] [LOCAL ] COR: Trimmed 68587 records to 47111 (keeping 200 days of data) [2025-10-09T18:10:59.082704] [DEBUG] [LOCAL ] COR: Primary data saved (47111 records). [2025-10-09T18:10:59.082864] [INFO ] [MAIN ] COR: Full history saved. [2025-10-09T18:10:59.082952] [INFO ] [MAIN ] Update Progress: 513/2373 symbols completed. COR took 36.7s. Estimated remaining: 4h 17m 9s. Rate: 7.2 symbols/min [2025-10-09T18:10:59.198485] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-09T18:10:59.287322] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:59.304975] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-09T18:10:59.305090] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-09T18:10:59.305282] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-09T18:10:59.305563] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-09T18:10:59.306068] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-09T18:10:59.307332] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T18:10:59.318305] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-09T18:10:59.706378] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:59.996703] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-09T18:11:00.240512] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T18:11:00.654006] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T18:11:00.796727] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-09T18:11:01.259878] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T18:11:01.596750] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-09T18:11:01.838300] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:11:02.396743] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-09T18:11:03.083440] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T18:11:03.196672] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-09T18:11:03.282722] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T18:11:03.287173] [INFO ] [REMOTE ] COTY: Full fetch complete (77114 records). [2025-10-09T18:11:03.287279] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-09T18:11:03.686727] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-09T18:11:03.686881] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-09T18:11:03.687941] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-09T18:11:03.688015] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-09T18:11:03.689701] [DEBUG] [LOCAL ] COTY: Trimmed 77114 records to 53632 (keeping 200 days of data) [2025-10-09T18:11:03.990909] [DEBUG] [LOCAL ] COTY: Primary data saved (53632 records). [2025-10-09T18:11:03.991057] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-09T18:11:03.991176] [INFO ] [MAIN ] Update Progress: 514/2373 symbols completed. COTY took 40.1s. Estimated remaining: 4h 16m 49s. Rate: 7.2 symbols/min [2025-10-09T18:11:04.002501] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-09T18:11:04.158785] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:04.188428] [DEBUG] [LOCAL ] CPAY: Loaded 30443 existing records from primary storage. [2025-10-09T18:11:04.188711] [INFO ] [MAIN ] CPAY: Loaded 30443 existing records. [2025-10-09T18:11:04.367479] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:04.367726] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-09T18:11:04.367783] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-09T18:11:04.371758] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-09T18:11:04.371889] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-09T18:11:04.740680] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:04.796671] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-09T18:11:05.073889] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T18:11:05.556338] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T18:11:05.596695] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-09T18:11:05.836694] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T18:11:06.396802] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-09T18:11:06.912985] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:11:07.196778] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-09T18:11:07.996681] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-09T18:11:08.038538] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T18:11:08.043048] [INFO ] [REMOTE ] CP: Full fetch complete (77125 records). [2025-10-09T18:11:08.043159] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-09T18:11:08.271081] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-09T18:11:08.444390] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-09T18:11:08.444590] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-09T18:11:08.445723] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-09T18:11:08.445829] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-09T18:11:08.458089] [DEBUG] [LOCAL ] CP: Trimmed 77125 records to 53653 (keeping 200 days of data) [2025-10-09T18:11:08.467334] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T18:11:08.796721] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-09T18:11:08.813424] [DEBUG] [LOCAL ] CP: Primary data saved (53653 records). [2025-10-09T18:11:08.813527] [INFO ] [MAIN ] CP: Full history saved. [2025-10-09T18:11:08.813601] [INFO ] [MAIN ] Update Progress: 515/2373 symbols completed. CP took 32.2s. Estimated remaining: 4h 16m 28s. Rate: 7.2 symbols/min [2025-10-09T18:11:08.984627] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:09.000159] [DEBUG] [LOCAL ] CPF: Loaded 15169 existing records from primary storage. [2025-10-09T18:11:09.000395] [INFO ] [MAIN ] CPF: Loaded 15169 existing records. [2025-10-09T18:11:09.184585] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:09.187298] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-09T18:11:09.187205] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-09T18:11:09.187443] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-09T18:11:09.188831] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-09T18:11:09.188891] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-09T18:11:09.543206] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:09.596684] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-09T18:11:09.962043] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-09T18:11:10.396715] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-09T18:11:11.196689] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-09T18:11:11.575240] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:11:11.996683] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-09T18:11:12.481015] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T18:11:12.796700] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-09T18:11:13.102440] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T18:11:13.596736] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-09T18:11:14.011362] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:11:14.396711] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-09T18:11:14.610095] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T18:11:15.197193] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-09T18:11:15.681924] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-09T18:11:15.701158] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T18:11:15.996732] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-09T18:11:16.276545] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-09T18:11:16.796725] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-09T18:11:17.596714] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-09T18:11:17.789846] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T18:11:18.396776] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-09T18:11:18.924119] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T18:11:19.196728] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-09T18:11:19.811954] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T18:11:19.996693] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-09T18:11:20.245810] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T18:11:20.796800] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-09T18:11:21.222914] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T18:11:21.596725] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-09T18:11:21.880701] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:11:22.396776] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-09T18:11:22.949690] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T18:11:23.196748] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-09T18:11:23.215794] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T18:11:23.561230] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T18:11:23.996729] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-09T18:11:24.796741] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-09T18:11:25.302248] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T18:11:25.596681] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-09T18:11:25.800019] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T18:11:26.396732] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-09T18:11:26.784887] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:11:27.196702] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-09T18:11:27.307124] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T18:11:27.996714] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-09T18:11:28.293192] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:11:28.295709] [INFO ] [REMOTE ] CPA: Full fetch complete (41371 records). [2025-10-09T18:11:28.295791] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-09T18:11:28.487780] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T18:11:28.672892] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-09T18:11:28.672976] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-09T18:11:28.673510] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-09T18:11:28.673550] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-09T18:11:28.674396] [DEBUG] [LOCAL ] CPA: Trimmed 41371 records to 28446 (keeping 200 days of data) [2025-10-09T18:11:28.799002] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-09T18:11:28.858850] [DEBUG] [LOCAL ] CPA: Primary data saved (28446 records). [2025-10-09T18:11:28.858978] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-09T18:11:28.859083] [INFO ] [MAIN ] Update Progress: 516/2373 symbols completed. CPA took 31.3s. Estimated remaining: 4h 17m 2s. Rate: 7.2 symbols/min [2025-10-09T18:11:29.026585] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:29.041524] [DEBUG] [LOCAL ] CPK: Loaded 13647 existing records from primary storage. [2025-10-09T18:11:29.041746] [INFO ] [MAIN ] CPK: Loaded 13647 existing records. [2025-10-09T18:11:29.217196] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:29.217417] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-09T18:11:29.217490] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-09T18:11:29.217780] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-09T18:11:29.217875] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-09T18:11:29.310112] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T18:11:29.575710] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:29.596669] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-09T18:11:30.396684] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-09T18:11:30.535576] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T18:11:30.778465] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T18:11:30.779279] [INFO ] [REMOTE ] CPAC: Full fetch complete (1874 records). [2025-10-09T18:11:30.779352] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-09T18:11:30.964793] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T18:11:30.965035] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:11:30.965129] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:11:30.965223] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-09T18:11:30.965305] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-09T18:11:30.965358] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-09T18:11:30.965427] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-09T18:11:30.965489] [INFO ] [MAIN ] Update Progress: 517/2373 symbols completed. CPAC took 31.9s. Estimated remaining: 4h 16m 32s. Rate: 7.2 symbols/min [2025-10-09T18:11:31.196735] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-09T18:11:31.996737] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-09T18:11:32.563119] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T18:11:32.796692] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-09T18:11:33.032019] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:11:33.596684] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-09T18:11:33.780030] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:11:34.396758] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-09T18:11:34.546827] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T18:11:34.952905] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T18:11:35.196733] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-09T18:11:35.989753] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T18:11:35.996665] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-09T18:11:36.796765] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-09T18:11:37.191586] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:11:37.596799] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-09T18:11:37.699688] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T18:11:38.396774] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-09T18:11:38.788585] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T18:11:38.791173] [INFO ] [REMOTE ] CPAY: Full fetch complete (44795 records). [2025-10-09T18:11:38.791256] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-09T18:11:39.177887] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-09T18:11:39.177975] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-09T18:11:39.178550] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-09T18:11:39.178638] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-09T18:11:39.179697] [DEBUG] [LOCAL ] CPAY: Trimmed 44795 records to 30592 (keeping 200 days of data) [2025-10-09T18:11:39.233951] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-09T18:11:39.297814] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T18:11:39.386111] [DEBUG] [LOCAL ] CPAY: Primary data saved (30592 records). [2025-10-09T18:11:39.386242] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-09T18:11:39.387274] [INFO ] [MAIN ] Update Progress: 518/2373 symbols completed. CPAY took 35.4s. Estimated remaining: 4h 16m 24s. Rate: 7.2 symbols/min [2025-10-09T18:11:39.864668] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:11:39.996698] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-09T18:11:40.796701] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-09T18:11:40.988144] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T18:11:41.596702] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-09T18:11:41.711559] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T18:11:42.119760] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-09T18:11:42.396721] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-09T18:11:43.196763] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-09T18:11:43.300712] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T18:11:43.996679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-09T18:11:44.111004] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T18:11:44.113710] [INFO ] [REMOTE ] CPF: Full fetch complete (23833 records). [2025-10-09T18:11:44.113815] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-09T18:11:44.493935] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-09T18:11:44.494032] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-09T18:11:44.495196] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-09T18:11:44.495258] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-09T18:11:44.495965] [DEBUG] [LOCAL ] CPF: Trimmed 23833 records to 15320 (keeping 200 days of data) [2025-10-09T18:11:44.592330] [DEBUG] [LOCAL ] CPF: Primary data saved (15320 records). [2025-10-09T18:11:44.592466] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-09T18:11:44.592545] [INFO ] [MAIN ] Update Progress: 519/2373 symbols completed. CPF took 35.8s. Estimated remaining: 4h 16m 4s. Rate: 7.2 symbols/min [2025-10-09T18:11:44.621687] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:11:44.796709] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-09T18:11:45.718392] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T18:11:45.721887] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-09T18:11:46.591339] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T18:11:46.593132] [INFO ] [REMOTE ] CPK: Full fetch complete (18127 records). [2025-10-09T18:11:46.593204] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-09T18:11:46.965000] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-09T18:11:46.965119] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-09T18:11:46.965552] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-09T18:11:46.965597] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-09T18:11:46.966177] [DEBUG] [LOCAL ] CPK: Trimmed 18127 records to 13753 (keeping 200 days of data) [2025-10-09T18:11:47.056675] [DEBUG] [LOCAL ] CPK: Primary data saved (13753 records). [2025-10-09T18:11:47.056821] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-09T18:11:47.056900] [INFO ] [MAIN ] Update Progress: 520/2373 symbols completed. CPK took 18.2s. Estimated remaining: 4h 15m 35s. Rate: 7.2 symbols/min [2025-10-09T18:11:47.667616] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:47.656869] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:47.736726] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:47.791917] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:47.838238] [DEBUG] [LOCAL ] CPS: Loaded 25526 existing records from primary storage. [2025-10-09T18:11:47.838859] [INFO ] [MAIN ] CPS: Loaded 25526 existing records. [2025-10-09T18:11:48.008025] [DEBUG] [LOCAL ] CPT: Loaded 44405 existing records from primary storage. [2025-10-09T18:11:48.008885] [INFO ] [MAIN ] CPT: Loaded 44405 existing records. [2025-10-09T18:11:48.205299] [DEBUG] [LOCAL ] CPRI: Loaded 52519 existing records from primary storage. [2025-10-09T18:11:48.209218] [INFO ] [MAIN ] CPRI: Loaded 52519 existing records. [2025-10-09T18:11:48.208803] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:48.229988] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-09T18:11:48.246175] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-09T18:11:48.246077] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-10-09T18:11:48.307173] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-09T18:11:48.335112] [INFO ] [MAIN ] CPNG: Loaded 53670 existing records. [2025-10-09T18:11:48.340407] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-09T18:11:48.724012] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:48.726932] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:48.776847] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-09T18:11:48.795392] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-09T18:11:48.809213] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-09T18:11:48.782153] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-09T18:11:48.871664] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-09T18:11:48.900722] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-09T18:11:48.943482] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-09T18:11:48.941152] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-09T18:11:48.946447] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:49.057041] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-09T18:11:49.128174] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-09T18:11:49.257020] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-09T18:11:49.291411] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-09T18:11:49.357258] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:49.495466] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-09T18:11:50.066160] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:50.113316] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-09T18:11:50.172211] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:50.188954] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-09T18:11:50.254553] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:50.254846] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-09T18:11:50.664797] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T18:11:50.669042] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-09T18:11:51.722785] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:11:51.730835] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-09T18:11:51.749193] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:11:51.757108] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-09T18:11:51.922486] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T18:11:51.996693] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-09T18:11:52.334003] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T18:11:52.511025] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T18:11:52.796719] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-09T18:11:52.916343] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T18:11:53.596719] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-09T18:11:53.976885] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T18:11:54.013093] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-09T18:11:54.396751] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-09T18:11:55.021111] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T18:11:55.196758] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-09T18:11:55.677328] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:11:55.996740] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-09T18:11:56.536312] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T18:11:56.796765] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-09T18:11:57.596725] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-09T18:11:57.747972] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:11:58.396704] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-09T18:11:58.442422] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T18:11:59.092780] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T18:11:59.196716] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-09T18:11:59.996706] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-09T18:12:00.241389] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T18:12:00.421506] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:12:00.796817] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-09T18:12:01.596775] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-09T18:12:02.063743] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-09T18:12:02.089560] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:12:02.396742] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-09T18:12:03.170153] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T18:12:03.196695] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-09T18:12:03.429964] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T18:12:03.996730] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-09T18:12:04.796728] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-09T18:12:04.867151] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T18:12:05.596727] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-09T18:12:06.332228] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-09T18:12:06.402027] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-09T18:12:06.421548] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:12:07.114744] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T18:12:07.196770] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-09T18:12:07.996733] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-09T18:12:08.393618] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:12:08.682853] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T18:12:08.796795] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-09T18:12:08.917367] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T18:12:09.596731] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-09T18:12:10.396824] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-09T18:12:11.064678] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-09T18:12:11.155904] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T18:12:11.196671] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-09T18:12:11.254845] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T18:12:11.996727] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-09T18:12:12.796705] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-09T18:12:13.022836] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T18:12:13.596694] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-09T18:12:13.714188] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T18:12:13.877975] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:12:13.880023] [INFO ] [REMOTE ] CPS: Full fetch complete (36351 records). [2025-10-09T18:12:13.880093] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-09T18:12:14.270351] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-09T18:12:14.270430] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-09T18:12:14.270968] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-09T18:12:14.271033] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-09T18:12:14.272245] [DEBUG] [LOCAL ] CPS: Trimmed 36351 records to 25661 (keeping 200 days of data) [2025-10-09T18:12:14.408600] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-09T18:12:14.430260] [DEBUG] [LOCAL ] CPS: Primary data saved (25661 records). [2025-10-09T18:12:14.430422] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-09T18:12:14.430520] [INFO ] [MAIN ] Update Progress: 521/2373 symbols completed. CPS took 27.4s. Estimated remaining: 4h 16m 35s. Rate: 7.2 symbols/min [2025-10-09T18:12:14.608734] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:14.627556] [DEBUG] [LOCAL ] CQP: Loaded 18929 existing records from primary storage. [2025-10-09T18:12:14.627836] [INFO ] [MAIN ] CQP: Loaded 18929 existing records. [2025-10-09T18:12:14.823286] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:14.824467] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-09T18:12:14.824531] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-09T18:12:14.825264] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-09T18:12:14.825326] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-09T18:12:15.199392] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-09T18:12:15.231099] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:15.356322] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:12:15.996721] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-09T18:12:16.571510] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T18:12:16.798117] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-09T18:12:16.801309] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-09T18:12:16.972724] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T18:12:17.596737] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-09T18:12:18.333078] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T18:12:18.336893] [INFO ] [REMOTE ] CPT: Full fetch complete (64054 records). [2025-10-09T18:12:18.337002] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-09T18:12:18.403407] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-09T18:12:18.717049] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T18:12:18.775864] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-09T18:12:18.775941] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-09T18:12:18.776695] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-09T18:12:18.776757] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-09T18:12:18.778027] [DEBUG] [LOCAL ] CPT: Trimmed 64054 records to 44728 (keeping 200 days of data) [2025-10-09T18:12:19.064979] [DEBUG] [LOCAL ] CPT: Primary data saved (44728 records). [2025-10-09T18:12:19.065101] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-09T18:12:19.065969] [INFO ] [MAIN ] Update Progress: 522/2373 symbols completed. CPT took 32.0s. Estimated remaining: 4h 16m 14s. Rate: 7.2 symbols/min [2025-10-09T18:12:19.209821] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-09T18:12:19.244781] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:19.271567] [DEBUG] [LOCAL ] CR: Loaded 24113 existing records from primary storage. [2025-10-09T18:12:19.271871] [INFO ] [MAIN ] CR: Loaded 24113 existing records. [2025-10-09T18:12:19.451459] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:19.451694] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-09T18:12:19.451751] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-09T18:12:19.451983] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-09T18:12:19.452039] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-09T18:12:19.799314] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:19.996712] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-09T18:12:20.280805] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T18:12:20.796767] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-09T18:12:21.288118] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T18:12:21.297001] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T18:12:21.596778] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-09T18:12:22.348986] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T18:12:22.353871] [INFO ] [REMOTE ] CPRI: Full fetch complete (75715 records). [2025-10-09T18:12:22.353995] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-09T18:12:22.354756] [FATAL] [VALIDATOR ] CPRI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:12:22.354847] [FATAL] [MAIN ] CPRI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:12:22.354893] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:12:22.354935] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-09T18:12:22.354992] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-09T18:12:22.355031] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-10-09T18:12:22.355263] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-10-09T18:12:22.355357] [INFO ] [MAIN ] Update Progress: 523/2373 symbols completed. CPRI took 35.3s. Estimated remaining: 4h 15m 48s. Rate: 7.2 symbols/min [2025-10-09T18:12:22.409099] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-09T18:12:22.535940] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:22.551107] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T18:12:22.563311] [DEBUG] [LOCAL ] CRBD: Loaded 9039 existing records from primary storage. [2025-10-09T18:12:22.563506] [INFO ] [MAIN ] CRBD: Loaded 9039 existing records. [2025-10-09T18:12:22.741698] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:22.741909] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-09T18:12:22.741958] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-09T18:12:22.742155] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-09T18:12:22.742214] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-09T18:12:23.098109] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:23.196697] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-09T18:12:23.538496] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T18:12:23.996728] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-09T18:12:24.281556] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:12:24.796705] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-09T18:12:25.021191] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T18:12:25.596743] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-09T18:12:25.773006] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T18:12:26.396684] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-09T18:12:26.788552] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:12:27.196730] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-09T18:12:27.607261] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T18:12:27.996752] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-09T18:12:28.796732] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-09T18:12:29.274774] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-09T18:12:29.454503] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T18:12:29.596805] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-09T18:12:29.950839] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T18:12:30.396772] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-09T18:12:31.066102] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:12:31.196733] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-09T18:12:31.870776] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-09T18:12:31.908097] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T18:12:31.996729] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-09T18:12:32.796701] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-09T18:12:33.085845] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:12:33.596729] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-09T18:12:34.396691] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-09T18:12:34.761636] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T18:12:34.775895] [INFO ] [REMOTE ] CPNG: Full fetch complete (77675 records). [2025-10-09T18:12:34.790797] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-09T18:12:34.799390] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T18:12:35.206607] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-09T18:12:35.212053] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-09T18:12:35.212121] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-09T18:12:35.213046] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-09T18:12:35.213250] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-09T18:12:35.214889] [DEBUG] [LOCAL ] CPNG: Trimmed 77675 records to 54060 (keeping 200 days of data) [2025-10-09T18:12:35.441968] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T18:12:35.576011] [DEBUG] [LOCAL ] CPNG: Primary data saved (54060 records). [2025-10-09T18:12:35.576163] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-09T18:12:35.576249] [INFO ] [MAIN ] Update Progress: 524/2373 symbols completed. CPNG took 48.5s. Estimated remaining: 4h 15m 57s. Rate: 7.2 symbols/min [2025-10-09T18:12:35.748550] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:35.798260] [DEBUG] [LOCAL ] CRBG: Loaded 52448 existing records from primary storage. [2025-10-09T18:12:35.798584] [INFO ] [MAIN ] CRBG: Loaded 52448 existing records. [2025-10-09T18:12:35.981175] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:35.984871] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-09T18:12:35.984964] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-09T18:12:35.988587] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T18:12:35.990724] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-09T18:12:35.991525] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-09T18:12:36.002639] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-09T18:12:36.347930] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:36.796716] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-09T18:12:37.187314] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T18:12:37.586937] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T18:12:37.596667] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-09T18:12:38.032869] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T18:12:38.396769] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-09T18:12:39.196752] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-09T18:12:39.996718] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-09T18:12:40.220117] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T18:12:40.246921] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T18:12:40.796737] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-09T18:12:40.978419] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:12:41.596767] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-09T18:12:42.401839] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-09T18:12:42.418076] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:12:42.770275] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:12:43.197285] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-09T18:12:43.199785] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T18:12:43.996764] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-09T18:12:44.704949] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T18:12:44.796672] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-09T18:12:44.914152] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T18:12:45.596703] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-09T18:12:46.366297] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T18:12:46.396677] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-09T18:12:46.499373] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T18:12:46.929934] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T18:12:47.196701] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-09T18:12:47.785160] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:12:47.786455] [INFO ] [REMOTE ] CRBD: Full fetch complete (13792 records). [2025-10-09T18:12:47.786565] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-09T18:12:48.001876] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-09T18:12:48.156232] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-09T18:12:48.156310] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-09T18:12:48.156606] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-09T18:12:48.156665] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-09T18:12:48.157149] [DEBUG] [LOCAL ] CRBD: Trimmed 13792 records to 9076 (keeping 200 days of data) [2025-10-09T18:12:48.213551] [DEBUG] [LOCAL ] CRBD: Primary data saved (9076 records). [2025-10-09T18:12:48.213730] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-09T18:12:48.213832] [INFO ] [MAIN ] Update Progress: 525/2373 symbols completed. CRBD took 25.9s. Estimated remaining: 4h 16m 4s. Rate: 7.2 symbols/min [2025-10-09T18:12:48.380594] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:48.426220] [DEBUG] [LOCAL ] CRC: Loaded 43809 existing records from primary storage. [2025-10-09T18:12:48.426522] [INFO ] [MAIN ] CRC: Loaded 43809 existing records. [2025-10-09T18:12:48.601262] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:48.601455] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-09T18:12:48.601502] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-09T18:12:48.601892] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-09T18:12:48.601948] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-09T18:12:48.807970] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-09T18:12:48.955236] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:49.596689] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-09T18:12:49.713685] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T18:12:49.822563] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T18:12:50.396741] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-09T18:12:50.559303] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T18:12:50.561431] [INFO ] [REMOTE ] CR: Full fetch complete (34670 records). [2025-10-09T18:12:50.561509] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-09T18:12:50.946922] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-09T18:12:50.947029] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-09T18:12:50.947633] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-09T18:12:50.947718] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-09T18:12:50.948635] [DEBUG] [LOCAL ] CR: Trimmed 34670 records to 24272 (keeping 200 days of data) [2025-10-09T18:12:51.054549] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T18:12:51.117864] [DEBUG] [LOCAL ] CR: Primary data saved (24272 records). [2025-10-09T18:12:51.118014] [INFO ] [MAIN ] CR: Full history saved. [2025-10-09T18:12:51.118101] [INFO ] [MAIN ] Update Progress: 526/2373 symbols completed. CR took 32.1s. Estimated remaining: 4h 15m 36s. Rate: 7.2 symbols/min [2025-10-09T18:12:51.201815] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-09T18:12:51.286198] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:51.286354] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-09T18:12:51.286394] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-09T18:12:51.286506] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-09T18:12:51.286549] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-09T18:12:51.286590] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-09T18:12:51.286624] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-09T18:12:51.664995] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:51.996690] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-09T18:12:52.078592] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T18:12:52.080139] [INFO ] [REMOTE ] CQP: Full fetch complete (30253 records). [2025-10-09T18:12:52.080212] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-09T18:12:52.459938] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-09T18:12:52.460084] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-09T18:12:52.460632] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-09T18:12:52.460717] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-09T18:12:52.461416] [DEBUG] [LOCAL ] CQP: Trimmed 30253 records to 19005 (keeping 200 days of data) [2025-10-09T18:12:52.579174] [DEBUG] [LOCAL ] CQP: Primary data saved (19005 records). [2025-10-09T18:12:52.579328] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-09T18:12:52.579427] [INFO ] [MAIN ] Update Progress: 527/2373 symbols completed. CQP took 38.1s. Estimated remaining: 4h 15m 4s. Rate: 7.2 symbols/min [2025-10-09T18:12:52.754523] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:52.809439] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-09T18:12:52.812306] [DEBUG] [LOCAL ] CRGY: Loaded 52481 existing records from primary storage. [2025-10-09T18:12:52.812727] [INFO ] [MAIN ] CRGY: Loaded 52481 existing records. [2025-10-09T18:12:52.993607] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:52.993869] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-09T18:12:52.993931] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-09T18:12:52.995186] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-09T18:12:52.995247] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-09T18:12:53.088813] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:12:53.104408] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-09T18:12:53.114885] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:12:53.139168] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-09T18:12:53.155248] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:12:53.175203] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-09T18:12:53.182443] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-09T18:12:53.182667] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-09T18:12:53.216674] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-09T18:12:53.225197] [INFO ] [MAIN ] Update Progress: 528/2373 symbols completed. CRCL took 2.1s. Estimated remaining: 4h 14m 29s. Rate: 7.2 symbols/min [2025-10-09T18:12:53.490202] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:53.551544] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:53.551862] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-10-09T18:12:53.551936] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-10-09T18:12:53.552124] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-09T18:12:53.552327] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-09T18:12:53.552404] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-09T18:12:53.552452] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-09T18:12:53.599908] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-09T18:12:53.684171] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T18:12:53.976700] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:54.396722] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-09T18:12:55.196699] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-09T18:12:55.513094] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T18:12:55.811007] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T18:12:55.996734] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-09T18:12:56.796707] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-09T18:12:56.923560] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:12:57.597422] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-09T18:12:57.597347] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T18:12:58.396699] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-09T18:12:58.462599] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:12:59.196688] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-09T18:12:59.465168] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T18:12:59.996682] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-09T18:13:00.248480] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T18:13:00.796718] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-09T18:13:00.897497] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T18:13:01.596696] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-09T18:13:01.768474] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T18:13:02.084577] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T18:13:02.396737] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-09T18:13:02.710865] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T18:13:03.196719] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-09T18:13:03.996690] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-09T18:13:04.123710] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T18:13:04.405870] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:13:04.796742] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-09T18:13:05.596731] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-09T18:13:05.892961] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T18:13:06.295012] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T18:13:06.396675] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-09T18:13:07.196693] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-09T18:13:07.587562] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T18:13:07.996722] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-09T18:13:08.092496] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T18:13:08.796739] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-09T18:13:08.950530] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:13:09.596741] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-09T18:13:09.772978] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T18:13:10.390750] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:13:10.400005] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-09T18:13:11.196722] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-09T18:13:11.464385] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T18:13:11.996777] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-09T18:13:12.441760] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T18:13:12.796727] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-09T18:13:13.034373] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T18:13:13.038950] [INFO ] [REMOTE ] CRBG: Full fetch complete (75763 records). [2025-10-09T18:13:13.039091] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-09T18:13:13.441548] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-09T18:13:13.441677] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-09T18:13:13.442666] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-09T18:13:13.442736] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-09T18:13:13.444281] [DEBUG] [LOCAL ] CRBG: Trimmed 75763 records to 52836 (keeping 200 days of data) [2025-10-09T18:13:13.636702] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-09T18:13:13.779119] [DEBUG] [LOCAL ] CRBG: Primary data saved (52836 records). [2025-10-09T18:13:13.779283] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-09T18:13:13.779495] [INFO ] [MAIN ] Update Progress: 529/2373 symbols completed. CRBG took 38.2s. Estimated remaining: 4h 15m 4s. Rate: 7.2 symbols/min [2025-10-09T18:13:13.960575] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:13.996638] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T18:13:14.049082] [DEBUG] [LOCAL ] CRI: Loaded 49762 existing records from primary storage. [2025-10-09T18:13:14.049387] [INFO ] [MAIN ] CRI: Loaded 49762 existing records. [2025-10-09T18:13:14.230667] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:14.230926] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-09T18:13:14.230987] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-09T18:13:14.231962] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-09T18:13:14.232023] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-09T18:13:14.402733] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-09T18:13:14.602544] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T18:13:14.645339] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:15.196717] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-09T18:13:15.234358] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T18:13:15.837900] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T18:13:15.996731] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-09T18:13:16.796702] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-09T18:13:17.208472] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T18:13:17.596695] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-09T18:13:17.815200] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T18:13:18.396712] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-09T18:13:18.449414] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T18:13:19.152445] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T18:13:19.196678] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-09T18:13:19.996766] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-09T18:13:20.218366] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T18:13:20.796768] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-09T18:13:20.996431] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T18:13:21.526597] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T18:13:21.530427] [INFO ] [REMOTE ] CRC: Full fetch complete (62553 records). [2025-10-09T18:13:21.530515] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-09T18:13:21.604599] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-09T18:13:21.993708] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-09T18:13:21.993858] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-09T18:13:21.994915] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-09T18:13:21.995089] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-09T18:13:21.997100] [DEBUG] [LOCAL ] CRC: Trimmed 62553 records to 44150 (keeping 200 days of data) [2025-10-09T18:13:22.160182] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T18:13:22.397208] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-09T18:13:22.409736] [DEBUG] [LOCAL ] CRC: Primary data saved (44150 records). [2025-10-09T18:13:22.409945] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-09T18:13:22.411320] [INFO ] [MAIN ] Update Progress: 530/2373 symbols completed. CRC took 34.2s. Estimated remaining: 4h 14m 56s. Rate: 7.2 symbols/min [2025-10-09T18:13:22.649254] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:22.710617] [DEBUG] [LOCAL ] CRK: Loaded 52203 existing records from primary storage. [2025-10-09T18:13:22.711013] [INFO ] [MAIN ] CRK: Loaded 52203 existing records. [2025-10-09T18:13:22.933759] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:22.933992] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-09T18:13:22.934044] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-09T18:13:22.935309] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-09T18:13:22.935371] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-09T18:13:23.200038] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-09T18:13:23.312585] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:23.510481] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:13:23.996700] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-09T18:13:24.446472] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-09T18:13:24.796710] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-09T18:13:24.863439] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T18:13:25.596683] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-09T18:13:25.830072] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T18:13:25.834553] [INFO ] [REMOTE ] CRGY: Full fetch complete (75933 records). [2025-10-09T18:13:25.834715] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-09T18:13:26.237869] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-09T18:13:26.238031] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-09T18:13:26.238988] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-09T18:13:26.239052] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-09T18:13:26.240533] [DEBUG] [LOCAL ] CRGY: Trimmed 75933 records to 52852 (keeping 200 days of data) [2025-10-09T18:13:26.418343] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-09T18:13:26.568424] [DEBUG] [LOCAL ] CRGY: Primary data saved (52852 records). [2025-10-09T18:13:26.568560] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-09T18:13:26.568697] [INFO ] [MAIN ] Update Progress: 531/2373 symbols completed. CRGY took 34.0s. Estimated remaining: 4h 14m 34s. Rate: 7.2 symbols/min [2025-10-09T18:13:26.749983] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:26.782164] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T18:13:26.831666] [DEBUG] [LOCAL ] CRL: Loaded 42811 existing records from primary storage. [2025-10-09T18:13:26.831963] [INFO ] [MAIN ] CRL: Loaded 42811 existing records. [2025-10-09T18:13:27.015002] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:27.015297] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-09T18:13:27.015380] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-09T18:13:27.016590] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-09T18:13:27.016739] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-09T18:13:27.201837] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-09T18:13:27.388465] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:27.418830] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:13:27.996682] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-09T18:13:28.323711] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:13:28.796714] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-09T18:13:28.931457] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:13:29.596704] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-09T18:13:29.730279] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:13:30.396721] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-09T18:13:30.642356] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T18:13:30.647011] [INFO ] [REMOTE ] CRH: Full fetch complete (77296 records). [2025-10-09T18:13:30.647163] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-09T18:13:31.046163] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-09T18:13:31.046380] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-09T18:13:31.047430] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-09T18:13:31.047520] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-09T18:13:31.049404] [DEBUG] [LOCAL ] CRH: Trimmed 77296 records to 53841 (keeping 200 days of data) [2025-10-09T18:13:31.168808] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:13:31.196892] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-09T18:13:31.422946] [DEBUG] [LOCAL ] CRH: Primary data saved (53841 records). [2025-10-09T18:13:31.423097] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-09T18:13:31.423173] [INFO ] [MAIN ] Update Progress: 532/2373 symbols completed. CRH took 38.2s. Estimated remaining: 4h 14m 14s. Rate: 7.2 symbols/min [2025-10-09T18:13:31.590199] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:31.645039] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-09T18:13:31.645363] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-09T18:13:31.822219] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:31.822620] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-09T18:13:31.822718] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-09T18:13:31.823117] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-09T18:13:31.823177] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-09T18:13:31.999741] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-09T18:13:32.188577] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:32.219818] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T18:13:32.796687] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-09T18:13:32.985274] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T18:13:33.596763] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-09T18:13:33.642306] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:13:34.079942] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T18:13:34.396725] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-09T18:13:35.196719] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-09T18:13:35.991489] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T18:13:36.001844] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-09T18:13:36.113207] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-09T18:13:36.796737] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-09T18:13:37.110698] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:13:37.296974] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T18:13:37.596781] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-09T18:13:38.396743] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-09T18:13:38.982469] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-09T18:13:39.060369] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T18:13:39.196729] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-09T18:13:39.996690] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-09T18:13:40.446118] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T18:13:40.796748] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-09T18:13:41.429894] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-09T18:13:41.596782] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-09T18:13:41.664365] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T18:13:42.084442] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T18:13:42.396741] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-09T18:13:43.196769] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-09T18:13:43.624851] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T18:13:43.914933] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T18:13:43.996692] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-09T18:13:44.412083] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:13:44.796711] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-09T18:13:45.596722] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-09T18:13:45.770597] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:13:46.396771] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-09T18:13:47.022321] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-09T18:13:47.043550] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:13:47.048258] [INFO ] [REMOTE ] CRI: Full fetch complete (70809 records). [2025-10-09T18:13:47.048420] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-09T18:13:47.204213] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-09T18:13:47.437570] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-09T18:13:47.437673] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-09T18:13:47.438522] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-09T18:13:47.438583] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-09T18:13:47.439955] [DEBUG] [LOCAL ] CRI: Trimmed 70809 records to 50079 (keeping 200 days of data) [2025-10-09T18:13:47.761281] [DEBUG] [LOCAL ] CRI: Primary data saved (50079 records). [2025-10-09T18:13:47.761407] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-09T18:13:47.761504] [INFO ] [MAIN ] Update Progress: 533/2373 symbols completed. CRI took 34.0s. Estimated remaining: 4h 14m 33s. Rate: 7.2 symbols/min [2025-10-09T18:13:47.934977] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:47.974908] [DEBUG] [LOCAL ] CRS: Loaded 43154 existing records from primary storage. [2025-10-09T18:13:47.975222] [INFO ] [MAIN ] CRS: Loaded 43154 existing records. [2025-10-09T18:13:48.008220] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-09T18:13:48.166751] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:48.167123] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-09T18:13:48.167376] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-09T18:13:48.167739] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-09T18:13:48.167804] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-09T18:13:48.478895] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-09T18:13:48.568762] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:48.796710] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-09T18:13:49.596742] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-09T18:13:49.652960] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-09T18:13:49.807103] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:13:50.401788] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-09T18:13:50.415962] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:13:51.196729] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-09T18:13:51.287673] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:13:51.996703] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-09T18:13:52.550614] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-09T18:13:52.768381] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:13:52.796673] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-09T18:13:53.467589] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T18:13:53.472139] [INFO ] [REMOTE ] CRK: Full fetch complete (75623 records). [2025-10-09T18:13:53.472257] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-09T18:13:53.608059] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-09T18:13:53.856394] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-09T18:13:53.856480] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-09T18:13:53.857464] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-09T18:13:53.857539] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-09T18:13:53.859103] [DEBUG] [LOCAL ] CRK: Trimmed 75623 records to 52593 (keeping 200 days of data) [2025-10-09T18:13:54.192028] [DEBUG] [LOCAL ] CRK: Primary data saved (52593 records). [2025-10-09T18:13:54.192258] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-09T18:13:54.193559] [INFO ] [MAIN ] Update Progress: 534/2373 symbols completed. CRK took 31.8s. Estimated remaining: 4h 14m 18s. Rate: 7.2 symbols/min [2025-10-09T18:13:54.394594] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T18:13:54.403360] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:54.400033] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-09T18:13:54.412359] [DEBUG] [LOCAL ] CRT: No existing data file found in primary storage. [2025-10-09T18:13:54.412841] [WARN ] [MAIN ] CRT: No existing data found, performing full refresh instead. [2025-10-09T18:13:54.412968] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-09T18:13:54.413014] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-09T18:13:54.413056] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-09T18:13:54.413090] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-09T18:13:54.794545] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:55.196752] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-09T18:13:55.341817] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T18:13:55.819773] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T18:13:55.996712] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-09T18:13:56.507071] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T18:13:56.796736] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-09T18:13:57.395499] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T18:13:57.433072] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:13:57.596736] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-09T18:13:58.170586] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T18:13:58.396771] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-09T18:13:59.196758] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-09T18:13:59.882480] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T18:13:59.996712] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-09T18:14:00.796799] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-09T18:14:01.428934] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T18:14:01.578349] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:14:01.596691] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-09T18:14:01.807257] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-09T18:14:02.075030] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T18:14:02.396730] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-09T18:14:03.196766] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-09T18:14:03.825467] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T18:14:03.996689] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-09T18:14:04.598442] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T18:14:04.796726] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-09T18:14:04.939552] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-09T18:14:05.596723] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-09T18:14:06.191266] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T18:14:06.396729] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-09T18:14:06.564826] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:14:07.085338] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T18:14:07.090673] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-09T18:14:07.090879] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-09T18:14:07.201948] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-09T18:14:07.576719] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-09T18:14:07.576847] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-09T18:14:07.577973] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-09T18:14:07.578043] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-09T18:14:07.579824] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54160 (keeping 200 days of data) [2025-10-09T18:14:07.970819] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-10-09T18:14:07.971036] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-09T18:14:07.971976] [INFO ] [MAIN ] Update Progress: 535/2373 symbols completed. CRM took 36.5s. Estimated remaining: 4h 14m 29s. Rate: 7.2 symbols/min [2025-10-09T18:14:08.001803] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-09T18:14:08.162361] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:08.201962] [DEBUG] [LOCAL ] CSAN: Loaded 42145 existing records from primary storage. [2025-10-09T18:14:08.202286] [INFO ] [MAIN ] CSAN: Loaded 42145 existing records. [2025-10-09T18:14:08.373799] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:08.374047] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-09T18:14:08.374097] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-09T18:14:08.374396] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-09T18:14:08.374452] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-09T18:14:08.739770] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:08.765449] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T18:14:08.796784] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-09T18:14:09.339180] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T18:14:09.596735] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-09T18:14:09.679072] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T18:14:10.304669] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T18:14:10.396701] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-09T18:14:11.196785] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-09T18:14:11.726925] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T18:14:11.996739] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-09T18:14:12.550729] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T18:14:12.796759] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-09T18:14:13.462440] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T18:14:13.463418] [INFO ] [REMOTE ] CRT: Full fetch complete (7470 records). [2025-10-09T18:14:13.463487] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-09T18:14:13.607871] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-09T18:14:13.753796] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T18:14:13.773618] [INFO ] [REMOTE ] CRL: Full fetch complete (63313 records). [2025-10-09T18:14:13.783995] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-09T18:14:13.955428] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-09T18:14:13.955573] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-09T18:14:13.955814] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-09T18:14:13.956134] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-09T18:14:13.972215] [DEBUG] [LOCAL ] CRT: Trimmed 7470 records to 4999 (keeping 200 days of data) [2025-10-09T18:14:14.193507] [DEBUG] [LOCAL ] CRT: Primary data saved (4999 records). [2025-10-09T18:14:14.214063] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-09T18:14:14.214927] [INFO ] [MAIN ] Update Progress: 536/2373 symbols completed. CRT took 20.0s. Estimated remaining: 4h 14m 13s. Rate: 7.2 symbols/min [2025-10-09T18:14:14.398441] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-09T18:14:14.491539] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-09T18:14:14.491851] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-09T18:14:14.492938] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-09T18:14:14.493035] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-09T18:14:14.522730] [DEBUG] [LOCAL ] CRL: Trimmed 63313 records to 43158 (keeping 200 days of data) [2025-10-09T18:14:14.752316] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:14.969911] [DEBUG] [LOCAL ] CSL: Loaded 31443 existing records from primary storage. [2025-10-09T18:14:14.972056] [INFO ] [MAIN ] CSL: Loaded 31443 existing records. [2025-10-09T18:14:15.274208] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:15.276281] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-09T18:14:15.276857] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-09T18:14:15.280364] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-09T18:14:15.280914] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-09T18:14:15.426893] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T18:14:15.498121] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-09T18:14:15.655115] [DEBUG] [LOCAL ] CRL: Primary data saved (43158 records). [2025-10-09T18:14:15.659142] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-09T18:14:15.664921] [INFO ] [MAIN ] Update Progress: 537/2373 symbols completed. CRL took 49.1s. Estimated remaining: 4h 13m 42s. Rate: 7.2 symbols/min [2025-10-09T18:14:15.786694] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:15.923514] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:15.951895] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T18:14:15.971331] [DEBUG] [LOCAL ] CSR: Loaded 12972 existing records from primary storage. [2025-10-09T18:14:15.971560] [INFO ] [MAIN ] CSR: Loaded 12972 existing records. [2025-10-09T18:14:16.003339] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-09T18:14:16.183243] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:16.183457] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-09T18:14:16.183506] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-09T18:14:16.183794] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-09T18:14:16.183853] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-09T18:14:16.540002] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:16.796746] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-09T18:14:16.915230] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:14:17.596687] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-09T18:14:17.859521] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T18:14:18.298185] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T18:14:18.396702] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-09T18:14:18.953838] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T18:14:19.196713] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-09T18:14:19.198251] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T18:14:19.996778] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-09T18:14:20.112265] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T18:14:20.796755] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-09T18:14:21.481635] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T18:14:21.596717] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-09T18:14:22.329038] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T18:14:22.396723] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-09T18:14:23.203062] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-09T18:14:23.221182] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T18:14:23.475674] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:14:23.996743] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-09T18:14:24.462859] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:14:24.796749] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-09T18:14:25.564159] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T18:14:25.596681] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-09T18:14:26.254378] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T18:14:26.396747] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-09T18:14:26.982776] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T18:14:27.196747] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-09T18:14:27.666866] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T18:14:27.670806] [INFO ] [REMOTE ] CRS: Full fetch complete (62593 records). [2025-10-09T18:14:27.670966] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-09T18:14:28.004884] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-09T18:14:28.062043] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-09T18:14:28.062122] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-09T18:14:28.062952] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-09T18:14:28.063017] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-09T18:14:28.064328] [DEBUG] [LOCAL ] CRS: Trimmed 62593 records to 43462 (keeping 200 days of data) [2025-10-09T18:14:28.352424] [DEBUG] [LOCAL ] CRS: Primary data saved (43462 records). [2025-10-09T18:14:28.352589] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-09T18:14:28.352709] [INFO ] [MAIN ] Update Progress: 538/2373 symbols completed. CRS took 40.6s. Estimated remaining: 4h 13m 48s. Rate: 7.2 symbols/min [2025-10-09T18:14:28.505739] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T18:14:28.560427] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:28.603244] [DEBUG] [LOCAL ] CSTM: Loaded 47541 existing records from primary storage. [2025-10-09T18:14:28.603534] [INFO ] [MAIN ] CSTM: Loaded 47541 existing records. [2025-10-09T18:14:28.791381] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:28.791603] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-09T18:14:28.791674] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-09T18:14:28.792019] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-09T18:14:28.792076] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-09T18:14:28.803065] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-09T18:14:29.160584] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:29.341235] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:14:29.596720] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-09T18:14:29.659439] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:14:30.396709] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-09T18:14:31.198082] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-09T18:14:31.203368] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T18:14:31.308391] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T18:14:31.996687] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-09T18:14:32.284330] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T18:14:32.796745] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-09T18:14:33.433809] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T18:14:33.596722] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-09T18:14:33.761771] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T18:14:34.396728] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-09T18:14:35.196726] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-09T18:14:35.283682] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:14:35.750013] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T18:14:35.996745] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-09T18:14:36.636946] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:14:36.796715] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-09T18:14:37.330227] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T18:14:37.333787] [INFO ] [REMOTE ] CSAN: Full fetch complete (60315 records). [2025-10-09T18:14:37.333925] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-09T18:14:37.601799] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-09T18:14:37.733940] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-09T18:14:37.734032] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-09T18:14:37.734775] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-09T18:14:37.734839] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-09T18:14:37.736105] [DEBUG] [LOCAL ] CSAN: Trimmed 60315 records to 42377 (keeping 200 days of data) [2025-10-09T18:14:37.976466] [DEBUG] [LOCAL ] CSAN: Primary data saved (42377 records). [2025-10-09T18:14:37.976637] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-09T18:14:37.977250] [INFO ] [MAIN ] Update Progress: 539/2373 symbols completed. CSAN took 30.0s. Estimated remaining: 4h 13m 45s. Rate: 7.2 symbols/min [2025-10-09T18:14:38.146847] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:38.162874] [DEBUG] [LOCAL ] CSV: Loaded 12748 existing records from primary storage. [2025-10-09T18:14:38.163155] [INFO ] [MAIN ] CSV: Loaded 12748 existing records. [2025-10-09T18:14:38.343811] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:38.344227] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-09T18:14:38.344465] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-09T18:14:38.349550] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-09T18:14:38.350978] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-09T18:14:38.362855] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T18:14:38.398518] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-09T18:14:38.538905] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:14:38.821945] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:39.196720] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-09T18:14:39.695774] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T18:14:39.942207] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T18:14:39.996703] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-09T18:14:40.796749] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-09T18:14:41.015480] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T18:14:41.596719] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-09T18:14:42.072308] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T18:14:42.075215] [INFO ] [REMOTE ] CSL: Full fetch complete (45301 records). [2025-10-09T18:14:42.075313] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-09T18:14:42.266050] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-09T18:14:42.401807] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-09T18:14:42.480016] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-09T18:14:42.480094] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-09T18:14:42.480725] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-09T18:14:42.480789] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-09T18:14:42.481835] [DEBUG] [LOCAL ] CSL: Trimmed 45301 records to 31693 (keeping 200 days of data) [2025-10-09T18:14:42.686433] [DEBUG] [LOCAL ] CSL: Primary data saved (31693 records). [2025-10-09T18:14:42.686578] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-09T18:14:42.687506] [INFO ] [MAIN ] Update Progress: 540/2373 symbols completed. CSL took 28.5s. Estimated remaining: 4h 13m 24s. Rate: 7.2 symbols/min [2025-10-09T18:14:42.857163] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:42.857346] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-09T18:14:42.857385] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-09T18:14:42.857499] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-09T18:14:42.857541] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-09T18:14:42.857583] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-09T18:14:42.857619] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-09T18:14:43.204825] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-09T18:14:43.209528] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:43.460349] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T18:14:43.996746] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-09T18:14:44.796759] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-09T18:14:44.943469] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T18:14:44.991433] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:14:44.992291] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T18:14:44.993789] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-09T18:14:44.996523] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:14:44.996916] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-09T18:14:44.996991] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:14:44.997088] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-09T18:14:44.997193] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-09T18:14:44.997261] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-09T18:14:44.997331] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-09T18:14:44.997401] [INFO ] [MAIN ] Update Progress: 541/2373 symbols completed. CSW took 2.3s. Estimated remaining: 4h 12m 56s. Rate: 7.2 symbols/min [2025-10-09T18:14:45.166337] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:45.177575] [DEBUG] [LOCAL ] CTBB: Loaded 7044 existing records from primary storage. [2025-10-09T18:14:45.177827] [INFO ] [MAIN ] CTBB: Loaded 7044 existing records. [2025-10-09T18:14:45.359090] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:45.359327] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-09T18:14:45.359394] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-09T18:14:45.359627] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-09T18:14:45.359737] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-09T18:14:45.604612] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-09T18:14:45.726425] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:46.396726] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-09T18:14:46.610204] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T18:14:47.196716] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-09T18:14:47.255249] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T18:14:47.996754] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-09T18:14:48.764362] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T18:14:48.788889] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T18:14:48.796670] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-09T18:14:49.359462] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T18:14:49.596736] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-09T18:14:50.240474] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T18:14:50.396741] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-09T18:14:51.196692] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-09T18:14:51.205952] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T18:14:51.996686] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-09T18:14:52.226453] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T18:14:52.602213] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T18:14:52.796786] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-09T18:14:53.596719] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-09T18:14:54.396731] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-09T18:14:54.418926] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T18:14:54.451270] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T18:14:55.139961] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:14:55.196678] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-09T18:14:55.996711] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-09T18:14:56.022639] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T18:14:56.024224] [INFO ] [REMOTE ] CSV: Full fetch complete (19308 records). [2025-10-09T18:14:56.024295] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-09T18:14:56.466508] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-09T18:14:56.466590] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-09T18:14:56.467048] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-09T18:14:56.467113] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-09T18:14:56.467687] [DEBUG] [LOCAL ] CSV: Trimmed 19308 records to 12804 (keeping 200 days of data) [2025-10-09T18:14:56.557301] [DEBUG] [LOCAL ] CSV: Primary data saved (12804 records). [2025-10-09T18:14:56.557449] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-09T18:14:56.557537] [INFO ] [MAIN ] Update Progress: 542/2373 symbols completed. CSV took 18.6s. Estimated remaining: 4h 12m 58s. Rate: 7.2 symbols/min [2025-10-09T18:14:56.723196] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:56.730974] [DEBUG] [LOCAL ] CTDD: Loaded 5820 existing records from primary storage. [2025-10-09T18:14:56.731142] [INFO ] [MAIN ] CTDD: Loaded 5820 existing records. [2025-10-09T18:14:56.803586] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-09T18:14:56.910772] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:56.911010] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-09T18:14:56.911067] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-09T18:14:56.911236] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-09T18:14:56.911294] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-09T18:14:57.272412] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:57.596687] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-09T18:14:57.653396] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T18:14:57.680284] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T18:14:58.097820] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-09T18:14:58.396690] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-09T18:14:59.196741] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-09T18:14:59.244418] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T18:14:59.996760] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-09T18:15:00.031773] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T18:15:00.516897] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T18:15:00.796731] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-09T18:15:01.537347] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T18:15:01.596774] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-09T18:15:02.396772] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-09T18:15:03.174611] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T18:15:03.196667] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-09T18:15:03.276046] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T18:15:03.773593] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T18:15:03.996800] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-09T18:15:04.796748] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-09T18:15:05.503889] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:15:05.596693] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-09T18:15:05.634265] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T18:15:06.200633] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T18:15:06.396767] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-09T18:15:07.176588] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T18:15:07.196794] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-09T18:15:07.996812] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-09T18:15:08.051399] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T18:15:08.721696] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T18:15:08.796763] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-09T18:15:09.503906] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T18:15:09.596742] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-09T18:15:10.396783] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-09T18:15:10.659162] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T18:15:10.660920] [INFO ] [REMOTE ] CSR: Full fetch complete (17717 records). [2025-10-09T18:15:10.660993] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-09T18:15:11.036044] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-09T18:15:11.036147] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-09T18:15:11.036537] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-09T18:15:11.036578] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-09T18:15:11.037428] [DEBUG] [LOCAL ] CSR: Trimmed 17717 records to 13088 (keeping 200 days of data) [2025-10-09T18:15:11.117775] [DEBUG] [LOCAL ] CSR: Primary data saved (13088 records). [2025-10-09T18:15:11.117929] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-09T18:15:11.118017] [INFO ] [MAIN ] Update Progress: 543/2373 symbols completed. CSR took 55.4s. Estimated remaining: 4h 13m 11s. Rate: 7.2 symbols/min [2025-10-09T18:15:11.197527] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-09T18:15:11.206054] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T18:15:11.224551] [INFO ] [REMOTE ] CTBB: Full fetch complete (10506 records). [2025-10-09T18:15:11.264755] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-09T18:15:11.371806] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:11.395918] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-09T18:15:11.398474] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-09T18:15:11.404439] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-09T18:15:11.409672] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-09T18:15:11.425115] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-09T18:15:11.443344] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-09T18:15:11.927959] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-09T18:15:11.938562] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-09T18:15:11.949220] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-09T18:15:11.949338] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-09T18:15:11.965721] [DEBUG] [LOCAL ] CTBB: Trimmed 10506 records to 7084 (keeping 200 days of data) [2025-10-09T18:15:11.998966] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-09T18:15:12.028254] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:12.076339] [DEBUG] [LOCAL ] CTBB: Primary data saved (7084 records). [2025-10-09T18:15:12.076485] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-09T18:15:12.076571] [INFO ] [MAIN ] Update Progress: 544/2373 symbols completed. CTBB took 27.1s. Estimated remaining: 4h 12m 38s. Rate: 7.2 symbols/min [2025-10-09T18:15:12.247564] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:12.247761] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-09T18:15:12.247807] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-09T18:15:12.247993] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-09T18:15:12.248042] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-09T18:15:12.248084] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-09T18:15:12.248141] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-09T18:15:12.612878] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:12.661952] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T18:15:12.689434] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T18:15:12.796672] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-09T18:15:13.596703] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-09T18:15:13.911158] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:15:13.911550] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-09T18:15:13.911661] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:15:13.911750] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-09T18:15:13.911814] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:15:13.911883] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-09T18:15:13.911948] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-09T18:15:13.911997] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-09T18:15:13.912065] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-09T18:15:13.912114] [INFO ] [MAIN ] Update Progress: 545/2373 symbols completed. CTEV took 1.8s. Estimated remaining: 4h 12m 8s. Rate: 7.2 symbols/min [2025-10-09T18:15:14.077617] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:14.112725] [DEBUG] [LOCAL ] CTO: Loaded 27825 existing records from primary storage. [2025-10-09T18:15:14.113017] [INFO ] [MAIN ] CTO: Loaded 27825 existing records. [2025-10-09T18:15:14.302692] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:15:14.302911] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-09T18:15:14.302959] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-09T18:15:14.303212] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-09T18:15:14.303269] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-09T18:15:14.403151] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-09T18:15:14.672173] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T18:15:14.677412] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:14.682334] [INFO ] [REMOTE ] CSTM: Full fetch complete (69339 records). [2025-10-09T18:15:14.682470] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-09T18:15:14.855361] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:15:14.889958] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-09T18:15:14.918211] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:15:14.973597] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-09T18:15:15.001216] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:15:15.008680] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-09T18:15:15.038212] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-09T18:15:15.042865] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-09T18:15:15.043248] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-09T18:15:15.053860] [INFO ] [MAIN ] Update Progress: 546/2373 symbols completed. CTEST took 3.9s. Estimated remaining: 4h 11m 36s. Rate: 7.3 symbols/min [2025-10-09T18:15:15.203355] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-09T18:15:15.272310] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-09T18:15:15.276731] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-09T18:15:15.277884] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-09T18:15:15.278368] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-09T18:15:15.335305] [DEBUG] [LOCAL ] CSTM: Trimmed 69339 records to 47875 (keeping 200 days of data) [2025-10-09T18:15:15.356714] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:15.357328] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-09T18:15:15.357402] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-09T18:15:15.357897] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-09T18:15:15.358007] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-09T18:15:15.358073] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-09T18:15:15.358108] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-09T18:15:15.980226] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:16.016362] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-09T18:15:16.099771] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T18:15:16.113061] [DEBUG] [LOCAL ] CSTM: Primary data saved (47875 records). [2025-10-09T18:15:16.113235] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-09T18:15:16.113326] [INFO ] [MAIN ] Update Progress: 547/2373 symbols completed. CSTM took 47.8s. Estimated remaining: 4h 11m 4s. Rate: 7.3 symbols/min [2025-10-09T18:15:16.278831] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:16.329630] [DEBUG] [LOCAL ] CTRA: Loaded 53646 existing records from primary storage. [2025-10-09T18:15:16.330023] [INFO ] [MAIN ] CTRA: Loaded 53646 existing records. [2025-10-09T18:15:16.506161] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:15:16.506379] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-09T18:15:16.506426] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-09T18:15:16.506850] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-09T18:15:16.506908] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-09T18:15:16.801791] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-09T18:15:16.857922] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:17.423419] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T18:15:17.551335] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:15:17.596683] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-09T18:15:18.396792] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-09T18:15:18.780274] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-09T18:15:19.196721] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-09T18:15:19.435061] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T18:15:19.821815] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T18:15:19.996772] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-09T18:15:20.796686] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-09T18:15:21.115097] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T18:15:21.596757] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-09T18:15:21.756462] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T18:15:22.396718] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-09T18:15:22.434369] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T18:15:23.196732] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-09T18:15:23.621512] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T18:15:23.705584] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T18:15:23.996738] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-09T18:15:24.351258] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T18:15:24.796762] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-09T18:15:25.596709] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-09T18:15:26.247041] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T18:15:26.396710] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-09T18:15:26.810044] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:15:26.844797] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T18:15:26.845593] [INFO ] [REMOTE ] CTDD: Full fetch complete (8236 records). [2025-10-09T18:15:26.845699] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-09T18:15:27.197128] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-09T18:15:27.197540] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-09T18:15:27.197673] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-09T18:15:27.198793] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-09T18:15:27.198865] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-09T18:15:27.199376] [DEBUG] [LOCAL ] CTDD: Trimmed 8236 records to 5834 (keeping 200 days of data) [2025-10-09T18:15:27.237101] [DEBUG] [LOCAL ] CTDD: Primary data saved (5834 records). [2025-10-09T18:15:27.237201] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-09T18:15:27.237280] [INFO ] [MAIN ] Update Progress: 548/2373 symbols completed. CTDD took 30.7s. Estimated remaining: 4h 11m 5s. Rate: 7.3 symbols/min [2025-10-09T18:15:27.403015] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:27.445599] [DEBUG] [LOCAL ] CTRE: Loaded 49289 existing records from primary storage. [2025-10-09T18:15:27.445923] [INFO ] [MAIN ] CTRE: Loaded 49289 existing records. [2025-10-09T18:15:27.629492] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:15:27.629746] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-09T18:15:27.629823] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-09T18:15:27.630149] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-09T18:15:27.630227] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-09T18:15:27.980776] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:27.996695] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-09T18:15:28.717560] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T18:15:28.796730] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-09T18:15:29.530308] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:15:29.596680] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-09T18:15:30.345102] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:15:30.396733] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-09T18:15:31.080408] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T18:15:31.196679] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-09T18:15:31.844328] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T18:15:31.996708] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-09T18:15:32.796782] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-09T18:15:32.946505] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:15:33.514849] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T18:15:33.596717] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-09T18:15:33.857611] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T18:15:34.396727] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-09T18:15:35.196688] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-09T18:15:35.454471] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T18:15:35.658820] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T18:15:35.996681] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-09T18:15:36.250550] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T18:15:36.796725] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-09T18:15:37.291539] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T18:15:37.596734] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-09T18:15:38.396760] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-09T18:15:38.709046] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T18:15:39.124961] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T18:15:39.196745] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-09T18:15:39.547583] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:15:39.996714] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-09T18:15:40.776149] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:15:40.796691] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-09T18:15:41.055415] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:15:41.596728] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-09T18:15:42.152620] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:15:42.396739] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-09T18:15:43.196746] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-09T18:15:43.344619] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:15:43.716082] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T18:15:43.996754] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-09T18:15:44.770050] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T18:15:44.796690] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-09T18:15:45.244851] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T18:15:45.596770] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-09T18:15:45.993418] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T18:15:46.396723] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-09T18:15:46.998936] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T18:15:47.002470] [INFO ] [REMOTE ] CTO: Full fetch complete (41682 records). [2025-10-09T18:15:47.002560] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-09T18:15:47.201879] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-09T18:15:47.385310] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-09T18:15:47.385416] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-09T18:15:47.386239] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-09T18:15:47.386361] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-09T18:15:47.387440] [DEBUG] [LOCAL ] CTO: Trimmed 41682 records to 28051 (keeping 200 days of data) [2025-10-09T18:15:47.560853] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:15:47.565223] [INFO ] [REMOTE ] CTOS: Full fetch complete (53275 records). [2025-10-09T18:15:47.565881] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-09T18:15:47.567258] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:15:47.568365] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:15:47.569715] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:15:47.572309] [DEBUG] [LOCAL ] CTO: Primary data saved (28051 records). [2025-10-09T18:15:47.572380] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-09T18:15:47.572517] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-09T18:15:47.573350] [INFO ] [MAIN ] Update Progress: 549/2373 symbols completed. CTO took 33.7s. Estimated remaining: 4h 11m 37s. Rate: 7.2 symbols/min [2025-10-09T18:15:47.572593] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-09T18:15:47.584801] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-09T18:15:47.594477] [DEBUG] [LOCAL ] CTOS: No derivative data file found to delete. [2025-10-09T18:15:47.617083] [INFO ] [MAIN ] Update Progress: 550/2373 symbols completed. CTOS took 32.6s. Estimated remaining: 4h 11m 2s. Rate: 7.3 symbols/min [2025-10-09T18:15:47.894672] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:47.912957] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:47.913170] [DEBUG] [LOCAL ] CTS: No existing data file found in primary storage. [2025-10-09T18:15:47.913225] [WARN ] [MAIN ] CTS: No existing data found, performing full refresh instead. [2025-10-09T18:15:47.913359] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-09T18:15:47.913410] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-09T18:15:47.913451] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-09T18:15:47.913504] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-09T18:15:48.004113] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-09T18:15:48.228038] [DEBUG] [LOCAL ] CTRI: Loaded 39419 existing records from primary storage. [2025-10-09T18:15:48.238981] [INFO ] [MAIN ] CTRI: Loaded 39419 existing records. [2025-10-09T18:15:48.406909] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:48.482445] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:15:48.482613] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-09T18:15:48.482686] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-09T18:15:48.482917] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-09T18:15:48.482957] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-09T18:15:48.812472] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-09T18:15:48.842067] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:48.882160] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T18:15:49.596706] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-09T18:15:49.732353] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T18:15:50.100888] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-09T18:15:50.396755] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-09T18:15:50.499907] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T18:15:51.196737] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-09T18:15:51.985370] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:15:51.996674] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-09T18:15:52.074569] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:15:52.796717] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-09T18:15:53.596703] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-09T18:15:53.887265] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T18:15:54.396687] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-09T18:15:54.428745] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T18:15:54.646753] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T18:15:55.196765] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-09T18:15:55.996702] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-09T18:15:56.322827] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T18:15:56.528734] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T18:15:56.796721] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-09T18:15:57.287436] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T18:15:57.596822] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-09T18:15:58.372216] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T18:15:58.396736] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-09T18:15:58.818943] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T18:15:59.196728] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-09T18:15:59.795608] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T18:15:59.996746] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-09T18:16:00.400164] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:16:00.796754] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-09T18:16:01.295332] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T18:16:01.299282] [INFO ] [REMOTE ] CTRE: Full fetch complete (70799 records). [2025-10-09T18:16:01.299414] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-09T18:16:01.300378] [FATAL] [VALIDATOR ] CTRE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:16:01.300470] [FATAL] [MAIN ] CTRE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:16:01.300514] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:16:01.300576] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-09T18:16:01.300674] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-09T18:16:01.300731] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-09T18:16:01.300990] [DEBUG] [LOCAL ] CTRE: Deleted derivative data file. [2025-10-09T18:16:01.301287] [INFO ] [MAIN ] Update Progress: 551/2373 symbols completed. CTRE took 34.1s. Estimated remaining: 4h 11m 11s. Rate: 7.3 symbols/min [2025-10-09T18:16:01.485590] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:01.485807] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-09T18:16:01.485851] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-09T18:16:01.485962] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-09T18:16:01.486003] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-09T18:16:01.486046] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-09T18:16:01.486080] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-09T18:16:01.596702] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-09T18:16:01.882677] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:01.934700] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T18:16:02.396783] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-09T18:16:03.096870] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:16:03.101511] [INFO ] [REMOTE ] CTRA: Full fetch complete (77661 records). [2025-10-09T18:16:03.101638] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-09T18:16:03.202395] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-09T18:16:03.505859] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-09T18:16:03.505964] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-09T18:16:03.506902] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-09T18:16:03.506968] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-09T18:16:03.508593] [DEBUG] [LOCAL ] CTRA: Trimmed 77661 records to 54036 (keeping 200 days of data) [2025-10-09T18:16:03.856831] [DEBUG] [LOCAL ] CTRA: Primary data saved (54036 records). [2025-10-09T18:16:03.857096] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-09T18:16:03.857259] [INFO ] [MAIN ] Update Progress: 552/2373 symbols completed. CTRA took 47.7s. Estimated remaining: 4h 10m 44s. Rate: 7.3 symbols/min [2025-10-09T18:16:04.012479] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-09T18:16:04.034152] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:04.034927] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-09T18:16:04.034974] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-09T18:16:04.035084] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-09T18:16:04.035125] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-09T18:16:04.035174] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-09T18:16:04.064620] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-09T18:16:04.143170] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T18:16:04.356558] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T18:16:04.494503] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:04.796746] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-09T18:16:05.275100] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T18:16:05.391419] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T18:16:05.596780] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-09T18:16:05.910456] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T18:16:06.396714] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-09T18:16:06.719787] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:16:07.196801] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-09T18:16:07.996730] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-09T18:16:08.237533] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T18:16:08.358882] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-09T18:16:08.796795] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-09T18:16:09.596725] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-09T18:16:09.924870] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-09T18:16:10.049796] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T18:16:10.396738] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-09T18:16:11.196745] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-09T18:16:11.733021] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T18:16:11.759047] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T18:16:11.996744] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-09T18:16:12.796736] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-09T18:16:13.596709] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-09T18:16:13.793211] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T18:16:14.050400] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T18:16:14.396775] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-09T18:16:14.652854] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-09T18:16:15.196762] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-09T18:16:15.273162] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T18:16:15.685846] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T18:16:15.996765] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-09T18:16:16.796734] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-09T18:16:17.395509] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:16:17.596715] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-09T18:16:18.396753] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-09T18:16:18.560306] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T18:16:18.654178] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-09T18:16:19.196768] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-09T18:16:19.276784] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T18:16:19.996696] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-09T18:16:20.130437] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T18:16:20.796730] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-09T18:16:21.596727] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-09T18:16:21.877873] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T18:16:21.937032] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T18:16:22.396693] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-09T18:16:22.424246] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T18:16:22.430919] [INFO ] [REMOTE ] CTRI: Full fetch complete (52299 records). [2025-10-09T18:16:22.431062] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-09T18:16:22.431771] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:16:22.431855] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:16:22.431898] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:16:22.431938] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-09T18:16:22.431995] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-09T18:16:22.432031] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-09T18:16:22.432269] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-10-09T18:16:22.432368] [INFO ] [MAIN ] Update Progress: 553/2373 symbols completed. CTRI took 34.9s. Estimated remaining: 4h 11m 10s. Rate: 7.2 symbols/min [2025-10-09T18:16:22.601089] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:22.654384] [DEBUG] [LOCAL ] CUBE: Loaded 50778 existing records from primary storage. [2025-10-09T18:16:22.654758] [INFO ] [MAIN ] CUBE: Loaded 50778 existing records. [2025-10-09T18:16:22.754891] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T18:16:22.766137] [INFO ] [REMOTE ] CUBB: Full fetch complete (924 records). [2025-10-09T18:16:22.794750] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-09T18:16:22.908632] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:16:22.924512] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-09T18:16:22.936392] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-09T18:16:22.936769] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-09T18:16:22.942181] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-09T18:16:23.128398] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-09T18:16:23.128685] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:16:23.128999] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:16:23.134408] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-09T18:16:23.144737] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-09T18:16:23.155073] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-09T18:16:23.182517] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-09T18:16:23.190805] [INFO ] [MAIN ] Update Progress: 554/2373 symbols completed. CUBB took 19.3s. Estimated remaining: 4h 10m 37s. Rate: 7.3 symbols/min [2025-10-09T18:16:23.205540] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-09T18:16:23.560573] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:23.597725] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:23.620894] [DEBUG] [LOCAL ] CUBI: Loaded 26977 existing records from primary storage. [2025-10-09T18:16:23.621206] [INFO ] [MAIN ] CUBI: Loaded 26977 existing records. [2025-10-09T18:16:23.814959] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:16:23.815192] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-09T18:16:23.815242] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-09T18:16:23.815530] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-09T18:16:23.815588] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-09T18:16:24.005531] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-09T18:16:24.174983] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:24.601792] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T18:16:24.796746] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-09T18:16:25.596700] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-09T18:16:25.643160] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T18:16:25.771991] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:16:26.396821] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-09T18:16:27.196743] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-09T18:16:27.355318] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T18:16:27.620526] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T18:16:27.930021] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T18:16:27.996734] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-09T18:16:28.796732] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-09T18:16:29.360269] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T18:16:29.596738] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-09T18:16:30.099622] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:16:30.396697] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-09T18:16:30.487454] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T18:16:30.489635] [INFO ] [REMOTE ] CTS: Full fetch complete (26737 records). [2025-10-09T18:16:30.489882] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-09T18:16:30.883183] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-09T18:16:30.883296] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-09T18:16:30.883807] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-09T18:16:30.883871] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-09T18:16:30.884553] [DEBUG] [LOCAL ] CTS: Trimmed 26737 records to 19505 (keeping 200 days of data) [2025-10-09T18:16:31.002869] [DEBUG] [LOCAL ] CTS: Primary data saved (19505 records). [2025-10-09T18:16:31.003010] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-09T18:16:31.003084] [INFO ] [MAIN ] Update Progress: 555/2373 symbols completed. CTS took 43.4s. Estimated remaining: 4h 10m 27s. Rate: 7.3 symbols/min [2025-10-09T18:16:31.172980] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:31.202982] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-09T18:16:31.225042] [DEBUG] [LOCAL ] CUK: Loaded 50970 existing records from primary storage. [2025-10-09T18:16:31.225362] [INFO ] [MAIN ] CUK: Loaded 50970 existing records. [2025-10-09T18:16:31.408536] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:16:31.408807] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-09T18:16:31.408863] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-09T18:16:31.409116] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-09T18:16:31.409174] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-09T18:16:31.771027] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:31.996691] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-09T18:16:32.104263] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T18:16:32.796717] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-09T18:16:32.963696] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T18:16:33.596766] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-09T18:16:33.901380] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T18:16:34.078794] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T18:16:34.396711] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-09T18:16:35.196698] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-09T18:16:35.440347] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:16:35.996742] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-09T18:16:36.063457] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T18:16:36.796784] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-09T18:16:37.167460] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T18:16:37.596745] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-09T18:16:37.856853] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T18:16:37.886915] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T18:16:38.396715] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-09T18:16:39.200551] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-09T18:16:39.205969] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T18:16:39.910842] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T18:16:39.915276] [INFO ] [REMOTE ] CTVA: Full fetch complete (76998 records). [2025-10-09T18:16:39.915423] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-09T18:16:40.001891] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-09T18:16:40.331964] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-09T18:16:40.337240] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-09T18:16:40.346400] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-09T18:16:40.347312] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-09T18:16:40.348329] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T18:16:40.356138] [DEBUG] [LOCAL ] CTVA: Trimmed 76998 records to 53653 (keeping 200 days of data) [2025-10-09T18:16:40.684552] [DEBUG] [LOCAL ] CTVA: Primary data saved (53653 records). [2025-10-09T18:16:40.684725] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-09T18:16:40.684811] [INFO ] [MAIN ] Update Progress: 556/2373 symbols completed. CTVA took 39.4s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-09T18:16:40.801848] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-09T18:16:40.870404] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:40.875281] [DEBUG] [LOCAL ] CULP: Loaded 2885 existing records from primary storage. [2025-10-09T18:16:40.875444] [INFO ] [MAIN ] CULP: Loaded 2885 existing records. [2025-10-09T18:16:41.055696] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:16:41.055893] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-09T18:16:41.055949] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-09T18:16:41.056085] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-09T18:16:41.056141] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-09T18:16:41.408698] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:41.593410] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T18:16:41.603053] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-09T18:16:42.284000] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T18:16:42.396683] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-09T18:16:42.470374] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:16:43.196728] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-09T18:16:43.996725] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-09T18:16:44.155466] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T18:16:44.216365] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T18:16:44.796768] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-09T18:16:45.596736] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-09T18:16:46.060426] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T18:16:46.076234] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T18:16:46.262569] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T18:16:46.396735] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-09T18:16:46.878467] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T18:16:47.196705] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-09T18:16:47.996805] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-09T18:16:48.796688] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-09T18:16:49.150313] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T18:16:49.596691] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-09T18:16:49.739718] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:16:49.763083] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:16:50.194242] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T18:16:50.396718] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-09T18:16:51.196758] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-09T18:16:51.996765] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-09T18:16:52.158465] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T18:16:52.721580] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T18:16:52.796680] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-09T18:16:52.895521] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T18:16:53.596767] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-09T18:16:53.927766] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T18:16:54.103038] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-09T18:16:54.396765] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-09T18:16:55.196721] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-09T18:16:55.996766] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-09T18:16:56.252843] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T18:16:56.463410] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T18:16:56.796694] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-09T18:16:56.867257] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T18:16:56.871522] [INFO ] [REMOTE ] CUBE: Full fetch complete (73042 records). [2025-10-09T18:16:56.871682] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-09T18:16:57.286486] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-09T18:16:57.286836] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-09T18:16:57.287872] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-09T18:16:57.287940] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-09T18:16:57.289480] [DEBUG] [LOCAL ] CUBE: Trimmed 73042 records to 51139 (keeping 200 days of data) [2025-10-09T18:16:57.596856] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-09T18:16:57.611115] [DEBUG] [LOCAL ] CUBE: Primary data saved (51139 records). [2025-10-09T18:16:57.611261] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-09T18:16:57.612549] [INFO ] [MAIN ] Update Progress: 557/2373 symbols completed. CUBE took 35.2s. Estimated remaining: 4h 10m 43s. Rate: 7.2 symbols/min [2025-10-09T18:16:57.923274] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:16:58.396731] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-09T18:16:59.046005] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T18:16:59.196692] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-09T18:16:59.402638] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:16:59.762844] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T18:16:59.996815] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-09T18:17:00.541907] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:17:00.796684] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-09T18:17:01.596718] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-09T18:17:02.041682] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T18:17:02.231240] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T18:17:02.396699] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-09T18:17:03.196764] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-09T18:17:03.807601] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T18:17:03.996673] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-09T18:17:04.367484] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T18:17:04.370021] [INFO ] [REMOTE ] CUBI: Full fetch complete (39034 records). [2025-10-09T18:17:04.370116] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-09T18:17:04.736210] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-09T18:17:04.736290] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-09T18:17:04.736856] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-09T18:17:04.736919] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-09T18:17:04.738719] [DEBUG] [LOCAL ] CUBI: Trimmed 39034 records to 27184 (keeping 200 days of data) [2025-10-09T18:17:04.821727] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-09T18:17:04.899482] [DEBUG] [LOCAL ] CUBI: Primary data saved (27184 records). [2025-10-09T18:17:04.899611] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-09T18:17:04.899719] [INFO ] [MAIN ] Update Progress: 558/2373 symbols completed. CUBI took 41.7s. Estimated remaining: 4h 10m 32s. Rate: 7.2 symbols/min [2025-10-09T18:17:05.441483] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T18:17:05.442262] [INFO ] [REMOTE ] CULP: Full fetch complete (4616 records). [2025-10-09T18:17:05.442332] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-09T18:17:05.821786] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-09T18:17:05.821969] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-09T18:17:05.822159] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-09T18:17:05.822238] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-09T18:17:05.822814] [DEBUG] [LOCAL ] CULP: Trimmed 4616 records to 2897 (keeping 200 days of data) [2025-10-09T18:17:05.870175] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T18:17:05.884627] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-09T18:17:05.887084] [DEBUG] [LOCAL ] CULP: Primary data saved (2897 records). [2025-10-09T18:17:05.887280] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-09T18:17:05.887443] [INFO ] [MAIN ] Update Progress: 559/2373 symbols completed. CULP took 25.2s. Estimated remaining: 4h 9m 60s. Rate: 7.3 symbols/min [2025-10-09T18:17:07.620578] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:17:07.626267] [INFO ] [REMOTE ] CUK: Full fetch complete (73704 records). [2025-10-09T18:17:07.626543] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-09T18:17:07.628000] [FATAL] [VALIDATOR ] CUK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:17:07.628223] [FATAL] [MAIN ] CUK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:17:07.628283] [WARN ] [MAIN ] CUK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:17:07.628363] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-09T18:17:07.628449] [DEBUG] [LOCAL ] CUK: No primary data file found to delete. [2025-10-09T18:17:07.628573] [INFO ] [LOCAL ] CUK: Starting deletion of derivative data. [2025-10-09T18:17:07.628948] [DEBUG] [LOCAL ] CUK: Deleted derivative data file. [2025-10-09T18:17:07.629102] [INFO ] [MAIN ] Update Progress: 560/2373 symbols completed. CUK took 36.6s. Estimated remaining: 4h 9m 30s. Rate: 7.3 symbols/min [2025-10-09T18:17:08.609137] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:08.646616] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:08.614688] [DEBUG] [LOCAL ] CVE: No existing data file found in primary storage. [2025-10-09T18:17:08.657739] [WARN ] [MAIN ] CVE: No existing data found, performing full refresh instead. [2025-10-09T18:17:08.657477] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:08.658749] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-09T18:17:08.658849] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-09T18:17:08.658964] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-09T18:17:08.659053] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-09T18:17:08.691102] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:08.942934] [DEBUG] [LOCAL ] CURV: Loaded 26786 existing records from primary storage. [2025-10-09T18:17:08.959001] [INFO ] [MAIN ] CURV: Loaded 26786 existing records. [2025-10-09T18:17:09.047238] [DEBUG] [LOCAL ] CURB: Loaded 32646 existing records from primary storage. [2025-10-09T18:17:09.111794] [INFO ] [MAIN ] CURB: Loaded 32646 existing records. [2025-10-09T18:17:09.367489] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:09.359159] [DEBUG] [LOCAL ] CUZ: Loaded 49428 existing records from primary storage. [2025-10-09T18:17:09.373123] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-09T18:17:09.383560] [INFO ] [MAIN ] CUZ: Loaded 49428 existing records. [2025-10-09T18:17:09.498187] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:09.556446] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-09T18:17:09.593689] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-09T18:17:09.622015] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-09T18:17:09.610937] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:09.632765] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-09T18:17:09.632711] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-09T18:17:09.632882] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-09T18:17:09.685798] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-09T18:17:09.711427] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-09T18:17:09.879599] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:09.943468] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-09T18:17:09.962016] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-09T18:17:10.052150] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-09T18:17:10.080639] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-09T18:17:10.490827] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:10.502452] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-09T18:17:10.814446] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:10.848098] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-09T18:17:10.891003] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:10.891631] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-09T18:17:10.956272] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T18:17:10.967597] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-09T18:17:11.885374] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:17:11.893243] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-09T18:17:12.251802] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T18:17:12.259444] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-09T18:17:12.512183] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:17:12.522786] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-09T18:17:12.698462] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T18:17:12.796705] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-09T18:17:12.996062] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:17:13.596746] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-09T18:17:13.641214] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T18:17:13.851377] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T18:17:14.110521] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T18:17:14.396690] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-09T18:17:14.716612] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:17:15.196723] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-09T18:17:15.996677] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-09T18:17:16.401610] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T18:17:16.799307] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-09T18:17:16.804387] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T18:17:16.867144] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T18:17:17.596777] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-09T18:17:18.396693] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-09T18:17:18.414688] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T18:17:18.474743] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T18:17:19.196805] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-09T18:17:19.996732] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-09T18:17:20.046750] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:17:20.169343] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:17:20.796777] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-09T18:17:21.596785] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-09T18:17:21.918028] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T18:17:22.088914] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T18:17:22.396718] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-09T18:17:22.884437] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T18:17:23.196724] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-09T18:17:23.638628] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T18:17:23.996741] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-09T18:17:24.796726] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-09T18:17:24.825601] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T18:17:25.596683] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-09T18:17:25.660514] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T18:17:26.301719] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:17:26.396745] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-09T18:17:26.996916] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T18:17:27.196736] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-09T18:17:27.364568] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T18:17:27.996729] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-09T18:17:28.796745] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-09T18:17:29.596758] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-09T18:17:29.882462] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-09T18:17:30.320762] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T18:17:30.396669] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-09T18:17:30.578812] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T18:17:30.818497] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:17:31.196711] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-09T18:17:31.996771] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-09T18:17:32.796701] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-09T18:17:33.004506] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-09T18:17:33.040475] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T18:17:33.043638] [INFO ] [REMOTE ] CURV: Full fetch complete (38915 records). [2025-10-09T18:17:33.043755] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-09T18:17:33.423555] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-09T18:17:33.474528] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-09T18:17:33.474607] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-09T18:17:33.475167] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-09T18:17:33.475231] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-09T18:17:33.476124] [DEBUG] [LOCAL ] CURV: Trimmed 38915 records to 27028 (keeping 200 days of data) [2025-10-09T18:17:33.601395] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-09T18:17:33.627154] [DEBUG] [LOCAL ] CURV: Primary data saved (27028 records). [2025-10-09T18:17:33.627568] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-09T18:17:33.627696] [INFO ] [MAIN ] Update Progress: 561/2373 symbols completed. CURV took 26.0s. Estimated remaining: 4h 10m 19s. Rate: 7.2 symbols/min [2025-10-09T18:17:33.798506] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:33.814779] [DEBUG] [LOCAL ] CVEO: Loaded 15261 existing records from primary storage. [2025-10-09T18:17:33.814999] [INFO ] [MAIN ] CVEO: Loaded 15261 existing records. [2025-10-09T18:17:33.996279] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:33.996527] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-09T18:17:33.996596] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-09T18:17:33.996897] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-09T18:17:33.996972] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-09T18:17:34.323475] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:17:34.387316] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:34.396667] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-09T18:17:35.170602] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T18:17:35.196666] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-09T18:17:35.704848] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:17:35.996741] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-09T18:17:36.796729] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-09T18:17:37.116940] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-09T18:17:37.123456] [INFO ] [REMOTE ] CVE: Full fetch complete (77561 records). [2025-10-09T18:17:37.123634] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-09T18:17:37.570137] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-09T18:17:37.571998] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:17:37.579274] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-09T18:17:37.580734] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-09T18:17:37.581157] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-09T18:17:37.583051] [DEBUG] [LOCAL ] CVE: Trimmed 77561 records to 53949 (keeping 200 days of data) [2025-10-09T18:17:37.641101] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-09T18:17:37.691300] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:17:37.937688] [DEBUG] [LOCAL ] CVE: Primary data saved (53949 records). [2025-10-09T18:17:37.937886] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-09T18:17:37.937981] [INFO ] [MAIN ] Update Progress: 562/2373 symbols completed. CVE took 30.3s. Estimated remaining: 4h 9m 58s. Rate: 7.2 symbols/min [2025-10-09T18:17:38.111258] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:38.154300] [DEBUG] [LOCAL ] CVI: Loaded 46541 existing records from primary storage. [2025-10-09T18:17:38.154603] [INFO ] [MAIN ] CVI: Loaded 46541 existing records. [2025-10-09T18:17:38.340619] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:38.340867] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-09T18:17:38.340915] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-09T18:17:38.341228] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-09T18:17:38.341286] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-09T18:17:38.403865] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-09T18:17:38.759853] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:38.779878] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:17:39.151638] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T18:17:39.196728] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-09T18:17:39.996765] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-09T18:17:40.796707] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-09T18:17:40.893607] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T18:17:41.349501] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:17:41.596715] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-09T18:17:41.628303] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T18:17:42.396738] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-09T18:17:43.152449] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T18:17:43.196670] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-09T18:17:43.339216] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T18:17:43.996758] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-09T18:17:44.500304] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T18:17:44.796687] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-09T18:17:45.015296] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T18:17:45.312263] [DEBUG] [REMOTE ] CURB: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-09T18:17:45.312585] [WARN ] [REMOTE ] CURB: No data returned for month 2025-10 [2025-10-09T18:17:45.312702] [FATAL] [REMOTE ] CURB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:17:45.312789] [FATAL] [MAIN ] CURB: Failed to fetch primary data. [2025-10-09T18:17:45.312851] [WARN ] [MAIN ] CURB: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:17:45.312922] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-09T18:17:45.312984] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-09T18:17:45.313032] [INFO ] [LOCAL ] CURB: Starting deletion of derivative data. [2025-10-09T18:17:45.313251] [DEBUG] [LOCAL ] CURB: Deleted derivative data file. [2025-10-09T18:17:45.313338] [INFO ] [MAIN ] Update Progress: 563/2373 symbols completed. CURB took 37.7s. Estimated remaining: 4h 9m 47s. Rate: 7.2 symbols/min [2025-10-09T18:17:45.478293] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:45.498888] [DEBUG] [LOCAL ] CVLG: Loaded 15513 existing records from primary storage. [2025-10-09T18:17:45.499154] [INFO ] [MAIN ] CVLG: Loaded 15513 existing records. [2025-10-09T18:17:45.599115] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-09T18:17:45.678292] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:45.678515] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-09T18:17:45.678563] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-09T18:17:45.678798] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-09T18:17:45.678857] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-09T18:17:46.037766] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:46.396764] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-09T18:17:47.196818] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-09T18:17:47.253082] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:17:47.379312] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T18:17:47.996735] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-09T18:17:48.036911] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T18:17:48.796730] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-09T18:17:49.132076] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T18:17:49.596735] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-09T18:17:50.396745] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-09T18:17:50.496088] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T18:17:51.096571] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:17:51.196668] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-09T18:17:51.311540] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T18:17:51.996706] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-09T18:17:52.784948] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:17:52.796677] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-09T18:17:52.846030] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T18:17:53.596706] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-09T18:17:53.614815] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T18:17:54.396730] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-09T18:17:54.504528] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T18:17:55.175410] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:17:55.196662] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-09T18:17:55.996727] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-09T18:17:56.019719] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T18:17:56.796736] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-09T18:17:57.169411] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:17:57.596776] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-09T18:17:58.118536] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:17:58.396693] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-09T18:17:58.804092] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:17:59.196715] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-09T18:17:59.726725] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T18:17:59.731025] [INFO ] [REMOTE ] CUZ: Full fetch complete (70731 records). [2025-10-09T18:17:59.731113] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-09T18:18:00.005672] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-09T18:18:00.133879] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-09T18:18:00.133967] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-09T18:18:00.135498] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-09T18:18:00.135578] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-09T18:18:00.137166] [DEBUG] [LOCAL ] CUZ: Trimmed 70731 records to 49781 (keeping 200 days of data) [2025-10-09T18:18:00.446418] [DEBUG] [LOCAL ] CUZ: Primary data saved (49781 records). [2025-10-09T18:18:00.446804] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-09T18:18:00.446903] [INFO ] [MAIN ] Update Progress: 564/2373 symbols completed. CUZ took 52.8s. Estimated remaining: 4h 10m 1s. Rate: 7.2 symbols/min [2025-10-09T18:18:00.633757] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:00.740529] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T18:18:00.752461] [DEBUG] [LOCAL ] CVNA: Loaded 52896 existing records from primary storage. [2025-10-09T18:18:00.753949] [INFO ] [MAIN ] CVNA: Loaded 52896 existing records. [2025-10-09T18:18:00.803874] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-09T18:18:01.014508] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:01.014858] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-09T18:18:01.014934] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-09T18:18:01.015190] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-09T18:18:01.015255] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-09T18:18:01.400524] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:18:01.416181] [INFO ] [REMOTE ] CVEO: Full fetch complete (20437 records). [2025-10-09T18:18:01.437273] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-09T18:18:01.448633] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:18:01.501899] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:18:01.565290] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:01.560625] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:18:01.565783] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-09T18:18:01.565876] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-09T18:18:01.565918] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-09T18:18:01.566138] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-10-09T18:18:01.566240] [INFO ] [MAIN ] Update Progress: 565/2373 symbols completed. CVEO took 27.9s. Estimated remaining: 4h 9m 30s. Rate: 7.2 symbols/min [2025-10-09T18:18:01.601845] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-09T18:18:01.755097] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:01.825916] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-09T18:18:01.826270] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-09T18:18:01.993553] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:18:02.049745] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:02.049948] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-09T18:18:02.049997] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-09T18:18:02.050238] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-09T18:18:02.050296] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-09T18:18:02.405781] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-09T18:18:02.405707] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:03.196751] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-09T18:18:03.441213] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:18:03.440886] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:18:03.996758] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-09T18:18:04.796780] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-09T18:18:05.236028] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T18:18:05.596694] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-09T18:18:05.889126] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T18:18:06.026960] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T18:18:06.396789] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-09T18:18:07.196683] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-09T18:18:07.675092] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T18:18:07.737800] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T18:18:07.741487] [INFO ] [REMOTE ] CVI: Full fetch complete (66961 records). [2025-10-09T18:18:07.741585] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-09T18:18:07.742253] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:18:07.742343] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:18:07.742386] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:18:07.742449] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-09T18:18:07.742539] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-09T18:18:07.742597] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-09T18:18:07.742838] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-09T18:18:07.742930] [INFO ] [MAIN ] Update Progress: 566/2373 symbols completed. CVI took 29.8s. Estimated remaining: 4h 9m 15s. Rate: 7.2 symbols/min [2025-10-09T18:18:07.917863] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:07.927891] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T18:18:07.985076] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-09T18:18:07.985444] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-09T18:18:08.001879] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-09T18:18:08.170382] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:08.170635] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-09T18:18:08.170721] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-09T18:18:08.170985] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-09T18:18:08.171043] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-09T18:18:08.519131] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:08.796702] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-09T18:18:09.596725] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-09T18:18:09.807454] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T18:18:10.396738] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-09T18:18:10.618636] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T18:18:10.869704] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-09T18:18:11.196746] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-09T18:18:11.996757] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-09T18:18:12.088166] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T18:18:12.796795] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-09T18:18:13.411948] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-09T18:18:13.596800] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-09T18:18:14.300167] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T18:18:14.403211] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-09T18:18:14.408805] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-09T18:18:14.783332] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-09T18:18:15.196716] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-09T18:18:15.244708] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T18:18:15.246366] [INFO ] [REMOTE ] CVLG: Full fetch complete (21179 records). [2025-10-09T18:18:15.246437] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-09T18:18:15.604712] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-09T18:18:15.604796] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-09T18:18:15.605208] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-09T18:18:15.605248] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-09T18:18:15.605883] [DEBUG] [LOCAL ] CVLG: Trimmed 21179 records to 15601 (keeping 200 days of data) [2025-10-09T18:18:15.703232] [DEBUG] [LOCAL ] CVLG: Primary data saved (15601 records). [2025-10-09T18:18:15.703384] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-09T18:18:15.703471] [INFO ] [MAIN ] Update Progress: 567/2373 symbols completed. CVLG took 30.4s. Estimated remaining: 4h 9m 5s. Rate: 7.3 symbols/min [2025-10-09T18:18:15.867959] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:15.890806] [DEBUG] [LOCAL ] CW: Loaded 22225 existing records from primary storage. [2025-10-09T18:18:15.891057] [INFO ] [MAIN ] CW: Loaded 22225 existing records. [2025-10-09T18:18:16.001852] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-09T18:18:16.070400] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:16.070681] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-09T18:18:16.070741] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-09T18:18:16.070928] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-09T18:18:16.070985] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-09T18:18:16.427820] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:16.796760] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-09T18:18:17.097229] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T18:18:17.596741] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-09T18:18:17.740624] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:18:18.396735] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-09T18:18:18.464327] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T18:18:18.807729] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T18:18:19.196738] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-09T18:18:19.996713] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-09T18:18:20.318131] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T18:18:20.458755] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T18:18:20.796794] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-09T18:18:21.596684] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-09T18:18:21.900889] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T18:18:22.396718] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-09T18:18:23.028167] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-09T18:18:23.196727] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-09T18:18:23.434019] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T18:18:23.828615] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-09T18:18:23.996724] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-09T18:18:24.796701] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-09T18:18:24.851421] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T18:18:25.596790] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-09T18:18:26.259784] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-09T18:18:26.396736] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-09T18:18:26.638229] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T18:18:27.196775] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-09T18:18:27.275426] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-09T18:18:27.996685] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-09T18:18:28.438263] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T18:18:28.796730] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-09T18:18:29.030596] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T18:18:29.596763] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-09T18:18:29.934827] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T18:18:30.396723] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-09T18:18:31.085713] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-09T18:18:31.196695] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-09T18:18:31.659403] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-09T18:18:31.996695] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-09T18:18:32.308025] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-09T18:18:32.516841] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T18:18:32.796712] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-09T18:18:33.596726] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-09T18:18:33.777019] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T18:18:33.781479] [INFO ] [REMOTE ] CVNA: Full fetch complete (76652 records). [2025-10-09T18:18:33.781594] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-09T18:18:34.121050] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:18:34.205190] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-09T18:18:34.205321] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-09T18:18:34.206216] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-09T18:18:34.206283] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-09T18:18:34.207690] [DEBUG] [LOCAL ] CVNA: Trimmed 76652 records to 53280 (keeping 200 days of data) [2025-10-09T18:18:34.416299] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-09T18:18:34.533606] [DEBUG] [LOCAL ] CVNA: Primary data saved (53280 records). [2025-10-09T18:18:34.533774] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-09T18:18:34.534410] [INFO ] [MAIN ] Update Progress: 568/2373 symbols completed. CVNA took 34.1s. Estimated remaining: 4h 9m 31s. Rate: 7.2 symbols/min [2025-10-09T18:18:34.698960] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:34.748840] [DEBUG] [LOCAL ] CWAN: Loaded 52465 existing records from primary storage. [2025-10-09T18:18:34.749158] [INFO ] [MAIN ] CWAN: Loaded 52465 existing records. [2025-10-09T18:18:34.920576] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:34.920788] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-09T18:18:34.920837] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-09T18:18:34.921084] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-09T18:18:34.921147] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-09T18:18:35.201786] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-09T18:18:35.274020] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:35.581821] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:18:35.934732] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-09T18:18:35.996687] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-09T18:18:36.796716] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-09T18:18:37.432322] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-09T18:18:37.596722] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-09T18:18:38.057291] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T18:18:38.396730] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-09T18:18:38.594495] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T18:18:39.196685] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-09T18:18:39.290977] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:18:39.996736] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-09T18:18:40.358981] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T18:18:40.637503] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-09T18:18:40.678242] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T18:18:40.682736] [INFO ] [REMOTE ] CVS: Full fetch complete (77811 records). [2025-10-09T18:18:40.682862] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-09T18:18:40.801782] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-09T18:18:41.069341] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-09T18:18:41.069423] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-09T18:18:41.070289] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-09T18:18:41.070355] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-09T18:18:41.071884] [DEBUG] [LOCAL ] CVS: Trimmed 77811 records to 54084 (keeping 200 days of data) [2025-10-09T18:18:41.397793] [DEBUG] [LOCAL ] CVS: Primary data saved (54084 records). [2025-10-09T18:18:41.397954] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-09T18:18:41.398040] [INFO ] [MAIN ] Update Progress: 569/2373 symbols completed. CVS took 39.8s. Estimated remaining: 4h 9m 18s. Rate: 7.2 symbols/min [2025-10-09T18:18:41.563860] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:41.564042] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-09T18:18:41.564098] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-09T18:18:41.564209] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-09T18:18:41.564254] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-09T18:18:41.564295] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-09T18:18:41.564327] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-09T18:18:41.606221] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-09T18:18:41.926135] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:42.396699] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-09T18:18:42.444062] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:18:43.196719] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-09T18:18:43.540064] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:18:43.885251] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-09T18:18:43.890196] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-09T18:18:43.890363] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-09T18:18:44.005904] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-09T18:18:44.378897] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-09T18:18:44.379035] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-09T18:18:44.380125] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-09T18:18:44.380207] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-09T18:18:44.382025] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54150 (keeping 200 days of data) [2025-10-09T18:18:44.512040] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:18:44.766948] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-10-09T18:18:44.767088] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-09T18:18:44.767974] [INFO ] [MAIN ] Update Progress: 570/2373 symbols completed. CVX took 37.0s. Estimated remaining: 4h 8m 54s. Rate: 7.2 symbols/min [2025-10-09T18:18:44.799212] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-09T18:18:44.936871] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:44.937019] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-09T18:18:44.937055] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-09T18:18:44.937162] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-09T18:18:44.937204] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-09T18:18:44.937243] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-09T18:18:44.937276] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-09T18:18:45.280207] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:45.596748] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-09T18:18:45.621059] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:18:46.097290] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T18:18:46.396689] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-09T18:18:47.196697] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-09T18:18:47.298144] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T18:18:47.300318] [INFO ] [REMOTE ] CW: Full fetch complete (33057 records). [2025-10-09T18:18:47.300415] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-09T18:18:47.615462] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T18:18:47.719702] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-09T18:18:47.719789] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-09T18:18:47.720316] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-09T18:18:47.720355] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-09T18:18:47.721148] [DEBUG] [LOCAL ] CW: Trimmed 33057 records to 22352 (keeping 200 days of data) [2025-10-09T18:18:47.861764] [DEBUG] [LOCAL ] CW: Primary data saved (22352 records). [2025-10-09T18:18:47.861931] [INFO ] [MAIN ] CW: Full history saved. [2025-10-09T18:18:47.862041] [INFO ] [MAIN ] Update Progress: 571/2373 symbols completed. CW took 32.2s. Estimated remaining: 4h 8m 29s. Rate: 7.3 symbols/min [2025-10-09T18:18:48.001837] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-09T18:18:48.032493] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:48.080406] [DEBUG] [LOCAL ] CWK: Loaded 49460 existing records from primary storage. [2025-10-09T18:18:48.080760] [INFO ] [MAIN ] CWK: Loaded 49460 existing records. [2025-10-09T18:18:48.255268] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:48.255450] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-09T18:18:48.255497] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-09T18:18:48.255733] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-09T18:18:48.255790] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-09T18:18:48.608254] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:48.645389] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T18:18:48.796721] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-09T18:18:49.531040] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T18:18:49.596765] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-09T18:18:50.039454] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T18:18:50.396792] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-09T18:18:51.196728] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-09T18:18:51.451084] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T18:18:51.973791] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:18:51.996723] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-09T18:18:52.796698] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-09T18:18:52.913221] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T18:18:53.576997] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:18:53.596737] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-09T18:18:54.396712] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-09T18:18:54.450699] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:18:55.201036] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-09T18:18:55.206782] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T18:18:55.904343] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T18:18:55.996709] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-09T18:18:56.796695] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-09T18:18:56.916962] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T18:18:57.476842] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T18:18:57.596767] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-09T18:18:58.396719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-09T18:18:58.656516] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T18:18:58.784511] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:18:59.196770] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-09T18:18:59.860044] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T18:18:59.996689] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-09T18:19:00.725382] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T18:19:00.796746] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-09T18:19:01.606205] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-09T18:19:01.611702] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:19:02.396711] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-09T18:19:02.821019] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T18:19:03.196714] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-09T18:19:03.445921] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T18:19:03.797764] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T18:19:03.996720] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-09T18:19:04.796745] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-09T18:19:04.940101] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:19:05.596699] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-09T18:19:05.718790] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:19:06.396769] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-09T18:19:06.567366] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T18:19:07.162891] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T18:19:07.196683] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-09T18:19:07.881455] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T18:19:07.996706] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-09T18:19:08.781349] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T18:19:08.796678] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-09T18:19:09.602080] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-09T18:19:09.608785] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T18:19:10.401833] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-09T18:19:10.427221] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:19:11.196740] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-09T18:19:11.307392] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T18:19:11.996738] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-09T18:19:12.172387] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:19:12.732393] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T18:19:12.796719] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-09T18:19:13.596732] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-09T18:19:13.726771] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:19:14.396717] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-09T18:19:14.672440] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T18:19:14.676978] [INFO ] [REMOTE ] CWH: Full fetch complete (73033 records). [2025-10-09T18:19:14.677110] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-09T18:19:15.072110] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-09T18:19:15.072242] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-09T18:19:15.073460] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-09T18:19:15.073548] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-09T18:19:15.075414] [DEBUG] [LOCAL ] CWH: Trimmed 73033 records to 51673 (keeping 200 days of data) [2025-10-09T18:19:15.196689] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-09T18:19:15.407204] [DEBUG] [LOCAL ] CWH: Primary data saved (51673 records). [2025-10-09T18:19:15.407361] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-09T18:19:15.407439] [INFO ] [MAIN ] Update Progress: 572/2373 symbols completed. CWH took 30.6s. Estimated remaining: 4h 9m 22s. Rate: 7.2 symbols/min [2025-10-09T18:19:15.551823] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T18:19:15.603187] [INFO ] [REMOTE ] CWAN: Full fetch complete (75185 records). [2025-10-09T18:19:15.603072] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:15.603666] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-09T18:19:15.603768] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-09T18:19:15.604066] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-09T18:19:15.603865] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-09T18:19:15.604231] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-09T18:19:15.604341] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-09T18:19:15.604426] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-09T18:19:16.365172] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:16.412773] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-09T18:19:16.412975] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-09T18:19:16.413834] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-09T18:19:16.414755] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-09T18:19:16.429497] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-09T18:19:16.440972] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T18:19:16.451600] [DEBUG] [LOCAL ] CWAN: Trimmed 75185 records to 52841 (keeping 200 days of data) [2025-10-09T18:19:16.766021] [DEBUG] [LOCAL ] CWAN: Primary data saved (52841 records). [2025-10-09T18:19:16.766161] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-09T18:19:16.766633] [INFO ] [MAIN ] Update Progress: 573/2373 symbols completed. CWAN took 42.2s. Estimated remaining: 4h 8m 52s. Rate: 7.2 symbols/min [2025-10-09T18:19:16.798818] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-09T18:19:16.945166] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:16.996044] [DEBUG] [LOCAL ] CX: Loaded 52821 existing records from primary storage. [2025-10-09T18:19:16.996448] [INFO ] [MAIN ] CX: Loaded 52821 existing records. [2025-10-09T18:19:17.210046] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:17.211042] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-09T18:19:17.213064] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-09T18:19:17.212905] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-09T18:19:17.223671] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-09T18:19:17.224183] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-09T18:19:17.600442] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-09T18:19:17.604974] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:17.608139] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T18:19:18.077333] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T18:19:18.396714] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-09T18:19:19.186966] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T18:19:19.191275] [INFO ] [REMOTE ] CWK: Full fetch complete (71021 records). [2025-10-09T18:19:19.191391] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-09T18:19:19.203358] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-09T18:19:19.586279] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-09T18:19:19.586361] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-09T18:19:19.587190] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-09T18:19:19.587254] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-09T18:19:19.588616] [DEBUG] [LOCAL ] CWK: Trimmed 71021 records to 49798 (keeping 200 days of data) [2025-10-09T18:19:19.877469] [DEBUG] [LOCAL ] CWK: Primary data saved (49798 records). [2025-10-09T18:19:19.877727] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-09T18:19:19.878745] [INFO ] [MAIN ] Update Progress: 574/2373 symbols completed. CWK took 32.0s. Estimated remaining: 4h 8m 27s. Rate: 7.2 symbols/min [2025-10-09T18:19:20.001806] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-09T18:19:20.054365] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:20.064239] [DEBUG] [LOCAL ] CXE: Loaded 6197 existing records from primary storage. [2025-10-09T18:19:20.064526] [INFO ] [MAIN ] CXE: Loaded 6197 existing records. [2025-10-09T18:19:20.263699] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:20.264251] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-09T18:19:20.264318] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-09T18:19:20.264517] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-09T18:19:20.264591] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-09T18:19:20.447272] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-09T18:19:20.682091] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:20.683269] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T18:19:20.796670] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-09T18:19:21.596741] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-09T18:19:21.614371] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T18:19:21.618226] [INFO ] [REMOTE ] CWEN: Full fetch complete (64663 records). [2025-10-09T18:19:21.618337] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-09T18:19:21.619055] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:19:21.619161] [FATAL] [MAIN ] CWEN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:19:21.619208] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:19:21.619246] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-09T18:19:21.619302] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-09T18:19:21.619336] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-10-09T18:19:21.619376] [DEBUG] [LOCAL ] CWEN: No derivative data file found to delete. [2025-10-09T18:19:21.619442] [INFO ] [MAIN ] Update Progress: 575/2373 symbols completed. CWEN took 40.2s. Estimated remaining: 4h 7m 58s. Rate: 7.3 symbols/min [2025-10-09T18:19:21.788715] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:21.796245] [DEBUG] [LOCAL ] CXH: Loaded 4425 existing records from primary storage. [2025-10-09T18:19:21.796455] [INFO ] [MAIN ] CXH: Loaded 4425 existing records. [2025-10-09T18:19:21.974386] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:21.974631] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-09T18:19:21.974712] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-09T18:19:21.974950] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-09T18:19:21.975008] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-09T18:19:22.146426] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T18:19:22.361377] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:22.396662] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-09T18:19:23.056292] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T18:19:23.196675] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-09T18:19:23.439086] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T18:19:23.647463] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T18:19:23.996775] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-09T18:19:24.438197] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T18:19:24.796743] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-09T18:19:25.596768] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-09T18:19:26.078053] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T18:19:26.396750] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-09T18:19:26.442483] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:19:27.196760] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-09T18:19:27.894507] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T18:19:27.996671] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-09T18:19:28.668770] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T18:19:28.796695] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-09T18:19:29.462964] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T18:19:29.535200] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T18:19:29.596682] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-09T18:19:30.396699] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-09T18:19:31.180185] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:19:31.196666] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-09T18:19:31.522892] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T18:19:31.996686] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-09T18:19:32.078765] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T18:19:32.437483] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-09T18:19:32.796717] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-09T18:19:33.596709] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-09T18:19:34.298737] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T18:19:34.396681] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-09T18:19:34.551380] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:19:34.979340] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T18:19:35.196708] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-09T18:19:35.551358] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T18:19:35.996732] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-09T18:19:36.796740] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-09T18:19:37.548885] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T18:19:37.599531] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-09T18:19:37.602229] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T18:19:38.182749] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:19:38.396758] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-09T18:19:39.196783] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-09T18:19:39.776612] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T18:19:39.996726] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-09T18:19:40.231950] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T18:19:40.611935] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T18:19:40.612767] [INFO ] [REMOTE ] CXH: Full fetch complete (5386 records). [2025-10-09T18:19:40.612843] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-09T18:19:40.805439] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-09T18:19:40.973027] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-09T18:19:40.973105] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-09T18:19:40.973255] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-09T18:19:40.973294] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-09T18:19:40.973736] [DEBUG] [LOCAL ] CXH: Trimmed 5386 records to 4438 (keeping 200 days of data) [2025-10-09T18:19:40.999545] [DEBUG] [LOCAL ] CXH: Primary data saved (4438 records). [2025-10-09T18:19:40.999631] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-09T18:19:40.999755] [INFO ] [MAIN ] Update Progress: 576/2373 symbols completed. CXH took 19.4s. Estimated remaining: 4h 8m 25s. Rate: 7.2 symbols/min [2025-10-09T18:19:41.162935] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:41.206113] [DEBUG] [LOCAL ] CXM: Loaded 47580 existing records from primary storage. [2025-10-09T18:19:41.206416] [INFO ] [MAIN ] CXM: Loaded 47580 existing records. [2025-10-09T18:19:41.378108] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:41.378323] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-09T18:19:41.378370] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-09T18:19:41.378682] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-09T18:19:41.378741] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-09T18:19:41.601814] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-09T18:19:41.736283] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T18:19:41.740532] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:42.396760] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-09T18:19:42.821724] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:19:43.164411] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T18:19:43.196669] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-09T18:19:43.807354] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-09T18:19:43.996697] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-09T18:19:44.796708] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-09T18:19:44.845918] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T18:19:45.596696] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-09T18:19:46.182660] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:19:46.410067] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-09T18:19:46.412715] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:19:47.196730] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-09T18:19:47.996759] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-09T18:19:48.736839] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:19:48.796721] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-09T18:19:49.222888] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T18:19:49.489106] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-10-09T18:19:49.539680] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:19:49.596670] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-09T18:19:50.182348] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:19:50.183373] [INFO ] [REMOTE ] CXE: Full fetch complete (11609 records). [2025-10-09T18:19:50.183440] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-09T18:19:50.401890] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-09T18:19:50.548263] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-09T18:19:50.548357] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-09T18:19:50.548620] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-09T18:19:50.548689] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-09T18:19:50.549116] [DEBUG] [LOCAL ] CXE: Trimmed 11609 records to 6217 (keeping 200 days of data) [2025-10-09T18:19:50.586091] [DEBUG] [LOCAL ] CXE: Primary data saved (6217 records). [2025-10-09T18:19:50.586192] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-09T18:19:50.586266] [INFO ] [MAIN ] Update Progress: 577/2373 symbols completed. CXE took 30.7s. Estimated remaining: 4h 8m 20s. Rate: 7.2 symbols/min [2025-10-09T18:19:50.752870] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:50.789538] [DEBUG] [LOCAL ] CXT: Loaded 30997 existing records from primary storage. [2025-10-09T18:19:50.789864] [INFO ] [MAIN ] CXT: Loaded 30997 existing records. [2025-10-09T18:19:50.963961] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:50.964231] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-09T18:19:50.964303] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-09T18:19:50.964679] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-09T18:19:50.964751] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-09T18:19:51.201952] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-09T18:19:51.346027] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:51.688964] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T18:19:51.996752] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-09T18:19:52.609043] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:19:52.796745] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-09T18:19:53.596692] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-09T18:19:53.797595] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T18:19:54.042534] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T18:19:54.396716] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-09T18:19:54.834984] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:19:55.196728] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-09T18:19:55.996708] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-09T18:19:56.239508] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T18:19:56.243968] [INFO ] [REMOTE ] CX: Full fetch complete (76382 records). [2025-10-09T18:19:56.244086] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-09T18:19:56.663497] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-09T18:19:56.663677] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-09T18:19:56.664772] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-09T18:19:56.664858] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-09T18:19:56.675729] [DEBUG] [LOCAL ] CX: Trimmed 76382 records to 53201 (keeping 200 days of data) [2025-10-09T18:19:56.694017] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T18:19:56.796838] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-09T18:19:57.026930] [DEBUG] [LOCAL ] CX: Primary data saved (53201 records). [2025-10-09T18:19:57.027072] [INFO ] [MAIN ] CX: Full history saved. [2025-10-09T18:19:57.027560] [INFO ] [MAIN ] Update Progress: 578/2373 symbols completed. CX took 40.3s. Estimated remaining: 4h 8m 6s. Rate: 7.2 symbols/min [2025-10-09T18:19:57.196108] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:57.236980] [DEBUG] [LOCAL ] CXW: Loaded 43976 existing records from primary storage. [2025-10-09T18:19:57.237302] [INFO ] [MAIN ] CXW: Loaded 43976 existing records. [2025-10-09T18:19:57.440037] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:57.440531] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-09T18:19:57.441924] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T18:19:57.441070] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-09T18:19:57.449377] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-09T18:19:57.449438] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-09T18:19:57.602564] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-09T18:19:57.809675] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:58.098141] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T18:19:58.396737] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-09T18:19:58.784157] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T18:19:59.196719] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-09T18:19:59.758942] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T18:19:59.996729] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-09T18:20:00.104660] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T18:20:00.107343] [INFO ] [REMOTE ] CWT: Full fetch complete (40743 records). [2025-10-09T18:20:00.107417] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-09T18:20:00.502171] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-09T18:20:00.502262] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-09T18:20:00.502985] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-09T18:20:00.503049] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-09T18:20:00.504057] [DEBUG] [LOCAL ] CWT: Trimmed 40743 records to 28221 (keeping 200 days of data) [2025-10-09T18:20:00.694785] [DEBUG] [LOCAL ] CWT: Primary data saved (28221 records). [2025-10-09T18:20:00.694927] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-09T18:20:00.695005] [INFO ] [MAIN ] Update Progress: 579/2373 symbols completed. CWT took 45.3s. Estimated remaining: 4h 7m 44s. Rate: 7.2 symbols/min [2025-10-09T18:20:00.801863] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-09T18:20:00.862125] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:00.888363] [DEBUG] [LOCAL ] CYD: Loaded 26383 existing records from primary storage. [2025-10-09T18:20:00.888616] [INFO ] [MAIN ] CYD: Loaded 26383 existing records. [2025-10-09T18:20:01.063516] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:01.063728] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-09T18:20:01.063781] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-09T18:20:01.064030] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-09T18:20:01.064090] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-09T18:20:01.436876] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:01.469857] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T18:20:01.596758] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-09T18:20:02.409817] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-09T18:20:02.444109] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:20:02.459337] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T18:20:03.196760] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-09T18:20:03.863536] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:20:03.909716] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:20:03.996693] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-09T18:20:04.796801] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-09T18:20:05.205151] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:20:05.596768] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-09T18:20:05.920066] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T18:20:06.396724] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-09T18:20:06.976170] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T18:20:07.196756] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-09T18:20:07.996685] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-09T18:20:08.112272] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:20:08.513975] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:20:08.796718] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-09T18:20:09.596709] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-09T18:20:09.627420] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:20:10.064341] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T18:20:10.396802] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-09T18:20:10.963331] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T18:20:11.196751] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-09T18:20:12.002075] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-09T18:20:12.021736] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T18:20:12.675096] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T18:20:12.796669] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-09T18:20:13.596757] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-09T18:20:13.816406] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T18:20:14.396742] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-09T18:20:14.467617] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T18:20:14.975621] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T18:20:15.196717] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-09T18:20:15.745756] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T18:20:15.996779] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-09T18:20:16.796716] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-09T18:20:16.901341] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:20:17.139004] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T18:20:17.596735] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-09T18:20:18.379132] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T18:20:18.383154] [INFO ] [REMOTE ] CXM: Full fetch complete (68620 records). [2025-10-09T18:20:18.383270] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-09T18:20:18.404982] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-09T18:20:18.841639] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-09T18:20:18.841778] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-09T18:20:18.842579] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-09T18:20:18.842621] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-09T18:20:18.844001] [DEBUG] [LOCAL ] CXM: Trimmed 68620 records to 47926 (keeping 200 days of data) [2025-10-09T18:20:19.079580] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T18:20:19.155703] [DEBUG] [LOCAL ] CXM: Primary data saved (47926 records). [2025-10-09T18:20:19.155872] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-09T18:20:19.155980] [INFO ] [MAIN ] Update Progress: 580/2373 symbols completed. CXM took 38.2s. Estimated remaining: 4h 8m 7s. Rate: 7.2 symbols/min [2025-10-09T18:20:19.201802] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-09T18:20:19.340242] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:19.377360] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T18:20:19.399089] [DEBUG] [LOCAL ] CYH: Loaded 47641 existing records from primary storage. [2025-10-09T18:20:19.399376] [INFO ] [MAIN ] CYH: Loaded 47641 existing records. [2025-10-09T18:20:19.575685] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:19.575870] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-09T18:20:19.575916] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-09T18:20:19.576129] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-09T18:20:19.576186] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-09T18:20:19.938573] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:19.996676] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-09T18:20:20.704627] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:20:20.796712] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-09T18:20:21.322023] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T18:20:21.596737] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-09T18:20:22.396714] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-09T18:20:22.438396] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T18:20:22.587476] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T18:20:23.196743] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-09T18:20:23.607499] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T18:20:23.996726] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-09T18:20:24.782612] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T18:20:24.796675] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-09T18:20:25.519796] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T18:20:25.596675] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-09T18:20:26.239166] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T18:20:26.396689] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-09T18:20:26.840722] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:20:26.843082] [INFO ] [REMOTE ] CYD: Full fetch complete (33955 records). [2025-10-09T18:20:26.843164] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-09T18:20:26.843800] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:20:26.843880] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:20:26.843949] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:20:26.844019] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-09T18:20:26.844084] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-09T18:20:26.844122] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-09T18:20:26.844381] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-09T18:20:26.844475] [INFO ] [MAIN ] Update Progress: 581/2373 symbols completed. CYD took 26.1s. Estimated remaining: 4h 7m 57s. Rate: 7.2 symbols/min [2025-10-09T18:20:27.011814] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:27.061680] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-10-09T18:20:27.061992] [INFO ] [MAIN ] D: Loaded 53647 existing records. [2025-10-09T18:20:27.206406] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-09T18:20:27.246766] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:27.247090] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-09T18:20:27.247141] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-09T18:20:27.247363] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-09T18:20:27.247419] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-09T18:20:27.607463] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:27.944463] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T18:20:27.996675] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-09T18:20:28.295799] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T18:20:28.796706] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-09T18:20:29.596764] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-09T18:20:30.087840] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T18:20:30.118455] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T18:20:30.121554] [INFO ] [REMOTE ] CXT: Full fetch complete (45469 records). [2025-10-09T18:20:30.121637] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-09T18:20:30.401788] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-09T18:20:30.518271] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-09T18:20:30.518376] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-09T18:20:30.519144] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-09T18:20:30.519212] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-09T18:20:30.520345] [DEBUG] [LOCAL ] CXT: Trimmed 45469 records to 31255 (keeping 200 days of data) [2025-10-09T18:20:30.716380] [DEBUG] [LOCAL ] CXT: Primary data saved (31255 records). [2025-10-09T18:20:30.716519] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-09T18:20:30.716637] [INFO ] [MAIN ] Update Progress: 582/2373 symbols completed. CXT took 40.1s. Estimated remaining: 4h 7m 35s. Rate: 7.2 symbols/min [2025-10-09T18:20:30.892972] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:30.906722] [DEBUG] [LOCAL ] DAC: Loaded 12578 existing records from primary storage. [2025-10-09T18:20:30.906955] [INFO ] [MAIN ] DAC: Loaded 12578 existing records. [2025-10-09T18:20:31.093843] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:31.094268] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-09T18:20:31.094452] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-09T18:20:31.094824] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-09T18:20:31.094999] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-09T18:20:31.197934] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-09T18:20:31.375673] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T18:20:31.507764] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:31.996684] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-09T18:20:32.613291] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-09T18:20:32.798457] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-09T18:20:32.801008] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T18:20:33.197496] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T18:20:33.564282] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T18:20:33.596666] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-09T18:20:34.284747] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T18:20:34.396698] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-09T18:20:35.196725] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-09T18:20:35.582855] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:20:35.996764] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-09T18:20:36.796688] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-09T18:20:36.956760] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T18:20:37.366178] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T18:20:37.596755] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-09T18:20:37.647275] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T18:20:38.397259] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-09T18:20:38.789374] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:20:39.196733] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-09T18:20:39.996708] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-09T18:20:40.314240] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T18:20:40.512884] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T18:20:40.518035] [INFO ] [REMOTE ] CXW: Full fetch complete (64948 records). [2025-10-09T18:20:40.518186] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-09T18:20:40.801823] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-09T18:20:40.940984] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-09T18:20:40.941093] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-09T18:20:40.941951] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-09T18:20:40.942018] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-09T18:20:40.943325] [DEBUG] [LOCAL ] CXW: Trimmed 64948 records to 44278 (keeping 200 days of data) [2025-10-09T18:20:41.202759] [DEBUG] [LOCAL ] CXW: Primary data saved (44278 records). [2025-10-09T18:20:41.202899] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-09T18:20:41.203468] [INFO ] [MAIN ] Update Progress: 583/2373 symbols completed. CXW took 44.2s. Estimated remaining: 4h 7m 33s. Rate: 7.2 symbols/min [2025-10-09T18:20:41.380374] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:41.432483] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-09T18:20:41.432881] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-09T18:20:41.599730] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-09T18:20:41.621772] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:41.623321] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-09T18:20:41.623503] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-09T18:20:41.631534] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-09T18:20:41.631876] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-09T18:20:41.645910] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T18:20:41.768595] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T18:20:42.026823] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:42.396738] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-09T18:20:43.196738] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-09T18:20:43.666528] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T18:20:43.996680] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-09T18:20:44.796779] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-09T18:20:45.139038] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T18:20:45.596736] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-09T18:20:45.874896] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T18:20:45.930241] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T18:20:46.351843] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (3.96 seconds). [2025-10-09T18:20:46.396771] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-09T18:20:47.057895] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T18:20:47.196694] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-09T18:20:47.352013] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T18:20:47.996726] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-09T18:20:48.796720] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-09T18:20:49.475267] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T18:20:49.510770] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-09T18:20:49.596677] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-09T18:20:49.731243] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T18:20:50.396728] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-09T18:20:50.831308] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T18:20:51.196717] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-09T18:20:51.960623] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T18:20:51.996676] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-09T18:20:52.321364] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-09T18:20:52.796728] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-09T18:20:52.844578] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T18:20:52.846184] [INFO ] [REMOTE ] DAC: Full fetch complete (19360 records). [2025-10-09T18:20:52.846255] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-09T18:20:53.215909] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-09T18:20:53.215986] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-09T18:20:53.216370] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-09T18:20:53.216410] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-09T18:20:53.216981] [DEBUG] [LOCAL ] DAC: Trimmed 19360 records to 12658 (keeping 200 days of data) [2025-10-09T18:20:53.293452] [DEBUG] [LOCAL ] DAC: Primary data saved (12658 records). [2025-10-09T18:20:53.293585] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-09T18:20:53.293704] [INFO ] [MAIN ] Update Progress: 584/2373 symbols completed. DAC took 22.6s. Estimated remaining: 4h 7m 36s. Rate: 7.2 symbols/min [2025-10-09T18:20:53.461562] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:53.511949] [DEBUG] [LOCAL ] DAN: Loaded 49113 existing records from primary storage. [2025-10-09T18:20:53.512274] [INFO ] [MAIN ] DAN: Loaded 49113 existing records. [2025-10-09T18:20:53.601901] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-09T18:20:53.691409] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:53.691588] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-09T18:20:53.691636] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-09T18:20:53.692020] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-09T18:20:53.692076] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-09T18:20:54.051037] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:54.288859] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T18:20:54.396718] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-09T18:20:55.196811] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-09T18:20:55.806626] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-09T18:20:55.996778] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-09T18:20:56.125303] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:20:56.796698] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-09T18:20:56.838678] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T18:20:56.842781] [INFO ] [REMOTE ] CYH: Full fetch complete (69793 records). [2025-10-09T18:20:56.842897] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-09T18:20:57.232903] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-09T18:20:57.232980] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-09T18:20:57.233783] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-09T18:20:57.233845] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-09T18:20:57.235198] [DEBUG] [LOCAL ] CYH: Trimmed 69793 records to 47995 (keeping 200 days of data) [2025-10-09T18:20:57.498928] [DEBUG] [LOCAL ] CYH: Primary data saved (47995 records). [2025-10-09T18:20:57.499063] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-09T18:20:57.499142] [INFO ] [MAIN ] Update Progress: 585/2373 symbols completed. CYH took 38.3s. Estimated remaining: 4h 7m 16s. Rate: 7.2 symbols/min [2025-10-09T18:20:57.599105] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-09T18:20:57.675181] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:57.695073] [DEBUG] [LOCAL ] DAO: Loaded 20100 existing records from primary storage. [2025-10-09T18:20:57.695306] [INFO ] [MAIN ] DAO: Loaded 20100 existing records. [2025-10-09T18:20:57.874492] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:57.874715] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-09T18:20:57.874771] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-09T18:20:57.874982] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-09T18:20:57.875038] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-09T18:20:58.238330] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:58.367880] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:20:58.396672] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-09T18:20:59.171389] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T18:20:59.196687] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-09T18:20:59.996711] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-09T18:21:00.065140] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:21:00.089826] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (4.09 seconds). [2025-10-09T18:21:00.796688] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-09T18:21:01.140852] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T18:21:01.445511] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T18:21:01.596783] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-09T18:21:02.364061] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T18:21:02.396675] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-09T18:21:03.169629] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-09T18:21:03.196673] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-09T18:21:03.633889] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:21:03.996696] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-09T18:21:04.796801] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-09T18:21:05.445550] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-09T18:21:05.596691] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-09T18:21:05.651882] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:21:06.352280] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:21:06.357478] [INFO ] [REMOTE ] D: Full fetch complete (77657 records). [2025-10-09T18:21:06.357681] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-09T18:21:06.401826] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-09T18:21:06.790198] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-09T18:21:06.790352] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-09T18:21:06.791263] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-09T18:21:06.791327] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-09T18:21:06.792747] [DEBUG] [LOCAL ] D: Trimmed 77657 records to 54037 (keeping 200 days of data) [2025-10-09T18:21:07.124507] [DEBUG] [LOCAL ] D: Primary data saved (54037 records). [2025-10-09T18:21:07.124666] [INFO ] [MAIN ] D: Full history saved. [2025-10-09T18:21:07.124782] [INFO ] [MAIN ] Update Progress: 586/2373 symbols completed. D took 40.3s. Estimated remaining: 4h 7m 11s. Rate: 7.2 symbols/min [2025-10-09T18:21:07.201904] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-09T18:21:07.295952] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:07.345122] [DEBUG] [LOCAL ] DAR: Loaded 51876 existing records from primary storage. [2025-10-09T18:21:07.345439] [INFO ] [MAIN ] DAR: Loaded 51876 existing records. [2025-10-09T18:21:07.526430] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:21:07.526779] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-09T18:21:07.526850] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-09T18:21:07.527275] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-09T18:21:07.527385] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-09T18:21:07.864429] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-09T18:21:07.940966] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:07.960462] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T18:21:07.996666] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-09T18:21:08.796690] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-09T18:21:08.831163] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T18:21:09.001542] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:21:09.596725] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-09T18:21:10.261190] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T18:21:10.396714] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-09T18:21:11.196742] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-09T18:21:11.285207] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T18:21:11.725608] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-10-09T18:21:11.996750] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-09T18:21:12.801805] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-09T18:21:12.818546] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:21:13.070900] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T18:21:13.596714] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-09T18:21:14.255039] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-09T18:21:14.396714] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-09T18:21:14.725229] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:21:15.196733] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-09T18:21:15.996742] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-09T18:21:16.070432] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:21:16.796689] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-09T18:21:16.839491] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:21:17.596720] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-09T18:21:18.147382] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T18:21:18.188527] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-09T18:21:18.396686] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-09T18:21:18.681071] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:21:19.196715] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-09T18:21:19.996744] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-09T18:21:20.146235] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T18:21:20.292757] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:21:20.295231] [INFO ] [REMOTE ] DAO: Full fetch complete (32177 records). [2025-10-09T18:21:20.295342] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-09T18:21:20.704862] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-09T18:21:20.704968] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-09T18:21:20.705554] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-09T18:21:20.705619] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-09T18:21:20.706467] [DEBUG] [LOCAL ] DAO: Trimmed 32177 records to 20161 (keeping 200 days of data) [2025-10-09T18:21:20.796771] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-09T18:21:20.820342] [DEBUG] [LOCAL ] DAO: Primary data saved (20161 records). [2025-10-09T18:21:20.820462] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-09T18:21:20.820541] [INFO ] [MAIN ] Update Progress: 587/2373 symbols completed. DAO took 23.3s. Estimated remaining: 4h 7m 20s. Rate: 7.2 symbols/min [2025-10-09T18:21:21.000265] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:21.046977] [DEBUG] [LOCAL ] DAVA: Loaded 41417 existing records from primary storage. [2025-10-09T18:21:21.047298] [INFO ] [MAIN ] DAVA: Loaded 41417 existing records. [2025-10-09T18:21:21.254885] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:21:21.255112] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-09T18:21:21.255159] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-09T18:21:21.255787] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-09T18:21:21.255846] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-09T18:21:21.605436] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-09T18:21:21.611763] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:21.780014] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:21:22.396702] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-09T18:21:22.536726] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:21:23.196734] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-09T18:21:23.591501] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-09T18:21:23.597049] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-09T18:21:23.597239] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-09T18:21:24.018021] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-09T18:21:24.048682] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T18:21:24.046622] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-09T18:21:24.059588] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-09T18:21:24.060739] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-09T18:21:24.060826] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-09T18:21:24.062758] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54143 (keeping 200 days of data) [2025-10-09T18:21:24.371583] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T18:21:24.427145] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-10-09T18:21:24.427290] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-09T18:21:24.427924] [INFO ] [MAIN ] Update Progress: 588/2373 symbols completed. DAL took 43.2s. Estimated remaining: 4h 6m 57s. Rate: 7.2 symbols/min [2025-10-09T18:21:24.630352] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:24.630581] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-09T18:21:24.630669] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-09T18:21:24.630794] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-09T18:21:24.630838] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-09T18:21:24.630880] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-09T18:21:24.630913] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-09T18:21:24.801880] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-09T18:21:25.053844] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:25.596689] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-09T18:21:25.689991] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:21:25.761337] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T18:21:26.396779] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-09T18:21:26.718016] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:21:27.196718] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-09T18:21:27.996690] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-09T18:21:28.259740] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T18:21:28.655798] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T18:21:28.660206] [INFO ] [REMOTE ] DAN: Full fetch complete (70894 records). [2025-10-09T18:21:28.660348] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-09T18:21:28.807594] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-09T18:21:29.096063] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-09T18:21:29.096185] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-09T18:21:29.097335] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-09T18:21:29.097406] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-09T18:21:29.099076] [DEBUG] [LOCAL ] DAN: Trimmed 70894 records to 49495 (keeping 200 days of data) [2025-10-09T18:21:29.420373] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T18:21:29.443903] [DEBUG] [LOCAL ] DAN: Primary data saved (49495 records). [2025-10-09T18:21:29.444052] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-09T18:21:29.444932] [INFO ] [MAIN ] Update Progress: 589/2373 symbols completed. DAN took 36.2s. Estimated remaining: 4h 6m 39s. Rate: 7.2 symbols/min [2025-10-09T18:21:29.600518] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-09T18:21:29.626097] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:29.686466] [DEBUG] [LOCAL ] DB: Loaded 52514 existing records from primary storage. [2025-10-09T18:21:29.686880] [INFO ] [MAIN ] DB: Loaded 52514 existing records. [2025-10-09T18:21:29.888001] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:21:29.888282] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-09T18:21:29.888344] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-09T18:21:29.888590] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-09T18:21:29.888687] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-09T18:21:30.287047] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:30.396736] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-09T18:21:30.794749] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:21:31.196719] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-09T18:21:31.713522] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:21:31.740941] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-09T18:21:31.996713] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-09T18:21:32.796712] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-09T18:21:33.596746] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-09T18:21:33.946152] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-09T18:21:34.141332] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:21:34.396691] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-09T18:21:35.080242] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T18:21:35.196695] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-09T18:21:35.346807] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (3.35 seconds). [2025-10-09T18:21:35.996723] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-09T18:21:36.070054] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T18:21:36.328099] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T18:21:36.796767] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-09T18:21:37.596690] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-09T18:21:37.807256] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:21:38.024433] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T18:21:38.396733] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-09T18:21:38.813618] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T18:21:39.196720] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-09T18:21:39.996770] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-09T18:21:40.328691] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T18:21:40.804010] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-09T18:21:40.825995] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:21:41.248489] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T18:21:41.596849] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-09T18:21:42.396746] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-09T18:21:42.547702] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:21:43.196698] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-09T18:21:43.322723] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:21:43.398912] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T18:21:43.996788] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-09T18:21:44.796763] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-09T18:21:45.122679] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T18:21:45.487531] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T18:21:45.596680] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-09T18:21:46.396695] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-09T18:21:46.677751] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T18:21:47.131930] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T18:21:47.196754] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-09T18:21:47.687528] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T18:21:47.996761] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-09T18:21:48.796807] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-09T18:21:48.969560] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T18:21:49.596761] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-09T18:21:49.745399] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:21:49.749824] [INFO ] [REMOTE ] DAVA: Full fetch complete (56507 records). [2025-10-09T18:21:49.749972] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-09T18:21:50.138383] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-09T18:21:50.138473] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-09T18:21:50.139210] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-09T18:21:50.139277] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-09T18:21:50.140569] [DEBUG] [LOCAL ] DAVA: Trimmed 56507 records to 41762 (keeping 200 days of data) [2025-10-09T18:21:50.392225] [DEBUG] [LOCAL ] DAVA: Primary data saved (41762 records). [2025-10-09T18:21:50.392357] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-09T18:21:50.392435] [INFO ] [MAIN ] Update Progress: 590/2373 symbols completed. DAVA took 29.6s. Estimated remaining: 4h 7m 9s. Rate: 7.2 symbols/min [2025-10-09T18:21:50.423899] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-09T18:21:50.564127] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:50.564332] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-09T18:21:50.564390] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-09T18:21:50.564535] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-09T18:21:50.564578] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-09T18:21:50.564622] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-09T18:21:50.564694] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-09T18:21:50.954603] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:50.977691] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T18:21:51.183208] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T18:21:51.189453] [INFO ] [REMOTE ] DAR: Full fetch complete (74631 records). [2025-10-09T18:21:51.189673] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-09T18:21:51.202492] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-09T18:21:51.589718] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-09T18:21:51.589899] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-09T18:21:51.590890] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-09T18:21:51.590974] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-09T18:21:51.592737] [DEBUG] [LOCAL ] DAR: Trimmed 74631 records to 52249 (keeping 200 days of data) [2025-10-09T18:21:51.797194] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T18:21:51.937272] [DEBUG] [LOCAL ] DAR: Primary data saved (52249 records). [2025-10-09T18:21:51.937420] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-09T18:21:51.937507] [INFO ] [MAIN ] Update Progress: 591/2373 symbols completed. DAR took 44.8s. Estimated remaining: 4h 6m 40s. Rate: 7.2 symbols/min [2025-10-09T18:21:52.001815] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-09T18:21:52.106187] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:52.146785] [DEBUG] [LOCAL ] DBI: Loaded 44280 existing records from primary storage. [2025-10-09T18:21:52.147081] [INFO ] [MAIN ] DBI: Loaded 44280 existing records. [2025-10-09T18:21:52.324811] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:21:52.325087] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-09T18:21:52.325165] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-09T18:21:52.325713] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-09T18:21:52.325798] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-09T18:21:52.698863] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:52.796679] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-09T18:21:52.939690] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:21:53.312537] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T18:21:53.596745] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-09T18:21:54.405138] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-09T18:21:54.410228] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T18:21:55.196769] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-09T18:21:55.333549] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:21:55.996706] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-09T18:21:56.796737] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-09T18:21:56.925728] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:21:57.132921] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-09T18:21:57.397315] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:21:57.596735] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-09T18:21:58.396710] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-09T18:21:58.719021] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-09T18:21:58.857212] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T18:21:59.196703] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-09T18:21:59.996706] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-09T18:22:00.262148] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T18:22:00.266602] [INFO ] [REMOTE ] DB: Full fetch complete (74827 records). [2025-10-09T18:22:00.266766] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-09T18:22:00.682129] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-09T18:22:00.682267] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-09T18:22:00.684473] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-09T18:22:00.683395] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T18:22:00.687750] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-09T18:22:00.690393] [DEBUG] [LOCAL ] DB: Trimmed 74827 records to 52889 (keeping 200 days of data) [2025-10-09T18:22:00.796926] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-09T18:22:01.024136] [DEBUG] [LOCAL ] DB: Primary data saved (52889 records). [2025-10-09T18:22:01.024280] [INFO ] [MAIN ] DB: Full history saved. [2025-10-09T18:22:01.025320] [INFO ] [MAIN ] Update Progress: 592/2373 symbols completed. DB took 31.6s. Estimated remaining: 4h 6m 34s. Rate: 7.2 symbols/min [2025-10-09T18:22:01.221489] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T18:22:01.220184] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:01.231176] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-09T18:22:01.231441] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-09T18:22:01.231678] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-09T18:22:01.231733] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-09T18:22:01.231781] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-09T18:22:01.231814] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-09T18:22:01.581116] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:01.596752] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-09T18:22:02.396688] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-09T18:22:02.469202] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T18:22:02.472947] [INFO ] [REMOTE ] DAY: Full fetch complete (71477 records). [2025-10-09T18:22:02.473051] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-09T18:22:02.882465] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-09T18:22:02.882553] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-09T18:22:02.883408] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-09T18:22:02.883474] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-09T18:22:02.884933] [DEBUG] [LOCAL ] DAY: Trimmed 71477 records to 49556 (keeping 200 days of data) [2025-10-09T18:22:03.185670] [DEBUG] [LOCAL ] DAY: Primary data saved (49556 records). [2025-10-09T18:22:03.185835] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-09T18:22:03.185982] [INFO ] [MAIN ] Update Progress: 593/2373 symbols completed. DAY took 38.8s. Estimated remaining: 4h 6m 7s. Rate: 7.2 symbols/min [2025-10-09T18:22:03.217700] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-09T18:22:03.367194] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:03.397726] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:22:03.418093] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T18:22:03.465028] [DEBUG] [LOCAL ] DBRG: Loaded 49813 existing records from primary storage. [2025-10-09T18:22:03.465369] [INFO ] [MAIN ] DBRG: Loaded 49813 existing records. [2025-10-09T18:22:03.637439] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:22:03.637683] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-09T18:22:03.637755] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-09T18:22:03.639190] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-09T18:22:03.639252] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-09T18:22:03.995770] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:03.996671] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-09T18:22:04.011602] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T18:22:04.796708] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-09T18:22:05.501849] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T18:22:05.591119] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T18:22:05.604134] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-09T18:22:06.315811] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T18:22:06.396751] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-09T18:22:07.120454] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T18:22:07.196772] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-09T18:22:07.996730] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-09T18:22:08.091305] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:22:08.670971] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T18:22:08.796735] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-09T18:22:09.290049] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T18:22:09.596727] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-09T18:22:10.396750] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-09T18:22:10.684239] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:22:11.196741] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-09T18:22:11.930478] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T18:22:11.945951] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T18:22:11.996696] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-09T18:22:12.594845] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T18:22:12.796733] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-09T18:22:13.596695] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-09T18:22:14.396741] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-09T18:22:14.546091] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:22:14.919079] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:22:15.196754] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-09T18:22:15.390843] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T18:22:15.996769] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-09T18:22:16.541304] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:22:16.796779] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-09T18:22:16.919181] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T18:22:17.596761] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-09T18:22:18.396701] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-09T18:22:18.452706] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:22:19.196762] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-09T18:22:19.218012] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T18:22:19.578316] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T18:22:19.996699] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-09T18:22:20.796841] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-09T18:22:20.888827] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T18:22:21.520903] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:22:21.578797] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T18:22:21.596672] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-09T18:22:22.396717] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-09T18:22:22.814093] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:22:23.196682] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-09T18:22:23.525015] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:22:23.715905] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T18:22:23.996738] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-09T18:22:24.796714] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-09T18:22:25.596681] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-09T18:22:25.776048] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T18:22:26.226864] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:22:26.228194] [INFO ] [REMOTE ] DBL: Full fetch complete (12461 records). [2025-10-09T18:22:26.228277] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-09T18:22:26.228825] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:22:26.228953] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:22:26.229011] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:22:26.229087] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-09T18:22:26.229158] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-09T18:22:26.229213] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-09T18:22:26.229302] [DEBUG] [LOCAL ] DBL: No derivative data file found to delete. [2025-10-09T18:22:26.229394] [INFO ] [MAIN ] Update Progress: 594/2373 symbols completed. DBL took 25.2s. Estimated remaining: 4h 6m 43s. Rate: 7.2 symbols/min [2025-10-09T18:22:26.401490] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-09T18:22:26.429451] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:26.431553] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T18:22:26.436139] [INFO ] [REMOTE ] DBI: Full fetch complete (65470 records). [2025-10-09T18:22:26.436281] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-09T18:22:26.743556] [DEBUG] [LOCAL ] DCI: Loaded 37056 existing records from primary storage. [2025-10-09T18:22:26.760751] [INFO ] [MAIN ] DCI: Loaded 37056 existing records. [2025-10-09T18:22:27.068683] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-09T18:22:27.069961] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-09T18:22:27.071420] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-09T18:22:27.078068] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-09T18:22:27.091064] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:22:27.091372] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-09T18:22:27.091440] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-09T18:22:27.091834] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-09T18:22:27.091900] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-09T18:22:27.091978] [DEBUG] [LOCAL ] DBI: Trimmed 65470 records to 44574 (keeping 200 days of data) [2025-10-09T18:22:27.229801] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-09T18:22:27.580395] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:27.758578] [DEBUG] [LOCAL ] DBI: Primary data saved (44574 records). [2025-10-09T18:22:27.759238] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-09T18:22:27.760206] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:22:27.760310] [INFO ] [MAIN ] Update Progress: 595/2373 symbols completed. DBI took 35.8s. Estimated remaining: 4h 6m 14s. Rate: 7.2 symbols/min [2025-10-09T18:22:27.941519] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:27.941747] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-09T18:22:27.941793] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-09T18:22:27.941912] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-09T18:22:27.941953] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-09T18:22:27.941994] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-09T18:22:27.942025] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-09T18:22:28.002471] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-09T18:22:28.279993] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T18:22:28.324897] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:28.796712] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-09T18:22:29.596677] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-09T18:22:29.615798] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T18:22:29.733322] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:22:30.328506] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T18:22:30.330629] [INFO ] [REMOTE ] DBD: Full fetch complete (31021 records). [2025-10-09T18:22:30.330856] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-09T18:22:30.331382] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:22:30.331468] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:22:30.331520] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:22:30.331600] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-09T18:22:30.331759] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-09T18:22:30.331825] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-09T18:22:30.331902] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-09T18:22:30.331998] [INFO ] [MAIN ] Update Progress: 596/2373 symbols completed. DBD took 39.9s. Estimated remaining: 4h 5m 49s. Rate: 7.2 symbols/min [2025-10-09T18:22:30.401902] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-09T18:22:30.507514] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:30.555578] [DEBUG] [LOCAL ] DD: Loaded 52853 existing records from primary storage. [2025-10-09T18:22:30.555911] [INFO ] [MAIN ] DD: Loaded 52853 existing records. [2025-10-09T18:22:30.729198] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:22:30.729385] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-09T18:22:30.729431] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-09T18:22:30.730719] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-09T18:22:30.730781] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-09T18:22:31.075258] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:31.196732] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-09T18:22:31.996743] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-09T18:22:32.319055] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:22:32.577449] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T18:22:32.796691] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-09T18:22:32.886405] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T18:22:33.596713] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-09T18:22:34.396694] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-09T18:22:34.649048] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T18:22:35.197741] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-09T18:22:35.200549] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:22:35.307589] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:22:35.996756] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-09T18:22:36.608898] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T18:22:36.796687] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-09T18:22:36.888772] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:22:37.596770] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-09T18:22:38.364505] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:22:38.396680] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-09T18:22:39.196696] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-09T18:22:39.212906] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T18:22:39.217017] [INFO ] [REMOTE ] DBRG: Full fetch complete (72312 records). [2025-10-09T18:22:39.217118] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-09T18:22:39.653037] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-09T18:22:39.653130] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-09T18:22:39.654696] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-09T18:22:39.654794] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-09T18:22:39.656208] [DEBUG] [LOCAL ] DBRG: Trimmed 72312 records to 50140 (keeping 200 days of data) [2025-10-09T18:22:39.987234] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T18:22:39.998493] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-09T18:22:40.015340] [DEBUG] [LOCAL ] DBRG: Primary data saved (50140 records). [2025-10-09T18:22:40.015459] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-09T18:22:40.016049] [INFO ] [MAIN ] Update Progress: 597/2373 symbols completed. DBRG took 36.8s. Estimated remaining: 4h 5m 45s. Rate: 7.2 symbols/min [2025-10-09T18:22:40.377813] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:22:40.796805] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-09T18:22:40.894683] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T18:22:41.596793] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-09T18:22:42.156636] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T18:22:42.396726] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-09T18:22:42.407964] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T18:22:43.196775] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-09T18:22:43.996705] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-09T18:22:44.134195] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:22:44.640336] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:22:44.796701] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-09T18:22:44.959678] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:22:45.596757] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-09T18:22:46.396702] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-09T18:22:46.669744] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:22:46.753570] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T18:22:47.196682] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-09T18:22:47.294286] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T18:22:47.996782] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-09T18:22:48.619961] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T18:22:48.796716] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-09T18:22:49.001734] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T18:22:49.596790] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-09T18:22:49.998290] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T18:22:50.328418] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T18:22:50.396683] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-09T18:22:51.196799] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-09T18:22:51.241045] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T18:22:51.242509] [INFO ] [REMOTE ] DCO: Full fetch complete (19006 records). [2025-10-09T18:22:51.242580] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-09T18:22:51.615127] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-09T18:22:51.615243] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-09T18:22:51.615749] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-09T18:22:51.615814] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-09T18:22:51.616484] [DEBUG] [LOCAL ] DCO: Trimmed 19006 records to 14031 (keeping 200 days of data) [2025-10-09T18:22:51.701064] [DEBUG] [LOCAL ] DCO: Primary data saved (14031 records). [2025-10-09T18:22:51.701220] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-09T18:22:51.701339] [INFO ] [MAIN ] Update Progress: 598/2373 symbols completed. DCO took 23.9s. Estimated remaining: 4h 5m 47s. Rate: 7.2 symbols/min [2025-10-09T18:22:51.996774] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-09T18:23:07.254989] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (16.06 seconds). [2025-10-09T18:23:07.263258] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-09T18:23:07.591911] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (15.60 seconds). [2025-10-09T18:23:07.603532] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-09T18:23:08.411949] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T18:23:08.420066] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-09T18:23:09.526377] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T18:23:09.539094] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-09T18:23:09.647152] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T18:23:09.656117] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-09T18:23:11.083559] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T18:23:11.092490] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-09T18:23:11.181827] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T18:23:11.193157] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-09T18:23:12.401186] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:23:12.405365] [INFO ] [REMOTE ] DCI: Full fetch complete (53639 records). [2025-10-09T18:23:12.405503] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-09T18:23:12.797513] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-09T18:23:12.797593] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-09T18:23:12.798316] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-09T18:23:12.798381] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-09T18:23:12.799461] [DEBUG] [LOCAL ] DCI: Trimmed 53639 records to 37295 (keeping 200 days of data) [2025-10-09T18:23:13.025528] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T18:23:13.032759] [INFO ] [REMOTE ] DD: Full fetch complete (76369 records). [2025-10-09T18:23:13.033756] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-09T18:23:13.170499] [DEBUG] [LOCAL ] DCI: Primary data saved (37295 records). [2025-10-09T18:23:13.199012] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-09T18:23:13.229416] [INFO ] [MAIN ] Update Progress: 599/2373 symbols completed. DCI took 47.0s. Estimated remaining: 4h 6m 17s. Rate: 7.2 symbols/min [2025-10-09T18:23:13.441377] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-09T18:23:13.441458] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-09T18:23:13.442353] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-09T18:23:13.442417] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-09T18:23:13.443892] [DEBUG] [LOCAL ] DD: Trimmed 76369 records to 53236 (keeping 200 days of data) [2025-10-09T18:23:13.769202] [DEBUG] [LOCAL ] DD: Primary data saved (53236 records). [2025-10-09T18:23:13.769342] [INFO ] [MAIN ] DD: Full history saved. [2025-10-09T18:23:13.769458] [INFO ] [MAIN ] Update Progress: 600/2373 symbols completed. DD took 43.4s. Estimated remaining: 4h 5m 46s. Rate: 7.2 symbols/min [2025-10-09T18:23:14.340208] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:14.428821] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:14.505834] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:14.502424] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:14.506549] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-10-09T18:23:14.506605] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-10-09T18:23:14.506756] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-09T18:23:14.506829] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-09T18:23:14.506898] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-09T18:23:14.506933] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-09T18:23:14.552705] [DEBUG] [LOCAL ] DDT: Loaded 2086 existing records from primary storage. [2025-10-09T18:23:14.559982] [INFO ] [MAIN ] DDT: Loaded 2086 existing records. [2025-10-09T18:23:14.756265] [DEBUG] [LOCAL ] DDS: Loaded 12832 existing records from primary storage. [2025-10-09T18:23:14.813490] [INFO ] [MAIN ] DDS: Loaded 12832 existing records. [2025-10-09T18:23:14.848686] [DEBUG] [LOCAL ] DDL: Loaded 36794 existing records from primary storage. [2025-10-09T18:23:14.958288] [INFO ] [MAIN ] DDL: Loaded 36794 existing records. [2025-10-09T18:23:15.004297] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:15.076230] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-09T18:23:15.125997] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-09T18:23:15.190301] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-09T18:23:15.190711] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-09T18:23:15.525213] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:15.544143] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:15.614330] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:15.591329] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-09T18:23:15.614707] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-09T18:23:15.630454] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-09T18:23:15.630213] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-09T18:23:15.630582] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-09T18:23:15.642869] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-09T18:23:15.643182] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-09T18:23:15.658772] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-09T18:23:15.707556] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-09T18:23:16.523894] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:16.574258] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-09T18:23:16.731868] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:16.754934] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-09T18:23:16.761368] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:16.761828] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-09T18:23:17.040145] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-09T18:23:17.041419] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-09T18:23:17.558589] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-09T18:23:17.570399] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-09T18:23:17.688016] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:23:17.689396] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-09T18:23:17.932691] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:23:17.936390] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-09T18:23:17.991581] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-09T18:23:17.992859] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-09T18:23:18.099068] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T18:23:18.108032] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-09T18:23:18.508771] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T18:23:18.512604] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-09T18:23:18.790219] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T18:23:18.791381] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-09T18:23:19.033887] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:23:19.043948] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-09T18:23:19.132764] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T18:23:19.136106] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-09T18:23:19.422299] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T18:23:19.424218] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-09T18:23:19.571623] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:23:19.578708] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-09T18:23:19.787256] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T18:23:19.788407] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-09T18:23:20.131970] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T18:23:20.133438] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-09T18:23:20.144059] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:23:20.147920] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-09T18:23:20.483064] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-09T18:23:20.485194] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-09T18:23:20.514835] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T18:23:20.525074] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-09T18:23:20.657553] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:23:20.665356] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-09T18:23:20.792484] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-09T18:23:20.794066] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-09T18:23:21.140757] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T18:23:21.141875] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-09T18:23:21.256517] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T18:23:21.260337] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-09T18:23:21.629819] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T18:23:21.630514] [INFO ] [REMOTE ] DDT: Full fetch complete (2843 records). [2025-10-09T18:23:21.630584] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-09T18:23:21.989625] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-09T18:23:21.989779] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-09T18:23:21.989910] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-09T18:23:21.989987] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-09T18:23:22.003020] [DEBUG] [LOCAL ] DDT: Trimmed 2843 records to 2096 (keeping 200 days of data) [2025-10-09T18:23:22.011996] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T18:23:22.030052] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-09T18:23:22.034625] [DEBUG] [LOCAL ] DDT: Primary data saved (2096 records). [2025-10-09T18:23:22.034732] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-09T18:23:22.034825] [INFO ] [MAIN ] Update Progress: 601/2373 symbols completed. DDT took 8.3s. Estimated remaining: 4h 5m 38s. Rate: 7.2 symbols/min [2025-10-09T18:23:22.213248] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:22.225738] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:23:22.230399] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-09T18:23:22.271452] [DEBUG] [LOCAL ] DE: Loaded 47554 existing records from primary storage. [2025-10-09T18:23:22.271789] [INFO ] [MAIN ] DE: Loaded 47554 existing records. [2025-10-09T18:23:22.461023] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T18:23:22.495526] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:22.496146] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-09T18:23:22.497139] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-09T18:23:22.497206] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-09T18:23:22.497454] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-09T18:23:22.497511] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-09T18:23:22.854612] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:22.854957] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-09T18:23:23.177601] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T18:23:23.181396] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-09T18:23:23.418921] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T18:23:23.429393] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-09T18:23:23.954636] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T18:23:23.959902] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-09T18:23:24.264757] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:23:24.281945] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-09T18:23:24.344934] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T18:23:24.750175] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T18:23:24.796667] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-09T18:23:24.926716] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T18:23:25.479169] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T18:23:25.596732] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-09T18:23:26.259000] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T18:23:26.396732] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-09T18:23:27.196722] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-09T18:23:27.996720] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-09T18:23:28.428545] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-10-09T18:23:28.514097] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:23:28.562174] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-09T18:23:28.796734] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-09T18:23:29.054509] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T18:23:29.055775] [INFO ] [REMOTE ] DDS: Full fetch complete (18807 records). [2025-10-09T18:23:29.055852] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-09T18:23:29.443626] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-09T18:23:29.443737] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-09T18:23:29.444125] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-09T18:23:29.444164] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-09T18:23:29.444704] [DEBUG] [LOCAL ] DDS: Trimmed 18807 records to 12885 (keeping 200 days of data) [2025-10-09T18:23:29.530356] [DEBUG] [LOCAL ] DDS: Primary data saved (12885 records). [2025-10-09T18:23:29.530494] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-09T18:23:29.530577] [INFO ] [MAIN ] Update Progress: 602/2373 symbols completed. DDS took 15.8s. Estimated remaining: 4h 5m 27s. Rate: 7.2 symbols/min [2025-10-09T18:23:29.604299] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-09T18:23:29.705992] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:29.729827] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T18:23:29.767284] [DEBUG] [LOCAL ] DEA: Loaded 40555 existing records from primary storage. [2025-10-09T18:23:29.767562] [INFO ] [MAIN ] DEA: Loaded 40555 existing records. [2025-10-09T18:23:29.948288] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:29.948514] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-09T18:23:29.948564] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-09T18:23:29.948825] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-09T18:23:29.948892] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-09T18:23:30.325026] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:30.396732] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-09T18:23:31.196686] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-09T18:23:31.280280] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T18:23:31.663315] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T18:23:31.996685] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-09T18:23:32.796790] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-09T18:23:33.106154] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T18:23:33.251848] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T18:23:33.596773] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-09T18:23:34.286822] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:23:34.396745] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-09T18:23:35.156856] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:23:35.160538] [INFO ] [REMOTE ] DDL: Full fetch complete (53163 records). [2025-10-09T18:23:35.160627] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-09T18:23:35.204167] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-09T18:23:35.546069] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-09T18:23:35.546153] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-09T18:23:35.546891] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-09T18:23:35.546955] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-09T18:23:35.548121] [DEBUG] [LOCAL ] DDL: Trimmed 53163 records to 37060 (keeping 200 days of data) [2025-10-09T18:23:35.757106] [DEBUG] [LOCAL ] DDL: Primary data saved (37060 records). [2025-10-09T18:23:35.757253] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-09T18:23:35.757362] [INFO ] [MAIN ] Update Progress: 603/2373 symbols completed. DDL took 22.0s. Estimated remaining: 4h 5m 12s. Rate: 7.2 symbols/min [2025-10-09T18:23:35.929109] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:35.960202] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:23:35.995700] [DEBUG] [LOCAL ] DEC: Loaded 30453 existing records from primary storage. [2025-10-09T18:23:35.995964] [INFO ] [MAIN ] DEC: Loaded 30453 existing records. [2025-10-09T18:23:36.006990] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-09T18:23:36.177121] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:36.177341] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-09T18:23:36.177389] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-09T18:23:36.177611] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-09T18:23:36.177697] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-09T18:23:36.539947] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:36.796687] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-09T18:23:36.855766] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:23:37.596720] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-09T18:23:38.028348] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-09T18:23:38.171775] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:23:38.396792] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-09T18:23:39.196686] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-09T18:23:39.464541] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T18:23:39.831228] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T18:23:39.996732] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-09T18:23:40.372783] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:23:40.796759] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-09T18:23:41.596698] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-09T18:23:41.775035] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T18:23:42.396682] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-09T18:23:42.427967] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T18:23:42.433900] [INFO ] [REMOTE ] DDD: Full fetch complete (73740 records). [2025-10-09T18:23:42.434067] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-09T18:23:42.598739] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:23:42.848066] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-09T18:23:42.848142] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-09T18:23:42.849025] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-09T18:23:42.849099] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-09T18:23:42.850423] [DEBUG] [LOCAL ] DDD: Trimmed 73740 records to 51305 (keeping 200 days of data) [2025-10-09T18:23:43.140920] [DEBUG] [LOCAL ] DDD: Primary data saved (51305 records). [2025-10-09T18:23:43.141054] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-09T18:23:43.141130] [INFO ] [MAIN ] Update Progress: 604/2373 symbols completed. DDD took 29.4s. Estimated remaining: 4h 5m 1s. Rate: 7.2 symbols/min [2025-10-09T18:23:43.203625] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-09T18:23:43.316388] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:43.367208] [DEBUG] [LOCAL ] DECK: Loaded 53291 existing records from primary storage. [2025-10-09T18:23:43.367525] [INFO ] [MAIN ] DECK: Loaded 53291 existing records. [2025-10-09T18:23:43.545600] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:43.546038] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-09T18:23:43.546100] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-09T18:23:43.546465] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-09T18:23:43.546525] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-09T18:23:43.911200] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:43.927446] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T18:23:43.996671] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-09T18:23:44.714327] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T18:23:44.796714] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-09T18:23:45.596716] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-09T18:23:45.917451] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T18:23:46.396743] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-09T18:23:46.564777] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:23:46.604385] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T18:23:47.196749] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-09T18:23:47.996796] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-09T18:23:48.247279] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T18:23:48.800324] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-09T18:23:48.802710] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T18:23:49.521409] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:23:49.596800] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-09T18:23:50.396779] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-09T18:23:50.626261] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T18:23:50.997849] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T18:23:51.196766] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-09T18:23:51.780365] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:23:51.996753] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-09T18:23:52.514015] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:23:52.796722] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-09T18:23:53.564738] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T18:23:53.596673] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-09T18:23:53.759331] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:23:54.396715] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-09T18:23:55.196729] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-09T18:23:55.275584] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:23:55.280226] [INFO ] [REMOTE ] DE: Full fetch complete (69462 records). [2025-10-09T18:23:55.280384] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-09T18:23:55.679792] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-09T18:23:55.679878] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-09T18:23:55.680794] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-09T18:23:55.680860] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-09T18:23:55.682218] [DEBUG] [LOCAL ] DE: Trimmed 69462 records to 47889 (keeping 200 days of data) [2025-10-09T18:23:55.937229] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T18:23:56.003026] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-09T18:23:56.033818] [DEBUG] [LOCAL ] DE: Primary data saved (47889 records). [2025-10-09T18:23:56.033929] [INFO ] [MAIN ] DE: Full history saved. [2025-10-09T18:23:56.034009] [INFO ] [MAIN ] Update Progress: 605/2373 symbols completed. DE took 34.0s. Estimated remaining: 4h 5m 6s. Rate: 7.2 symbols/min [2025-10-09T18:23:56.209020] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:56.209176] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-10-09T18:23:56.209212] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-10-09T18:23:56.209394] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-09T18:23:56.209472] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-09T18:23:56.209536] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-09T18:23:56.209571] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-09T18:23:56.567992] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:56.796724] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-09T18:23:56.928188] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T18:23:57.166775] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-09T18:23:57.596729] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-09T18:23:58.299399] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T18:23:58.396739] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-09T18:23:59.196691] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-09T18:23:59.295566] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T18:23:59.996770] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-09T18:24:00.491608] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T18:24:00.796689] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-09T18:24:01.096718] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T18:24:01.596711] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-09T18:24:01.722792] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:24:02.044883] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:24:02.396701] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-09T18:24:02.929128] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T18:24:03.196730] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-09T18:24:03.525450] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:24:03.996730] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-09T18:24:04.505729] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T18:24:04.796721] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-09T18:24:05.279550] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T18:24:05.596726] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-09T18:24:06.396763] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-09T18:24:06.645693] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T18:24:06.729386] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:24:06.732675] [INFO ] [REMOTE ] DEA: Full fetch complete (61871 records). [2025-10-09T18:24:06.732780] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-09T18:24:06.734259] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:06.734350] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:06.734393] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:06.734461] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-09T18:24:06.734525] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-09T18:24:06.734560] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-09T18:24:06.735013] [DEBUG] [LOCAL ] DEA: Deleted derivative data file. [2025-10-09T18:24:06.735951] [INFO ] [MAIN ] Update Progress: 606/2373 symbols completed. DEA took 37.2s. Estimated remaining: 4h 5m 5s. Rate: 7.2 symbols/min [2025-10-09T18:24:06.903620] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:06.957966] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-09T18:24:06.958324] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-09T18:24:07.132895] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:07.133111] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-09T18:24:07.133156] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-09T18:24:07.134493] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-09T18:24:07.134551] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-09T18:24:07.201932] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-09T18:24:07.493686] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:07.630514] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T18:24:07.996744] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-09T18:24:08.518399] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T18:24:08.521677] [INFO ] [REMOTE ] DEC: Full fetch complete (43834 records). [2025-10-09T18:24:08.521781] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-09T18:24:08.806210] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-09T18:24:08.898854] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-09T18:24:08.898931] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-09T18:24:08.899636] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-09T18:24:08.899721] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-09T18:24:08.900633] [DEBUG] [LOCAL ] DEC: Trimmed 43834 records to 30645 (keeping 200 days of data) [2025-10-09T18:24:09.087460] [DEBUG] [LOCAL ] DEC: Primary data saved (30645 records). [2025-10-09T18:24:09.087610] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-09T18:24:09.087730] [INFO ] [MAIN ] Update Progress: 607/2373 symbols completed. DEC took 33.3s. Estimated remaining: 4h 4m 39s. Rate: 7.2 symbols/min [2025-10-09T18:24:09.258456] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:09.258661] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-09T18:24:09.258719] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-09T18:24:09.258830] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-09T18:24:09.258871] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-09T18:24:09.258912] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-09T18:24:09.258944] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-09T18:24:09.612199] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-09T18:24:09.617738] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:09.649030] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T18:24:10.396737] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-09T18:24:10.683404] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T18:24:11.196772] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-09T18:24:11.996751] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-09T18:24:12.109079] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T18:24:12.189330] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-09T18:24:12.796742] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-09T18:24:13.075408] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T18:24:13.547882] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:24:13.596689] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-09T18:24:14.364062] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T18:24:14.396696] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-09T18:24:15.203335] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-09T18:24:15.206576] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T18:24:15.854220] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:24:15.996712] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-09T18:24:16.796791] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-09T18:24:17.333616] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-09T18:24:17.543425] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T18:24:17.596700] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-09T18:24:18.306614] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T18:24:18.396682] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-09T18:24:19.196714] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-09T18:24:19.873797] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-09T18:24:19.996679] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-09T18:24:20.059757] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:24:20.796711] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-09T18:24:21.096235] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T18:24:21.596719] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-09T18:24:22.054455] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T18:24:22.257357] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T18:24:22.396683] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-09T18:24:23.196731] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-09T18:24:23.569636] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-09T18:24:23.573605] [INFO ] [REMOTE ] DECK: Full fetch complete (76405 records). [2025-10-09T18:24:23.573760] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-09T18:24:23.574605] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:23.574715] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:23.574783] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:23.574861] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-09T18:24:23.574943] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-09T18:24:23.575001] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-10-09T18:24:23.575199] [DEBUG] [LOCAL ] DECK: Deleted derivative data file. [2025-10-09T18:24:23.575867] [INFO ] [MAIN ] Update Progress: 608/2373 symbols completed. DECK took 40.4s. Estimated remaining: 4h 4m 49s. Rate: 7.2 symbols/min [2025-10-09T18:24:23.742738] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:23.776717] [DEBUG] [LOCAL ] DFH: Loaded 32083 existing records from primary storage. [2025-10-09T18:24:23.777063] [INFO ] [MAIN ] DFH: Loaded 32083 existing records. [2025-10-09T18:24:23.965512] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:23.965810] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-09T18:24:23.965889] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-09T18:24:23.966734] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-09T18:24:23.966795] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-09T18:24:23.997889] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-09T18:24:24.289174] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T18:24:24.377533] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:24.796744] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-09T18:24:25.289022] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T18:24:25.569048] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T18:24:25.573058] [INFO ] [REMOTE ] DEI: Full fetch complete (69384 records). [2025-10-09T18:24:25.573159] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-09T18:24:25.575638] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:25.575756] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:25.575800] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:25.575847] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-09T18:24:25.575948] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-09T18:24:25.575999] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-10-09T18:24:25.576055] [DEBUG] [LOCAL ] DEI: No derivative data file found to delete. [2025-10-09T18:24:25.576131] [INFO ] [MAIN ] Update Progress: 609/2373 symbols completed. DEI took 29.5s. Estimated remaining: 4h 4m 22s. Rate: 7.2 symbols/min [2025-10-09T18:24:25.605842] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-09T18:24:25.754025] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:25.775353] [DEBUG] [LOCAL ] DFIN: Loaded 22871 existing records from primary storage. [2025-10-09T18:24:25.775597] [INFO ] [MAIN ] DFIN: Loaded 22871 existing records. [2025-10-09T18:24:25.955044] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:25.955298] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-09T18:24:25.955371] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-09T18:24:25.956014] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-09T18:24:25.956074] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-09T18:24:26.284311] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T18:24:26.344432] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:26.396665] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-09T18:24:27.196762] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-09T18:24:27.446340] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T18:24:27.633949] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:24:27.996745] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-09T18:24:28.540192] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T18:24:28.796734] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-09T18:24:28.861466] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:24:29.596723] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-09T18:24:30.396738] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-09T18:24:30.817946] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T18:24:31.196709] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-09T18:24:31.291023] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T18:24:31.390337] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T18:24:31.996759] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-09T18:24:32.199204] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T18:24:32.796780] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-09T18:24:33.596792] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-09T18:24:34.320406] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T18:24:34.396703] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-09T18:24:34.591968] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T18:24:35.036548] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:24:35.196738] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-09T18:24:35.981378] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T18:24:35.996677] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-09T18:24:36.152849] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T18:24:36.796783] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-09T18:24:37.268407] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T18:24:37.596773] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-09T18:24:37.873339] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T18:24:38.396718] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-09T18:24:39.196685] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-09T18:24:39.224117] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:24:39.288955] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T18:24:39.996684] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-09T18:24:40.189924] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T18:24:40.796721] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-09T18:24:41.596756] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-09T18:24:41.724530] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T18:24:41.864823] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T18:24:42.396837] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-09T18:24:42.687688] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T18:24:43.196730] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-09T18:24:43.847552] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T18:24:43.996677] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-09T18:24:44.469383] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T18:24:44.796760] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-09T18:24:45.596686] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-09T18:24:45.719877] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T18:24:45.721204] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T18:24:46.364204] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T18:24:46.396665] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-09T18:24:47.196736] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-09T18:24:47.373360] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:24:47.996704] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-09T18:24:48.451842] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T18:24:48.598869] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T18:24:48.796736] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-09T18:24:49.596719] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-09T18:24:49.928994] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:24:49.931068] [INFO ] [REMOTE ] DFIN: Full fetch complete (33347 records). [2025-10-09T18:24:49.931158] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-09T18:24:49.931713] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:49.931813] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:49.931889] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:49.931987] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-09T18:24:49.932066] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-09T18:24:49.932121] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-10-09T18:24:49.932362] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-10-09T18:24:49.932454] [INFO ] [MAIN ] Update Progress: 610/2373 symbols completed. DFIN took 24.4s. Estimated remaining: 4h 5m 0s. Rate: 7.2 symbols/min [2025-10-09T18:24:50.112133] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:50.124138] [DEBUG] [LOCAL ] DFP: Loaded 11313 existing records from primary storage. [2025-10-09T18:24:50.124369] [INFO ] [MAIN ] DFP: Loaded 11313 existing records. [2025-10-09T18:24:50.299422] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:50.299629] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-09T18:24:50.299711] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-09T18:24:50.300244] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-09T18:24:50.300303] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-09T18:24:50.398795] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-09T18:24:50.690961] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:51.196807] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-09T18:24:51.372678] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T18:24:51.377029] [INFO ] [REMOTE ] DEO: Full fetch complete (71521 records). [2025-10-09T18:24:51.377141] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-09T18:24:51.686598] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T18:24:51.715552] [INFO ] [REMOTE ] DFH: Full fetch complete (47961 records). [2025-10-09T18:24:51.738982] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-09T18:24:51.766035] [FATAL] [VALIDATOR ] DFH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:51.787236] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-09T18:24:51.787348] [FATAL] [MAIN ] DFH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:51.787511] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:51.787453] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-09T18:24:51.787631] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-09T18:24:51.788527] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-09T18:24:51.788604] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-09T18:24:51.788862] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-09T18:24:51.788917] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-10-09T18:24:51.789085] [DEBUG] [LOCAL ] DFH: Deleted derivative data file. [2025-10-09T18:24:51.789697] [INFO ] [MAIN ] Update Progress: 611/2373 symbols completed. DFH took 28.2s. Estimated remaining: 4h 4m 33s. Rate: 7.2 symbols/min [2025-10-09T18:24:51.885461] [DEBUG] [LOCAL ] DEO: Trimmed 71521 records to 49498 (keeping 200 days of data) [2025-10-09T18:24:51.997277] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-09T18:24:52.058351] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:52.059179] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-09T18:24:52.062630] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-09T18:24:52.066988] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-09T18:24:52.067902] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-09T18:24:52.072764] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-09T18:24:52.075179] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-09T18:24:52.571460] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:52.671247] [DEBUG] [LOCAL ] DEO: Primary data saved (49498 records). [2025-10-09T18:24:52.671398] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-09T18:24:52.671536] [INFO ] [MAIN ] Update Progress: 612/2373 symbols completed. DEO took 43.6s. Estimated remaining: 4h 4m 4s. Rate: 7.2 symbols/min [2025-10-09T18:24:52.799982] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-09T18:24:52.852110] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:52.861598] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T18:24:52.909065] [DEBUG] [LOCAL ] DGX: Loaded 44756 existing records from primary storage. [2025-10-09T18:24:52.909357] [INFO ] [MAIN ] DGX: Loaded 44756 existing records. [2025-10-09T18:24:53.094820] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:53.095087] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-09T18:24:53.095205] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-09T18:24:53.095616] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-09T18:24:53.095901] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-09T18:24:53.521301] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:53.523384] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-09T18:24:53.596796] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-09T18:24:54.345946] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T18:24:54.396739] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-09T18:24:54.862200] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T18:24:55.196729] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-09T18:24:55.656869] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T18:24:55.843492] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T18:24:55.996692] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-09T18:24:56.796747] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-09T18:24:57.589373] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T18:24:57.600763] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-09T18:24:57.613329] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T18:24:58.396735] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-09T18:24:59.175410] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:24:59.196756] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-09T18:24:59.996709] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-09T18:25:00.522036] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-09T18:25:00.527163] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-09T18:25:00.527467] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-09T18:25:00.605814] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T18:25:00.805082] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-09T18:25:00.958392] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-09T18:25:00.958485] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-09T18:25:00.959452] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-09T18:25:00.959524] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-09T18:25:00.961050] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54126 (keeping 200 days of data) [2025-10-09T18:25:01.218746] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-09T18:25:01.379072] [DEBUG] [LOCAL ] DELL: Primary data saved (54126 records). [2025-10-09T18:25:01.379231] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-09T18:25:01.380313] [INFO ] [MAIN ] Update Progress: 613/2373 symbols completed. DELL took 54.6s. Estimated remaining: 4h 3m 57s. Rate: 7.2 symbols/min [2025-10-09T18:25:01.549084] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:01.549243] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-09T18:25:01.549279] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-09T18:25:01.549389] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-09T18:25:01.549430] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-09T18:25:01.549471] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-09T18:25:01.549506] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-09T18:25:01.602740] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-09T18:25:01.908141] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:02.327352] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T18:25:02.396726] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-09T18:25:02.790009] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-09T18:25:03.138281] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T18:25:03.196717] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-09T18:25:03.996704] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-09T18:25:04.034415] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T18:25:04.796719] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-09T18:25:05.248678] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T18:25:05.596706] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-09T18:25:06.396732] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-09T18:25:06.608728] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:25:06.642398] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T18:25:07.196734] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-09T18:25:07.996788] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-09T18:25:08.530117] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-09T18:25:08.717862] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:25:08.796687] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-09T18:25:08.981621] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T18:25:09.596741] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-09T18:25:10.396718] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-09T18:25:10.647218] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T18:25:10.681748] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T18:25:11.196739] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-09T18:25:11.996751] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-09T18:25:12.110823] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T18:25:12.675180] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T18:25:12.677149] [INFO ] [REMOTE ] DFP: Full fetch complete (15933 records). [2025-10-09T18:25:12.677440] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-09T18:25:12.801952] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-09T18:25:13.060294] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-09T18:25:13.060403] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-09T18:25:13.060986] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-09T18:25:13.061069] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-09T18:25:13.062008] [DEBUG] [LOCAL ] DFP: Trimmed 15933 records to 11365 (keeping 200 days of data) [2025-10-09T18:25:13.132377] [DEBUG] [LOCAL ] DFP: Primary data saved (11365 records). [2025-10-09T18:25:13.132695] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-09T18:25:13.132987] [INFO ] [MAIN ] Update Progress: 614/2373 symbols completed. DFP took 23.2s. Estimated remaining: 4h 3m 58s. Rate: 7.2 symbols/min [2025-10-09T18:25:13.336707] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T18:25:13.334990] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:13.412553] [DEBUG] [LOCAL ] DHI: Loaded 53342 existing records from primary storage. [2025-10-09T18:25:13.412911] [INFO ] [MAIN ] DHI: Loaded 53342 existing records. [2025-10-09T18:25:13.587570] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:13.587805] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-09T18:25:13.587888] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-09T18:25:13.588147] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-09T18:25:13.588220] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-09T18:25:13.601893] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-09T18:25:13.944937] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:14.125114] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:25:14.396691] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-09T18:25:14.739864] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T18:25:15.196731] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-09T18:25:16.004553] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-09T18:25:16.009953] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T18:25:16.211022] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:25:16.796732] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-09T18:25:17.596727] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-09T18:25:17.890023] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T18:25:18.396683] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-09T18:25:18.517843] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T18:25:18.726368] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T18:25:19.196742] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-09T18:25:20.006586] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-09T18:25:20.031038] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:25:20.796702] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-09T18:25:20.889440] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T18:25:21.051787] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T18:25:21.596780] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-09T18:25:22.396733] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-09T18:25:22.617581] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:25:22.861404] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T18:25:23.111569] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:25:23.196732] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-09T18:25:23.935155] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T18:25:23.996710] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-09T18:25:24.796811] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-09T18:25:25.096428] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T18:25:25.596722] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-09T18:25:26.396721] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-09T18:25:26.777368] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T18:25:27.154345] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T18:25:27.196738] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-09T18:25:27.570368] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:25:27.996713] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-09T18:25:28.796711] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-09T18:25:29.214880] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T18:25:29.596703] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-09T18:25:29.692496] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:25:30.041205] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:25:30.045443] [INFO ] [REMOTE ] DGX: Full fetch complete (64815 records). [2025-10-09T18:25:30.045555] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-09T18:25:30.046509] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:25:30.046607] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:25:30.046705] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:25:30.046778] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-09T18:25:30.046871] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-09T18:25:30.046935] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-09T18:25:30.047156] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-10-09T18:25:30.047277] [INFO ] [MAIN ] Update Progress: 615/2373 symbols completed. DGX took 37.4s. Estimated remaining: 4h 4m 14s. Rate: 7.2 symbols/min [2025-10-09T18:25:30.248391] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:30.310144] [DEBUG] [LOCAL ] DHR: Loaded 53383 existing records from primary storage. [2025-10-09T18:25:30.310551] [INFO ] [MAIN ] DHR: Loaded 53383 existing records. [2025-10-09T18:25:30.401845] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-09T18:25:30.516153] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:30.516384] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-09T18:25:30.516435] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-09T18:25:30.516724] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-09T18:25:30.516785] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-09T18:25:30.888226] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:31.196720] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-09T18:25:31.684433] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T18:25:31.996695] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-09T18:25:32.273578] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:25:32.797866] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-09T18:25:32.801010] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T18:25:33.070847] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T18:25:33.073308] [INFO ] [REMOTE ] DHF: Full fetch complete (30092 records). [2025-10-09T18:25:33.073382] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-09T18:25:33.440847] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-09T18:25:33.440950] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-09T18:25:33.441468] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-09T18:25:33.441509] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-09T18:25:33.442391] [DEBUG] [LOCAL ] DHF: Trimmed 30092 records to 21395 (keeping 200 days of data) [2025-10-09T18:25:33.577750] [DEBUG] [LOCAL ] DHF: Primary data saved (21395 records). [2025-10-09T18:25:33.578020] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-09T18:25:33.578122] [INFO ] [MAIN ] Update Progress: 616/2373 symbols completed. DHF took 32.2s. Estimated remaining: 4h 3m 52s. Rate: 7.2 symbols/min [2025-10-09T18:25:33.607030] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-09T18:25:33.751582] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:33.813566] [DEBUG] [LOCAL ] DHT: Loaded 47880 existing records from primary storage. [2025-10-09T18:25:33.814014] [INFO ] [MAIN ] DHT: Loaded 47880 existing records. [2025-10-09T18:25:34.076936] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:34.077208] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-09T18:25:34.077267] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-09T18:25:34.077593] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-09T18:25:34.077696] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-09T18:25:34.404802] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-09T18:25:34.549788] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:25:34.591733] [INFO ] [REMOTE ] DG: Full fetch complete (77207 records). [2025-10-09T18:25:34.607699] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-09T18:25:34.693565] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:35.104420] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-09T18:25:35.104709] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-09T18:25:35.105790] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-09T18:25:35.105880] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-09T18:25:35.107721] [DEBUG] [LOCAL ] DG: Trimmed 77207 records to 53670 (keeping 200 days of data) [2025-10-09T18:25:35.203895] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-09T18:25:35.245562] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:25:35.503723] [DEBUG] [LOCAL ] DG: Primary data saved (53670 records). [2025-10-09T18:25:35.503873] [INFO ] [MAIN ] DG: Full history saved. [2025-10-09T18:25:35.503948] [INFO ] [MAIN ] Update Progress: 617/2373 symbols completed. DG took 43.7s. Estimated remaining: 4h 3m 26s. Rate: 7.2 symbols/min [2025-10-09T18:25:35.669469] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:35.683350] [DEBUG] [LOCAL ] DHX: Loaded 12939 existing records from primary storage. [2025-10-09T18:25:35.683537] [INFO ] [MAIN ] DHX: Loaded 12939 existing records. [2025-10-09T18:25:35.857021] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:35.857289] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-09T18:25:35.857339] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-09T18:25:35.857570] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-09T18:25:35.857634] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-09T18:25:36.001778] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-09T18:25:36.219518] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:36.270003] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T18:25:36.649834] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T18:25:36.796732] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-09T18:25:37.543139] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T18:25:37.596704] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-09T18:25:37.842057] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T18:25:38.396738] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-09T18:25:39.196684] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-09T18:25:39.661463] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-09T18:25:39.825191] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T18:25:39.849982] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:25:39.996700] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-09T18:25:40.796772] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-09T18:25:41.351357] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T18:25:41.596716] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-09T18:25:42.404346] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-09T18:25:42.410729] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T18:25:42.443480] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T18:25:43.196774] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-09T18:25:43.989277] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T18:25:43.996668] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-09T18:25:44.602782] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T18:25:44.796683] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-09T18:25:44.955522] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T18:25:45.596755] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-09T18:25:46.396746] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-09T18:25:46.440069] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T18:25:46.696341] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T18:25:47.196732] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-09T18:25:47.933739] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T18:25:47.996707] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-09T18:25:48.796727] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-09T18:25:49.431588] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-09T18:25:49.558196] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T18:25:49.596668] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-09T18:25:49.651665] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T18:25:50.208758] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T18:25:50.396717] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-09T18:25:51.186382] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T18:25:51.196669] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-09T18:25:51.996715] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-09T18:25:52.796748] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-09T18:25:53.185843] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T18:25:53.596753] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-09T18:25:53.738846] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T18:25:54.396691] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-09T18:25:54.510043] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T18:25:54.514840] [INFO ] [REMOTE ] DHI: Full fetch complete (76817 records). [2025-10-09T18:25:54.514996] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-09T18:25:54.516116] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:25:54.516217] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:25:54.516285] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:25:54.516369] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-09T18:25:54.516470] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-09T18:25:54.516530] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-09T18:25:54.516787] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-09T18:25:54.516922] [INFO ] [MAIN ] Update Progress: 618/2373 symbols completed. DHI took 41.4s. Estimated remaining: 4h 3m 48s. Rate: 7.2 symbols/min [2025-10-09T18:25:54.704581] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:54.720314] [DEBUG] [LOCAL ] DIAX: Loaded 13144 existing records from primary storage. [2025-10-09T18:25:54.720541] [INFO ] [MAIN ] DIAX: Loaded 13144 existing records. [2025-10-09T18:25:54.894293] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:54.894574] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-09T18:25:54.894630] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-09T18:25:54.894966] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-09T18:25:54.895024] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-09T18:25:55.209538] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-09T18:25:55.249612] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:55.385408] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T18:25:55.786028] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T18:25:55.996716] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-09T18:25:56.203520] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T18:25:56.796714] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-09T18:25:57.422917] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:25:57.424596] [INFO ] [REMOTE ] DHX: Full fetch complete (20833 records). [2025-10-09T18:25:57.424722] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-09T18:25:57.598528] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-09T18:25:57.807301] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:25:57.844111] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-09T18:25:57.844210] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-09T18:25:57.844880] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-09T18:25:57.844964] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-09T18:25:57.846181] [DEBUG] [LOCAL ] DHX: Trimmed 20833 records to 13158 (keeping 200 days of data) [2025-10-09T18:25:57.919315] [DEBUG] [LOCAL ] DHX: Primary data saved (13158 records). [2025-10-09T18:25:57.919463] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-09T18:25:57.919574] [INFO ] [MAIN ] Update Progress: 619/2373 symbols completed. DHX took 22.4s. Estimated remaining: 4h 3m 25s. Rate: 7.2 symbols/min [2025-10-09T18:25:58.090985] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:58.126978] [DEBUG] [LOCAL ] DIN: Loaded 37280 existing records from primary storage. [2025-10-09T18:25:58.127352] [INFO ] [MAIN ] DIN: Loaded 37280 existing records. [2025-10-09T18:25:58.336549] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:58.336911] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-09T18:25:58.336964] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-09T18:25:58.338056] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-09T18:25:58.338117] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-09T18:25:58.406336] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-09T18:25:58.639032] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T18:25:58.702519] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:59.196791] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-09T18:25:59.711854] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T18:25:59.744826] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:25:59.996726] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-09T18:26:00.792430] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:26:00.796667] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-09T18:26:01.299076] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-09T18:26:01.596755] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-09T18:26:02.396753] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-09T18:26:03.076251] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-09T18:26:03.196692] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-09T18:26:03.237471] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T18:26:03.926764] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T18:26:03.996723] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-09T18:26:04.783070] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T18:26:04.796667] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-09T18:26:05.508147] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T18:26:05.596692] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-09T18:26:06.396728] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-09T18:26:07.196751] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-09T18:26:07.210430] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T18:26:07.215001] [INFO ] [REMOTE ] DHT: Full fetch complete (69929 records). [2025-10-09T18:26:07.215105] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-09T18:26:07.622563] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-09T18:26:07.622701] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-09T18:26:07.623695] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-09T18:26:07.623766] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-09T18:26:07.625302] [DEBUG] [LOCAL ] DHT: Trimmed 69929 records to 48239 (keeping 200 days of data) [2025-10-09T18:26:07.862848] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T18:26:07.941262] [DEBUG] [LOCAL ] DHT: Primary data saved (48239 records). [2025-10-09T18:26:07.941406] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-09T18:26:07.942251] [INFO ] [MAIN ] Update Progress: 620/2373 symbols completed. DHT took 34.4s. Estimated remaining: 4h 3m 22s. Rate: 7.2 symbols/min [2025-10-09T18:26:08.006521] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-09T18:26:08.129095] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:08.163130] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:26:08.228346] [DEBUG] [LOCAL ] DINO: Loaded 52894 existing records from primary storage. [2025-10-09T18:26:08.228692] [INFO ] [MAIN ] DINO: Loaded 52894 existing records. [2025-10-09T18:26:08.409281] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:26:08.409611] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-09T18:26:08.409689] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-09T18:26:08.411077] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-09T18:26:08.411137] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-09T18:26:08.790973] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:08.796677] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-09T18:26:09.585898] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T18:26:09.596672] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-09T18:26:10.396748] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-09T18:26:10.559610] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:26:11.070899] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T18:26:11.196689] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-09T18:26:11.956915] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T18:26:11.996688] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-09T18:26:12.675223] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T18:26:12.796671] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-09T18:26:12.881532] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T18:26:13.596762] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-09T18:26:14.346446] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T18:26:14.396670] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-09T18:26:15.196694] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-09T18:26:15.345449] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T18:26:15.347387] [INFO ] [REMOTE ] DIAX: Full fetch complete (17805 records). [2025-10-09T18:26:15.347500] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-09T18:26:15.693760] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T18:26:15.789345] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-09T18:26:15.789429] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-09T18:26:15.789842] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-09T18:26:15.789905] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-09T18:26:15.790554] [DEBUG] [LOCAL ] DIAX: Trimmed 17805 records to 13228 (keeping 200 days of data) [2025-10-09T18:26:15.871019] [DEBUG] [LOCAL ] DIAX: Primary data saved (13228 records). [2025-10-09T18:26:15.871167] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-09T18:26:15.871250] [INFO ] [MAIN ] Update Progress: 621/2373 symbols completed. DIAX took 21.4s. Estimated remaining: 4h 3m 12s. Rate: 7.2 symbols/min [2025-10-09T18:26:16.001851] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-09T18:26:16.063628] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:16.063822] [DEBUG] [LOCAL ] DIS: No existing data file found in primary storage. [2025-10-09T18:26:16.063864] [WARN ] [MAIN ] DIS: No existing data found, performing full refresh instead. [2025-10-09T18:26:16.063991] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-09T18:26:16.064069] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-09T18:26:16.064145] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-09T18:26:16.064186] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-09T18:26:16.495717] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:16.637513] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:26:16.796707] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-09T18:26:17.596701] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-09T18:26:17.733313] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:26:18.396768] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-09T18:26:19.041345] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T18:26:19.177155] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-09T18:26:19.196666] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-09T18:26:19.996736] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-09T18:26:20.252467] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T18:26:20.583618] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:26:20.588584] [INFO ] [REMOTE ] DHR: Full fetch complete (77267 records). [2025-10-09T18:26:20.588730] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-09T18:26:20.803474] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-09T18:26:20.991315] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-09T18:26:20.991455] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-09T18:26:20.992424] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-09T18:26:20.992492] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-09T18:26:20.994390] [DEBUG] [LOCAL ] DHR: Trimmed 77267 records to 53763 (keeping 200 days of data) [2025-10-09T18:26:21.257329] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-09T18:26:21.389138] [DEBUG] [LOCAL ] DHR: Primary data saved (53763 records). [2025-10-09T18:26:21.389288] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-09T18:26:21.390400] [INFO ] [MAIN ] Update Progress: 622/2373 symbols completed. DHR took 51.3s. Estimated remaining: 4h 2m 56s. Rate: 7.2 symbols/min [2025-10-09T18:26:21.582333] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:21.582512] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-09T18:26:21.582552] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-09T18:26:21.582699] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-09T18:26:21.582774] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-09T18:26:21.582819] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-09T18:26:21.582855] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-09T18:26:21.604558] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-09T18:26:21.974248] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:22.152140] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T18:26:22.396745] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-09T18:26:22.860405] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T18:26:23.196737] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-09T18:26:23.938906] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-09T18:26:23.996675] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-09T18:26:24.803790] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-09T18:26:24.825998] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T18:26:25.596808] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-09T18:26:26.089615] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-09T18:26:26.179246] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:26:26.396767] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-09T18:26:27.008263] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T18:26:27.196759] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-09T18:26:27.524214] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-09T18:26:27.949115] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T18:26:27.996693] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-09T18:26:28.796779] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-09T18:26:29.125595] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T18:26:29.596768] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-09T18:26:30.396699] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-09T18:26:31.066400] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T18:26:31.196675] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-09T18:26:31.390180] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-09T18:26:31.799633] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T18:26:31.803879] [INFO ] [REMOTE ] DIN: Full fetch complete (54959 records). [2025-10-09T18:26:31.804005] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-09T18:26:31.804730] [FATAL] [VALIDATOR ] DIN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:26:31.804825] [FATAL] [MAIN ] DIN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:26:31.804875] [WARN ] [MAIN ] DIN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:26:31.804953] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-09T18:26:31.805026] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-09T18:26:31.805068] [INFO ] [LOCAL ] DIN: Starting deletion of derivative data. [2025-10-09T18:26:31.805383] [DEBUG] [LOCAL ] DIN: Deleted derivative data file. [2025-10-09T18:26:31.806008] [INFO ] [MAIN ] Update Progress: 623/2373 symbols completed. DIN took 33.9s. Estimated remaining: 4h 2m 54s. Rate: 7.2 symbols/min [2025-10-09T18:26:31.983623] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:31.996722] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-09T18:26:32.038041] [DEBUG] [LOCAL ] DK: Loaded 49326 existing records from primary storage. [2025-10-09T18:26:32.038447] [INFO ] [MAIN ] DK: Loaded 49326 existing records. [2025-10-09T18:26:32.217830] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:26:32.218045] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-09T18:26:32.218093] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-09T18:26:32.218355] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-09T18:26:32.218412] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-09T18:26:32.396368] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-09T18:26:32.578200] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:32.796755] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-09T18:26:32.947856] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T18:26:33.596797] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-09T18:26:34.018185] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:26:34.396706] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-09T18:26:34.529758] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:26:35.196815] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-09T18:26:35.609888] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-09T18:26:35.996720] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-09T18:26:36.330883] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-09T18:26:36.483736] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T18:26:36.796822] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-09T18:26:37.596782] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-09T18:26:38.020159] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T18:26:38.396736] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-09T18:26:39.196744] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-09T18:26:39.782208] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-09T18:26:39.858696] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:26:39.996717] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-09T18:26:40.796769] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-09T18:26:40.968888] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:26:41.083927] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-09T18:26:41.369544] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T18:26:41.596829] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-09T18:26:42.396713] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-09T18:26:42.695064] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-09T18:26:42.949775] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T18:26:43.196754] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-09T18:26:43.555008] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-09T18:26:43.996721] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-09T18:26:44.426545] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T18:26:44.796730] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-09T18:26:45.596720] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-09T18:26:45.992694] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T18:26:45.993352] [INFO ] [REMOTE ] DIVY: Full fetch complete (1705 records). [2025-10-09T18:26:45.993416] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-09T18:26:46.174300] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T18:26:46.174486] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:26:46.174552] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:26:46.174603] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-09T18:26:46.174691] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-09T18:26:46.174751] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-09T18:26:46.174795] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-09T18:26:46.174853] [INFO ] [MAIN ] Update Progress: 624/2373 symbols completed. DIVY took 24.8s. Estimated remaining: 4h 3m 2s. Rate: 7.2 symbols/min [2025-10-09T18:26:46.344333] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:46.366700] [DEBUG] [LOCAL ] DKL: Loaded 17900 existing records from primary storage. [2025-10-09T18:26:46.366961] [INFO ] [MAIN ] DKL: Loaded 17900 existing records. [2025-10-09T18:26:46.400151] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-09T18:26:46.559120] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:26:46.559544] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-09T18:26:46.559607] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-09T18:26:46.559941] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-09T18:26:46.560003] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-09T18:26:46.958913] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-09T18:26:46.964491] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:47.196722] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-09T18:26:47.996689] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-09T18:26:48.327309] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T18:26:48.796685] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-09T18:26:49.010411] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T18:26:49.172404] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:26:49.596717] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-09T18:26:50.396707] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-09T18:26:50.483421] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T18:26:51.196691] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-09T18:26:51.322509] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T18:26:51.504005] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:26:51.996735] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-09T18:26:52.468594] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T18:26:52.796690] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-09T18:26:52.902057] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T18:26:53.596718] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-09T18:26:54.396749] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-09T18:26:54.738028] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T18:26:54.778961] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T18:26:55.196785] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-09T18:26:55.756622] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T18:26:55.996723] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-09T18:26:56.796727] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-09T18:26:57.232729] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-09T18:26:57.237561] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-09T18:26:57.237760] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-09T18:26:57.477889] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T18:26:57.601771] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-09T18:26:57.699634] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-09T18:26:57.699753] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-09T18:26:57.700700] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-09T18:26:57.700767] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-09T18:26:57.702536] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 54178 (keeping 200 days of data) [2025-10-09T18:26:58.063232] [DEBUG] [LOCAL ] DIS: Primary data saved (54178 records). [2025-10-09T18:26:58.063367] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-09T18:26:58.063443] [INFO ] [MAIN ] Update Progress: 625/2373 symbols completed. DIS took 42.2s. Estimated remaining: 4h 3m 4s. Rate: 7.2 symbols/min [2025-10-09T18:26:58.237030] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:58.248151] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:26:58.253270] [INFO ] [REMOTE ] DINO: Full fetch complete (76621 records). [2025-10-09T18:26:58.253427] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-09T18:26:58.401598] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-09T18:26:58.603994] [DEBUG] [LOCAL ] DKS: Loaded 49707 existing records from primary storage. [2025-10-09T18:26:58.615286] [INFO ] [MAIN ] DKS: Loaded 49707 existing records. [2025-10-09T18:26:58.810596] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-09T18:26:58.821555] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-09T18:26:58.827622] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-09T18:26:58.832940] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-09T18:26:58.890566] [DEBUG] [LOCAL ] DINO: Trimmed 76621 records to 53271 (keeping 200 days of data) [2025-10-09T18:26:58.896411] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:26:58.896941] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-09T18:26:58.897000] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-09T18:26:58.897419] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-09T18:26:58.897494] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-09T18:26:59.389612] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:59.395550] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-09T18:26:59.432034] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:26:59.634676] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T18:26:59.683119] [DEBUG] [LOCAL ] DINO: Primary data saved (53271 records). [2025-10-09T18:26:59.683286] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-09T18:26:59.684441] [INFO ] [MAIN ] Update Progress: 626/2373 symbols completed. DINO took 51.7s. Estimated remaining: 4h 2m 37s. Rate: 7.2 symbols/min [2025-10-09T18:26:59.848898] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:59.882275] [DEBUG] [LOCAL ] DLB: Loaded 32096 existing records from primary storage. [2025-10-09T18:26:59.882549] [INFO ] [MAIN ] DLB: Loaded 32096 existing records. [2025-10-09T18:27:00.001832] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-09T18:27:00.060474] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:00.060716] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-09T18:27:00.060773] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-09T18:27:00.061042] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-09T18:27:00.061099] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-09T18:27:00.407053] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:00.796781] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-09T18:27:01.304484] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T18:27:01.423725] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T18:27:01.596732] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-09T18:27:02.122240] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T18:27:02.396742] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-09T18:27:02.978401] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T18:27:03.196731] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-09T18:27:03.851045] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:27:03.855528] [INFO ] [REMOTE ] DK: Full fetch complete (70857 records). [2025-10-09T18:27:03.855701] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-09T18:27:04.006692] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-09T18:27:04.289507] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-09T18:27:04.293819] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-09T18:27:04.295668] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-09T18:27:04.296205] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-09T18:27:04.296070] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T18:27:04.301919] [DEBUG] [LOCAL ] DK: Trimmed 70857 records to 49695 (keeping 200 days of data) [2025-10-09T18:27:04.611753] [DEBUG] [LOCAL ] DK: Primary data saved (49695 records). [2025-10-09T18:27:04.611895] [INFO ] [MAIN ] DK: Full history saved. [2025-10-09T18:27:04.612424] [INFO ] [MAIN ] Update Progress: 627/2373 symbols completed. DK took 32.8s. Estimated remaining: 4h 2m 19s. Rate: 7.2 symbols/min [2025-10-09T18:27:04.813158] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-09T18:27:04.815790] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:04.817034] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-10-09T18:27:04.817096] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-10-09T18:27:04.817210] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-09T18:27:04.817251] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-09T18:27:04.817294] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-09T18:27:04.817326] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-09T18:27:05.190727] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:05.594862] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T18:27:05.604029] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-09T18:27:05.785512] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T18:27:06.396704] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-09T18:27:06.455533] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:27:07.196746] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-09T18:27:07.783950] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:27:07.996690] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-09T18:27:08.209209] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:27:08.735975] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T18:27:08.796694] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-09T18:27:09.596725] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-09T18:27:09.644335] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T18:27:10.396769] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-09T18:27:11.196696] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-09T18:27:11.313203] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T18:27:11.314758] [INFO ] [REMOTE ] DKL: Full fetch complete (28007 records). [2025-10-09T18:27:11.314834] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-09T18:27:11.708371] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-09T18:27:11.708558] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-09T18:27:11.709326] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-09T18:27:11.709446] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-09T18:27:11.744956] [DEBUG] [LOCAL ] DKL: Trimmed 28007 records to 18052 (keeping 200 days of data) [2025-10-09T18:27:11.734910] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T18:27:11.753435] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-09T18:27:11.875013] [DEBUG] [LOCAL ] DKL: Primary data saved (18052 records). [2025-10-09T18:27:11.875171] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-09T18:27:11.875285] [INFO ] [MAIN ] Update Progress: 628/2373 symbols completed. DKL took 25.7s. Estimated remaining: 4h 2m 8s. Rate: 7.2 symbols/min [2025-10-09T18:27:12.001799] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-09T18:27:12.053439] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:12.110907] [DEBUG] [LOCAL ] DLR: Loaded 50850 existing records from primary storage. [2025-10-09T18:27:12.111272] [INFO ] [MAIN ] DLR: Loaded 50850 existing records. [2025-10-09T18:27:12.292613] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:12.292865] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-09T18:27:12.292941] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-09T18:27:12.293226] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-09T18:27:12.293293] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-09T18:27:12.669496] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:12.796683] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-09T18:27:12.848841] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T18:27:13.596783] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-09T18:27:14.396693] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-09T18:27:14.431595] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T18:27:15.196753] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-09T18:27:15.498347] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T18:27:15.551618] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:27:15.996774] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-09T18:27:16.796687] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-09T18:27:16.995627] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T18:27:17.072748] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:27:17.596787] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-09T18:27:17.657070] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T18:27:18.396737] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-09T18:27:19.196704] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-09T18:27:19.390156] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T18:27:19.784353] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T18:27:19.928709] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T18:27:19.996712] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-09T18:27:20.796773] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-09T18:27:21.543943] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T18:27:21.596777] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-09T18:27:22.338630] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:27:22.396670] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-09T18:27:23.196746] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-09T18:27:23.341396] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:27:23.626757] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-09T18:27:23.996726] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-09T18:27:24.046002] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T18:27:24.796712] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-09T18:27:25.593366] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T18:27:25.597037] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-09T18:27:25.599099] [INFO ] [REMOTE ] DKS: Full fetch complete (71628 records). [2025-10-09T18:27:25.599241] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-09T18:27:25.983568] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-09T18:27:25.983675] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-09T18:27:25.984608] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-09T18:27:25.984690] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-09T18:27:25.986077] [DEBUG] [LOCAL ] DKS: Trimmed 71628 records to 50059 (keeping 200 days of data) [2025-10-09T18:27:26.296526] [DEBUG] [LOCAL ] DKS: Primary data saved (50059 records). [2025-10-09T18:27:26.296701] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-09T18:27:26.296798] [INFO ] [MAIN ] Update Progress: 629/2373 symbols completed. DKS took 28.2s. Estimated remaining: 4h 2m 16s. Rate: 7.2 symbols/min [2025-10-09T18:27:26.399708] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-09T18:27:26.473054] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:26.501687] [DEBUG] [LOCAL ] DLX: Loaded 28454 existing records from primary storage. [2025-10-09T18:27:26.501952] [INFO ] [MAIN ] DLX: Loaded 28454 existing records. [2025-10-09T18:27:26.682576] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:26.682919] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-09T18:27:26.682996] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-09T18:27:26.683299] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-09T18:27:26.683373] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-09T18:27:26.944514] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-09T18:27:27.115220] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:27.118233] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T18:27:27.121407] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:27:27.196665] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-09T18:27:27.667043] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-09T18:27:27.996774] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-09T18:27:28.796765] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-09T18:27:29.288971] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T18:27:29.596754] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-09T18:27:29.765813] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T18:27:30.396742] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-09T18:27:30.464742] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T18:27:31.056055] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T18:27:31.196758] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-09T18:27:31.808028] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T18:27:31.808996] [INFO ] [REMOTE ] DLNG: Full fetch complete (11823 records). [2025-10-09T18:27:31.809065] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-09T18:27:31.809439] [FATAL] [VALIDATOR ] DLNG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:27:31.809534] [FATAL] [MAIN ] DLNG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:27:31.809625] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:27:31.809735] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-09T18:27:31.809808] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-09T18:27:31.809846] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-10-09T18:27:31.809904] [DEBUG] [LOCAL ] DLNG: No derivative data file found to delete. [2025-10-09T18:27:31.809982] [INFO ] [MAIN ] Update Progress: 630/2373 symbols completed. DLNG took 27.2s. Estimated remaining: 4h 2m 0s. Rate: 7.2 symbols/min [2025-10-09T18:27:31.976673] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:31.998012] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-09T18:27:31.999101] [DEBUG] [LOCAL ] DLY: Loaded 20261 existing records from primary storage. [2025-10-09T18:27:32.000077] [INFO ] [MAIN ] DLY: Loaded 20261 existing records. [2025-10-09T18:27:32.178631] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:32.178889] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-09T18:27:32.178943] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-09T18:27:32.179150] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-09T18:27:32.179206] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-09T18:27:32.534158] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:32.796732] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-09T18:27:33.225476] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:27:33.596687] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-09T18:27:33.633603] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T18:27:34.396732] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-09T18:27:35.082560] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T18:27:35.196703] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-09T18:27:35.304571] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T18:27:35.996747] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-09T18:27:36.436816] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:27:36.796807] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-09T18:27:37.428381] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T18:27:37.563563] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T18:27:37.596672] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-09T18:27:38.396801] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-09T18:27:38.522308] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T18:27:39.196700] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-09T18:27:39.259073] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T18:27:39.996715] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-09T18:27:40.198131] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T18:27:40.796767] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-09T18:27:41.596746] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-09T18:27:41.687128] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:27:41.816251] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T18:27:42.396728] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-09T18:27:43.007493] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T18:27:43.196780] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-09T18:27:43.996703] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-09T18:27:44.207312] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:27:44.245630] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T18:27:44.796765] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-09T18:27:45.196464] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T18:27:45.596740] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-09T18:27:46.396744] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-09T18:27:46.605705] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T18:27:46.898956] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:27:47.106060] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:27:47.196738] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-09T18:27:47.996690] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-09T18:27:48.228529] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T18:27:48.796718] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-09T18:27:49.144209] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T18:27:49.596768] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-09T18:27:50.396716] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-09T18:27:50.599233] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T18:27:50.940493] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:27:51.196696] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-09T18:27:51.232770] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T18:27:51.996707] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-09T18:27:52.504388] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:27:52.796758] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-09T18:27:53.427615] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T18:27:53.431860] [INFO ] [REMOTE ] DLR: Full fetch complete (73994 records). [2025-10-09T18:27:53.431975] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-09T18:27:53.607111] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-09T18:27:53.826230] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-09T18:27:53.826339] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-09T18:27:53.827337] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-09T18:27:53.827406] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-09T18:27:53.828966] [DEBUG] [LOCAL ] DLR: Trimmed 73994 records to 51205 (keeping 200 days of data) [2025-10-09T18:27:54.101623] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T18:27:54.198030] [DEBUG] [LOCAL ] DLR: Primary data saved (51205 records). [2025-10-09T18:27:54.198177] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-09T18:27:54.199384] [INFO ] [MAIN ] Update Progress: 631/2373 symbols completed. DLR took 42.3s. Estimated remaining: 4h 2m 31s. Rate: 7.2 symbols/min [2025-10-09T18:27:54.376052] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:54.384704] [DEBUG] [LOCAL ] DMA: Loaded 4615 existing records from primary storage. [2025-10-09T18:27:54.384992] [INFO ] [MAIN ] DMA: Loaded 4615 existing records. [2025-10-09T18:27:54.405479] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-09T18:27:54.563372] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:54.563570] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-09T18:27:54.563617] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-09T18:27:54.563819] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-09T18:27:54.563876] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-09T18:27:54.903316] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T18:27:54.947104] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:55.196716] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-09T18:27:55.373022] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T18:27:55.996757] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-09T18:27:56.277780] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:27:56.280437] [INFO ] [REMOTE ] DLY: Full fetch complete (28336 records). [2025-10-09T18:27:56.280526] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-09T18:27:56.651704] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-09T18:27:56.651826] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-09T18:27:56.652349] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-09T18:27:56.652388] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-09T18:27:56.653244] [DEBUG] [LOCAL ] DLY: Trimmed 28336 records to 20448 (keeping 200 days of data) [2025-10-09T18:27:56.777969] [DEBUG] [LOCAL ] DLY: Primary data saved (20448 records). [2025-10-09T18:27:56.778112] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-09T18:27:56.778197] [INFO ] [MAIN ] Update Progress: 632/2373 symbols completed. DLY took 25.0s. Estimated remaining: 4h 2m 6s. Rate: 7.2 symbols/min [2025-10-09T18:27:56.801808] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-09T18:27:56.953584] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:56.965405] [DEBUG] [LOCAL ] DMB: Loaded 10262 existing records from primary storage. [2025-10-09T18:27:56.965824] [INFO ] [MAIN ] DMB: Loaded 10262 existing records. [2025-10-09T18:27:57.106690] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T18:27:57.151273] [INFO ] [REMOTE ] DLX: Full fetch complete (41228 records). [2025-10-09T18:27:57.175919] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-09T18:27:57.175782] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:57.176325] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-09T18:27:57.176767] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-09T18:27:57.177120] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-09T18:27:57.177182] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-09T18:27:57.628008] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-09T18:27:57.970762] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:57.988728] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-09T18:27:57.988860] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-09T18:27:57.989573] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-09T18:27:57.989668] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-09T18:27:57.990757] [DEBUG] [LOCAL ] DLX: Trimmed 41228 records to 28604 (keeping 200 days of data) [2025-10-09T18:27:58.104480] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T18:27:58.109526] [INFO ] [REMOTE ] DLB: Full fetch complete (47101 records). [2025-10-09T18:27:58.112190] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-09T18:27:58.402405] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-09T18:27:58.494924] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T18:27:58.502031] [DEBUG] [LOCAL ] DLX: Primary data saved (28604 records). [2025-10-09T18:27:58.514166] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-09T18:27:58.514283] [INFO ] [MAIN ] Update Progress: 633/2373 symbols completed. DLX took 32.2s. Estimated remaining: 4h 1m 40s. Rate: 7.2 symbols/min [2025-10-09T18:27:58.713811] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-09T18:27:58.719030] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-09T18:27:58.732709] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-09T18:27:58.732788] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-09T18:27:58.764478] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:58.764771] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-10-09T18:27:58.764842] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-10-09T18:27:58.764962] [DEBUG] [LOCAL ] DLB: Trimmed 47101 records to 32314 (keeping 200 days of data) [2025-10-09T18:27:58.765119] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-09T18:27:58.765317] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-09T18:27:58.765692] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-09T18:27:58.765775] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-09T18:27:59.208136] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-09T18:27:59.232218] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:59.247177] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T18:27:59.346423] [DEBUG] [LOCAL ] DLB: Primary data saved (32314 records). [2025-10-09T18:27:59.346571] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-09T18:27:59.347723] [INFO ] [MAIN ] Update Progress: 634/2373 symbols completed. DLB took 59.7s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-10-09T18:27:59.517434] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:59.564797] [DEBUG] [LOCAL ] DNA: Loaded 48491 existing records from primary storage. [2025-10-09T18:27:59.565156] [INFO ] [MAIN ] DNA: Loaded 48491 existing records. [2025-10-09T18:27:59.742547] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:59.742763] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-09T18:27:59.742812] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-09T18:27:59.743069] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-09T18:27:59.743132] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-09T18:27:59.826057] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T18:28:00.001779] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-09T18:28:00.113724] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:00.611621] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T18:28:00.796750] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-09T18:28:01.358480] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T18:28:01.596730] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-09T18:28:02.396735] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-09T18:28:03.200266] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-09T18:28:03.202247] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T18:28:03.284956] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T18:28:03.837671] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T18:28:03.996697] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-09T18:28:04.563425] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T18:28:04.796746] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-09T18:28:05.596768] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-09T18:28:06.135783] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T18:28:06.384483] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T18:28:06.396672] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-09T18:28:07.196713] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-09T18:28:07.947534] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T18:28:07.996679] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-09T18:28:08.152826] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T18:28:08.547009] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T18:28:08.796738] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-09T18:28:09.547423] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T18:28:09.596671] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-09T18:28:10.402137] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-09T18:28:10.404961] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T18:28:11.196727] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-09T18:28:11.402147] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:28:11.934769] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T18:28:11.996670] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-09T18:28:12.491288] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T18:28:12.796728] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-09T18:28:13.540595] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T18:28:13.596733] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-09T18:28:14.396725] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-09T18:28:15.181892] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T18:28:15.196733] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-09T18:28:15.259602] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:28:15.641838] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T18:28:15.996729] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-09T18:28:16.475234] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T18:28:16.796771] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-09T18:28:17.437786] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T18:28:17.596807] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-09T18:28:18.091628] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T18:28:18.092749] [INFO ] [REMOTE ] DMA: Full fetch complete (6716 records). [2025-10-09T18:28:18.092841] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-09T18:28:18.402010] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-09T18:28:18.492348] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-09T18:28:18.492432] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-09T18:28:18.492631] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-09T18:28:18.492730] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-09T18:28:18.493123] [DEBUG] [LOCAL ] DMA: Trimmed 6716 records to 4708 (keeping 200 days of data) [2025-10-09T18:28:18.523476] [DEBUG] [LOCAL ] DMA: Primary data saved (4708 records). [2025-10-09T18:28:18.523586] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-09T18:28:18.523690] [INFO ] [MAIN ] Update Progress: 635/2373 symbols completed. DMA took 24.3s. Estimated remaining: 4h 1m 32s. Rate: 7.2 symbols/min [2025-10-09T18:28:18.700127] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:18.741744] [DEBUG] [LOCAL ] DNOW: Loaded 43622 existing records from primary storage. [2025-10-09T18:28:18.742088] [INFO ] [MAIN ] DNOW: Loaded 43622 existing records. [2025-10-09T18:28:18.918552] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:18.918794] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-09T18:28:18.918844] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-09T18:28:18.919072] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-09T18:28:18.919130] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-09T18:28:19.202101] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-09T18:28:19.282232] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:19.396481] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T18:28:19.996748] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-09T18:28:20.744960] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T18:28:20.746901] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:28:20.759619] [INFO ] [REMOTE ] DMO: Full fetch complete (14506 records). [2025-10-09T18:28:20.760199] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-09T18:28:20.801955] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-09T18:28:21.128796] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-09T18:28:21.128877] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-09T18:28:21.129183] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-09T18:28:21.129222] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-09T18:28:21.129730] [DEBUG] [LOCAL ] DMO: Trimmed 14506 records to 10036 (keeping 200 days of data) [2025-10-09T18:28:21.194152] [DEBUG] [LOCAL ] DMO: Primary data saved (10036 records). [2025-10-09T18:28:21.194309] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-09T18:28:21.194421] [INFO ] [MAIN ] Update Progress: 636/2373 symbols completed. DMO took 22.7s. Estimated remaining: 4h 1m 9s. Rate: 7.2 symbols/min [2025-10-09T18:28:21.366176] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:21.400876] [DEBUG] [LOCAL ] DNP: Loaded 33275 existing records from primary storage. [2025-10-09T18:28:21.401205] [INFO ] [MAIN ] DNP: Loaded 33275 existing records. [2025-10-09T18:28:21.582364] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:21.582632] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-09T18:28:21.582716] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-09T18:28:21.583049] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-09T18:28:21.583108] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-09T18:28:21.603740] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-09T18:28:21.698439] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T18:28:22.009934] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:22.396718] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-09T18:28:23.196754] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-09T18:28:23.448174] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T18:28:23.664722] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T18:28:23.803531] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T18:28:23.996790] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-09T18:28:24.796689] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-09T18:28:24.849217] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T18:28:25.596725] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-09T18:28:25.980753] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:28:26.396732] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-09T18:28:27.173604] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T18:28:27.196671] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-09T18:28:27.653528] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T18:28:27.996734] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-09T18:28:28.801277] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-09T18:28:28.809452] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T18:28:29.528582] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T18:28:29.596836] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-09T18:28:29.976862] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:28:30.121597] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T18:28:30.396731] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-09T18:28:31.196772] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-09T18:28:31.895156] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:28:31.896105] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T18:28:31.996701] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-09T18:28:32.796722] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-09T18:28:33.074106] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T18:28:33.596721] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-09T18:28:34.396770] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-09T18:28:34.623313] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T18:28:34.696124] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T18:28:35.196717] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-09T18:28:35.934128] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:28:35.996680] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-09T18:28:36.526151] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T18:28:36.796704] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-09T18:28:37.008027] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T18:28:37.596772] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-09T18:28:38.216002] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T18:28:38.396719] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-09T18:28:39.186631] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T18:28:39.198516] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-09T18:28:39.430697] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T18:28:39.938773] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T18:28:39.996691] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-09T18:28:40.796724] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-09T18:28:41.304431] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:28:41.308159] [INFO ] [REMOTE ] DNOW: Full fetch complete (62890 records). [2025-10-09T18:28:41.308257] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-09T18:28:41.416483] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:28:41.604880] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-09T18:28:41.701534] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-09T18:28:41.701858] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-09T18:28:41.702733] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-09T18:28:41.702804] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-09T18:28:41.704101] [DEBUG] [LOCAL ] DNOW: Trimmed 62890 records to 43943 (keeping 200 days of data) [2025-10-09T18:28:41.978990] [DEBUG] [LOCAL ] DNOW: Primary data saved (43943 records). [2025-10-09T18:28:41.979166] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-09T18:28:41.979272] [INFO ] [MAIN ] Update Progress: 637/2373 symbols completed. DNOW took 23.5s. Estimated remaining: 4h 1m 34s. Rate: 7.2 symbols/min [2025-10-09T18:28:42.396806] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-09T18:28:42.793674] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:28:42.996931] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T18:28:43.196724] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-09T18:28:43.912515] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T18:28:43.913749] [INFO ] [REMOTE ] DMB: Full fetch complete (14798 records). [2025-10-09T18:28:43.913823] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-09T18:28:44.002977] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-09T18:28:44.290722] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-09T18:28:44.290854] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-09T18:28:44.291258] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-09T18:28:44.291299] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-09T18:28:44.291829] [DEBUG] [LOCAL ] DMB: Trimmed 14798 records to 10302 (keeping 200 days of data) [2025-10-09T18:28:44.351774] [DEBUG] [LOCAL ] DMB: Primary data saved (10302 records). [2025-10-09T18:28:44.351895] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-09T18:28:44.351980] [INFO ] [MAIN ] Update Progress: 638/2373 symbols completed. DMB took 47.6s. Estimated remaining: 4h 1m 10s. Rate: 7.2 symbols/min [2025-10-09T18:28:44.796825] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-09T18:28:45.946393] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T18:28:45.965065] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T18:28:45.969582] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-09T18:28:45.973140] [INFO ] [REMOTE ] DNA: Full fetch complete (71050 records). [2025-10-09T18:28:45.973253] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-09T18:28:46.402149] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-09T18:28:46.402255] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-09T18:28:46.403279] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-09T18:28:46.403356] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-09T18:28:46.405108] [DEBUG] [LOCAL ] DNA: Trimmed 71050 records to 48858 (keeping 200 days of data) [2025-10-09T18:28:46.727316] [DEBUG] [LOCAL ] DNA: Primary data saved (48858 records). [2025-10-09T18:28:46.727492] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-09T18:28:46.728502] [INFO ] [MAIN ] Update Progress: 639/2373 symbols completed. DNA took 47.4s. Estimated remaining: 4h 0m 45s. Rate: 7.2 symbols/min [2025-10-09T18:28:47.418418] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:28:47.426149] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-09T18:28:48.422168] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:28:48.429044] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-09T18:28:49.421974] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T18:28:49.429807] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-09T18:28:50.301241] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T18:28:50.308989] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-09T18:28:51.619831] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:28:51.627779] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-09T18:28:52.718709] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T18:28:52.721458] [INFO ] [REMOTE ] DNP: Full fetch complete (48886 records). [2025-10-09T18:28:52.721545] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-09T18:28:53.114330] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-09T18:28:53.114411] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-09T18:28:53.115147] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-09T18:28:53.115212] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-09T18:28:53.116329] [DEBUG] [LOCAL ] DNP: Trimmed 48886 records to 33468 (keeping 200 days of data) [2025-10-09T18:28:53.316325] [DEBUG] [LOCAL ] DNP: Primary data saved (33468 records). [2025-10-09T18:28:53.316456] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-09T18:28:53.316537] [INFO ] [MAIN ] Update Progress: 640/2373 symbols completed. DNP took 32.1s. Estimated remaining: 4h 0m 32s. Rate: 7.2 symbols/min [2025-10-09T18:28:53.912613] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:53.909817] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:54.011948] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:54.063176] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:54.182712] [DEBUG] [LOCAL ] DOCS: Loaded 50973 existing records from primary storage. [2025-10-09T18:28:54.184060] [INFO ] [MAIN ] DOCS: Loaded 50973 existing records. [2025-10-09T18:28:54.185254] [DEBUG] [LOCAL ] DOC: Loaded 53548 existing records from primary storage. [2025-10-09T18:28:54.183851] [DEBUG] [LOCAL ] DOLE: Loaded 38840 existing records from primary storage. [2025-10-09T18:28:54.215634] [INFO ] [MAIN ] DOC: Loaded 53548 existing records. [2025-10-09T18:28:54.261749] [INFO ] [MAIN ] DOLE: Loaded 38840 existing records. [2025-10-09T18:28:54.440893] [DEBUG] [LOCAL ] DOCN: Loaded 50781 existing records from primary storage. [2025-10-09T18:28:54.516023] [INFO ] [MAIN ] DOCN: Loaded 50781 existing records. [2025-10-09T18:28:54.640230] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:54.640949] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-09T18:28:54.706199] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-09T18:28:54.770501] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:54.791406] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-09T18:28:54.796800] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-09T18:28:54.881401] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-09T18:28:54.891024] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:54.891125] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-09T18:28:54.965731] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-09T18:28:55.012708] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-09T18:28:55.012808] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-09T18:28:55.040204] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:55.037167] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-09T18:28:55.058704] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-09T18:28:55.069293] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-09T18:28:55.079771] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-09T18:28:55.090210] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-09T18:28:55.099312] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-09T18:28:55.099252] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-09T18:28:56.207405] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:56.297974] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-09T18:28:56.353905] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:56.389357] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-09T18:28:56.402953] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:56.415029] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-09T18:28:56.479349] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:56.479619] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-09T18:28:57.542514] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T18:28:57.549533] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-09T18:28:57.600049] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T18:28:57.608981] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-09T18:28:57.773149] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T18:28:57.784124] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-09T18:28:57.844938] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T18:28:57.855366] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-09T18:28:58.556783] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T18:28:58.564263] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-09T18:28:59.025714] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:28:59.035359] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-09T18:28:59.130049] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T18:28:59.140259] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-09T18:28:59.186165] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T18:28:59.196663] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-09T18:28:59.798011] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T18:28:59.996786] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-09T18:29:00.437029] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:29:00.548551] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T18:29:00.796702] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-09T18:29:00.925670] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:29:01.596741] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-09T18:29:01.700842] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T18:29:02.394109] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T18:29:02.403558] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-09T18:29:02.864162] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:29:03.196715] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-09T18:29:03.551186] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T18:29:03.996721] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-09T18:29:04.640306] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T18:29:04.796708] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-09T18:29:05.321331] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:29:05.596729] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-09T18:29:06.396727] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-09T18:29:06.684068] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T18:29:07.196712] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-09T18:29:07.369805] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:29:07.996789] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-09T18:29:08.046489] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T18:29:08.699937] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:29:08.796688] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-09T18:29:09.596736] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-09T18:29:09.837130] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T18:29:10.306235] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T18:29:10.396700] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-09T18:29:10.644355] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T18:29:11.196787] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-09T18:29:11.996706] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-09T18:29:12.221293] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T18:29:12.309869] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T18:29:12.796717] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-09T18:29:13.596686] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-09T18:29:13.772435] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T18:29:14.396695] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-09T18:29:14.731039] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T18:29:15.196766] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-09T18:29:15.368250] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T18:29:15.931899] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T18:29:15.996683] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-09T18:29:16.307894] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:29:16.796775] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-09T18:29:17.596692] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-09T18:29:18.052151] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T18:29:18.396767] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-09T18:29:18.666626] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T18:29:18.768411] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:29:19.196746] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-09T18:29:19.924928] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T18:29:19.996690] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-09T18:29:20.730458] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T18:29:20.796701] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-09T18:29:21.596864] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-09T18:29:21.826608] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:29:22.396710] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-09T18:29:22.691753] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-09T18:29:22.696160] [INFO ] [REMOTE ] DOCN: Full fetch complete (72080 records). [2025-10-09T18:29:22.696264] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-09T18:29:23.089244] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-09T18:29:23.089418] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-09T18:29:23.090376] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-09T18:29:23.090441] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-09T18:29:23.091999] [DEBUG] [LOCAL ] DOCN: Trimmed 72080 records to 51170 (keeping 200 days of data) [2025-10-09T18:29:23.197402] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-09T18:29:23.333117] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:29:23.439086] [DEBUG] [LOCAL ] DOCN: Primary data saved (51170 records). [2025-10-09T18:29:23.439222] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-09T18:29:23.439305] [INFO ] [MAIN ] Update Progress: 641/2373 symbols completed. DOCN took 30.0s. Estimated remaining: 4h 1m 23s. Rate: 7.2 symbols/min [2025-10-09T18:29:23.607265] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:23.638689] [DEBUG] [LOCAL ] DOUG: Loaded 34415 existing records from primary storage. [2025-10-09T18:29:23.638983] [INFO ] [MAIN ] DOUG: Loaded 34415 existing records. [2025-10-09T18:29:23.748892] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T18:29:23.778759] [INFO ] [REMOTE ] DOLE: Full fetch complete (54405 records). [2025-10-09T18:29:23.801393] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-09T18:29:23.831724] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:23.832113] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-09T18:29:23.832172] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-09T18:29:23.863758] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-09T18:29:23.907704] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-09T18:29:23.997444] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-09T18:29:24.572140] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:24.608373] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-09T18:29:24.608517] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-09T18:29:24.609355] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-09T18:29:24.609497] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-09T18:29:24.610859] [DEBUG] [LOCAL ] DOLE: Trimmed 54405 records to 39185 (keeping 200 days of data) [2025-10-09T18:29:24.718935] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T18:29:24.725298] [INFO ] [REMOTE ] DOC: Full fetch complete (77386 records). [2025-10-09T18:29:24.725722] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-09T18:29:24.798915] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-09T18:29:25.162331] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-09T18:29:25.162782] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-09T18:29:25.163780] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-09T18:29:25.164166] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-09T18:29:25.169144] [DEBUG] [LOCAL ] DOC: Trimmed 77386 records to 53937 (keeping 200 days of data) [2025-10-09T18:29:25.483567] [DEBUG] [LOCAL ] DOLE: Primary data saved (39185 records). [2025-10-09T18:29:25.492981] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-09T18:29:25.519754] [INFO ] [MAIN ] Update Progress: 642/2373 symbols completed. DOLE took 32.2s. Estimated remaining: 4h 0m 57s. Rate: 7.2 symbols/min [2025-10-09T18:29:25.711061] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:25.833476] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T18:29:25.862947] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-09T18:29:25.867620] [DEBUG] [LOCAL ] DOC: Primary data saved (53937 records). [2025-10-09T18:29:25.878967] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-09T18:29:25.879085] [INFO ] [MAIN ] Update Progress: 643/2373 symbols completed. DOC took 32.6s. Estimated remaining: 4h 0m 27s. Rate: 7.2 symbols/min [2025-10-09T18:29:26.026613] [DEBUG] [LOCAL ] DOV: Loaded 45490 existing records from primary storage. [2025-10-09T18:29:26.052603] [INFO ] [MAIN ] DOV: Loaded 45490 existing records. [2025-10-09T18:29:26.079525] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:26.266227] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:26.267072] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-09T18:29:26.267278] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-09T18:29:26.267681] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-09T18:29:26.267831] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-09T18:29:26.390080] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T18:29:26.418259] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-09T18:29:26.499325] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-09T18:29:26.515221] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-09T18:29:26.861747] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:26.869559] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-09T18:29:26.869702] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-09T18:29:26.884499] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-09T18:29:26.886403] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-09T18:29:26.889866] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:27.201840] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-09T18:29:27.262039] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:27.367916] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:29:27.372563] [INFO ] [REMOTE ] DOCS: Full fetch complete (74100 records). [2025-10-09T18:29:27.372729] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-09T18:29:27.501734] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:29:27.805553] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-09T18:29:27.805663] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-09T18:29:27.806670] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-09T18:29:27.806739] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-09T18:29:27.808295] [DEBUG] [LOCAL ] DOCS: Trimmed 74100 records to 51323 (keeping 200 days of data) [2025-10-09T18:29:28.017991] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-09T18:29:28.130112] [DEBUG] [LOCAL ] DOCS: Primary data saved (51323 records). [2025-10-09T18:29:28.130273] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-09T18:29:28.131853] [INFO ] [MAIN ] Update Progress: 644/2373 symbols completed. DOCS took 34.8s. Estimated remaining: 4h 0m 3s. Rate: 7.2 symbols/min [2025-10-09T18:29:28.305138] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:28.321699] [DEBUG] [LOCAL ] DPG: Loaded 13460 existing records from primary storage. [2025-10-09T18:29:28.321936] [INFO ] [MAIN ] DPG: Loaded 13460 existing records. [2025-10-09T18:29:28.505430] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:28.505823] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-09T18:29:28.505887] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-09T18:29:28.506083] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-09T18:29:28.506140] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-09T18:29:28.802378] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-09T18:29:28.878747] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:28.902871] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T18:29:29.136377] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:29:29.596786] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-09T18:29:30.396722] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-09T18:29:30.592049] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T18:29:30.838899] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T18:29:31.196739] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-09T18:29:31.829576] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T18:29:31.869234] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:29:31.996709] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-09T18:29:32.796750] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-09T18:29:33.337148] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T18:29:33.351491] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T18:29:33.596770] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-09T18:29:34.332627] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T18:29:34.396712] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-09T18:29:35.097053] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T18:29:35.196734] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-09T18:29:35.996727] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-09T18:29:36.796700] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-09T18:29:36.889515] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T18:29:37.551154] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T18:29:37.589059] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T18:29:37.596666] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-09T18:29:38.396720] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-09T18:29:38.465331] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T18:29:39.196811] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-09T18:29:39.588976] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:29:39.996725] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-09T18:29:40.237342] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:29:40.796717] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-09T18:29:41.596698] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-09T18:29:41.742850] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:29:41.808010] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T18:29:42.215518] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T18:29:42.396697] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-09T18:29:43.093070] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T18:29:43.196771] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-09T18:29:43.996700] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-09T18:29:44.024248] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T18:29:44.796739] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-09T18:29:45.596716] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-09T18:29:45.910427] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:29:45.970733] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-09T18:29:46.396715] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-09T18:29:47.137750] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:29:47.196721] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-09T18:29:47.484838] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T18:29:47.946016] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T18:29:47.947865] [INFO ] [REMOTE ] DPG: Full fetch complete (18924 records). [2025-10-09T18:29:47.947996] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-09T18:29:48.005117] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-09T18:29:48.341746] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-09T18:29:48.341828] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-09T18:29:48.342247] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-09T18:29:48.342309] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-09T18:29:48.343122] [DEBUG] [LOCAL ] DPG: Trimmed 18924 records to 13621 (keeping 200 days of data) [2025-10-09T18:29:48.429188] [DEBUG] [LOCAL ] DPG: Primary data saved (13621 records). [2025-10-09T18:29:48.429351] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-09T18:29:48.429465] [INFO ] [MAIN ] Update Progress: 645/2373 symbols completed. DPG took 20.3s. Estimated remaining: 4h 0m 26s. Rate: 7.2 symbols/min [2025-10-09T18:29:48.595965] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:48.638934] [DEBUG] [LOCAL ] DQ: Loaded 43500 existing records from primary storage. [2025-10-09T18:29:48.639222] [INFO ] [MAIN ] DQ: Loaded 43500 existing records. [2025-10-09T18:29:48.808825] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-09T18:29:48.813597] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:48.814835] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-09T18:29:48.814937] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-09T18:29:48.815240] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-09T18:29:48.815299] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-09T18:29:49.114907] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T18:29:49.147712] [INFO ] [REMOTE ] DOUG: Full fetch complete (50781 records). [2025-10-09T18:29:49.159696] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-09T18:29:49.191681] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:49.565729] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-09T18:29:49.565814] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-09T18:29:49.566493] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-09T18:29:49.566534] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-09T18:29:49.567573] [DEBUG] [LOCAL ] DOUG: Trimmed 50781 records to 34675 (keeping 200 days of data) [2025-10-09T18:29:49.611487] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-09T18:29:49.763712] [DEBUG] [LOCAL ] DOUG: Primary data saved (34675 records). [2025-10-09T18:29:49.763842] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-09T18:29:49.764358] [INFO ] [MAIN ] Update Progress: 646/2373 symbols completed. DOUG took 26.3s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-09T18:29:49.937555] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:49.975693] [DEBUG] [LOCAL ] DRD: Loaded 37231 existing records from primary storage. [2025-10-09T18:29:49.975976] [INFO ] [MAIN ] DRD: Loaded 37231 existing records. [2025-10-09T18:29:50.153013] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:50.153253] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-09T18:29:50.153303] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-09T18:29:50.153682] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-09T18:29:50.153742] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-09T18:29:50.404251] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-09T18:29:50.551731] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:50.756189] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-09T18:29:51.196697] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-09T18:29:51.234002] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:29:51.885936] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T18:29:51.996697] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-09T18:29:52.459628] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T18:29:52.796698] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-09T18:29:53.398782] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T18:29:53.596686] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-09T18:29:53.659765] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:29:54.396768] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-09T18:29:54.981212] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T18:29:55.196757] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-09T18:29:55.598638] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T18:29:55.996723] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-09T18:29:56.796672] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-09T18:29:57.033484] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T18:29:57.262806] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:29:57.596724] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-09T18:29:58.149552] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T18:29:58.396781] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-09T18:29:59.014273] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T18:29:59.196707] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-09T18:29:59.777606] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T18:29:59.996757] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-09T18:30:00.532201] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:30:00.796744] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-09T18:30:01.533840] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T18:30:01.596699] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-09T18:30:01.881450] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:30:02.396800] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-09T18:30:02.858877] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T18:30:02.862877] [INFO ] [REMOTE ] DOV: Full fetch complete (65320 records). [2025-10-09T18:30:02.863042] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-09T18:30:03.201813] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-09T18:30:03.269638] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-09T18:30:03.269845] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-09T18:30:03.270693] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-09T18:30:03.270759] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-09T18:30:03.272108] [DEBUG] [LOCAL ] DOV: Trimmed 65320 records to 45846 (keeping 200 days of data) [2025-10-09T18:30:03.563162] [DEBUG] [LOCAL ] DOV: Primary data saved (45846 records). [2025-10-09T18:30:03.563297] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-09T18:30:03.563381] [INFO ] [MAIN ] Update Progress: 647/2373 symbols completed. DOV took 38.0s. Estimated remaining: 4h 0m 6s. Rate: 7.2 symbols/min [2025-10-09T18:30:03.738481] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:03.784838] [DEBUG] [LOCAL ] DRH: Loaded 50450 existing records from primary storage. [2025-10-09T18:30:03.785292] [INFO ] [MAIN ] DRH: Loaded 50450 existing records. [2025-10-09T18:30:03.931546] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T18:30:03.997245] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-09T18:30:04.001020] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:04.002418] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-09T18:30:04.002483] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-09T18:30:04.002780] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-09T18:30:04.002839] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-09T18:30:04.378077] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:04.796720] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-09T18:30:05.309353] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T18:30:05.596729] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-09T18:30:05.914344] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:30:06.361632] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:30:06.396717] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-09T18:30:07.196683] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-09T18:30:07.367921] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:30:07.715597] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:30:07.996727] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-09T18:30:08.578915] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T18:30:08.796758] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-09T18:30:09.392829] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:30:09.596734] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-09T18:30:10.396704] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-09T18:30:10.566142] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T18:30:11.196702] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-09T18:30:11.680115] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-09T18:30:11.914964] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:30:11.996669] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-09T18:30:12.796684] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-09T18:30:12.911566] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T18:30:12.915686] [INFO ] [REMOTE ] DQ: Full fetch complete (63224 records). [2025-10-09T18:30:12.915825] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-09T18:30:13.294341] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-09T18:30:13.294429] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-09T18:30:13.295245] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-09T18:30:13.295313] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-09T18:30:13.296603] [DEBUG] [LOCAL ] DQ: Trimmed 63224 records to 43865 (keeping 200 days of data) [2025-10-09T18:30:13.594375] [DEBUG] [LOCAL ] DQ: Primary data saved (43865 records). [2025-10-09T18:30:13.594578] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-09T18:30:13.596014] [INFO ] [MAIN ] Update Progress: 648/2373 symbols completed. DQ took 25.2s. Estimated remaining: 4h 0m 2s. Rate: 7.2 symbols/min [2025-10-09T18:30:13.601495] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-09T18:30:13.849307] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:13.917699] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T18:30:13.998115] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T18:30:14.047449] [DEBUG] [LOCAL ] DRI: Loaded 47675 existing records from primary storage. [2025-10-09T18:30:14.048203] [INFO ] [MAIN ] DRI: Loaded 47675 existing records. [2025-10-09T18:30:14.280149] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:14.280410] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-09T18:30:14.280461] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-09T18:30:14.280874] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-09T18:30:14.280957] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-09T18:30:14.397925] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-09T18:30:14.678132] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:15.196753] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-09T18:30:15.988280] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-09T18:30:15.998933] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-09T18:30:16.067077] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T18:30:16.796703] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-09T18:30:17.002836] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T18:30:17.379494] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T18:30:17.596775] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-09T18:30:18.324010] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T18:30:18.396676] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-09T18:30:19.196769] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-09T18:30:19.789435] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T18:30:19.996727] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-09T18:30:20.229418] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T18:30:20.774039] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T18:30:20.796688] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-09T18:30:21.289933] [DEBUG] [REMOTE ] DRI: Error fetching primary data for 2025-01: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-09T18:30:21.290087] [WARN ] [REMOTE ] DRI: No data returned for month 2025-01 [2025-10-09T18:30:21.290159] [FATAL] [REMOTE ] DRI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:30:21.290202] [FATAL] [MAIN ] DRI: Failed to fetch primary data. [2025-10-09T18:30:21.290234] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:30:21.290272] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-09T18:30:21.290326] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-09T18:30:21.290361] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-09T18:30:21.290696] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-10-09T18:30:21.290779] [INFO ] [MAIN ] Update Progress: 649/2373 symbols completed. DRI took 7.7s. Estimated remaining: 3h 59m 52s. Rate: 7.2 symbols/min [2025-10-09T18:30:21.459132] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:21.470849] [DEBUG] [LOCAL ] DRLL: Loaded 9289 existing records from primary storage. [2025-10-09T18:30:21.471102] [INFO ] [MAIN ] DRLL: Loaded 9289 existing records. [2025-10-09T18:30:21.601891] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-09T18:30:21.657103] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:21.657269] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-09T18:30:21.657324] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-09T18:30:21.657513] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-09T18:30:21.657567] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-09T18:30:22.011289] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:22.050442] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:30:22.396815] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-09T18:30:22.907893] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T18:30:23.196757] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-09T18:30:23.996730] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-09T18:30:24.225557] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T18:30:24.796688] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-09T18:30:24.899678] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T18:30:25.412286] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T18:30:25.596751] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-09T18:30:26.002028] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T18:30:26.396721] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-09T18:30:27.196717] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-09T18:30:27.537451] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T18:30:27.996710] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-09T18:30:28.322500] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-09T18:30:28.326356] [INFO ] [REMOTE ] DRD: Full fetch complete (50619 records). [2025-10-09T18:30:28.326469] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-09T18:30:28.706584] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T18:30:28.726810] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-09T18:30:28.726870] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-09T18:30:28.727547] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-09T18:30:28.727587] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-09T18:30:28.728619] [DEBUG] [LOCAL ] DRD: Trimmed 50619 records to 37578 (keeping 200 days of data) [2025-10-09T18:30:28.820051] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-09T18:30:28.969686] [DEBUG] [LOCAL ] DRD: Primary data saved (37578 records). [2025-10-09T18:30:28.969849] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-09T18:30:28.970513] [INFO ] [MAIN ] Update Progress: 650/2373 symbols completed. DRD took 39.2s. Estimated remaining: 3h 59m 42s. Rate: 7.2 symbols/min [2025-10-09T18:30:29.140000] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:29.170814] [DEBUG] [LOCAL ] DSL: Loaded 28586 existing records from primary storage. [2025-10-09T18:30:29.171102] [INFO ] [MAIN ] DSL: Loaded 28586 existing records. [2025-10-09T18:30:29.355941] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:29.356246] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-09T18:30:29.356353] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-09T18:30:29.356757] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-09T18:30:29.356818] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-09T18:30:29.528125] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T18:30:29.600976] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-09T18:30:29.604744] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-09T18:30:29.802713] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:30.396739] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-09T18:30:31.144112] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T18:30:31.196674] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-09T18:30:31.333127] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-09T18:30:31.337764] [INFO ] [REMOTE ] DRH: Full fetch complete (71897 records). [2025-10-09T18:30:31.337940] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-09T18:30:31.758202] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-09T18:30:31.758292] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-09T18:30:31.759245] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-09T18:30:31.759312] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-09T18:30:31.760742] [DEBUG] [LOCAL ] DRH: Trimmed 71897 records to 50811 (keeping 200 days of data) [2025-10-09T18:30:31.947582] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T18:30:31.998560] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-09T18:30:32.075125] [DEBUG] [LOCAL ] DRH: Primary data saved (50811 records). [2025-10-09T18:30:32.075263] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-09T18:30:32.075361] [INFO ] [MAIN ] Update Progress: 651/2373 symbols completed. DRH took 28.5s. Estimated remaining: 3h 59m 19s. Rate: 7.2 symbols/min [2025-10-09T18:30:32.242516] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:32.242721] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-10-09T18:30:32.242777] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-10-09T18:30:32.242899] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-09T18:30:32.242945] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-09T18:30:32.242987] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-09T18:30:32.243019] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-09T18:30:32.598061] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:32.796748] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-09T18:30:33.498400] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T18:30:33.596689] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-09T18:30:34.060456] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-09T18:30:34.065081] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-09T18:30:34.065217] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-09T18:30:34.405225] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-09T18:30:34.470120] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-09T18:30:34.470370] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-09T18:30:34.471456] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-09T18:30:34.475107] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-09T18:30:34.479420] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T18:30:34.483398] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54123 (keeping 200 days of data) [2025-10-09T18:30:34.813441] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-10-09T18:30:34.813581] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-09T18:30:34.813682] [INFO ] [MAIN ] Update Progress: 652/2373 symbols completed. DOW took 1m 9s. Estimated remaining: 3h 58m 56s. Rate: 7.2 symbols/min [2025-10-09T18:30:34.984202] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:34.989407] [DEBUG] [LOCAL ] DSMC: Loaded 1842 existing records from primary storage. [2025-10-09T18:30:34.989594] [INFO ] [MAIN ] DSMC: Loaded 1842 existing records. [2025-10-09T18:30:35.169343] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:35.169623] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-09T18:30:35.169706] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-09T18:30:35.169903] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-09T18:30:35.169961] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-09T18:30:35.201825] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-09T18:30:35.545680] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:35.555943] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T18:30:35.784143] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-09T18:30:35.996746] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-09T18:30:36.796728] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-09T18:30:37.258926] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T18:30:37.596726] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-09T18:30:37.752335] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T18:30:38.396725] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-09T18:30:38.496617] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T18:30:38.989415] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:30:39.196780] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-09T18:30:39.678603] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T18:30:39.996740] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-09T18:30:40.432205] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-09T18:30:40.796714] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-09T18:30:41.123826] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T18:30:41.596755] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-09T18:30:42.396694] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-09T18:30:42.791602] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:30:43.196760] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-09T18:30:43.326290] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T18:30:43.996713] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-09T18:30:44.311275] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T18:30:44.335315] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-09T18:30:44.796730] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-09T18:30:45.533456] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:30:45.596707] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-09T18:30:46.396726] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-09T18:30:46.766062] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T18:30:47.196687] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-09T18:30:47.474046] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:30:47.475351] [INFO ] [REMOTE ] DRLL: Full fetch complete (14984 records). [2025-10-09T18:30:47.475456] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-09T18:30:47.851742] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-09T18:30:47.851824] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-09T18:30:47.852145] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-09T18:30:47.852183] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-09T18:30:47.852710] [DEBUG] [LOCAL ] DRLL: Trimmed 14984 records to 9351 (keeping 200 days of data) [2025-10-09T18:30:47.912723] [DEBUG] [LOCAL ] DRLL: Primary data saved (9351 records). [2025-10-09T18:30:47.912862] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-09T18:30:47.912949] [INFO ] [MAIN ] Update Progress: 653/2373 symbols completed. DRLL took 26.6s. Estimated remaining: 3h 59m 0s. Rate: 7.2 symbols/min [2025-10-09T18:30:48.001803] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-09T18:30:48.083168] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:48.107200] [DEBUG] [LOCAL ] DSU: Loaded 22858 existing records from primary storage. [2025-10-09T18:30:48.107453] [INFO ] [MAIN ] DSU: Loaded 22858 existing records. [2025-10-09T18:30:48.286430] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:48.286738] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-09T18:30:48.286814] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-09T18:30:48.287264] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-09T18:30:48.287332] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-09T18:30:48.483705] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T18:30:48.674220] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:48.796678] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-09T18:30:49.151158] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T18:30:49.561799] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T18:30:49.596710] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-09T18:30:50.396744] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-09T18:30:50.676776] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:30:50.907898] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T18:30:51.196782] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-09T18:30:51.717368] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T18:30:51.996750] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-09T18:30:52.796760] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-09T18:30:52.836906] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T18:30:53.217488] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-09T18:30:53.596721] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-09T18:30:53.902906] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-09T18:30:54.396740] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-09T18:30:55.125805] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T18:30:55.196675] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-09T18:30:55.992079] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T18:30:55.996673] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-09T18:30:56.628988] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:30:56.796728] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-09T18:30:57.596694] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-09T18:30:57.705050] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T18:30:58.396715] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-09T18:30:58.607434] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:30:58.737665] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T18:30:59.196742] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-09T18:30:59.996717] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-09T18:31:00.161995] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:31:00.796737] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-09T18:31:00.904878] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T18:31:00.906393] [INFO ] [REMOTE ] DSM: Full fetch complete (24086 records). [2025-10-09T18:31:00.906465] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-09T18:31:01.275694] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-09T18:31:01.275788] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-09T18:31:01.276268] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-09T18:31:01.276309] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-09T18:31:01.277318] [DEBUG] [LOCAL ] DSM: Trimmed 24086 records to 14667 (keeping 200 days of data) [2025-10-09T18:31:01.342632] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:31:01.370601] [DEBUG] [LOCAL ] DSM: Primary data saved (14667 records). [2025-10-09T18:31:01.370800] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-09T18:31:01.370887] [INFO ] [MAIN ] Update Progress: 654/2373 symbols completed. DSM took 29.3s. Estimated remaining: 3h 59m 6s. Rate: 7.2 symbols/min [2025-10-09T18:31:01.552079] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:01.552260] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-10-09T18:31:01.552299] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-10-09T18:31:01.552438] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-09T18:31:01.552481] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-09T18:31:01.552561] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-09T18:31:01.552610] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-09T18:31:01.602027] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-09T18:31:01.949762] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:02.396693] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-09T18:31:02.571226] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T18:31:02.827135] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T18:31:03.196749] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-09T18:31:03.680471] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T18:31:03.681204] [INFO ] [REMOTE ] DSMC: Full fetch complete (2838 records). [2025-10-09T18:31:03.681322] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-09T18:31:04.001841] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-09T18:31:04.030875] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-09T18:31:04.031691] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-09T18:31:04.031822] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-09T18:31:04.031865] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-09T18:31:04.032210] [DEBUG] [LOCAL ] DSMC: Trimmed 2838 records to 1848 (keeping 200 days of data) [2025-10-09T18:31:04.044298] [DEBUG] [LOCAL ] DSMC: Primary data saved (1848 records). [2025-10-09T18:31:04.044372] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-09T18:31:04.044443] [INFO ] [MAIN ] Update Progress: 655/2373 symbols completed. DSMC took 29.2s. Estimated remaining: 3h 58m 42s. Rate: 7.2 symbols/min [2025-10-09T18:31:04.242274] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:04.296893] [DEBUG] [LOCAL ] DT: Loaded 52944 existing records from primary storage. [2025-10-09T18:31:04.297270] [INFO ] [MAIN ] DT: Loaded 52944 existing records. [2025-10-09T18:31:04.485843] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:04.486108] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-09T18:31:04.486175] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-09T18:31:04.486541] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-09T18:31:04.486621] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-09T18:31:04.804271] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-09T18:31:04.923985] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:05.198072] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T18:31:05.596735] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-09T18:31:05.684965] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T18:31:06.396737] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-09T18:31:07.202760] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-09T18:31:07.216736] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:31:07.747270] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T18:31:07.996734] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-09T18:31:08.238768] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:31:08.796701] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-09T18:31:09.596755] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-09T18:31:09.844765] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T18:31:09.934773] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:31:10.396717] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-09T18:31:11.111339] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T18:31:11.196724] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-09T18:31:11.707412] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:31:11.996719] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-09T18:31:12.367887] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T18:31:12.796731] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-09T18:31:13.248154] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T18:31:13.250943] [INFO ] [REMOTE ] DSL: Full fetch complete (41456 records). [2025-10-09T18:31:13.251063] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-09T18:31:13.602742] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-09T18:31:13.641268] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-09T18:31:13.641336] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-09T18:31:13.642063] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-09T18:31:13.642200] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-09T18:31:13.643560] [DEBUG] [LOCAL ] DSL: Trimmed 41456 records to 28765 (keeping 200 days of data) [2025-10-09T18:31:13.828455] [DEBUG] [LOCAL ] DSL: Primary data saved (28765 records). [2025-10-09T18:31:13.828614] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-09T18:31:13.829254] [INFO ] [MAIN ] Update Progress: 656/2373 symbols completed. DSL took 44.9s. Estimated remaining: 3h 58m 38s. Rate: 7.2 symbols/min [2025-10-09T18:31:14.002628] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:14.014489] [DEBUG] [LOCAL ] DTB: Loaded 5032 existing records from primary storage. [2025-10-09T18:31:14.014741] [INFO ] [MAIN ] DTB: Loaded 5032 existing records. [2025-10-09T18:31:14.194372] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:14.194768] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-09T18:31:14.194841] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-09T18:31:14.195091] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-09T18:31:14.195150] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-09T18:31:14.415305] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-09T18:31:14.639020] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:14.641580] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T18:31:14.708090] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:31:15.196761] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-09T18:31:15.394379] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:31:15.828255] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T18:31:15.996754] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-09T18:31:16.470547] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:31:16.796766] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-09T18:31:17.596755] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-09T18:31:17.867088] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T18:31:18.396710] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-09T18:31:18.905464] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:31:19.196718] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-09T18:31:19.417693] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:31:19.562452] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T18:31:19.996733] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-09T18:31:20.796701] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-09T18:31:21.006208] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T18:31:21.008634] [INFO ] [REMOTE ] DSU: Full fetch complete (32917 records). [2025-10-09T18:31:21.008745] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-09T18:31:21.395907] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T18:31:21.484219] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-09T18:31:21.484300] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-09T18:31:21.484911] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-09T18:31:21.484974] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-09T18:31:21.485720] [DEBUG] [LOCAL ] DSU: Trimmed 32917 records to 23027 (keeping 200 days of data) [2025-10-09T18:31:21.599040] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-09T18:31:21.650158] [DEBUG] [LOCAL ] DSU: Primary data saved (23027 records). [2025-10-09T18:31:21.650340] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-09T18:31:21.650471] [INFO ] [MAIN ] Update Progress: 657/2373 symbols completed. DSU took 33.7s. Estimated remaining: 3h 58m 28s. Rate: 7.2 symbols/min [2025-10-09T18:31:21.897205] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:21.965269] [DEBUG] [LOCAL ] DTE: Loaded 47531 existing records from primary storage. [2025-10-09T18:31:21.965748] [INFO ] [MAIN ] DTE: Loaded 47531 existing records. [2025-10-09T18:31:22.151755] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T18:31:22.268970] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:22.269242] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-09T18:31:22.269300] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-09T18:31:22.269732] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-09T18:31:22.269792] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-09T18:31:22.401869] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-09T18:31:22.811140] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:23.196784] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-09T18:31:23.996722] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-09T18:31:24.201157] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:31:24.424130] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T18:31:24.796735] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-09T18:31:25.601846] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-09T18:31:25.617099] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:31:25.831582] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T18:31:26.396780] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-09T18:31:26.946170] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:31:27.196692] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-09T18:31:27.893289] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T18:31:27.996682] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-09T18:31:28.396579] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:31:28.796772] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-09T18:31:29.563794] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:31:29.596695] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-09T18:31:30.254899] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-09T18:31:30.396719] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-09T18:31:30.482424] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:31:31.064105] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-09T18:31:31.196723] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-09T18:31:31.996734] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-09T18:31:32.796680] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-09T18:31:32.838536] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T18:31:33.012955] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T18:31:33.596712] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-09T18:31:34.396745] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-09T18:31:34.537373] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T18:31:34.958091] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:31:35.196760] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-09T18:31:35.996790] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-09T18:31:36.166622] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T18:31:36.414785] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-09T18:31:36.460618] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T18:31:36.796717] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-09T18:31:37.596800] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-09T18:31:38.396791] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-09T18:31:38.409161] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T18:31:39.196701] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-09T18:31:39.325256] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T18:31:39.579413] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T18:31:39.996731] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-09T18:31:40.632242] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T18:31:40.729446] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T18:31:40.796694] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-09T18:31:41.596705] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-09T18:31:41.681564] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T18:31:42.396739] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-09T18:31:43.197036] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-09T18:31:43.412766] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T18:31:43.429127] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T18:31:43.431400] [INFO ] [REMOTE ] DSX: Full fetch complete (36001 records). [2025-10-09T18:31:43.431480] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-09T18:31:43.815574] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-09T18:31:43.815681] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-09T18:31:43.816268] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-09T18:31:43.816329] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-09T18:31:43.817276] [DEBUG] [LOCAL ] DSX: Trimmed 36001 records to 24199 (keeping 200 days of data) [2025-10-09T18:31:43.963543] [DEBUG] [LOCAL ] DSX: Primary data saved (24199 records). [2025-10-09T18:31:43.963741] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-09T18:31:43.963868] [INFO ] [MAIN ] Update Progress: 658/2373 symbols completed. DSX took 42.6s. Estimated remaining: 3h 58m 56s. Rate: 7.2 symbols/min [2025-10-09T18:31:44.001805] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-09T18:31:44.041059] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T18:31:44.153216] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:44.153414] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-09T18:31:44.153458] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-09T18:31:44.153587] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-09T18:31:44.153696] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-09T18:31:44.153791] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-09T18:31:44.153847] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-09T18:31:44.516861] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:44.796703] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-09T18:31:45.222261] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-09T18:31:45.596733] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-09T18:31:45.745049] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:31:45.749515] [INFO ] [REMOTE ] DT: Full fetch complete (76665 records). [2025-10-09T18:31:45.749634] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-09T18:31:46.140688] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-09T18:31:46.140800] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-09T18:31:46.141733] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-09T18:31:46.141798] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-09T18:31:46.143246] [DEBUG] [LOCAL ] DT: Trimmed 76665 records to 53326 (keeping 200 days of data) [2025-10-09T18:31:46.231065] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:31:46.233945] [INFO ] [REMOTE ] DTB: Full fetch complete (6830 records). [2025-10-09T18:31:46.234317] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-09T18:31:46.401461] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-09T18:31:46.741200] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-09T18:31:46.747683] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-09T18:31:46.750137] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-09T18:31:46.751100] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-09T18:31:46.759701] [DEBUG] [LOCAL ] DTB: Trimmed 6830 records to 5053 (keeping 200 days of data) [2025-10-09T18:31:46.841179] [DEBUG] [LOCAL ] DTB: Primary data saved (5053 records). [2025-10-09T18:31:46.858843] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-09T18:31:46.859001] [INFO ] [MAIN ] Update Progress: 659/2373 symbols completed. DTB took 33.0s. Estimated remaining: 3h 58m 34s. Rate: 7.2 symbols/min [2025-10-09T18:31:47.030780] [DEBUG] [LOCAL ] DT: Primary data saved (53326 records). [2025-10-09T18:31:47.044333] [INFO ] [MAIN ] DT: Full history saved. [2025-10-09T18:31:47.045381] [INFO ] [MAIN ] Update Progress: 660/2373 symbols completed. DT took 43.0s. Estimated remaining: 3h 58m 4s. Rate: 7.2 symbols/min [2025-10-09T18:31:47.108018] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:47.201444] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-09T18:31:47.233243] [DEBUG] [LOCAL ] DTG: Loaded 5856 existing records from primary storage. [2025-10-09T18:31:47.254000] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:47.254532] [INFO ] [MAIN ] DTG: Loaded 5856 existing records. [2025-10-09T18:31:47.254761] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-09T18:31:47.287551] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-09T18:31:47.327310] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-09T18:31:47.338803] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-09T18:31:47.361442] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-09T18:31:47.361499] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-09T18:31:47.584897] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:47.605907] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-09T18:31:47.622578] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-09T18:31:47.648247] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-09T18:31:47.672435] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-09T18:31:47.743046] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-09T18:31:47.931903] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:48.003283] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-09T18:31:48.211119] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:48.222804] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T18:31:48.233725] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:31:48.233990] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-09T18:31:48.234096] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:31:48.234161] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-09T18:31:48.234222] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:31:48.234294] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-09T18:31:48.234369] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-09T18:31:48.234445] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-09T18:31:48.234535] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-09T18:31:48.234605] [INFO ] [MAIN ] Update Progress: 661/2373 symbols completed. DTK took 1.2s. Estimated remaining: 3h 57m 37s. Rate: 7.2 symbols/min [2025-10-09T18:31:48.402272] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:48.444237] [DEBUG] [LOCAL ] DTM: Loaded 44082 existing records from primary storage. [2025-10-09T18:31:48.444526] [INFO ] [MAIN ] DTM: Loaded 44082 existing records. [2025-10-09T18:31:48.619849] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:48.620032] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-09T18:31:48.620080] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-09T18:31:48.620302] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-09T18:31:48.620373] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-09T18:31:48.806291] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-09T18:31:48.979894] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:49.596724] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-09T18:31:49.943810] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T18:31:50.396699] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-09T18:31:50.439284] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T18:31:50.509883] [DEBUG] [REMOTE ] DTM: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-09T18:31:50.510189] [WARN ] [REMOTE ] DTM: No data returned for month 2024-12 [2025-10-09T18:31:50.510269] [FATAL] [REMOTE ] DTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:31:50.510320] [FATAL] [MAIN ] DTM: Failed to fetch primary data. [2025-10-09T18:31:50.510377] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:31:50.510448] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-09T18:31:50.510510] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-09T18:31:50.510544] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-09T18:31:50.510813] [DEBUG] [LOCAL ] DTM: Deleted derivative data file. [2025-10-09T18:31:50.510901] [INFO ] [MAIN ] Update Progress: 662/2373 symbols completed. DTM took 2.3s. Estimated remaining: 3h 57m 13s. Rate: 7.2 symbols/min [2025-10-09T18:31:50.683127] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:50.683260] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-09T18:31:50.683297] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-09T18:31:50.683406] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-09T18:31:50.683447] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-09T18:31:50.683488] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-09T18:31:50.683519] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-09T18:31:51.083911] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:51.196729] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-09T18:31:51.996691] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-09T18:31:52.031254] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T18:31:52.796690] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-09T18:31:52.911307] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T18:31:53.596725] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-09T18:31:54.068585] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:31:54.238785] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T18:31:54.242279] [INFO ] [REMOTE ] DTE: Full fetch complete (68449 records). [2025-10-09T18:31:54.242382] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-09T18:31:54.243152] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:31:54.243253] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:31:54.243330] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:31:54.243466] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-09T18:31:54.243557] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-09T18:31:54.243614] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-10-09T18:31:54.243820] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-10-09T18:31:54.244735] [INFO ] [MAIN ] Update Progress: 663/2373 symbols completed. DTE took 32.6s. Estimated remaining: 3h 56m 53s. Rate: 7.2 symbols/min [2025-10-09T18:31:54.410383] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-09T18:31:54.413916] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:54.475981] [DEBUG] [LOCAL ] DUK: Loaded 53445 existing records from primary storage. [2025-10-09T18:31:54.476303] [INFO ] [MAIN ] DUK: Loaded 53445 existing records. [2025-10-09T18:31:54.653195] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:54.653419] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-09T18:31:54.653475] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-09T18:31:54.653746] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-09T18:31:54.653813] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-09T18:31:55.034982] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T18:31:55.039035] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:55.196714] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-09T18:31:55.690171] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T18:31:55.996732] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-09T18:31:56.472478] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-09T18:31:56.796703] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-09T18:31:57.242436] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:31:57.596762] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-09T18:31:58.396730] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-09T18:31:58.868798] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T18:31:59.196691] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-09T18:31:59.386931] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T18:31:59.476511] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-09T18:31:59.996721] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-09T18:32:00.474409] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T18:32:00.796735] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-09T18:32:01.303794] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T18:32:01.596721] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-09T18:32:02.183073] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:32:02.396737] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-09T18:32:02.795351] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T18:32:03.196729] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-09T18:32:03.794520] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T18:32:03.795292] [INFO ] [REMOTE ] DTF: Full fetch complete (1899 records). [2025-10-09T18:32:03.795360] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-09T18:32:03.979551] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-09T18:32:03.979733] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:32:03.979803] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:32:03.979879] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-09T18:32:03.979970] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-09T18:32:03.980030] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-09T18:32:03.980093] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-09T18:32:03.980200] [INFO ] [MAIN ] Update Progress: 664/2373 symbols completed. DTF took 20.0s. Estimated remaining: 3h 56m 48s. Rate: 7.2 symbols/min [2025-10-09T18:32:04.001838] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-09T18:32:04.156286] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:04.156472] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-09T18:32:04.156509] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-09T18:32:04.156623] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-09T18:32:04.156698] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-09T18:32:04.156754] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-09T18:32:04.156788] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-09T18:32:04.549155] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:04.796725] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-09T18:32:05.223591] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T18:32:05.596699] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-09T18:32:05.822745] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T18:32:06.180326] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T18:32:06.396697] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-09T18:32:07.105710] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T18:32:07.196698] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-09T18:32:07.695386] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-09T18:32:07.996702] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-09T18:32:08.589469] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T18:32:08.796704] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-09T18:32:09.596774] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-09T18:32:10.245469] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T18:32:10.396694] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-09T18:32:10.637404] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T18:32:10.822768] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T18:32:11.196732] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-09T18:32:11.884722] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T18:32:11.996696] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-09T18:32:12.614274] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T18:32:12.796713] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-09T18:32:13.596806] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-09T18:32:13.619418] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T18:32:14.034958] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T18:32:14.396731] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-09T18:32:14.968752] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T18:32:15.196794] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-09T18:32:15.803354] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T18:32:15.996748] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-09T18:32:16.796723] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-09T18:32:17.511861] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T18:32:17.584227] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T18:32:17.596671] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-09T18:32:18.396774] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-09T18:32:19.066846] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T18:32:19.196722] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-09T18:32:19.727287] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T18:32:19.728340] [INFO ] [REMOTE ] DTW: Full fetch complete (7365 records). [2025-10-09T18:32:19.728412] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-09T18:32:19.999810] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-09T18:32:20.096773] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-09T18:32:20.097006] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-09T18:32:20.097333] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-09T18:32:20.097448] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-09T18:32:20.098390] [DEBUG] [LOCAL ] DTW: Trimmed 7365 records to 4922 (keeping 200 days of data) [2025-10-09T18:32:20.130947] [DEBUG] [LOCAL ] DTW: Primary data saved (4922 records). [2025-10-09T18:32:20.131335] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-09T18:32:20.131454] [INFO ] [MAIN ] Update Progress: 665/2373 symbols completed. DTW took 29.6s. Estimated remaining: 3h 57m 0s. Rate: 7.2 symbols/min [2025-10-09T18:32:20.302977] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:20.347597] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-09T18:32:20.401963] [DEBUG] [LOCAL ] DV: Loaded 51300 existing records from primary storage. [2025-10-09T18:32:20.402309] [INFO ] [MAIN ] DV: Loaded 51300 existing records. [2025-10-09T18:32:20.601832] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:32:20.602052] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-09T18:32:20.602115] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-09T18:32:20.602449] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-09T18:32:20.602506] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-09T18:32:20.801935] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-09T18:32:20.872883] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T18:32:21.002908] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:21.502694] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T18:32:21.596683] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-09T18:32:22.396776] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-09T18:32:23.003898] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T18:32:23.067629] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T18:32:23.196729] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-09T18:32:23.996691] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-09T18:32:24.581129] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:32:24.796689] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-09T18:32:25.006082] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T18:32:25.181493] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-09T18:32:25.596718] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-09T18:32:26.176682] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T18:32:26.177580] [INFO ] [REMOTE ] DUKB: Full fetch complete (9361 records). [2025-10-09T18:32:26.177673] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-09T18:32:26.402232] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-09T18:32:26.585990] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-09T18:32:26.586074] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-09T18:32:26.586322] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-09T18:32:26.586362] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-09T18:32:26.586873] [DEBUG] [LOCAL ] DUKB: Trimmed 9361 records to 6397 (keeping 200 days of data) [2025-10-09T18:32:26.628288] [DEBUG] [LOCAL ] DUKB: Primary data saved (6397 records). [2025-10-09T18:32:26.628424] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-09T18:32:26.628498] [INFO ] [MAIN ] Update Progress: 666/2373 symbols completed. DUKB took 22.6s. Estimated remaining: 3h 56m 47s. Rate: 7.2 symbols/min [2025-10-09T18:32:26.807399] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:26.850407] [DEBUG] [LOCAL ] DVA: Loaded 41008 existing records from primary storage. [2025-10-09T18:32:26.850732] [INFO ] [MAIN ] DVA: Loaded 41008 existing records. [2025-10-09T18:32:27.096469] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T18:32:27.096056] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:32:27.099978] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-09T18:32:27.100028] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-09T18:32:27.100536] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-09T18:32:27.100605] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-09T18:32:27.200789] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-09T18:32:27.451095] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:27.996724] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-09T18:32:28.796691] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-09T18:32:28.836586] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T18:32:29.233856] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T18:32:29.260774] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T18:32:29.596754] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-09T18:32:30.215942] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:32:30.396791] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-09T18:32:30.871771] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T18:32:31.196766] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-09T18:32:31.996723] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-09T18:32:32.635552] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:32:32.646520] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T18:32:32.647793] [INFO ] [REMOTE ] DTG: Full fetch complete (8932 records). [2025-10-09T18:32:32.647896] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-09T18:32:32.801839] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-09T18:32:33.028957] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-09T18:32:33.029036] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-09T18:32:33.029243] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-09T18:32:33.029283] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-09T18:32:33.029706] [DEBUG] [LOCAL ] DTG: Trimmed 8932 records to 5881 (keeping 200 days of data) [2025-10-09T18:32:33.066668] [DEBUG] [LOCAL ] DTG: Primary data saved (5881 records). [2025-10-09T18:32:33.066777] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-09T18:32:33.066865] [INFO ] [MAIN ] Update Progress: 667/2373 symbols completed. DTG took 46.2s. Estimated remaining: 3h 56m 34s. Rate: 7.2 symbols/min [2025-10-09T18:32:33.236334] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:33.236500] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-09T18:32:33.236557] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-09T18:32:33.236761] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-09T18:32:33.236821] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-09T18:32:33.236866] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-09T18:32:33.236899] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-09T18:32:33.589160] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:33.596673] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-09T18:32:34.394696] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T18:32:34.404090] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-09T18:32:35.196733] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-09T18:32:35.528867] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T18:32:35.900913] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T18:32:35.996692] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-09T18:32:36.607707] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T18:32:36.796725] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-09T18:32:37.596740] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-09T18:32:37.926570] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-09T18:32:38.253220] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:32:38.396708] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-09T18:32:39.035446] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T18:32:39.196722] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-09T18:32:39.968186] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T18:32:39.996707] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-09T18:32:40.796709] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-09T18:32:41.056997] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T18:32:41.191737] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:32:41.596801] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-09T18:32:42.396713] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-09T18:32:43.132509] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-09T18:32:43.196686] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-09T18:32:43.661054] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:32:43.784526] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-09T18:32:43.996726] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-09T18:32:44.796727] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-09T18:32:44.946921] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:32:45.596684] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-09T18:32:46.081262] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T18:32:46.396732] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-09T18:32:46.690062] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T18:32:47.196737] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-09T18:32:47.996813] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-09T18:32:48.247330] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-09T18:32:48.579208] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-09T18:32:48.796682] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-09T18:32:48.903797] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T18:32:49.596718] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-09T18:32:49.980959] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T18:32:49.985442] [INFO ] [REMOTE ] DUK: Full fetch complete (77389 records). [2025-10-09T18:32:49.985557] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-09T18:32:50.374749] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-09T18:32:50.374829] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-09T18:32:50.375725] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-09T18:32:50.375789] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-09T18:32:50.377341] [DEBUG] [LOCAL ] DUK: Trimmed 77389 records to 53830 (keeping 200 days of data) [2025-10-09T18:32:50.433560] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-09T18:32:50.723952] [DEBUG] [LOCAL ] DUK: Primary data saved (53830 records). [2025-10-09T18:32:50.724092] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-09T18:32:50.725355] [INFO ] [MAIN ] Update Progress: 668/2373 symbols completed. DUK took 56.5s. Estimated remaining: 3h 56m 50s. Rate: 7.2 symbols/min [2025-10-09T18:32:50.901060] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:50.901401] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-09T18:32:50.901512] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-09T18:32:50.901991] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-09T18:32:50.902233] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-09T18:32:50.917970] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-09T18:32:50.930734] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-09T18:32:50.932942] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T18:32:51.200383] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-09T18:32:51.257337] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T18:32:51.339526] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:51.806934] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T18:32:51.996787] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-09T18:32:52.796704] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-09T18:32:53.225459] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-09T18:32:53.299091] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T18:32:53.596722] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-09T18:32:54.396706] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-09T18:32:54.672015] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T18:32:55.196762] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-09T18:32:55.379281] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T18:32:55.981864] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T18:32:55.996664] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-09T18:32:56.675010] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T18:32:56.796722] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-09T18:32:57.586791] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T18:32:57.596668] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-09T18:32:58.396716] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-09T18:32:58.712481] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:32:58.892616] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T18:32:58.896272] [INFO ] [REMOTE ] DVA: Full fetch complete (59775 records). [2025-10-09T18:32:58.896407] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-09T18:32:59.201817] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-09T18:32:59.291362] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-09T18:32:59.291461] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-09T18:32:59.292269] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-09T18:32:59.292335] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-09T18:32:59.293979] [DEBUG] [LOCAL ] DVA: Trimmed 59775 records to 41299 (keeping 200 days of data) [2025-10-09T18:32:59.545289] [DEBUG] [LOCAL ] DVA: Primary data saved (41299 records). [2025-10-09T18:32:59.545428] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-09T18:32:59.545544] [INFO ] [MAIN ] Update Progress: 669/2373 symbols completed. DVA took 32.9s. Estimated remaining: 3h 56m 43s. Rate: 7.2 symbols/min [2025-10-09T18:32:59.713767] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:59.758912] [DEBUG] [LOCAL ] DXC: Loaded 49857 existing records from primary storage. [2025-10-09T18:32:59.759211] [INFO ] [MAIN ] DXC: Loaded 49857 existing records. [2025-10-09T18:32:59.934273] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:32:59.934472] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-09T18:32:59.934519] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-09T18:32:59.934966] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-09T18:32:59.935025] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-09T18:32:59.998581] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-09T18:33:00.104083] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T18:33:00.181146] [INFO ] [REMOTE ] DV: Full fetch complete (73557 records). [2025-10-09T18:33:00.207447] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-09T18:33:00.456368] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:00.755372] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-09T18:33:00.755463] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-09T18:33:00.756438] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-09T18:33:00.756508] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-09T18:33:00.758162] [DEBUG] [LOCAL ] DV: Trimmed 73557 records to 51658 (keeping 200 days of data) [2025-10-09T18:33:00.808157] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-09T18:33:01.083110] [DEBUG] [LOCAL ] DV: Primary data saved (51658 records). [2025-10-09T18:33:01.083250] [INFO ] [MAIN ] DV: Full history saved. [2025-10-09T18:33:01.083333] [INFO ] [MAIN ] Update Progress: 670/2373 symbols completed. DV took 41.0s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-09T18:33:01.289428] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:01.329964] [DEBUG] [LOCAL ] DXYZ: Loaded 37113 existing records from primary storage. [2025-10-09T18:33:01.330341] [INFO ] [MAIN ] DXYZ: Loaded 37113 existing records. [2025-10-09T18:33:01.493183] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-09T18:33:01.585629] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:01.586000] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-09T18:33:01.586119] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-09T18:33:01.586486] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-09T18:33:01.586548] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-09T18:33:01.601950] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-09T18:33:01.990985] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-09T18:33:01.996905] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:02.396706] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-09T18:33:02.428055] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:33:03.086802] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T18:33:03.196700] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-09T18:33:03.996715] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-09T18:33:04.757137] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:33:04.761828] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-09T18:33:04.761992] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-09T18:33:04.805373] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-09T18:33:05.104248] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-09T18:33:05.237935] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-09T18:33:05.238055] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-09T18:33:05.239055] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-09T18:33:05.239135] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-09T18:33:05.240882] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54089 (keeping 200 days of data) [2025-10-09T18:33:05.362753] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T18:33:05.609628] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-09T18:33:05.650905] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-10-09T18:33:05.651077] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-09T18:33:05.651157] [INFO ] [MAIN ] Update Progress: 671/2373 symbols completed. DVN took 32.6s. Estimated remaining: 3h 55m 59s. Rate: 7.2 symbols/min [2025-10-09T18:33:05.829753] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:05.860212] [DEBUG] [LOCAL ] DY: Loaded 28554 existing records from primary storage. [2025-10-09T18:33:05.860509] [INFO ] [MAIN ] DY: Loaded 28554 existing records. [2025-10-09T18:33:06.036340] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:06.036584] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-09T18:33:06.036633] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-09T18:33:06.036903] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-09T18:33:06.036960] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-09T18:33:06.385093] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:06.396667] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-09T18:33:06.859508] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T18:33:07.055678] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:33:07.196817] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-09T18:33:07.669883] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T18:33:07.996749] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-09T18:33:08.796788] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-09T18:33:09.127686] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-09T18:33:09.596705] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-09T18:33:09.727316] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T18:33:09.763739] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:33:10.396754] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-09T18:33:11.196758] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-09T18:33:11.413741] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:33:11.782193] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T18:33:11.996741] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-09T18:33:12.796763] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-09T18:33:12.983348] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T18:33:13.596697] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-09T18:33:13.644741] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:33:14.004676] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:33:14.396784] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-09T18:33:15.104034] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:33:15.196711] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-09T18:33:15.920249] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:33:15.996748] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-09T18:33:16.541431] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T18:33:16.796780] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-09T18:33:16.930352] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T18:33:17.596778] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-09T18:33:18.396694] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-09T18:33:18.594198] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T18:33:19.196727] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-09T18:33:19.403145] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:33:19.480355] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T18:33:19.996778] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-09T18:33:20.796737] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-09T18:33:21.194381] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T18:33:21.428931] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T18:33:21.596700] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-09T18:33:22.396682] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-09T18:33:22.463068] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T18:33:23.196676] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-09T18:33:23.395380] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T18:33:23.576401] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T18:33:23.996722] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-09T18:33:24.706099] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:33:24.796684] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-09T18:33:25.596704] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-09T18:33:25.866503] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T18:33:25.897376] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T18:33:26.396732] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-09T18:33:27.196748] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-09T18:33:27.359852] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T18:33:27.775527] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T18:33:27.996771] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-09T18:33:28.802413] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-09T18:33:28.816035] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T18:33:29.595080] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T18:33:29.602304] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-09T18:33:29.952674] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T18:33:29.954972] [INFO ] [REMOTE ] DY: Full fetch complete (43742 records). [2025-10-09T18:33:29.955068] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-09T18:33:30.397032] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-09T18:33:30.414035] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-09T18:33:30.414192] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-09T18:33:30.415031] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-09T18:33:30.415102] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-09T18:33:30.416151] [DEBUG] [LOCAL ] DY: Trimmed 43742 records to 28668 (keeping 200 days of data) [2025-10-09T18:33:30.627545] [DEBUG] [LOCAL ] DY: Primary data saved (28668 records). [2025-10-09T18:33:30.627749] [INFO ] [MAIN ] DY: Full history saved. [2025-10-09T18:33:30.628633] [INFO ] [MAIN ] Update Progress: 672/2373 symbols completed. DY took 25.0s. Estimated remaining: 3h 56m 33s. Rate: 7.2 symbols/min [2025-10-09T18:33:30.821556] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:30.857111] [DEBUG] [LOCAL ] E: Loaded 33186 existing records from primary storage. [2025-10-09T18:33:30.857407] [INFO ] [MAIN ] E: Loaded 33186 existing records. [2025-10-09T18:33:31.057305] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:31.057765] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-09T18:33:31.057913] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-09T18:33:31.058312] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-09T18:33:31.058381] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-09T18:33:31.198143] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-09T18:33:31.302854] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T18:33:31.470744] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:31.996741] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-09T18:33:32.312757] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T18:33:32.796776] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-09T18:33:33.299898] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-09T18:33:33.304394] [INFO ] [REMOTE ] DX: Full fetch complete (75563 records). [2025-10-09T18:33:33.304513] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-09T18:33:33.491139] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T18:33:33.601817] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-09T18:33:33.733681] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-09T18:33:33.733776] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-09T18:33:33.734669] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-09T18:33:33.734734] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-09T18:33:33.736167] [DEBUG] [LOCAL ] DX: Trimmed 75563 records to 52858 (keeping 200 days of data) [2025-10-09T18:33:34.070774] [DEBUG] [LOCAL ] DX: Primary data saved (52858 records). [2025-10-09T18:33:34.070899] [INFO ] [MAIN ] DX: Full history saved. [2025-10-09T18:33:34.070986] [INFO ] [MAIN ] Update Progress: 673/2373 symbols completed. DX took 43.3s. Estimated remaining: 3h 56m 12s. Rate: 7.2 symbols/min [2025-10-09T18:33:34.248614] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:34.290743] [DEBUG] [LOCAL ] EAF: Loaded 42154 existing records from primary storage. [2025-10-09T18:33:34.291102] [INFO ] [MAIN ] EAF: Loaded 42154 existing records. [2025-10-09T18:33:34.398511] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-09T18:33:34.545226] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T18:33:34.550501] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:34.551277] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-09T18:33:34.561035] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-09T18:33:34.561531] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-09T18:33:34.561602] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-09T18:33:34.996983] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:35.026735] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:33:35.196714] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-09T18:33:35.996768] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-09T18:33:36.175117] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T18:33:36.179048] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57467 records). [2025-10-09T18:33:36.179157] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-09T18:33:36.563238] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-09T18:33:36.563322] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-09T18:33:36.564096] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-09T18:33:36.564161] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-09T18:33:36.565320] [DEBUG] [LOCAL ] DXYZ: Trimmed 57467 records to 37365 (keeping 200 days of data) [2025-10-09T18:33:36.795462] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37365 records). [2025-10-09T18:33:36.795639] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-09T18:33:36.795777] [INFO ] [MAIN ] Update Progress: 674/2373 symbols completed. DXYZ took 35.7s. Estimated remaining: 3h 55m 50s. Rate: 7.2 symbols/min [2025-10-09T18:33:36.829203] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-09T18:33:36.979381] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:37.010944] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T18:33:37.024292] [DEBUG] [LOCAL ] EAI: Loaded 4002 existing records from primary storage. [2025-10-09T18:33:37.024515] [INFO ] [MAIN ] EAI: Loaded 4002 existing records. [2025-10-09T18:33:37.201166] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:37.201376] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-09T18:33:37.201423] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-09T18:33:37.201612] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-09T18:33:37.201703] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-09T18:33:37.583106] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:37.601837] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-09T18:33:37.619096] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T18:33:38.137982] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T18:33:38.396725] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-09T18:33:38.879205] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T18:33:39.196723] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-09T18:33:39.706616] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:33:39.710851] [INFO ] [REMOTE ] DXC: Full fetch complete (69306 records). [2025-10-09T18:33:39.710980] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-09T18:33:39.711768] [FATAL] [VALIDATOR ] DXC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:33:39.711857] [FATAL] [MAIN ] DXC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:33:39.711902] [WARN ] [MAIN ] DXC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:33:39.711968] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-09T18:33:39.712043] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-09T18:33:39.712118] [INFO ] [LOCAL ] DXC: Starting deletion of derivative data. [2025-10-09T18:33:39.712402] [DEBUG] [LOCAL ] DXC: Deleted derivative data file. [2025-10-09T18:33:39.712505] [INFO ] [MAIN ] Update Progress: 675/2373 symbols completed. DXC took 40.2s. Estimated remaining: 3h 55m 28s. Rate: 7.2 symbols/min [2025-10-09T18:33:39.913299] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:39.941478] [DEBUG] [LOCAL ] EARN: Loaded 29114 existing records from primary storage. [2025-10-09T18:33:39.941768] [INFO ] [MAIN ] EARN: Loaded 29114 existing records. [2025-10-09T18:33:39.999678] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-09T18:33:40.121973] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:40.122159] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-09T18:33:40.122206] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-09T18:33:40.122429] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-09T18:33:40.122485] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-09T18:33:40.486986] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:40.621203] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T18:33:40.790890] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T18:33:40.799905] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-09T18:33:41.357618] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:33:41.596711] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-09T18:33:42.396721] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-09T18:33:42.956751] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T18:33:43.196709] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-09T18:33:43.764685] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T18:33:43.996706] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-09T18:33:44.476370] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T18:33:44.796687] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-09T18:33:44.829780] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T18:33:45.525958] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T18:33:45.596704] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-09T18:33:46.103777] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-09T18:33:46.396762] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-09T18:33:47.196721] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-09T18:33:47.588700] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T18:33:47.975230] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T18:33:47.996670] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-09T18:33:48.796749] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-09T18:33:49.207671] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-09T18:33:49.526598] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T18:33:49.596692] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-09T18:33:50.396719] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-09T18:33:51.109431] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T18:33:51.196721] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-09T18:33:51.851393] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T18:33:51.996695] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-09T18:33:52.129973] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T18:33:52.796721] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-09T18:33:53.559746] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T18:33:53.596685] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-09T18:33:54.396755] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-09T18:33:54.451246] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T18:33:54.850796] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T18:33:54.953108] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T18:33:55.196711] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-09T18:33:55.996725] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-09T18:33:56.651917] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T18:33:56.796715] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-09T18:33:57.596710] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-09T18:33:57.672492] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T18:33:58.172222] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T18:33:58.396744] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-09T18:33:58.615778] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T18:33:59.196730] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-09T18:33:59.533378] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T18:33:59.741858] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T18:33:59.743262] [INFO ] [REMOTE ] EAI: Full fetch complete (6106 records). [2025-10-09T18:33:59.743359] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-09T18:34:00.010454] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-09T18:34:00.267777] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-09T18:34:00.267907] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-09T18:34:00.268142] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-09T18:34:00.268184] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-09T18:34:00.268686] [DEBUG] [LOCAL ] EAI: Trimmed 6106 records to 4026 (keeping 200 days of data) [2025-10-09T18:34:00.303133] [DEBUG] [LOCAL ] EAI: Primary data saved (4026 records). [2025-10-09T18:34:00.303346] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-09T18:34:00.303469] [INFO ] [MAIN ] Update Progress: 676/2373 symbols completed. EAI took 23.5s. Estimated remaining: 3h 55m 50s. Rate: 7.2 symbols/min [2025-10-09T18:34:00.551440] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:00.601902] [DEBUG] [LOCAL ] EAT: Loaded 49839 existing records from primary storage. [2025-10-09T18:34:00.602249] [INFO ] [MAIN ] EAT: Loaded 49839 existing records. [2025-10-09T18:34:00.776095] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:00.776288] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-09T18:34:00.776345] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-09T18:34:00.776613] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-09T18:34:00.776695] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-09T18:34:00.806831] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-09T18:34:01.123176] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:01.596685] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-09T18:34:02.065868] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T18:34:02.396761] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-09T18:34:02.780164] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T18:34:03.085344] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T18:34:03.088336] [INFO ] [REMOTE ] E: Full fetch complete (47941 records). [2025-10-09T18:34:03.088441] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-09T18:34:03.201870] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-09T18:34:03.482233] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-09T18:34:03.482329] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-09T18:34:03.483031] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-09T18:34:03.483095] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-09T18:34:03.484171] [DEBUG] [LOCAL ] E: Trimmed 47941 records to 33374 (keeping 200 days of data) [2025-10-09T18:34:03.696205] [DEBUG] [LOCAL ] E: Primary data saved (33374 records). [2025-10-09T18:34:03.696359] [INFO ] [MAIN ] E: Full history saved. [2025-10-09T18:34:03.697237] [INFO ] [MAIN ] Update Progress: 677/2373 symbols completed. E took 33.1s. Estimated remaining: 3h 55m 30s. Rate: 7.2 symbols/min [2025-10-09T18:34:03.996732] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-09T18:34:04.335968] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-09T18:34:04.734495] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T18:34:04.796752] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-09T18:34:05.596710] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-09T18:34:05.746734] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T18:34:05.982096] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:34:06.396780] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-09T18:34:07.196696] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-09T18:34:07.434131] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T18:34:07.673564] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T18:34:07.996770] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-09T18:34:08.347134] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T18:34:08.350082] [INFO ] [REMOTE ] EAF: Full fetch complete (63063 records). [2025-10-09T18:34:08.350180] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-09T18:34:08.772811] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-09T18:34:08.772926] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-09T18:34:08.773871] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-09T18:34:08.773949] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-09T18:34:08.775342] [DEBUG] [LOCAL ] EAF: Trimmed 63063 records to 42401 (keeping 200 days of data) [2025-10-09T18:34:08.821889] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-09T18:34:09.028730] [DEBUG] [LOCAL ] EAF: Primary data saved (42401 records). [2025-10-09T18:34:09.028871] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-09T18:34:09.030507] [INFO ] [MAIN ] Update Progress: 678/2373 symbols completed. EAF took 35.0s. Estimated remaining: 3h 55m 14s. Rate: 7.2 symbols/min [2025-10-09T18:34:09.786514] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:34:09.798272] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-09T18:34:09.971162] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:34:10.396720] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-09T18:34:11.466671] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:34:11.477601] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-09T18:34:11.809786] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T18:34:11.996787] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-09T18:34:13.223268] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T18:34:13.229496] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-09T18:34:13.392216] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:34:13.596733] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-09T18:34:14.345613] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T18:34:14.396789] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-09T18:34:15.326817] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T18:34:15.337621] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-09T18:34:15.739542] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T18:34:15.742258] [INFO ] [REMOTE ] EARN: Full fetch complete (45691 records). [2025-10-09T18:34:15.742342] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-09T18:34:16.127093] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-09T18:34:16.127175] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-09T18:34:16.127960] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-09T18:34:16.128022] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-09T18:34:16.128994] [DEBUG] [LOCAL ] EARN: Trimmed 45691 records to 29315 (keeping 200 days of data) [2025-10-09T18:34:16.302171] [DEBUG] [LOCAL ] EARN: Primary data saved (29315 records). [2025-10-09T18:34:16.302307] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-09T18:34:16.302387] [INFO ] [MAIN ] Update Progress: 679/2373 symbols completed. EARN took 36.6s. Estimated remaining: 3h 55m 3s. Rate: 7.2 symbols/min [2025-10-09T18:34:16.769609] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:34:16.779609] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-09T18:34:18.338119] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T18:34:18.348980] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-09T18:34:19.869061] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:34:19.880196] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-09T18:34:21.591567] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T18:34:21.602586] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-09T18:34:23.083329] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T18:34:23.087536] [INFO ] [REMOTE ] EAT: Full fetch complete (72103 records). [2025-10-09T18:34:23.087682] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-09T18:34:23.476386] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-09T18:34:23.476476] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-09T18:34:23.477342] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-09T18:34:23.477406] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-09T18:34:23.478784] [DEBUG] [LOCAL ] EAT: Trimmed 72103 records to 50205 (keeping 200 days of data) [2025-10-09T18:34:23.779441] [DEBUG] [LOCAL ] EAT: Primary data saved (50205 records). [2025-10-09T18:34:23.779576] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-09T18:34:23.779675] [INFO ] [MAIN ] Update Progress: 680/2373 symbols completed. EAT took 23.5s. Estimated remaining: 3h 54m 52s. Rate: 7.2 symbols/min [2025-10-09T18:34:24.314122] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:24.369486] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:24.442849] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-09T18:34:24.466183] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-09T18:34:24.478147] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:24.478756] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-09T18:34:24.478811] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-09T18:34:24.478857] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-09T18:34:24.478890] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-09T18:34:24.518888] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:24.632886] [DEBUG] [LOCAL ] EBF: Loaded 19015 existing records from primary storage. [2025-10-09T18:34:24.658243] [INFO ] [MAIN ] EBF: Loaded 19015 existing records. [2025-10-09T18:34:24.975876] [DEBUG] [LOCAL ] EBS: Loaded 46781 existing records from primary storage. [2025-10-09T18:34:24.993569] [INFO ] [MAIN ] EBS: Loaded 46781 existing records. [2025-10-09T18:34:24.993354] [DEBUG] [LOCAL ] EBR: Loaded 43127 existing records from primary storage. [2025-10-09T18:34:25.158553] [INFO ] [MAIN ] EBR: Loaded 43127 existing records. [2025-10-09T18:34:25.158304] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:25.295917] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:25.301863] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-09T18:34:25.252521] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-09T18:34:25.341031] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-09T18:34:25.423904] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-09T18:34:25.455249] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-09T18:34:25.455129] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:25.517296] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-09T18:34:25.538577] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-09T18:34:25.569102] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-09T18:34:25.582838] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-09T18:34:25.575218] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:25.674603] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-09T18:34:25.697193] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-09T18:34:25.751262] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-09T18:34:25.783336] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-09T18:34:26.398028] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:26.425322] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-09T18:34:26.565265] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:26.570286] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-09T18:34:26.660851] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:26.661206] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-09T18:34:27.095714] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T18:34:27.105096] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-09T18:34:27.459529] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T18:34:27.463150] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-09T18:34:28.447572] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:34:28.451398] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-09T18:34:28.515665] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T18:34:28.525739] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-09T18:34:28.597516] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T18:34:28.606491] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-09T18:34:28.664132] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T18:34:28.673482] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-09T18:34:29.295750] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T18:34:29.300073] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-09T18:34:29.705801] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:34:29.716385] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-09T18:34:29.842762] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:34:29.851176] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-09T18:34:30.008019] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T18:34:30.017389] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-09T18:34:30.440514] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T18:34:30.446034] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-09T18:34:30.724689] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T18:34:31.150220] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T18:34:31.196681] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-09T18:34:31.289864] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T18:34:31.313386] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T18:34:31.996780] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-09T18:34:32.482757] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T18:34:32.796855] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-09T18:34:33.422275] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T18:34:33.567461] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T18:34:33.596739] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-09T18:34:34.396788] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-09T18:34:35.108326] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:34:35.196694] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-09T18:34:35.366694] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:34:35.996736] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-09T18:34:36.393033] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:34:36.796700] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-09T18:34:36.995678] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:34:37.596730] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-09T18:34:37.975206] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T18:34:38.396719] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-09T18:34:38.703237] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T18:34:39.196691] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-09T18:34:39.244948] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T18:34:39.996692] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-09T18:34:40.498509] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T18:34:40.796691] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-09T18:34:41.038330] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T18:34:41.596781] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-09T18:34:42.298149] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:34:42.396720] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-09T18:34:42.804172] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T18:34:43.196719] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-09T18:34:43.877848] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T18:34:43.996729] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-09T18:34:44.759811] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T18:34:44.796705] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-09T18:34:45.596785] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-09T18:34:45.816023] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T18:34:46.161861] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T18:34:46.310265] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:34:46.396673] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-09T18:34:47.196713] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-09T18:34:47.713690] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T18:34:47.996727] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-09T18:34:48.432066] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:34:48.434238] [INFO ] [REMOTE ] EBF: Full fetch complete (27633 records). [2025-10-09T18:34:48.434341] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-09T18:34:48.809059] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-09T18:34:48.807237] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-09T18:34:48.809200] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-09T18:34:48.809896] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-09T18:34:48.810544] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-09T18:34:48.811521] [DEBUG] [LOCAL ] EBF: Trimmed 27633 records to 19184 (keeping 200 days of data) [2025-10-09T18:34:48.934925] [DEBUG] [LOCAL ] EBF: Primary data saved (19184 records). [2025-10-09T18:34:48.935062] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-09T18:34:48.935145] [INFO ] [MAIN ] Update Progress: 681/2373 symbols completed. EBF took 25.2s. Estimated remaining: 3h 55m 26s. Rate: 7.2 symbols/min [2025-10-09T18:34:49.101507] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:49.146447] [DEBUG] [LOCAL ] EC: Loaded 49065 existing records from primary storage. [2025-10-09T18:34:49.146800] [INFO ] [MAIN ] EC: Loaded 49065 existing records. [2025-10-09T18:34:49.329909] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:49.330298] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-09T18:34:49.330438] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-09T18:34:49.331103] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-09T18:34:49.331165] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-09T18:34:49.603187] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-09T18:34:49.758478] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:34:49.763940] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:50.051269] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T18:34:50.396731] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-09T18:34:51.196715] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-09T18:34:51.593127] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T18:34:51.996750] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-09T18:34:52.330909] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T18:34:52.502703] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:34:52.505812] [INFO ] [REMOTE ] EB: Full fetch complete (55726 records). [2025-10-09T18:34:52.505904] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-09T18:34:52.802719] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-09T18:34:52.899304] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-09T18:34:52.899394] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-09T18:34:52.900161] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-09T18:34:52.900247] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-09T18:34:52.901498] [DEBUG] [LOCAL ] EB: Trimmed 55726 records to 37092 (keeping 200 days of data) [2025-10-09T18:34:53.113526] [DEBUG] [LOCAL ] EB: Primary data saved (37092 records). [2025-10-09T18:34:53.113673] [INFO ] [MAIN ] EB: Full history saved. [2025-10-09T18:34:53.113765] [INFO ] [MAIN ] Update Progress: 682/2373 symbols completed. EB took 29.3s. Estimated remaining: 3h 55m 7s. Rate: 7.2 symbols/min [2025-10-09T18:34:53.288706] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:53.314719] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:34:53.348311] [DEBUG] [LOCAL ] ECAT: Loaded 29416 existing records from primary storage. [2025-10-09T18:34:53.348561] [INFO ] [MAIN ] ECAT: Loaded 29416 existing records. [2025-10-09T18:34:53.522984] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:53.523215] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-09T18:34:53.523298] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-09T18:34:53.523729] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-09T18:34:53.523805] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-09T18:34:53.601812] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-09T18:34:53.879084] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:54.312404] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T18:34:54.396680] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-09T18:34:55.096220] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T18:34:55.196690] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-09T18:34:55.711892] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:34:55.996725] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-09T18:34:56.602292] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T18:34:56.606089] [INFO ] [REMOTE ] EBR: Full fetch complete (62466 records). [2025-10-09T18:34:56.606196] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-09T18:34:56.801809] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-09T18:34:57.003156] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-09T18:34:57.003248] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-09T18:34:57.004115] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-09T18:34:57.004185] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-09T18:34:57.005452] [DEBUG] [LOCAL ] EBR: Trimmed 62466 records to 43463 (keeping 200 days of data) [2025-10-09T18:34:57.231459] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T18:34:57.289609] [DEBUG] [LOCAL ] EBR: Primary data saved (43463 records). [2025-10-09T18:34:57.289768] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-09T18:34:57.289868] [INFO ] [MAIN ] Update Progress: 683/2373 symbols completed. EBR took 33.4s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-10-09T18:34:57.456795] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:57.499980] [DEBUG] [LOCAL ] ECC: Loaded 43089 existing records from primary storage. [2025-10-09T18:34:57.500928] [INFO ] [MAIN ] ECC: Loaded 43089 existing records. [2025-10-09T18:34:57.599573] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-09T18:34:57.682910] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:57.683347] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-09T18:34:57.683409] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-09T18:34:57.684049] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-09T18:34:57.684110] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-09T18:34:58.057450] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:58.396675] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-09T18:34:58.734517] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T18:34:58.780767] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:34:59.196714] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-09T18:34:59.678235] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T18:34:59.683949] [INFO ] [REMOTE ] EBS: Full fetch complete (67342 records). [2025-10-09T18:34:59.684155] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-09T18:34:59.999956] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-09T18:35:00.145491] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-09T18:35:00.145759] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-09T18:35:00.146701] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-09T18:35:00.146786] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-09T18:35:00.156866] [DEBUG] [LOCAL ] EBS: Trimmed 67342 records to 47100 (keeping 200 days of data) [2025-10-09T18:35:00.173370] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T18:35:00.450262] [DEBUG] [LOCAL ] EBS: Primary data saved (47100 records). [2025-10-09T18:35:00.450404] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-09T18:35:00.450489] [INFO ] [MAIN ] Update Progress: 684/2373 symbols completed. EBS took 36.7s. Estimated remaining: 3h 54m 27s. Rate: 7.2 symbols/min [2025-10-09T18:35:00.617476] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:00.617632] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-09T18:35:00.617704] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-09T18:35:00.617841] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-09T18:35:00.617894] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-09T18:35:00.617937] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-09T18:35:00.617969] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-09T18:35:00.802021] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-09T18:35:00.970607] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:01.596675] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-09T18:35:01.750841] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T18:35:02.396733] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-09T18:35:02.750245] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T18:35:02.959319] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T18:35:03.185222] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T18:35:03.196684] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-09T18:35:03.996811] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-09T18:35:04.389477] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:35:04.796822] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-09T18:35:05.596776] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-09T18:35:05.636353] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:35:06.000543] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T18:35:06.396742] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-09T18:35:06.734485] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T18:35:07.196683] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-09T18:35:07.464760] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:35:07.519531] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:35:07.996781] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-09T18:35:08.796810] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-09T18:35:09.204695] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:35:09.596768] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-09T18:35:10.396689] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-09T18:35:10.546830] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T18:35:11.002339] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T18:35:11.196769] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-09T18:35:11.903320] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:35:11.996774] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-09T18:35:12.589488] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T18:35:12.796718] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-09T18:35:13.346745] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T18:35:13.596717] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-09T18:35:14.396715] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-09T18:35:14.444916] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:35:14.829518] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T18:35:15.196778] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-09T18:35:15.404899] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:35:15.500849] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-09T18:35:15.996776] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-09T18:35:16.796795] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-09T18:35:17.238915] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T18:35:17.596824] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-09T18:35:17.686272] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:35:18.396740] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-09T18:35:18.983858] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T18:35:19.196796] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-09T18:35:19.544754] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T18:35:19.572227] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:35:19.575735] [INFO ] [REMOTE ] EC: Full fetch complete (71470 records). [2025-10-09T18:35:19.575859] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-09T18:35:19.576607] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:35:19.576741] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:35:19.576825] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:35:19.576911] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-09T18:35:19.576992] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-09T18:35:19.577044] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-09T18:35:19.577371] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-10-09T18:35:19.578522] [INFO ] [MAIN ] Update Progress: 685/2373 symbols completed. EC took 30.6s. Estimated remaining: 3h 54m 46s. Rate: 7.2 symbols/min [2025-10-09T18:35:19.748778] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:19.754787] [DEBUG] [LOCAL ] ECCU: Loaded 2260 existing records from primary storage. [2025-10-09T18:35:19.754994] [INFO ] [MAIN ] ECCU: Loaded 2260 existing records. [2025-10-09T18:35:19.934085] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:35:19.934327] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-09T18:35:19.934401] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-09T18:35:19.934619] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-09T18:35:19.934716] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-09T18:35:20.001821] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-09T18:35:20.288788] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:20.431187] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:35:20.796762] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-09T18:35:21.596738] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-09T18:35:22.020499] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-09T18:35:22.366799] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T18:35:22.396678] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-09T18:35:23.196723] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-09T18:35:23.686196] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T18:35:23.791905] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T18:35:23.996701] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-09T18:35:24.564144] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T18:35:24.796722] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-09T18:35:25.373213] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T18:35:25.596780] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-09T18:35:26.088021] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T18:35:26.396752] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-09T18:35:27.196731] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-09T18:35:27.761308] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:35:27.996746] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-09T18:35:28.600586] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:35:28.796721] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-09T18:35:29.236491] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T18:35:29.596823] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-09T18:35:30.127302] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T18:35:30.396721] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-09T18:35:31.143456] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T18:35:31.147226] [INFO ] [REMOTE ] ECC: Full fetch complete (60989 records). [2025-10-09T18:35:31.147332] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-09T18:35:31.202010] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-09T18:35:31.467875] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T18:35:31.515016] [INFO ] [REMOTE ] ECAT: Full fetch complete (42898 records). [2025-10-09T18:35:31.539618] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-09T18:35:31.628804] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-09T18:35:31.639883] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-09T18:35:31.659622] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-09T18:35:31.662078] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-09T18:35:31.722400] [DEBUG] [LOCAL ] ECC: Trimmed 60989 records to 43399 (keeping 200 days of data) [2025-10-09T18:35:31.821078] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T18:35:32.002563] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-09T18:35:32.050977] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-09T18:35:32.051361] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-09T18:35:32.052056] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-09T18:35:32.052363] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-09T18:35:32.063388] [DEBUG] [LOCAL ] ECAT: Trimmed 42898 records to 29593 (keeping 200 days of data) [2025-10-09T18:35:32.355077] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T18:35:32.370719] [DEBUG] [LOCAL ] ECAT: Primary data saved (29593 records). [2025-10-09T18:35:32.371686] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-09T18:35:32.376026] [INFO ] [MAIN ] Update Progress: 686/2373 symbols completed. ECAT took 39.3s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-10-09T18:35:32.597639] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:32.600950] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-09T18:35:32.601039] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-09T18:35:32.607146] [DEBUG] [LOCAL ] ECC: Primary data saved (43399 records). [2025-10-09T18:35:32.607673] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-09T18:35:32.607969] [INFO ] [MAIN ] Update Progress: 687/2373 symbols completed. ECC took 35.3s. Estimated remaining: 3h 54m 20s. Rate: 7.2 symbols/min [2025-10-09T18:35:32.607771] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-09T18:35:32.640911] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-09T18:35:32.641017] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-09T18:35:32.641086] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-09T18:35:32.815613] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-09T18:35:33.098531] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:33.120532] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-09T18:35:33.120615] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-09T18:35:33.126601] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-09T18:35:33.131851] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-09T18:35:33.142245] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-09T18:35:33.147472] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-09T18:35:33.313806] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:33.342462] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T18:35:33.594416] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:33.596673] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-09T18:35:34.234916] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T18:35:34.396721] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-09T18:35:34.786053] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-09T18:35:35.196735] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-09T18:35:35.505478] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T18:35:35.996771] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-09T18:35:36.405615] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T18:35:36.406351] [INFO ] [REMOTE ] ECCC: Full fetch complete (1304 records). [2025-10-09T18:35:36.406420] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-09T18:35:36.584259] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-09T18:35:36.584533] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:35:36.584622] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:35:36.584733] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-09T18:35:36.584822] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-09T18:35:36.584874] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-09T18:35:36.584943] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-09T18:35:36.585007] [INFO ] [MAIN ] Update Progress: 688/2373 symbols completed. ECCC took 36.1s. Estimated remaining: 3h 54m 1s. Rate: 7.2 symbols/min [2025-10-09T18:35:36.755420] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:36.791052] [DEBUG] [LOCAL ] ECG: Loaded 33381 existing records from primary storage. [2025-10-09T18:35:36.791377] [INFO ] [MAIN ] ECG: Loaded 33381 existing records. [2025-10-09T18:35:36.802313] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-09T18:35:36.977769] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:35:36.978035] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-09T18:35:36.978083] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-09T18:35:36.978335] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-09T18:35:36.978394] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-09T18:35:37.342914] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:37.381541] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:35:37.596740] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-09T18:35:38.022568] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T18:35:38.396734] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-09T18:35:38.984278] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T18:35:39.196743] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-09T18:35:39.451870] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-09T18:35:39.996729] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-09T18:35:40.291937] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-09T18:35:40.796735] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-09T18:35:41.108425] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T18:35:41.596747] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-09T18:35:42.013628] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:35:42.396724] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-09T18:35:43.196728] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-09T18:35:43.858784] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T18:35:43.996715] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-09T18:35:44.393323] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-09T18:35:44.796810] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-09T18:35:44.983956] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-09T18:35:45.245105] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:35:45.596764] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-09T18:35:46.037670] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T18:35:46.396691] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-09T18:35:46.660400] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-09T18:35:47.196797] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-09T18:35:47.697775] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T18:35:47.996728] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-09T18:35:48.572544] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T18:35:48.573278] [INFO ] [REMOTE ] ECCU: Full fetch complete (4450 records). [2025-10-09T18:35:48.573347] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-09T18:35:48.806001] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-09T18:35:48.930203] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-09T18:35:48.930315] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-09T18:35:48.930501] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-09T18:35:48.930562] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-09T18:35:48.930974] [DEBUG] [LOCAL ] ECCU: Trimmed 4450 records to 2264 (keeping 200 days of data) [2025-10-09T18:35:48.946923] [DEBUG] [LOCAL ] ECCU: Primary data saved (2264 records). [2025-10-09T18:35:48.947059] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-09T18:35:48.947147] [INFO ] [MAIN ] Update Progress: 689/2373 symbols completed. ECCU took 29.4s. Estimated remaining: 3h 54m 2s. Rate: 7.2 symbols/min [2025-10-09T18:35:49.116697] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:49.166860] [DEBUG] [LOCAL ] ECL: Loaded 46683 existing records from primary storage. [2025-10-09T18:35:49.167220] [INFO ] [MAIN ] ECL: Loaded 46683 existing records. [2025-10-09T18:35:49.272409] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T18:35:49.357222] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:35:49.357459] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-09T18:35:49.357509] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-09T18:35:49.357912] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-09T18:35:49.357972] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-09T18:35:49.601938] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-09T18:35:49.717952] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:49.975158] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-09T18:35:50.396731] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-09T18:35:50.689821] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-09T18:35:51.196724] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-09T18:35:51.588670] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T18:35:51.589384] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-09T18:35:51.589455] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-09T18:35:51.771857] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-09T18:35:51.772053] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:35:51.772123] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:35:51.772213] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-09T18:35:51.772293] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-09T18:35:51.772349] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-09T18:35:51.772416] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-09T18:35:51.772525] [INFO ] [MAIN ] Update Progress: 690/2373 symbols completed. ECCW took 19.4s. Estimated remaining: 3h 53m 41s. Rate: 7.2 symbols/min [2025-10-09T18:35:51.945834] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:51.968724] [DEBUG] [LOCAL ] ECO: Loaded 18349 existing records from primary storage. [2025-10-09T18:35:51.968997] [INFO ] [MAIN ] ECO: Loaded 18349 existing records. [2025-10-09T18:35:52.001800] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-09T18:35:52.184579] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:35:52.184861] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-09T18:35:52.184910] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-09T18:35:52.185494] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-09T18:35:52.185554] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-09T18:35:52.552731] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:52.796726] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-09T18:35:53.287929] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T18:35:53.596731] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-09T18:35:53.984929] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T18:35:53.988559] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T18:35:54.396708] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-09T18:35:55.196722] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-09T18:35:55.453100] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-09T18:35:55.470342] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T18:35:55.996731] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-09T18:35:56.352781] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T18:35:56.796719] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-09T18:35:57.596728] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-09T18:35:58.171962] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T18:35:58.396694] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-09T18:35:58.758078] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T18:35:59.196774] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-09T18:35:59.511046] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T18:35:59.996794] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-09T18:36:00.409064] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:36:00.796803] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-09T18:36:01.596728] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-09T18:36:01.890539] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T18:36:02.360606] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T18:36:02.396764] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-09T18:36:03.142407] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:36:03.196670] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-09T18:36:03.607082] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:36:03.996752] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-09T18:36:04.711846] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T18:36:04.796773] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-09T18:36:05.598528] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T18:36:05.598426] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-09T18:36:05.643328] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T18:36:06.396790] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-09T18:36:06.550781] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T18:36:06.737016] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T18:36:07.196732] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-09T18:36:07.996697] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-09T18:36:08.030891] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:36:08.418681] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T18:36:08.419390] [INFO ] [REMOTE ] ECCX: Full fetch complete (1450 records). [2025-10-09T18:36:08.419459] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-09T18:36:08.613821] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-09T18:36:08.614065] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:36:08.614150] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:36:08.614229] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-09T18:36:08.614294] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-09T18:36:08.614329] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-09T18:36:08.614368] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-09T18:36:08.614454] [INFO ] [MAIN ] Update Progress: 691/2373 symbols completed. ECCX took 36.0s. Estimated remaining: 3h 53m 53s. Rate: 7.2 symbols/min [2025-10-09T18:36:08.805154] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:08.802162] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-09T18:36:08.845509] [DEBUG] [LOCAL ] ECVT: Loaded 43281 existing records from primary storage. [2025-10-09T18:36:08.845867] [INFO ] [MAIN ] ECVT: Loaded 43281 existing records. [2025-10-09T18:36:09.024950] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:09.025221] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-09T18:36:09.025272] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-09T18:36:09.026561] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-09T18:36:09.026623] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-09T18:36:09.419096] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:09.596724] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-09T18:36:10.051453] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:36:10.396720] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-09T18:36:11.196691] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-09T18:36:11.322298] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T18:36:11.429713] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T18:36:11.996732] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-09T18:36:12.476834] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T18:36:12.796721] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-09T18:36:12.993069] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:36:13.596694] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-09T18:36:13.820371] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T18:36:14.396709] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-09T18:36:15.167499] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T18:36:15.196674] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-09T18:36:15.365076] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T18:36:15.996771] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-09T18:36:16.581427] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T18:36:16.796696] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-09T18:36:16.911551] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T18:36:17.596687] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-09T18:36:17.984120] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:36:18.396752] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-09T18:36:18.580072] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T18:36:19.196765] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-09T18:36:19.996766] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-09T18:36:20.045929] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T18:36:20.440937] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:36:20.443428] [INFO ] [REMOTE ] ECG: Full fetch complete (50626 records). [2025-10-09T18:36:20.443508] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-09T18:36:20.444143] [FATAL] [VALIDATOR ] ECG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:36:20.444245] [FATAL] [MAIN ] ECG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:36:20.444297] [WARN ] [MAIN ] ECG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:36:20.444367] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-09T18:36:20.444430] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-09T18:36:20.444468] [INFO ] [LOCAL ] ECG: Starting deletion of derivative data. [2025-10-09T18:36:20.444730] [DEBUG] [LOCAL ] ECG: Deleted derivative data file. [2025-10-09T18:36:20.444833] [INFO ] [MAIN ] Update Progress: 692/2373 symbols completed. ECG took 43.9s. Estimated remaining: 3h 53m 53s. Rate: 7.2 symbols/min [2025-10-09T18:36:20.612079] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:20.664380] [DEBUG] [LOCAL ] ED: Loaded 52710 existing records from primary storage. [2025-10-09T18:36:20.664885] [INFO ] [MAIN ] ED: Loaded 52710 existing records. [2025-10-09T18:36:20.803103] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-09T18:36:20.844427] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:20.844700] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-09T18:36:20.844816] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-09T18:36:20.846797] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-09T18:36:20.846859] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-09T18:36:21.130989] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:36:21.154073] [INFO ] [REMOTE ] ECO: Full fetch complete (28570 records). [2025-10-09T18:36:21.171976] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-09T18:36:21.279816] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:21.582167] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-09T18:36:21.582240] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-09T18:36:21.582721] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-09T18:36:21.582782] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-09T18:36:21.583474] [DEBUG] [LOCAL ] ECO: Trimmed 28570 records to 18474 (keeping 200 days of data) [2025-10-09T18:36:21.630953] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-09T18:36:21.697453] [DEBUG] [LOCAL ] ECO: Primary data saved (18474 records). [2025-10-09T18:36:21.697570] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-09T18:36:21.697668] [INFO ] [MAIN ] Update Progress: 693/2373 symbols completed. ECO took 29.9s. Estimated remaining: 3h 53m 28s. Rate: 7.2 symbols/min [2025-10-09T18:36:21.864808] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:21.890147] [DEBUG] [LOCAL ] EDD: Loaded 26944 existing records from primary storage. [2025-10-09T18:36:21.890389] [INFO ] [MAIN ] EDD: Loaded 26944 existing records. [2025-10-09T18:36:22.070365] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:22.070706] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-09T18:36:22.070766] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-09T18:36:22.071004] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-09T18:36:22.071062] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-09T18:36:22.404794] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-09T18:36:22.437336] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:22.473821] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:36:23.196744] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-09T18:36:23.660329] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T18:36:23.699785] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T18:36:23.996794] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-09T18:36:24.344926] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T18:36:24.796735] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-09T18:36:25.564280] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T18:36:25.596678] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-09T18:36:26.319639] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T18:36:26.396718] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-09T18:36:26.711491] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T18:36:27.196716] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-09T18:36:27.805265] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:36:27.996682] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-09T18:36:28.335741] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T18:36:28.796697] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-09T18:36:29.596685] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-09T18:36:29.864592] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T18:36:30.176435] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:36:30.396733] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-09T18:36:30.610890] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T18:36:31.196762] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-09T18:36:31.996694] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-09T18:36:32.288792] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T18:36:32.316320] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:36:32.796766] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-09T18:36:33.435538] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T18:36:33.596691] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-09T18:36:34.309973] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T18:36:34.396730] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-09T18:36:35.082000] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T18:36:35.196728] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-09T18:36:35.931966] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T18:36:35.996694] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-09T18:36:36.645502] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T18:36:36.796721] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-09T18:36:37.460705] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T18:36:37.464461] [INFO ] [REMOTE ] ECVT: Full fetch complete (60114 records). [2025-10-09T18:36:37.464578] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-09T18:36:37.605727] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-09T18:36:37.862796] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-09T18:36:37.862877] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-09T18:36:37.863781] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-09T18:36:37.863849] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-09T18:36:37.865177] [DEBUG] [LOCAL ] ECVT: Trimmed 60114 records to 43520 (keeping 200 days of data) [2025-10-09T18:36:38.131144] [DEBUG] [LOCAL ] ECVT: Primary data saved (43520 records). [2025-10-09T18:36:38.131279] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-09T18:36:38.131359] [INFO ] [MAIN ] Update Progress: 694/2373 symbols completed. ECVT took 29.5s. Estimated remaining: 3h 53m 39s. Rate: 7.2 symbols/min [2025-10-09T18:36:38.301694] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:38.315147] [DEBUG] [LOCAL ] EDF: Loaded 13210 existing records from primary storage. [2025-10-09T18:36:38.315348] [INFO ] [MAIN ] EDF: Loaded 13210 existing records. [2025-10-09T18:36:38.406006] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-09T18:36:38.519709] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:38.520290] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-09T18:36:38.520376] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-09T18:36:38.521158] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-09T18:36:38.521240] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-09T18:36:38.864682] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:36:39.046157] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:39.049424] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-09T18:36:39.196731] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-09T18:36:39.651405] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T18:36:39.996780] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-09T18:36:40.796732] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-09T18:36:40.992262] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T18:36:41.200261] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T18:36:41.596782] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-09T18:36:41.862204] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T18:36:42.396772] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-09T18:36:43.196761] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-09T18:36:43.311028] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T18:36:43.924085] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T18:36:43.961418] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T18:36:43.996673] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-09T18:36:44.796682] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-09T18:36:44.955963] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T18:36:45.596743] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-09T18:36:46.396751] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-09T18:36:46.495278] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T18:36:46.499873] [INFO ] [REMOTE ] ED: Full fetch complete (76297 records). [2025-10-09T18:36:46.499991] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-09T18:36:46.684739] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:36:46.945607] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-09T18:36:46.945749] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-09T18:36:46.951519] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-09T18:36:46.955096] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-09T18:36:46.956113] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T18:36:46.960742] [DEBUG] [LOCAL ] ED: Trimmed 76297 records to 53094 (keeping 200 days of data) [2025-10-09T18:36:47.197138] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-09T18:36:47.294608] [DEBUG] [LOCAL ] ED: Primary data saved (53094 records). [2025-10-09T18:36:47.294770] [INFO ] [MAIN ] ED: Full history saved. [2025-10-09T18:36:47.296895] [INFO ] [MAIN ] Update Progress: 695/2373 symbols completed. ED took 26.9s. Estimated remaining: 3h 53m 32s. Rate: 7.2 symbols/min [2025-10-09T18:36:47.469723] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:47.490192] [DEBUG] [LOCAL ] EDN: Loaded 18262 existing records from primary storage. [2025-10-09T18:36:47.490433] [INFO ] [MAIN ] EDN: Loaded 18262 existing records. [2025-10-09T18:36:47.674724] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:47.674991] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-09T18:36:47.675040] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-09T18:36:47.675264] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-09T18:36:47.675321] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-09T18:36:48.004956] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-09T18:36:48.047484] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:48.214239] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T18:36:48.796744] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-09T18:36:49.129019] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T18:36:49.596772] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-09T18:36:50.104843] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:36:50.108978] [INFO ] [REMOTE ] ECL: Full fetch complete (68016 records). [2025-10-09T18:36:50.109105] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-09T18:36:50.401973] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-09T18:36:50.500877] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-09T18:36:50.500977] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-09T18:36:50.501877] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-09T18:36:50.501957] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-09T18:36:50.503292] [DEBUG] [LOCAL ] ECL: Trimmed 68016 records to 46987 (keeping 200 days of data) [2025-10-09T18:36:50.818376] [DEBUG] [LOCAL ] ECL: Primary data saved (46987 records). [2025-10-09T18:36:50.818536] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-09T18:36:50.820047] [INFO ] [MAIN ] Update Progress: 696/2373 symbols completed. ECL took 1m 2s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-09T18:36:50.993780] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:51.037831] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T18:36:51.058065] [DEBUG] [LOCAL ] EDU: Loaded 44849 existing records from primary storage. [2025-10-09T18:36:51.058391] [INFO ] [MAIN ] EDU: Loaded 44849 existing records. [2025-10-09T18:36:51.201616] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-09T18:36:51.242845] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:51.244018] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-09T18:36:51.244167] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-09T18:36:51.244925] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-09T18:36:51.245006] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-09T18:36:51.358813] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T18:36:51.616157] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:51.996718] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-09T18:36:52.349476] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:36:52.796742] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-09T18:36:53.552439] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:36:53.579772] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T18:36:53.596804] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-09T18:36:54.396737] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-09T18:36:54.791977] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:36:55.196717] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-09T18:36:55.969359] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T18:36:55.996667] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-09T18:36:56.060415] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T18:36:56.548021] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:36:56.796715] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-09T18:36:57.596694] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-09T18:36:57.930178] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:36:58.396781] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-09T18:36:58.790064] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:36:59.196749] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-09T18:36:59.978740] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:36:59.996674] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-09T18:37:00.034088] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T18:37:00.796735] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-09T18:37:01.596739] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-09T18:37:01.668117] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:37:01.711744] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T18:37:02.396788] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-09T18:37:02.939268] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T18:37:03.196733] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-09T18:37:03.498744] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T18:37:03.996780] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-09T18:37:04.351391] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T18:37:04.354272] [INFO ] [REMOTE ] EDD: Full fetch complete (38517 records). [2025-10-09T18:37:04.354367] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-09T18:37:04.732890] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-09T18:37:04.733007] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-09T18:37:04.733634] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-09T18:37:04.733724] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-09T18:37:04.734753] [DEBUG] [LOCAL ] EDD: Trimmed 38517 records to 27133 (keeping 200 days of data) [2025-10-09T18:37:04.817998] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-09T18:37:04.896042] [DEBUG] [LOCAL ] EDD: Primary data saved (27133 records). [2025-10-09T18:37:04.896187] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-09T18:37:04.896268] [INFO ] [MAIN ] Update Progress: 697/2373 symbols completed. EDD took 43.2s. Estimated remaining: 3h 53m 18s. Rate: 7.2 symbols/min [2025-10-09T18:37:05.077531] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T18:37:05.080783] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:05.117394] [DEBUG] [LOCAL ] EE: Loaded 32798 existing records from primary storage. [2025-10-09T18:37:05.117717] [INFO ] [MAIN ] EE: Loaded 32798 existing records. [2025-10-09T18:37:05.301888] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:37:05.302154] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-09T18:37:05.302207] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-09T18:37:05.302460] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-09T18:37:05.302517] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-09T18:37:05.601815] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-09T18:37:05.669832] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:05.672098] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T18:37:05.674276] [INFO ] [REMOTE ] EDF: Full fetch complete (20550 records). [2025-10-09T18:37:05.674364] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-09T18:37:06.117916] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-09T18:37:06.118032] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-09T18:37:06.118666] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-09T18:37:06.118752] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-09T18:37:06.119478] [DEBUG] [LOCAL ] EDF: Trimmed 20550 records to 13313 (keeping 200 days of data) [2025-10-09T18:37:06.209904] [DEBUG] [LOCAL ] EDF: Primary data saved (13313 records). [2025-10-09T18:37:06.210051] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-09T18:37:06.210134] [INFO ] [MAIN ] Update Progress: 698/2373 symbols completed. EDF took 28.1s. Estimated remaining: 3h 52m 53s. Rate: 7.2 symbols/min [2025-10-09T18:37:06.391430] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:06.391579] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-09T18:37:06.391615] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-09T18:37:06.391743] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-09T18:37:06.391784] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-09T18:37:06.391825] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-09T18:37:06.391861] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-09T18:37:06.402785] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-09T18:37:06.746757] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T18:37:06.765876] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:07.196729] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-09T18:37:07.983789] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T18:37:07.996704] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-09T18:37:08.172377] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T18:37:08.796734] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-09T18:37:09.596767] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-09T18:37:09.677110] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:37:09.802959] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:37:10.396686] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-09T18:37:10.679748] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T18:37:10.876634] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T18:37:11.196758] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-09T18:37:11.996755] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-09T18:37:12.796704] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-09T18:37:12.839255] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T18:37:13.101129] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-09T18:37:13.164109] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T18:37:13.596786] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-09T18:37:14.194088] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T18:37:14.396768] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-09T18:37:14.899186] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T18:37:15.196772] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-09T18:37:15.996773] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-09T18:37:16.276710] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:37:16.796754] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-09T18:37:16.973136] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:37:17.596747] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-09T18:37:18.322831] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T18:37:18.396667] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-09T18:37:18.777770] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T18:37:19.196683] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-09T18:37:19.635363] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T18:37:19.996754] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-09T18:37:20.413956] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:37:20.796771] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-09T18:37:21.596693] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-09T18:37:21.795133] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T18:37:21.986665] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T18:37:21.988881] [INFO ] [REMOTE ] EDN: Full fetch complete (29648 records). [2025-10-09T18:37:21.988956] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-09T18:37:22.371279] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-09T18:37:22.371369] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-09T18:37:22.371958] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-09T18:37:22.372185] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-09T18:37:22.373133] [DEBUG] [LOCAL ] EDN: Trimmed 29648 records to 18533 (keeping 200 days of data) [2025-10-09T18:37:22.423132] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-09T18:37:22.494965] [DEBUG] [LOCAL ] EDN: Primary data saved (18533 records). [2025-10-09T18:37:22.495098] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-09T18:37:22.495177] [INFO ] [MAIN ] Update Progress: 699/2373 symbols completed. EDN took 35.2s. Estimated remaining: 3h 53m 3s. Rate: 7.2 symbols/min [2025-10-09T18:37:22.638546] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:37:22.707016] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:22.718562] [DEBUG] [LOCAL ] EEX: Loaded 10841 existing records from primary storage. [2025-10-09T18:37:22.718818] [INFO ] [MAIN ] EEX: Loaded 10841 existing records. [2025-10-09T18:37:22.908399] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:37:22.908748] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-09T18:37:22.908804] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-09T18:37:22.909360] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-09T18:37:22.909441] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-09T18:37:23.202453] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-09T18:37:23.293532] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:23.830061] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T18:37:23.870183] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T18:37:23.996732] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-09T18:37:24.796762] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-09T18:37:25.113081] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:37:25.596774] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-09T18:37:26.150563] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:37:26.172017] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T18:37:26.396764] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-09T18:37:27.196707] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-09T18:37:27.957519] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:37:27.965121] [INFO ] [REMOTE ] EDU: Full fetch complete (66524 records). [2025-10-09T18:37:27.965257] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-09T18:37:28.001912] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-09T18:37:28.369044] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-09T18:37:28.369168] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-09T18:37:28.370032] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-09T18:37:28.370176] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-09T18:37:28.391017] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T18:37:28.398297] [DEBUG] [LOCAL ] EDU: Trimmed 66524 records to 45177 (keeping 200 days of data) [2025-10-09T18:37:28.604976] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T18:37:28.679607] [DEBUG] [LOCAL ] EDU: Primary data saved (45177 records). [2025-10-09T18:37:28.679777] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-09T18:37:28.681048] [INFO ] [MAIN ] Update Progress: 700/2373 symbols completed. EDU took 37.9s. Estimated remaining: 3h 52m 50s. Rate: 7.2 symbols/min [2025-10-09T18:37:28.801797] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-09T18:37:28.850705] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:28.850856] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-09T18:37:28.850899] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-09T18:37:28.851007] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-09T18:37:28.851050] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-09T18:37:28.851094] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-09T18:37:28.851127] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-09T18:37:29.205606] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:29.596689] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-09T18:37:29.627264] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T18:37:30.396735] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-09T18:37:30.611677] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T18:37:30.756791] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T18:37:31.196732] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-09T18:37:31.756619] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T18:37:31.996701] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-09T18:37:32.796795] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-09T18:37:33.596747] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-09T18:37:33.970429] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T18:37:34.031225] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T18:37:34.178426] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T18:37:34.396752] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-09T18:37:34.934639] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T18:37:34.935381] [INFO ] [REMOTE ] EEA: Full fetch complete (3861 records). [2025-10-09T18:37:34.935451] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-09T18:37:35.119852] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T18:37:35.120071] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:37:35.120158] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:37:35.120252] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-09T18:37:35.120330] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-09T18:37:35.120367] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-09T18:37:35.120423] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-09T18:37:35.120500] [INFO ] [MAIN ] Update Progress: 701/2373 symbols completed. EEA took 28.9s. Estimated remaining: 3h 52m 37s. Rate: 7.2 symbols/min [2025-10-09T18:37:35.201806] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-09T18:37:35.299464] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:35.315202] [DEBUG] [LOCAL ] EFR: Loaded 14966 existing records from primary storage. [2025-10-09T18:37:35.315422] [INFO ] [MAIN ] EFR: Loaded 14966 existing records. [2025-10-09T18:37:35.491220] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:37:35.491399] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-09T18:37:35.491447] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-09T18:37:35.492244] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-09T18:37:35.492305] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-09T18:37:35.842359] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:35.996676] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-09T18:37:36.391613] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T18:37:36.796774] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-09T18:37:37.071833] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T18:37:37.596774] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-09T18:37:37.703128] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T18:37:38.396717] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-09T18:37:38.872558] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:37:39.196707] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-09T18:37:39.552558] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:37:39.555484] [INFO ] [REMOTE ] EE: Full fetch complete (43844 records). [2025-10-09T18:37:39.555564] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-09T18:37:39.975091] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-09T18:37:39.975347] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-09T18:37:39.976036] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-09T18:37:39.976114] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-09T18:37:39.977151] [DEBUG] [LOCAL ] EE: Trimmed 43844 records to 33129 (keeping 200 days of data) [2025-10-09T18:37:40.031302] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-09T18:37:40.082593] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:37:40.193206] [DEBUG] [LOCAL ] EE: Primary data saved (33129 records). [2025-10-09T18:37:40.193336] [INFO ] [MAIN ] EE: Full history saved. [2025-10-09T18:37:40.193966] [INFO ] [MAIN ] Update Progress: 702/2373 symbols completed. EE took 35.3s. Estimated remaining: 3h 52m 21s. Rate: 7.2 symbols/min [2025-10-09T18:37:40.367978] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:40.383463] [DEBUG] [LOCAL ] EFT: Loaded 13144 existing records from primary storage. [2025-10-09T18:37:40.383718] [INFO ] [MAIN ] EFT: Loaded 13144 existing records. [2025-10-09T18:37:40.566535] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:37:40.566746] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-09T18:37:40.566800] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-09T18:37:40.567345] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-09T18:37:40.567404] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-09T18:37:40.677427] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:37:40.801865] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-09T18:37:40.942288] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:41.596723] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-09T18:37:41.636340] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:37:42.396740] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-09T18:37:42.879735] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T18:37:43.023183] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T18:37:43.196699] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-09T18:37:43.996702] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-09T18:37:44.438663] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:37:44.503768] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:37:44.796706] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-09T18:37:45.480462] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T18:37:45.596797] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-09T18:37:46.396736] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-09T18:37:47.171840] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T18:37:47.199975] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-09T18:37:47.202959] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T18:37:47.996780] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-09T18:37:48.677995] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T18:37:48.796686] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-09T18:37:48.869809] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T18:37:49.596726] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-09T18:37:50.107377] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:37:50.396682] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-09T18:37:50.498479] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T18:37:50.858809] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T18:37:51.196716] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-09T18:37:51.996719] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-09T18:37:52.773152] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:37:52.796668] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-09T18:37:52.931978] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T18:37:53.596721] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-09T18:37:54.166679] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T18:37:54.396738] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-09T18:37:54.624563] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T18:37:55.117537] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T18:37:55.196665] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-09T18:37:55.996669] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-09T18:37:56.015017] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T18:37:56.796777] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-09T18:37:57.493161] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T18:37:57.596677] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-09T18:37:57.925308] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T18:37:58.264923] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T18:37:58.396718] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-09T18:37:59.196747] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-09T18:37:59.371194] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T18:37:59.953614] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T18:37:59.954829] [INFO ] [REMOTE ] EEX: Full fetch complete (18904 records). [2025-10-09T18:37:59.954899] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-09T18:38:00.007048] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-09T18:38:00.316609] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-09T18:38:00.316714] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-09T18:38:00.317060] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-09T18:38:00.317099] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-09T18:38:00.317614] [DEBUG] [LOCAL ] EEX: Trimmed 18904 records to 10865 (keeping 200 days of data) [2025-10-09T18:38:00.392389] [DEBUG] [LOCAL ] EEX: Primary data saved (10865 records). [2025-10-09T18:38:00.392541] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-09T18:38:00.392631] [INFO ] [MAIN ] Update Progress: 703/2373 symbols completed. EEX took 37.9s. Estimated remaining: 3h 52m 41s. Rate: 7.2 symbols/min [2025-10-09T18:38:00.558893] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:00.602707] [DEBUG] [LOCAL ] EFX: Loaded 44556 existing records from primary storage. [2025-10-09T18:38:00.602997] [INFO ] [MAIN ] EFX: Loaded 44556 existing records. [2025-10-09T18:38:00.784089] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:00.784297] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-09T18:38:00.784352] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-09T18:38:00.785692] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-09T18:38:00.785752] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-09T18:38:00.806005] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-09T18:38:01.092536] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T18:38:01.174383] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:01.596792] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-09T18:38:02.353937] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T18:38:02.358105] [INFO ] [REMOTE ] EFC: Full fetch complete (66312 records). [2025-10-09T18:38:02.358214] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-09T18:38:02.359169] [FATAL] [VALIDATOR ] EFC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:38:02.359258] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:38:02.359328] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:38:02.359403] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-09T18:38:02.359469] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-09T18:38:02.359506] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-10-09T18:38:02.359552] [DEBUG] [LOCAL ] EFC: No derivative data file found to delete. [2025-10-09T18:38:02.359612] [INFO ] [MAIN ] Update Progress: 704/2373 symbols completed. EFC took 33.7s. Estimated remaining: 3h 52m 17s. Rate: 7.2 symbols/min [2025-10-09T18:38:02.401951] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-09T18:38:02.506548] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T18:38:02.570314] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:02.599693] [DEBUG] [LOCAL ] EFXT: Loaded 29343 existing records from primary storage. [2025-10-09T18:38:02.599956] [INFO ] [MAIN ] EFXT: Loaded 29343 existing records. [2025-10-09T18:38:02.776146] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:02.776397] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-09T18:38:02.776471] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-09T18:38:02.777271] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-09T18:38:02.777332] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-09T18:38:03.139379] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:03.196726] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-09T18:38:03.929512] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:38:03.996673] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-09T18:38:04.606385] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T18:38:04.796730] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-09T18:38:05.532608] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:38:05.596690] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-09T18:38:05.873069] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T18:38:06.396748] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-09T18:38:06.997733] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T18:38:07.196686] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-09T18:38:07.343963] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T18:38:07.855316] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T18:38:07.996717] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-09T18:38:08.796771] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-09T18:38:08.853147] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T18:38:09.596723] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-09T18:38:10.134736] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T18:38:10.396724] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-09T18:38:10.617719] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T18:38:11.196718] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-09T18:38:11.615013] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T18:38:11.873584] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T18:38:11.875371] [INFO ] [REMOTE ] EFT: Full fetch complete (17964 records). [2025-10-09T18:38:11.875463] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-09T18:38:12.001815] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-09T18:38:12.250267] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-09T18:38:12.250349] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-09T18:38:12.250748] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-09T18:38:12.250815] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-09T18:38:12.251350] [DEBUG] [LOCAL ] EFT: Trimmed 17964 records to 13215 (keeping 200 days of data) [2025-10-09T18:38:12.332050] [DEBUG] [LOCAL ] EFT: Primary data saved (13215 records). [2025-10-09T18:38:12.332194] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-09T18:38:12.332276] [INFO ] [MAIN ] Update Progress: 705/2373 symbols completed. EFT took 32.1s. Estimated remaining: 3h 52m 13s. Rate: 7.2 symbols/min [2025-10-09T18:38:12.505456] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:12.531673] [DEBUG] [LOCAL ] EG: Loaded 27804 existing records from primary storage. [2025-10-09T18:38:12.531947] [INFO ] [MAIN ] EG: Loaded 27804 existing records. [2025-10-09T18:38:12.716062] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:12.716339] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-09T18:38:12.716405] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-09T18:38:12.717351] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-09T18:38:12.717412] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-09T18:38:12.801948] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-09T18:38:13.038774] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T18:38:13.067208] [INFO ] [REMOTE ] EFR: Full fetch complete (19161 records). [2025-10-09T18:38:13.097019] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-09T18:38:13.153253] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:13.481326] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-09T18:38:13.481407] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-09T18:38:13.481823] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-09T18:38:13.481935] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-09T18:38:13.482537] [DEBUG] [LOCAL ] EFR: Trimmed 19161 records to 15071 (keeping 200 days of data) [2025-10-09T18:38:13.572721] [DEBUG] [LOCAL ] EFR: Primary data saved (15071 records). [2025-10-09T18:38:13.572860] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-09T18:38:13.572939] [INFO ] [MAIN ] Update Progress: 706/2373 symbols completed. EFR took 38.5s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-09T18:38:13.602240] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-09T18:38:13.743389] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:13.743558] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-10-09T18:38:13.743596] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-10-09T18:38:13.743728] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-09T18:38:13.743772] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-09T18:38:13.743814] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-09T18:38:13.743911] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-09T18:38:14.094925] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:14.403782] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-09T18:38:14.423004] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T18:38:14.818505] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T18:38:15.196749] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-09T18:38:15.829790] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T18:38:15.996756] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-09T18:38:16.791836] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T18:38:16.798010] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-09T18:38:17.512662] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:38:17.596735] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-09T18:38:17.941192] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T18:38:18.396750] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-09T18:38:18.598343] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T18:38:19.196778] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-09T18:38:19.573157] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:38:19.996710] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-09T18:38:20.796721] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-09T18:38:20.823231] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T18:38:21.304324] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T18:38:21.596680] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-09T18:38:21.941216] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T18:38:22.396785] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-09T18:38:22.984318] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T18:38:23.196693] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-09T18:38:23.872939] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T18:38:23.996675] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-09T18:38:24.685236] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:38:24.796688] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-09T18:38:25.596830] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-09T18:38:25.832951] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T18:38:26.396717] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-09T18:38:26.612501] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:38:26.908430] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T18:38:27.196723] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-09T18:38:27.393296] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:38:27.996738] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-09T18:38:28.552000] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T18:38:28.796716] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-09T18:38:29.319099] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T18:38:29.596691] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-09T18:38:29.807512] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T18:38:30.396761] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-09T18:38:30.702324] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T18:38:31.196705] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-09T18:38:31.564930] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T18:38:31.996738] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-09T18:38:32.711082] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T18:38:32.796695] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-09T18:38:32.941197] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T18:38:33.596713] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-09T18:38:34.338960] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T18:38:34.396682] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-09T18:38:34.714960] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T18:38:35.196713] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-09T18:38:35.712735] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:38:35.996754] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-09T18:38:36.376974] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:38:36.380142] [INFO ] [REMOTE ] EFXT: Full fetch complete (43993 records). [2025-10-09T18:38:36.380229] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-09T18:38:36.762207] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-09T18:38:36.762293] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-09T18:38:36.762904] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-09T18:38:36.762973] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-09T18:38:36.763913] [DEBUG] [LOCAL ] EFXT: Trimmed 43993 records to 29630 (keeping 200 days of data) [2025-10-09T18:38:36.819633] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-09T18:38:36.945624] [DEBUG] [LOCAL ] EFXT: Primary data saved (29630 records). [2025-10-09T18:38:36.945794] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-09T18:38:36.945968] [INFO ] [MAIN ] Update Progress: 707/2373 symbols completed. EFXT took 34.6s. Estimated remaining: 3h 52m 15s. Rate: 7.2 symbols/min [2025-10-09T18:38:37.112420] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:37.142917] [DEBUG] [LOCAL ] EGP: Loaded 30646 existing records from primary storage. [2025-10-09T18:38:37.143181] [INFO ] [MAIN ] EGP: Loaded 30646 existing records. [2025-10-09T18:38:37.321373] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:37.321730] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-09T18:38:37.321816] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-09T18:38:37.322934] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-09T18:38:37.322995] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-09T18:38:37.601387] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-09T18:38:37.675928] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T18:38:37.721164] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:38.235851] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T18:38:38.396696] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-09T18:38:38.720848] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T18:38:39.196702] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-09T18:38:39.740244] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T18:38:39.996735] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-09T18:38:40.796708] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-09T18:38:40.884296] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T18:38:40.888390] [INFO ] [REMOTE ] EFX: Full fetch complete (64497 records). [2025-10-09T18:38:40.888537] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-09T18:38:41.274786] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-09T18:38:41.274955] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-09T18:38:41.275893] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-09T18:38:41.275975] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-09T18:38:41.277338] [DEBUG] [LOCAL ] EFX: Trimmed 64497 records to 44924 (keeping 200 days of data) [2025-10-09T18:38:41.412550] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T18:38:41.602778] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-09T18:38:41.621471] [DEBUG] [LOCAL ] EFX: Primary data saved (44924 records). [2025-10-09T18:38:41.621602] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-09T18:38:41.621729] [INFO ] [MAIN ] Update Progress: 708/2373 symbols completed. EFX took 41.2s. Estimated remaining: 3h 51m 57s. Rate: 7.2 symbols/min [2025-10-09T18:38:41.813264] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:41.869819] [DEBUG] [LOCAL ] EGY: Loaded 41770 existing records from primary storage. [2025-10-09T18:38:41.870863] [INFO ] [MAIN ] EGY: Loaded 41770 existing records. [2025-10-09T18:38:41.871395] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T18:38:42.059959] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:42.060179] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-09T18:38:42.060230] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-09T18:38:42.061247] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-09T18:38:42.061348] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-09T18:38:42.403167] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-09T18:38:42.434475] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:42.950394] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:38:43.196749] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-09T18:38:43.852744] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:38:43.996692] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-09T18:38:44.749523] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:38:44.796707] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-09T18:38:45.394065] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T18:38:45.596755] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-09T18:38:45.937028] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T18:38:45.939929] [INFO ] [REMOTE ] EG: Full fetch complete (43252 records). [2025-10-09T18:38:45.940096] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-09T18:38:46.336079] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-09T18:38:46.336193] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-09T18:38:46.337044] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-09T18:38:46.337112] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-09T18:38:46.338178] [DEBUG] [LOCAL ] EG: Trimmed 43252 records to 28013 (keeping 200 days of data) [2025-10-09T18:38:46.404567] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-09T18:38:46.520852] [DEBUG] [LOCAL ] EG: Primary data saved (28013 records). [2025-10-09T18:38:46.521030] [INFO ] [MAIN ] EG: Full history saved. [2025-10-09T18:38:46.521127] [INFO ] [MAIN ] Update Progress: 709/2373 symbols completed. EG took 34.2s. Estimated remaining: 3h 51m 41s. Rate: 7.2 symbols/min [2025-10-09T18:38:46.688258] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:46.715766] [DEBUG] [LOCAL ] EHAB: Loaded 29327 existing records from primary storage. [2025-10-09T18:38:46.716095] [INFO ] [MAIN ] EHAB: Loaded 29327 existing records. [2025-10-09T18:38:46.898985] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:46.899315] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-09T18:38:46.899496] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-09T18:38:46.900328] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-09T18:38:46.900393] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-09T18:38:47.027242] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:38:47.201916] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-09T18:38:47.296318] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:47.720577] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:38:47.996692] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-09T18:38:48.796817] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-09T18:38:49.007099] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T18:38:49.202037] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:38:49.596724] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-09T18:38:49.736112] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T18:38:50.396753] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-09T18:38:51.196769] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-09T18:38:51.320999] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T18:38:51.325876] [INFO ] [REMOTE ] EGO: Full fetch complete (73939 records). [2025-10-09T18:38:51.325996] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-09T18:38:51.769905] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-09T18:38:51.770056] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-09T18:38:51.776556] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-09T18:38:51.786762] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-09T18:38:51.788330] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T18:38:51.795531] [DEBUG] [LOCAL ] EGO: Trimmed 73939 records to 52063 (keeping 200 days of data) [2025-10-09T18:38:51.999930] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-09T18:38:52.110270] [DEBUG] [LOCAL ] EGO: Primary data saved (52063 records). [2025-10-09T18:38:52.110418] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-09T18:38:52.110494] [INFO ] [MAIN ] Update Progress: 710/2373 symbols completed. EGO took 38.5s. Estimated remaining: 3h 51m 26s. Rate: 7.2 symbols/min [2025-10-09T18:38:52.276202] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:52.323623] [DEBUG] [LOCAL ] EHC: Loaded 41177 existing records from primary storage. [2025-10-09T18:38:52.324156] [INFO ] [MAIN ] EHC: Loaded 41177 existing records. [2025-10-09T18:38:52.508902] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:52.509273] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-09T18:38:52.509479] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-09T18:38:52.510879] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-09T18:38:52.510941] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-09T18:38:52.812424] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-09T18:38:52.868019] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:38:52.921184] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:52.935973] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T18:38:53.596737] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-09T18:38:53.913152] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T18:38:54.396806] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-09T18:38:55.196747] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-09T18:38:55.306068] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:38:55.843187] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T18:38:55.996747] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-09T18:38:56.317830] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T18:38:56.796706] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-09T18:38:57.128378] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T18:38:57.596681] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-09T18:38:57.778741] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:38:58.396753] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-09T18:38:59.054933] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:38:59.196689] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-09T18:38:59.465511] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T18:38:59.996718] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-09T18:39:00.435542] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T18:39:00.796723] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-09T18:39:01.197332] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T18:39:01.596792] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-09T18:39:02.238921] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T18:39:02.396761] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-09T18:39:02.642926] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T18:39:02.645575] [INFO ] [REMOTE ] EGP: Full fetch complete (45348 records). [2025-10-09T18:39:02.645729] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-09T18:39:03.040297] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-09T18:39:03.040380] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-09T18:39:03.041064] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-09T18:39:03.041130] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-09T18:39:03.042296] [DEBUG] [LOCAL ] EGP: Trimmed 45348 records to 30837 (keeping 200 days of data) [2025-10-09T18:39:03.201629] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-09T18:39:03.243567] [DEBUG] [LOCAL ] EGP: Primary data saved (30837 records). [2025-10-09T18:39:03.243746] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-09T18:39:03.244994] [INFO ] [MAIN ] Update Progress: 711/2373 symbols completed. EGP took 26.3s. Estimated remaining: 3h 51m 24s. Rate: 7.2 symbols/min [2025-10-09T18:39:03.418150] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:03.430853] [DEBUG] [LOCAL ] EHI: Loaded 10705 existing records from primary storage. [2025-10-09T18:39:03.431118] [INFO ] [MAIN ] EHI: Loaded 10705 existing records. [2025-10-09T18:39:03.641395] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:39:03.641683] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-09T18:39:03.641743] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-09T18:39:03.657294] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-09T18:39:03.657381] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-09T18:39:03.744319] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T18:39:04.001859] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-09T18:39:04.029370] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:04.796687] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-09T18:39:04.903499] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T18:39:05.037690] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T18:39:05.596697] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-09T18:39:05.850748] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T18:39:06.396758] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-09T18:39:07.043955] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:39:07.196769] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-09T18:39:07.225392] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:39:07.996777] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-09T18:39:08.523369] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T18:39:08.796774] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-09T18:39:09.157261] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T18:39:09.596724] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-09T18:39:09.948005] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:39:10.396721] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-09T18:39:10.470353] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T18:39:11.196747] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-09T18:39:11.996980] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-09T18:39:11.999576] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T18:39:12.653521] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T18:39:12.796714] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-09T18:39:13.171293] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:39:13.596778] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-09T18:39:14.249851] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T18:39:14.396743] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-09T18:39:14.545335] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T18:39:15.196709] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-09T18:39:15.736890] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:39:15.996734] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-09T18:39:16.340321] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T18:39:16.343767] [INFO ] [REMOTE ] EGY: Full fetch complete (61086 records). [2025-10-09T18:39:16.343868] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-09T18:39:16.724345] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-09T18:39:16.724431] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-09T18:39:16.725235] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-09T18:39:16.725301] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-09T18:39:16.726554] [DEBUG] [LOCAL ] EGY: Trimmed 61086 records to 42030 (keeping 200 days of data) [2025-10-09T18:39:16.809986] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-09T18:39:16.977503] [DEBUG] [LOCAL ] EGY: Primary data saved (42030 records). [2025-10-09T18:39:16.977675] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-09T18:39:16.977788] [INFO ] [MAIN ] Update Progress: 712/2373 symbols completed. EGY took 35.4s. Estimated remaining: 3h 51m 29s. Rate: 7.2 symbols/min [2025-10-09T18:39:17.173665] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T18:39:17.177300] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:17.206179] [DEBUG] [LOCAL ] EIC: Loaded 23043 existing records from primary storage. [2025-10-09T18:39:17.206451] [INFO ] [MAIN ] EIC: Loaded 23043 existing records. [2025-10-09T18:39:17.389395] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:39:17.389636] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-09T18:39:17.389722] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-09T18:39:17.390483] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-09T18:39:17.390545] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-09T18:39:17.603785] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-09T18:39:17.702448] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:39:17.799177] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:18.396735] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-09T18:39:18.912084] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:39:19.063310] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T18:39:19.196727] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-09T18:39:19.996793] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-09T18:39:20.584412] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T18:39:20.796684] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-09T18:39:20.809047] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T18:39:21.596789] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-09T18:39:21.891406] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T18:39:22.396752] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-09T18:39:22.458256] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T18:39:23.196734] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-09T18:39:23.474549] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:39:23.996695] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-09T18:39:24.796700] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-09T18:39:24.895867] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T18:39:24.995265] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T18:39:24.997606] [INFO ] [REMOTE ] EHAB: Full fetch complete (40897 records). [2025-10-09T18:39:24.997758] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-09T18:39:25.377324] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-09T18:39:25.377422] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-09T18:39:25.378076] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-09T18:39:25.378139] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-09T18:39:25.379143] [DEBUG] [LOCAL ] EHAB: Trimmed 40897 records to 29479 (keeping 200 days of data) [2025-10-09T18:39:25.547755] [DEBUG] [LOCAL ] EHAB: Primary data saved (29479 records). [2025-10-09T18:39:25.547923] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-09T18:39:25.548013] [INFO ] [MAIN ] Update Progress: 713/2373 symbols completed. EHAB took 39.0s. Estimated remaining: 3h 51m 21s. Rate: 7.2 symbols/min [2025-10-09T18:39:25.601867] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-09T18:39:25.659346] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T18:39:25.735112] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:25.735237] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-09T18:39:25.735289] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-09T18:39:25.735422] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-09T18:39:25.735490] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-09T18:39:25.735545] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-09T18:39:25.735585] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-09T18:39:26.090853] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:26.396743] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-09T18:39:26.902524] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T18:39:27.043027] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T18:39:27.196717] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-09T18:39:27.996719] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-09T18:39:28.117761] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T18:39:28.119253] [INFO ] [REMOTE ] EHI: Full fetch complete (16260 records). [2025-10-09T18:39:28.119322] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-09T18:39:28.493114] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-09T18:39:28.493191] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-09T18:39:28.493569] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-09T18:39:28.493608] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-09T18:39:28.494133] [DEBUG] [LOCAL ] EHI: Trimmed 16260 records to 10769 (keeping 200 days of data) [2025-10-09T18:39:28.555445] [DEBUG] [LOCAL ] EHI: Primary data saved (10769 records). [2025-10-09T18:39:28.555577] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-09T18:39:28.555688] [INFO ] [MAIN ] Update Progress: 714/2373 symbols completed. EHI took 25.3s. Estimated remaining: 3h 50m 60s. Rate: 7.2 symbols/min [2025-10-09T18:39:28.732466] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:28.732663] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-09T18:39:28.732724] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-09T18:39:28.732836] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-09T18:39:28.732877] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-09T18:39:28.732918] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-09T18:39:28.732950] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-09T18:39:28.801943] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-09T18:39:29.116188] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:29.262968] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T18:39:29.480713] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T18:39:29.596671] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-09T18:39:30.396720] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-09T18:39:30.983581] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T18:39:31.044343] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T18:39:31.196703] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-09T18:39:31.996760] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-09T18:39:32.265730] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T18:39:32.426573] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T18:39:32.796737] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-09T18:39:33.596749] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-09T18:39:34.189683] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:39:34.193073] [INFO ] [REMOTE ] EHC: Full fetch complete (58733 records). [2025-10-09T18:39:34.193182] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-09T18:39:34.405221] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-09T18:39:34.579014] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-09T18:39:34.579093] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-09T18:39:34.579862] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-09T18:39:34.579926] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-09T18:39:34.581118] [DEBUG] [LOCAL ] EHC: Trimmed 58733 records to 41416 (keeping 200 days of data) [2025-10-09T18:39:34.821795] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T18:39:34.870289] [DEBUG] [LOCAL ] EHC: Primary data saved (41416 records). [2025-10-09T18:39:34.870412] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-09T18:39:34.870488] [INFO ] [MAIN ] Update Progress: 715/2373 symbols completed. EHC took 42.8s. Estimated remaining: 3h 50m 47s. Rate: 7.2 symbols/min [2025-10-09T18:39:34.976165] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T18:39:35.047841] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:35.048051] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-09T18:39:35.048107] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-09T18:39:35.048256] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-09T18:39:35.048298] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-09T18:39:35.048339] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-09T18:39:35.048370] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-09T18:39:35.197557] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-09T18:39:35.405554] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:35.637489] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T18:39:35.996799] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-09T18:39:36.328994] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T18:39:36.796727] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-09T18:39:37.116839] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-09T18:39:37.596774] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-09T18:39:38.396693] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-09T18:39:38.653507] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-09T18:39:38.748003] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:39:39.196711] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-09T18:39:39.620355] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:39:39.996724] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-09T18:39:40.380239] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T18:39:40.796740] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-09T18:39:41.596791] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-09T18:39:41.925483] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T18:39:42.025983] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:39:42.396721] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-09T18:39:43.196686] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-09T18:39:43.572270] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-09T18:39:43.589039] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T18:39:43.996741] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-09T18:39:44.455999] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T18:39:44.796742] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-09T18:39:45.173425] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T18:39:45.596720] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-09T18:39:46.339128] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:39:46.396777] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-09T18:39:47.196708] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-09T18:39:47.229556] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T18:39:47.231582] [INFO ] [REMOTE ] EIC: Full fetch complete (34494 records). [2025-10-09T18:39:47.231701] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-09T18:39:47.602406] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-09T18:39:47.602488] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-09T18:39:47.603090] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-09T18:39:47.603161] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-09T18:39:47.603918] [DEBUG] [LOCAL ] EIC: Trimmed 34494 records to 23193 (keeping 200 days of data) [2025-10-09T18:39:47.732317] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T18:39:47.758042] [DEBUG] [LOCAL ] EIC: Primary data saved (23193 records). [2025-10-09T18:39:47.758185] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-09T18:39:47.758274] [INFO ] [MAIN ] Update Progress: 716/2373 symbols completed. EIC took 30.8s. Estimated remaining: 3h 50m 49s. Rate: 7.2 symbols/min [2025-10-09T18:39:47.941856] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:47.962309] [DEBUG] [LOCAL ] EIG: Loaded 20264 existing records from primary storage. [2025-10-09T18:39:47.962549] [INFO ] [MAIN ] EIG: Loaded 20264 existing records. [2025-10-09T18:39:48.001937] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-09T18:39:48.149765] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:39:48.150047] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-09T18:39:48.150108] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-09T18:39:48.151152] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-09T18:39:48.151214] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-09T18:39:48.516966] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:48.701947] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T18:39:48.796718] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-09T18:39:49.136238] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T18:39:49.596758] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-09T18:39:50.018033] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T18:39:50.396723] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-09T18:39:50.932174] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T18:39:51.196705] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-09T18:39:51.590191] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T18:39:51.996721] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-09T18:39:52.357213] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T18:39:52.357963] [INFO ] [REMOTE ] EICA: Full fetch complete (1279 records). [2025-10-09T18:39:52.358030] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-09T18:39:52.532834] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-09T18:39:52.533046] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:39:52.533115] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:39:52.533166] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-09T18:39:52.533220] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-09T18:39:52.533255] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-09T18:39:52.533293] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-09T18:39:52.533350] [INFO ] [MAIN ] Update Progress: 717/2373 symbols completed. EICA took 27.0s. Estimated remaining: 3h 50m 32s. Rate: 7.2 symbols/min [2025-10-09T18:39:52.796766] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-09T18:39:53.337108] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T18:39:53.596738] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-09T18:39:54.296696] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T18:39:54.396739] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-09T18:39:55.070458] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:39:55.196709] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-09T18:39:55.972876] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:39:55.996676] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-09T18:39:56.551782] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T18:39:56.796762] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-09T18:39:57.279536] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-09T18:39:57.596723] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-09T18:39:58.158020] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T18:39:58.396743] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-09T18:39:59.040889] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-09T18:39:59.196707] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-09T18:39:59.779246] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T18:39:59.996707] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-09T18:40:00.698198] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T18:40:00.796723] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-09T18:40:01.525189] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T18:40:01.596723] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-09T18:40:01.931496] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T18:40:02.396740] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-09T18:40:02.980086] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T18:40:02.980896] [INFO ] [REMOTE ] EICB: Full fetch complete (2699 records). [2025-10-09T18:40:02.980968] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-09T18:40:03.174883] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T18:40:03.175079] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:40:03.175147] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:40:03.175199] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-09T18:40:03.175255] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-09T18:40:03.175291] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-09T18:40:03.175369] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-09T18:40:03.175458] [INFO ] [MAIN ] Update Progress: 718/2373 symbols completed. EICB took 34.6s. Estimated remaining: 3h 50m 29s. Rate: 7.2 symbols/min [2025-10-09T18:40:03.196700] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-09T18:40:03.996694] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-09T18:40:04.078229] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T18:40:04.719318] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T18:40:04.796704] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-09T18:40:05.317677] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T18:40:05.318938] [INFO ] [REMOTE ] EICC: Full fetch complete (8380 records). [2025-10-09T18:40:05.319051] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-09T18:40:05.319469] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:40:05.319568] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:40:05.319611] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:40:05.319699] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-09T18:40:05.319767] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-09T18:40:05.319803] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-09T18:40:05.319860] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-09T18:40:05.319941] [INFO ] [MAIN ] Update Progress: 719/2373 symbols completed. EICC took 30.4s. Estimated remaining: 3h 50m 7s. Rate: 7.2 symbols/min [2025-10-09T18:40:05.596725] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-09T18:40:06.789597] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:40:06.794591] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-09T18:40:07.855934] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T18:40:07.861585] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-09T18:40:08.856977] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:40:08.861826] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-09T18:40:09.957230] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T18:40:09.962249] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-09T18:40:11.106304] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:40:11.112407] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-09T18:40:11.852278] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:40:11.857053] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-09T18:40:12.828171] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T18:40:12.829973] [INFO ] [REMOTE ] EIG: Full fetch complete (27079 records). [2025-10-09T18:40:12.830044] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-09T18:40:13.199836] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-09T18:40:13.199916] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-09T18:40:13.200418] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-09T18:40:13.200459] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-09T18:40:13.201148] [DEBUG] [LOCAL ] EIG: Trimmed 27079 records to 20377 (keeping 200 days of data) [2025-10-09T18:40:13.325583] [DEBUG] [LOCAL ] EIG: Primary data saved (20377 records). [2025-10-09T18:40:13.325740] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-09T18:40:13.325834] [INFO ] [MAIN ] Update Progress: 720/2373 symbols completed. EIG took 25.6s. Estimated remaining: 3h 49m 57s. Rate: 7.2 symbols/min [2025-10-09T18:40:13.953279] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:13.968679] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:14.024710] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:14.045087] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:14.050510] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-10-09T18:40:14.050914] [INFO ] [MAIN ] ELC: Loaded 3504 existing records. [2025-10-09T18:40:14.272458] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:14.272812] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-09T18:40:14.272875] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-09T18:40:14.273233] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-09T18:40:14.273304] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-09T18:40:14.430871] [DEBUG] [LOCAL ] EL: Loaded 53372 existing records from primary storage. [2025-10-09T18:40:14.461831] [DEBUG] [LOCAL ] EIX: Loaded 53347 existing records from primary storage. [2025-10-09T18:40:14.468185] [INFO ] [MAIN ] EL: Loaded 53372 existing records. [2025-10-09T18:40:14.473575] [INFO ] [MAIN ] EIX: Loaded 53347 existing records. [2025-10-09T18:40:14.586773] [DEBUG] [LOCAL ] ELAN: Loaded 53293 existing records from primary storage. [2025-10-09T18:40:14.722157] [INFO ] [MAIN ] ELAN: Loaded 53293 existing records. [2025-10-09T18:40:15.086727] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:15.178874] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:15.210554] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:15.248298] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-09T18:40:15.179042] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-09T18:40:15.216125] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-09T18:40:15.272566] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-09T18:40:15.275480] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:15.276575] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-09T18:40:15.276634] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-09T18:40:15.278429] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-09T18:40:15.278512] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-09T18:40:15.276437] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-09T18:40:15.289974] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-09T18:40:15.304979] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-09T18:40:15.325416] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-09T18:40:15.375124] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-09T18:40:16.122790] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T18:40:16.156784] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-09T18:40:16.299733] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:16.336030] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-09T18:40:16.330624] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:16.341558] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-09T18:40:16.406503] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:16.407226] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-09T18:40:16.874817] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T18:40:16.876277] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-09T18:40:17.990503] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T18:40:18.001044] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-09T18:40:18.117167] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T18:40:18.129996] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-09T18:40:18.725683] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-09T18:40:18.737478] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-09T18:40:18.742049] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T18:40:18.743284] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-09T18:40:19.063633] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-09T18:40:19.196755] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-09T18:40:19.420889] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:40:19.514433] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T18:40:19.809821] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T18:40:19.996745] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-09T18:40:20.322166] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T18:40:20.796784] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-09T18:40:21.596775] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-09T18:40:21.741615] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:40:21.906595] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-09T18:40:22.396708] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-09T18:40:22.833779] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-09T18:40:22.926896] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T18:40:23.196719] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-09T18:40:23.620350] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-09T18:40:23.996767] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-09T18:40:24.588060] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:40:24.796757] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-09T18:40:25.596715] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-09T18:40:26.160262] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T18:40:26.203797] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:40:26.396711] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-09T18:40:27.196741] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-09T18:40:27.996743] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-09T18:40:28.165432] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:40:28.612202] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T18:40:28.613382] [INFO ] [REMOTE ] ELC: Full fetch complete (5059 records). [2025-10-09T18:40:28.613691] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-09T18:40:28.801861] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-09T18:40:29.061859] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-09T18:40:29.061972] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-09T18:40:29.062294] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-09T18:40:29.062429] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-09T18:40:29.063240] [DEBUG] [LOCAL ] ELC: Trimmed 5059 records to 3524 (keeping 200 days of data) [2025-10-09T18:40:29.106870] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T18:40:29.131219] [DEBUG] [LOCAL ] ELC: Primary data saved (3524 records). [2025-10-09T18:40:29.131352] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-09T18:40:29.131463] [INFO ] [MAIN ] Update Progress: 721/2373 symbols completed. ELC took 15.8s. Estimated remaining: 3h 50m 6s. Rate: 7.2 symbols/min [2025-10-09T18:40:29.336378] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:29.389184] [DEBUG] [LOCAL ] ELF: Loaded 52053 existing records from primary storage. [2025-10-09T18:40:29.389542] [INFO ] [MAIN ] ELF: Loaded 52053 existing records. [2025-10-09T18:40:29.573273] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:29.573519] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-09T18:40:29.573578] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-09T18:40:29.575015] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-09T18:40:29.575078] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-09T18:40:29.606164] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-09T18:40:29.987092] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:30.396709] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-09T18:40:30.535987] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:40:31.196743] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-09T18:40:31.511408] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:40:31.996699] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-09T18:40:32.113567] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T18:40:32.505907] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T18:40:32.796733] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-09T18:40:33.596735] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-09T18:40:34.006372] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T18:40:34.396720] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-09T18:40:34.832018] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T18:40:34.960932] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:40:35.196706] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-09T18:40:35.996681] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-09T18:40:36.195897] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:40:36.796756] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-09T18:40:36.864818] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:40:37.596694] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-09T18:40:37.798871] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T18:40:38.048814] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T18:40:38.396733] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-09T18:40:39.085718] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:40:39.196815] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-09T18:40:39.996719] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-09T18:40:40.559104] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-09T18:40:40.796721] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-09T18:40:41.277790] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-09T18:40:41.596691] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-09T18:40:41.817413] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T18:40:42.396692] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-09T18:40:42.444167] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:40:43.201842] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-09T18:40:43.218905] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T18:40:43.996733] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-09T18:40:44.268705] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:40:44.796711] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-09T18:40:45.043579] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T18:40:45.432693] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T18:40:45.596700] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-09T18:40:46.396685] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-09T18:40:46.869841] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-09T18:40:47.196708] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-09T18:40:47.247474] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T18:40:47.252099] [INFO ] [REMOTE ] ELAN: Full fetch complete (76872 records). [2025-10-09T18:40:47.252222] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-09T18:40:47.645693] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-09T18:40:47.645802] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-09T18:40:47.647336] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-09T18:40:47.647404] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-09T18:40:47.649059] [DEBUG] [LOCAL ] ELAN: Trimmed 76872 records to 53679 (keeping 200 days of data) [2025-10-09T18:40:47.971822] [DEBUG] [LOCAL ] ELAN: Primary data saved (53679 records). [2025-10-09T18:40:47.971966] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-09T18:40:47.972080] [INFO ] [MAIN ] Update Progress: 722/2373 symbols completed. ELAN took 34.6s. Estimated remaining: 3h 50m 22s. Rate: 7.2 symbols/min [2025-10-09T18:40:48.003693] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-09T18:40:48.147402] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:48.184893] [DEBUG] [LOCAL ] ELME: Loaded 39293 existing records from primary storage. [2025-10-09T18:40:48.185172] [INFO ] [MAIN ] ELME: Loaded 39293 existing records. [2025-10-09T18:40:48.370880] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:48.371186] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-09T18:40:48.371298] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-09T18:40:48.372756] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-09T18:40:48.372819] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-09T18:40:48.743504] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-09T18:40:48.810690] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-09T18:40:48.834183] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:49.239752] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-09T18:40:49.596697] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-09T18:40:49.774788] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T18:40:50.396744] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-09T18:40:50.647035] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:40:51.097876] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T18:40:51.196738] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-09T18:40:51.996716] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-09T18:40:52.202263] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T18:40:52.241400] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:40:52.796761] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-09T18:40:53.596689] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-09T18:40:53.673576] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T18:40:54.396691] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-09T18:40:54.711974] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T18:40:55.196685] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-09T18:40:55.297401] [DEBUG] [REMOTE ] EIX: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-09T18:40:55.297723] [WARN ] [REMOTE ] EIX: No data returned for month 2025-10 [2025-10-09T18:40:55.297843] [FATAL] [REMOTE ] EIX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:40:55.297951] [FATAL] [MAIN ] EIX: Failed to fetch primary data. [2025-10-09T18:40:55.298017] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:40:55.298089] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-09T18:40:55.298151] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-09T18:40:55.298186] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-10-09T18:40:55.298471] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-10-09T18:40:55.298572] [INFO ] [MAIN ] Update Progress: 723/2373 symbols completed. EIX took 42.0s. Estimated remaining: 3h 50m 11s. Rate: 7.2 symbols/min [2025-10-09T18:40:55.475330] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:55.508389] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:40:55.544590] [DEBUG] [LOCAL ] ELP: Loaded 25619 existing records from primary storage. [2025-10-09T18:40:55.544924] [INFO ] [MAIN ] ELP: Loaded 25619 existing records. [2025-10-09T18:40:55.785089] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:55.792108] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-09T18:40:55.803566] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-09T18:40:55.804900] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:40:55.804949] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-09T18:40:55.814101] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-09T18:40:56.005736] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-09T18:40:56.183292] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:56.796732] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-09T18:40:57.550355] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T18:40:57.554499] [INFO ] [REMOTE ] ELF: Full fetch complete (75261 records). [2025-10-09T18:40:57.554614] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-09T18:40:57.601799] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-09T18:40:57.976893] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-09T18:40:57.976979] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-09T18:40:57.978126] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-09T18:40:57.978196] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-09T18:40:57.979723] [DEBUG] [LOCAL ] ELF: Trimmed 75261 records to 52403 (keeping 200 days of data) [2025-10-09T18:40:58.090881] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T18:40:58.330530] [DEBUG] [LOCAL ] ELF: Primary data saved (52403 records). [2025-10-09T18:40:58.330702] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-09T18:40:58.330798] [INFO ] [MAIN ] Update Progress: 724/2373 symbols completed. ELF took 29.2s. Estimated remaining: 3h 49m 51s. Rate: 7.2 symbols/min [2025-10-09T18:40:58.406342] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-09T18:40:58.513861] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:58.514039] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-09T18:40:58.514098] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-09T18:40:58.514217] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-09T18:40:58.514260] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-09T18:40:58.514302] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-09T18:40:58.514336] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-09T18:40:58.905119] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:59.196712] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-09T18:40:59.481408] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T18:40:59.486439] [INFO ] [REMOTE ] EL: Full fetch complete (77274 records). [2025-10-09T18:40:59.486583] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-09T18:40:59.797528] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:40:59.913600] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-09T18:40:59.914150] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-09T18:40:59.915252] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-09T18:40:59.915359] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-09T18:40:59.939622] [DEBUG] [LOCAL ] EL: Trimmed 77274 records to 53760 (keeping 200 days of data) [2025-10-09T18:40:59.940458] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T18:41:00.005515] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-09T18:41:00.292762] [DEBUG] [LOCAL ] EL: Primary data saved (53760 records). [2025-10-09T18:41:00.292925] [INFO ] [MAIN ] EL: Full history saved. [2025-10-09T18:41:00.293031] [INFO ] [MAIN ] Update Progress: 725/2373 symbols completed. EL took 47.0s. Estimated remaining: 3h 49m 28s. Rate: 7.2 symbols/min [2025-10-09T18:41:00.465193] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:00.512006] [DEBUG] [LOCAL ] ELS: Loaded 49760 existing records from primary storage. [2025-10-09T18:41:00.512333] [INFO ] [MAIN ] ELS: Loaded 49760 existing records. [2025-10-09T18:41:00.690749] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:00.690926] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-09T18:41:00.690979] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-09T18:41:00.692336] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-09T18:41:00.692396] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-09T18:41:00.801829] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-09T18:41:01.054594] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:01.138665] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T18:41:01.445479] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T18:41:01.596747] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-09T18:41:02.396778] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-09T18:41:02.671579] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-09T18:41:02.976583] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:41:03.196702] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-09T18:41:03.526402] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-09T18:41:03.996787] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-09T18:41:04.796767] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-09T18:41:05.397351] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T18:41:05.596739] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-09T18:41:06.396699] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-09T18:41:06.578190] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T18:41:06.775372] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-09T18:41:06.890621] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:41:07.196707] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-09T18:41:07.996776] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-09T18:41:08.279359] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-09T18:41:08.590977] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T18:41:08.796750] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-09T18:41:09.123313] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T18:41:09.596705] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-09T18:41:10.396715] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-09T18:41:10.589725] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T18:41:11.196762] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-09T18:41:11.996756] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-09T18:41:12.122339] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:41:12.425532] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:41:12.530993] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T18:41:12.796706] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-09T18:41:13.596788] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-09T18:41:14.127188] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T18:41:14.396688] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-09T18:41:14.423180] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T18:41:15.196715] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-09T18:41:15.510035] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-09T18:41:15.996763] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-09T18:41:16.188608] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T18:41:16.796717] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-09T18:41:17.074566] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-09T18:41:17.424020] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:41:17.596766] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-09T18:41:17.937031] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T18:41:17.937746] [INFO ] [REMOTE ] ELPC: Full fetch complete (1416 records). [2025-10-09T18:41:17.937850] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-09T18:41:18.121303] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-09T18:41:18.121512] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:41:18.121605] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:41:18.121700] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-09T18:41:18.121779] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-09T18:41:18.121838] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-09T18:41:18.121900] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-09T18:41:18.121982] [INFO ] [MAIN ] Update Progress: 726/2373 symbols completed. ELPC took 19.8s. Estimated remaining: 3h 49m 41s. Rate: 7.2 symbols/min [2025-10-09T18:41:18.289888] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:18.338132] [DEBUG] [LOCAL ] ELV: Loaded 50611 existing records from primary storage. [2025-10-09T18:41:18.338464] [INFO ] [MAIN ] ELV: Loaded 50611 existing records. [2025-10-09T18:41:18.401891] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-09T18:41:18.517561] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:18.517783] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-09T18:41:18.517871] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-09T18:41:18.519304] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-09T18:41:18.519364] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-09T18:41:18.876174] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:19.196688] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-09T18:41:19.575157] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T18:41:19.996735] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-09T18:41:20.705750] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T18:41:20.710253] [INFO ] [REMOTE ] ELME: Full fetch complete (56092 records). [2025-10-09T18:41:20.710381] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-09T18:41:20.801815] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-09T18:41:21.111931] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-09T18:41:21.112014] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-09T18:41:21.112807] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-09T18:41:21.112872] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-09T18:41:21.113996] [DEBUG] [LOCAL ] ELME: Trimmed 56092 records to 39587 (keeping 200 days of data) [2025-10-09T18:41:21.362555] [DEBUG] [LOCAL ] ELME: Primary data saved (39587 records). [2025-10-09T18:41:21.362804] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-09T18:41:21.362899] [INFO ] [MAIN ] Update Progress: 727/2373 symbols completed. ELME took 33.4s. Estimated remaining: 3h 49m 21s. Rate: 7.2 symbols/min [2025-10-09T18:41:21.581855] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T18:41:21.580242] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:21.591485] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-09T18:41:21.591594] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-09T18:41:21.592288] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-09T18:41:21.592712] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-09T18:41:21.592808] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-09T18:41:21.592849] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-09T18:41:21.604271] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-09T18:41:21.954701] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:22.396689] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-09T18:41:22.762219] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T18:41:23.196695] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-09T18:41:23.419150] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:41:23.564888] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:41:23.996720] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-09T18:41:24.763981] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:41:24.796681] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-09T18:41:24.974275] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T18:41:25.596714] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-09T18:41:26.162794] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T18:41:26.396742] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-09T18:41:27.196693] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-09T18:41:27.320582] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T18:41:27.369195] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T18:41:27.413837] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:41:27.414174] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-09T18:41:27.414272] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:41:27.414322] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-09T18:41:27.414358] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:41:27.414397] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-09T18:41:27.414476] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-09T18:41:27.414532] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-09T18:41:27.414576] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-09T18:41:27.414625] [INFO ] [MAIN ] Update Progress: 728/2373 symbols completed. EMA took 6.1s. Estimated remaining: 3h 49m 7s. Rate: 7.2 symbols/min [2025-10-09T18:41:27.589786] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:27.611725] [DEBUG] [LOCAL ] EMD: Loaded 21094 existing records from primary storage. [2025-10-09T18:41:27.611975] [INFO ] [MAIN ] EMD: Loaded 21094 existing records. [2025-10-09T18:41:27.793695] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:27.793891] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-09T18:41:27.793937] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-09T18:41:27.794206] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-09T18:41:27.794264] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-09T18:41:28.001846] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-09T18:41:28.159239] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:28.796774] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-09T18:41:29.279317] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T18:41:29.596715] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-09T18:41:30.168383] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T18:41:30.396728] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-09T18:41:31.198116] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-09T18:41:31.211512] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T18:41:31.795310] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T18:41:31.996795] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-09T18:41:32.274323] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:41:32.796751] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-09T18:41:33.596723] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-09T18:41:33.809373] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T18:41:33.985815] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T18:41:33.988113] [INFO ] [REMOTE ] ELP: Full fetch complete (36830 records). [2025-10-09T18:41:33.988222] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-09T18:41:34.372150] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-09T18:41:34.372229] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-09T18:41:34.372908] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-09T18:41:34.372972] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-09T18:41:34.373842] [DEBUG] [LOCAL ] ELP: Trimmed 36830 records to 25781 (keeping 200 days of data) [2025-10-09T18:41:34.422482] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-09T18:41:34.531371] [DEBUG] [LOCAL ] ELP: Primary data saved (25781 records). [2025-10-09T18:41:34.531522] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-09T18:41:34.531634] [INFO ] [MAIN ] Update Progress: 729/2373 symbols completed. ELP took 39.2s. Estimated remaining: 3h 48m 56s. Rate: 7.2 symbols/min [2025-10-09T18:41:34.708260] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:34.743387] [DEBUG] [LOCAL ] EME: Loaded 31165 existing records from primary storage. [2025-10-09T18:41:34.743694] [INFO ] [MAIN ] EME: Loaded 31165 existing records. [2025-10-09T18:41:34.918715] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:34.918926] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-09T18:41:34.918974] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-09T18:41:34.919169] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-09T18:41:34.919225] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-09T18:41:35.197528] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-09T18:41:35.286756] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:35.301122] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:41:35.529915] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T18:41:35.996732] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-09T18:41:36.672151] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T18:41:36.796708] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-09T18:41:37.596705] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-09T18:41:37.782431] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T18:41:38.194624] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T18:41:38.199025] [INFO ] [REMOTE ] ELS: Full fetch complete (70987 records). [2025-10-09T18:41:38.199158] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-09T18:41:38.402076] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-09T18:41:38.621042] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-09T18:41:38.621350] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-09T18:41:38.622561] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-09T18:41:38.622805] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-09T18:41:38.624453] [DEBUG] [LOCAL ] ELS: Trimmed 70987 records to 50144 (keeping 200 days of data) [2025-10-09T18:41:38.896125] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T18:41:39.004000] [DEBUG] [LOCAL ] ELS: Primary data saved (50144 records). [2025-10-09T18:41:39.004176] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-09T18:41:39.004274] [INFO ] [MAIN ] Update Progress: 730/2373 symbols completed. ELS took 38.7s. Estimated remaining: 3h 48m 39s. Rate: 7.2 symbols/min [2025-10-09T18:41:39.202030] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-09T18:41:39.206465] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:39.214581] [DEBUG] [LOCAL ] EMF: Loaded 3289 existing records from primary storage. [2025-10-09T18:41:39.215051] [INFO ] [MAIN ] EMF: Loaded 3289 existing records. [2025-10-09T18:41:39.427765] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:39.428295] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-09T18:41:39.428352] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-09T18:41:39.428671] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-09T18:41:39.428732] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-09T18:41:39.858851] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:39.996697] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-09T18:41:40.138546] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T18:41:40.244105] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:41:40.796700] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-09T18:41:40.918537] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T18:41:41.596725] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-09T18:41:42.396740] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-09T18:41:42.533224] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T18:41:43.018429] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-09T18:41:43.196703] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-09T18:41:43.366909] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T18:41:43.911243] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T18:41:43.996701] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-09T18:41:44.529937] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T18:41:44.796727] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-09T18:41:45.468190] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T18:41:45.596732] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-09T18:41:46.396729] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-09T18:41:47.000906] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T18:41:47.070366] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T18:41:47.196672] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-09T18:41:47.996720] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-09T18:41:48.666206] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T18:41:48.796704] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-09T18:41:49.219513] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-09T18:41:49.539475] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T18:41:49.596687] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-09T18:41:50.396766] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-09T18:41:51.196677] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-09T18:41:51.659225] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-09T18:41:51.996693] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-09T18:41:52.078832] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T18:41:52.137406] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T18:41:52.796771] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-09T18:41:53.596724] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-09T18:41:53.707067] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T18:41:53.711322] [INFO ] [REMOTE ] ELV: Full fetch complete (73075 records). [2025-10-09T18:41:53.711423] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-09T18:41:53.906809] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T18:41:54.123895] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-09T18:41:54.123980] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-09T18:41:54.124876] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-09T18:41:54.124940] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-09T18:41:54.126353] [DEBUG] [LOCAL ] ELV: Trimmed 73075 records to 50963 (keeping 200 days of data) [2025-10-09T18:41:54.415538] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-09T18:41:54.455925] [DEBUG] [LOCAL ] ELV: Primary data saved (50963 records). [2025-10-09T18:41:54.456033] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-09T18:41:54.457278] [INFO ] [MAIN ] Update Progress: 731/2373 symbols completed. ELV took 36.3s. Estimated remaining: 3h 48m 47s. Rate: 7.2 symbols/min [2025-10-09T18:41:54.626468] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:54.677929] [DEBUG] [LOCAL ] EMN: Loaded 50628 existing records from primary storage. [2025-10-09T18:41:54.678244] [INFO ] [MAIN ] EMN: Loaded 50628 existing records. [2025-10-09T18:41:54.856565] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:54.857045] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-09T18:41:54.857193] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-09T18:41:54.857875] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-09T18:41:54.857937] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-09T18:41:55.160408] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T18:41:55.196855] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-09T18:41:55.260397] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:55.273695] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T18:41:55.996773] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-09T18:41:56.572580] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T18:41:56.796683] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-09T18:41:56.909460] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T18:41:57.596738] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-09T18:41:58.396688] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-09T18:41:58.501558] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T18:41:58.791769] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:41:59.196698] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-09T18:41:59.504915] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:41:59.996708] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-09T18:42:00.351371] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T18:42:00.797758] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-09T18:42:00.799835] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T18:42:01.284839] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-09T18:42:01.596731] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-09T18:42:02.396725] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-09T18:42:03.095604] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T18:42:03.196736] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-09T18:42:03.493851] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:42:03.496327] [INFO ] [REMOTE ] EMD: Full fetch complete (32327 records). [2025-10-09T18:42:03.496408] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-09T18:42:03.880054] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-09T18:42:03.880135] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-09T18:42:03.880732] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-09T18:42:03.880795] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-09T18:42:03.881531] [DEBUG] [LOCAL ] EMD: Trimmed 32327 records to 21300 (keeping 200 days of data) [2025-10-09T18:42:03.996950] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-09T18:42:04.011806] [DEBUG] [LOCAL ] EMD: Primary data saved (21300 records). [2025-10-09T18:42:04.011991] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-09T18:42:04.012118] [INFO ] [MAIN ] Update Progress: 732/2373 symbols completed. EMD took 36.6s. Estimated remaining: 3h 48m 41s. Rate: 7.2 symbols/min [2025-10-09T18:42:04.181446] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:04.196005] [DEBUG] [LOCAL ] EMO: Loaded 12883 existing records from primary storage. [2025-10-09T18:42:04.196219] [INFO ] [MAIN ] EMO: Loaded 12883 existing records. [2025-10-09T18:42:04.376705] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:04.376921] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-09T18:42:04.376991] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-09T18:42:04.377181] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-09T18:42:04.377238] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-09T18:42:04.609678] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T18:42:04.789803] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:04.801780] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-09T18:42:04.819408] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:42:05.596696] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-09T18:42:05.762510] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T18:42:06.143073] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:42:06.396772] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-09T18:42:07.022354] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T18:42:07.196704] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-09T18:42:07.996726] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-09T18:42:08.588006] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:42:08.590877] [INFO ] [REMOTE ] EME: Full fetch complete (46823 records). [2025-10-09T18:42:08.590968] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-09T18:42:08.801823] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-09T18:42:08.977406] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-09T18:42:08.977502] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-09T18:42:08.978362] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-09T18:42:08.978435] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-09T18:42:08.979606] [DEBUG] [LOCAL ] EME: Trimmed 46823 records to 31359 (keeping 200 days of data) [2025-10-09T18:42:09.183987] [DEBUG] [LOCAL ] EME: Primary data saved (31359 records). [2025-10-09T18:42:09.184144] [INFO ] [MAIN ] EME: Full history saved. [2025-10-09T18:42:09.184754] [INFO ] [MAIN ] Update Progress: 733/2373 symbols completed. EME took 34.7s. Estimated remaining: 3h 48m 25s. Rate: 7.2 symbols/min [2025-10-09T18:42:09.381991] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:09.382363] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-09T18:42:09.382467] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-09T18:42:09.382691] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-09T18:42:09.382803] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-09T18:42:09.382886] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-09T18:42:09.382940] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-09T18:42:09.603400] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-09T18:42:09.651006] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T18:42:09.784410] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:42:09.806746] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:10.280434] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T18:42:10.396712] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-09T18:42:10.889815] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T18:42:10.890795] [INFO ] [REMOTE ] EMF: Full fetch complete (6873 records). [2025-10-09T18:42:10.890885] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-09T18:42:11.201799] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-09T18:42:11.302081] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-09T18:42:11.302164] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-09T18:42:11.302395] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-09T18:42:11.302438] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-09T18:42:11.302885] [DEBUG] [LOCAL ] EMF: Trimmed 6873 records to 3301 (keeping 200 days of data) [2025-10-09T18:42:11.327732] [DEBUG] [LOCAL ] EMF: Primary data saved (3301 records). [2025-10-09T18:42:11.328127] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-09T18:42:11.328303] [INFO ] [MAIN ] Update Progress: 734/2373 symbols completed. EMF took 32.3s. Estimated remaining: 3h 48m 3s. Rate: 7.2 symbols/min [2025-10-09T18:42:11.520463] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:11.574445] [DEBUG] [LOCAL ] EMR: Loaded 53224 existing records from primary storage. [2025-10-09T18:42:11.574805] [INFO ] [MAIN ] EMR: Loaded 53224 existing records. [2025-10-09T18:42:11.752477] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:11.752735] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-09T18:42:11.752791] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-09T18:42:11.753197] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-09T18:42:11.753255] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-09T18:42:11.950051] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T18:42:11.999770] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-09T18:42:12.142056] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:12.796764] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-09T18:42:12.966948] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T18:42:13.544997] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T18:42:13.596696] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-09T18:42:14.396748] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-09T18:42:14.999940] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T18:42:15.114305] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T18:42:15.196707] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-09T18:42:15.725955] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T18:42:15.996699] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-09T18:42:16.795531] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T18:42:16.799166] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-09T18:42:17.596769] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-09T18:42:18.221584] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:42:18.396695] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-09T18:42:18.516441] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T18:42:18.864972] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:42:19.196713] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-09T18:42:19.996742] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-09T18:42:20.273936] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:42:20.439234] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T18:42:20.796726] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-09T18:42:21.596760] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-09T18:42:22.307130] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T18:42:22.396719] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-09T18:42:22.855398] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T18:42:23.196777] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-09T18:42:23.435029] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T18:42:23.996751] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-09T18:42:24.006215] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T18:42:24.008421] [INFO ] [REMOTE ] EMO: Full fetch complete (17558 records). [2025-10-09T18:42:24.008525] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-09T18:42:24.382606] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-09T18:42:24.382727] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-09T18:42:24.383106] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-09T18:42:24.383146] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-09T18:42:24.383758] [DEBUG] [LOCAL ] EMO: Trimmed 17558 records to 13052 (keeping 200 days of data) [2025-10-09T18:42:24.466288] [DEBUG] [LOCAL ] EMO: Primary data saved (13052 records). [2025-10-09T18:42:24.466425] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-09T18:42:24.466511] [INFO ] [MAIN ] Update Progress: 735/2373 symbols completed. EMO took 20.5s. Estimated remaining: 3h 48m 5s. Rate: 7.2 symbols/min [2025-10-09T18:42:24.634189] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:24.639022] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T18:42:24.686324] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-09T18:42:24.686636] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-09T18:42:24.801877] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-09T18:42:24.867303] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:24.867567] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-09T18:42:24.867617] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-09T18:42:24.867957] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-09T18:42:24.868018] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-09T18:42:25.277300] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:25.596724] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-09T18:42:26.169247] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T18:42:26.401855] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-09T18:42:26.418795] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:42:27.196704] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-09T18:42:27.996784] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-09T18:42:28.139795] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T18:42:28.796705] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-09T18:42:29.046401] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T18:42:29.393818] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T18:42:29.596738] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-09T18:42:30.396709] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-09T18:42:30.598090] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T18:42:31.023187] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T18:42:31.196713] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-09T18:42:31.653154] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T18:42:31.871747] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T18:42:31.996741] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-09T18:42:32.559524] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T18:42:32.796728] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-09T18:42:33.193901] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-09T18:42:33.596791] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-09T18:42:34.396726] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-09T18:42:35.196725] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-09T18:42:35.385094] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:42:35.708994] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T18:42:35.996792] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-09T18:42:36.191000] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T18:42:36.796752] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-09T18:42:37.379771] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T18:42:37.380582] [INFO ] [REMOTE ] EMP: Full fetch complete (4267 records). [2025-10-09T18:42:37.380723] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-09T18:42:37.601977] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-09T18:42:37.744560] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-09T18:42:37.744765] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-09T18:42:37.744972] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-09T18:42:37.745029] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-09T18:42:37.745380] [DEBUG] [LOCAL ] EMP: Trimmed 4267 records to 3098 (keeping 200 days of data) [2025-10-09T18:42:37.764917] [DEBUG] [LOCAL ] EMP: Primary data saved (3098 records). [2025-10-09T18:42:37.764981] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-09T18:42:37.765047] [INFO ] [MAIN ] Update Progress: 736/2373 symbols completed. EMP took 28.6s. Estimated remaining: 3h 48m 8s. Rate: 7.2 symbols/min [2025-10-09T18:42:37.946172] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:37.952575] [DEBUG] [LOCAL ] ENFY: Loaded 3235 existing records from primary storage. [2025-10-09T18:42:37.952813] [INFO ] [MAIN ] ENFY: Loaded 3235 existing records. [2025-10-09T18:42:38.132975] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:38.133256] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-09T18:42:38.133314] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-09T18:42:38.133593] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-09T18:42:38.133744] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-09T18:42:38.280372] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T18:42:38.401838] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-09T18:42:38.537388] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:39.196737] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-09T18:42:39.612767] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T18:42:39.996808] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-09T18:42:40.006776] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T18:42:40.090512] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:42:40.796767] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-09T18:42:41.354498] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:42:41.543520] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:42:41.596737] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-09T18:42:42.396736] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-09T18:42:43.196762] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-09T18:42:43.996780] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-09T18:42:44.232925] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-09T18:42:44.523668] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T18:42:44.796749] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-09T18:42:44.982084] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T18:42:45.003836] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-09T18:42:45.008256] [INFO ] [REMOTE ] EMN: Full fetch complete (72095 records). [2025-10-09T18:42:45.008373] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-09T18:42:45.192409] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-09T18:42:45.411130] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-09T18:42:45.411212] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-09T18:42:45.412096] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-09T18:42:45.412209] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-09T18:42:45.413758] [DEBUG] [LOCAL ] EMN: Trimmed 72095 records to 50972 (keeping 200 days of data) [2025-10-09T18:42:45.597690] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-09T18:42:45.736315] [DEBUG] [LOCAL ] EMN: Primary data saved (50972 records). [2025-10-09T18:42:45.736460] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-09T18:42:45.736570] [INFO ] [MAIN ] Update Progress: 737/2373 symbols completed. EMN took 51.3s. Estimated remaining: 3h 47m 59s. Rate: 7.2 symbols/min [2025-10-09T18:42:45.910356] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:45.947078] [DEBUG] [LOCAL ] ENIC: Loaded 36357 existing records from primary storage. [2025-10-09T18:42:45.947406] [INFO ] [MAIN ] ENIC: Loaded 36357 existing records. [2025-10-09T18:42:46.051031] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:42:46.131326] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:46.131561] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-09T18:42:46.131619] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-09T18:42:46.131960] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-09T18:42:46.132017] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-09T18:42:46.401849] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-09T18:42:46.504376] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:47.196758] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-09T18:42:47.827070] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T18:42:47.996704] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-09T18:42:48.360439] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T18:42:48.796720] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-09T18:42:49.596694] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-09T18:42:49.718296] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:42:50.020522] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T18:42:50.295833] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T18:42:50.396677] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-09T18:42:51.101365] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T18:42:51.196775] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-09T18:42:51.996730] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-09T18:42:52.796704] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-09T18:42:52.979928] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:42:53.254616] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T18:42:53.298357] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-09T18:42:53.596793] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-09T18:42:54.396765] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-09T18:42:54.989360] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T18:42:55.196709] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-09T18:42:55.378482] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:42:55.996785] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-09T18:42:56.450828] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T18:42:56.796809] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-09T18:42:57.596691] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-09T18:42:58.046415] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-09T18:42:58.139213] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T18:42:58.140167] [INFO ] [REMOTE ] ENFY: Full fetch complete (5548 records). [2025-10-09T18:42:58.140238] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-09T18:42:58.352656] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T18:42:58.401737] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-09T18:42:58.559001] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-09T18:42:58.559091] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-09T18:42:58.559275] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-09T18:42:58.559325] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-09T18:42:58.559957] [DEBUG] [LOCAL ] ENFY: Trimmed 5548 records to 3256 (keeping 200 days of data) [2025-10-09T18:42:58.580384] [DEBUG] [LOCAL ] ENFY: Primary data saved (3256 records). [2025-10-09T18:42:58.580523] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-09T18:42:58.580637] [INFO ] [MAIN ] Update Progress: 738/2373 symbols completed. ENFY took 20.8s. Estimated remaining: 3h 48m 0s. Rate: 7.2 symbols/min [2025-10-09T18:42:58.749511] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:58.753888] [DEBUG] [LOCAL ] ENO: Loaded 1889 existing records from primary storage. [2025-10-09T18:42:58.754039] [INFO ] [MAIN ] ENO: Loaded 1889 existing records. [2025-10-09T18:42:58.929448] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:58.929683] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-09T18:42:58.929740] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-09T18:42:58.929920] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-09T18:42:58.929977] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-09T18:42:59.202724] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-09T18:42:59.279440] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:59.996736] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-09T18:43:00.162158] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:43:00.467076] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:43:00.589373] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T18:43:00.796738] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-09T18:43:01.152712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-09T18:43:01.596701] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-09T18:43:02.396719] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-09T18:43:03.196705] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-09T18:43:03.333967] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:43:03.996673] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-09T18:43:04.101700] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T18:43:04.106543] [INFO ] [REMOTE ] ENB: Full fetch complete (77487 records). [2025-10-09T18:43:04.106676] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-09T18:43:04.499612] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-09T18:43:04.499829] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-09T18:43:04.500828] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-09T18:43:04.500892] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-09T18:43:04.502335] [DEBUG] [LOCAL ] ENB: Trimmed 77487 records to 53900 (keeping 200 days of data) [2025-10-09T18:43:04.630136] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:43:04.819772] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-09T18:43:04.870730] [DEBUG] [LOCAL ] ENB: Primary data saved (53900 records). [2025-10-09T18:43:04.870874] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-09T18:43:04.870979] [INFO ] [MAIN ] Update Progress: 739/2373 symbols completed. ENB took 40.4s. Estimated remaining: 3h 47m 47s. Rate: 7.2 symbols/min [2025-10-09T18:43:05.038950] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:05.078188] [DEBUG] [LOCAL ] ENOV: Loaded 44833 existing records from primary storage. [2025-10-09T18:43:05.078482] [INFO ] [MAIN ] ENOV: Loaded 44833 existing records. [2025-10-09T18:43:05.252698] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:05.252907] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-09T18:43:05.252954] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-09T18:43:05.253212] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-09T18:43:05.253269] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-09T18:43:05.633171] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:05.634499] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T18:43:05.603667] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-09T18:43:05.640178] [INFO ] [REMOTE ] EMR: Full fetch complete (77079 records). [2025-10-09T18:43:05.640272] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-09T18:43:06.035144] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-09T18:43:06.035313] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-09T18:43:06.036268] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-09T18:43:06.036333] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-09T18:43:06.037890] [DEBUG] [LOCAL ] EMR: Trimmed 77079 records to 53610 (keeping 200 days of data) [2025-10-09T18:43:06.235713] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T18:43:06.287509] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T18:43:06.396697] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-09T18:43:06.417668] [DEBUG] [LOCAL ] EMR: Primary data saved (53610 records). [2025-10-09T18:43:06.417777] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-09T18:43:06.421249] [INFO ] [MAIN ] Update Progress: 740/2373 symbols completed. EMR took 55.1s. Estimated remaining: 3h 47m 24s. Rate: 7.2 symbols/min [2025-10-09T18:43:06.595375] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:06.652270] [DEBUG] [LOCAL ] ENR: Loaded 43238 existing records from primary storage. [2025-10-09T18:43:06.652575] [INFO ] [MAIN ] ENR: Loaded 43238 existing records. [2025-10-09T18:43:06.825497] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:06.825792] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-09T18:43:06.825843] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-09T18:43:06.826136] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-09T18:43:06.826194] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-09T18:43:07.198698] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-09T18:43:07.198551] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:07.714946] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:43:07.996726] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-09T18:43:08.796786] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-09T18:43:08.854181] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T18:43:09.096697] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-09T18:43:09.495770] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T18:43:09.596715] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-09T18:43:10.396728] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-09T18:43:10.919900] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T18:43:11.017481] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:43:11.196750] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-09T18:43:11.642596] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T18:43:11.996743] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-09T18:43:12.796762] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-09T18:43:12.952701] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T18:43:13.596814] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-09T18:43:14.033263] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-09T18:43:14.170906] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T18:43:14.396736] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-09T18:43:15.196788] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-09T18:43:15.526883] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-09T18:43:15.706998] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T18:43:15.996749] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-09T18:43:16.796719] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-09T18:43:17.178338] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-09T18:43:17.332474] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:43:17.596775] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-09T18:43:18.396779] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-09T18:43:18.915005] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:43:19.196775] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-09T18:43:19.565357] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T18:43:19.996768] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-09T18:43:20.718722] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T18:43:20.796726] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-09T18:43:21.152612] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T18:43:21.596762] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-09T18:43:21.989783] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:43:22.126525] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T18:43:22.396746] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-09T18:43:23.196721] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-09T18:43:23.676026] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T18:43:23.996781] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-09T18:43:24.198360] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T18:43:24.201239] [INFO ] [REMOTE ] ENIC: Full fetch complete (51436 records). [2025-10-09T18:43:24.201332] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-09T18:43:24.609156] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-09T18:43:24.609244] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-09T18:43:24.610024] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-09T18:43:24.610090] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-09T18:43:24.611224] [DEBUG] [LOCAL ] ENIC: Trimmed 51436 records to 36571 (keeping 200 days of data) [2025-10-09T18:43:24.797301] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-09T18:43:24.823979] [DEBUG] [LOCAL ] ENIC: Primary data saved (36571 records). [2025-10-09T18:43:24.824101] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-09T18:43:24.824183] [INFO ] [MAIN ] Update Progress: 741/2373 symbols completed. ENIC took 39.1s. Estimated remaining: 3h 47m 38s. Rate: 7.2 symbols/min [2025-10-09T18:43:25.004735] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:25.034113] [DEBUG] [LOCAL ] ENS: Loaded 29250 existing records from primary storage. [2025-10-09T18:43:25.034382] [INFO ] [MAIN ] ENS: Loaded 29250 existing records. [2025-10-09T18:43:25.208818] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T18:43:25.214190] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:25.214491] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-09T18:43:25.215289] [INFO ] [REMOTE ] ENO: Full fetch complete (3087 records). [2025-10-09T18:43:25.216073] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-09T18:43:25.216233] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-09T18:43:25.216661] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-09T18:43:25.228542] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-09T18:43:25.613272] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-09T18:43:25.916113] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:25.999289] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-09T18:43:25.999582] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-09T18:43:26.000238] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-09T18:43:26.001319] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-09T18:43:26.001525] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-09T18:43:26.011855] [DEBUG] [LOCAL ] ENO: Trimmed 3087 records to 1899 (keeping 200 days of data) [2025-10-09T18:43:26.024899] [DEBUG] [LOCAL ] ENO: Primary data saved (1899 records). [2025-10-09T18:43:26.024969] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-09T18:43:26.025064] [INFO ] [MAIN ] Update Progress: 742/2373 symbols completed. ENO took 27.4s. Estimated remaining: 3h 47m 14s. Rate: 7.2 symbols/min [2025-10-09T18:43:26.201423] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:26.227998] [DEBUG] [LOCAL ] ENVA: Loaded 25329 existing records from primary storage. [2025-10-09T18:43:26.228270] [INFO ] [MAIN ] ENVA: Loaded 25329 existing records. [2025-10-09T18:43:26.402493] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-09T18:43:26.408853] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:26.409160] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-09T18:43:26.409218] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-09T18:43:26.409461] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-09T18:43:26.409518] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-09T18:43:26.759933] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:26.940180] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T18:43:27.196717] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-09T18:43:27.769109] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T18:43:27.996690] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-09T18:43:28.311978] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:43:28.796685] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-09T18:43:29.312108] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:43:29.596781] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-09T18:43:30.401847] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-09T18:43:30.422255] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:43:30.747584] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:43:31.196767] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-09T18:43:31.898876] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T18:43:31.996809] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-09T18:43:32.450233] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T18:43:32.796782] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-09T18:43:33.044446] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T18:43:33.596778] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-09T18:43:33.907305] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T18:43:34.396719] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-09T18:43:34.983037] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:43:35.196697] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-09T18:43:35.623314] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T18:43:35.996732] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-09T18:43:36.457504] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T18:43:36.462594] [INFO ] [REMOTE ] ENOV: Full fetch complete (63316 records). [2025-10-09T18:43:36.462804] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-09T18:43:36.801939] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-09T18:43:36.858492] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-09T18:43:36.858574] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-09T18:43:36.859421] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-09T18:43:36.859486] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-09T18:43:36.862696] [DEBUG] [LOCAL ] ENOV: Trimmed 63316 records to 45067 (keeping 200 days of data) [2025-10-09T18:43:37.087701] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T18:43:37.156144] [DEBUG] [LOCAL ] ENOV: Primary data saved (45067 records). [2025-10-09T18:43:37.156291] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-09T18:43:37.156377] [INFO ] [MAIN ] Update Progress: 743/2373 symbols completed. ENOV took 32.3s. Estimated remaining: 3h 47m 11s. Rate: 7.2 symbols/min [2025-10-09T18:43:37.327430] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:37.342872] [DEBUG] [LOCAL ] EOD: Loaded 14808 existing records from primary storage. [2025-10-09T18:43:37.343091] [INFO ] [MAIN ] EOD: Loaded 14808 existing records. [2025-10-09T18:43:37.519784] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:37.520043] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-09T18:43:37.520110] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-09T18:43:37.520386] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-09T18:43:37.520469] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-09T18:43:37.601889] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-09T18:43:37.891930] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:38.064481] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T18:43:38.396714] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-09T18:43:39.107194] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T18:43:39.196744] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-09T18:43:39.669239] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T18:43:39.845103] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T18:43:39.996736] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-09T18:43:40.796685] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-09T18:43:40.854887] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:43:41.596724] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-09T18:43:41.781897] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T18:43:42.396723] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-09T18:43:42.911116] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:43:43.196700] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-09T18:43:43.327179] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:43:43.836424] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T18:43:43.996755] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-09T18:43:44.625017] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T18:43:44.796712] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-09T18:43:45.416096] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T18:43:45.596719] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-09T18:43:46.396707] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-09T18:43:46.532826] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T18:43:47.196746] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-09T18:43:47.819585] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T18:43:47.996721] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-09T18:43:48.267114] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T18:43:48.796726] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-09T18:43:49.212411] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T18:43:49.596727] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-09T18:43:49.817391] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T18:43:49.821803] [INFO ] [REMOTE ] ENR: Full fetch complete (59017 records). [2025-10-09T18:43:49.822114] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-09T18:43:50.244994] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-09T18:43:50.245079] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-09T18:43:50.246010] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-09T18:43:50.246078] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-09T18:43:50.247324] [DEBUG] [LOCAL ] ENR: Trimmed 59017 records to 43536 (keeping 200 days of data) [2025-10-09T18:43:50.427139] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-09T18:43:50.520750] [DEBUG] [LOCAL ] ENR: Primary data saved (43536 records). [2025-10-09T18:43:50.520884] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-09T18:43:50.521958] [INFO ] [MAIN ] Update Progress: 744/2373 symbols completed. ENR took 44.1s. Estimated remaining: 3h 47m 14s. Rate: 7.2 symbols/min [2025-10-09T18:43:50.694438] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:50.723335] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T18:43:50.768732] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-09T18:43:50.769057] [INFO ] [MAIN ] EOG: Loaded 53344 existing records. [2025-10-09T18:43:50.943151] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:50.943416] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-09T18:43:50.943463] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-09T18:43:50.943833] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-09T18:43:50.943890] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-09T18:43:51.201901] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-09T18:43:51.312606] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:51.725249] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T18:43:51.996720] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-09T18:43:52.240442] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T18:43:52.796722] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-09T18:43:53.570851] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T18:43:53.596735] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-09T18:43:54.006614] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T18:43:54.396760] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-09T18:43:54.884551] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T18:43:55.196776] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-09T18:43:55.996724] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-09T18:43:56.131084] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:43:56.600015] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T18:43:56.796710] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-09T18:43:56.892015] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T18:43:57.596763] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-09T18:43:57.875612] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T18:43:58.377020] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T18:43:58.396664] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-09T18:43:59.191174] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T18:43:59.193541] [INFO ] [REMOTE ] EOD: Full fetch complete (20738 records). [2025-10-09T18:43:59.193624] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-09T18:43:59.205337] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-09T18:43:59.561718] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-09T18:43:59.561806] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-09T18:43:59.562254] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-09T18:43:59.562293] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-09T18:43:59.562939] [DEBUG] [LOCAL ] EOD: Trimmed 20738 records to 14933 (keeping 200 days of data) [2025-10-09T18:43:59.649030] [DEBUG] [LOCAL ] EOD: Primary data saved (14933 records). [2025-10-09T18:43:59.649170] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-09T18:43:59.649254] [INFO ] [MAIN ] Update Progress: 745/2373 symbols completed. EOD took 22.5s. Estimated remaining: 3h 47m 7s. Rate: 7.2 symbols/min [2025-10-09T18:43:59.821997] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:59.835169] [DEBUG] [LOCAL ] EOI: Loaded 10829 existing records from primary storage. [2025-10-09T18:43:59.835400] [INFO ] [MAIN ] EOI: Loaded 10829 existing records. [2025-10-09T18:44:00.001886] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-09T18:44:00.017854] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:00.019093] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-09T18:44:00.019148] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-09T18:44:00.019460] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-09T18:44:00.019520] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-09T18:44:00.384358] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:00.796725] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-09T18:44:00.908754] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T18:44:01.500008] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:44:01.503065] [INFO ] [REMOTE ] ENS: Full fetch complete (42059 records). [2025-10-09T18:44:01.503148] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-09T18:44:01.598429] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-09T18:44:01.869723] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T18:44:01.941853] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-09T18:44:01.941928] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-09T18:44:01.942557] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-09T18:44:01.942596] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-09T18:44:01.943690] [DEBUG] [LOCAL ] ENS: Trimmed 42059 records to 29440 (keeping 200 days of data) [2025-10-09T18:44:02.127862] [DEBUG] [LOCAL ] ENS: Primary data saved (29440 records). [2025-10-09T18:44:02.128012] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-09T18:44:02.128097] [INFO ] [MAIN ] Update Progress: 746/2373 symbols completed. ENS took 37.3s. Estimated remaining: 3h 46m 46s. Rate: 7.2 symbols/min [2025-10-09T18:44:02.295555] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:02.312870] [DEBUG] [LOCAL ] EOS: Loaded 15423 existing records from primary storage. [2025-10-09T18:44:02.313094] [INFO ] [MAIN ] EOS: Loaded 15423 existing records. [2025-10-09T18:44:02.401959] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-09T18:44:02.502350] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:02.502605] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-09T18:44:02.502683] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-09T18:44:02.502879] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-09T18:44:02.502937] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-09T18:44:02.862710] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:03.196698] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-09T18:44:03.563868] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T18:44:03.693948] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-09T18:44:03.996737] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-09T18:44:04.184194] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T18:44:04.796718] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-09T18:44:05.596687] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-09T18:44:05.720749] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T18:44:05.766402] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T18:44:06.396731] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-09T18:44:06.811532] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T18:44:06.813803] [INFO ] [REMOTE ] ENVA: Full fetch complete (36700 records). [2025-10-09T18:44:06.813879] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-09T18:44:07.175253] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-09T18:44:07.175327] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-09T18:44:07.175886] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-09T18:44:07.175948] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-09T18:44:07.176712] [DEBUG] [LOCAL ] ENVA: Trimmed 36700 records to 25478 (keeping 200 days of data) [2025-10-09T18:44:07.226438] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-09T18:44:07.331340] [DEBUG] [LOCAL ] ENVA: Primary data saved (25478 records). [2025-10-09T18:44:07.331511] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-09T18:44:07.331611] [INFO ] [MAIN ] Update Progress: 747/2373 symbols completed. ENVA took 41.3s. Estimated remaining: 3h 46m 31s. Rate: 7.2 symbols/min [2025-10-09T18:44:07.538214] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:07.547043] [DEBUG] [LOCAL ] EOT: Loaded 6743 existing records from primary storage. [2025-10-09T18:44:07.547231] [INFO ] [MAIN ] EOT: Loaded 6743 existing records. [2025-10-09T18:44:07.720592] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:07.720821] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-09T18:44:07.720869] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-09T18:44:07.721040] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-09T18:44:07.721096] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-09T18:44:08.010760] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-09T18:44:08.098811] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:08.392740] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T18:44:08.658201] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T18:44:08.726034] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T18:44:08.796720] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-09T18:44:09.596742] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-09T18:44:09.778856] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:44:10.396728] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-09T18:44:11.076212] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T18:44:11.196733] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-09T18:44:11.310882] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T18:44:11.996733] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-09T18:44:12.369609] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T18:44:12.796732] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-09T18:44:13.468328] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T18:44:13.562087] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T18:44:13.596663] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-09T18:44:14.396741] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-09T18:44:14.935915] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T18:44:15.196682] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-09T18:44:15.298437] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T18:44:15.931671] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T18:44:15.996686] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-09T18:44:16.796715] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-09T18:44:17.063475] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T18:44:17.596734] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-09T18:44:17.654034] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T18:44:18.173524] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:44:18.396741] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-09T18:44:19.196779] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-09T18:44:19.996693] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-09T18:44:20.221336] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T18:44:20.310981] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:44:20.646117] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T18:44:20.796744] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-09T18:44:21.410921] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T18:44:21.596753] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-09T18:44:22.396721] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-09T18:44:22.734936] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T18:44:22.739757] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-09T18:44:22.739879] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-09T18:44:23.140806] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T18:44:23.163979] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-09T18:44:23.164975] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-09T18:44:23.166031] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-09T18:44:23.166140] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-09T18:44:23.167550] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 53734 (keeping 200 days of data) [2025-10-09T18:44:23.224692] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-09T18:44:23.516190] [DEBUG] [LOCAL ] EOG: Primary data saved (53734 records). [2025-10-09T18:44:23.516337] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-09T18:44:23.517435] [INFO ] [MAIN ] Update Progress: 748/2373 symbols completed. EOG took 33.0s. Estimated remaining: 3h 46m 40s. Rate: 7.2 symbols/min [2025-10-09T18:44:23.688526] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:23.717164] [DEBUG] [LOCAL ] EPAC: Loaded 26691 existing records from primary storage. [2025-10-09T18:44:23.717421] [INFO ] [MAIN ] EPAC: Loaded 26691 existing records. [2025-10-09T18:44:23.893090] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:23.893314] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-09T18:44:23.893421] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-09T18:44:23.893712] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-09T18:44:23.893770] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-09T18:44:24.001868] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-09T18:44:24.205843] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T18:44:24.247887] [INFO ] [REMOTE ] EOS: Full fetch complete (23349 records). [2025-10-09T18:44:24.257104] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-09T18:44:24.289949] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:24.754066] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T18:44:24.796956] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-09T18:44:24.845154] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-09T18:44:24.845280] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-09T18:44:24.846112] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-09T18:44:24.846203] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-09T18:44:24.847516] [DEBUG] [LOCAL ] EOS: Trimmed 23349 records to 15505 (keeping 200 days of data) [2025-10-09T18:44:24.977370] [DEBUG] [LOCAL ] EOS: Primary data saved (15505 records). [2025-10-09T18:44:24.977584] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-09T18:44:24.977742] [INFO ] [MAIN ] Update Progress: 749/2373 symbols completed. EOS took 22.8s. Estimated remaining: 3h 46m 16s. Rate: 7.2 symbols/min [2025-10-09T18:44:25.209757] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:25.253376] [DEBUG] [LOCAL ] EPAM: Loaded 39420 existing records from primary storage. [2025-10-09T18:44:25.253747] [INFO ] [MAIN ] EPAM: Loaded 39420 existing records. [2025-10-09T18:44:25.471213] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:25.471513] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-09T18:44:25.471578] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-09T18:44:25.471936] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-09T18:44:25.471995] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-09T18:44:25.596995] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-09T18:44:25.694808] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T18:44:25.864850] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:26.396687] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-09T18:44:26.685756] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T18:44:27.196778] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-09T18:44:27.222632] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:44:27.996725] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-09T18:44:28.675126] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T18:44:28.754508] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:44:28.796703] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-09T18:44:29.333079] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-09T18:44:29.596751] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-09T18:44:30.320867] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T18:44:30.396739] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-09T18:44:31.174754] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T18:44:31.196689] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-09T18:44:31.644886] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T18:44:31.996722] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-09T18:44:32.741822] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T18:44:32.796731] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-09T18:44:33.596723] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-09T18:44:34.004610] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T18:44:34.104036] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T18:44:34.396722] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-09T18:44:35.196697] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-09T18:44:35.205131] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T18:44:35.996749] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-09T18:44:36.477609] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:44:36.796730] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-09T18:44:37.078684] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:44:37.291593] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T18:44:37.596722] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-09T18:44:38.396712] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-09T18:44:38.493707] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T18:44:39.039383] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T18:44:39.041299] [INFO ] [REMOTE ] EOI: Full fetch complete (16224 records). [2025-10-09T18:44:39.041378] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-09T18:44:39.198685] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-09T18:44:39.414972] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-09T18:44:39.415060] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-09T18:44:39.415576] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-09T18:44:39.415661] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-09T18:44:39.416445] [DEBUG] [LOCAL ] EOI: Trimmed 16224 records to 10887 (keeping 200 days of data) [2025-10-09T18:44:39.483991] [DEBUG] [LOCAL ] EOI: Primary data saved (10887 records). [2025-10-09T18:44:39.484123] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-09T18:44:39.484262] [INFO ] [MAIN ] Update Progress: 750/2373 symbols completed. EOI took 39.8s. Estimated remaining: 3h 46m 21s. Rate: 7.2 symbols/min [2025-10-09T18:44:39.652451] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:39.689171] [DEBUG] [LOCAL ] EPC: Loaded 39795 existing records from primary storage. [2025-10-09T18:44:39.689466] [INFO ] [MAIN ] EPC: Loaded 39795 existing records. [2025-10-09T18:44:39.864190] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:39.864419] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-09T18:44:39.864465] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-09T18:44:39.864937] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-09T18:44:39.864998] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-09T18:44:40.003055] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-09T18:44:40.238114] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:40.337829] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T18:44:40.796756] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-09T18:44:41.436422] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T18:44:41.596728] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-09T18:44:41.999126] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:44:42.396775] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-09T18:44:42.700439] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T18:44:43.196713] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-09T18:44:43.283367] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T18:44:43.996778] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-09T18:44:44.331557] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T18:44:44.640104] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T18:44:44.796729] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-09T18:44:45.357552] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T18:44:45.358805] [INFO ] [REMOTE ] EOT: Full fetch complete (10626 records). [2025-10-09T18:44:45.358875] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-09T18:44:45.602039] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-09T18:44:45.736121] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-09T18:44:45.736560] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-09T18:44:45.736885] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-09T18:44:45.736946] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-09T18:44:45.737407] [DEBUG] [LOCAL ] EOT: Trimmed 10626 records to 6841 (keeping 200 days of data) [2025-10-09T18:44:45.780512] [DEBUG] [LOCAL ] EOT: Primary data saved (6841 records). [2025-10-09T18:44:45.780637] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-09T18:44:45.780763] [INFO ] [MAIN ] Update Progress: 751/2373 symbols completed. EOT took 38.4s. Estimated remaining: 3h 46m 8s. Rate: 7.2 symbols/min [2025-10-09T18:44:45.948597] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:46.000103] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-09T18:44:46.000451] [INFO ] [MAIN ] EPD: Loaded 53611 existing records. [2025-10-09T18:44:46.176854] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:46.177107] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-09T18:44:46.177168] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-09T18:44:46.177501] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-09T18:44:46.177561] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-09T18:44:46.402009] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-09T18:44:46.552945] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:46.820998] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T18:44:47.196719] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-09T18:44:47.626486] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T18:44:47.996722] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-09T18:44:48.572924] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:44:48.796727] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-09T18:44:49.596683] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-09T18:44:49.958116] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T18:44:50.030112] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:44:50.396741] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-09T18:44:51.196711] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-09T18:44:51.231350] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T18:44:51.838506] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:44:51.996709] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-09T18:44:52.753817] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T18:44:52.796690] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-09T18:44:53.602429] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-09T18:44:53.612763] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T18:44:54.396701] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-09T18:44:54.427140] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T18:44:55.019126] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T18:44:55.196763] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-09T18:44:55.589921] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T18:44:55.996723] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-09T18:44:56.315749] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T18:44:56.796764] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-09T18:44:57.596760] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-09T18:44:57.802111] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:44:58.128751] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T18:44:58.396768] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-09T18:44:58.505579] [DEBUG] [REMOTE ] EPAM: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-09T18:44:58.506248] [WARN ] [REMOTE ] EPAM: No data returned for month 2025-07 [2025-10-09T18:44:58.506431] [FATAL] [REMOTE ] EPAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:44:58.506576] [FATAL] [MAIN ] EPAM: Failed to fetch primary data. [2025-10-09T18:44:58.506678] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:44:58.506757] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-09T18:44:58.506841] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-09T18:44:58.506909] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-10-09T18:44:58.507172] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-10-09T18:44:58.507308] [INFO ] [MAIN ] Update Progress: 752/2373 symbols completed. EPAM took 33.5s. Estimated remaining: 3h 46m 9s. Rate: 7.2 symbols/min [2025-10-09T18:44:58.696199] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:58.739681] [DEBUG] [LOCAL ] EPR: Loaded 43947 existing records from primary storage. [2025-10-09T18:44:58.739983] [INFO ] [MAIN ] EPR: Loaded 43947 existing records. [2025-10-09T18:44:58.934925] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:58.944600] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-09T18:44:58.945178] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-09T18:44:58.945852] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:44:58.948124] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-09T18:44:58.952196] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-09T18:44:59.201917] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-09T18:44:59.317749] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:59.996744] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-09T18:45:00.788130] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:45:00.797112] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-09T18:45:01.596690] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-09T18:45:02.083160] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T18:45:02.396784] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-09T18:45:03.076958] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T18:45:03.095419] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:45:03.097937] [INFO ] [REMOTE ] EPAC: Full fetch complete (38765 records). [2025-10-09T18:45:03.098022] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-09T18:45:03.197201] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-09T18:45:03.482197] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-09T18:45:03.482314] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-09T18:45:03.483062] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-09T18:45:03.483127] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-09T18:45:03.484042] [DEBUG] [LOCAL ] EPAC: Trimmed 38765 records to 26880 (keeping 200 days of data) [2025-10-09T18:45:03.661822] [DEBUG] [LOCAL ] EPAC: Primary data saved (26880 records). [2025-10-09T18:45:03.661962] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-09T18:45:03.662068] [INFO ] [MAIN ] Update Progress: 753/2373 symbols completed. EPAC took 40.1s. Estimated remaining: 3h 45m 54s. Rate: 7.2 symbols/min [2025-10-09T18:45:03.833909] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:45:03.893327] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T18:45:03.918419] [DEBUG] [LOCAL ] EPRT: Loaded 48408 existing records from primary storage. [2025-10-09T18:45:03.919315] [INFO ] [MAIN ] EPRT: Loaded 48408 existing records. [2025-10-09T18:45:04.001864] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-09T18:45:04.108314] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:45:04.108602] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-09T18:45:04.108677] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-09T18:45:04.108962] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-09T18:45:04.109022] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-09T18:45:04.457467] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:45:04.758448] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T18:45:04.796672] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-09T18:45:05.596728] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-09T18:45:05.766315] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T18:45:06.335553] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T18:45:06.396719] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-09T18:45:07.196742] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-09T18:45:07.255747] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T18:45:07.479681] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:45:07.483087] [INFO ] [REMOTE ] EPC: Full fetch complete (57057 records). [2025-10-09T18:45:07.483182] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-09T18:45:07.901127] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-09T18:45:07.901216] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-09T18:45:07.902058] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-09T18:45:07.902125] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-09T18:45:07.903410] [DEBUG] [LOCAL ] EPC: Trimmed 57057 records to 40043 (keeping 200 days of data) [2025-10-09T18:45:07.999492] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-09T18:45:08.147743] [DEBUG] [LOCAL ] EPC: Primary data saved (40043 records). [2025-10-09T18:45:08.147906] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-09T18:45:08.148011] [INFO ] [MAIN ] Update Progress: 754/2373 symbols completed. EPC took 28.7s. Estimated remaining: 3h 45m 37s. Rate: 7.2 symbols/min [2025-10-09T18:45:08.313030] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:45:08.324794] [DEBUG] [LOCAL ] EQBK: Loaded 10961 existing records from primary storage. [2025-10-09T18:45:08.324994] [INFO ] [MAIN ] EQBK: Loaded 10961 existing records. [2025-10-09T18:45:08.502995] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:45:08.503309] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-09T18:45:08.503393] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-09T18:45:08.503753] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-09T18:45:08.503891] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-09T18:45:08.805432] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-09T18:45:08.863458] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:45:08.904024] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:45:09.377861] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:45:09.596763] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-09T18:45:10.396726] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-09T18:45:10.721266] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T18:45:11.196732] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-09T18:45:11.304315] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:45:12.008424] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-09T18:45:12.010838] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T18:45:12.796725] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-09T18:45:12.885972] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T18:45:13.506483] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-09T18:45:13.596712] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-09T18:45:14.396806] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-09T18:45:14.627397] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T18:45:15.196758] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-09T18:45:15.856231] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-09T18:45:15.996672] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-09T18:45:16.031215] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T18:45:16.615789] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T18:45:16.796768] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-09T18:45:17.596812] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-09T18:45:18.030084] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-09T18:45:18.089577] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T18:45:18.396725] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-09T18:45:19.196792] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-09T18:45:19.274354] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T18:45:19.865697] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:45:19.939808] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T18:45:19.945190] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-09T18:45:19.945364] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-09T18:45:20.002033] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-09T18:45:20.387612] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-09T18:45:20.387762] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-09T18:45:20.389105] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-09T18:45:20.389185] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-09T18:45:20.390881] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 54001 (keeping 200 days of data) [2025-10-09T18:45:20.728444] [DEBUG] [LOCAL ] EPD: Primary data saved (54001 records). [2025-10-09T18:45:20.728594] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-09T18:45:20.729247] [INFO ] [MAIN ] Update Progress: 755/2373 symbols completed. EPD took 34.9s. Estimated remaining: 3h 45m 38s. Rate: 7.2 symbols/min [2025-10-09T18:45:20.802914] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-09T18:45:20.900440] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:45:20.953397] [DEBUG] [LOCAL ] EQH: Loaded 52650 existing records from primary storage. [2025-10-09T18:45:20.953780] [INFO ] [MAIN ] EQH: Loaded 52650 existing records. [2025-10-09T18:45:21.128636] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:45:21.128883] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-09T18:45:21.128935] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-09T18:45:21.129270] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-09T18:45:21.129327] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-09T18:45:21.493311] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:45:21.596702] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-09T18:45:21.604246] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:45:21.939155] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T18:45:22.396722] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-09T18:45:23.029794] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T18:45:23.196744] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-09T18:45:23.991424] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:45:24.001679] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-09T18:45:24.656426] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T18:45:24.796702] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-09T18:45:24.970687] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T18:45:25.596720] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-09T18:45:26.396772] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-09T18:45:26.439173] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T18:45:27.012497] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:45:27.196769] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-09T18:45:27.305245] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T18:45:27.996743] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-09T18:45:28.425081] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T18:45:28.796742] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-09T18:45:29.596725] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-09T18:45:29.877871] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T18:45:30.315390] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T18:45:30.351204] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T18:45:30.396678] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-09T18:45:31.196724] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-09T18:45:31.902998] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:45:31.996665] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-09T18:45:32.703795] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T18:45:32.707545] [INFO ] [REMOTE ] EPR: Full fetch complete (63048 records). [2025-10-09T18:45:32.707681] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-09T18:45:32.804382] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-09T18:45:33.095819] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-09T18:45:33.095898] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-09T18:45:33.096725] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-09T18:45:33.096787] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-09T18:45:33.098034] [DEBUG] [LOCAL ] EPR: Trimmed 63048 records to 44256 (keeping 200 days of data) [2025-10-09T18:45:33.365768] [DEBUG] [LOCAL ] EPR: Primary data saved (44256 records). [2025-10-09T18:45:33.366002] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-09T18:45:33.366101] [INFO ] [MAIN ] Update Progress: 756/2373 symbols completed. EPR took 34.9s. Estimated remaining: 3h 45m 39s. Rate: 7.2 symbols/min [2025-10-09T18:45:33.549369] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:45:33.605084] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-09T18:45:33.620382] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T18:45:33.618862] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T18:45:33.651119] [DEBUG] [LOCAL ] EQNR: Loaded 53032 existing records from primary storage. [2025-10-09T18:45:33.651916] [INFO ] [MAIN ] EQNR: Loaded 53032 existing records. [2025-10-09T18:45:33.827185] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:45:33.827402] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-09T18:45:33.827470] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-09T18:45:33.827998] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-09T18:45:33.828056] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-09T18:45:34.172833] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:45:34.396709] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-09T18:45:34.938529] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T18:45:35.196698] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-09T18:45:35.428514] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T18:45:35.996715] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-09T18:45:36.796691] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-09T18:45:36.985016] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T18:45:37.452683] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T18:45:37.596710] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-09T18:45:38.396713] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-09T18:45:38.699878] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T18:45:39.157054] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:45:39.163991] [INFO ] [REMOTE ] EPRT: Full fetch complete (68987 records). [2025-10-09T18:45:39.164254] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-09T18:45:39.201878] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-09T18:45:39.580604] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-09T18:45:39.580778] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-09T18:45:39.581803] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-09T18:45:39.581870] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-09T18:45:39.583359] [DEBUG] [LOCAL ] EPRT: Trimmed 68987 records to 48787 (keeping 200 days of data) [2025-10-09T18:45:39.908403] [DEBUG] [LOCAL ] EPRT: Primary data saved (48787 records). [2025-10-09T18:45:39.908560] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-09T18:45:39.909501] [INFO ] [MAIN ] Update Progress: 757/2373 symbols completed. EPRT took 36.2s. Estimated remaining: 3h 45m 26s. Rate: 7.2 symbols/min [2025-10-09T18:45:39.996702] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-09T18:45:40.157738] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T18:45:40.713009] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T18:45:40.796747] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-09T18:45:40.929258] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T18:45:41.467185] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T18:45:41.596764] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-09T18:45:42.396812] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-09T18:45:43.045469] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T18:45:43.196677] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-09T18:45:43.996744] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-09T18:45:44.033330] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T18:45:44.627347] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T18:45:44.789044] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T18:45:44.790505] [INFO ] [REMOTE ] EQBK: Full fetch complete (15481 records). [2025-10-09T18:45:44.790582] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-09T18:45:44.802353] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-09T18:45:45.209818] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-09T18:45:45.209932] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-09T18:45:45.210293] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-09T18:45:45.210332] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-09T18:45:45.210913] [DEBUG] [LOCAL ] EQBK: Trimmed 15481 records to 11036 (keeping 200 days of data) [2025-10-09T18:45:45.280603] [DEBUG] [LOCAL ] EQBK: Primary data saved (11036 records). [2025-10-09T18:45:45.280820] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-09T18:45:45.280914] [INFO ] [MAIN ] Update Progress: 758/2373 symbols completed. EQBK took 37.1s. Estimated remaining: 3h 45m 12s. Rate: 7.2 symbols/min [2025-10-09T18:45:45.596824] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-09T18:45:46.571062] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:45:46.586333] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-09T18:45:47.009037] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T18:45:47.196756] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-09T18:45:48.696765] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T18:45:48.708273] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-09T18:45:48.935989] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:45:48.940662] [INFO ] [REMOTE ] EQH: Full fetch complete (76393 records). [2025-10-09T18:45:48.940822] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-09T18:45:49.329146] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-09T18:45:49.329241] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-09T18:45:49.330197] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-09T18:45:49.330266] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-09T18:45:49.331807] [DEBUG] [LOCAL ] EQH: Trimmed 76393 records to 53036 (keeping 200 days of data) [2025-10-09T18:45:49.660787] [DEBUG] [LOCAL ] EQH: Primary data saved (53036 records). [2025-10-09T18:45:49.660963] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-09T18:45:49.661524] [INFO ] [MAIN ] Update Progress: 759/2373 symbols completed. EQH took 28.9s. Estimated remaining: 3h 44m 55s. Rate: 7.2 symbols/min [2025-10-09T18:45:50.444583] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T18:45:50.456238] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-09T18:45:52.093157] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T18:45:52.104210] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-09T18:45:53.734354] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:45:53.747353] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-09T18:45:55.391212] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T18:45:55.405185] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-09T18:45:57.309013] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T18:45:57.321026] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-09T18:45:59.301245] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T18:45:59.306173] [INFO ] [REMOTE ] EQNR: Full fetch complete (76808 records). [2025-10-09T18:45:59.306316] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-09T18:45:59.704172] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-09T18:45:59.704291] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-09T18:45:59.705369] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-09T18:45:59.705436] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-09T18:45:59.707115] [DEBUG] [LOCAL ] EQNR: Trimmed 76808 records to 53406 (keeping 200 days of data) [2025-10-09T18:46:00.032137] [DEBUG] [LOCAL ] EQNR: Primary data saved (53406 records). [2025-10-09T18:46:00.032297] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-09T18:46:00.032413] [INFO ] [MAIN ] Update Progress: 760/2373 symbols completed. EQNR took 26.7s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-09T18:46:00.700577] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:00.688243] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:00.730685] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:00.748639] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:00.749583] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-09T18:46:00.749660] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-09T18:46:00.749811] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-09T18:46:00.749859] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-09T18:46:00.749984] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-09T18:46:00.750042] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-09T18:46:00.820520] [DEBUG] [LOCAL ] EQV: Loaded 2709 existing records from primary storage. [2025-10-09T18:46:00.839503] [INFO ] [MAIN ] EQV: Loaded 2709 existing records. [2025-10-09T18:46:01.309058] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-09T18:46:01.315715] [DEBUG] [LOCAL ] EQR: Loaded 51608 existing records from primary storage. [2025-10-09T18:46:01.350829] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-10-09T18:46:01.360153] [INFO ] [MAIN ] EQR: Loaded 51608 existing records. [2025-10-09T18:46:01.359998] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:01.413521] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-09T18:46:01.442377] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-09T18:46:01.624858] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-09T18:46:01.694807] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:01.687368] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-09T18:46:01.781212] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-09T18:46:01.813485] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:01.856588] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-09T18:46:01.877679] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-09T18:46:01.914502] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-09T18:46:01.931204] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-09T18:46:01.925918] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:02.023912] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-09T18:46:02.037939] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-09T18:46:02.095411] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-09T18:46:02.131976] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-09T18:46:02.578031] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T18:46:02.704680] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-09T18:46:02.791050] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:02.817597] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-09T18:46:02.874461] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:02.905744] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-09T18:46:03.023052] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:03.023318] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-09T18:46:03.134151] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T18:46:03.135128] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-09T18:46:03.509000] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-09T18:46:03.510456] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-09T18:46:03.628754] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T18:46:03.630986] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-09T18:46:03.815603] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-09T18:46:03.817026] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-09T18:46:04.077874] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-09T18:46:04.079046] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-09T18:46:04.209548] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T18:46:04.212009] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-09T18:46:04.460681] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T18:46:04.461846] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-09T18:46:04.731265] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T18:46:04.741192] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-09T18:46:04.798165] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T18:46:04.799371] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-09T18:46:04.803840] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T18:46:04.805681] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-09T18:46:04.970257] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T18:46:04.981221] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-09T18:46:05.109790] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-09T18:46:05.349873] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T18:46:05.596721] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-09T18:46:06.033454] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T18:46:06.403183] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-09T18:46:06.422824] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T18:46:06.883118] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T18:46:06.987858] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-09T18:46:07.196722] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-09T18:46:07.996733] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-09T18:46:08.796690] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-09T18:46:08.866675] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:46:09.241724] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:46:09.455915] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:46:09.596692] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-09T18:46:10.396780] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-09T18:46:10.853881] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T18:46:11.125719] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T18:46:11.196699] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-09T18:46:11.827746] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T18:46:11.996723] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-09T18:46:12.595215] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T18:46:12.596232] [INFO ] [REMOTE ] EQS: Full fetch complete (2479 records). [2025-10-09T18:46:12.596322] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-09T18:46:12.801979] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-09T18:46:12.806017] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-09T18:46:12.807057] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:46:12.807133] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:46:12.807191] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-09T18:46:12.807246] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-09T18:46:12.807283] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-09T18:46:12.807324] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-09T18:46:12.807385] [INFO ] [MAIN ] Update Progress: 761/2373 symbols completed. EQS took 12.8s. Estimated remaining: 3h 44m 52s. Rate: 7.2 symbols/min [2025-10-09T18:46:12.979770] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:13.028021] [DEBUG] [LOCAL ] ERJ: Loaded 50464 existing records from primary storage. [2025-10-09T18:46:13.028341] [INFO ] [MAIN ] ERJ: Loaded 50464 existing records. [2025-10-09T18:46:13.205178] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:13.205412] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-09T18:46:13.205461] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-09T18:46:13.205816] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-09T18:46:13.205876] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-09T18:46:13.558836] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:13.596674] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-09T18:46:14.066332] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T18:46:14.396746] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-09T18:46:15.018433] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-09T18:46:15.196734] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-09T18:46:15.719084] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T18:46:15.773962] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:46:15.996695] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-09T18:46:16.796745] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-09T18:46:17.509068] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:46:17.596688] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-09T18:46:18.162873] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T18:46:18.396756] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-09T18:46:19.062295] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T18:46:19.196693] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-09T18:46:19.303873] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:46:19.996737] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-09T18:46:20.796749] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-09T18:46:20.857087] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T18:46:21.319377] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:46:21.367683] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T18:46:21.368394] [INFO ] [REMOTE ] EQV: Full fetch complete (5743 records). [2025-10-09T18:46:21.368500] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-09T18:46:21.603970] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-09T18:46:21.721730] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-09T18:46:21.721813] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-09T18:46:21.721977] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-09T18:46:21.722016] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-09T18:46:21.722389] [DEBUG] [LOCAL ] EQV: Trimmed 5743 records to 2713 (keeping 200 days of data) [2025-10-09T18:46:21.738863] [DEBUG] [LOCAL ] EQV: Primary data saved (2713 records). [2025-10-09T18:46:21.738938] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-09T18:46:21.739010] [INFO ] [MAIN ] Update Progress: 762/2373 symbols completed. EQV took 21.7s. Estimated remaining: 3h 44m 45s. Rate: 7.2 symbols/min [2025-10-09T18:46:21.933300] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:21.981005] [DEBUG] [LOCAL ] ERO: Loaded 41514 existing records from primary storage. [2025-10-09T18:46:21.981308] [INFO ] [MAIN ] ERO: Loaded 41514 existing records. [2025-10-09T18:46:22.192525] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:22.192762] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-09T18:46:22.192813] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-09T18:46:22.193093] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-09T18:46:22.193134] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-09T18:46:22.406890] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-09T18:46:22.603119] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:23.015054] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T18:46:23.196723] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-09T18:46:23.996705] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-09T18:46:24.175066] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T18:46:24.726424] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:46:24.796693] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-09T18:46:25.596743] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-09T18:46:25.765673] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:46:26.396724] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-09T18:46:26.820254] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T18:46:26.890464] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T18:46:27.196709] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-09T18:46:27.908063] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T18:46:27.996682] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-09T18:46:28.796695] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-09T18:46:28.931743] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:46:29.596729] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-09T18:46:30.116403] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:46:30.122734] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-09T18:46:30.396729] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-09T18:46:31.197122] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-09T18:46:31.197007] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T18:46:31.439051] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:46:31.996723] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-09T18:46:32.699602] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T18:46:32.796738] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-09T18:46:33.585891] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T18:46:33.596954] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-09T18:46:34.286192] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T18:46:34.396705] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-09T18:46:34.917464] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T18:46:34.921911] [INFO ] [REMOTE ] EQR: Full fetch complete (74138 records). [2025-10-09T18:46:34.922019] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-09T18:46:35.201846] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-09T18:46:35.323305] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-09T18:46:35.323384] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-09T18:46:35.324292] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-09T18:46:35.324357] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-09T18:46:35.325810] [DEBUG] [LOCAL ] EQR: Trimmed 74138 records to 51995 (keeping 200 days of data) [2025-10-09T18:46:35.654589] [DEBUG] [LOCAL ] EQR: Primary data saved (51995 records). [2025-10-09T18:46:35.654772] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-09T18:46:35.654862] [INFO ] [MAIN ] Update Progress: 763/2373 symbols completed. EQR took 35.6s. Estimated remaining: 3h 44m 48s. Rate: 7.2 symbols/min [2025-10-09T18:46:35.848721] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:35.901031] [DEBUG] [LOCAL ] ES: Loaded 52628 existing records from primary storage. [2025-10-09T18:46:35.901369] [INFO ] [MAIN ] ES: Loaded 52628 existing records. [2025-10-09T18:46:36.000848] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-09T18:46:36.081065] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:36.081693] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-09T18:46:36.081868] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-09T18:46:36.082342] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-09T18:46:36.082398] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-09T18:46:36.455759] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:36.486621] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T18:46:36.804258] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-09T18:46:36.825565] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T18:46:37.275247] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:46:37.596810] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-09T18:46:38.394276] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T18:46:38.406243] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-09T18:46:39.196742] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-09T18:46:39.331510] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:46:39.811928] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T18:46:39.996695] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-09T18:46:40.773552] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T18:46:40.778048] [INFO ] [REMOTE ] EQT: Full fetch complete (77694 records). [2025-10-09T18:46:40.778159] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-09T18:46:40.808754] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-09T18:46:41.186308] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-09T18:46:41.186420] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-09T18:46:41.187478] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-09T18:46:41.187663] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-09T18:46:41.189495] [DEBUG] [LOCAL ] EQT: Trimmed 77694 records to 54072 (keeping 200 days of data) [2025-10-09T18:46:41.340090] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:46:41.555798] [DEBUG] [LOCAL ] EQT: Primary data saved (54072 records). [2025-10-09T18:46:41.555939] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-09T18:46:41.556843] [INFO ] [MAIN ] Update Progress: 764/2373 symbols completed. EQT took 41.5s. Estimated remaining: 3h 44m 34s. Rate: 7.2 symbols/min [2025-10-09T18:46:41.601882] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-09T18:46:41.727503] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:41.757094] [DEBUG] [LOCAL ] ESAB: Loaded 26086 existing records from primary storage. [2025-10-09T18:46:41.757373] [INFO ] [MAIN ] ESAB: Loaded 26086 existing records. [2025-10-09T18:46:41.935552] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:41.935807] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-09T18:46:41.935855] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-09T18:46:41.936065] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-09T18:46:41.936121] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-09T18:46:42.329402] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:42.372371] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T18:46:42.396674] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-09T18:46:42.899435] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:46:43.196737] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-09T18:46:43.478859] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T18:46:43.996754] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-09T18:46:44.780082] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:46:44.796668] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-09T18:46:45.597157] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-09T18:46:45.597003] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T18:46:45.803873] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T18:46:46.396685] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-09T18:46:46.545564] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T18:46:47.196772] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-09T18:46:47.997966] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-09T18:46:48.003209] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T18:46:48.307362] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T18:46:48.796797] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-09T18:46:49.458230] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:46:49.596668] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-09T18:46:50.002055] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:46:50.396756] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-09T18:46:51.152289] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T18:46:51.196746] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-09T18:46:51.941721] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T18:46:51.946322] [INFO ] [REMOTE ] ERO: Full fetch complete (59775 records). [2025-10-09T18:46:51.946475] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-09T18:46:52.007592] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-09T18:46:52.357550] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-09T18:46:52.357634] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-09T18:46:52.358490] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-09T18:46:52.358555] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-09T18:46:52.359812] [DEBUG] [LOCAL ] ERO: Trimmed 59775 records to 41893 (keeping 200 days of data) [2025-10-09T18:46:52.577331] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T18:46:52.582892] [INFO ] [REMOTE ] ERJ: Full fetch complete (72379 records). [2025-10-09T18:46:52.583523] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-09T18:46:52.802333] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-09T18:46:53.006383] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-09T18:46:53.007021] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-09T18:46:53.008244] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-09T18:46:53.008327] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-09T18:46:53.024490] [DEBUG] [LOCAL ] ERJ: Trimmed 72379 records to 50781 (keeping 200 days of data) [2025-10-09T18:46:53.026177] [DEBUG] [LOCAL ] ERO: Primary data saved (41893 records). [2025-10-09T18:46:53.026286] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-09T18:46:53.026578] [INFO ] [MAIN ] Update Progress: 765/2373 symbols completed. ERO took 31.3s. Estimated remaining: 3h 44m 32s. Rate: 7.2 symbols/min [2025-10-09T18:46:53.294845] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:53.319051] [DEBUG] [LOCAL ] ESE: Loaded 16540 existing records from primary storage. [2025-10-09T18:46:53.320082] [INFO ] [MAIN ] ESE: Loaded 16540 existing records. [2025-10-09T18:46:53.514247] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:53.514552] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-09T18:46:53.514709] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-09T18:46:53.514976] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-09T18:46:53.515035] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-09T18:46:53.996891] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:53.998451] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-09T18:46:54.047416] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T18:46:54.071069] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T18:46:54.151857] [DEBUG] [LOCAL ] ERJ: Primary data saved (50781 records). [2025-10-09T18:46:54.151997] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-09T18:46:54.152080] [INFO ] [MAIN ] Update Progress: 766/2373 symbols completed. ERJ took 41.3s. Estimated remaining: 3h 44m 9s. Rate: 7.2 symbols/min [2025-10-09T18:46:54.317258] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:54.364087] [DEBUG] [LOCAL ] ESI: Loaded 50673 existing records from primary storage. [2025-10-09T18:46:54.364415] [INFO ] [MAIN ] ESI: Loaded 50673 existing records. [2025-10-09T18:46:54.406725] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-09T18:46:54.543039] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:54.543217] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-09T18:46:54.543264] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-09T18:46:54.543484] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-09T18:46:54.543541] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-09T18:46:54.852966] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:46:54.920931] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:55.196695] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-09T18:46:55.533221] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T18:46:55.996748] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-09T18:46:56.271208] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T18:46:56.796774] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-09T18:46:57.596695] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-09T18:46:58.102837] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T18:46:58.396732] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-09T18:46:58.456431] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T18:46:58.480891] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T18:46:59.196762] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-09T18:46:59.996766] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-09T18:47:00.230531] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T18:47:00.768900] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:47:00.796686] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-09T18:47:01.222547] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:47:01.596784] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-09T18:47:02.396723] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-09T18:47:02.504829] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T18:47:03.196749] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-09T18:47:03.452899] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-09T18:47:03.992170] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T18:47:04.002786] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-09T18:47:04.183243] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T18:47:04.796713] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-09T18:47:05.378281] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:47:05.596755] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-09T18:47:06.396724] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-09T18:47:06.697621] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:47:06.796535] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T18:47:07.196731] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-09T18:47:07.985584] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:47:07.997060] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-09T18:47:08.556815] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T18:47:08.796741] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-09T18:47:09.593155] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T18:47:09.598360] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-09T18:47:10.045479] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T18:47:10.048002] [INFO ] [REMOTE ] ESAB: Full fetch complete (35827 records). [2025-10-09T18:47:10.048077] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-09T18:47:10.402001] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-09T18:47:10.444370] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-09T18:47:10.444468] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-09T18:47:10.445217] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-09T18:47:10.445284] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-09T18:47:10.446323] [DEBUG] [LOCAL ] ESAB: Trimmed 35827 records to 26259 (keeping 200 days of data) [2025-10-09T18:47:10.619946] [DEBUG] [LOCAL ] ESAB: Primary data saved (26259 records). [2025-10-09T18:47:10.620088] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-09T18:47:10.620173] [INFO ] [MAIN ] Update Progress: 767/2373 symbols completed. ESAB took 29.1s. Estimated remaining: 3h 44m 17s. Rate: 7.2 symbols/min [2025-10-09T18:47:10.793809] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:10.835582] [DEBUG] [LOCAL ] ESNT: Loaded 38246 existing records from primary storage. [2025-10-09T18:47:10.835900] [INFO ] [MAIN ] ESNT: Loaded 38246 existing records. [2025-10-09T18:47:11.023021] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:11.023437] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-09T18:47:11.023553] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-09T18:47:11.023928] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-09T18:47:11.024023] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-09T18:47:11.223048] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-09T18:47:11.397484] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:11.428315] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:47:11.514589] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T18:47:11.996780] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-09T18:47:12.796715] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-09T18:47:12.896314] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T18:47:13.438915] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T18:47:13.596724] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-09T18:47:13.751124] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:47:13.755989] [INFO ] [REMOTE ] ES: Full fetch complete (76239 records). [2025-10-09T18:47:13.756146] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-09T18:47:14.158948] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-09T18:47:14.159041] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-09T18:47:14.159987] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-09T18:47:14.160050] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-09T18:47:14.161477] [DEBUG] [LOCAL ] ES: Trimmed 76239 records to 53014 (keeping 200 days of data) [2025-10-09T18:47:14.396885] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-09T18:47:14.492209] [DEBUG] [LOCAL ] ES: Primary data saved (53014 records). [2025-10-09T18:47:14.492368] [INFO ] [MAIN ] ES: Full history saved. [2025-10-09T18:47:14.492473] [INFO ] [MAIN ] Update Progress: 768/2373 symbols completed. ES took 38.8s. Estimated remaining: 3h 43m 60s. Rate: 7.2 symbols/min [2025-10-09T18:47:14.664438] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:14.705977] [DEBUG] [LOCAL ] ESRT: Loaded 46356 existing records from primary storage. [2025-10-09T18:47:14.706315] [INFO ] [MAIN ] ESRT: Loaded 46356 existing records. [2025-10-09T18:47:14.892791] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:14.893446] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-09T18:47:14.893771] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-09T18:47:14.894134] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-09T18:47:14.894261] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-09T18:47:15.026869] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T18:47:15.202632] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-09T18:47:15.295938] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:15.996750] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-09T18:47:16.803426] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-09T18:47:16.805659] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T18:47:16.901021] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-09T18:47:17.596759] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-09T18:47:17.814866] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T18:47:17.858273] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T18:47:18.396760] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-09T18:47:19.196693] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-09T18:47:19.364200] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T18:47:19.466206] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T18:47:19.996848] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-09T18:47:20.464185] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T18:47:20.796859] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-09T18:47:21.353239] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:47:21.357858] [INFO ] [REMOTE ] ESI: Full fetch complete (72859 records). [2025-10-09T18:47:21.358028] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-09T18:47:21.601819] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-09T18:47:21.764942] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-09T18:47:21.765027] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-09T18:47:21.765931] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-09T18:47:21.765995] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-09T18:47:21.767468] [DEBUG] [LOCAL ] ESI: Trimmed 72859 records to 51049 (keeping 200 days of data) [2025-10-09T18:47:22.082886] [DEBUG] [LOCAL ] ESI: Primary data saved (51049 records). [2025-10-09T18:47:22.083019] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-09T18:47:22.083101] [INFO ] [MAIN ] Update Progress: 769/2373 symbols completed. ESI took 27.9s. Estimated remaining: 3h 43m 50s. Rate: 7.2 symbols/min [2025-10-09T18:47:22.280663] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:22.277639] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T18:47:22.318950] [DEBUG] [LOCAL ] ESS: Loaded 29778 existing records from primary storage. [2025-10-09T18:47:22.319240] [INFO ] [MAIN ] ESS: Loaded 29778 existing records. [2025-10-09T18:47:22.401784] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-09T18:47:22.506841] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:22.507169] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-09T18:47:22.507228] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-09T18:47:22.507443] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-09T18:47:22.507501] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-09T18:47:22.831904] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:47:22.898438] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:23.196810] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-09T18:47:23.996744] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-09T18:47:24.141756] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T18:47:24.440821] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:47:24.796793] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-09T18:47:25.104379] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T18:47:25.596778] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-09T18:47:26.295744] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:47:26.396726] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-09T18:47:26.790354] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:47:27.196777] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-09T18:47:27.370058] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T18:47:27.996743] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-09T18:47:28.659580] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:47:28.796739] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-09T18:47:29.603104] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-09T18:47:29.622860] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T18:47:29.988073] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:47:30.396681] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-09T18:47:30.692563] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T18:47:31.196767] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-09T18:47:31.489214] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:47:31.996704] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-09T18:47:32.109001] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T18:47:32.110739] [INFO ] [REMOTE ] ESE: Full fetch complete (22428 records). [2025-10-09T18:47:32.110824] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-09T18:47:32.481207] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-09T18:47:32.481290] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-09T18:47:32.481850] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-09T18:47:32.481915] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-09T18:47:32.482563] [DEBUG] [LOCAL ] ESE: Trimmed 22428 records to 16664 (keeping 200 days of data) [2025-10-09T18:47:32.595349] [DEBUG] [LOCAL ] ESE: Primary data saved (16664 records). [2025-10-09T18:47:32.595565] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-09T18:47:32.595727] [INFO ] [MAIN ] Update Progress: 770/2373 symbols completed. ESE took 39.6s. Estimated remaining: 3h 43m 46s. Rate: 7.2 symbols/min [2025-10-09T18:47:32.769892] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:32.796843] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-09T18:47:32.822628] [DEBUG] [LOCAL ] ESTC: Loaded 50106 existing records from primary storage. [2025-10-09T18:47:32.823012] [INFO ] [MAIN ] ESTC: Loaded 50106 existing records. [2025-10-09T18:47:33.033020] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:33.033255] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-09T18:47:33.033302] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-09T18:47:33.033702] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-09T18:47:33.033763] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-09T18:47:33.415855] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:33.601840] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-09T18:47:33.617238] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T18:47:34.163505] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T18:47:34.396720] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-09T18:47:35.078864] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T18:47:35.196751] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-09T18:47:35.691441] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:47:35.996752] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-09T18:47:36.766611] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:47:36.796724] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-09T18:47:37.499894] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:47:37.596683] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-09T18:47:37.867489] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T18:47:38.396696] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-09T18:47:38.886174] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T18:47:39.196718] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-09T18:47:39.756956] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T18:47:39.996788] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-09T18:47:40.265292] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T18:47:40.796718] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-09T18:47:41.423191] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T18:47:41.596719] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-09T18:47:41.818898] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T18:47:42.396747] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-09T18:47:42.956489] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:47:42.960181] [INFO ] [REMOTE ] ESNT: Full fetch complete (57147 records). [2025-10-09T18:47:42.960303] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-09T18:47:43.201878] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-09T18:47:43.357045] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-09T18:47:43.357127] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-09T18:47:43.357938] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-09T18:47:43.358003] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-09T18:47:43.359109] [DEBUG] [LOCAL ] ESNT: Trimmed 57147 records to 38557 (keeping 200 days of data) [2025-10-09T18:47:43.609948] [DEBUG] [LOCAL ] ESNT: Primary data saved (38557 records). [2025-10-09T18:47:43.610157] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-09T18:47:43.611165] [INFO ] [MAIN ] Update Progress: 771/2373 symbols completed. ESNT took 33.0s. Estimated remaining: 3h 43m 43s. Rate: 7.2 symbols/min [2025-10-09T18:47:43.792087] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:43.844635] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-09T18:47:43.845063] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-09T18:47:44.021368] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-09T18:47:44.051230] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:44.054622] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:47:44.053065] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-09T18:47:44.064386] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-09T18:47:44.065558] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-09T18:47:44.065623] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-09T18:47:44.439171] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:44.796700] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-09T18:47:44.964987] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T18:47:45.450078] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:47:45.596702] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-09T18:47:46.066404] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T18:47:46.396731] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-09T18:47:47.196695] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-09T18:47:47.548200] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T18:47:47.619859] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T18:47:47.996726] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-09T18:47:48.647562] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:47:48.651719] [INFO ] [REMOTE ] ESRT: Full fetch complete (66502 records). [2025-10-09T18:47:48.651872] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-09T18:47:48.802483] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-09T18:47:49.048673] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-09T18:47:49.048764] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-09T18:47:49.049589] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-09T18:47:49.049630] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-09T18:47:49.050978] [DEBUG] [LOCAL ] ESRT: Trimmed 66502 records to 46673 (keeping 200 days of data) [2025-10-09T18:47:49.325163] [DEBUG] [LOCAL ] ESRT: Primary data saved (46673 records). [2025-10-09T18:47:49.325297] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-09T18:47:49.325379] [INFO ] [MAIN ] Update Progress: 772/2373 symbols completed. ESRT took 34.8s. Estimated remaining: 3h 43m 29s. Rate: 7.2 symbols/min [2025-10-09T18:47:49.495525] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:49.509912] [DEBUG] [LOCAL ] ETB: Loaded 12203 existing records from primary storage. [2025-10-09T18:47:49.510132] [INFO ] [MAIN ] ETB: Loaded 12203 existing records. [2025-10-09T18:47:49.605745] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-09T18:47:49.688896] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:49.690236] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-09T18:47:49.690284] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-09T18:47:49.690526] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-09T18:47:49.690583] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-09T18:47:50.047081] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:50.076732] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T18:47:50.165811] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:47:50.396732] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-09T18:47:51.196724] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-09T18:47:51.375349] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:47:51.686226] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-09T18:47:51.996674] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-09T18:47:52.498464] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-09T18:47:52.796716] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-09T18:47:53.374091] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T18:47:53.538183] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:47:53.596707] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-09T18:47:54.396722] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-09T18:47:55.196740] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-09T18:47:55.497107] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:47:55.996747] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-09T18:47:56.464722] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T18:47:56.548357] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-09T18:47:56.796793] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-09T18:47:57.596788] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-09T18:47:58.001989] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T18:47:58.061398] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:47:58.396717] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-09T18:47:59.196760] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-09T18:47:59.350096] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:47:59.353587] [INFO ] [REMOTE ] ESS: Full fetch complete (43234 records). [2025-10-09T18:47:59.353737] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-09T18:47:59.739378] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-09T18:47:59.739458] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-09T18:47:59.740120] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-09T18:47:59.740183] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-09T18:47:59.741115] [DEBUG] [LOCAL ] ESS: Trimmed 43234 records to 29941 (keeping 200 days of data) [2025-10-09T18:47:59.935334] [DEBUG] [LOCAL ] ESS: Primary data saved (29941 records). [2025-10-09T18:47:59.935781] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-09T18:47:59.935876] [INFO ] [MAIN ] Update Progress: 773/2373 symbols completed. ESS took 37.9s. Estimated remaining: 3h 43m 25s. Rate: 7.2 symbols/min [2025-10-09T18:48:00.002445] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-09T18:48:00.114975] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:00.143021] [DEBUG] [LOCAL ] ETD: Loaded 27379 existing records from primary storage. [2025-10-09T18:48:00.143281] [INFO ] [MAIN ] ETD: Loaded 27379 existing records. [2025-10-09T18:48:00.325796] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:00.326241] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-09T18:48:00.326390] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-09T18:48:00.326947] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-09T18:48:00.327006] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-09T18:48:00.712295] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:00.714949] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T18:48:00.796700] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-09T18:48:01.305545] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T18:48:01.596721] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-09T18:48:02.224211] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T18:48:02.303166] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-09T18:48:02.396701] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-09T18:48:03.079093] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T18:48:03.196747] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-09T18:48:03.659210] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-09T18:48:03.996727] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-09T18:48:04.656151] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T18:48:04.796772] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-09T18:48:05.519325] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-09T18:48:05.595998] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T18:48:05.598560] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-09T18:48:06.396807] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-09T18:48:07.196759] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-09T18:48:07.257976] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:48:07.336382] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T18:48:07.661136] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T18:48:07.996732] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-09T18:48:08.796744] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-09T18:48:09.596700] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-09T18:48:09.643428] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T18:48:09.645254] [INFO ] [REMOTE ] ETB: Full fetch complete (18334 records). [2025-10-09T18:48:09.645439] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-09T18:48:10.039734] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-09T18:48:10.039875] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-09T18:48:10.040483] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-09T18:48:10.040569] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-09T18:48:10.041561] [DEBUG] [LOCAL ] ETB: Trimmed 18334 records to 12264 (keeping 200 days of data) [2025-10-09T18:48:10.109838] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-09T18:48:10.168704] [DEBUG] [LOCAL ] ETB: Primary data saved (12264 records). [2025-10-09T18:48:10.168888] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-09T18:48:10.169004] [INFO ] [MAIN ] Update Progress: 774/2373 symbols completed. ETB took 20.8s. Estimated remaining: 3h 43m 21s. Rate: 7.2 symbols/min [2025-10-09T18:48:10.345958] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:10.365927] [DEBUG] [LOCAL ] ETG: Loaded 16576 existing records from primary storage. [2025-10-09T18:48:10.366271] [INFO ] [MAIN ] ETG: Loaded 16576 existing records. [2025-10-09T18:48:10.401911] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-09T18:48:10.556331] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:10.556567] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-09T18:48:10.556615] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-09T18:48:10.556879] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-09T18:48:10.556939] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-09T18:48:10.921564] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:11.196730] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-09T18:48:11.996748] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-09T18:48:12.873406] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-09T18:48:12.892466] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-10-09T18:48:12.906322] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-09T18:48:12.936598] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T18:48:13.596729] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-09T18:48:13.627721] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-09T18:48:14.396685] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-09T18:48:14.562036] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T18:48:15.111194] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T18:48:15.196731] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-09T18:48:15.965508] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T18:48:15.969728] [INFO ] [REMOTE ] ESTC: Full fetch complete (72106 records). [2025-10-09T18:48:15.969821] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-09T18:48:16.001821] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-09T18:48:16.362253] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-09T18:48:16.362364] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-09T18:48:16.363342] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-09T18:48:16.363449] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-09T18:48:16.364936] [DEBUG] [LOCAL ] ESTC: Trimmed 72106 records to 50479 (keeping 200 days of data) [2025-10-09T18:48:16.465792] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:48:16.679523] [DEBUG] [LOCAL ] ESTC: Primary data saved (50479 records). [2025-10-09T18:48:16.679690] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-09T18:48:16.679822] [INFO ] [MAIN ] Update Progress: 775/2373 symbols completed. ESTC took 44.1s. Estimated remaining: 3h 43m 8s. Rate: 7.2 symbols/min [2025-10-09T18:48:16.801948] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-09T18:48:16.850512] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:16.868392] [DEBUG] [LOCAL ] ETJ: Loaded 17038 existing records from primary storage. [2025-10-09T18:48:16.868624] [INFO ] [MAIN ] ETJ: Loaded 17038 existing records. [2025-10-09T18:48:17.047255] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:17.047618] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-09T18:48:17.047745] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-09T18:48:17.053074] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-09T18:48:17.058798] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-09T18:48:17.102357] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:48:17.408236] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:17.596670] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-09T18:48:18.160085] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T18:48:18.396721] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-09T18:48:18.416846] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T18:48:19.196751] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-09T18:48:19.315261] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T18:48:19.996738] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-09T18:48:20.497975] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T18:48:20.796716] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-09T18:48:21.596737] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-09T18:48:22.070884] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-09T18:48:22.102242] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:48:22.396685] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-09T18:48:23.196748] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-09T18:48:23.228347] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:48:23.505135] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T18:48:23.996722] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-09T18:48:24.796703] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-09T18:48:24.839105] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T18:48:25.389109] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-09T18:48:25.393628] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-09T18:48:25.393808] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-09T18:48:25.602326] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-09T18:48:25.785616] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-09T18:48:25.785736] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-09T18:48:25.786735] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-09T18:48:25.786800] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-09T18:48:25.788306] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54179 (keeping 200 days of data) [2025-10-09T18:48:26.130738] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-10-09T18:48:26.130878] [INFO ] [MAIN ] ET: Full history saved. [2025-10-09T18:48:26.131424] [INFO ] [MAIN ] Update Progress: 776/2373 symbols completed. ET took 42.5s. Estimated remaining: 3h 43m 2s. Rate: 7.2 symbols/min [2025-10-09T18:48:26.254802] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T18:48:26.325199] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:26.384787] [DEBUG] [LOCAL ] ETN: Loaded 52702 existing records from primary storage. [2025-10-09T18:48:26.385166] [INFO ] [MAIN ] ETN: Loaded 52702 existing records. [2025-10-09T18:48:26.405274] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-09T18:48:26.599372] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:26.599628] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-09T18:48:26.599812] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-09T18:48:26.611364] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-09T18:48:26.611519] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-09T18:48:26.645757] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T18:48:26.981304] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:27.196715] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-09T18:48:27.727340] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:48:27.996693] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-09T18:48:28.796731] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-09T18:48:28.924586] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:48:29.127183] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:48:29.129858] [INFO ] [REMOTE ] ETD: Full fetch complete (38469 records). [2025-10-09T18:48:29.129942] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-09T18:48:29.492912] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-09T18:48:29.492996] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-09T18:48:29.493635] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-09T18:48:29.493717] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-09T18:48:29.494582] [DEBUG] [LOCAL ] ETD: Trimmed 38469 records to 27570 (keeping 200 days of data) [2025-10-09T18:48:29.597686] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-09T18:48:29.664272] [DEBUG] [LOCAL ] ETD: Primary data saved (27570 records). [2025-10-09T18:48:29.664470] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-09T18:48:29.664567] [INFO ] [MAIN ] Update Progress: 777/2373 symbols completed. ETD took 29.7s. Estimated remaining: 3h 42m 44s. Rate: 7.2 symbols/min [2025-10-09T18:48:29.839480] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:29.852462] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T18:48:29.863269] [DEBUG] [LOCAL ] ETO: Loaded 6764 existing records from primary storage. [2025-10-09T18:48:29.863481] [INFO ] [MAIN ] ETO: Loaded 6764 existing records. [2025-10-09T18:48:30.037535] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:30.037809] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-09T18:48:30.037899] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-09T18:48:30.038167] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-09T18:48:30.038224] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-09T18:48:30.390080] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:30.396681] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-09T18:48:30.997110] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:48:31.196677] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-09T18:48:31.605530] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-09T18:48:31.721957] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-09T18:48:31.996668] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-09T18:48:32.505805] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:48:32.796738] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-09T18:48:33.596691] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-09T18:48:33.818061] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T18:48:34.396749] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-09T18:48:35.196685] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-09T18:48:35.799539] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-09T18:48:35.827150] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T18:48:35.961930] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T18:48:35.996670] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-09T18:48:36.796721] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-09T18:48:37.479434] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-09T18:48:37.596733] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-09T18:48:38.056767] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T18:48:38.396685] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-09T18:48:38.765832] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:48:39.196722] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-09T18:48:39.962120] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T18:48:39.996756] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-09T18:48:40.728054] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T18:48:40.796682] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-09T18:48:41.358085] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T18:48:41.596717] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-09T18:48:42.217127] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:48:42.396719] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-09T18:48:42.838733] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T18:48:43.196801] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-09T18:48:43.368514] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (4.97 seconds). [2025-10-09T18:48:43.996758] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-09T18:48:44.012161] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T18:48:44.013577] [INFO ] [REMOTE ] ETO: Full fetch complete (9644 records). [2025-10-09T18:48:44.013675] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-09T18:48:44.372369] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-09T18:48:44.372460] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-09T18:48:44.372757] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-09T18:48:44.372822] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-09T18:48:44.373264] [DEBUG] [LOCAL ] ETO: Trimmed 9644 records to 6884 (keeping 200 days of data) [2025-10-09T18:48:44.414847] [DEBUG] [LOCAL ] ETO: Primary data saved (6884 records). [2025-10-09T18:48:44.414964] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-09T18:48:44.415049] [INFO ] [MAIN ] Update Progress: 778/2373 symbols completed. ETO took 14.8s. Estimated remaining: 3h 42m 49s. Rate: 7.2 symbols/min [2025-10-09T18:48:44.593495] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:44.675124] [DEBUG] [LOCAL ] ETR: Loaded 53231 existing records from primary storage. [2025-10-09T18:48:44.675774] [INFO ] [MAIN ] ETR: Loaded 53231 existing records. [2025-10-09T18:48:44.802011] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-09T18:48:44.954841] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:44.956764] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-09T18:48:44.956677] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T18:48:44.956928] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-09T18:48:44.963173] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-09T18:48:44.963243] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-09T18:48:45.315764] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:45.596792] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-09T18:48:45.723443] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T18:48:46.396706] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-09T18:48:47.196709] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-09T18:48:47.225139] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:48:47.357586] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:48:47.996763] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-09T18:48:48.796701] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-09T18:48:49.208863] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T18:48:49.353895] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T18:48:49.596765] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-09T18:48:49.701988] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T18:48:50.396769] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-09T18:48:51.196702] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-09T18:48:51.329347] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T18:48:51.996745] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-09T18:48:52.269487] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:48:52.579481] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:48:52.796772] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-09T18:48:53.596763] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-09T18:48:53.817863] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:48:54.190086] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:48:54.222334] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:48:54.396775] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-09T18:48:55.196741] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-09T18:48:55.522387] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T18:48:55.996723] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-09T18:48:56.220956] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T18:48:56.796749] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-09T18:48:57.596714] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-09T18:48:57.756577] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T18:48:57.759719] [INFO ] [REMOTE ] ETG: Full fetch complete (24767 records). [2025-10-09T18:48:57.759805] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-09T18:48:58.154080] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-09T18:48:58.262119] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-09T18:48:58.262200] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-09T18:48:58.262804] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-09T18:48:58.262894] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-09T18:48:58.263718] [DEBUG] [LOCAL ] ETG: Trimmed 24767 records to 16668 (keeping 200 days of data) [2025-10-09T18:48:58.386227] [DEBUG] [LOCAL ] ETG: Primary data saved (16668 records). [2025-10-09T18:48:58.386377] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-09T18:48:58.386517] [INFO ] [MAIN ] Update Progress: 779/2373 symbols completed. ETG took 48.2s. Estimated remaining: 3h 42m 52s. Rate: 7.2 symbols/min [2025-10-09T18:48:58.401939] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-09T18:48:58.582732] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:58.605204] [DEBUG] [LOCAL ] ETV: Loaded 22112 existing records from primary storage. [2025-10-09T18:48:58.605438] [INFO ] [MAIN ] ETV: Loaded 22112 existing records. [2025-10-09T18:48:58.783235] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:58.783439] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-09T18:48:58.783487] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-09T18:48:58.784289] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-09T18:48:58.784349] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-09T18:48:59.141382] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:59.196686] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-09T18:48:59.251099] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T18:48:59.253409] [INFO ] [REMOTE ] ETJ: Full fetch complete (25568 records). [2025-10-09T18:48:59.253482] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-09T18:48:59.641081] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-09T18:48:59.641264] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-09T18:48:59.642024] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-09T18:48:59.642167] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-09T18:48:59.643507] [DEBUG] [LOCAL ] ETJ: Trimmed 25568 records to 17098 (keeping 200 days of data) [2025-10-09T18:48:59.752124] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-09T18:48:59.791814] [DEBUG] [LOCAL ] ETJ: Primary data saved (17098 records). [2025-10-09T18:48:59.791960] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-09T18:48:59.792042] [INFO ] [MAIN ] Update Progress: 780/2373 symbols completed. ETJ took 43.1s. Estimated remaining: 3h 42m 29s. Rate: 7.2 symbols/min [2025-10-09T18:48:59.960775] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:59.986086] [DEBUG] [LOCAL ] ETW: Loaded 25426 existing records from primary storage. [2025-10-09T18:48:59.986361] [INFO ] [MAIN ] ETW: Loaded 25426 existing records. [2025-10-09T18:49:00.007113] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-09T18:49:00.178378] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:00.178625] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-09T18:49:00.178732] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-09T18:49:00.179884] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-09T18:49:00.179951] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-09T18:49:00.414844] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T18:49:00.580696] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:00.796744] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-09T18:49:01.596754] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-09T18:49:02.067774] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T18:49:02.396761] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-09T18:49:02.474147] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T18:49:03.144497] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T18:49:03.172427] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T18:49:03.196686] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-09T18:49:03.996752] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-09T18:49:04.796802] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-09T18:49:04.873566] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T18:49:04.937307] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T18:49:05.596733] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-09T18:49:05.887793] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T18:49:06.396691] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-09T18:49:06.416011] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T18:49:07.196727] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-09T18:49:07.964012] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T18:49:07.996740] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-09T18:49:08.284332] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T18:49:08.796731] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-09T18:49:09.594123] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:49:09.598716] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-09T18:49:10.124789] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-09T18:49:10.396704] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-09T18:49:10.817866] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T18:49:11.196699] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-09T18:49:11.280473] [DEBUG] [REMOTE ] ETV: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-09T18:49:11.280629] [WARN ] [REMOTE ] ETV: No data returned for month 2025-05 [2025-10-09T18:49:11.280748] [FATAL] [REMOTE ] ETV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:49:11.280817] [FATAL] [MAIN ] ETV: Failed to fetch primary data. [2025-10-09T18:49:11.280884] [WARN ] [MAIN ] ETV: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:49:11.280958] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-09T18:49:11.281029] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-09T18:49:11.281078] [INFO ] [LOCAL ] ETV: Starting deletion of derivative data. [2025-10-09T18:49:11.281329] [DEBUG] [LOCAL ] ETV: Deleted derivative data file. [2025-10-09T18:49:11.281403] [INFO ] [MAIN ] Update Progress: 781/2373 symbols completed. ETV took 12.9s. Estimated remaining: 3h 42m 27s. Rate: 7.2 symbols/min [2025-10-09T18:49:11.448671] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:11.455320] [DEBUG] [LOCAL ] ETX: Loaded 5220 existing records from primary storage. [2025-10-09T18:49:11.455488] [INFO ] [MAIN ] ETX: Loaded 5220 existing records. [2025-10-09T18:49:11.628223] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:11.628453] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-09T18:49:11.628536] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-09T18:49:11.628824] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-09T18:49:11.628881] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-09T18:49:11.980676] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:11.996674] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-09T18:49:12.796712] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-09T18:49:12.878970] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T18:49:13.064605] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T18:49:13.068985] [INFO ] [REMOTE ] ETN: Full fetch complete (76518 records). [2025-10-09T18:49:13.069108] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-09T18:49:13.475953] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-09T18:49:13.476147] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-09T18:49:13.477092] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-09T18:49:13.477156] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-09T18:49:13.478625] [DEBUG] [LOCAL ] ETN: Trimmed 76518 records to 53075 (keeping 200 days of data) [2025-10-09T18:49:13.597288] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-09T18:49:13.826361] [DEBUG] [LOCAL ] ETN: Primary data saved (53075 records). [2025-10-09T18:49:13.826506] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-09T18:49:13.826633] [INFO ] [MAIN ] Update Progress: 782/2373 symbols completed. ETN took 47.7s. Estimated remaining: 3h 42m 7s. Rate: 7.2 symbols/min [2025-10-09T18:49:13.999023] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:14.022057] [DEBUG] [LOCAL ] ETY: Loaded 23084 existing records from primary storage. [2025-10-09T18:49:14.022311] [INFO ] [MAIN ] ETY: Loaded 23084 existing records. [2025-10-09T18:49:14.209779] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:14.210160] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-09T18:49:14.210304] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-09T18:49:14.211261] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-09T18:49:14.211327] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-09T18:49:14.409262] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-09T18:49:14.438102] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T18:49:14.651059] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:14.682260] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:49:14.796016] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-09T18:49:15.196718] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-09T18:49:15.996697] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-09T18:49:16.523958] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T18:49:16.796731] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-09T18:49:16.878274] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T18:49:17.596702] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-09T18:49:17.776903] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T18:49:18.396717] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-09T18:49:19.196755] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-09T18:49:19.272331] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:49:19.276846] [INFO ] [REMOTE ] ETR: Full fetch complete (77087 records). [2025-10-09T18:49:19.276966] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-09T18:49:19.396463] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T18:49:19.698126] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-09T18:49:19.698221] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-09T18:49:19.699835] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-09T18:49:19.701187] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-09T18:49:19.701255] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-09T18:49:19.702731] [DEBUG] [LOCAL ] ETR: Trimmed 77087 records to 53610 (keeping 200 days of data) [2025-10-09T18:49:20.017030] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-09T18:49:20.072756] [DEBUG] [LOCAL ] ETR: Primary data saved (53610 records). [2025-10-09T18:49:20.072879] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-09T18:49:20.072995] [INFO ] [MAIN ] Update Progress: 783/2373 symbols completed. ETR took 35.7s. Estimated remaining: 3h 41m 54s. Rate: 7.2 symbols/min [2025-10-09T18:49:20.272996] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:20.291759] [DEBUG] [LOCAL ] EVC: Loaded 18236 existing records from primary storage. [2025-10-09T18:49:20.292007] [INFO ] [MAIN ] EVC: Loaded 18236 existing records. [2025-10-09T18:49:20.508232] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:20.508439] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-09T18:49:20.508489] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-09T18:49:20.509110] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-09T18:49:20.509171] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-09T18:49:20.635492] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T18:49:20.801973] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-09T18:49:20.943204] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:21.586680] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T18:49:21.596666] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-09T18:49:22.396693] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-09T18:49:22.717162] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:49:22.955563] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T18:49:23.196728] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-09T18:49:23.996729] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-09T18:49:24.407387] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T18:49:24.796681] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-09T18:49:24.952524] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T18:49:25.516821] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T18:49:25.596716] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-09T18:49:26.396691] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-09T18:49:26.426580] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:49:27.196745] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-09T18:49:27.695041] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T18:49:27.996739] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-09T18:49:28.166683] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T18:49:28.796675] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-09T18:49:28.860185] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T18:49:29.596737] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-09T18:49:29.812067] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T18:49:30.396688] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-09T18:49:30.504374] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T18:49:30.949503] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T18:49:31.196723] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-09T18:49:31.996755] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-09T18:49:32.796688] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-09T18:49:32.972696] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T18:49:33.056403] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T18:49:33.535402] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T18:49:33.596787] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-09T18:49:34.169584] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T18:49:34.396716] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-09T18:49:35.196746] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-09T18:49:35.514501] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T18:49:35.996715] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-09T18:49:36.796736] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-09T18:49:37.103963] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:49:37.596771] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-09T18:49:38.396740] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-09T18:49:38.498364] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T18:49:38.985031] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:49:38.986132] [INFO ] [REMOTE ] ETX: Full fetch complete (6990 records). [2025-10-09T18:49:38.986201] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-09T18:49:39.200053] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-09T18:49:39.264668] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (4.07 seconds). [2025-10-09T18:49:39.382852] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-09T18:49:39.382936] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-09T18:49:39.383155] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-09T18:49:39.383199] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-09T18:49:39.383614] [DEBUG] [LOCAL ] ETX: Trimmed 6990 records to 5243 (keeping 200 days of data) [2025-10-09T18:49:39.419662] [DEBUG] [LOCAL ] ETX: Primary data saved (5243 records). [2025-10-09T18:49:39.419790] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-09T18:49:39.419876] [INFO ] [MAIN ] Update Progress: 784/2373 symbols completed. ETX took 28.1s. Estimated remaining: 3h 42m 8s. Rate: 7.2 symbols/min [2025-10-09T18:49:39.607193] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:39.646628] [DEBUG] [LOCAL ] EVEX: Loaded 31368 existing records from primary storage. [2025-10-09T18:49:39.646930] [INFO ] [MAIN ] EVEX: Loaded 31368 existing records. [2025-10-09T18:49:39.851377] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-09T18:49:39.850856] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:39.856377] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-09T18:49:39.856798] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-09T18:49:39.857087] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-09T18:49:39.857145] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-09T18:49:40.001881] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-09T18:49:40.224639] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:40.329676] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:49:40.332389] [INFO ] [REMOTE ] ETW: Full fetch complete (36629 records). [2025-10-09T18:49:40.332465] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-09T18:49:40.719158] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-09T18:49:40.719424] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-09T18:49:40.720562] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-09T18:49:40.720677] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-09T18:49:40.721776] [DEBUG] [LOCAL ] ETW: Trimmed 36629 records to 25618 (keeping 200 days of data) [2025-10-09T18:49:40.809690] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-09T18:49:40.893559] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T18:49:40.906916] [DEBUG] [LOCAL ] ETW: Primary data saved (25618 records). [2025-10-09T18:49:40.907075] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-09T18:49:40.907167] [INFO ] [MAIN ] Update Progress: 785/2373 symbols completed. ETW took 41.1s. Estimated remaining: 3h 41m 46s. Rate: 7.2 symbols/min [2025-10-09T18:49:41.077667] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:41.088565] [DEBUG] [LOCAL ] EVF: Loaded 9735 existing records from primary storage. [2025-10-09T18:49:41.088823] [INFO ] [MAIN ] EVF: Loaded 9735 existing records. [2025-10-09T18:49:41.262965] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:41.263198] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-09T18:49:41.263264] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-09T18:49:41.263822] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-09T18:49:41.263881] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-09T18:49:41.597277] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-09T18:49:41.628421] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:41.641184] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:49:42.396768] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-09T18:49:42.653731] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T18:49:42.993694] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:49:43.196741] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-09T18:49:43.996744] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-09T18:49:44.145940] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T18:49:44.610660] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T18:49:44.796755] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-09T18:49:45.596684] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-09T18:49:45.694622] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T18:49:46.371363] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-09T18:49:46.373823] [INFO ] [REMOTE ] ETY: Full fetch complete (34261 records). [2025-10-09T18:49:46.373912] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-09T18:49:46.402958] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-09T18:49:46.746865] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-09T18:49:46.746940] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-09T18:49:46.747578] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-09T18:49:46.747619] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-09T18:49:46.748596] [DEBUG] [LOCAL ] ETY: Trimmed 34261 records to 23191 (keeping 200 days of data) [2025-10-09T18:49:46.890099] [DEBUG] [LOCAL ] ETY: Primary data saved (23191 records). [2025-10-09T18:49:46.890259] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-09T18:49:46.890374] [INFO ] [MAIN ] Update Progress: 786/2373 symbols completed. ETY took 33.1s. Estimated remaining: 3h 41m 32s. Rate: 7.2 symbols/min [2025-10-09T18:49:47.061920] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:47.069673] [DEBUG] [LOCAL ] EVG: Loaded 5983 existing records from primary storage. [2025-10-09T18:49:47.069876] [INFO ] [MAIN ] EVG: Loaded 5983 existing records. [2025-10-09T18:49:47.206913] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-09T18:49:47.250219] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:47.250694] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-09T18:49:47.250765] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-09T18:49:47.251140] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-09T18:49:47.251203] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-09T18:49:47.548074] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:49:47.634404] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:47.822828] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T18:49:47.996800] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-09T18:49:48.796710] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-09T18:49:49.099165] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:49:49.596731] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-09T18:49:49.642526] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:49:50.396692] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-09T18:49:50.421879] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T18:49:51.002625] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T18:49:51.196760] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-09T18:49:51.996712] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-09T18:49:52.318697] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T18:49:52.796690] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-09T18:49:52.907300] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T18:49:53.441542] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T18:49:53.443147] [INFO ] [REMOTE ] EVC: Full fetch complete (29314 records). [2025-10-09T18:49:53.443222] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-09T18:49:53.600066] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-09T18:49:53.814006] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-09T18:49:53.814089] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-09T18:49:53.814633] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-09T18:49:53.814751] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-09T18:49:53.815504] [DEBUG] [LOCAL ] EVC: Trimmed 29314 records to 18310 (keeping 200 days of data) [2025-10-09T18:49:53.926683] [DEBUG] [LOCAL ] EVC: Primary data saved (18310 records). [2025-10-09T18:49:53.926899] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-09T18:49:53.927002] [INFO ] [MAIN ] Update Progress: 787/2373 symbols completed. EVC took 33.9s. Estimated remaining: 3h 41m 21s. Rate: 7.2 symbols/min [2025-10-09T18:49:54.097088] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:54.143982] [DEBUG] [LOCAL ] EVH: Loaded 49565 existing records from primary storage. [2025-10-09T18:49:54.144299] [INFO ] [MAIN ] EVH: Loaded 49565 existing records. [2025-10-09T18:49:54.248702] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T18:49:54.326282] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:54.326527] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-09T18:49:54.326575] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-09T18:49:54.326812] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-09T18:49:54.326872] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-09T18:49:54.401922] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-09T18:49:54.675771] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:55.196738] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-09T18:49:55.454962] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T18:49:55.668327] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T18:49:55.996731] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-09T18:49:56.752547] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T18:49:56.796674] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-09T18:49:57.345212] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T18:49:57.596723] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-09T18:49:58.126266] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T18:49:58.396748] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-09T18:49:58.982391] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T18:49:59.196763] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-09T18:49:59.970806] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T18:49:59.996724] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-09T18:50:00.431054] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:50:00.796758] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-09T18:50:01.299041] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T18:50:01.596736] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-09T18:50:02.202961] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T18:50:02.396792] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-09T18:50:03.036056] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-09T18:50:03.196715] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-09T18:50:03.996727] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-09T18:50:04.714021] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T18:50:04.750595] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:50:04.796754] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-09T18:50:05.342213] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T18:50:05.343567] [INFO ] [REMOTE ] EVG: Full fetch complete (8174 records). [2025-10-09T18:50:05.343661] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-09T18:50:05.601795] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-09T18:50:05.785767] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-09T18:50:05.785843] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-09T18:50:05.786078] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-09T18:50:05.786131] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-09T18:50:05.786548] [DEBUG] [LOCAL ] EVG: Trimmed 8174 records to 6026 (keeping 200 days of data) [2025-10-09T18:50:05.827689] [DEBUG] [LOCAL ] EVG: Primary data saved (6026 records). [2025-10-09T18:50:05.827826] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-09T18:50:05.827937] [INFO ] [MAIN ] Update Progress: 788/2373 symbols completed. EVG took 18.9s. Estimated remaining: 3h 41m 20s. Rate: 7.2 symbols/min [2025-10-09T18:50:06.042337] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:06.056396] [DEBUG] [LOCAL ] EVN: Loaded 11115 existing records from primary storage. [2025-10-09T18:50:06.056600] [INFO ] [MAIN ] EVN: Loaded 11115 existing records. [2025-10-09T18:50:06.272045] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:06.272328] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-09T18:50:06.272387] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-09T18:50:06.272612] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-09T18:50:06.272717] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-09T18:50:06.401865] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-09T18:50:06.636778] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:06.735090] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T18:50:07.196721] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-09T18:50:07.857702] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T18:50:07.996701] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-09T18:50:08.080189] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T18:50:08.796741] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-09T18:50:09.596702] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-09T18:50:09.798102] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:50:10.302983] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-09T18:50:10.396723] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-09T18:50:11.196702] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-09T18:50:11.455283] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T18:50:11.575032] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T18:50:11.769624] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T18:50:11.996706] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-09T18:50:12.796714] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-09T18:50:13.484119] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T18:50:13.596817] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-09T18:50:14.143579] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T18:50:14.172983] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T18:50:14.396735] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-09T18:50:15.196764] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-09T18:50:15.589809] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:50:15.996724] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-09T18:50:16.327244] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T18:50:16.796795] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-09T18:50:17.601832] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-09T18:50:17.620361] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:50:18.159804] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T18:50:18.398399] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-09T18:50:18.403118] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T18:50:19.196695] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-09T18:50:19.252477] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T18:50:19.996776] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-09T18:50:20.471876] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T18:50:20.473639] [INFO ] [REMOTE ] EVF: Full fetch complete (12696 records). [2025-10-09T18:50:20.473751] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-09T18:50:20.801795] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-09T18:50:20.844774] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-09T18:50:20.844856] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-09T18:50:20.845227] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-09T18:50:20.845265] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-09T18:50:20.845918] [DEBUG] [LOCAL ] EVF: Trimmed 12696 records to 9843 (keeping 200 days of data) [2025-10-09T18:50:20.902947] [DEBUG] [LOCAL ] EVF: Primary data saved (9843 records). [2025-10-09T18:50:20.903079] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-09T18:50:20.903164] [INFO ] [MAIN ] Update Progress: 789/2373 symbols completed. EVF took 40.0s. Estimated remaining: 3h 41m 25s. Rate: 7.2 symbols/min [2025-10-09T18:50:21.070700] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:21.105906] [DEBUG] [LOCAL ] EVR: Loaded 34583 existing records from primary storage. [2025-10-09T18:50:21.106248] [INFO ] [MAIN ] EVR: Loaded 34583 existing records. [2025-10-09T18:50:21.287264] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:21.287477] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-09T18:50:21.287524] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-09T18:50:21.288673] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-09T18:50:21.288735] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-09T18:50:21.600125] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-09T18:50:21.671563] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:21.699824] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T18:50:22.396710] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-09T18:50:22.472244] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:50:22.512445] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T18:50:23.196715] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-09T18:50:23.510878] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T18:50:23.996724] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-09T18:50:24.796695] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-09T18:50:24.863078] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T18:50:25.596726] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-09T18:50:25.626136] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T18:50:25.630477] [INFO ] [REMOTE ] EVEX: Full fetch complete (42778 records). [2025-10-09T18:50:25.630609] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-09T18:50:26.006509] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-09T18:50:26.006667] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-09T18:50:26.007332] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-09T18:50:26.007376] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-09T18:50:26.008414] [DEBUG] [LOCAL ] EVEX: Trimmed 42778 records to 31707 (keeping 200 days of data) [2025-10-09T18:50:26.129193] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T18:50:26.152839] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T18:50:26.249509] [DEBUG] [LOCAL ] EVEX: Primary data saved (31707 records). [2025-10-09T18:50:26.249671] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-09T18:50:26.250805] [INFO ] [MAIN ] Update Progress: 790/2373 symbols completed. EVEX took 46.8s. Estimated remaining: 3h 41m 11s. Rate: 7.2 symbols/min [2025-10-09T18:50:26.401821] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-09T18:50:26.461405] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:26.480758] [DEBUG] [LOCAL ] EVT: Loaded 16893 existing records from primary storage. [2025-10-09T18:50:26.481024] [INFO ] [MAIN ] EVT: Loaded 16893 existing records. [2025-10-09T18:50:26.668575] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:26.668829] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-09T18:50:26.668881] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-09T18:50:26.669434] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-09T18:50:26.669543] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-09T18:50:27.037746] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:27.196731] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-09T18:50:27.206776] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T18:50:27.996704] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-09T18:50:28.054923] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T18:50:28.673627] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T18:50:28.796726] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-09T18:50:29.596795] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-09T18:50:30.293151] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T18:50:30.396753] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-09T18:50:30.865774] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T18:50:31.196711] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-09T18:50:31.243838] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T18:50:31.996758] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-09T18:50:32.227987] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T18:50:32.796685] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-09T18:50:32.916958] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T18:50:32.918841] [INFO ] [REMOTE ] EVN: Full fetch complete (17622 records). [2025-10-09T18:50:32.918912] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-09T18:50:33.291636] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-09T18:50:33.291741] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-09T18:50:33.292128] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-09T18:50:33.292168] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-09T18:50:33.292696] [DEBUG] [LOCAL ] EVN: Trimmed 17622 records to 11172 (keeping 200 days of data) [2025-10-09T18:50:33.359218] [DEBUG] [LOCAL ] EVN: Primary data saved (11172 records). [2025-10-09T18:50:33.359353] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-09T18:50:33.359437] [INFO ] [MAIN ] Update Progress: 791/2373 symbols completed. EVN took 27.5s. Estimated remaining: 3h 40m 60s. Rate: 7.2 symbols/min [2025-10-09T18:50:33.529053] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:33.540552] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T18:50:33.569036] [DEBUG] [LOCAL ] EVTC: Loaded 26384 existing records from primary storage. [2025-10-09T18:50:33.569326] [INFO ] [MAIN ] EVTC: Loaded 26384 existing records. [2025-10-09T18:50:33.601984] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-09T18:50:33.751008] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:33.751236] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-09T18:50:33.751284] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-09T18:50:33.752113] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-09T18:50:33.752174] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-09T18:50:34.095758] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:34.396703] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-09T18:50:35.196677] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-09T18:50:35.300621] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T18:50:35.360453] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T18:50:35.982763] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T18:50:35.996674] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-09T18:50:36.796738] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-09T18:50:36.912727] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T18:50:37.596687] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-09T18:50:37.914599] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T18:50:38.396753] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-09T18:50:38.988537] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:50:38.992861] [INFO ] [REMOTE ] EVH: Full fetch complete (71745 records). [2025-10-09T18:50:38.992971] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-09T18:50:39.204110] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-09T18:50:39.323352] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T18:50:39.421328] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-09T18:50:39.421404] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-09T18:50:39.422297] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-09T18:50:39.422365] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-09T18:50:39.423875] [DEBUG] [LOCAL ] EVH: Trimmed 71745 records to 49927 (keeping 200 days of data) [2025-10-09T18:50:39.708699] [DEBUG] [LOCAL ] EVH: Primary data saved (49927 records). [2025-10-09T18:50:39.708842] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-09T18:50:39.708928] [INFO ] [MAIN ] Update Progress: 792/2373 symbols completed. EVH took 45.8s. Estimated remaining: 3h 40m 47s. Rate: 7.2 symbols/min [2025-10-09T18:50:39.875086] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:39.909954] [DEBUG] [LOCAL ] EVTL: Loaded 39239 existing records from primary storage. [2025-10-09T18:50:39.910253] [INFO ] [MAIN ] EVTL: Loaded 39239 existing records. [2025-10-09T18:50:40.002798] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-09T18:50:40.091439] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:40.091688] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-09T18:50:40.091747] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-09T18:50:40.092779] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-09T18:50:40.092839] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-09T18:50:40.453991] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:40.491637] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T18:50:40.796684] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-09T18:50:41.117128] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T18:50:41.596720] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-09T18:50:42.396685] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-09T18:50:42.430400] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T18:50:42.944551] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T18:50:43.196708] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-09T18:50:43.633763] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T18:50:43.996699] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-09T18:50:44.133700] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T18:50:44.595747] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T18:50:44.796722] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-09T18:50:45.596724] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-09T18:50:45.866789] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T18:50:46.401766] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-09T18:50:46.411846] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T18:50:47.196718] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-09T18:50:47.982090] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T18:50:48.006383] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-09T18:50:48.008960] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T18:50:48.796781] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-09T18:50:49.502269] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T18:50:49.596703] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-09T18:50:49.726141] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T18:50:50.396730] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-09T18:50:50.692138] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:50:51.196747] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-09T18:50:51.335822] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T18:50:51.996726] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-09T18:50:52.411312] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:50:52.741251] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T18:50:52.796700] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-09T18:50:53.596714] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-09T18:50:53.934960] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T18:50:54.396762] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-09T18:50:54.859070] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T18:50:55.196777] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-09T18:50:55.988570] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T18:50:55.996779] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-09T18:50:56.583043] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T18:50:56.796728] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-09T18:50:57.123391] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:50:57.596697] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-09T18:50:57.939601] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T18:50:58.396770] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-09T18:50:59.196778] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-09T18:50:59.265670] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:50:59.559352] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:50:59.562207] [INFO ] [REMOTE ] EVTC: Full fetch complete (38100 records). [2025-10-09T18:50:59.562296] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-09T18:50:59.935524] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-09T18:50:59.935710] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-09T18:50:59.936422] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-09T18:50:59.936514] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-09T18:50:59.937595] [DEBUG] [LOCAL ] EVTC: Trimmed 38100 records to 26578 (keeping 200 days of data) [2025-10-09T18:50:59.997520] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-09T18:51:00.109311] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T18:51:00.124969] [DEBUG] [LOCAL ] EVTC: Primary data saved (26578 records). [2025-10-09T18:51:00.125064] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-09T18:51:00.125139] [INFO ] [MAIN ] Update Progress: 793/2373 symbols completed. EVTC took 26.8s. Estimated remaining: 3h 41m 3s. Rate: 7.1 symbols/min [2025-10-09T18:51:00.293066] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:00.315781] [DEBUG] [LOCAL ] EVTR: Loaded 24255 existing records from primary storage. [2025-10-09T18:51:00.316035] [INFO ] [MAIN ] EVTR: Loaded 24255 existing records. [2025-10-09T18:51:00.497077] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:00.497314] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-09T18:51:00.497362] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-09T18:51:00.498313] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-09T18:51:00.498373] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-09T18:51:00.801975] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-09T18:51:00.859833] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:01.277591] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T18:51:01.596728] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-09T18:51:01.766694] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T18:51:01.768905] [INFO ] [REMOTE ] EVT: Full fetch complete (25196 records). [2025-10-09T18:51:01.768986] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-09T18:51:02.144761] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-09T18:51:02.144849] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-09T18:51:02.145334] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-09T18:51:02.145373] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-09T18:51:02.146124] [DEBUG] [LOCAL ] EVT: Trimmed 25196 records to 16976 (keeping 200 days of data) [2025-10-09T18:51:02.259368] [DEBUG] [LOCAL ] EVT: Primary data saved (16976 records). [2025-10-09T18:51:02.259524] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-09T18:51:02.259611] [INFO ] [MAIN ] Update Progress: 794/2373 symbols completed. EVT took 36.0s. Estimated remaining: 3h 40m 42s. Rate: 7.2 symbols/min [2025-10-09T18:51:02.405738] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-09T18:51:02.440257] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:02.500999] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-09T18:51:02.501447] [INFO ] [MAIN ] EW: Loaded 53402 existing records. [2025-10-09T18:51:02.696900] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:02.697232] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-09T18:51:02.697296] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-09T18:51:02.698613] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-09T18:51:02.698703] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-09T18:51:02.988492] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:51:03.023342] [INFO ] [REMOTE ] EVR: Full fetch complete (50650 records). [2025-10-09T18:51:03.052741] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-09T18:51:03.091125] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:03.201881] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-09T18:51:03.537007] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-09T18:51:03.537522] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T18:51:03.537599] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-09T18:51:03.542602] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-09T18:51:03.543246] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-09T18:51:03.544418] [DEBUG] [LOCAL ] EVR: Trimmed 50650 records to 34827 (keeping 200 days of data) [2025-10-09T18:51:03.774059] [DEBUG] [LOCAL ] EVR: Primary data saved (34827 records). [2025-10-09T18:51:03.774216] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-09T18:51:03.774302] [INFO ] [MAIN ] Update Progress: 795/2373 symbols completed. EVR took 42.9s. Estimated remaining: 3h 40m 20s. Rate: 7.2 symbols/min [2025-10-09T18:51:03.946306] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:03.984858] [DEBUG] [LOCAL ] EXG: Loaded 34256 existing records from primary storage. [2025-10-09T18:51:03.985134] [INFO ] [MAIN ] EXG: Loaded 34256 existing records. [2025-10-09T18:51:04.005912] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-09T18:51:04.168021] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:04.168244] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-09T18:51:04.168298] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-09T18:51:04.169346] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-09T18:51:04.169405] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-09T18:51:04.533051] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:04.796698] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-09T18:51:05.023762] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T18:51:05.201684] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T18:51:05.596723] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-09T18:51:06.176533] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:51:06.396822] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-09T18:51:06.677661] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:51:07.196786] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-09T18:51:07.996720] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-09T18:51:08.095843] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T18:51:08.183182] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T18:51:08.796731] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-09T18:51:09.339182] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T18:51:09.596690] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-09T18:51:09.836805] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T18:51:10.396717] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-09T18:51:10.969621] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T18:51:11.196707] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-09T18:51:11.472116] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T18:51:11.996727] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-09T18:51:12.796697] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-09T18:51:12.872489] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T18:51:13.596705] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-09T18:51:13.644759] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T18:51:13.671396] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T18:51:14.396784] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-09T18:51:15.196697] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-09T18:51:15.549521] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-09T18:51:15.553902] [INFO ] [REMOTE ] EVTL: Full fetch complete (53545 records). [2025-10-09T18:51:15.554006] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-09T18:51:15.936465] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-09T18:51:15.936572] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-09T18:51:15.937373] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-09T18:51:15.937474] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-09T18:51:15.938990] [DEBUG] [LOCAL ] EVTL: Trimmed 53545 records to 39616 (keeping 200 days of data) [2025-10-09T18:51:16.020270] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-09T18:51:16.056099] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:51:16.210043] [DEBUG] [LOCAL ] EVTL: Primary data saved (39616 records). [2025-10-09T18:51:16.210189] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-09T18:51:16.210272] [INFO ] [MAIN ] Update Progress: 796/2373 symbols completed. EVTL took 36.5s. Estimated remaining: 3h 40m 20s. Rate: 7.2 symbols/min [2025-10-09T18:51:16.387666] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:16.400982] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:51:16.454312] [DEBUG] [LOCAL ] EXK: Loaded 53142 existing records from primary storage. [2025-10-09T18:51:16.454621] [INFO ] [MAIN ] EXK: Loaded 53142 existing records. [2025-10-09T18:51:16.630289] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:16.630520] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-09T18:51:16.630567] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-09T18:51:16.631803] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-09T18:51:16.631862] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-09T18:51:16.803784] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-09T18:51:16.999176] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:17.322332] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T18:51:17.596754] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-09T18:51:17.810818] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T18:51:18.396733] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-09T18:51:19.178549] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T18:51:19.196663] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-09T18:51:19.704472] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:51:19.996730] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-09T18:51:20.793479] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T18:51:20.803064] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-09T18:51:21.596686] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-09T18:51:21.796677] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:51:21.816521] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T18:51:21.819729] [INFO ] [REMOTE ] EVTR: Full fetch complete (32912 records). [2025-10-09T18:51:21.819848] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-09T18:51:22.204085] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-09T18:51:22.204258] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-09T18:51:22.204931] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-09T18:51:22.204994] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-09T18:51:22.205813] [DEBUG] [LOCAL ] EVTR: Trimmed 32912 records to 24504 (keeping 200 days of data) [2025-10-09T18:51:22.365448] [DEBUG] [LOCAL ] EVTR: Primary data saved (24504 records). [2025-10-09T18:51:22.365595] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-09T18:51:22.365748] [INFO ] [MAIN ] Update Progress: 797/2373 symbols completed. EVTR took 22.2s. Estimated remaining: 3h 40m 7s. Rate: 7.2 symbols/min [2025-10-09T18:51:22.396703] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-09T18:51:23.206971] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-09T18:51:23.209554] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T18:51:23.673584] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:51:23.996728] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-09T18:51:24.796706] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-09T18:51:25.032598] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T18:51:25.596725] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-09T18:51:26.348854] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-09T18:51:26.396774] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-09T18:51:26.599670] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T18:51:26.957952] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:51:27.196751] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-09T18:51:27.407563] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T18:51:27.996859] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-09T18:51:28.622888] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T18:51:28.796766] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-09T18:51:28.938241] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T18:51:29.596705] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-09T18:51:30.396706] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-09T18:51:30.626534] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T18:51:31.086381] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T18:51:31.196739] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-09T18:51:31.423877] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T18:51:31.996767] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-09T18:51:32.801453] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-09T18:51:32.806991] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T18:51:33.596790] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-09T18:51:33.793574] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T18:51:33.826150] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T18:51:34.396764] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-09T18:51:35.196689] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-09T18:51:35.316042] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:51:35.669724] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T18:51:35.996733] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-09T18:51:36.796762] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-09T18:51:36.928700] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-09T18:51:36.933276] [INFO ] [REMOTE ] EW: Full fetch complete (77352 records). [2025-10-09T18:51:36.933403] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-09T18:51:37.321777] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-09T18:51:37.321860] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-09T18:51:37.322817] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-09T18:51:37.322883] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-09T18:51:37.324398] [DEBUG] [LOCAL ] EW: Trimmed 77352 records to 53791 (keeping 200 days of data) [2025-10-09T18:51:37.587339] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:51:37.601873] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-09T18:51:37.699237] [DEBUG] [LOCAL ] EW: Primary data saved (53791 records). [2025-10-09T18:51:37.699400] [INFO ] [MAIN ] EW: Full history saved. [2025-10-09T18:51:37.700621] [INFO ] [MAIN ] Update Progress: 798/2373 symbols completed. EW took 35.4s. Estimated remaining: 3h 40m 12s. Rate: 7.2 symbols/min [2025-10-09T18:51:38.278927] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T18:51:38.396725] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-09T18:51:39.487515] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T18:51:39.499017] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-09T18:51:39.629403] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T18:51:39.632447] [INFO ] [REMOTE ] EXG: Full fetch complete (49792 records). [2025-10-09T18:51:39.632550] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-09T18:51:40.030996] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-09T18:51:40.031078] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-09T18:51:40.031908] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-09T18:51:40.031975] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-09T18:51:40.033114] [DEBUG] [LOCAL ] EXG: Trimmed 49792 records to 34445 (keeping 200 days of data) [2025-10-09T18:51:40.243539] [DEBUG] [LOCAL ] EXG: Primary data saved (34445 records). [2025-10-09T18:51:40.243719] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-09T18:51:40.243824] [INFO ] [MAIN ] Update Progress: 799/2373 symbols completed. EXG took 36.5s. Estimated remaining: 3h 39m 52s. Rate: 7.2 symbols/min [2025-10-09T18:51:41.508667] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-09T18:51:41.520354] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-09T18:51:43.199587] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:51:43.204098] [INFO ] [REMOTE ] EXK: Full fetch complete (76585 records). [2025-10-09T18:51:43.204207] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-09T18:51:43.598850] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-09T18:51:43.598932] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-09T18:51:43.599875] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-09T18:51:43.599939] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-09T18:51:43.601346] [DEBUG] [LOCAL ] EXK: Trimmed 76585 records to 53532 (keeping 200 days of data) [2025-10-09T18:51:43.909424] [DEBUG] [LOCAL ] EXK: Primary data saved (53532 records). [2025-10-09T18:51:43.909562] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-09T18:51:43.909668] [INFO ] [MAIN ] Update Progress: 800/2373 symbols completed. EXK took 27.7s. Estimated remaining: 3h 39m 35s. Rate: 7.2 symbols/min [2025-10-09T18:51:44.589686] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:44.640095] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:44.690358] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:44.686381] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:44.746892] [DEBUG] [LOCAL ] EXP: Loaded 29620 existing records from primary storage. [2025-10-09T18:51:44.747270] [INFO ] [MAIN ] EXP: Loaded 29620 existing records. [2025-10-09T18:51:44.864157] [DEBUG] [LOCAL ] EXR: Loaded 45251 existing records from primary storage. [2025-10-09T18:51:44.895402] [INFO ] [MAIN ] EXR: Loaded 45251 existing records. [2025-10-09T18:51:44.912148] [DEBUG] [LOCAL ] EXPD: Loaded 47841 existing records from primary storage. [2025-10-09T18:51:44.991839] [INFO ] [MAIN ] EXPD: Loaded 47841 existing records. [2025-10-09T18:51:45.147617] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-09T18:51:45.146327] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:45.172148] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-09T18:51:45.187882] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-09T18:51:45.218722] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-09T18:51:45.348034] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-09T18:51:45.406735] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-09T18:51:45.401721] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:45.497499] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-09T18:51:45.544417] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-09T18:51:45.552898] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:45.605536] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-09T18:51:45.574952] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-09T18:51:45.616106] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-09T18:51:45.634177] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-09T18:51:45.639410] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-09T18:51:45.728136] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-09T18:51:45.816198] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:45.923070] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-09T18:51:45.983349] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-09T18:51:46.055588] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-09T18:51:46.072400] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-09T18:51:46.593218] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:46.656888] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-09T18:51:46.984099] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:47.011841] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:47.029091] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-09T18:51:47.023123] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-09T18:51:47.121341] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:47.121701] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-09T18:51:48.188490] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:51:48.194950] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-09T18:51:48.374917] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T18:51:48.384464] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-09T18:51:48.597247] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T18:51:48.606136] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-09T18:51:49.164287] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T18:51:49.175528] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-09T18:51:49.308018] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T18:51:49.314995] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-09T18:51:49.619523] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T18:51:49.628963] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-09T18:51:50.229486] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:51:50.239359] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-09T18:51:50.268960] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T18:51:50.275043] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-09T18:51:51.242796] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-09T18:51:51.253471] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-09T18:51:51.307008] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T18:51:51.317038] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-09T18:51:51.548545] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:51:51.796979] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T18:51:51.996695] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-09T18:51:52.766800] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T18:51:52.796695] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-09T18:51:52.899704] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T18:51:53.036347] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T18:51:53.596732] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-09T18:51:54.174216] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:51:54.396754] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-09T18:51:54.672606] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T18:51:55.196740] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-09T18:51:55.996682] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-09T18:51:56.159475] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:51:56.192437] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T18:51:56.796699] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-09T18:51:57.596732] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-09T18:51:58.240798] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T18:51:58.396745] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-09T18:51:58.465814] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-09T18:51:59.200399] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-09T18:51:59.208981] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T18:51:59.606614] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T18:51:59.996713] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-09T18:52:00.403345] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T18:52:00.796775] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-09T18:52:01.595124] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T18:52:01.604633] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-09T18:52:02.396771] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-09T18:52:02.988262] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:52:03.050318] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T18:52:03.196683] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-09T18:52:03.696162] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T18:52:03.996722] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-09T18:52:04.796768] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-09T18:52:04.840225] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T18:52:05.114066] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T18:52:05.116757] [INFO ] [REMOTE ] EXP: Full fetch complete (42798 records). [2025-10-09T18:52:05.116878] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-09T18:52:05.567125] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-09T18:52:05.567213] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-09T18:52:05.568074] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-09T18:52:05.568141] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-09T18:52:05.569412] [DEBUG] [LOCAL ] EXP: Trimmed 42798 records to 29811 (keeping 200 days of data) [2025-10-09T18:52:05.627753] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-09T18:52:05.761766] [DEBUG] [LOCAL ] EXP: Primary data saved (29811 records). [2025-10-09T18:52:05.761874] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-09T18:52:05.761958] [INFO ] [MAIN ] Update Progress: 801/2373 symbols completed. EXP took 21.8s. Estimated remaining: 3h 39m 53s. Rate: 7.1 symbols/min [2025-10-09T18:52:05.930872] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:05.968346] [DEBUG] [LOCAL ] FAF: Loaded 41546 existing records from primary storage. [2025-10-09T18:52:05.968693] [INFO ] [MAIN ] FAF: Loaded 41546 existing records. [2025-10-09T18:52:06.143611] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:06.143854] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-09T18:52:06.143899] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-09T18:52:06.144230] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-09T18:52:06.144287] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-09T18:52:06.411081] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-09T18:52:06.515966] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:07.196701] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-09T18:52:07.289431] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T18:52:07.405082] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-09T18:52:07.859406] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:52:07.996717] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-09T18:52:08.633745] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T18:52:08.796692] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-09T18:52:09.596844] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-09T18:52:10.098361] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T18:52:10.380812] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-09T18:52:10.396677] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-09T18:52:10.792328] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T18:52:10.796505] [INFO ] [REMOTE ] EXPD: Full fetch complete (69307 records). [2025-10-09T18:52:10.796635] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-09T18:52:11.202618] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-09T18:52:11.203348] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-09T18:52:11.203424] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-09T18:52:11.204357] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-09T18:52:11.205409] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-09T18:52:11.206963] [DEBUG] [LOCAL ] EXPD: Trimmed 69307 records to 48219 (keeping 200 days of data) [2025-10-09T18:52:11.506428] [DEBUG] [LOCAL ] EXPD: Primary data saved (48219 records). [2025-10-09T18:52:11.506582] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-09T18:52:11.506787] [INFO ] [MAIN ] Update Progress: 802/2373 symbols completed. EXPD took 27.6s. Estimated remaining: 3h 39m 39s. Rate: 7.2 symbols/min [2025-10-09T18:52:11.681373] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:11.727893] [DEBUG] [LOCAL ] FBIN: Loaded 50379 existing records from primary storage. [2025-10-09T18:52:11.728250] [INFO ] [MAIN ] FBIN: Loaded 50379 existing records. [2025-10-09T18:52:11.911987] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:11.912202] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-09T18:52:11.912249] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-09T18:52:11.912681] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-09T18:52:11.912745] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-09T18:52:12.011698] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-09T18:52:12.293451] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:12.400533] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T18:52:12.796720] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-09T18:52:12.984323] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-09T18:52:13.272077] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T18:52:13.596731] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-09T18:52:13.867430] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T18:52:14.396720] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-09T18:52:15.196718] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-09T18:52:15.996757] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-09T18:52:16.070496] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-09T18:52:16.120367] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T18:52:16.796743] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-09T18:52:16.852076] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T18:52:17.579561] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:52:17.596724] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-09T18:52:18.396711] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-09T18:52:18.669844] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T18:52:19.113748] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T18:52:19.196716] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-09T18:52:19.996691] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-09T18:52:20.098453] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T18:52:20.588112] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T18:52:20.796728] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-09T18:52:21.596697] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-09T18:52:21.641408] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T18:52:22.121217] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T18:52:22.396729] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-09T18:52:23.196719] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-09T18:52:23.786420] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-09T18:52:23.791958] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-09T18:52:23.792150] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-09T18:52:23.999131] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-09T18:52:24.305069] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:52:24.305397] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-09T18:52:24.314791] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-09T18:52:24.316526] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-09T18:52:24.317035] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-09T18:52:24.318509] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-10-09T18:52:24.459772] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T18:52:24.697118] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-10-09T18:52:24.697264] [INFO ] [MAIN ] F: Full history saved. [2025-10-09T18:52:24.697371] [INFO ] [MAIN ] Update Progress: 803/2373 symbols completed. F took 40.8s. Estimated remaining: 3h 39m 40s. Rate: 7.1 symbols/min [2025-10-09T18:52:24.801825] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-09T18:52:24.867427] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:24.896801] [DEBUG] [LOCAL ] FBK: Loaded 26718 existing records from primary storage. [2025-10-09T18:52:24.897084] [INFO ] [MAIN ] FBK: Loaded 26718 existing records. [2025-10-09T18:52:25.074340] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:25.074689] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-09T18:52:25.074757] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-09T18:52:25.075134] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-09T18:52:25.075192] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-09T18:52:25.433940] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:25.460130] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T18:52:25.596685] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-09T18:52:26.396758] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-09T18:52:26.546173] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T18:52:26.592356] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T18:52:27.196725] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-09T18:52:27.659184] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T18:52:27.663636] [INFO ] [REMOTE ] EXR: Full fetch complete (65898 records). [2025-10-09T18:52:27.663828] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-09T18:52:28.003577] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-09T18:52:28.078324] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:52:28.078703] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-09T18:52:28.082727] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-09T18:52:28.084750] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-09T18:52:28.084820] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-09T18:52:28.086150] [DEBUG] [LOCAL ] EXR: Trimmed 65898 records to 45561 (keeping 200 days of data) [2025-10-09T18:52:28.376514] [DEBUG] [LOCAL ] EXR: Primary data saved (45561 records). [2025-10-09T18:52:28.376714] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-09T18:52:28.376819] [INFO ] [MAIN ] Update Progress: 804/2373 symbols completed. EXR took 44.4s. Estimated remaining: 3h 39m 22s. Rate: 7.2 symbols/min [2025-10-09T18:52:28.548717] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:28.593212] [DEBUG] [LOCAL ] FBP: Loaded 45763 existing records from primary storage. [2025-10-09T18:52:28.593541] [INFO ] [MAIN ] FBP: Loaded 45763 existing records. [2025-10-09T18:52:28.768117] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:28.768319] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-09T18:52:28.768366] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-09T18:52:28.768612] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-09T18:52:28.768707] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-09T18:52:28.801986] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-09T18:52:29.122452] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:29.452721] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T18:52:29.596708] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-09T18:52:29.968564] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:52:30.396720] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-09T18:52:31.196693] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-09T18:52:31.234803] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T18:52:31.370371] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T18:52:31.996731] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-09T18:52:32.796708] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-09T18:52:32.849222] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T18:52:32.852979] [INFO ] [REMOTE ] FAF: Full fetch complete (57718 records). [2025-10-09T18:52:32.853089] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-09T18:52:33.192912] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T18:52:33.272506] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-09T18:52:33.272605] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-09T18:52:33.273493] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-09T18:52:33.274268] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-09T18:52:33.275451] [DEBUG] [LOCAL ] FAF: Trimmed 57718 records to 41815 (keeping 200 days of data) [2025-10-09T18:52:33.537391] [DEBUG] [LOCAL ] FAF: Primary data saved (41815 records). [2025-10-09T18:52:33.537526] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-09T18:52:33.538422] [INFO ] [MAIN ] Update Progress: 805/2373 symbols completed. FAF took 27.8s. Estimated remaining: 3h 39m 8s. Rate: 7.2 symbols/min [2025-10-09T18:52:33.601824] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-09T18:52:33.706591] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:33.746879] [DEBUG] [LOCAL ] FBRT: Loaded 35080 existing records from primary storage. [2025-10-09T18:52:33.747167] [INFO ] [MAIN ] FBRT: Loaded 35080 existing records. [2025-10-09T18:52:33.919110] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:33.919357] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-09T18:52:33.919423] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-09T18:52:33.919808] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-09T18:52:33.919866] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-09T18:52:34.268176] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:34.396810] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-09T18:52:35.156851] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T18:52:35.196691] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-09T18:52:35.355735] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T18:52:35.996699] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-09T18:52:36.554452] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T18:52:36.796790] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-09T18:52:37.448389] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T18:52:37.491345] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (4.69 seconds). [2025-10-09T18:52:37.520442] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T18:52:37.596729] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-09T18:52:38.396747] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-09T18:52:38.833629] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T18:52:39.196759] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-09T18:52:39.967816] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T18:52:39.996668] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-09T18:52:40.186085] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T18:52:40.796733] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-09T18:52:41.358544] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T18:52:41.596742] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-09T18:52:42.252393] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T18:52:42.396679] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-09T18:52:42.849619] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T18:52:43.196724] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-09T18:52:43.760333] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:52:43.764489] [INFO ] [REMOTE ] FBIN: Full fetch complete (72726 records). [2025-10-09T18:52:43.764612] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-09T18:52:44.002956] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-09T18:52:44.163937] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-09T18:52:44.164030] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-09T18:52:44.165003] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-09T18:52:44.165066] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-09T18:52:44.166480] [DEBUG] [LOCAL ] FBIN: Trimmed 72726 records to 50714 (keeping 200 days of data) [2025-10-09T18:52:44.473577] [DEBUG] [LOCAL ] FBIN: Primary data saved (50714 records). [2025-10-09T18:52:44.473747] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-09T18:52:44.474565] [INFO ] [MAIN ] Update Progress: 806/2373 symbols completed. FBIN took 33.0s. Estimated remaining: 3h 39m 4s. Rate: 7.2 symbols/min [2025-10-09T18:52:44.610177] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T18:52:44.683919] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:44.702190] [DEBUG] [LOCAL ] FC: Loaded 15157 existing records from primary storage. [2025-10-09T18:52:44.702435] [INFO ] [MAIN ] FC: Loaded 15157 existing records. [2025-10-09T18:52:44.801867] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-09T18:52:44.882084] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:44.882301] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-09T18:52:44.882347] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-09T18:52:44.882532] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-09T18:52:44.882589] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-09T18:52:45.250383] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:45.343475] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T18:52:45.596742] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-09T18:52:46.106511] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T18:52:46.396716] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-09T18:52:46.655738] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T18:52:47.196750] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-09T18:52:47.754574] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T18:52:47.826591] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:52:47.996741] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-09T18:52:48.796798] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-09T18:52:49.584090] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T18:52:49.596721] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-09T18:52:49.702079] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T18:52:50.396762] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-09T18:52:50.476274] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T18:52:50.480204] [INFO ] [REMOTE ] FBK: Full fetch complete (34279 records). [2025-10-09T18:52:50.480363] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-09T18:52:50.959475] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-09T18:52:50.959607] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-09T18:52:50.960798] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-09T18:52:50.960891] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-09T18:52:50.962532] [DEBUG] [LOCAL ] FBK: Trimmed 34279 records to 26942 (keeping 200 days of data) [2025-10-09T18:52:51.201301] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-09T18:52:51.213335] [DEBUG] [LOCAL ] FBK: Primary data saved (26942 records). [2025-10-09T18:52:51.213605] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-09T18:52:51.213767] [INFO ] [MAIN ] Update Progress: 807/2373 symbols completed. FBK took 26.5s. Estimated remaining: 3h 38m 53s. Rate: 7.2 symbols/min [2025-10-09T18:52:51.470571] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:51.528838] [DEBUG] [LOCAL ] FCF: Loaded 39188 existing records from primary storage. [2025-10-09T18:52:51.529267] [INFO ] [MAIN ] FCF: Loaded 39188 existing records. [2025-10-09T18:52:51.803937] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:51.804247] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-09T18:52:51.804477] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-09T18:52:51.804971] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-09T18:52:51.805048] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-09T18:52:51.998855] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-09T18:52:52.131849] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:52:52.235095] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T18:52:52.234589] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:52.796773] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-09T18:52:53.450106] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:52:53.596729] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-09T18:52:54.038030] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:52:54.396729] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-09T18:52:54.909470] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:52:55.196727] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-09T18:52:55.532976] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T18:52:55.996752] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-09T18:52:56.315913] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T18:52:56.796801] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-09T18:52:57.453755] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T18:52:57.596714] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-09T18:52:57.633622] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T18:52:58.396747] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-09T18:52:58.953870] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:52:59.196747] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-09T18:52:59.406997] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:52:59.996761] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-09T18:53:00.435032] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:53:00.796774] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-09T18:53:01.388277] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:53:01.596780] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-09T18:53:01.952968] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T18:53:02.396748] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-09T18:53:02.700997] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T18:53:03.196700] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-09T18:53:03.996697] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-09T18:53:04.066731] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T18:53:04.337674] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T18:53:04.796736] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-09T18:53:05.301062] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:53:05.596732] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-09T18:53:06.154233] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:53:06.157878] [INFO ] [REMOTE ] FBRT: Full fetch complete (49269 records). [2025-10-09T18:53:06.157957] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-09T18:53:06.405909] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-09T18:53:06.493831] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T18:53:06.588069] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-09T18:53:06.588152] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-09T18:53:06.589031] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-09T18:53:06.589097] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-09T18:53:06.590333] [DEBUG] [LOCAL ] FBRT: Trimmed 49269 records to 35372 (keeping 200 days of data) [2025-10-09T18:53:06.808661] [DEBUG] [LOCAL ] FBRT: Primary data saved (35372 records). [2025-10-09T18:53:06.808815] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-09T18:53:06.809363] [INFO ] [MAIN ] Update Progress: 808/2373 symbols completed. FBRT took 33.3s. Estimated remaining: 3h 38m 58s. Rate: 7.1 symbols/min [2025-10-09T18:53:06.977329] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:07.007575] [DEBUG] [LOCAL ] FCN: Loaded 26003 existing records from primary storage. [2025-10-09T18:53:07.007895] [INFO ] [MAIN ] FCN: Loaded 26003 existing records. [2025-10-09T18:53:07.182167] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:07.182359] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-09T18:53:07.182405] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-09T18:53:07.182703] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-09T18:53:07.182760] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-09T18:53:07.202785] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-09T18:53:07.538873] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:07.996699] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-09T18:53:08.050523] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T18:53:08.353791] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T18:53:08.796721] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-09T18:53:09.189889] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:53:09.596775] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-09T18:53:10.113057] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T18:53:10.132307] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T18:53:10.396715] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-09T18:53:11.196734] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-09T18:53:11.496774] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T18:53:11.996725] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-09T18:53:12.547828] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:53:12.796716] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-09T18:53:13.193862] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T18:53:13.596686] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-09T18:53:13.833141] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:53:14.396754] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-09T18:53:14.830490] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:53:15.196768] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-09T18:53:15.932973] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T18:53:15.936890] [INFO ] [REMOTE ] FBP: Full fetch complete (66373 records). [2025-10-09T18:53:15.936995] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-09T18:53:16.006904] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-09T18:53:16.348587] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-09T18:53:16.348763] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-09T18:53:16.349842] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-09T18:53:16.349908] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-09T18:53:16.351318] [DEBUG] [LOCAL ] FBP: Trimmed 66373 records to 46095 (keeping 200 days of data) [2025-10-09T18:53:16.637523] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T18:53:16.667489] [DEBUG] [LOCAL ] FBP: Primary data saved (46095 records). [2025-10-09T18:53:16.667660] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-09T18:53:16.667759] [INFO ] [MAIN ] Update Progress: 809/2373 symbols completed. FBP took 48.3s. Estimated remaining: 3h 38m 53s. Rate: 7.1 symbols/min [2025-10-09T18:53:16.801773] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-09T18:53:16.845960] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:16.882855] [DEBUG] [LOCAL ] FCPT: Loaded 37317 existing records from primary storage. [2025-10-09T18:53:16.883137] [INFO ] [MAIN ] FCPT: Loaded 37317 existing records. [2025-10-09T18:53:17.080234] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:17.080569] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-09T18:53:17.080742] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-09T18:53:17.080987] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-09T18:53:17.081044] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-09T18:53:17.418796] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:53:17.467887] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:17.596719] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-09T18:53:17.900914] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T18:53:18.396686] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-09T18:53:18.822026] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T18:53:19.078115] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T18:53:19.196680] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-09T18:53:19.996750] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-09T18:53:20.017128] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T18:53:20.018768] [INFO ] [REMOTE ] FC: Full fetch complete (21758 records). [2025-10-09T18:53:20.018841] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-09T18:53:20.395581] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-09T18:53:20.395702] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-09T18:53:20.396273] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-09T18:53:20.396336] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-09T18:53:20.396982] [DEBUG] [LOCAL ] FC: Trimmed 21758 records to 15218 (keeping 200 days of data) [2025-10-09T18:53:20.490100] [DEBUG] [LOCAL ] FC: Primary data saved (15218 records). [2025-10-09T18:53:20.490248] [INFO ] [MAIN ] FC: Full history saved. [2025-10-09T18:53:20.490338] [INFO ] [MAIN ] Update Progress: 810/2373 symbols completed. FC took 36.0s. Estimated remaining: 3h 38m 36s. Rate: 7.2 symbols/min [2025-10-09T18:53:20.664236] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:20.664395] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-09T18:53:20.664433] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-09T18:53:20.664547] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-09T18:53:20.664590] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-09T18:53:20.664634] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-09T18:53:20.664708] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-09T18:53:20.806966] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-09T18:53:21.035325] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:21.322188] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T18:53:21.596722] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-09T18:53:22.182294] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:53:22.396703] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-09T18:53:22.868191] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T18:53:23.196734] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-09T18:53:23.501994] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T18:53:23.505491] [INFO ] [REMOTE ] FCF: Full fetch complete (58041 records). [2025-10-09T18:53:23.505638] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-09T18:53:23.894225] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-09T18:53:23.894318] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-09T18:53:23.895122] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-09T18:53:23.895191] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-09T18:53:23.896680] [DEBUG] [LOCAL ] FCF: Trimmed 58041 records to 39430 (keeping 200 days of data) [2025-10-09T18:53:23.998675] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-09T18:53:24.137974] [DEBUG] [LOCAL ] FCF: Primary data saved (39430 records). [2025-10-09T18:53:24.138109] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-09T18:53:24.138191] [INFO ] [MAIN ] Update Progress: 811/2373 symbols completed. FCF took 32.9s. Estimated remaining: 3h 38m 18s. Rate: 7.2 symbols/min [2025-10-09T18:53:24.320205] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:24.347912] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-09T18:53:24.349515] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:53:24.367359] [DEBUG] [LOCAL ] FCT: Loaded 14779 existing records from primary storage. [2025-10-09T18:53:24.367595] [INFO ] [MAIN ] FCT: Loaded 14779 existing records. [2025-10-09T18:53:24.561478] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:24.561857] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-09T18:53:24.561944] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-09T18:53:24.562180] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-09T18:53:24.562251] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-09T18:53:24.803620] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-09T18:53:24.985757] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:25.276790] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:53:25.596714] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-09T18:53:26.396778] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-09T18:53:26.814741] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-09T18:53:27.003920] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:53:27.196753] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-09T18:53:27.996761] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-09T18:53:28.638902] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:53:28.796762] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-09T18:53:29.011094] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T18:53:29.596794] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-09T18:53:29.945372] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T18:53:30.396692] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-09T18:53:30.591334] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T18:53:30.727792] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-09T18:53:31.196765] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-09T18:53:31.996785] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-09T18:53:32.417632] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T18:53:32.725248] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:53:32.796759] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-09T18:53:33.596720] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-09T18:53:33.840508] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:53:34.157039] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:53:34.396773] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-09T18:53:34.738723] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T18:53:35.196732] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-09T18:53:35.608742] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-09T18:53:35.996723] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-09T18:53:36.313275] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T18:53:36.796770] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-09T18:53:37.596746] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-09T18:53:38.009132] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T18:53:38.396742] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-09T18:53:38.991921] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T18:53:39.196690] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-09T18:53:39.252144] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T18:53:39.996722] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-09T18:53:40.581680] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T18:53:40.778028] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:53:40.796666] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-09T18:53:41.596752] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-09T18:53:41.679415] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T18:53:41.931852] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T18:53:42.396693] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-09T18:53:43.196703] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-09T18:53:43.552302] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T18:53:43.997692] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-09T18:53:44.004027] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T18:53:44.796765] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-09T18:53:45.095580] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:53:45.098163] [INFO ] [REMOTE ] FCN: Full fetch complete (35681 records). [2025-10-09T18:53:45.098242] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-09T18:53:45.467659] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-09T18:53:45.467747] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-09T18:53:45.468362] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-09T18:53:45.468418] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-09T18:53:45.469240] [DEBUG] [LOCAL ] FCN: Trimmed 35681 records to 26164 (keeping 200 days of data) [2025-10-09T18:53:45.610129] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-09T18:53:45.631987] [DEBUG] [LOCAL ] FCN: Primary data saved (26164 records). [2025-10-09T18:53:45.632103] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-09T18:53:45.632213] [INFO ] [MAIN ] Update Progress: 812/2373 symbols completed. FCN took 38.8s. Estimated remaining: 3h 38m 35s. Rate: 7.1 symbols/min [2025-10-09T18:53:45.742118] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T18:53:45.813665] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:45.862094] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-09T18:53:45.862400] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-09T18:53:46.050301] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:46.050506] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-09T18:53:46.050553] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-09T18:53:46.050825] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-09T18:53:46.050883] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-09T18:53:46.401899] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-09T18:53:46.432922] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:46.911969] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T18:53:47.051208] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T18:53:47.196697] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-09T18:53:47.996727] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-09T18:53:48.273294] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:53:48.277286] [INFO ] [REMOTE ] FCPT: Full fetch complete (53836 records). [2025-10-09T18:53:48.277390] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-09T18:53:48.705208] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-09T18:53:48.705295] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-09T18:53:48.706094] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-09T18:53:48.706166] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-09T18:53:48.707389] [DEBUG] [LOCAL ] FCPT: Trimmed 53836 records to 37591 (keeping 200 days of data) [2025-10-09T18:53:48.796992] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-09T18:53:48.931224] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T18:53:48.970175] [DEBUG] [LOCAL ] FCPT: Primary data saved (37591 records). [2025-10-09T18:53:48.970333] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-09T18:53:48.970430] [INFO ] [MAIN ] Update Progress: 813/2373 symbols completed. FCPT took 32.3s. Estimated remaining: 3h 38m 17s. Rate: 7.1 symbols/min [2025-10-09T18:53:49.137800] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:49.169405] [DEBUG] [LOCAL ] FDP: Loaded 30061 existing records from primary storage. [2025-10-09T18:53:49.169696] [INFO ] [MAIN ] FDP: Loaded 30061 existing records. [2025-10-09T18:53:49.298929] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T18:53:49.322672] [INFO ] [REMOTE ] FCRX: Full fetch complete (1669 records). [2025-10-09T18:53:49.331635] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-09T18:53:49.434589] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:49.455767] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-09T18:53:49.456191] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-09T18:53:49.495133] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-09T18:53:49.514430] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-09T18:53:49.600884] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-09T18:53:49.613261] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-09T18:53:49.636482] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:53:49.647495] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:53:49.659101] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-09T18:53:49.688535] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-09T18:53:49.693774] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-09T18:53:49.699411] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-09T18:53:49.699565] [INFO ] [MAIN ] Update Progress: 814/2373 symbols completed. FCRX took 29.2s. Estimated remaining: 3h 37m 54s. Rate: 7.2 symbols/min [2025-10-09T18:53:50.082609] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:50.104005] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:50.131385] [DEBUG] [LOCAL ] FDS: Loaded 26941 existing records from primary storage. [2025-10-09T18:53:50.131705] [INFO ] [MAIN ] FDS: Loaded 26941 existing records. [2025-10-09T18:53:50.306531] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:50.306778] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-09T18:53:50.306830] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-09T18:53:50.307156] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-09T18:53:50.307213] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-09T18:53:50.403158] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-09T18:53:50.664235] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:53:50.676714] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:51.196800] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-09T18:53:51.996686] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-09T18:53:52.312243] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:53:52.514048] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-09T18:53:52.802248] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-09T18:53:52.810877] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T18:53:53.596727] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-09T18:53:54.396704] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-09T18:53:54.781251] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T18:53:54.930325] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T18:53:54.969240] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T18:53:55.196730] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-09T18:53:55.996703] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-09T18:53:56.346535] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T18:53:56.796799] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-09T18:53:56.846042] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T18:53:57.596677] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-09T18:53:57.915540] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T18:53:58.396756] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-09T18:53:59.196770] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-09T18:53:59.415790] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:53:59.580824] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T18:53:59.996788] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-09T18:54:00.347371] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T18:54:00.796724] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-09T18:54:01.173473] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T18:54:01.531049] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T18:54:01.596719] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-09T18:54:02.396722] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-09T18:54:02.869597] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T18:54:03.196780] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-09T18:54:03.559756] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:54:03.562098] [INFO ] [REMOTE ] FCT: Full fetch complete (21165 records). [2025-10-09T18:54:03.562200] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-09T18:54:03.939729] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-09T18:54:03.939825] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-09T18:54:03.940395] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-09T18:54:03.940435] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-09T18:54:03.941066] [DEBUG] [LOCAL ] FCT: Trimmed 21165 records to 14880 (keeping 200 days of data) [2025-10-09T18:54:04.005552] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-09T18:54:04.034361] [DEBUG] [LOCAL ] FCT: Primary data saved (14880 records). [2025-10-09T18:54:04.034511] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-09T18:54:04.034610] [INFO ] [MAIN ] Update Progress: 815/2373 symbols completed. FCT took 39.9s. Estimated remaining: 3h 37m 57s. Rate: 7.1 symbols/min [2025-10-09T18:54:04.199562] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:04.252361] [DEBUG] [LOCAL ] FDX: Loaded 51462 existing records from primary storage. [2025-10-09T18:54:04.252722] [INFO ] [MAIN ] FDX: Loaded 51462 existing records. [2025-10-09T18:54:04.430333] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:04.430736] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-09T18:54:04.430802] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-09T18:54:04.431351] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-09T18:54:04.431409] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-09T18:54:04.812575] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-09T18:54:04.816820] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:04.839147] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T18:54:05.118367] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T18:54:05.596721] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-09T18:54:06.396745] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-09T18:54:06.739799] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T18:54:06.932578] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:54:07.196722] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-09T18:54:07.737505] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T18:54:07.996780] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-09T18:54:08.480620] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T18:54:08.796696] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-09T18:54:08.837915] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T18:54:09.596714] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-09T18:54:10.396745] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-09T18:54:10.702791] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T18:54:11.196735] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-09T18:54:11.771726] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T18:54:11.814220] [INFO ] [REMOTE ] FDS: Full fetch complete (38092 records). [2025-10-09T18:54:11.814594] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-09T18:54:11.825228] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-09T18:54:12.001932] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-09T18:54:12.236615] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-09T18:54:12.236731] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-09T18:54:12.237381] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-09T18:54:12.237423] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-09T18:54:12.238398] [DEBUG] [LOCAL ] FDS: Trimmed 38092 records to 27281 (keeping 200 days of data) [2025-10-09T18:54:12.416706] [DEBUG] [LOCAL ] FDS: Primary data saved (27281 records). [2025-10-09T18:54:12.416864] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-09T18:54:12.416952] [INFO ] [MAIN ] Update Progress: 816/2373 symbols completed. FDS took 22.7s. Estimated remaining: 3h 37m 48s. Rate: 7.1 symbols/min [2025-10-09T18:54:12.589093] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:12.642066] [DEBUG] [LOCAL ] FE: Loaded 53433 existing records from primary storage. [2025-10-09T18:54:12.642391] [INFO ] [MAIN ] FE: Loaded 53433 existing records. [2025-10-09T18:54:12.807493] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-09T18:54:12.830936] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:12.831217] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-09T18:54:12.831279] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-09T18:54:12.831536] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-09T18:54:12.831594] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-09T18:54:13.231452] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:13.236603] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T18:54:13.278228] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T18:54:13.596744] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-09T18:54:14.396716] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-09T18:54:14.630558] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T18:54:14.659258] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:54:15.196788] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-09T18:54:15.996759] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-09T18:54:16.213781] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:54:16.796723] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-09T18:54:17.129907] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T18:54:17.596707] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-09T18:54:18.396686] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-09T18:54:18.555951] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:54:18.771302] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-09T18:54:19.196742] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-09T18:54:19.996737] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-09T18:54:20.653740] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-09T18:54:20.681388] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T18:54:20.780477] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-10-09T18:54:20.796690] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-09T18:54:21.596688] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-09T18:54:21.674839] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T18:54:22.396796] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-09T18:54:22.458717] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:54:23.086639] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T18:54:23.196705] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-09T18:54:23.634512] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:54:23.996736] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-09T18:54:24.796694] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-09T18:54:25.132411] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T18:54:25.596758] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-09T18:54:25.808476] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:54:26.396709] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-09T18:54:26.538482] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:54:27.196713] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-09T18:54:27.426846] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T18:54:27.996683] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-09T18:54:28.157289] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T18:54:28.796817] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-09T18:54:29.177305] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T18:54:29.181828] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-09T18:54:29.181960] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-09T18:54:29.590817] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-09T18:54:29.591009] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-09T18:54:29.592315] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-09T18:54:29.592468] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-09T18:54:29.594358] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54090 (keeping 200 days of data) [2025-10-09T18:54:29.596699] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-09T18:54:29.723278] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T18:54:29.746594] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T18:54:29.750876] [INFO ] [REMOTE ] FDP: Full fetch complete (42883 records). [2025-10-09T18:54:29.751226] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-09T18:54:30.154637] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-09T18:54:30.155261] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-09T18:54:30.156305] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-09T18:54:30.156390] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-09T18:54:30.160194] [DEBUG] [LOCAL ] FDP: Trimmed 42883 records to 30266 (keeping 200 days of data) [2025-10-09T18:54:30.398076] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-09T18:54:30.577684] [DEBUG] [LOCAL ] FDP: Primary data saved (30266 records). [2025-10-09T18:54:30.578376] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-09T18:54:30.578818] [INFO ] [MAIN ] Update Progress: 817/2373 symbols completed. FDP took 41.6s. Estimated remaining: 3h 37m 58s. Rate: 7.1 symbols/min [2025-10-09T18:54:30.765215] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:30.765914] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-09T18:54:30.766495] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-09T18:54:30.766941] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-09T18:54:30.769610] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-09T18:54:30.769721] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-09T18:54:30.772630] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-09T18:54:30.772567] [DEBUG] [LOCAL ] FCX: Primary data saved (54090 records). [2025-10-09T18:54:30.772764] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-09T18:54:30.807610] [INFO ] [MAIN ] Update Progress: 818/2373 symbols completed. FCX took 45.2s. Estimated remaining: 3h 37m 35s. Rate: 7.1 symbols/min [2025-10-09T18:54:31.258087] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:31.343212] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:31.343836] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-09T18:54:31.384188] [DEBUG] [LOCAL ] FERG: Loaded 48754 existing records from primary storage. [2025-10-09T18:54:31.384523] [INFO ] [MAIN ] FERG: Loaded 48754 existing records. [2025-10-09T18:54:31.572111] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:31.572531] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-09T18:54:31.572692] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-09T18:54:31.583806] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-09T18:54:31.589035] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-09T18:54:31.679930] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-09T18:54:31.721626] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-09T18:54:31.984197] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:31.996668] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-09T18:54:32.214694] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T18:54:32.796779] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-09T18:54:33.115814] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-09T18:54:33.596746] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-09T18:54:33.760368] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:54:33.858898] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-09T18:54:34.396762] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-09T18:54:35.196807] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-09T18:54:35.738021] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:54:35.996756] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-09T18:54:36.414929] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:54:36.540519] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T18:54:36.796719] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-09T18:54:37.596788] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-09T18:54:38.065715] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-09T18:54:38.396771] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-09T18:54:38.552752] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T18:54:38.828353] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T18:54:39.196788] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-09T18:54:39.542062] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T18:54:39.996872] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-09T18:54:40.796740] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-09T18:54:41.134997] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T18:54:41.596772] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-09T18:54:41.862336] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T18:54:41.866522] [INFO ] [REMOTE ] FDX: Full fetch complete (74362 records). [2025-10-09T18:54:41.866639] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-09T18:54:41.979457] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-09T18:54:42.271437] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-09T18:54:42.271535] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-09T18:54:42.272471] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-09T18:54:42.272535] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-09T18:54:42.273986] [DEBUG] [LOCAL ] FDX: Trimmed 74362 records to 51817 (keeping 200 days of data) [2025-10-09T18:54:42.397553] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-09T18:54:42.600801] [DEBUG] [LOCAL ] FDX: Primary data saved (51817 records). [2025-10-09T18:54:42.600946] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-09T18:54:42.601030] [INFO ] [MAIN ] Update Progress: 819/2373 symbols completed. FDX took 38.6s. Estimated remaining: 3h 37m 33s. Rate: 7.1 symbols/min [2025-10-09T18:54:42.767453] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:42.783161] [DEBUG] [LOCAL ] FET: Loaded 12811 existing records from primary storage. [2025-10-09T18:54:42.783383] [INFO ] [MAIN ] FET: Loaded 12811 existing records. [2025-10-09T18:54:42.969052] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:42.969344] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-09T18:54:42.969402] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-09T18:54:42.969680] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-09T18:54:42.969751] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-09T18:54:43.206020] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-09T18:54:43.320966] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:43.773715] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T18:54:43.996760] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-09T18:54:44.132799] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T18:54:44.691748] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T18:54:44.796709] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-09T18:54:45.596742] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-09T18:54:46.130768] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T18:54:46.396766] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-09T18:54:47.196789] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-09T18:54:47.234692] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T18:54:47.664454] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T18:54:47.665202] [INFO ] [REMOTE ] FENG: Full fetch complete (2259 records). [2025-10-09T18:54:47.665269] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-09T18:54:47.848055] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T18:54:47.848377] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:54:47.848517] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:54:47.848612] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-09T18:54:47.848742] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-09T18:54:47.848805] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-09T18:54:47.848851] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-09T18:54:47.848911] [INFO ] [MAIN ] Update Progress: 820/2373 symbols completed. FENG took 17.3s. Estimated remaining: 3h 37m 18s. Rate: 7.1 symbols/min [2025-10-09T18:54:47.999817] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-09T18:54:48.025514] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:48.050875] [DEBUG] [LOCAL ] FF: Loaded 24514 existing records from primary storage. [2025-10-09T18:54:48.051148] [INFO ] [MAIN ] FF: Loaded 24514 existing records. [2025-10-09T18:54:48.233623] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:48.233888] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-09T18:54:48.234058] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-09T18:54:48.234450] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-09T18:54:48.234513] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-09T18:54:48.370091] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-09T18:54:48.644486] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:48.796726] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-09T18:54:48.816383] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T18:54:49.596784] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-09T18:54:50.380199] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T18:54:50.396677] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-09T18:54:51.196783] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-09T18:54:51.362460] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T18:54:51.367401] [INFO ] [REMOTE ] FE: Full fetch complete (77283 records). [2025-10-09T18:54:51.367568] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-09T18:54:52.015152] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-09T18:54:52.017382] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-09T18:54:52.022151] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-09T18:54:52.072063] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-09T18:54:52.089535] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-09T18:54:52.113171] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T18:54:52.115901] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T18:54:52.138814] [DEBUG] [LOCAL ] FE: Trimmed 77283 records to 53823 (keeping 200 days of data) [2025-10-09T18:54:52.600508] [DEBUG] [LOCAL ] FE: Primary data saved (53823 records). [2025-10-09T18:54:52.600780] [INFO ] [MAIN ] FE: Full history saved. [2025-10-09T18:54:52.602043] [INFO ] [MAIN ] Update Progress: 821/2373 symbols completed. FE took 40.2s. Estimated remaining: 3h 37m 3s. Rate: 7.2 symbols/min [2025-10-09T18:54:52.803214] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-09T18:54:52.833959] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:52.846561] [DEBUG] [LOCAL ] FFA: Loaded 6060 existing records from primary storage. [2025-10-09T18:54:52.855143] [INFO ] [MAIN ] FFA: Loaded 6060 existing records. [2025-10-09T18:54:52.889093] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T18:54:53.054637] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:53.054933] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-09T18:54:53.054998] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-09T18:54:53.055309] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-09T18:54:53.055381] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-09T18:54:53.401633] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:53.596692] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-09T18:54:53.829385] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T18:54:54.196320] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:54:54.396774] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-09T18:54:54.911980] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T18:54:55.196756] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-09T18:54:55.925922] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T18:54:55.996736] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-09T18:54:56.796701] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-09T18:54:56.883958] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:54:57.186783] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-09T18:54:57.596773] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-09T18:54:58.386724] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T18:54:58.396672] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-09T18:54:59.196737] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-09T18:54:59.739890] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T18:54:59.996775] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-09T18:55:00.610943] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T18:55:00.796713] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-09T18:55:00.885686] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:55:01.423315] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T18:55:01.596920] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-09T18:55:02.396768] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-09T18:55:02.446127] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T18:55:03.196769] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-09T18:55:03.886096] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T18:55:03.996714] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-09T18:55:04.192721] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T18:55:04.741335] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T18:55:04.796673] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-09T18:55:05.596737] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-09T18:55:05.625939] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:55:06.396723] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-09T18:55:07.043105] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T18:55:07.196748] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-09T18:55:07.284904] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:55:07.996792] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-09T18:55:08.026519] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:55:08.796728] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-09T18:55:09.277765] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T18:55:09.481771] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T18:55:09.596708] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-09T18:55:10.396702] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-09T18:55:10.669123] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T18:55:10.851251] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T18:55:11.196744] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-09T18:55:11.785700] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:55:11.996730] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-09T18:55:12.796691] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-09T18:55:12.924436] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T18:55:13.341016] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T18:55:13.596725] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-09T18:55:14.396714] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-09T18:55:14.525252] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T18:55:15.196719] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-09T18:55:15.800916] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:55:15.996721] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-09T18:55:16.228954] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T18:55:16.796728] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-09T18:55:17.596687] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-09T18:55:17.804200] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T18:55:17.805918] [INFO ] [REMOTE ] FFA: Full fetch complete (8735 records). [2025-10-09T18:55:17.805990] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-09T18:55:18.045839] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-09T18:55:18.241664] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-09T18:55:18.241789] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-09T18:55:18.242006] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-09T18:55:18.242046] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-09T18:55:18.242483] [DEBUG] [LOCAL ] FFA: Trimmed 8735 records to 6118 (keeping 200 days of data) [2025-10-09T18:55:18.280805] [DEBUG] [LOCAL ] FFA: Primary data saved (6118 records). [2025-10-09T18:55:18.280907] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-09T18:55:18.280986] [INFO ] [MAIN ] Update Progress: 822/2373 symbols completed. FFA took 25.7s. Estimated remaining: 3h 37m 27s. Rate: 7.1 symbols/min [2025-10-09T18:55:18.401321] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-09T18:55:18.438703] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T18:55:18.467612] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:18.486869] [DEBUG] [LOCAL ] FFC: Loaded 16723 existing records from primary storage. [2025-10-09T18:55:18.487097] [INFO ] [MAIN ] FFC: Loaded 16723 existing records. [2025-10-09T18:55:18.659019] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:18.659205] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-09T18:55:18.659253] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-09T18:55:18.659422] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-09T18:55:18.659482] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-09T18:55:19.007417] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:19.196688] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-09T18:55:19.335833] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T18:55:19.337599] [INFO ] [REMOTE ] FET: Full fetch complete (18239 records). [2025-10-09T18:55:19.337697] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-09T18:55:19.710088] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-09T18:55:19.710174] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-09T18:55:19.710616] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-09T18:55:19.710714] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-09T18:55:19.711456] [DEBUG] [LOCAL ] FET: Trimmed 18239 records to 12879 (keeping 200 days of data) [2025-10-09T18:55:19.791146] [DEBUG] [LOCAL ] FET: Primary data saved (12879 records). [2025-10-09T18:55:19.791295] [INFO ] [MAIN ] FET: Full history saved. [2025-10-09T18:55:19.791379] [INFO ] [MAIN ] Update Progress: 823/2373 symbols completed. FET took 37.2s. Estimated remaining: 3h 37m 6s. Rate: 7.1 symbols/min [2025-10-09T18:55:19.969892] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:19.996939] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-09T18:55:20.008520] [DEBUG] [LOCAL ] FFWM: Loaded 35821 existing records from primary storage. [2025-10-09T18:55:20.008871] [INFO ] [MAIN ] FFWM: Loaded 35821 existing records. [2025-10-09T18:55:20.127856] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T18:55:20.172227] [INFO ] [REMOTE ] FF: Full fetch complete (36470 records). [2025-10-09T18:55:20.179918] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-09T18:55:20.233673] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:20.277485] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-09T18:55:20.293494] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-09T18:55:20.304282] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-09T18:55:20.304409] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-09T18:55:20.808592] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-09T18:55:20.962494] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:20.962711] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-09T18:55:20.962789] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-09T18:55:20.963571] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-09T18:55:20.963630] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-09T18:55:20.964397] [DEBUG] [LOCAL ] FF: Trimmed 36470 records to 24629 (keeping 200 days of data) [2025-10-09T18:55:21.112355] [DEBUG] [LOCAL ] FF: Primary data saved (24629 records). [2025-10-09T18:55:21.112488] [INFO ] [MAIN ] FF: Full history saved. [2025-10-09T18:55:21.112571] [INFO ] [MAIN ] Update Progress: 824/2373 symbols completed. FF took 33.3s. Estimated remaining: 3h 36m 44s. Rate: 7.1 symbols/min [2025-10-09T18:55:21.279417] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:21.302153] [DEBUG] [LOCAL ] FG: Loaded 22742 existing records from primary storage. [2025-10-09T18:55:21.302396] [INFO ] [MAIN ] FG: Loaded 22742 existing records. [2025-10-09T18:55:21.481128] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:21.481366] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-09T18:55:21.481586] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-09T18:55:21.481907] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-09T18:55:21.481982] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-09T18:55:21.633312] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-09T18:55:21.680326] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:55:21.762830] [INFO ] [REMOTE ] FERG: Full fetch complete (70851 records). [2025-10-09T18:55:21.791180] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-09T18:55:21.957568] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:22.028334] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T18:55:22.299452] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-09T18:55:22.299530] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-09T18:55:22.300393] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-09T18:55:22.300457] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-09T18:55:22.301782] [DEBUG] [LOCAL ] FERG: Trimmed 70851 records to 49116 (keeping 200 days of data) [2025-10-09T18:55:22.396818] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-09T18:55:22.628384] [DEBUG] [LOCAL ] FERG: Primary data saved (49116 records). [2025-10-09T18:55:22.628537] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-09T18:55:22.628664] [INFO ] [MAIN ] Update Progress: 825/2373 symbols completed. FERG took 51.8s. Estimated remaining: 3h 36m 23s. Rate: 7.2 symbols/min [2025-10-09T18:55:22.802900] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:22.823998] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T18:55:22.833875] [DEBUG] [LOCAL ] FGN: Loaded 3793 existing records from primary storage. [2025-10-09T18:55:22.834055] [INFO ] [MAIN ] FGN: Loaded 3793 existing records. [2025-10-09T18:55:23.007496] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:23.007705] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-09T18:55:23.007765] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-09T18:55:23.008015] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-09T18:55:23.008072] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-09T18:55:23.162988] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T18:55:23.204386] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-09T18:55:23.377729] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:23.996712] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-09T18:55:24.070192] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-09T18:55:24.796695] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-09T18:55:25.096803] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:55:25.596710] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-09T18:55:25.805856] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T18:55:26.396735] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-09T18:55:26.918343] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:55:26.966570] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T18:55:27.196769] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-09T18:55:27.758579] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:55:27.996727] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-09T18:55:28.796723] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-09T18:55:28.866364] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T18:55:29.596721] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-09T18:55:30.135218] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T18:55:30.396706] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-09T18:55:30.514745] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T18:55:30.715110] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:55:31.196707] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-09T18:55:31.996717] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-09T18:55:32.546308] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T18:55:32.716019] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:55:32.796669] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-09T18:55:33.596731] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-09T18:55:34.244894] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:55:34.313747] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T18:55:34.396679] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-09T18:55:35.196770] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-09T18:55:35.710686] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:55:35.996709] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-09T18:55:36.519162] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T18:55:36.554372] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T18:55:36.796730] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-09T18:55:37.107176] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-09T18:55:37.596780] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-09T18:55:38.396760] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-09T18:55:38.488972] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T18:55:38.949955] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T18:55:39.196713] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-09T18:55:39.996732] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-09T18:55:40.097467] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T18:55:40.429493] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:55:40.796726] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-09T18:55:41.351016] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:55:41.596724] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-09T18:55:42.396755] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-09T18:55:42.582780] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T18:55:42.686148] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-09T18:55:43.196777] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-09T18:55:43.996737] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-09T18:55:44.124045] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T18:55:44.654224] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T18:55:44.796779] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-09T18:55:45.596736] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-09T18:55:45.965661] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T18:55:46.040255] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T18:55:46.041342] [INFO ] [REMOTE ] FGN: Full fetch complete (5664 records). [2025-10-09T18:55:46.041426] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-09T18:55:46.405436] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-09T18:55:46.407391] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-09T18:55:46.407479] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-09T18:55:46.407752] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-09T18:55:46.407865] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-09T18:55:46.408393] [DEBUG] [LOCAL ] FGN: Trimmed 5664 records to 3810 (keeping 200 days of data) [2025-10-09T18:55:46.432845] [DEBUG] [LOCAL ] FGN: Primary data saved (3810 records). [2025-10-09T18:55:46.432915] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-09T18:55:46.433024] [INFO ] [MAIN ] Update Progress: 826/2373 symbols completed. FGN took 23.8s. Estimated remaining: 3h 36m 43s. Rate: 7.1 symbols/min [2025-10-09T18:55:46.600530] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:46.600721] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-09T18:55:46.600811] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-09T18:55:46.600894] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-09T18:55:46.600931] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-09T18:55:46.601031] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-09T18:55:46.601080] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-09T18:55:46.950709] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:47.117903] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:55:47.196723] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-09T18:55:47.996725] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-09T18:55:48.174527] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T18:55:48.418842] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:55:48.419177] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-09T18:55:48.419292] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:55:48.419348] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-09T18:55:48.419406] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:55:48.419480] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-09T18:55:48.419548] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-09T18:55:48.419606] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-09T18:55:48.419723] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-09T18:55:48.419805] [INFO ] [MAIN ] Update Progress: 827/2373 symbols completed. FGSN took 2.0s. Estimated remaining: 3h 36m 23s. Rate: 7.1 symbols/min [2025-10-09T18:55:48.601767] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:48.601957] [DEBUG] [LOCAL ] FHI: No existing data file found in primary storage. [2025-10-09T18:55:48.602015] [WARN ] [MAIN ] FHI: No existing data found, performing full refresh instead. [2025-10-09T18:55:48.602178] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-09T18:55:48.602256] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-09T18:55:48.602317] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-10-09T18:55:48.602351] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-09T18:55:48.801846] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-09T18:55:48.962537] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:49.596732] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-09T18:55:50.187242] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T18:55:50.396749] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-09T18:55:50.504249] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T18:55:51.196697] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-09T18:55:51.512119] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T18:55:51.996718] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-09T18:55:52.252678] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:55:52.796743] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-09T18:55:52.945021] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T18:55:53.596726] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-09T18:55:53.974532] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:55:53.977753] [INFO ] [REMOTE ] FFWM: Full fetch complete (51790 records). [2025-10-09T18:55:53.977899] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-09T18:55:54.366694] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-09T18:55:54.366801] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-09T18:55:54.367664] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-09T18:55:54.367729] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-09T18:55:54.369036] [DEBUG] [LOCAL ] FFWM: Trimmed 51790 records to 36030 (keeping 200 days of data) [2025-10-09T18:55:54.415863] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-09T18:55:54.582028] [DEBUG] [LOCAL ] FFWM: Primary data saved (36030 records). [2025-10-09T18:55:54.582189] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-09T18:55:54.582319] [INFO ] [MAIN ] Update Progress: 828/2373 symbols completed. FFWM took 34.8s. Estimated remaining: 3h 36m 10s. Rate: 7.1 symbols/min [2025-10-09T18:55:54.766304] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:54.816215] [DEBUG] [LOCAL ] FHN: Loaded 53373 existing records from primary storage. [2025-10-09T18:55:54.816552] [INFO ] [MAIN ] FHN: Loaded 53373 existing records. [2025-10-09T18:55:55.013061] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:55.013522] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-09T18:55:55.013667] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-09T18:55:55.014138] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-09T18:55:55.014204] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-09T18:55:55.199566] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-09T18:55:55.207635] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T18:55:55.446888] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:55.462249] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T18:55:55.885961] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T18:55:55.996735] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-09T18:55:56.796726] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-09T18:55:57.596708] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-09T18:55:57.674005] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T18:55:57.675705] [INFO ] [REMOTE ] FFC: Full fetch complete (24651 records). [2025-10-09T18:55:57.675778] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-09T18:55:57.833926] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T18:55:58.092328] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-09T18:55:58.092403] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-09T18:55:58.092917] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-09T18:55:58.092979] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-09T18:55:58.093584] [DEBUG] [LOCAL ] FFC: Trimmed 24651 records to 16860 (keeping 200 days of data) [2025-10-09T18:55:58.198948] [DEBUG] [LOCAL ] FFC: Primary data saved (16860 records). [2025-10-09T18:55:58.199094] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-09T18:55:58.199179] [INFO ] [MAIN ] Update Progress: 829/2373 symbols completed. FFC took 39.9s. Estimated remaining: 3h 35m 53s. Rate: 7.2 symbols/min [2025-10-09T18:55:58.367813] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:58.396929] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-09T18:55:58.421360] [DEBUG] [LOCAL ] FI: Loaded 53534 existing records from primary storage. [2025-10-09T18:55:58.421713] [INFO ] [MAIN ] FI: Loaded 53534 existing records. [2025-10-09T18:55:58.599688] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:58.600052] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-09T18:55:58.600123] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-09T18:55:58.600385] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-09T18:55:58.600446] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-09T18:55:58.966931] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:58.992105] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:55:59.196759] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-09T18:55:59.543022] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T18:55:59.996741] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-09T18:56:00.613670] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T18:56:00.773498] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T18:56:00.775561] [INFO ] [REMOTE ] FG: Full fetch complete (28112 records). [2025-10-09T18:56:00.775630] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-09T18:56:00.801945] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-09T18:56:01.156494] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-09T18:56:01.156575] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-09T18:56:01.157194] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-09T18:56:01.157259] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-09T18:56:01.158073] [DEBUG] [LOCAL ] FG: Trimmed 28112 records to 22863 (keeping 200 days of data) [2025-10-09T18:56:01.302075] [DEBUG] [LOCAL ] FG: Primary data saved (22863 records). [2025-10-09T18:56:01.302209] [INFO ] [MAIN ] FG: Full history saved. [2025-10-09T18:56:01.302293] [INFO ] [MAIN ] Update Progress: 830/2373 symbols completed. FG took 40.2s. Estimated remaining: 3h 35m 35s. Rate: 7.2 symbols/min [2025-10-09T18:56:01.494745] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:01.517901] [DEBUG] [LOCAL ] FICO: Loaded 21409 existing records from primary storage. [2025-10-09T18:56:01.518159] [INFO ] [MAIN ] FICO: Loaded 21409 existing records. [2025-10-09T18:56:01.601883] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-09T18:56:01.706181] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:01.706502] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-09T18:56:01.706564] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-09T18:56:01.706889] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-09T18:56:01.706953] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-09T18:56:02.061131] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:02.340315] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T18:56:02.396666] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-09T18:56:03.083442] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T18:56:03.196725] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-09T18:56:03.948936] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T18:56:03.996742] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-09T18:56:04.224036] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T18:56:04.796730] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-09T18:56:05.599464] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-09T18:56:05.605360] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T18:56:05.814413] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T18:56:06.396813] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-09T18:56:07.131121] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:56:07.196667] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-09T18:56:07.645970] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T18:56:07.996700] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-09T18:56:08.219933] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T18:56:08.796739] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-09T18:56:08.882250] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T18:56:09.596721] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-09T18:56:10.316228] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T18:56:10.396672] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-09T18:56:11.205566] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-09T18:56:11.208484] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T18:56:11.996712] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-09T18:56:12.359723] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T18:56:12.741911] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T18:56:12.796664] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-09T18:56:12.852544] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T18:56:13.596768] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-09T18:56:14.339416] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T18:56:14.396704] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-09T18:56:14.986314] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T18:56:15.196730] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-09T18:56:15.938693] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T18:56:15.996710] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-09T18:56:16.793332] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T18:56:16.797633] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-09T18:56:17.239474] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T18:56:17.596731] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-09T18:56:18.148478] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T18:56:18.151553] [INFO ] [REMOTE ] FHI: Full fetch complete (57485 records). [2025-10-09T18:56:18.151672] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-09T18:56:18.406618] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-09T18:56:18.543249] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-09T18:56:18.543338] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-09T18:56:18.544146] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-09T18:56:18.544208] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-09T18:56:18.545413] [DEBUG] [LOCAL ] FHI: Trimmed 57485 records to 40145 (keeping 200 days of data) [2025-10-09T18:56:18.788746] [DEBUG] [LOCAL ] FHI: Primary data saved (40145 records). [2025-10-09T18:56:18.788875] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-09T18:56:18.788965] [INFO ] [MAIN ] Update Progress: 831/2373 symbols completed. FHI took 30.4s. Estimated remaining: 3h 35m 43s. Rate: 7.1 symbols/min [2025-10-09T18:56:18.966230] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:18.966480] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-09T18:56:18.966538] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-09T18:56:18.966706] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-09T18:56:18.966766] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-09T18:56:18.966814] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-09T18:56:18.966848] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-09T18:56:19.213842] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-09T18:56:19.362390] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:19.391365] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T18:56:19.529785] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T18:56:19.996724] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-09T18:56:20.796740] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-09T18:56:21.205521] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-09T18:56:21.280103] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T18:56:21.409611] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T18:56:21.596774] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-09T18:56:22.396761] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-09T18:56:22.895969] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T18:56:23.196764] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-09T18:56:23.423726] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-09T18:56:23.996690] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-09T18:56:24.263170] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:56:24.318053] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:56:24.796714] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-09T18:56:25.596693] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-09T18:56:25.970709] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:56:26.396769] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-09T18:56:27.196801] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-09T18:56:27.265071] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:56:27.536014] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-09T18:56:27.996721] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-09T18:56:28.042867] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T18:56:28.796736] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-09T18:56:29.596708] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-09T18:56:30.043691] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:56:30.076576] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-09T18:56:30.130078] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T18:56:30.396726] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-09T18:56:30.696247] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T18:56:31.196729] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-09T18:56:31.996776] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-09T18:56:32.229924] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:56:32.230172] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-09T18:56:32.230263] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:56:32.230338] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-09T18:56:32.230401] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:56:32.230482] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-09T18:56:32.230555] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-09T18:56:32.230611] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-09T18:56:32.230701] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-09T18:56:32.230770] [INFO ] [MAIN ] Update Progress: 832/2373 symbols completed. FIG took 13.4s. Estimated remaining: 3h 35m 44s. Rate: 7.1 symbols/min [2025-10-09T18:56:32.401176] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:32.443676] [DEBUG] [LOCAL ] FIGS: Loaded 48743 existing records from primary storage. [2025-10-09T18:56:32.444002] [INFO ] [MAIN ] FIGS: Loaded 48743 existing records. [2025-10-09T18:56:32.623867] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:32.624072] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-09T18:56:32.624121] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-09T18:56:32.624354] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-09T18:56:32.624411] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-09T18:56:32.805550] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-09T18:56:32.997999] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:33.072635] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T18:56:33.596753] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-09T18:56:33.882847] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:56:33.885897] [INFO ] [REMOTE ] FICO: Full fetch complete (29450 records). [2025-10-09T18:56:33.885971] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-09T18:56:34.260104] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-09T18:56:34.260261] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-09T18:56:34.260963] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-09T18:56:34.261031] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-09T18:56:34.261843] [DEBUG] [LOCAL ] FICO: Trimmed 29450 records to 21632 (keeping 200 days of data) [2025-10-09T18:56:34.397043] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-09T18:56:34.400906] [DEBUG] [LOCAL ] FICO: Primary data saved (21632 records). [2025-10-09T18:56:34.400972] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-09T18:56:34.401051] [INFO ] [MAIN ] Update Progress: 833/2373 symbols completed. FICO took 33.1s. Estimated remaining: 3h 35m 24s. Rate: 7.1 symbols/min [2025-10-09T18:56:34.580328] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:34.623054] [DEBUG] [LOCAL ] FIHL: Loaded 39645 existing records from primary storage. [2025-10-09T18:56:34.623335] [INFO ] [MAIN ] FIHL: Loaded 39645 existing records. [2025-10-09T18:56:34.813454] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:34.813759] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-09T18:56:34.813816] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-09T18:56:34.814043] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-09T18:56:34.814108] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-09T18:56:35.170446] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:35.196671] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-09T18:56:35.336146] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:56:35.996683] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-09T18:56:36.092537] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T18:56:36.545775] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T18:56:36.796815] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-09T18:56:37.596702] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-09T18:56:37.662276] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T18:56:38.161048] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:56:38.165594] [INFO ] [REMOTE ] FHN: Full fetch complete (77294 records). [2025-10-09T18:56:38.165751] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-09T18:56:38.401918] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-09T18:56:38.570885] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-09T18:56:38.570964] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-09T18:56:38.571884] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-09T18:56:38.571947] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-09T18:56:38.573364] [DEBUG] [LOCAL ] FHN: Trimmed 77294 records to 53763 (keeping 200 days of data) [2025-10-09T18:56:38.904427] [DEBUG] [LOCAL ] FHN: Primary data saved (53763 records). [2025-10-09T18:56:38.904552] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-09T18:56:38.904632] [INFO ] [MAIN ] Update Progress: 834/2373 symbols completed. FHN took 44.3s. Estimated remaining: 3h 35m 9s. Rate: 7.2 symbols/min [2025-10-09T18:56:39.072773] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:39.083351] [DEBUG] [LOCAL ] FINS: Loaded 8304 existing records from primary storage. [2025-10-09T18:56:39.083554] [INFO ] [MAIN ] FINS: Loaded 8304 existing records. [2025-10-09T18:56:39.201819] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-09T18:56:39.266388] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:39.266961] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-09T18:56:39.267131] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-09T18:56:39.267417] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-09T18:56:39.267482] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-09T18:56:39.706137] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:39.709130] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T18:56:39.996701] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-09T18:56:40.140506] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T18:56:40.543371] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T18:56:40.713798] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T18:56:40.720077] [INFO ] [REMOTE ] FI: Full fetch complete (77216 records). [2025-10-09T18:56:40.720255] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-09T18:56:40.801811] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-09T18:56:41.121931] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-09T18:56:41.122051] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-09T18:56:41.123076] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-09T18:56:41.123155] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-09T18:56:41.124748] [DEBUG] [LOCAL ] FI: Trimmed 77216 records to 53923 (keeping 200 days of data) [2025-10-09T18:56:41.456250] [DEBUG] [LOCAL ] FI: Primary data saved (53923 records). [2025-10-09T18:56:41.456387] [INFO ] [MAIN ] FI: Full history saved. [2025-10-09T18:56:41.457334] [INFO ] [MAIN ] Update Progress: 835/2373 symbols completed. FI took 43.3s. Estimated remaining: 3h 34m 50s. Rate: 7.2 symbols/min [2025-10-09T18:56:41.599282] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-09T18:56:41.633995] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:41.680967] [DEBUG] [LOCAL ] FINV: Loaded 45214 existing records from primary storage. [2025-10-09T18:56:41.681298] [INFO ] [MAIN ] FINV: Loaded 45214 existing records. [2025-10-09T18:56:41.869964] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T18:56:41.869350] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:41.871347] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-09T18:56:41.873904] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-09T18:56:41.874211] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-09T18:56:41.874269] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-09T18:56:42.223823] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:42.396701] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-09T18:56:42.993830] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T18:56:43.196715] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-09T18:56:43.787318] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T18:56:43.996721] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-09T18:56:44.014291] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T18:56:44.796743] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-09T18:56:45.101185] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:56:45.483398] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T18:56:45.596697] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-09T18:56:46.396808] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-09T18:56:46.991965] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T18:56:47.027557] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T18:56:47.196751] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-09T18:56:47.943070] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T18:56:47.996739] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-09T18:56:48.763732] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T18:56:48.796667] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-09T18:56:49.329237] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T18:56:49.596756] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-09T18:56:50.396702] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-09T18:56:50.905542] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T18:56:51.196769] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-09T18:56:51.493198] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T18:56:51.755310] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T18:56:51.996728] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-09T18:56:52.796699] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-09T18:56:53.095312] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T18:56:53.596727] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-09T18:56:54.232921] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:56:54.294883] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T18:56:54.396721] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-09T18:56:55.180011] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T18:56:55.196671] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-09T18:56:55.891218] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T18:56:55.892245] [INFO ] [REMOTE ] FINS: Full fetch complete (11891 records). [2025-10-09T18:56:55.892314] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-09T18:56:55.996806] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-09T18:56:56.265583] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-09T18:56:56.265683] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-09T18:56:56.265958] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-09T18:56:56.265998] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-09T18:56:56.266435] [DEBUG] [LOCAL ] FINS: Trimmed 11891 records to 8357 (keeping 200 days of data) [2025-10-09T18:56:56.318995] [DEBUG] [LOCAL ] FINS: Primary data saved (8357 records). [2025-10-09T18:56:56.319106] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-09T18:56:56.319182] [INFO ] [MAIN ] Update Progress: 836/2373 symbols completed. FINS took 17.4s. Estimated remaining: 3h 34m 53s. Rate: 7.2 symbols/min [2025-10-09T18:56:56.485214] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:56.535052] [DEBUG] [LOCAL ] FIS: Loaded 53350 existing records from primary storage. [2025-10-09T18:56:56.535404] [INFO ] [MAIN ] FIS: Loaded 53350 existing records. [2025-10-09T18:56:56.721211] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:56.721449] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-09T18:56:56.721504] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-09T18:56:56.721833] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-09T18:56:56.721892] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-09T18:56:56.801841] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-09T18:56:57.074045] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:57.534000] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:56:57.596688] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-09T18:56:58.396685] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-09T18:56:58.502371] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:56:58.705124] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T18:56:59.196720] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-09T18:56:59.996731] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-09T18:57:00.125866] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:57:00.749128] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:57:00.796669] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-09T18:57:01.096855] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T18:57:01.596751] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-09T18:57:02.401842] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-09T18:57:02.418850] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:57:03.022351] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:57:03.196723] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-09T18:57:03.996718] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-09T18:57:04.085101] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T18:57:04.666024] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T18:57:04.796700] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-09T18:57:05.596783] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-09T18:57:05.665333] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:57:06.092249] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:57:06.396793] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-09T18:57:07.113792] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:57:07.196698] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-09T18:57:07.996678] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-09T18:57:08.266099] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T18:57:08.429907] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T18:57:08.796719] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-09T18:57:09.596690] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-09T18:57:09.683878] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T18:57:10.367983] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T18:57:10.372271] [INFO ] [REMOTE ] FINV: Full fetch complete (63916 records). [2025-10-09T18:57:10.372378] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-09T18:57:10.405526] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-09T18:57:10.761974] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-09T18:57:10.762060] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-09T18:57:10.762940] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-09T18:57:10.763003] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-09T18:57:10.764351] [DEBUG] [LOCAL ] FINV: Trimmed 63916 records to 45581 (keeping 200 days of data) [2025-10-09T18:57:11.031473] [DEBUG] [LOCAL ] FINV: Primary data saved (45581 records). [2025-10-09T18:57:11.031639] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-09T18:57:11.033067] [INFO ] [MAIN ] Update Progress: 837/2373 symbols completed. FINV took 29.6s. Estimated remaining: 3h 34m 56s. Rate: 7.1 symbols/min [2025-10-09T18:57:11.196719] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-09T18:57:11.557309] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T18:57:11.996768] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-09T18:57:12.063322] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:57:12.642432] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T18:57:12.796741] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-09T18:57:13.596758] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-09T18:57:13.873433] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T18:57:14.296832] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T18:57:14.396734] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-09T18:57:14.847243] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:57:15.196743] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-09T18:57:15.493290] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:57:15.497505] [INFO ] [REMOTE ] FIGS: Full fetch complete (70810 records). [2025-10-09T18:57:15.497620] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-09T18:57:15.887090] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-09T18:57:15.887177] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-09T18:57:15.888132] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-09T18:57:15.888206] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-09T18:57:15.889738] [DEBUG] [LOCAL ] FIGS: Trimmed 70810 records to 49061 (keeping 200 days of data) [2025-10-09T18:57:15.996868] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-09T18:57:16.174138] [DEBUG] [LOCAL ] FIGS: Primary data saved (49061 records). [2025-10-09T18:57:16.174279] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-09T18:57:16.175188] [INFO ] [MAIN ] Update Progress: 838/2373 symbols completed. FIGS took 43.9s. Estimated remaining: 3h 34m 42s. Rate: 7.1 symbols/min [2025-10-09T18:57:16.699604] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T18:57:16.796697] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-09T18:57:17.425698] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:57:17.596779] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-09T18:57:17.760022] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T18:57:18.396729] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-09T18:57:19.409537] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:57:19.421393] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-09T18:57:19.686285] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T18:57:19.689912] [INFO ] [REMOTE ] FIHL: Full fetch complete (56070 records). [2025-10-09T18:57:19.690028] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-09T18:57:20.076222] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-09T18:57:20.076304] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-09T18:57:20.077116] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-09T18:57:20.077181] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-09T18:57:20.078347] [DEBUG] [LOCAL ] FIHL: Trimmed 56070 records to 39903 (keeping 200 days of data) [2025-10-09T18:57:20.325450] [DEBUG] [LOCAL ] FIHL: Primary data saved (39903 records). [2025-10-09T18:57:20.325594] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-09T18:57:20.325711] [INFO ] [MAIN ] Update Progress: 839/2373 symbols completed. FIHL took 45.9s. Estimated remaining: 3h 34m 26s. Rate: 7.2 symbols/min [2025-10-09T18:57:21.183078] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:57:21.195175] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-09T18:57:22.855420] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T18:57:22.868579] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-09T18:57:24.249904] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T18:57:24.254392] [INFO ] [REMOTE ] FIS: Full fetch complete (77178 records). [2025-10-09T18:57:24.254525] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-09T18:57:24.672053] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-09T18:57:24.672170] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-09T18:57:24.673194] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-09T18:57:24.673266] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-09T18:57:24.675084] [DEBUG] [LOCAL ] FIS: Trimmed 77178 records to 53737 (keeping 200 days of data) [2025-10-09T18:57:25.015187] [DEBUG] [LOCAL ] FIS: Primary data saved (53737 records). [2025-10-09T18:57:25.015328] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-09T18:57:25.015458] [INFO ] [MAIN ] Update Progress: 840/2373 symbols completed. FIS took 28.7s. Estimated remaining: 3h 34m 11s. Rate: 7.2 symbols/min [2025-10-09T18:57:25.652448] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:25.644283] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:25.714424] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-09T18:57:25.699780] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:25.717923] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:25.718237] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-09T18:57:25.718879] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-09T18:57:25.718927] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-09T18:57:25.718970] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-09T18:57:25.719003] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-09T18:57:25.830218] [DEBUG] [LOCAL ] FLC: Loaded 5366 existing records from primary storage. [2025-10-09T18:57:25.842233] [INFO ] [MAIN ] FLC: Loaded 5366 existing records. [2025-10-09T18:57:26.048852] [DEBUG] [LOCAL ] FIX: Loaded 29294 existing records from primary storage. [2025-10-09T18:57:26.068888] [INFO ] [MAIN ] FIX: Loaded 29294 existing records. [2025-10-09T18:57:26.319520] [DEBUG] [LOCAL ] FLG: Loaded 53325 existing records from primary storage. [2025-10-09T18:57:26.372278] [INFO ] [MAIN ] FLG: Loaded 53325 existing records. [2025-10-09T18:57:26.495961] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:26.520937] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-09T18:57:26.521064] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-09T18:57:26.632259] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:26.642857] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-09T18:57:26.693467] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-09T18:57:26.693557] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-09T18:57:26.751427] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-09T18:57:26.780044] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:26.880525] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-09T18:57:26.864027] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-09T18:57:26.948202] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-09T18:57:26.947932] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:26.998143] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-09T18:57:27.052965] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-09T18:57:27.161161] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-09T18:57:27.223533] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-09T18:57:27.233090] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:57:27.260119] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-09T18:57:27.346401] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:57:27.408150] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-09T18:57:27.423252] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:57:27.533781] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-09T18:57:27.573130] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-09T18:57:27.572860] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:27.587320] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-09T18:57:27.612401] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-09T18:57:27.662066] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-09T18:57:27.733672] [INFO ] [MAIN ] Update Progress: 841/2373 symbols completed. FIXT took 2.7s. Estimated remaining: 3h 33m 52s. Rate: 7.2 symbols/min [2025-10-09T18:57:27.911528] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:27.973548] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-09T18:57:28.119533] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:28.143381] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-09T18:57:28.175919] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:28.209949] [DEBUG] [LOCAL ] FLNG: Loaded 33564 existing records from primary storage. [2025-10-09T18:57:28.210243] [INFO ] [MAIN ] FLNG: Loaded 33564 existing records. [2025-10-09T18:57:28.393721] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T18:57:28.397277] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:28.399386] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-09T18:57:28.399563] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-09T18:57:28.400306] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-09T18:57:28.400522] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-09T18:57:28.400578] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-09T18:57:28.757629] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:28.758004] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-09T18:57:29.138550] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T18:57:29.140849] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-09T18:57:29.324587] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T18:57:29.330482] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-09T18:57:29.762177] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T18:57:29.763804] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-09T18:57:29.836530] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T18:57:29.847411] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-09T18:57:30.153193] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-09T18:57:30.155189] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-09T18:57:30.259103] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T18:57:30.396672] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-09T18:57:30.588212] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T18:57:30.620445] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-09T18:57:31.196697] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-09T18:57:31.379770] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T18:57:31.749154] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T18:57:31.791416] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T18:57:31.996712] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-09T18:57:32.540596] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-09T18:57:32.796716] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-09T18:57:33.310400] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T18:57:33.596801] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-09T18:57:34.270320] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T18:57:34.396689] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-09T18:57:34.795634] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T18:57:35.196700] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-09T18:57:35.996791] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-09T18:57:36.779303] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T18:57:36.780205] [INFO ] [REMOTE ] FLC: Full fetch complete (7788 records). [2025-10-09T18:57:36.780273] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-09T18:57:36.802019] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-09T18:57:36.906692] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T18:57:37.169967] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-09T18:57:37.170057] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-09T18:57:37.170287] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-09T18:57:37.170327] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-09T18:57:37.170746] [DEBUG] [LOCAL ] FLC: Trimmed 7788 records to 5406 (keeping 200 days of data) [2025-10-09T18:57:37.204244] [DEBUG] [LOCAL ] FLC: Primary data saved (5406 records). [2025-10-09T18:57:37.204342] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-09T18:57:37.204424] [INFO ] [MAIN ] Update Progress: 842/2373 symbols completed. FLC took 12.2s. Estimated remaining: 3h 33m 46s. Rate: 7.2 symbols/min [2025-10-09T18:57:37.370924] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:37.422418] [DEBUG] [LOCAL ] FLO: Loaded 51950 existing records from primary storage. [2025-10-09T18:57:37.422791] [INFO ] [MAIN ] FLO: Loaded 51950 existing records. [2025-10-09T18:57:37.601215] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:37.598451] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-09T18:57:37.601577] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-09T18:57:37.602550] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-09T18:57:37.602853] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-09T18:57:37.602925] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-09T18:57:37.959160] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:38.348753] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T18:57:38.396696] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-09T18:57:39.109132] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T18:57:39.196691] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-09T18:57:39.974006] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T18:57:39.996718] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-09T18:57:40.796690] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-09T18:57:40.917048] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T18:57:41.260587] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T18:57:41.596726] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-09T18:57:42.396689] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-09T18:57:42.471037] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T18:57:43.176619] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T18:57:43.196691] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-09T18:57:43.788228] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T18:57:43.996763] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-09T18:57:44.796787] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-09T18:57:44.994076] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T18:57:45.355984] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T18:57:45.596752] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-09T18:57:46.396725] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-09T18:57:46.443984] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T18:57:46.743969] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:57:47.196698] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-09T18:57:47.777809] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:57:47.996769] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-09T18:57:48.599504] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T18:57:48.796675] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-09T18:57:48.851481] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T18:57:49.596749] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-09T18:57:50.396739] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-09T18:57:50.518006] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T18:57:50.597687] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:57:51.196716] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-09T18:57:51.768922] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T18:57:51.996711] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-09T18:57:52.594282] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:57:52.796745] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-09T18:57:53.596777] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-09T18:57:53.704412] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T18:57:53.982099] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T18:57:54.396765] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-09T18:57:55.196713] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-09T18:57:55.336454] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:57:55.996714] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-09T18:57:56.796773] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-09T18:57:56.868893] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-09T18:57:57.539569] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-09T18:57:57.560071] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:57:57.565550] [INFO ] [REMOTE ] FLG: Full fetch complete (77284 records). [2025-10-09T18:57:57.565725] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-09T18:57:57.601818] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-09T18:57:57.967831] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-09T18:57:57.968071] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-09T18:57:57.969218] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-09T18:57:57.969439] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-09T18:57:57.971213] [DEBUG] [LOCAL ] FLG: Trimmed 77284 records to 53704 (keeping 200 days of data) [2025-10-09T18:57:58.182866] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T18:57:58.342188] [DEBUG] [LOCAL ] FLG: Primary data saved (53704 records). [2025-10-09T18:57:58.342327] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-09T18:57:58.342429] [INFO ] [MAIN ] Update Progress: 843/2373 symbols completed. FLG took 33.3s. Estimated remaining: 3h 34m 0s. Rate: 7.1 symbols/min [2025-10-09T18:57:58.404517] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-09T18:57:58.511126] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:58.511323] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-09T18:57:58.511459] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-09T18:57:58.511578] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-09T18:57:58.511620] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-09T18:57:58.511704] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-09T18:57:58.511760] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-09T18:57:58.862674] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:59.196229] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T18:57:59.204164] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-09T18:57:59.422850] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:57:59.423151] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-09T18:57:59.423254] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:57:59.423324] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-09T18:57:59.423390] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:57:59.423460] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-09T18:57:59.423539] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-09T18:57:59.423594] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-09T18:57:59.423673] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-09T18:57:59.423756] [INFO ] [MAIN ] Update Progress: 844/2373 symbols completed. FLOC took 1.1s. Estimated remaining: 3h 33m 39s. Rate: 7.2 symbols/min [2025-10-09T18:57:59.589334] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:59.637574] [DEBUG] [LOCAL ] FLR: Loaded 53168 existing records from primary storage. [2025-10-09T18:57:59.637975] [INFO ] [MAIN ] FLR: Loaded 53168 existing records. [2025-10-09T18:57:59.814047] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:59.814269] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-09T18:57:59.814315] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-09T18:57:59.814529] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-09T18:57:59.814585] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-09T18:57:59.996802] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-09T18:58:00.184359] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:00.228529] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T18:58:00.796749] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-09T18:58:01.596732] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-09T18:58:01.662381] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T18:58:02.216395] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T18:58:02.396707] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-09T18:58:02.758368] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T18:58:03.196715] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-09T18:58:03.838536] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T18:58:03.996721] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-09T18:58:04.233852] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T18:58:04.236633] [INFO ] [REMOTE ] FLNG: Full fetch complete (50273 records). [2025-10-09T18:58:04.236754] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-09T18:58:04.622936] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-09T18:58:04.623039] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-09T18:58:04.623817] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-09T18:58:04.623881] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-09T18:58:04.624949] [DEBUG] [LOCAL ] FLNG: Trimmed 50273 records to 33806 (keeping 200 days of data) [2025-10-09T18:58:04.812461] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-09T18:58:04.839239] [DEBUG] [LOCAL ] FLNG: Primary data saved (33806 records). [2025-10-09T18:58:04.839379] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-09T18:58:04.839505] [INFO ] [MAIN ] Update Progress: 845/2373 symbols completed. FLNG took 37.0s. Estimated remaining: 3h 33m 25s. Rate: 7.2 symbols/min [2025-10-09T18:58:05.008251] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:05.057672] [DEBUG] [LOCAL ] FLS: Loaded 50253 existing records from primary storage. [2025-10-09T18:58:05.058060] [INFO ] [MAIN ] FLS: Loaded 50253 existing records. [2025-10-09T18:58:05.243194] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:05.243401] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-09T18:58:05.243449] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-09T18:58:05.243712] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-09T18:58:05.243778] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-09T18:58:05.598705] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-09T18:58:05.711788] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:05.730563] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:58:06.396700] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-09T18:58:06.580694] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:58:06.940378] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T18:58:06.943197] [INFO ] [REMOTE ] FIX: Full fetch complete (45265 records). [2025-10-09T18:58:06.943296] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-09T18:58:07.201957] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-09T18:58:07.326207] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-09T18:58:07.326307] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-09T18:58:07.327091] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-09T18:58:07.327153] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-09T18:58:07.328278] [DEBUG] [LOCAL ] FIX: Trimmed 45265 records to 29455 (keeping 200 days of data) [2025-10-09T18:58:07.523614] [DEBUG] [LOCAL ] FIX: Primary data saved (29455 records). [2025-10-09T18:58:07.523774] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-09T18:58:07.523872] [INFO ] [MAIN ] Update Progress: 846/2373 symbols completed. FIX took 42.5s. Estimated remaining: 3h 33m 6s. Rate: 7.2 symbols/min [2025-10-09T18:58:07.691668] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:07.739334] [DEBUG] [LOCAL ] FLUT: Loaded 50781 existing records from primary storage. [2025-10-09T18:58:07.739634] [INFO ] [MAIN ] FLUT: Loaded 50781 existing records. [2025-10-09T18:58:07.921609] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:07.921863] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-09T18:58:07.921908] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-09T18:58:07.922148] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-09T18:58:07.922205] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-09T18:58:08.018963] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-09T18:58:08.307729] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:08.309812] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T18:58:08.499946] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T18:58:08.796722] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-09T18:58:09.596694] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-09T18:58:09.694136] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T18:58:10.396787] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-09T18:58:10.466316] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:58:10.741462] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T18:58:11.196686] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-09T18:58:11.996794] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-09T18:58:12.058147] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T18:58:12.796703] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-09T18:58:12.914338] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T18:58:13.405816] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:58:13.596784] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-09T18:58:14.396696] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-09T18:58:14.521038] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T18:58:15.196696] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-09T18:58:15.396661] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T18:58:15.996711] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-09T18:58:16.179838] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T18:58:16.450002] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T18:58:16.796708] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-09T18:58:17.596743] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-09T18:58:17.734795] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:58:17.739196] [INFO ] [REMOTE ] FLO: Full fetch complete (75070 records). [2025-10-09T18:58:17.739305] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-09T18:58:18.133324] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-09T18:58:18.133498] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-09T18:58:18.134532] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-09T18:58:18.134615] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-09T18:58:18.136218] [DEBUG] [LOCAL ] FLO: Trimmed 75070 records to 52335 (keeping 200 days of data) [2025-10-09T18:58:18.262692] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T18:58:18.397430] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-09T18:58:18.502856] [DEBUG] [LOCAL ] FLO: Primary data saved (52335 records). [2025-10-09T18:58:18.502993] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-09T18:58:18.503099] [INFO ] [MAIN ] Update Progress: 847/2373 symbols completed. FLO took 41.3s. Estimated remaining: 3h 33m 3s. Rate: 7.2 symbols/min [2025-10-09T18:58:18.668249] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:18.689252] [DEBUG] [LOCAL ] FLXR: Loaded 20757 existing records from primary storage. [2025-10-09T18:58:18.689482] [INFO ] [MAIN ] FLXR: Loaded 20757 existing records. [2025-10-09T18:58:18.864615] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:18.864815] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-09T18:58:18.864862] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-09T18:58:18.865071] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-09T18:58:18.865127] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-09T18:58:19.205851] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-09T18:58:19.245442] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:19.278521] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T18:58:19.996816] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-09T18:58:20.357972] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T18:58:20.736207] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T18:58:20.796708] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-09T18:58:20.860698] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:58:21.530498] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T18:58:21.596738] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-09T18:58:22.396745] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-09T18:58:22.397148] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:58:23.196753] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-09T18:58:23.982388] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T18:58:23.996669] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-09T18:58:24.679152] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T18:58:24.796711] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-09T18:58:25.596773] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-09T18:58:25.779996] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T18:58:26.289602] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T18:58:26.396674] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-09T18:58:26.921326] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:58:27.196756] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-09T18:58:27.962391] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T18:58:27.996707] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-09T18:58:28.796716] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-09T18:58:28.981717] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T18:58:29.498111] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:58:29.502505] [INFO ] [REMOTE ] FLR: Full fetch complete (76480 records). [2025-10-09T18:58:29.502598] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-09T18:58:29.598016] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-09T18:58:29.851448] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T18:58:29.930462] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-09T18:58:29.930538] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-09T18:58:29.931464] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-09T18:58:29.931528] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-09T18:58:29.932938] [DEBUG] [LOCAL ] FLR: Trimmed 76480 records to 53555 (keeping 200 days of data) [2025-10-09T18:58:30.252795] [DEBUG] [LOCAL ] FLR: Primary data saved (53555 records). [2025-10-09T18:58:30.252963] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-09T18:58:30.253075] [INFO ] [MAIN ] Update Progress: 848/2373 symbols completed. FLR took 30.8s. Estimated remaining: 3h 33m 0s. Rate: 7.2 symbols/min [2025-10-09T18:58:30.402544] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-09T18:58:30.429527] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:30.475994] [DEBUG] [LOCAL ] FMC: Loaded 51801 existing records from primary storage. [2025-10-09T18:58:30.476300] [INFO ] [MAIN ] FMC: Loaded 51801 existing records. [2025-10-09T18:58:30.660211] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:30.660415] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-09T18:58:30.660464] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-09T18:58:30.660735] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-09T18:58:30.660793] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-09T18:58:31.029902] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:31.041338] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T18:58:31.196682] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-09T18:58:31.325861] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T18:58:31.996733] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-09T18:58:32.796758] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-09T18:58:32.824094] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:58:32.908419] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T18:58:33.596747] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-09T18:58:34.133056] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:58:34.396691] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-09T18:58:34.641192] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:58:35.196746] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-09T18:58:35.996789] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-09T18:58:36.045489] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T18:58:36.796686] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-09T18:58:36.934256] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T18:58:37.581371] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T18:58:37.596699] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-09T18:58:38.023330] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T18:58:38.396700] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-09T18:58:39.028967] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T18:58:39.033362] [INFO ] [REMOTE ] FLS: Full fetch complete (71860 records). [2025-10-09T18:58:39.033497] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-09T18:58:39.206711] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-09T18:58:39.429812] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-09T18:58:39.429899] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-09T18:58:39.430876] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-09T18:58:39.430942] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-09T18:58:39.432309] [DEBUG] [LOCAL ] FLS: Trimmed 71860 records to 50642 (keeping 200 days of data) [2025-10-09T18:58:39.754146] [DEBUG] [LOCAL ] FLS: Primary data saved (50642 records). [2025-10-09T18:58:39.754285] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-09T18:58:39.754996] [INFO ] [MAIN ] Update Progress: 849/2373 symbols completed. FLS took 34.9s. Estimated remaining: 3h 32m 54s. Rate: 7.2 symbols/min [2025-10-09T18:58:39.932704] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:39.941781] [DEBUG] [LOCAL ] FMN: Loaded 5285 existing records from primary storage. [2025-10-09T18:58:39.942076] [INFO ] [MAIN ] FMN: Loaded 5285 existing records. [2025-10-09T18:58:40.002479] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-09T18:58:40.148981] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:40.149295] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-09T18:58:40.149491] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-09T18:58:40.149795] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-09T18:58:40.149938] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-09T18:58:40.461769] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-09T18:58:40.549385] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:40.796746] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-09T18:58:41.080538] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T18:58:41.135236] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T18:58:41.280317] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T18:58:41.596702] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-09T18:58:42.381635] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T18:58:42.396664] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-09T18:58:43.120590] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T18:58:43.196715] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-09T18:58:43.996780] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-09T18:58:44.796758] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-09T18:58:44.867578] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T18:58:45.032976] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T18:58:45.463925] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T18:58:45.596719] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-09T18:58:46.396741] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-09T18:58:47.187732] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T18:58:47.196672] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-09T18:58:47.646276] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T18:58:47.681860] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T18:58:47.996704] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-09T18:58:48.582379] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T18:58:48.796703] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-09T18:58:49.596741] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-09T18:58:49.909820] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T18:58:50.396727] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-09T18:58:51.072428] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T18:58:51.143516] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:58:51.196676] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-09T18:58:51.996713] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-09T18:58:52.796735] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-09T18:58:52.947504] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:58:53.085784] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T18:58:53.088320] [INFO ] [REMOTE ] FLXR: Full fetch complete (26320 records). [2025-10-09T18:58:53.088390] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-09T18:58:53.449938] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-09T18:58:53.450016] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-09T18:58:53.450567] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-09T18:58:53.450618] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-09T18:58:53.451507] [DEBUG] [LOCAL ] FLXR: Trimmed 26320 records to 20932 (keeping 200 days of data) [2025-10-09T18:58:53.577197] [DEBUG] [LOCAL ] FLXR: Primary data saved (20932 records). [2025-10-09T18:58:53.577321] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-09T18:58:53.577398] [INFO ] [MAIN ] Update Progress: 850/2373 symbols completed. FLXR took 35.1s. Estimated remaining: 3h 32m 55s. Rate: 7.2 symbols/min [2025-10-09T18:58:53.606800] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-09T18:58:53.760319] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:53.793613] [DEBUG] [LOCAL ] FMS: Loaded 29995 existing records from primary storage. [2025-10-09T18:58:53.793956] [INFO ] [MAIN ] FMS: Loaded 29995 existing records. [2025-10-09T18:58:53.985871] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:53.986143] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-09T18:58:53.986220] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-09T18:58:53.986498] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-09T18:58:53.986557] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-09T18:58:54.354830] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T18:58:54.383600] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:54.396674] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-09T18:58:54.493183] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T18:58:54.499104] [INFO ] [REMOTE ] FLUT: Full fetch complete (73033 records). [2025-10-09T18:58:54.499251] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-09T18:58:54.882447] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-09T18:58:54.882540] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-09T18:58:54.883553] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-09T18:58:54.883625] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-09T18:58:54.885343] [DEBUG] [LOCAL ] FLUT: Trimmed 73033 records to 51157 (keeping 200 days of data) [2025-10-09T18:58:55.196806] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-09T18:58:55.208545] [DEBUG] [LOCAL ] FLUT: Primary data saved (51157 records). [2025-10-09T18:58:55.208749] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-09T18:58:55.209977] [INFO ] [MAIN ] Update Progress: 851/2373 symbols completed. FLUT took 47.7s. Estimated remaining: 3h 32m 35s. Rate: 7.2 symbols/min [2025-10-09T18:58:55.377563] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:55.418296] [DEBUG] [LOCAL ] FMX: Loaded 40585 existing records from primary storage. [2025-10-09T18:58:55.418593] [INFO ] [MAIN ] FMX: Loaded 40585 existing records. [2025-10-09T18:58:55.604183] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:55.619878] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-09T18:58:55.620380] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T18:58:55.620584] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-09T18:58:55.626822] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-09T18:58:55.626881] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-09T18:58:55.808534] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T18:58:55.988322] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:55.996665] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-09T18:58:56.796718] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-09T18:58:57.420173] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T18:58:57.431763] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T18:58:57.432911] [INFO ] [REMOTE ] FMN: Full fetch complete (9994 records). [2025-10-09T18:58:57.432981] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-09T18:58:57.602272] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-09T18:58:57.792262] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-09T18:58:57.792354] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-09T18:58:57.792696] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-09T18:58:57.792761] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-09T18:58:57.793414] [DEBUG] [LOCAL ] FMN: Trimmed 9994 records to 5363 (keeping 200 days of data) [2025-10-09T18:58:57.830925] [DEBUG] [LOCAL ] FMN: Primary data saved (5363 records). [2025-10-09T18:58:57.831076] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-09T18:58:57.831165] [INFO ] [MAIN ] Update Progress: 852/2373 symbols completed. FMN took 18.1s. Estimated remaining: 3h 32m 16s. Rate: 7.2 symbols/min [2025-10-09T18:58:57.995133] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:57.999296] [DEBUG] [LOCAL ] FMY: Loaded 1384 existing records from primary storage. [2025-10-09T18:58:57.999450] [INFO ] [MAIN ] FMY: Loaded 1384 existing records. [2025-10-09T18:58:58.170935] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:58.171159] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-09T18:58:58.171206] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-09T18:58:58.171525] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-09T18:58:58.171583] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-09T18:58:58.406020] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-09T18:58:58.523160] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:58.917461] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:58:59.196749] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-09T18:58:59.557266] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T18:58:59.996741] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-09T18:59:00.124276] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:59:00.356999] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-09T18:59:00.796735] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-09T18:59:01.596733] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-09T18:59:02.262040] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T18:59:02.396716] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-09T18:59:03.070036] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T18:59:03.196686] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-09T18:59:03.884355] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T18:59:03.996709] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-09T18:59:04.796686] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-09T18:59:04.913083] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T18:59:05.117297] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:59:05.120197] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T18:59:05.596728] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-09T18:59:06.396715] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-09T18:59:06.709525] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-09T18:59:06.761273] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T18:59:07.196749] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-09T18:59:07.645593] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:59:07.996726] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-09T18:59:08.345753] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-09T18:59:08.796704] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-09T18:59:09.596764] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-09T18:59:10.158110] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T18:59:10.396706] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-09T18:59:11.196687] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-09T18:59:11.237517] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T18:59:11.449031] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T18:59:11.511896] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T18:59:11.996717] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-09T18:59:12.796725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-09T18:59:13.183807] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-09T18:59:13.529077] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:59:13.596683] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-09T18:59:14.396710] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-09T18:59:15.196724] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-09T18:59:15.370333] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T18:59:15.901137] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T18:59:15.996676] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-09T18:59:16.488056] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T18:59:16.796725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-09T18:59:17.249100] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T18:59:17.535768] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T18:59:17.596695] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-09T18:59:17.954113] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T18:59:18.396702] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-09T18:59:18.833902] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T18:59:18.834562] [INFO ] [REMOTE ] FMY: Full fetch complete (1968 records). [2025-10-09T18:59:18.834629] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-09T18:59:19.186154] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-09T18:59:19.186232] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-09T18:59:19.186325] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-09T18:59:19.186363] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-09T18:59:19.186711] [DEBUG] [LOCAL ] FMY: Trimmed 1968 records to 1393 (keeping 200 days of data) [2025-10-09T18:59:19.195878] [DEBUG] [LOCAL ] FMY: Primary data saved (1393 records). [2025-10-09T18:59:19.195944] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-09T18:59:19.196011] [INFO ] [MAIN ] Update Progress: 853/2373 symbols completed. FMY took 21.4s. Estimated remaining: 3h 32m 31s. Rate: 7.2 symbols/min [2025-10-09T18:59:19.206626] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-09T18:59:19.370741] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:19.416678] [DEBUG] [LOCAL ] FN: Loaded 38138 existing records from primary storage. [2025-10-09T18:59:19.417005] [INFO ] [MAIN ] FN: Loaded 38138 existing records. [2025-10-09T18:59:19.595355] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:19.595608] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-09T18:59:19.595686] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-09T18:59:19.596010] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-09T18:59:19.596074] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-09T18:59:19.955762] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:19.996756] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-09T18:59:20.642823] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T18:59:20.796731] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-09T18:59:21.596737] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-09T18:59:21.813681] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T18:59:21.830488] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T18:59:21.835219] [INFO ] [REMOTE ] FMC: Full fetch complete (75143 records). [2025-10-09T18:59:21.835335] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-09T18:59:22.226779] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-09T18:59:22.226867] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-09T18:59:22.227801] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-09T18:59:22.227869] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-09T18:59:22.229295] [DEBUG] [LOCAL ] FMC: Trimmed 75143 records to 52191 (keeping 200 days of data) [2025-10-09T18:59:22.420460] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-09T18:59:22.573570] [DEBUG] [LOCAL ] FMC: Primary data saved (52191 records). [2025-10-09T18:59:22.573743] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-09T18:59:22.573834] [INFO ] [MAIN ] Update Progress: 854/2373 symbols completed. FMC took 52.3s. Estimated remaining: 3h 32m 14s. Rate: 7.2 symbols/min [2025-10-09T18:59:22.755467] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:22.776439] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:59:22.832558] [DEBUG] [LOCAL ] FNB: Loaded 52530 existing records from primary storage. [2025-10-09T18:59:22.832953] [INFO ] [MAIN ] FNB: Loaded 52530 existing records. [2025-10-09T18:59:23.017489] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:23.017761] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-09T18:59:23.017858] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-09T18:59:23.018724] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-09T18:59:23.018785] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-09T18:59:23.209468] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-09T18:59:23.383058] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:23.714436] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T18:59:23.996718] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-09T18:59:24.579139] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T18:59:24.796781] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-09T18:59:25.385779] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:59:25.596706] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-09T18:59:26.191794] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:59:26.396762] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-09T18:59:26.864864] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T18:59:26.868747] [INFO ] [REMOTE ] FMS: Full fetch complete (42409 records). [2025-10-09T18:59:26.868941] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-09T18:59:27.205070] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-09T18:59:27.246801] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-09T18:59:27.246883] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-09T18:59:27.247544] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-09T18:59:27.247585] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-09T18:59:27.250321] [DEBUG] [LOCAL ] FMS: Trimmed 42409 records to 30246 (keeping 200 days of data) [2025-10-09T18:59:27.449769] [DEBUG] [LOCAL ] FMS: Primary data saved (30246 records). [2025-10-09T18:59:27.449966] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-09T18:59:27.450070] [INFO ] [MAIN ] Update Progress: 855/2373 symbols completed. FMS took 33.9s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-10-09T18:59:27.658762] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:27.713916] [DEBUG] [LOCAL ] FND: Loaded 52108 existing records from primary storage. [2025-10-09T18:59:27.714243] [INFO ] [MAIN ] FND: Loaded 52108 existing records. [2025-10-09T18:59:27.934145] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:27.934423] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-09T18:59:27.934586] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-09T18:59:27.935052] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-09T18:59:27.935140] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-09T18:59:28.012017] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-09T18:59:28.048184] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:59:28.323211] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:28.796697] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-09T18:59:28.848485] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T18:59:29.596717] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-09T18:59:29.730838] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T18:59:30.394202] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T18:59:30.405035] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-09T18:59:31.196696] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-09T18:59:31.336772] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T18:59:31.983187] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T18:59:31.996665] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-09T18:59:32.796681] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-09T18:59:32.890227] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T18:59:33.237534] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:59:33.240735] [INFO ] [REMOTE ] FMX: Full fetch complete (57518 records). [2025-10-09T18:59:33.240822] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-09T18:59:33.598499] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-09T18:59:33.618316] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-09T18:59:33.618425] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-09T18:59:33.619262] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-09T18:59:33.619331] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-09T18:59:33.620767] [DEBUG] [LOCAL ] FMX: Trimmed 57518 records to 40806 (keeping 200 days of data) [2025-10-09T18:59:33.874684] [DEBUG] [LOCAL ] FMX: Primary data saved (40806 records). [2025-10-09T18:59:33.874896] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-09T18:59:33.875005] [INFO ] [MAIN ] Update Progress: 856/2373 symbols completed. FMX took 38.7s. Estimated remaining: 3h 31m 47s. Rate: 7.2 symbols/min [2025-10-09T18:59:34.085084] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:34.115721] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:59:34.169517] [DEBUG] [LOCAL ] FNF: Loaded 48933 existing records from primary storage. [2025-10-09T18:59:34.169875] [INFO ] [MAIN ] FNF: Loaded 48933 existing records. [2025-10-09T18:59:34.345898] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:34.346132] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-09T18:59:34.346178] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-09T18:59:34.347733] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-09T18:59:34.347814] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-09T18:59:34.401912] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-09T18:59:34.697260] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:35.196682] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-09T18:59:35.305281] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:59:35.834627] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T18:59:35.996698] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-09T18:59:36.682903] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T18:59:36.796704] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-09T18:59:37.596690] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-09T18:59:37.653948] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T18:59:37.815437] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T18:59:38.396725] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-09T18:59:39.163109] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:59:39.196697] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-09T18:59:39.996687] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-09T18:59:40.118124] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T18:59:40.703541] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T18:59:40.796728] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-09T18:59:41.315430] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T18:59:41.596787] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-09T18:59:42.397079] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-09T18:59:42.402028] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T18:59:43.108680] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:59:43.196683] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-09T18:59:43.762479] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T18:59:43.996715] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-09T18:59:44.782906] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T18:59:44.796665] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-09T18:59:45.596799] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-09T18:59:45.647915] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:59:46.396697] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-09T18:59:46.442989] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:59:46.972452] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:59:47.196715] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-09T18:59:47.479616] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:59:47.996714] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-09T18:59:48.796770] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-09T18:59:48.955663] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T18:59:49.596832] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-09T18:59:49.736572] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:59:50.215747] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T18:59:50.396745] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-09T18:59:50.729566] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:59:50.732277] [INFO ] [REMOTE ] FN: Full fetch complete (56009 records). [2025-10-09T18:59:50.732366] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-09T18:59:51.118332] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-09T18:59:51.118402] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-09T18:59:51.119183] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-09T18:59:51.119247] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-09T18:59:51.120328] [DEBUG] [LOCAL ] FN: Trimmed 56009 records to 38337 (keeping 200 days of data) [2025-10-09T18:59:51.214495] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-09T18:59:51.364680] [DEBUG] [LOCAL ] FN: Primary data saved (38337 records). [2025-10-09T18:59:51.364841] [INFO ] [MAIN ] FN: Full history saved. [2025-10-09T18:59:51.365479] [INFO ] [MAIN ] Update Progress: 857/2373 symbols completed. FN took 32.2s. Estimated remaining: 3h 31m 55s. Rate: 7.2 symbols/min [2025-10-09T18:59:51.534965] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:51.582606] [DEBUG] [LOCAL ] FNV: Loaded 46166 existing records from primary storage. [2025-10-09T18:59:51.582955] [INFO ] [MAIN ] FNV: Loaded 46166 existing records. [2025-10-09T18:59:51.758411] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:51.758953] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-09T18:59:51.759106] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-09T18:59:51.760820] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-09T18:59:51.760882] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-09T18:59:52.002662] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-09T18:59:52.121038] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:52.149591] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T18:59:52.315303] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T18:59:52.796710] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-09T18:59:53.421291] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T18:59:53.596761] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-09T18:59:54.396674] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-09T18:59:54.512014] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T18:59:55.140571] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T18:59:55.196667] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-09T18:59:55.996731] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-09T18:59:56.121061] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T18:59:56.802573] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-09T18:59:56.814304] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:59:57.335348] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:59:57.596733] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-09T18:59:58.149080] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T18:59:58.153518] [INFO ] [REMOTE ] FNB: Full fetch complete (75888 records). [2025-10-09T18:59:58.153625] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-09T18:59:58.404924] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-09T18:59:58.538305] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-09T18:59:58.538389] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-09T18:59:58.539350] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-09T18:59:58.539416] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-09T18:59:58.540925] [DEBUG] [LOCAL ] FNB: Trimmed 75888 records to 52919 (keeping 200 days of data) [2025-10-09T18:59:58.875725] [DEBUG] [LOCAL ] FNB: Primary data saved (52919 records). [2025-10-09T18:59:58.875884] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-09T18:59:58.875979] [INFO ] [MAIN ] Update Progress: 858/2373 symbols completed. FNB took 36.3s. Estimated remaining: 3h 31m 45s. Rate: 7.2 symbols/min [2025-10-09T18:59:59.043326] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:59.056883] [DEBUG] [LOCAL ] FOA: Loaded 13062 existing records from primary storage. [2025-10-09T18:59:59.057090] [INFO ] [MAIN ] FOA: Loaded 13062 existing records. [2025-10-09T18:59:59.197579] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-09T18:59:59.237967] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:59.238462] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-09T18:59:59.238573] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-09T18:59:59.239308] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-09T18:59:59.239374] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-09T18:59:59.602137] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:59.631911] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-09T18:59:59.923766] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T18:59:59.996675] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-09T19:00:00.790593] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T19:00:00.801748] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-09T19:00:01.596713] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-09T19:00:01.729775] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:00:02.015769] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:00:02.396730] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-09T19:00:03.196730] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-09T19:00:03.468230] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T19:00:03.996942] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-09T19:00:04.153475] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T19:00:04.796987] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-09T19:00:05.026590] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:00:05.096080] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:00:05.596730] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-09T19:00:06.396755] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-09T19:00:06.508459] [DEBUG] [REMOTE ] FOA: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-09T19:00:06.508830] [WARN ] [REMOTE ] FOA: No data returned for month 2025-02 [2025-10-09T19:00:06.508938] [FATAL] [REMOTE ] FOA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:00:06.509035] [FATAL] [MAIN ] FOA: Failed to fetch primary data. [2025-10-09T19:00:06.509101] [WARN ] [MAIN ] FOA: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:00:06.509174] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-09T19:00:06.509253] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-10-09T19:00:06.509310] [INFO ] [LOCAL ] FOA: Starting deletion of derivative data. [2025-10-09T19:00:06.509625] [DEBUG] [LOCAL ] FOA: Deleted derivative data file. [2025-10-09T19:00:06.509755] [INFO ] [MAIN ] Update Progress: 859/2373 symbols completed. FOA took 7.6s. Estimated remaining: 3h 31m 35s. Rate: 7.2 symbols/min [2025-10-09T19:00:06.697501] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:06.710006] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-09T19:00:06.715098] [INFO ] [REMOTE ] FND: Full fetch complete (74734 records). [2025-10-09T19:00:06.715273] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-09T19:00:06.806460] [DEBUG] [LOCAL ] FOF: Loaded 8522 existing records from primary storage. [2025-10-09T19:00:06.823591] [INFO ] [MAIN ] FOF: Loaded 8522 existing records. [2025-10-09T19:00:07.207108] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T19:00:07.212588] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-09T19:00:07.258789] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:07.259124] [INFO ] [REMOTE ] FNF: Full fetch complete (69711 records). [2025-10-09T19:00:07.259330] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-09T19:00:07.265057] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-09T19:00:07.265391] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-09T19:00:07.300206] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-09T19:00:07.329706] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-09T19:00:07.469111] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-09T19:00:07.523593] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-09T19:00:07.567080] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-09T19:00:07.592138] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-09T19:00:07.863047] [DEBUG] [LOCAL ] FND: Trimmed 74734 records to 52495 (keeping 200 days of data) [2025-10-09T19:00:08.147230] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:08.166327] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-09T19:00:08.241008] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-09T19:00:08.241340] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-09T19:00:08.242247] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-09T19:00:08.242329] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-09T19:00:08.245629] [DEBUG] [LOCAL ] FNF: Trimmed 69711 records to 49306 (keeping 200 days of data) [2025-10-09T19:00:08.802249] [DEBUG] [LOCAL ] FND: Primary data saved (52495 records). [2025-10-09T19:00:08.803018] [INFO ] [MAIN ] FND: Full history saved. [2025-10-09T19:00:08.803379] [INFO ] [MAIN ] Update Progress: 860/2373 symbols completed. FND took 41.4s. Estimated remaining: 3h 31m 16s. Rate: 7.2 symbols/min [2025-10-09T19:00:08.921554] [DEBUG] [LOCAL ] FNF: Primary data saved (49306 records). [2025-10-09T19:00:08.932574] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-09T19:00:08.956870] [INFO ] [MAIN ] Update Progress: 861/2373 symbols completed. FNF took 35.1s. Estimated remaining: 3h 30m 53s. Rate: 7.2 symbols/min [2025-10-09T19:00:09.038180] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:09.092980] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T19:00:09.117538] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-09T19:00:09.229976] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:09.237135] [DEBUG] [LOCAL ] FOR: Loaded 19696 existing records from primary storage. [2025-10-09T19:00:09.237519] [INFO ] [MAIN ] FOR: Loaded 19696 existing records. [2025-10-09T19:00:09.426294] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:09.426832] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-09T19:00:09.426935] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-09T19:00:09.437619] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-09T19:00:09.451497] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-09T19:00:09.535939] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-09T19:00:09.598594] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-09T19:00:09.629025] [DEBUG] [LOCAL ] FOUR: Loaded 49586 existing records from primary storage. [2025-10-09T19:00:09.640003] [INFO ] [MAIN ] FOUR: Loaded 49586 existing records. [2025-10-09T19:00:09.781956] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T19:00:10.122453] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:10.128614] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:10.129294] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-09T19:00:10.129355] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-09T19:00:10.130733] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-09T19:00:10.130795] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-09T19:00:10.404300] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-09T19:00:10.487753] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:11.196697] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-09T19:00:11.296285] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T19:00:11.411191] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:00:11.990600] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T19:00:11.996674] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-09T19:00:12.796714] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-09T19:00:13.031340] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T19:00:13.596743] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-09T19:00:13.812336] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:00:14.396772] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-09T19:00:15.196700] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-09T19:00:15.237827] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T19:00:15.473406] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T19:00:15.996693] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-09T19:00:16.082550] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T19:00:16.796762] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-09T19:00:17.604112] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-09T19:00:17.622491] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:00:17.662705] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T19:00:18.396811] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-09T19:00:19.196697] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-09T19:00:19.348767] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T19:00:19.637420] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T19:00:19.912778] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T19:00:19.996685] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-09T19:00:20.706598] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:00:20.796726] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-09T19:00:21.500635] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T19:00:21.596714] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-09T19:00:22.241830] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T19:00:22.396748] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-09T19:00:23.165354] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T19:00:23.196790] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-09T19:00:23.996718] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-09T19:00:24.654094] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T19:00:24.745536] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T19:00:24.796693] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-09T19:00:25.596764] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-09T19:00:25.685793] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T19:00:25.687075] [INFO ] [REMOTE ] FOF: Full fetch complete (11891 records). [2025-10-09T19:00:25.687149] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-09T19:00:26.047502] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-09T19:00:26.047581] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-09T19:00:26.047929] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-09T19:00:26.047991] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-09T19:00:26.048448] [DEBUG] [LOCAL ] FOF: Trimmed 11891 records to 8601 (keeping 200 days of data) [2025-10-09T19:00:26.102850] [DEBUG] [LOCAL ] FOF: Primary data saved (8601 records). [2025-10-09T19:00:26.102981] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-09T19:00:26.103064] [INFO ] [MAIN ] Update Progress: 862/2373 symbols completed. FOF took 19.6s. Estimated remaining: 3h 31m 0s. Rate: 7.2 symbols/min [2025-10-09T19:00:26.275578] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:26.295849] [DEBUG] [LOCAL ] FPF: Loaded 18595 existing records from primary storage. [2025-10-09T19:00:26.296113] [INFO ] [MAIN ] FPF: Loaded 18595 existing records. [2025-10-09T19:00:26.399847] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-09T19:00:26.479490] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:26.479710] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-09T19:00:26.479767] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-09T19:00:26.480527] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-09T19:00:26.480587] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-09T19:00:26.791056] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T19:00:26.851702] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:27.196744] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-09T19:00:27.996770] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-09T19:00:28.080721] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T19:00:28.183105] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T19:00:28.759808] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T19:00:28.796673] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-09T19:00:29.596726] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-09T19:00:29.891490] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:00:30.396694] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-09T19:00:31.196725] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-09T19:00:31.362035] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T19:00:31.414468] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:00:31.996715] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-09T19:00:32.796735] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-09T19:00:32.891484] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T19:00:33.363009] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T19:00:33.596709] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-09T19:00:33.714982] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:00:34.396763] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-09T19:00:34.557040] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T19:00:35.196726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-09T19:00:35.996840] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-09T19:00:36.131438] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T19:00:36.156748] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T19:00:36.796715] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-09T19:00:37.596726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-09T19:00:37.628878] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:00:37.634181] [INFO ] [REMOTE ] FNV: Full fetch complete (66553 records). [2025-10-09T19:00:37.634402] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-09T19:00:38.025375] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-09T19:00:38.025549] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-09T19:00:38.026700] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-09T19:00:38.026784] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-09T19:00:38.028315] [DEBUG] [LOCAL ] FNV: Trimmed 66553 records to 46540 (keeping 200 days of data) [2025-10-09T19:00:38.279473] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T19:00:38.371724] [DEBUG] [LOCAL ] FNV: Primary data saved (46540 records). [2025-10-09T19:00:38.371875] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-09T19:00:38.372602] [INFO ] [MAIN ] Update Progress: 863/2373 symbols completed. FNV took 47.0s. Estimated remaining: 3h 30m 59s. Rate: 7.2 symbols/min [2025-10-09T19:00:38.401960] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-09T19:00:38.487202] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T19:00:38.562725] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:38.582778] [DEBUG] [LOCAL ] FPH: Loaded 19300 existing records from primary storage. [2025-10-09T19:00:38.583044] [INFO ] [MAIN ] FPH: Loaded 19300 existing records. [2025-10-09T19:00:38.756820] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:38.757062] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-09T19:00:38.757109] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-09T19:00:38.757927] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-09T19:00:38.757986] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-09T19:00:39.114510] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:39.196730] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-09T19:00:39.656745] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:00:39.996715] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-09T19:00:40.252356] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:00:40.796718] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-09T19:00:40.987395] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T19:00:41.596760] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-09T19:00:42.370668] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T19:00:42.402142] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-09T19:00:42.408772] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T19:00:43.196720] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-09T19:00:43.974607] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:00:43.996682] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-09T19:00:44.059851] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T19:00:44.796739] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-09T19:00:45.596716] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-09T19:00:45.695575] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T19:00:45.698192] [INFO ] [REMOTE ] FOR: Full fetch complete (29831 records). [2025-10-09T19:00:45.698331] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-09T19:00:46.100314] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-09T19:00:46.100952] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-09T19:00:46.102530] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T19:00:46.103573] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-09T19:00:46.114175] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-09T19:00:46.116001] [DEBUG] [LOCAL ] FOR: Trimmed 29831 records to 19850 (keeping 200 days of data) [2025-10-09T19:00:46.235077] [DEBUG] [LOCAL ] FOR: Primary data saved (19850 records). [2025-10-09T19:00:46.235232] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-09T19:00:46.235320] [INFO ] [MAIN ] Update Progress: 864/2373 symbols completed. FOR took 37.4s. Estimated remaining: 3h 30m 50s. Rate: 7.2 symbols/min [2025-10-09T19:00:46.404383] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-09T19:00:46.424506] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:46.456488] [DEBUG] [LOCAL ] FPI: Loaded 31074 existing records from primary storage. [2025-10-09T19:00:46.456847] [INFO ] [MAIN ] FPI: Loaded 31074 existing records. [2025-10-09T19:00:46.649924] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:46.651933] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-09T19:00:46.652005] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-09T19:00:46.653179] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T19:00:46.653240] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-09T19:00:46.659502] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-09T19:00:47.011020] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:47.196728] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-09T19:00:47.715593] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:00:47.720014] [INFO ] [REMOTE ] FOUR: Full fetch complete (72030 records). [2025-10-09T19:00:47.720136] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-09T19:00:48.005591] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-09T19:00:48.120030] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-09T19:00:48.120111] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-09T19:00:48.121114] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-09T19:00:48.121182] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-09T19:00:48.123250] [DEBUG] [LOCAL ] FOUR: Trimmed 72030 records to 49959 (keeping 200 days of data) [2025-10-09T19:00:48.354559] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T19:00:48.457218] [DEBUG] [LOCAL ] FOUR: Primary data saved (49959 records). [2025-10-09T19:00:48.457360] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-09T19:00:48.457510] [INFO ] [MAIN ] Update Progress: 865/2373 symbols completed. FOUR took 39.5s. Estimated remaining: 3h 30m 30s. Rate: 7.2 symbols/min [2025-10-09T19:00:48.643283] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:48.685014] [DEBUG] [LOCAL ] FR: Loaded 46358 existing records from primary storage. [2025-10-09T19:00:48.685349] [INFO ] [MAIN ] FR: Loaded 46358 existing records. [2025-10-09T19:00:48.801845] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-09T19:00:48.872763] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:48.872952] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-09T19:00:48.873021] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-09T19:00:48.874719] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-09T19:00:48.874783] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-09T19:00:49.248909] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:49.267167] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T19:00:49.596728] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-09T19:00:49.610428] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T19:00:50.396697] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-09T19:00:50.692327] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T19:00:50.960917] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T19:00:51.196745] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-09T19:00:51.996736] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-09T19:00:52.255024] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T19:00:52.722747] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T19:00:52.796714] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-09T19:00:53.596753] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-09T19:00:53.739739] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T19:00:54.396703] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-09T19:00:54.703206] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:00:55.196720] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-09T19:00:55.975421] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T19:00:55.996676] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-09T19:00:56.174435] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T19:00:56.796750] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-09T19:00:57.425958] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T19:00:57.596687] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-09T19:00:57.850610] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T19:00:57.853143] [INFO ] [REMOTE ] FPF: Full fetch complete (26672 records). [2025-10-09T19:00:57.853218] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-09T19:00:58.246497] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-09T19:00:58.246614] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-09T19:00:58.247234] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-09T19:00:58.247287] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-09T19:00:58.248033] [DEBUG] [LOCAL ] FPF: Trimmed 26672 records to 18750 (keeping 200 days of data) [2025-10-09T19:00:58.366624] [DEBUG] [LOCAL ] FPF: Primary data saved (18750 records). [2025-10-09T19:00:58.366819] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-09T19:00:58.366908] [INFO ] [MAIN ] Update Progress: 866/2373 symbols completed. FPF took 32.3s. Estimated remaining: 3h 30m 25s. Rate: 7.2 symbols/min [2025-10-09T19:00:58.402963] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-09T19:00:58.562311] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:58.577848] [DEBUG] [LOCAL ] FRA: Loaded 14561 existing records from primary storage. [2025-10-09T19:00:58.578097] [INFO ] [MAIN ] FRA: Loaded 14561 existing records. [2025-10-09T19:00:58.762230] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:58.762511] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-09T19:00:58.762582] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-09T19:00:58.763410] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-09T19:00:58.763473] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-09T19:00:59.188131] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:59.209576] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-09T19:00:59.212534] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T19:00:59.468982] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T19:00:59.996724] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-09T19:01:00.323838] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T19:01:00.796687] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-09T19:01:00.985545] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T19:01:01.596681] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-09T19:01:01.882459] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:01:02.396690] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-09T19:01:02.783788] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T19:01:03.196688] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-09T19:01:03.425587] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T19:01:03.996744] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-09T19:01:04.796683] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-09T19:01:04.912300] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:01:05.057350] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T19:01:05.596753] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-09T19:01:05.942297] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:01:05.944904] [INFO ] [REMOTE ] FPH: Full fetch complete (31182 records). [2025-10-09T19:01:05.944996] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-09T19:01:06.325702] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-09T19:01:06.325818] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-09T19:01:06.326559] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-09T19:01:06.326610] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-09T19:01:06.327444] [DEBUG] [LOCAL ] FPH: Trimmed 31182 records to 19427 (keeping 200 days of data) [2025-10-09T19:01:06.404086] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-09T19:01:06.439277] [DEBUG] [LOCAL ] FPH: Primary data saved (19427 records). [2025-10-09T19:01:06.439433] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-09T19:01:06.439518] [INFO ] [MAIN ] Update Progress: 867/2373 symbols completed. FPH took 28.1s. Estimated remaining: 3h 30m 16s. Rate: 7.2 symbols/min [2025-10-09T19:01:06.606004] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:06.606176] [DEBUG] [LOCAL ] FRGE: No existing data file found in primary storage. [2025-10-09T19:01:06.606213] [WARN ] [MAIN ] FRGE: No existing data found, performing full refresh instead. [2025-10-09T19:01:06.606322] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-09T19:01:06.606364] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-09T19:01:06.606404] [DEBUG] [LOCAL ] FRGE: No primary data file found to delete. [2025-10-09T19:01:06.606436] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-09T19:01:06.968264] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:07.196712] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-09T19:01:07.313124] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:01:07.807134] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:01:07.996832] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-09T19:01:08.329698] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:01:08.796734] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-09T19:01:09.226549] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T19:01:09.596716] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-09T19:01:09.998957] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T19:01:10.324019] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T19:01:10.396745] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-09T19:01:11.196709] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-09T19:01:11.468127] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:01:11.996726] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-09T19:01:12.429490] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:01:12.796696] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-09T19:01:13.521750] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:01:13.564825] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:01:13.596678] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-09T19:01:14.396746] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-09T19:01:15.116944] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:01:15.196767] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-09T19:01:15.403716] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T19:01:15.996735] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-09T19:01:16.516083] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T19:01:16.796753] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-09T19:01:16.941027] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T19:01:17.596694] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-09T19:01:18.032424] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:01:18.396767] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-09T19:01:19.080338] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:01:19.111697] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:01:19.196761] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-09T19:01:19.996738] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-09T19:01:20.550560] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:01:20.796738] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-09T19:01:21.004946] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:01:21.596710] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-09T19:01:22.302286] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T19:01:22.403926] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-09T19:01:22.404815] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T19:01:23.196772] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-09T19:01:23.907420] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T19:01:23.911437] [INFO ] [REMOTE ] FR: Full fetch complete (66690 records). [2025-10-09T19:01:23.911546] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-09T19:01:24.002123] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-09T19:01:24.339783] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-09T19:01:24.340830] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T19:01:24.340397] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-09T19:01:24.345818] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-09T19:01:24.346027] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-09T19:01:24.347396] [DEBUG] [LOCAL ] FR: Trimmed 66690 records to 46701 (keeping 200 days of data) [2025-10-09T19:01:24.644396] [DEBUG] [LOCAL ] FR: Primary data saved (46701 records). [2025-10-09T19:01:24.644535] [INFO ] [MAIN ] FR: Full history saved. [2025-10-09T19:01:24.645714] [INFO ] [MAIN ] Update Progress: 868/2373 symbols completed. FR took 36.2s. Estimated remaining: 3h 30m 24s. Rate: 7.2 symbols/min [2025-10-09T19:01:24.800671] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-09T19:01:24.822302] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:24.878357] [DEBUG] [LOCAL ] FRO: Loaded 51674 existing records from primary storage. [2025-10-09T19:01:24.878720] [INFO ] [MAIN ] FRO: Loaded 51674 existing records. [2025-10-09T19:01:25.059404] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:25.059728] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-09T19:01:25.059791] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-09T19:01:25.061372] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-09T19:01:25.061436] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-09T19:01:25.428781] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:25.454884] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T19:01:25.596676] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-09T19:01:25.733037] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T19:01:25.735072] [INFO ] [REMOTE ] FRA: Full fetch complete (23869 records). [2025-10-09T19:01:25.735144] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-09T19:01:26.097959] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-09T19:01:26.098036] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-09T19:01:26.098486] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-09T19:01:26.098532] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-09T19:01:26.099181] [DEBUG] [LOCAL ] FRA: Trimmed 23869 records to 14632 (keeping 200 days of data) [2025-10-09T19:01:26.191944] [DEBUG] [LOCAL ] FRA: Primary data saved (14632 records). [2025-10-09T19:01:26.192080] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-09T19:01:26.192161] [INFO ] [MAIN ] Update Progress: 869/2373 symbols completed. FRA took 27.8s. Estimated remaining: 3h 30m 4s. Rate: 7.2 symbols/min [2025-10-09T19:01:26.362880] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:26.403467] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-09T19:01:26.406116] [DEBUG] [LOCAL ] FRT: Loaded 41872 existing records from primary storage. [2025-10-09T19:01:26.406409] [INFO ] [MAIN ] FRT: Loaded 41872 existing records. [2025-10-09T19:01:26.582993] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:26.583181] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-09T19:01:26.583229] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-09T19:01:26.584384] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-09T19:01:26.584442] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-09T19:01:26.956377] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T19:01:26.955534] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:27.196725] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-09T19:01:27.996707] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-09T19:01:28.445321] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T19:01:28.710132] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:01:28.796836] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-09T19:01:29.250880] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:01:29.564200] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T19:01:29.596668] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-09T19:01:30.396697] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-09T19:01:30.444844] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:01:31.196798] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-09T19:01:31.720820] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T19:01:31.979116] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T19:01:31.996762] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-09T19:01:32.795808] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T19:01:32.798835] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-09T19:01:33.596754] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-09T19:01:34.396738] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-09T19:01:34.788030] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-09T19:01:35.045821] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T19:01:35.196683] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-09T19:01:35.440739] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T19:01:35.443509] [INFO ] [REMOTE ] FPI: Full fetch complete (44018 records). [2025-10-09T19:01:35.443587] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-09T19:01:35.813541] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-09T19:01:35.813624] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-09T19:01:35.814322] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-09T19:01:35.814374] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-09T19:01:35.815396] [DEBUG] [LOCAL ] FPI: Trimmed 44018 records to 31242 (keeping 200 days of data) [2025-10-09T19:01:35.996983] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-09T19:01:36.012629] [DEBUG] [LOCAL ] FPI: Primary data saved (31242 records). [2025-10-09T19:01:36.012807] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-09T19:01:36.012909] [INFO ] [MAIN ] Update Progress: 870/2373 symbols completed. FPI took 49.8s. Estimated remaining: 3h 29m 58s. Rate: 7.2 symbols/min [2025-10-09T19:01:36.186055] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:36.225350] [DEBUG] [LOCAL ] FSCO: Loaded 38029 existing records from primary storage. [2025-10-09T19:01:36.225697] [INFO ] [MAIN ] FSCO: Loaded 38029 existing records. [2025-10-09T19:01:36.442555] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:36.442804] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-09T19:01:36.442854] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-09T19:01:36.443855] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-09T19:01:36.443917] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-09T19:01:36.798539] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-09T19:01:36.835516] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:01:36.841949] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:36.843223] [INFO ] [REMOTE ] FRGE: Full fetch complete (31558 records). [2025-10-09T19:01:36.843470] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-09T19:01:37.048556] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T19:01:37.287631] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-09T19:01:37.287749] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-09T19:01:37.288470] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-09T19:01:37.288573] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-09T19:01:37.289489] [DEBUG] [LOCAL ] FRGE: Trimmed 31558 records to 16985 (keeping 200 days of data) [2025-10-09T19:01:37.412782] [DEBUG] [LOCAL ] FRGE: Primary data saved (16985 records). [2025-10-09T19:01:37.412931] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-09T19:01:37.413010] [INFO ] [MAIN ] Update Progress: 871/2373 symbols completed. FRGE took 31.0s. Estimated remaining: 3h 29m 38s. Rate: 7.2 symbols/min [2025-10-09T19:01:37.608426] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-09T19:01:37.613530] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:37.667270] [DEBUG] [LOCAL ] FSK: Loaded 49404 existing records from primary storage. [2025-10-09T19:01:37.667622] [INFO ] [MAIN ] FSK: Loaded 49404 existing records. [2025-10-09T19:01:37.868524] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:37.868767] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-09T19:01:37.868820] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-09T19:01:37.870179] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-09T19:01:37.870239] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-09T19:01:38.222838] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:38.396761] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-09T19:01:38.719517] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-09T19:01:39.196704] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-09T19:01:39.295949] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T19:01:39.996739] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-09T19:01:40.109124] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T19:01:40.422896] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T19:01:40.796769] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-09T19:01:41.564077] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:01:41.596734] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-09T19:01:42.396691] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-09T19:01:42.539008] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:01:43.009079] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:01:43.196747] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-09T19:01:43.951805] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T19:01:43.996667] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-09T19:01:44.673777] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T19:01:44.796700] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-09T19:01:45.583972] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:01:45.596668] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-09T19:01:46.255031] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:01:46.396697] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-09T19:01:47.196726] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-09T19:01:47.304045] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:01:47.963298] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:01:47.996694] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-09T19:01:48.498580] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T19:01:48.796717] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-09T19:01:49.506590] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T19:01:49.596741] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-09T19:01:49.694245] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T19:01:50.396717] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-09T19:01:51.036860] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:01:51.040719] [INFO ] [REMOTE ] FRT: Full fetch complete (60341 records). [2025-10-09T19:01:51.040854] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-09T19:01:51.206793] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-09T19:01:51.498033] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-09T19:01:51.498127] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-09T19:01:51.499045] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-09T19:01:51.499113] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-09T19:01:51.500512] [DEBUG] [LOCAL ] FRT: Trimmed 60341 records to 42147 (keeping 200 days of data) [2025-10-09T19:01:51.798474] [DEBUG] [LOCAL ] FRT: Primary data saved (42147 records). [2025-10-09T19:01:51.798609] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-09T19:01:51.798729] [INFO ] [MAIN ] Update Progress: 872/2373 symbols completed. FRT took 25.6s. Estimated remaining: 3h 29m 40s. Rate: 7.2 symbols/min [2025-10-09T19:01:51.968208] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:51.996690] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-09T19:01:52.015333] [DEBUG] [LOCAL ] FSLY: Loaded 51235 existing records from primary storage. [2025-10-09T19:01:52.015630] [INFO ] [MAIN ] FSLY: Loaded 51235 existing records. [2025-10-09T19:01:52.193725] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:52.193945] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-09T19:01:52.194233] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-09T19:01:52.204048] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-09T19:01:52.217557] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-09T19:01:52.304988] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T19:01:52.586680] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:52.796725] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-09T19:01:53.202224] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T19:01:53.340266] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T19:01:53.596731] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-09T19:01:54.396704] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-09T19:01:54.746202] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T19:01:54.979025] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T19:01:55.196729] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-09T19:01:55.996789] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-09T19:01:56.030964] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T19:01:56.796717] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-09T19:01:56.889981] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T19:01:57.282763] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T19:01:57.596740] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-09T19:01:58.396700] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-09T19:01:58.793207] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T19:01:59.196722] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-09T19:01:59.261241] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:01:59.769127] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T19:01:59.996788] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-09T19:02:00.796803] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-09T19:02:00.881239] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T19:02:01.596897] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-09T19:02:01.662010] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T19:02:01.949162] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T19:02:02.396730] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-09T19:02:03.196743] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-09T19:02:03.254885] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T19:02:03.598739] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T19:02:03.996691] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-09T19:02:04.796786] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-09T19:02:04.863562] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T19:02:05.596711] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-09T19:02:05.801719] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T19:02:06.396703] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-09T19:02:06.523600] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T19:02:07.196703] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-09T19:02:07.336331] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T19:02:07.340689] [INFO ] [REMOTE ] FRO: Full fetch complete (75199 records). [2025-10-09T19:02:07.340814] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-09T19:02:07.759111] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-09T19:02:07.759200] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-09T19:02:07.760178] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-09T19:02:07.760255] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-09T19:02:07.761817] [DEBUG] [LOCAL ] FRO: Trimmed 75199 records to 52062 (keeping 200 days of data) [2025-10-09T19:02:07.996802] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-09T19:02:08.097677] [DEBUG] [LOCAL ] FRO: Primary data saved (52062 records). [2025-10-09T19:02:08.097852] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-09T19:02:08.099005] [INFO ] [MAIN ] Update Progress: 873/2373 symbols completed. FRO took 43.5s. Estimated remaining: 3h 29m 45s. Rate: 7.2 symbols/min [2025-10-09T19:02:08.274538] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:08.305590] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T19:02:08.365817] [DEBUG] [LOCAL ] FSM: Loaded 53296 existing records from primary storage. [2025-10-09T19:02:08.366167] [INFO ] [MAIN ] FSM: Loaded 53296 existing records. [2025-10-09T19:02:08.539819] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:08.539994] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-09T19:02:08.540040] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-09T19:02:08.541287] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-09T19:02:08.541347] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-09T19:02:08.796805] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-09T19:02:08.798498] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:02:08.840549] [INFO ] [REMOTE ] FSK: Full fetch complete (71685 records). [2025-10-09T19:02:08.869753] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-09T19:02:09.060060] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:09.358027] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-09T19:02:09.358135] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-09T19:02:09.359263] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-09T19:02:09.359371] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-09T19:02:09.360918] [DEBUG] [LOCAL ] FSK: Trimmed 71685 records to 49791 (keeping 200 days of data) [2025-10-09T19:02:09.479568] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T19:02:09.608451] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-09T19:02:09.707686] [DEBUG] [LOCAL ] FSK: Primary data saved (49791 records). [2025-10-09T19:02:09.707850] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-09T19:02:09.708427] [INFO ] [MAIN ] Update Progress: 874/2373 symbols completed. FSK took 32.3s. Estimated remaining: 3h 29m 25s. Rate: 7.2 symbols/min [2025-10-09T19:02:09.877142] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:09.912138] [DEBUG] [LOCAL ] FSS: Loaded 33877 existing records from primary storage. [2025-10-09T19:02:09.912434] [INFO ] [MAIN ] FSS: Loaded 33877 existing records. [2025-10-09T19:02:10.090952] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:10.091251] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-09T19:02:10.091394] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-09T19:02:10.092715] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-09T19:02:10.092779] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-09T19:02:10.398718] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-09T19:02:10.456314] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:10.488667] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T19:02:10.912911] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T19:02:11.196776] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-09T19:02:11.996779] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-09T19:02:12.314451] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T19:02:12.796682] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-09T19:02:12.877955] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:02:12.955001] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T19:02:13.596732] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-09T19:02:14.396708] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-09T19:02:14.549704] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:02:14.575257] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T19:02:15.196775] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-09T19:02:15.956783] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:02:15.996727] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-09T19:02:16.626725] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T19:02:16.796718] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-09T19:02:17.114724] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T19:02:17.596768] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-09T19:02:18.396726] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-09T19:02:18.503960] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:02:19.140690] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:02:19.196696] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-09T19:02:19.935904] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:02:19.996785] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-09T19:02:20.796820] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-09T19:02:21.116787] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T19:02:21.437190] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T19:02:21.596778] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-09T19:02:22.229423] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T19:02:22.396747] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-09T19:02:22.803163] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:02:23.196776] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-09T19:02:23.351066] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:02:23.996747] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-09T19:02:24.612411] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T19:02:24.796739] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-09T19:02:25.160861] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T19:02:25.165570] [INFO ] [REMOTE ] FSCO: Full fetch complete (54749 records). [2025-10-09T19:02:25.165789] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-09T19:02:25.549671] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-09T19:02:25.549764] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-09T19:02:25.550528] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-09T19:02:25.550568] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-09T19:02:25.551721] [DEBUG] [LOCAL ] FSCO: Trimmed 54749 records to 38325 (keeping 200 days of data) [2025-10-09T19:02:25.606347] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-09T19:02:25.789851] [DEBUG] [LOCAL ] FSCO: Primary data saved (38325 records). [2025-10-09T19:02:25.790003] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-09T19:02:25.790168] [INFO ] [MAIN ] Update Progress: 875/2373 symbols completed. FSCO took 49.8s. Estimated remaining: 3h 29m 30s. Rate: 7.2 symbols/min [2025-10-09T19:02:25.965320] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:25.973818] [DEBUG] [LOCAL ] FT: Loaded 6607 existing records from primary storage. [2025-10-09T19:02:25.974022] [INFO ] [MAIN ] FT: Loaded 6607 existing records. [2025-10-09T19:02:26.156706] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:26.157085] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-09T19:02:26.157148] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-09T19:02:26.157495] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-09T19:02:26.157556] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-09T19:02:26.335252] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T19:02:26.404317] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-09T19:02:26.417351] [INFO ] [REMOTE ] FSLY: Full fetch complete (74862 records). [2025-10-09T19:02:26.417531] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-09T19:02:26.697400] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:27.045572] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-09T19:02:27.047164] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:02:27.047259] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-09T19:02:27.048794] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-09T19:02:27.055615] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-09T19:02:27.057882] [DEBUG] [LOCAL ] FSLY: Trimmed 74862 records to 51612 (keeping 200 days of data) [2025-10-09T19:02:27.215166] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-09T19:02:27.350113] [DEBUG] [LOCAL ] FSLY: Primary data saved (51612 records). [2025-10-09T19:02:27.350252] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-09T19:02:27.350332] [INFO ] [MAIN ] Update Progress: 876/2373 symbols completed. FSLY took 35.6s. Estimated remaining: 3h 29m 10s. Rate: 7.2 symbols/min [2025-10-09T19:02:27.516898] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:27.529712] [DEBUG] [LOCAL ] FTHY: Loaded 12273 existing records from primary storage. [2025-10-09T19:02:27.529911] [INFO ] [MAIN ] FTHY: Loaded 12273 existing records. [2025-10-09T19:02:27.712432] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:27.712684] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-09T19:02:27.712749] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-09T19:02:27.713142] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-09T19:02:27.713232] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-09T19:02:28.000148] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-09T19:02:28.082582] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:28.203535] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T19:02:28.342246] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T19:02:28.734667] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T19:02:28.796736] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-09T19:02:29.596765] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-09T19:02:29.783541] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T19:02:30.239851] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T19:02:30.396788] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-09T19:02:31.196728] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-09T19:02:31.286902] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T19:02:31.996736] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-09T19:02:32.533480] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T19:02:32.796731] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-09T19:02:33.229664] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T19:02:33.474404] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T19:02:33.596765] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-09T19:02:34.309521] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-09T19:02:34.396730] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-09T19:02:35.130873] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T19:02:35.196740] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-09T19:02:35.996721] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-09T19:02:36.705962] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T19:02:36.796690] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-09T19:02:37.069128] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T19:02:37.493738] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T19:02:37.596731] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-09T19:02:38.396732] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-09T19:02:38.814800] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T19:02:38.985210] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T19:02:39.196761] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-09T19:02:39.996742] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-09T19:02:40.330245] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T19:02:40.333189] [INFO ] [REMOTE ] FSS: Full fetch complete (48401 records). [2025-10-09T19:02:40.333282] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-09T19:02:40.730121] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-09T19:02:40.730205] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-09T19:02:40.731125] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-09T19:02:40.731192] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-09T19:02:40.732392] [DEBUG] [LOCAL ] FSS: Trimmed 48401 records to 34059 (keeping 200 days of data) [2025-10-09T19:02:40.797351] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-09T19:02:40.845351] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:02:40.981007] [DEBUG] [LOCAL ] FSS: Primary data saved (34059 records). [2025-10-09T19:02:40.981181] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-09T19:02:40.981808] [INFO ] [MAIN ] Update Progress: 877/2373 symbols completed. FSS took 31.3s. Estimated remaining: 3h 29m 10s. Rate: 7.2 symbols/min [2025-10-09T19:02:41.596768] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-09T19:02:42.328832] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T19:02:42.396684] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-09T19:02:42.628493] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:02:43.196732] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-09T19:02:43.267082] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T19:02:43.996724] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-09T19:02:44.769615] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:02:44.796672] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-09T19:02:44.957395] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T19:02:44.962038] [INFO ] [REMOTE ] FSM: Full fetch complete (76847 records). [2025-10-09T19:02:44.962173] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-09T19:02:45.354977] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-09T19:02:45.355059] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-09T19:02:45.356022] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-09T19:02:45.356089] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-09T19:02:45.357714] [DEBUG] [LOCAL ] FSM: Trimmed 76847 records to 53686 (keeping 200 days of data) [2025-10-09T19:02:45.569232] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T19:02:45.596734] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-09T19:02:45.686244] [DEBUG] [LOCAL ] FSM: Primary data saved (53686 records). [2025-10-09T19:02:45.686399] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-09T19:02:45.687856] [INFO ] [MAIN ] Update Progress: 878/2373 symbols completed. FSM took 37.6s. Estimated remaining: 3h 28m 56s. Rate: 7.2 symbols/min [2025-10-09T19:02:46.309903] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T19:02:46.396697] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-09T19:02:46.882294] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T19:02:47.196775] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-09T19:02:47.987980] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:02:47.996664] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-09T19:02:48.718477] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T19:02:48.720368] [INFO ] [REMOTE ] FTHY: Full fetch complete (17558 records). [2025-10-09T19:02:48.720455] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-09T19:02:48.810070] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-09T19:02:49.084739] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-09T19:02:49.084817] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-09T19:02:49.085237] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-09T19:02:49.085278] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-09T19:02:49.085889] [DEBUG] [LOCAL ] FTHY: Trimmed 17558 records to 12386 (keeping 200 days of data) [2025-10-09T19:02:49.175639] [DEBUG] [LOCAL ] FTHY: Primary data saved (12386 records). [2025-10-09T19:02:49.175835] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-09T19:02:49.175953] [INFO ] [MAIN ] Update Progress: 879/2373 symbols completed. FTHY took 21.8s. Estimated remaining: 3h 28m 39s. Rate: 7.2 symbols/min [2025-10-09T19:02:49.362729] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T19:02:49.596730] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-09T19:02:50.302479] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T19:02:50.396837] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-09T19:02:50.991549] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T19:02:50.992852] [INFO ] [REMOTE ] FT: Full fetch complete (9240 records). [2025-10-09T19:02:50.992920] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-09T19:02:51.351547] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-09T19:02:51.351632] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-09T19:02:51.351917] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-09T19:02:51.351963] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-09T19:02:51.352409] [DEBUG] [LOCAL ] FT: Trimmed 9240 records to 6755 (keeping 200 days of data) [2025-10-09T19:02:51.393299] [DEBUG] [LOCAL ] FT: Primary data saved (6755 records). [2025-10-09T19:02:51.393443] [INFO ] [MAIN ] FT: Full history saved. [2025-10-09T19:02:51.393530] [INFO ] [MAIN ] Update Progress: 880/2373 symbols completed. FT took 25.6s. Estimated remaining: 3h 28m 20s. Rate: 7.2 symbols/min [2025-10-09T19:02:51.992865] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:51.995816] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:52.102795] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:52.123073] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:52.172169] [DEBUG] [LOCAL ] FTS: Loaded 42429 existing records from primary storage. [2025-10-09T19:02:52.182450] [INFO ] [MAIN ] FTS: Loaded 42429 existing records. [2025-10-09T19:02:52.255845] [DEBUG] [LOCAL ] FTV: Loaded 52988 existing records from primary storage. [2025-10-09T19:02:52.282396] [DEBUG] [LOCAL ] FTK: Loaded 32569 existing records from primary storage. [2025-10-09T19:02:52.288260] [INFO ] [MAIN ] FTV: Loaded 52988 existing records. [2025-10-09T19:02:52.294021] [INFO ] [MAIN ] FTK: Loaded 32569 existing records. [2025-10-09T19:02:52.624147] [DEBUG] [LOCAL ] FTI: Loaded 53294 existing records from primary storage. [2025-10-09T19:02:52.673254] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:52.673439] [INFO ] [MAIN ] FTI: Loaded 53294 existing records. [2025-10-09T19:02:52.725414] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-09T19:02:52.771151] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-09T19:02:52.807805] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-09T19:02:52.867054] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:52.911490] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-09T19:02:52.911669] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-09T19:02:52.927107] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-09T19:02:52.954516] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:52.965375] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-09T19:02:52.985527] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-09T19:02:53.013967] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-09T19:02:52.990891] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-09T19:02:53.042470] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-09T19:02:53.059505] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-09T19:02:53.501425] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:53.523265] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-09T19:02:53.603381] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-09T19:02:53.816086] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-09T19:02:53.853239] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-09T19:02:54.145617] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:54.203624] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-09T19:02:54.241956] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:54.273540] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-09T19:02:54.409251] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:54.448434] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-09T19:02:54.601883] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:54.602199] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-09T19:02:55.238631] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T19:02:55.243701] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-09T19:02:55.459154] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T19:02:55.467173] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-09T19:02:56.008091] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T19:02:56.013569] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-09T19:02:56.170952] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T19:02:56.272697] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T19:02:56.458716] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T19:02:56.796724] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-09T19:02:57.086010] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T19:02:57.596727] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-09T19:02:58.403903] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-09T19:02:58.426941] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T19:02:58.722771] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:02:59.196833] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-09T19:02:59.996777] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-09T19:03:00.078395] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T19:03:00.796799] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-09T19:03:00.839265] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:03:01.540058] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:03:01.596779] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-09T19:03:02.156685] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T19:03:02.396773] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-09T19:03:03.152324] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:03:03.196689] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-09T19:03:03.996729] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-09T19:03:04.086556] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T19:03:04.787706] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:03:04.798864] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-09T19:03:05.290903] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T19:03:05.596727] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-09T19:03:06.396703] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-09T19:03:06.519218] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:03:07.180905] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T19:03:07.196666] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-09T19:03:07.996694] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-09T19:03:08.363957] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T19:03:08.410200] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T19:03:08.796730] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-09T19:03:09.097094] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T19:03:09.596750] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-09T19:03:10.396685] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-09T19:03:10.620022] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T19:03:10.849458] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T19:03:11.196733] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-09T19:03:11.928547] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:03:11.996677] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-09T19:03:12.787023] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T19:03:12.802066] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-09T19:03:13.596691] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-09T19:03:13.882221] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T19:03:13.909408] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T19:03:14.396799] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-09T19:03:15.202427] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-09T19:03:15.207665] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T19:03:15.646032] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T19:03:15.996773] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-09T19:03:16.796692] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-09T19:03:17.150639] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T19:03:17.453771] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:03:17.596756] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-09T19:03:18.230371] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:03:18.396741] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-09T19:03:19.050423] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T19:03:19.196715] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-09T19:03:19.907485] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T19:03:19.911418] [INFO ] [REMOTE ] FTS: Full fetch complete (60250 records). [2025-10-09T19:03:19.911520] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-09T19:03:20.001990] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-09T19:03:20.301544] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-09T19:03:20.301697] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-09T19:03:20.302927] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-09T19:03:20.303012] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-09T19:03:20.304916] [DEBUG] [LOCAL ] FTS: Trimmed 60250 records to 42723 (keeping 200 days of data) [2025-10-09T19:03:20.573734] [DEBUG] [LOCAL ] FTS: Primary data saved (42723 records). [2025-10-09T19:03:20.573863] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-09T19:03:20.573944] [INFO ] [MAIN ] Update Progress: 881/2373 symbols completed. FTS took 29.2s. Estimated remaining: 3h 28m 47s. Rate: 7.1 symbols/min [2025-10-09T19:03:20.748569] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:20.752766] [DEBUG] [LOCAL ] FTWO: Loaded 1882 existing records from primary storage. [2025-10-09T19:03:20.752958] [INFO ] [MAIN ] FTWO: Loaded 1882 existing records. [2025-10-09T19:03:20.816688] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-09T19:03:20.942971] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:20.943365] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-09T19:03:20.943438] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-09T19:03:20.944003] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-09T19:03:20.944104] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-09T19:03:21.136486] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T19:03:21.385071] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:21.517602] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:03:21.596772] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-09T19:03:22.396741] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-09T19:03:22.613705] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T19:03:22.760577] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T19:03:23.196695] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-09T19:03:23.275718] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T19:03:23.996728] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-09T19:03:24.542380] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T19:03:24.796723] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-09T19:03:25.368206] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T19:03:25.372622] [INFO ] [REMOTE ] FTV: Full fetch complete (76406 records). [2025-10-09T19:03:25.372766] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-09T19:03:25.601781] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-09T19:03:25.771520] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-09T19:03:25.771600] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-09T19:03:25.772584] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-09T19:03:25.772672] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-09T19:03:25.777148] [DEBUG] [LOCAL ] FTV: Trimmed 76406 records to 53377 (keeping 200 days of data) [2025-10-09T19:03:26.115498] [DEBUG] [LOCAL ] FTV: Primary data saved (53377 records). [2025-10-09T19:03:26.115619] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-09T19:03:26.115738] [INFO ] [MAIN ] Update Progress: 882/2373 symbols completed. FTV took 34.7s. Estimated remaining: 3h 28m 34s. Rate: 7.1 symbols/min [2025-10-09T19:03:26.291376] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:26.296858] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T19:03:26.301765] [INFO ] [REMOTE ] FTI: Full fetch complete (77123 records). [2025-10-09T19:03:26.301924] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-09T19:03:26.402845] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-09T19:03:26.685159] [DEBUG] [LOCAL ] FUBO: Loaded 53705 existing records from primary storage. [2025-10-09T19:03:26.701068] [INFO ] [MAIN ] FUBO: Loaded 53705 existing records. [2025-10-09T19:03:26.890412] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-09T19:03:26.916801] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-09T19:03:26.930817] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-09T19:03:26.941313] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-09T19:03:26.972296] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:26.972916] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-09T19:03:26.973030] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-09T19:03:26.974686] [DEBUG] [LOCAL ] FTI: Trimmed 77123 records to 53681 (keeping 200 days of data) [2025-10-09T19:03:26.974896] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-09T19:03:26.975266] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-09T19:03:27.169161] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:03:27.202047] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T19:03:27.222988] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-09T19:03:27.488220] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:27.718620] [DEBUG] [LOCAL ] FTI: Primary data saved (53681 records). [2025-10-09T19:03:27.718801] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-09T19:03:27.719517] [INFO ] [MAIN ] Update Progress: 883/2373 symbols completed. FTI took 36.3s. Estimated remaining: 3h 28m 14s. Rate: 7.2 symbols/min [2025-10-09T19:03:27.815925] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T19:03:27.895801] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:27.927464] [DEBUG] [LOCAL ] FUL: Loaded 32850 existing records from primary storage. [2025-10-09T19:03:27.927751] [INFO ] [MAIN ] FUL: Loaded 32850 existing records. [2025-10-09T19:03:28.001828] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-09T19:03:28.104501] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:28.104748] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-09T19:03:28.104818] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-09T19:03:28.105638] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-09T19:03:28.105734] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-09T19:03:28.460015] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:28.796725] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-09T19:03:29.084696] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-09T19:03:29.596728] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-09T19:03:29.916363] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T19:03:30.035457] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:03:30.396717] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-09T19:03:30.753546] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T19:03:31.196714] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-09T19:03:31.669448] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T19:03:31.996800] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-09T19:03:32.436599] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T19:03:32.796748] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-09T19:03:33.596716] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-09T19:03:34.396727] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-09T19:03:34.947521] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T19:03:34.951486] [INFO ] [REMOTE ] FTK: Full fetch complete (43819 records). [2025-10-09T19:03:34.951601] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-09T19:03:35.207603] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-09T19:03:35.405067] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-09T19:03:35.428316] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-09T19:03:35.428413] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-09T19:03:35.429250] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-09T19:03:35.429313] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-09T19:03:35.430359] [DEBUG] [LOCAL ] FTK: Trimmed 43819 records to 32796 (keeping 200 days of data) [2025-10-09T19:03:35.552078] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T19:03:35.573948] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T19:03:35.665195] [DEBUG] [LOCAL ] FTK: Primary data saved (32796 records). [2025-10-09T19:03:35.665342] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-09T19:03:35.665433] [INFO ] [MAIN ] Update Progress: 884/2373 symbols completed. FTK took 44.3s. Estimated remaining: 3h 28m 5s. Rate: 7.2 symbols/min [2025-10-09T19:03:35.837529] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:35.889748] [DEBUG] [LOCAL ] FUN: Loaded 51776 existing records from primary storage. [2025-10-09T19:03:35.890092] [INFO ] [MAIN ] FUN: Loaded 51776 existing records. [2025-10-09T19:03:36.001845] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-09T19:03:36.077778] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:36.078042] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-09T19:03:36.078094] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-09T19:03:36.079497] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-09T19:03:36.079558] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-09T19:03:36.478660] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:36.505388] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T19:03:36.796732] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-09T19:03:37.596718] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-09T19:03:38.396724] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-09T19:03:38.991834] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T19:03:38.992743] [INFO ] [REMOTE ] FTWO: Full fetch complete (3326 records). [2025-10-09T19:03:38.992817] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-09T19:03:39.135229] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:03:39.220565] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-09T19:03:39.259919] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-09T19:03:39.455771] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-09T19:03:39.455886] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-09T19:03:39.456031] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-09T19:03:39.456073] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-09T19:03:39.456399] [DEBUG] [LOCAL ] FTWO: Trimmed 3326 records to 1903 (keeping 200 days of data) [2025-10-09T19:03:39.469019] [DEBUG] [LOCAL ] FTWO: Primary data saved (1903 records). [2025-10-09T19:03:39.469078] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-09T19:03:39.469145] [INFO ] [MAIN ] Update Progress: 885/2373 symbols completed. FTWO took 18.9s. Estimated remaining: 3h 27m 49s. Rate: 7.2 symbols/min [2025-10-09T19:03:39.637379] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:39.661131] [DEBUG] [LOCAL ] FVR: Loaded 21569 existing records from primary storage. [2025-10-09T19:03:39.661386] [INFO ] [MAIN ] FVR: Loaded 21569 existing records. [2025-10-09T19:03:39.873687] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:39.873907] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-09T19:03:39.873953] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-09T19:03:39.874787] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-09T19:03:39.874846] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-09T19:03:40.012202] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-09T19:03:40.235725] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:40.488303] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T19:03:40.796694] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-09T19:03:41.596796] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-09T19:03:41.898991] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T19:03:42.281626] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-09T19:03:42.396718] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-09T19:03:43.151016] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:03:43.196670] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-09T19:03:43.691950] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T19:03:43.996727] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-09T19:03:44.796740] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-09T19:03:45.244118] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:03:45.309141] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T19:03:45.596738] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-09T19:03:46.037558] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T19:03:46.396780] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-09T19:03:47.025952] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:03:47.196697] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-09T19:03:47.420091] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:03:47.996723] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-09T19:03:48.796751] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-09T19:03:49.440597] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-09T19:03:49.482334] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T19:03:49.596725] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-09T19:03:49.656297] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T19:03:50.396736] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-09T19:03:50.503167] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:03:51.196722] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-09T19:03:51.990705] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T19:03:51.996668] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-09T19:03:52.148995] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:03:52.794434] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T19:03:52.798765] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-09T19:03:53.596757] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-09T19:03:54.138155] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T19:03:54.396729] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-09T19:03:55.035486] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:03:55.196717] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-09T19:03:55.707738] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T19:03:55.996750] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-09T19:03:56.427041] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:03:56.796784] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-09T19:03:57.251491] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T19:03:57.596701] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-09T19:03:57.921120] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T19:03:58.396780] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-09T19:03:59.196738] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-09T19:03:59.996739] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-09T19:04:00.137376] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-09T19:04:00.188284] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T19:04:00.425754] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:04:00.796772] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-09T19:04:01.131529] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:04:01.596751] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-09T19:04:02.396691] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-09T19:04:02.645955] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T19:04:02.732634] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:04:03.196755] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-09T19:04:03.572872] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:04:03.575872] [INFO ] [REMOTE ] FUL: Full fetch complete (47841 records). [2025-10-09T19:04:03.575959] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-09T19:04:03.976533] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-09T19:04:03.976687] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-09T19:04:03.977434] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-09T19:04:03.977600] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-09T19:04:03.990964] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T19:04:03.995638] [DEBUG] [LOCAL ] FUL: Trimmed 47841 records to 33056 (keeping 200 days of data) [2025-10-09T19:04:03.996798] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-09T19:04:04.208603] [DEBUG] [LOCAL ] FUL: Primary data saved (33056 records). [2025-10-09T19:04:04.208817] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-09T19:04:04.209592] [INFO ] [MAIN ] Update Progress: 886/2373 symbols completed. FUL took 36.5s. Estimated remaining: 3h 28m 8s. Rate: 7.1 symbols/min [2025-10-09T19:04:04.409195] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:04.452231] [DEBUG] [LOCAL ] FVRR: Loaded 40243 existing records from primary storage. [2025-10-09T19:04:04.452564] [INFO ] [MAIN ] FVRR: Loaded 40243 existing records. [2025-10-09T19:04:04.633714] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:04.633977] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-09T19:04:04.634039] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-09T19:04:04.635379] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-09T19:04:04.635439] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-09T19:04:04.806225] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-09T19:04:04.996125] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:05.596784] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-09T19:04:05.902568] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T19:04:06.396774] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-09T19:04:07.109348] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:04:07.146847] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-09T19:04:07.173143] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:04:07.196685] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-09T19:04:07.996744] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-09T19:04:08.796806] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-09T19:04:08.884328] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T19:04:08.906877] [DEBUG] [REMOTE ] FVR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-09T19:04:08.907489] [WARN ] [REMOTE ] FVR: No data returned for month 2025-10 [2025-10-09T19:04:08.907896] [FATAL] [REMOTE ] FVR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:04:08.908397] [FATAL] [MAIN ] FVR: Failed to fetch primary data. [2025-10-09T19:04:08.908503] [WARN ] [MAIN ] FVR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:04:08.908586] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-09T19:04:08.908743] [DEBUG] [LOCAL ] FVR: No primary data file found to delete. [2025-10-09T19:04:08.908821] [INFO ] [LOCAL ] FVR: Starting deletion of derivative data. [2025-10-09T19:04:08.909185] [DEBUG] [LOCAL ] FVR: Deleted derivative data file. [2025-10-09T19:04:08.909341] [INFO ] [MAIN ] Update Progress: 887/2373 symbols completed. FVR took 29.4s. Estimated remaining: 3h 27m 53s. Rate: 7.1 symbols/min [2025-10-09T19:04:09.157454] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:09.160776] [DEBUG] [LOCAL ] FXED: Loaded 1252 existing records from primary storage. [2025-10-09T19:04:09.160969] [INFO ] [MAIN ] FXED: Loaded 1252 existing records. [2025-10-09T19:04:09.371561] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:09.371944] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-09T19:04:09.372001] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-09T19:04:09.372203] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-09T19:04:09.372287] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-09T19:04:09.598784] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-09T19:04:09.752550] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:09.784526] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T19:04:10.396775] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-09T19:04:11.189784] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:04:11.197467] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-09T19:04:11.938884] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T19:04:11.943457] [INFO ] [REMOTE ] FUN: Full fetch complete (73028 records). [2025-10-09T19:04:11.943606] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-09T19:04:12.006783] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-09T19:04:12.345213] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-09T19:04:12.345104] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-09T19:04:12.346339] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-09T19:04:12.347292] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-09T19:04:12.347355] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-09T19:04:12.348720] [DEBUG] [LOCAL ] FUN: Trimmed 73028 records to 52165 (keeping 200 days of data) [2025-10-09T19:04:12.649711] [DEBUG] [LOCAL ] FUN: Primary data saved (52165 records). [2025-10-09T19:04:12.649854] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-09T19:04:12.651173] [INFO ] [MAIN ] Update Progress: 888/2373 symbols completed. FUN took 37.0s. Estimated remaining: 3h 27m 37s. Rate: 7.2 symbols/min [2025-10-09T19:04:12.802413] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-09T19:04:12.836525] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:12.892554] [DEBUG] [LOCAL ] G: Loaded 49981 existing records from primary storage. [2025-10-09T19:04:12.892949] [INFO ] [MAIN ] G: Loaded 49981 existing records. [2025-10-09T19:04:13.069800] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:13.070038] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-09T19:04:13.070099] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-09T19:04:13.071535] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-09T19:04:13.071596] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-09T19:04:13.382032] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T19:04:13.435892] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:13.467387] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-09T19:04:13.596677] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-09T19:04:14.396716] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-09T19:04:14.730467] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T19:04:15.207058] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-09T19:04:15.242108] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T19:04:15.996740] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-09T19:04:16.796743] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-09T19:04:16.893125] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T19:04:17.572676] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T19:04:17.596682] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-09T19:04:18.396768] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-09T19:04:18.894847] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-09T19:04:18.899553] [INFO ] [REMOTE ] FUBO: Full fetch complete (77771 records). [2025-10-09T19:04:18.899723] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-09T19:04:19.203741] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-09T19:04:19.323833] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-09T19:04:19.323985] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-09T19:04:19.325298] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-09T19:04:19.325429] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-09T19:04:19.360013] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T19:04:19.358273] [DEBUG] [LOCAL ] FUBO: Trimmed 77771 records to 54095 (keeping 200 days of data) [2025-10-09T19:04:19.572996] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T19:04:19.606763] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T19:04:19.735080] [DEBUG] [LOCAL ] FUBO: Primary data saved (54095 records). [2025-10-09T19:04:19.735248] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-09T19:04:19.735384] [INFO ] [MAIN ] Update Progress: 889/2373 symbols completed. FUBO took 53.6s. Estimated remaining: 3h 27m 27s. Rate: 7.2 symbols/min [2025-10-09T19:04:19.914596] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:19.947200] [DEBUG] [LOCAL ] GAB: Loaded 27641 existing records from primary storage. [2025-10-09T19:04:19.947523] [INFO ] [MAIN ] GAB: Loaded 27641 existing records. [2025-10-09T19:04:20.005117] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-09T19:04:20.134487] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:20.134766] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-09T19:04:20.134876] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-09T19:04:20.135774] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-09T19:04:20.135835] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-09T19:04:20.443966] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:04:20.524214] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:20.796736] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-09T19:04:21.596742] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-09T19:04:21.952034] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T19:04:22.396697] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-09T19:04:22.439209] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T19:04:23.196716] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-09T19:04:23.991277] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T19:04:24.001463] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-09T19:04:24.426169] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:04:24.438424] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:04:24.796737] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-09T19:04:25.596743] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-09T19:04:26.036735] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T19:04:26.262984] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:04:26.396792] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-09T19:04:27.196789] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-09T19:04:27.700832] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T19:04:27.996768] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-09T19:04:28.535258] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:04:28.796720] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-09T19:04:29.100131] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T19:04:29.596793] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-09T19:04:30.054622] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T19:04:30.396735] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-09T19:04:30.452164] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T19:04:31.196718] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-09T19:04:31.689004] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:04:31.823701] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T19:04:31.996761] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-09T19:04:32.796780] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-09T19:04:33.596764] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-09T19:04:33.625729] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T19:04:34.166386] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T19:04:34.396795] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-09T19:04:34.980160] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T19:04:35.196761] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-09T19:04:35.258266] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T19:04:35.996787] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-09T19:04:36.748969] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:04:36.796689] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-09T19:04:37.211243] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:04:37.596728] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-09T19:04:38.396684] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-09T19:04:38.468315] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T19:04:38.469208] [INFO ] [REMOTE ] FXED: Full fetch complete (1806 records). [2025-10-09T19:04:38.469325] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-09T19:04:38.752268] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-09T19:04:38.865150] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-09T19:04:38.865235] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-09T19:04:38.865323] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-09T19:04:38.865361] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-09T19:04:38.865699] [DEBUG] [LOCAL ] FXED: Trimmed 1806 records to 1259 (keeping 200 days of data) [2025-10-09T19:04:38.874034] [DEBUG] [LOCAL ] FXED: Primary data saved (1259 records). [2025-10-09T19:04:38.874092] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-09T19:04:38.874171] [INFO ] [MAIN ] Update Progress: 890/2373 symbols completed. FXED took 30.0s. Estimated remaining: 3h 27m 36s. Rate: 7.1 symbols/min [2025-10-09T19:04:39.038619] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:39.044586] [DEBUG] [LOCAL ] GAM: Loaded 4028 existing records from primary storage. [2025-10-09T19:04:39.044759] [INFO ] [MAIN ] GAM: Loaded 4028 existing records. [2025-10-09T19:04:39.197019] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-09T19:04:39.224708] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:39.224944] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-09T19:04:39.225020] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-09T19:04:39.226384] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-09T19:04:39.226443] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-09T19:04:39.585003] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:39.791829] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T19:04:39.795567] [INFO ] [REMOTE ] FVRR: Full fetch complete (59193 records). [2025-10-09T19:04:39.795700] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-09T19:04:40.004746] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-09T19:04:40.182853] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-09T19:04:40.182940] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-09T19:04:40.183882] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-09T19:04:40.183951] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-09T19:04:40.185361] [DEBUG] [LOCAL ] FVRR: Trimmed 59193 records to 40524 (keeping 200 days of data) [2025-10-09T19:04:40.439803] [DEBUG] [LOCAL ] FVRR: Primary data saved (40524 records). [2025-10-09T19:04:40.439949] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-09T19:04:40.440890] [INFO ] [MAIN ] Update Progress: 891/2373 symbols completed. FVRR took 36.2s. Estimated remaining: 3h 27m 16s. Rate: 7.2 symbols/min [2025-10-09T19:04:40.622284] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:40.675413] [DEBUG] [LOCAL ] GAP: Loaded 53652 existing records from primary storage. [2025-10-09T19:04:40.675892] [INFO ] [MAIN ] GAP: Loaded 53652 existing records. [2025-10-09T19:04:40.806000] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-09T19:04:40.813611] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T19:04:40.919605] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:40.919921] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-09T19:04:40.919977] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-09T19:04:40.921910] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-09T19:04:40.921974] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-09T19:04:41.355225] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:41.414194] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:04:41.596779] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-09T19:04:41.973142] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T19:04:42.396740] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-09T19:04:43.196727] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-09T19:04:43.378000] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:04:43.441997] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T19:04:43.644261] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T19:04:43.996720] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-09T19:04:44.796694] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-09T19:04:45.066550] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T19:04:45.434849] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T19:04:45.596728] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-09T19:04:46.396720] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-09T19:04:47.110610] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T19:04:47.196704] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-09T19:04:47.996718] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-09T19:04:48.114600] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T19:04:48.346492] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:04:48.348993] [INFO ] [REMOTE ] GAB: Full fetch complete (39362 records). [2025-10-09T19:04:48.349073] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-09T19:04:48.730270] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-09T19:04:48.730416] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-09T19:04:48.731352] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-09T19:04:48.731421] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-09T19:04:48.732449] [DEBUG] [LOCAL ] GAB: Trimmed 39362 records to 27889 (keeping 200 days of data) [2025-10-09T19:04:48.817626] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-09T19:04:48.897524] [DEBUG] [LOCAL ] GAB: Primary data saved (27889 records). [2025-10-09T19:04:48.897692] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-09T19:04:48.897829] [INFO ] [MAIN ] Update Progress: 892/2373 symbols completed. GAB took 29.2s. Estimated remaining: 3h 27m 8s. Rate: 7.1 symbols/min [2025-10-09T19:04:49.066407] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:49.085463] [DEBUG] [LOCAL ] GATX: Loaded 18143 existing records from primary storage. [2025-10-09T19:04:49.085758] [INFO ] [MAIN ] GATX: Loaded 18143 existing records. [2025-10-09T19:04:49.278893] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:49.279130] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-09T19:04:49.279183] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-09T19:04:49.279760] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-09T19:04:49.279819] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-09T19:04:49.600882] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-09T19:04:49.660236] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:49.775399] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T19:04:50.381783] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:04:50.396683] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-09T19:04:50.488597] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:04:50.493065] [INFO ] [REMOTE ] G: Full fetch complete (71768 records). [2025-10-09T19:04:50.493192] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-09T19:04:50.878483] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-09T19:04:50.878567] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-09T19:04:50.879518] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-09T19:04:50.879587] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-09T19:04:50.881002] [DEBUG] [LOCAL ] G: Trimmed 71768 records to 50363 (keeping 200 days of data) [2025-10-09T19:04:51.197132] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-09T19:04:51.201099] [DEBUG] [LOCAL ] G: Primary data saved (50363 records). [2025-10-09T19:04:51.201274] [INFO ] [MAIN ] G: Full history saved. [2025-10-09T19:04:51.202219] [INFO ] [MAIN ] Update Progress: 893/2373 symbols completed. G took 38.6s. Estimated remaining: 3h 26m 50s. Rate: 7.2 symbols/min [2025-10-09T19:04:51.382293] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:51.397412] [DEBUG] [LOCAL ] GBAB: Loaded 13043 existing records from primary storage. [2025-10-09T19:04:51.397673] [INFO ] [MAIN ] GBAB: Loaded 13043 existing records. [2025-10-09T19:04:51.520586] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T19:04:51.591945] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:51.592159] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-09T19:04:51.592207] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-09T19:04:51.592706] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-09T19:04:51.592765] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-09T19:04:51.948249] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:51.996668] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-09T19:04:52.796710] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-09T19:04:52.986732] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T19:04:53.068170] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T19:04:53.406939] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T19:04:53.596719] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-09T19:04:54.396699] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-09T19:04:54.617452] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:04:55.196754] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-09T19:04:55.226627] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T19:04:55.996701] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-09T19:04:56.095995] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T19:04:56.796755] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-09T19:04:56.952114] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T19:04:57.565007] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:04:57.596676] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-09T19:04:58.172344] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T19:04:58.396758] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-09T19:04:59.196778] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-09T19:04:59.854688] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T19:04:59.996745] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-09T19:05:00.289541] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T19:05:00.593055] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T19:05:00.796802] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-09T19:05:01.366557] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T19:05:01.596744] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-09T19:05:02.396722] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-09T19:05:02.656637] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T19:05:02.761028] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T19:05:03.196702] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-09T19:05:03.996814] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-09T19:05:04.767032] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T19:05:04.796753] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-09T19:05:04.978138] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T19:05:05.596682] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-09T19:05:05.931263] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:05:06.236237] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T19:05:06.237137] [INFO ] [REMOTE ] GAM: Full fetch complete (6592 records). [2025-10-09T19:05:06.237204] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-09T19:05:06.401980] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-09T19:05:06.604752] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-09T19:05:06.604831] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-09T19:05:06.605009] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-09T19:05:06.605047] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-09T19:05:06.605440] [DEBUG] [LOCAL ] GAM: Trimmed 6592 records to 4058 (keeping 200 days of data) [2025-10-09T19:05:06.633734] [DEBUG] [LOCAL ] GAM: Primary data saved (4058 records). [2025-10-09T19:05:06.633947] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-09T19:05:06.634038] [INFO ] [MAIN ] Update Progress: 894/2373 symbols completed. GAM took 27.8s. Estimated remaining: 3h 26m 53s. Rate: 7.1 symbols/min [2025-10-09T19:05:06.798886] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:06.840505] [DEBUG] [LOCAL ] GBCI: Loaded 40512 existing records from primary storage. [2025-10-09T19:05:06.840826] [INFO ] [MAIN ] GBCI: Loaded 40512 existing records. [2025-10-09T19:05:07.012816] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:07.013096] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-09T19:05:07.013141] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-09T19:05:07.014555] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-09T19:05:07.014615] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-09T19:05:07.202503] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-09T19:05:07.380008] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:07.423302] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:05:07.996722] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-09T19:05:08.796737] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-09T19:05:09.167636] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-09T19:05:09.325003] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T19:05:09.446602] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:05:09.596723] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-09T19:05:10.396729] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-09T19:05:11.040176] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T19:05:11.196694] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-09T19:05:11.363987] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T19:05:11.996782] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-09T19:05:12.641433] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:05:12.688293] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T19:05:12.796717] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-09T19:05:13.596796] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-09T19:05:14.396689] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-09T19:05:14.624851] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:05:14.756452] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T19:05:15.196689] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-09T19:05:15.281226] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T19:05:15.996776] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-09T19:05:16.489774] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:05:16.796686] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-09T19:05:17.137520] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:05:17.596737] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-09T19:05:17.620246] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T19:05:18.396801] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-09T19:05:18.529294] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:05:19.146978] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T19:05:19.148521] [INFO ] [REMOTE ] GBAB: Full fetch complete (19373 records). [2025-10-09T19:05:19.148597] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-09T19:05:19.204823] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-09T19:05:19.579512] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-09T19:05:19.580012] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-09T19:05:19.580557] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-09T19:05:19.580683] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-09T19:05:19.581744] [DEBUG] [LOCAL ] GBAB: Trimmed 19373 records to 13099 (keeping 200 days of data) [2025-10-09T19:05:19.669446] [DEBUG] [LOCAL ] GBAB: Primary data saved (13099 records). [2025-10-09T19:05:19.669598] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-09T19:05:19.669715] [INFO ] [MAIN ] Update Progress: 895/2373 symbols completed. GBAB took 28.5s. Estimated remaining: 3h 26m 52s. Rate: 7.1 symbols/min [2025-10-09T19:05:19.845950] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:19.846135] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-09T19:05:19.846173] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-09T19:05:19.846293] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-09T19:05:19.846337] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-09T19:05:19.846379] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-09T19:05:19.846414] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-09T19:05:20.007801] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-09T19:05:20.234554] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:20.334239] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:05:20.796764] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-09T19:05:21.596777] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-09T19:05:21.709481] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T19:05:21.709326] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:05:21.722190] [INFO ] [REMOTE ] GATX: Full fetch complete (25019 records). [2025-10-09T19:05:21.722463] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-09T19:05:22.085362] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-09T19:05:22.085444] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-09T19:05:22.085921] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-09T19:05:22.085984] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-09T19:05:22.086601] [DEBUG] [LOCAL ] GATX: Trimmed 25019 records to 18233 (keeping 200 days of data) [2025-10-09T19:05:22.200130] [DEBUG] [LOCAL ] GATX: Primary data saved (18233 records). [2025-10-09T19:05:22.200274] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-09T19:05:22.200355] [INFO ] [MAIN ] Update Progress: 896/2373 symbols completed. GATX took 33.3s. Estimated remaining: 3h 26m 34s. Rate: 7.2 symbols/min [2025-10-09T19:05:22.373592] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:22.399136] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-09T19:05:22.417537] [DEBUG] [LOCAL ] GBTG: Loaded 40036 existing records from primary storage. [2025-10-09T19:05:22.417877] [INFO ] [MAIN ] GBTG: Loaded 40036 existing records. [2025-10-09T19:05:22.594410] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:22.594669] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-09T19:05:22.594743] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-09T19:05:22.595960] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-09T19:05:22.596024] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-09T19:05:22.967178] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:22.990306] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T19:05:23.161161] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T19:05:23.196677] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-09T19:05:23.996722] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-09T19:05:24.326304] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:05:24.796779] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-09T19:05:25.596729] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-09T19:05:26.093983] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T19:05:26.218106] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T19:05:26.396702] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-09T19:05:26.620848] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:05:27.196723] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-09T19:05:27.715879] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:05:27.996761] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-09T19:05:28.677356] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T19:05:28.796796] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-09T19:05:29.317295] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T19:05:29.596727] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-09T19:05:29.908443] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T19:05:30.244768] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T19:05:30.396720] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-09T19:05:30.641073] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-09T19:05:31.196746] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-09T19:05:31.996753] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-09T19:05:32.741371] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T19:05:32.796676] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-09T19:05:33.596744] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-09T19:05:33.806530] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-09T19:05:33.811171] [INFO ] [REMOTE ] GAP: Full fetch complete (77632 records). [2025-10-09T19:05:33.811283] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-09T19:05:34.214002] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-09T19:05:34.222307] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-09T19:05:34.236771] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-09T19:05:34.237410] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-09T19:05:34.238376] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T19:05:34.248841] [DEBUG] [LOCAL ] GAP: Trimmed 77632 records to 54042 (keeping 200 days of data) [2025-10-09T19:05:34.432745] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-09T19:05:34.592437] [DEBUG] [LOCAL ] GAP: Primary data saved (54042 records). [2025-10-09T19:05:34.592572] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-09T19:05:34.593204] [INFO ] [MAIN ] Update Progress: 897/2373 symbols completed. GAP took 54.2s. Estimated remaining: 3h 26m 32s. Rate: 7.1 symbols/min [2025-10-09T19:05:34.761620] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:34.790039] [DEBUG] [LOCAL ] GBX: Loaded 29122 existing records from primary storage. [2025-10-09T19:05:34.790310] [INFO ] [MAIN ] GBX: Loaded 29122 existing records. [2025-10-09T19:05:34.971217] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:34.971446] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-09T19:05:34.971600] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-09T19:05:34.972731] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-09T19:05:34.972792] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-09T19:05:35.074731] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T19:05:35.201817] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-09T19:05:35.254695] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:05:35.382856] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:35.996734] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-09T19:05:36.796755] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-09T19:05:36.844171] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:05:37.581246] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:05:37.604406] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-09T19:05:37.606620] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T19:05:38.047295] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:05:38.396728] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-09T19:05:38.695151] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T19:05:39.196732] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-09T19:05:39.996719] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-09T19:05:40.766762] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T19:05:40.796668] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-09T19:05:41.107931] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T19:05:41.596698] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-09T19:05:41.816764] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T19:05:42.396775] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-09T19:05:43.174235] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T19:05:43.196696] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-09T19:05:43.812072] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T19:05:43.816833] [INFO ] [REMOTE ] GBCI: Full fetch complete (58552 records). [2025-10-09T19:05:43.816950] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-09T19:05:44.002386] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-09T19:05:44.226378] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-09T19:05:44.226461] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-09T19:05:44.227296] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-09T19:05:44.227361] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-09T19:05:44.228556] [DEBUG] [LOCAL ] GBCI: Trimmed 58552 records to 40822 (keeping 200 days of data) [2025-10-09T19:05:44.355245] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T19:05:44.498176] [DEBUG] [LOCAL ] GBCI: Primary data saved (40822 records). [2025-10-09T19:05:44.498313] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-09T19:05:44.498406] [INFO ] [MAIN ] Update Progress: 898/2373 symbols completed. GBCI took 37.9s. Estimated remaining: 3h 26m 26s. Rate: 7.1 symbols/min [2025-10-09T19:05:44.649464] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:05:44.700935] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:44.740848] [DEBUG] [LOCAL ] GCI: Loaded 44080 existing records from primary storage. [2025-10-09T19:05:44.741170] [INFO ] [MAIN ] GCI: Loaded 44080 existing records. [2025-10-09T19:05:44.802036] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-09T19:05:44.920850] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:44.921069] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-09T19:05:44.921119] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-09T19:05:44.922387] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-09T19:05:44.922447] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-09T19:05:45.313719] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:45.596727] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-09T19:05:46.217348] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T19:05:46.396700] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-09T19:05:47.050831] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:05:47.196722] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-09T19:05:47.793939] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:05:47.996745] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-09T19:05:48.730217] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:05:48.796664] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-09T19:05:49.248179] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T19:05:49.251771] [INFO ] [REMOTE ] GBTG: Full fetch complete (56426 records). [2025-10-09T19:05:49.251880] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-09T19:05:49.598505] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-09T19:05:49.644271] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-09T19:05:49.644354] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-09T19:05:49.645258] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-09T19:05:49.645326] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-09T19:05:49.646557] [DEBUG] [LOCAL ] GBTG: Trimmed 56426 records to 40278 (keeping 200 days of data) [2025-10-09T19:05:49.872822] [DEBUG] [LOCAL ] GBTG: Primary data saved (40278 records). [2025-10-09T19:05:49.872952] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-09T19:05:49.873032] [INFO ] [MAIN ] Update Progress: 899/2373 symbols completed. GBTG took 27.7s. Estimated remaining: 3h 26m 13s. Rate: 7.1 symbols/min [2025-10-09T19:05:50.017599] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T19:05:50.073320] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:50.095751] [DEBUG] [LOCAL ] GCO: Loaded 24065 existing records from primary storage. [2025-10-09T19:05:50.095974] [INFO ] [MAIN ] GCO: Loaded 24065 existing records. [2025-10-09T19:05:50.286288] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:50.286507] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-09T19:05:50.286560] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-09T19:05:50.286788] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-09T19:05:50.286849] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-09T19:05:50.401883] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-09T19:05:50.667152] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:50.914149] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T19:05:51.001097] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:05:51.196724] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-09T19:05:51.996732] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-09T19:05:52.443419] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T19:05:52.592195] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T19:05:52.796723] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-09T19:05:53.596717] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-09T19:05:54.302080] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T19:05:54.396698] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-09T19:05:54.478895] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:05:55.196729] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-09T19:05:55.996740] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-09T19:05:56.045586] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T19:05:56.389372] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T19:05:56.406689] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:05:56.796771] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-09T19:05:57.235978] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T19:05:57.236669] [INFO ] [REMOTE ] GBLI: Full fetch complete (1309 records). [2025-10-09T19:05:57.236743] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-09T19:05:57.413992] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-09T19:05:57.414184] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:05:57.414274] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:05:57.414347] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-09T19:05:57.414411] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-09T19:05:57.414458] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-09T19:05:57.414526] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-09T19:05:57.414583] [INFO ] [MAIN ] Update Progress: 900/2373 symbols completed. GBLI took 37.7s. Estimated remaining: 3h 26m 3s. Rate: 7.1 symbols/min [2025-10-09T19:05:57.593443] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:57.596688] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-09T19:05:57.616240] [DEBUG] [LOCAL ] GCTS: Loaded 20353 existing records from primary storage. [2025-10-09T19:05:57.616469] [INFO ] [MAIN ] GCTS: Loaded 20353 existing records. [2025-10-09T19:05:57.793464] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:57.793692] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-09T19:05:57.793750] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-09T19:05:57.793961] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-09T19:05:57.794018] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-09T19:05:58.146260] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:58.396748] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-09T19:05:59.140582] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T19:05:59.196714] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-09T19:05:59.471414] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T19:05:59.996772] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-09T19:06:00.746697] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:06:00.796688] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-09T19:06:01.197119] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T19:06:01.596723] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-09T19:06:02.038885] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T19:06:02.396721] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-09T19:06:02.753313] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T19:06:03.196728] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-09T19:06:03.618084] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T19:06:03.996689] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-09T19:06:04.359029] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T19:06:04.796740] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-09T19:06:04.997212] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T19:06:05.596724] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-09T19:06:06.248563] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T19:06:06.319197] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:06:06.396717] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-09T19:06:07.196771] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-09T19:06:07.843505] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:06:07.847354] [INFO ] [REMOTE ] GCI: Full fetch complete (63233 records). [2025-10-09T19:06:07.847465] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-09T19:06:07.999053] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-09T19:06:08.250218] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-09T19:06:08.250376] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-09T19:06:08.251755] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-09T19:06:08.251839] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-09T19:06:08.253486] [DEBUG] [LOCAL ] GCI: Trimmed 63233 records to 44365 (keeping 200 days of data) [2025-10-09T19:06:08.369204] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T19:06:08.524832] [DEBUG] [LOCAL ] GCI: Primary data saved (44365 records). [2025-10-09T19:06:08.524975] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-09T19:06:08.525090] [INFO ] [MAIN ] Update Progress: 901/2373 symbols completed. GCI took 24.0s. Estimated remaining: 3h 25m 59s. Rate: 7.1 symbols/min [2025-10-09T19:06:08.699605] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:08.708875] [DEBUG] [LOCAL ] GCV: Loaded 7565 existing records from primary storage. [2025-10-09T19:06:08.709108] [INFO ] [MAIN ] GCV: Loaded 7565 existing records. [2025-10-09T19:06:08.801840] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-09T19:06:08.892821] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:08.893106] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-09T19:06:08.893152] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-09T19:06:08.893322] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-09T19:06:08.893378] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-09T19:06:09.201044] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T19:06:09.250198] [INFO ] [REMOTE ] GBX: Full fetch complete (42706 records). [2025-10-09T19:06:09.276203] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-09T19:06:09.280897] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:09.600346] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T19:06:09.600411] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-09T19:06:09.684715] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-09T19:06:09.684796] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-09T19:06:09.685449] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-09T19:06:09.685489] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-09T19:06:09.686474] [DEBUG] [LOCAL ] GBX: Trimmed 42706 records to 29325 (keeping 200 days of data) [2025-10-09T19:06:09.866242] [DEBUG] [LOCAL ] GBX: Primary data saved (29325 records). [2025-10-09T19:06:09.866379] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-09T19:06:09.866866] [INFO ] [MAIN ] Update Progress: 902/2373 symbols completed. GBX took 35.3s. Estimated remaining: 3h 25m 39s. Rate: 7.2 symbols/min [2025-10-09T19:06:10.043298] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:10.087809] [DEBUG] [LOCAL ] GD: Loaded 46879 existing records from primary storage. [2025-10-09T19:06:10.088117] [INFO ] [MAIN ] GD: Loaded 46879 existing records. [2025-10-09T19:06:10.274557] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:10.274875] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-09T19:06:10.274936] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-09T19:06:10.276486] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-09T19:06:10.276553] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-09T19:06:10.401837] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-09T19:06:10.645980] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T19:06:10.766932] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:11.196806] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-09T19:06:11.496284] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T19:06:11.996779] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-09T19:06:12.796683] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-09T19:06:12.958478] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T19:06:13.107182] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T19:06:13.397784] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T19:06:13.596755] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-09T19:06:14.036696] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T19:06:14.396745] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-09T19:06:15.082363] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T19:06:15.196696] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-09T19:06:15.996776] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-09T19:06:16.673121] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:06:16.796751] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-09T19:06:17.596720] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-09T19:06:17.810706] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T19:06:18.373000] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:06:18.396668] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-09T19:06:18.733514] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T19:06:19.196719] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-09T19:06:19.232639] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T19:06:19.996759] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-09T19:06:20.030776] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T19:06:20.796691] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-09T19:06:21.248141] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:06:21.596725] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-09T19:06:22.258801] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:06:22.273248] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T19:06:22.396685] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-09T19:06:23.181685] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T19:06:23.196669] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-09T19:06:23.996696] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-09T19:06:24.197804] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T19:06:24.620633] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T19:06:24.796722] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-09T19:06:25.596699] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-09T19:06:25.858770] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T19:06:26.396760] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-09T19:06:26.500290] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T19:06:27.112084] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T19:06:27.196793] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-09T19:06:27.996765] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-09T19:06:28.332550] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T19:06:28.334683] [INFO ] [REMOTE ] GCTS: Full fetch complete (26993 records). [2025-10-09T19:06:28.334756] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-09T19:06:28.600308] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T19:06:28.723130] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-09T19:06:28.723221] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-09T19:06:28.723813] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-09T19:06:28.723876] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-09T19:06:28.724532] [DEBUG] [LOCAL ] GCTS: Trimmed 26993 records to 20474 (keeping 200 days of data) [2025-10-09T19:06:28.805803] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-09T19:06:28.845546] [DEBUG] [LOCAL ] GCTS: Primary data saved (20474 records). [2025-10-09T19:06:28.845704] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-09T19:06:28.845794] [INFO ] [MAIN ] Update Progress: 903/2373 symbols completed. GCTS took 31.4s. Estimated remaining: 3h 25m 48s. Rate: 7.1 symbols/min [2025-10-09T19:06:29.017685] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:29.065889] [DEBUG] [LOCAL ] GDDY: Loaded 49785 existing records from primary storage. [2025-10-09T19:06:29.066210] [INFO ] [MAIN ] GDDY: Loaded 49785 existing records. [2025-10-09T19:06:29.246901] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:29.247153] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-09T19:06:29.247208] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-09T19:06:29.247419] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-09T19:06:29.247477] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-09T19:06:29.603006] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-09T19:06:29.626937] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:29.862834] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T19:06:30.396736] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-09T19:06:30.990692] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T19:06:31.196825] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-09T19:06:31.412164] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T19:06:31.996738] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-09T19:06:32.796692] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-09T19:06:32.908614] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T19:06:33.596692] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-09T19:06:33.759619] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T19:06:33.759948] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T19:06:34.396765] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-09T19:06:35.196780] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-09T19:06:35.260877] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T19:06:35.262613] [INFO ] [REMOTE ] GCV: Full fetch complete (9619 records). [2025-10-09T19:06:35.262745] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-09T19:06:35.479248] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T19:06:35.678749] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-09T19:06:35.678840] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-09T19:06:35.679157] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-09T19:06:35.679220] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-09T19:06:35.679713] [DEBUG] [LOCAL ] GCV: Trimmed 9619 records to 7653 (keeping 200 days of data) [2025-10-09T19:06:35.724217] [DEBUG] [LOCAL ] GCV: Primary data saved (7653 records). [2025-10-09T19:06:35.724340] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-09T19:06:35.724436] [INFO ] [MAIN ] Update Progress: 904/2373 symbols completed. GCV took 27.2s. Estimated remaining: 3h 25m 37s. Rate: 7.1 symbols/min [2025-10-09T19:06:35.893609] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:35.898622] [DEBUG] [LOCAL ] GDIV: Loaded 3609 existing records from primary storage. [2025-10-09T19:06:35.898791] [INFO ] [MAIN ] GDIV: Loaded 3609 existing records. [2025-10-09T19:06:35.996770] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-09T19:06:36.074440] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:36.074662] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-09T19:06:36.074724] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-09T19:06:36.075025] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-09T19:06:36.075084] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-09T19:06:36.448116] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:36.668049] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T19:06:36.796723] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-09T19:06:37.557438] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:06:37.596684] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-09T19:06:38.321937] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:06:38.396735] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-09T19:06:38.505147] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T19:06:38.506958] [INFO ] [REMOTE ] GCO: Full fetch complete (35222 records). [2025-10-09T19:06:38.507028] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-09T19:06:38.876953] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-09T19:06:38.877032] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-09T19:06:38.877702] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-09T19:06:38.877827] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-09T19:06:38.878631] [DEBUG] [LOCAL ] GCO: Trimmed 35222 records to 24160 (keeping 200 days of data) [2025-10-09T19:06:39.017587] [DEBUG] [LOCAL ] GCO: Primary data saved (24160 records). [2025-10-09T19:06:39.017762] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-09T19:06:39.017865] [INFO ] [MAIN ] Update Progress: 905/2373 symbols completed. GCO took 49.1s. Estimated remaining: 3h 25m 21s. Rate: 7.1 symbols/min [2025-10-09T19:06:39.184900] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:39.189368] [DEBUG] [LOCAL ] GDL: Loaded 2553 existing records from primary storage. [2025-10-09T19:06:39.189543] [INFO ] [MAIN ] GDL: Loaded 2553 existing records. [2025-10-09T19:06:39.201962] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-09T19:06:39.365704] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:39.365907] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-09T19:06:39.365953] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-09T19:06:39.366174] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-09T19:06:39.366240] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-09T19:06:39.716067] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:39.996725] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-09T19:06:40.026000] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T19:06:40.383098] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-09T19:06:40.796750] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-09T19:06:40.993497] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T19:06:41.242797] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T19:06:41.596722] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-09T19:06:41.994262] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-09T19:06:42.396734] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-09T19:06:43.196735] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-09T19:06:43.483810] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-09T19:06:43.996729] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-09T19:06:44.061474] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:06:44.796761] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-09T19:06:45.376545] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T19:06:45.408437] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:06:45.596749] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-09T19:06:46.396716] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-09T19:06:46.849152] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-09T19:06:47.185994] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T19:06:47.196692] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-09T19:06:47.996775] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-09T19:06:48.476282] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T19:06:48.796688] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-09T19:06:48.909332] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T19:06:49.350123] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T19:06:49.596757] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-09T19:06:50.197842] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T19:06:50.396824] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-09T19:06:50.824234] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T19:06:51.196727] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-09T19:06:51.530528] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T19:06:51.996719] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-09T19:06:52.478415] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T19:06:52.796734] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-09T19:06:53.255007] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T19:06:53.596727] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-09T19:06:54.165892] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T19:06:54.396725] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-09T19:06:54.923493] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T19:06:55.196741] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-09T19:06:55.701852] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T19:06:55.702991] [INFO ] [REMOTE ] GDL: Full fetch complete (3555 records). [2025-10-09T19:06:55.703080] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-09T19:06:56.002002] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-09T19:06:56.075260] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-09T19:06:56.075339] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-09T19:06:56.075475] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-09T19:06:56.075516] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-09T19:06:56.075909] [DEBUG] [LOCAL ] GDL: Trimmed 3555 records to 2566 (keeping 200 days of data) [2025-10-09T19:06:56.091680] [DEBUG] [LOCAL ] GDL: Primary data saved (2566 records). [2025-10-09T19:06:56.091760] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-09T19:06:56.091836] [INFO ] [MAIN ] Update Progress: 906/2373 symbols completed. GDL took 17.1s. Estimated remaining: 3h 25m 26s. Rate: 7.1 symbols/min [2025-10-09T19:06:56.256631] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:56.264232] [DEBUG] [LOCAL ] GDO: Loaded 5927 existing records from primary storage. [2025-10-09T19:06:56.264423] [INFO ] [MAIN ] GDO: Loaded 5927 existing records. [2025-10-09T19:06:56.437541] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:56.437808] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-09T19:06:56.437869] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-09T19:06:56.438241] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-09T19:06:56.438300] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-09T19:06:56.793025] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:56.796662] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-09T19:06:56.819500] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T19:06:57.596692] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-09T19:06:57.617107] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:06:58.396771] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-09T19:06:59.089245] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T19:06:59.196808] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-09T19:06:59.243619] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T19:06:59.752165] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T19:06:59.996699] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-09T19:07:00.581969] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T19:07:00.796784] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-09T19:07:01.141047] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T19:07:01.596732] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-09T19:07:02.214256] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T19:07:02.396766] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-09T19:07:02.865235] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T19:07:02.866340] [INFO ] [REMOTE ] GDIV: Full fetch complete (5467 records). [2025-10-09T19:07:02.866430] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-09T19:07:03.202045] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-09T19:07:03.455358] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-09T19:07:03.455488] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-09T19:07:03.455848] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-09T19:07:03.455932] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-09T19:07:03.456800] [DEBUG] [LOCAL ] GDIV: Trimmed 5467 records to 3625 (keeping 200 days of data) [2025-10-09T19:07:03.492162] [DEBUG] [LOCAL ] GDIV: Primary data saved (3625 records). [2025-10-09T19:07:03.492353] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-09T19:07:03.492476] [INFO ] [MAIN ] Update Progress: 907/2373 symbols completed. GDIV took 27.8s. Estimated remaining: 3h 25m 16s. Rate: 7.1 symbols/min [2025-10-09T19:07:03.756413] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:03.811028] [DEBUG] [LOCAL ] GDOT: Loaded 37785 existing records from primary storage. [2025-10-09T19:07:03.811517] [INFO ] [MAIN ] GDOT: Loaded 37785 existing records. [2025-10-09T19:07:04.010403] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-09T19:07:04.016255] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:04.017779] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-09T19:07:04.017847] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-09T19:07:04.018844] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-09T19:07:04.018908] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-09T19:07:04.420573] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:04.605927] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T19:07:04.796689] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-09T19:07:04.851298] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T19:07:04.855104] [INFO ] [REMOTE ] GD: Full fetch complete (69889 records). [2025-10-09T19:07:04.855213] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-09T19:07:05.250419] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-09T19:07:05.250503] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-09T19:07:05.251410] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-09T19:07:05.251475] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-09T19:07:05.252810] [DEBUG] [LOCAL ] GD: Trimmed 69889 records to 47158 (keeping 200 days of data) [2025-10-09T19:07:05.473615] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T19:07:05.559748] [DEBUG] [LOCAL ] GD: Primary data saved (47158 records). [2025-10-09T19:07:05.559891] [INFO ] [MAIN ] GD: Full history saved. [2025-10-09T19:07:05.560607] [INFO ] [MAIN ] Update Progress: 908/2373 symbols completed. GD took 55.7s. Estimated remaining: 3h 24m 58s. Rate: 7.1 symbols/min [2025-10-09T19:07:05.601803] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-09T19:07:05.738029] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:05.758692] [DEBUG] [LOCAL ] GDV: Loaded 19517 existing records from primary storage. [2025-10-09T19:07:05.758969] [INFO ] [MAIN ] GDV: Loaded 19517 existing records. [2025-10-09T19:07:05.943862] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:05.944107] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-09T19:07:05.944173] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-09T19:07:05.945164] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-09T19:07:05.945245] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-09T19:07:06.317021] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:06.364347] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:07:06.396763] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-09T19:07:07.196732] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-09T19:07:07.788425] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:07:07.996733] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-09T19:07:08.763695] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T19:07:08.796711] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-09T19:07:08.817788] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:07:09.434832] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-09T19:07:09.596767] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-09T19:07:10.053585] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T19:07:10.396723] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-09T19:07:11.196740] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-09T19:07:11.797331] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:07:11.996723] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-09T19:07:12.796707] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-09T19:07:12.969218] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T19:07:13.167483] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:07:13.442425] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T19:07:13.596724] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-09T19:07:14.082741] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T19:07:14.396790] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-09T19:07:15.196687] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-09T19:07:15.409413] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:07:15.996784] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-09T19:07:16.796736] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-09T19:07:16.976844] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:07:17.545494] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:07:17.594926] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T19:07:17.598724] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-09T19:07:18.396833] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-09T19:07:19.052922] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T19:07:19.196681] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-09T19:07:19.440297] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T19:07:19.996749] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-09T19:07:20.524150] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T19:07:20.524449] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T19:07:20.796727] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-09T19:07:21.596708] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-09T19:07:22.226590] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T19:07:22.227808] [INFO ] [REMOTE ] GDO: Full fetch complete (8698 records). [2025-10-09T19:07:22.227879] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-09T19:07:22.404186] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-09T19:07:22.620379] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T19:07:22.638450] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-09T19:07:22.638628] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-09T19:07:22.639129] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-09T19:07:22.639294] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-09T19:07:22.640219] [DEBUG] [LOCAL ] GDO: Trimmed 8698 records to 5961 (keeping 200 days of data) [2025-10-09T19:07:22.676235] [DEBUG] [LOCAL ] GDO: Primary data saved (5961 records). [2025-10-09T19:07:22.676311] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-09T19:07:22.676388] [INFO ] [MAIN ] Update Progress: 909/2373 symbols completed. GDO took 26.6s. Estimated remaining: 3h 25m 3s. Rate: 7.1 symbols/min [2025-10-09T19:07:22.842948] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:22.894205] [DEBUG] [LOCAL ] GE: Loaded 53706 existing records from primary storage. [2025-10-09T19:07:22.894537] [INFO ] [MAIN ] GE: Loaded 53706 existing records. [2025-10-09T19:07:23.074213] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:23.074431] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-09T19:07:23.074489] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-09T19:07:23.075942] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-09T19:07:23.076018] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-09T19:07:23.201875] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-09T19:07:23.428258] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:23.621029] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T19:07:23.996726] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-09T19:07:24.796690] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-09T19:07:25.150871] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-09T19:07:25.155228] [INFO ] [REMOTE ] GDDY: Full fetch complete (71783 records). [2025-10-09T19:07:25.155341] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-09T19:07:25.543201] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-09T19:07:25.543280] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-09T19:07:25.544187] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-09T19:07:25.544253] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-09T19:07:25.545606] [DEBUG] [LOCAL ] GDDY: Trimmed 71783 records to 50152 (keeping 200 days of data) [2025-10-09T19:07:25.598277] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-09T19:07:25.860879] [DEBUG] [LOCAL ] GDDY: Primary data saved (50152 records). [2025-10-09T19:07:25.861222] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-09T19:07:25.862279] [INFO ] [MAIN ] Update Progress: 910/2373 symbols completed. GDDY took 57.0s. Estimated remaining: 3h 24m 46s. Rate: 7.1 symbols/min [2025-10-09T19:07:26.066001] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:26.069163] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-09T19:07:26.098436] [DEBUG] [LOCAL ] GEF: Loaded 20665 existing records from primary storage. [2025-10-09T19:07:26.098720] [INFO ] [MAIN ] GEF: Loaded 20665 existing records. [2025-10-09T19:07:26.277208] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:26.277572] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-09T19:07:26.277827] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-09T19:07:26.286450] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-09T19:07:26.299539] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-09T19:07:26.401007] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T19:07:26.401196] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-09T19:07:26.672180] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:26.883328] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:07:27.196724] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-09T19:07:27.996684] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-09T19:07:28.321750] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:07:28.558454] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-09T19:07:28.796747] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-09T19:07:29.001794] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T19:07:29.596707] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-09T19:07:30.396704] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-09T19:07:30.628696] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:07:30.782503] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-09T19:07:31.196801] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-09T19:07:31.487183] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T19:07:31.996716] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-09T19:07:32.782425] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T19:07:32.796672] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-09T19:07:32.908244] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T19:07:33.596735] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-09T19:07:34.297618] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T19:07:34.359044] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T19:07:34.396672] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-09T19:07:35.196698] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-09T19:07:35.468900] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:07:35.996718] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-09T19:07:36.796695] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-09T19:07:36.897270] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T19:07:37.041121] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T19:07:37.596692] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-09T19:07:37.653214] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T19:07:38.396776] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-09T19:07:39.196755] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-09T19:07:39.378682] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T19:07:39.612278] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-09T19:07:39.971615] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T19:07:39.996666] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-09T19:07:40.796766] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-09T19:07:41.221394] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:07:41.596722] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-09T19:07:42.362180] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T19:07:42.366352] [INFO ] [REMOTE ] GDOT: Full fetch complete (53126 records). [2025-10-09T19:07:42.366483] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-09T19:07:42.407990] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-09T19:07:42.528040] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:07:42.810372] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-09T19:07:42.810459] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-09T19:07:42.811208] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-09T19:07:42.811272] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-09T19:07:42.812331] [DEBUG] [LOCAL ] GDOT: Trimmed 53126 records to 38054 (keeping 200 days of data) [2025-10-09T19:07:43.029599] [DEBUG] [LOCAL ] GDOT: Primary data saved (38054 records). [2025-10-09T19:07:43.029765] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-09T19:07:43.029857] [INFO ] [MAIN ] Update Progress: 911/2373 symbols completed. GDOT took 39.5s. Estimated remaining: 3h 24m 52s. Rate: 7.1 symbols/min [2025-10-09T19:07:43.201521] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-09T19:07:43.201443] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:43.202673] [DEBUG] [LOCAL ] GEL: No existing data file found in primary storage. [2025-10-09T19:07:43.202740] [WARN ] [MAIN ] GEL: No existing data found, performing full refresh instead. [2025-10-09T19:07:43.202894] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-09T19:07:43.202965] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-09T19:07:43.203042] [DEBUG] [LOCAL ] GEL: No primary data file found to delete. [2025-10-09T19:07:43.203098] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-09T19:07:43.568914] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:43.996692] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-09T19:07:44.406563] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T19:07:44.671167] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-09T19:07:44.785942] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:07:44.796669] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-09T19:07:45.596696] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-09T19:07:45.642043] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T19:07:45.644019] [INFO ] [REMOTE ] GDV: Full fetch complete (28467 records). [2025-10-09T19:07:45.644089] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-09T19:07:46.010551] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-09T19:07:46.010764] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-09T19:07:46.011315] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-09T19:07:46.011357] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-09T19:07:46.012048] [DEBUG] [LOCAL ] GDV: Trimmed 28467 records to 19701 (keeping 200 days of data) [2025-10-09T19:07:46.132322] [DEBUG] [LOCAL ] GDV: Primary data saved (19701 records). [2025-10-09T19:07:46.132463] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-09T19:07:46.132544] [INFO ] [MAIN ] Update Progress: 912/2373 symbols completed. GDV took 40.6s. Estimated remaining: 3h 24m 35s. Rate: 7.1 symbols/min [2025-10-09T19:07:46.296292] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:46.349243] [DEBUG] [LOCAL ] GENI: Loaded 52944 existing records from primary storage. [2025-10-09T19:07:46.349624] [INFO ] [MAIN ] GENI: Loaded 52944 existing records. [2025-10-09T19:07:46.402195] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-09T19:07:46.525060] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:46.525283] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-09T19:07:46.525331] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-09T19:07:46.526987] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-09T19:07:46.527050] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-09T19:07:46.873226] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:47.196738] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-09T19:07:47.442438] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T19:07:47.613442] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:07:47.996682] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-09T19:07:48.296466] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T19:07:48.298689] [INFO ] [REMOTE ] GEF: Full fetch complete (29335 records). [2025-10-09T19:07:48.298765] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-09T19:07:48.678014] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-09T19:07:48.678086] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-09T19:07:48.678661] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-09T19:07:48.678724] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-09T19:07:48.679371] [DEBUG] [LOCAL ] GEF: Trimmed 29335 records to 20821 (keeping 200 days of data) [2025-10-09T19:07:48.796791] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-09T19:07:48.820246] [DEBUG] [LOCAL ] GEF: Primary data saved (20821 records). [2025-10-09T19:07:48.820366] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-09T19:07:48.820444] [INFO ] [MAIN ] Update Progress: 913/2373 symbols completed. GEF took 23.0s. Estimated remaining: 3h 24m 18s. Rate: 7.1 symbols/min [2025-10-09T19:07:48.991483] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:49.044275] [DEBUG] [LOCAL ] GEO: Loaded 51887 existing records from primary storage. [2025-10-09T19:07:49.044614] [INFO ] [MAIN ] GEO: Loaded 51887 existing records. [2025-10-09T19:07:49.228136] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:49.245325] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-09T19:07:49.245455] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-09T19:07:49.246806] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:07:49.253322] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-09T19:07:49.253509] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-09T19:07:49.609362] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:49.603769] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-09T19:07:50.396717] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-09T19:07:50.562827] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T19:07:51.196756] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-09T19:07:51.270565] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T19:07:51.943425] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-09T19:07:51.996685] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-09T19:07:52.761114] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T19:07:52.796675] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-09T19:07:53.596748] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-09T19:07:54.201323] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T19:07:54.396760] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-09T19:07:54.738783] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T19:07:55.064518] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:07:55.196806] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-09T19:07:55.996793] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-09T19:07:56.293365] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T19:07:56.584267] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-09T19:07:56.796744] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-09T19:07:57.596708] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-09T19:07:57.788977] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T19:07:57.852929] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T19:07:58.396784] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-09T19:07:59.196762] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-09T19:07:59.306143] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T19:07:59.996764] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-09T19:08:00.546058] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-09T19:08:00.550828] [INFO ] [REMOTE ] GE: Full fetch complete (77771 records). [2025-10-09T19:08:00.550966] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-09T19:08:00.804564] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-09T19:08:00.975027] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-09T19:08:00.985476] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-09T19:08:00.991865] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-09T19:08:01.003124] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-09T19:08:01.005371] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T19:08:01.016189] [DEBUG] [LOCAL ] GE: Trimmed 77771 records to 54096 (keeping 200 days of data) [2025-10-09T19:08:01.363776] [DEBUG] [LOCAL ] GE: Primary data saved (54096 records). [2025-10-09T19:08:01.363927] [INFO ] [MAIN ] GE: Full history saved. [2025-10-09T19:08:01.364965] [INFO ] [MAIN ] Update Progress: 914/2373 symbols completed. GE took 38.7s. Estimated remaining: 3h 24m 16s. Rate: 7.1 symbols/min [2025-10-09T19:08:01.538888] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:01.580261] [DEBUG] [LOCAL ] GES: Loaded 38643 existing records from primary storage. [2025-10-09T19:08:01.580639] [INFO ] [MAIN ] GES: Loaded 38643 existing records. [2025-10-09T19:08:01.611696] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-09T19:08:01.809968] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:01.810222] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-09T19:08:01.814469] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:08:01.811470] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-09T19:08:01.833178] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-09T19:08:01.833266] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-09T19:08:02.216762] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:02.319858] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T19:08:02.396718] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-09T19:08:03.128751] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:08:03.196678] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-09T19:08:03.996680] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-09T19:08:04.374094] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T19:08:04.541818] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T19:08:04.796835] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-09T19:08:05.295788] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T19:08:05.596753] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-09T19:08:06.283960] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:08:06.396708] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-09T19:08:07.034896] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:08:07.196733] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-09T19:08:07.996744] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-09T19:08:08.091198] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T19:08:08.796731] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-09T19:08:09.104273] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:08:09.137541] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T19:08:09.596737] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-09T19:08:10.396775] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-09T19:08:10.550680] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:08:10.710684] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T19:08:11.196748] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-09T19:08:11.811528] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:08:11.996760] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-09T19:08:12.735594] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:08:12.796706] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-09T19:08:13.092630] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T19:08:13.095003] [INFO ] [REMOTE ] GEL: Full fetch complete (48196 records). [2025-10-09T19:08:13.095105] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-09T19:08:13.507560] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-09T19:08:13.507695] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-09T19:08:13.508508] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-09T19:08:13.508563] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-09T19:08:13.509906] [DEBUG] [LOCAL ] GEL: Trimmed 48196 records to 32514 (keeping 200 days of data) [2025-10-09T19:08:13.602036] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-09T19:08:13.726157] [DEBUG] [LOCAL ] GEL: Primary data saved (32514 records). [2025-10-09T19:08:13.726314] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-09T19:08:13.726402] [INFO ] [MAIN ] Update Progress: 915/2373 symbols completed. GEL took 30.7s. Estimated remaining: 3h 24m 14s. Rate: 7.1 symbols/min [2025-10-09T19:08:13.910062] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:13.956066] [DEBUG] [LOCAL ] GETY: Loaded 35367 existing records from primary storage. [2025-10-09T19:08:13.956489] [INFO ] [MAIN ] GETY: Loaded 35367 existing records. [2025-10-09T19:08:14.143976] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:14.144274] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-09T19:08:14.144343] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-09T19:08:14.145510] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-09T19:08:14.145573] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-09T19:08:14.403184] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-09T19:08:14.522149] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:14.602615] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T19:08:15.196693] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-09T19:08:15.442177] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T19:08:15.677109] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T19:08:15.996740] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-09T19:08:16.671121] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:08:16.796730] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-09T19:08:17.596684] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-09T19:08:17.662855] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:08:17.667223] [INFO ] [REMOTE ] GEO: Full fetch complete (75430 records). [2025-10-09T19:08:17.667325] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-09T19:08:18.052907] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-09T19:08:18.052993] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-09T19:08:18.053922] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-09T19:08:18.053984] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-09T19:08:18.055370] [DEBUG] [LOCAL ] GEO: Trimmed 75430 records to 52261 (keeping 200 days of data) [2025-10-09T19:08:18.361269] [DEBUG] [LOCAL ] GEO: Primary data saved (52261 records). [2025-10-09T19:08:18.361419] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-09T19:08:18.362425] [INFO ] [MAIN ] Update Progress: 916/2373 symbols completed. GEO took 29.5s. Estimated remaining: 3h 23m 59s. Rate: 7.1 symbols/min [2025-10-09T19:08:18.407287] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-09T19:08:18.541131] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:18.596522] [DEBUG] [LOCAL ] GEV: Loaded 53015 existing records from primary storage. [2025-10-09T19:08:18.596902] [INFO ] [MAIN ] GEV: Loaded 53015 existing records. [2025-10-09T19:08:18.786489] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:18.786893] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-09T19:08:18.786988] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-09T19:08:18.818865] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-09T19:08:18.815538] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-09T19:08:18.832850] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-09T19:08:19.201704] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-09T19:08:19.206344] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:19.238121] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T19:08:19.960612] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:08:19.996730] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-09T19:08:20.791353] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:08:20.800036] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-09T19:08:21.596757] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-09T19:08:22.086954] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T19:08:22.240166] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-09T19:08:22.396687] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-09T19:08:23.131074] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:08:23.196695] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-09T19:08:23.996808] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-09T19:08:24.685616] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-09T19:08:24.736989] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T19:08:24.796683] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-09T19:08:25.243629] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T19:08:25.596736] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-09T19:08:26.279160] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T19:08:26.396685] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-09T19:08:27.196724] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-09T19:08:27.746045] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-09T19:08:27.809492] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T19:08:27.996730] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-09T19:08:28.332252] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:08:28.796721] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-09T19:08:29.596714] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-09T19:08:30.160988] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T19:08:30.203602] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-09T19:08:30.396725] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-09T19:08:30.528062] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T19:08:31.196719] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-09T19:08:31.996721] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-09T19:08:32.755249] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-09T19:08:32.797495] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T19:08:32.797577] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-09T19:08:33.234408] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:08:33.596711] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-09T19:08:34.396769] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-09T19:08:35.196695] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-09T19:08:35.262318] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-09T19:08:35.393977] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T19:08:35.399430] [INFO ] [REMOTE ] GENI: Full fetch complete (75618 records). [2025-10-09T19:08:35.399542] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-09T19:08:35.830443] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-09T19:08:35.830629] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-09T19:08:35.831678] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-09T19:08:35.831830] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-09T19:08:35.833395] [DEBUG] [LOCAL ] GENI: Trimmed 75618 records to 53328 (keeping 200 days of data) [2025-10-09T19:08:35.963086] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T19:08:36.041777] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-09T19:08:36.202290] [DEBUG] [LOCAL ] GENI: Primary data saved (53328 records). [2025-10-09T19:08:36.202527] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-09T19:08:36.203256] [INFO ] [MAIN ] Update Progress: 917/2373 symbols completed. GENI took 50.1s. Estimated remaining: 3h 24m 6s. Rate: 7.1 symbols/min [2025-10-09T19:08:36.599351] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:08:36.796701] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-09T19:08:37.596743] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-09T19:08:37.767231] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T19:08:38.064955] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:08:38.067977] [INFO ] [REMOTE ] GES: Full fetch complete (58937 records). [2025-10-09T19:08:38.068078] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-09T19:08:38.401804] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-09T19:08:38.477305] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-09T19:08:38.477385] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-09T19:08:38.478382] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-09T19:08:38.478451] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-09T19:08:38.479911] [DEBUG] [LOCAL ] GES: Trimmed 58937 records to 38897 (keeping 200 days of data) [2025-10-09T19:08:38.608403] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:08:38.748890] [DEBUG] [LOCAL ] GES: Primary data saved (38897 records). [2025-10-09T19:08:38.749069] [INFO ] [MAIN ] GES: Full history saved. [2025-10-09T19:08:38.749159] [INFO ] [MAIN ] Update Progress: 918/2373 symbols completed. GES took 37.4s. Estimated remaining: 3h 23m 48s. Rate: 7.1 symbols/min [2025-10-09T19:08:39.196776] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-09T19:08:40.430750] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T19:08:40.444900] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-09T19:08:40.464478] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:08:40.796770] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-09T19:08:41.947357] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:08:41.950556] [INFO ] [REMOTE ] GETY: Full fetch complete (55496 records). [2025-10-09T19:08:41.950683] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-09T19:08:42.332054] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-09T19:08:42.332210] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-09T19:08:42.333029] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-09T19:08:42.333294] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-09T19:08:42.334463] [DEBUG] [LOCAL ] GETY: Trimmed 55496 records to 35597 (keeping 200 days of data) [2025-10-09T19:08:42.548421] [DEBUG] [LOCAL ] GETY: Primary data saved (35597 records). [2025-10-09T19:08:42.548766] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-09T19:08:42.548888] [INFO ] [MAIN ] Update Progress: 919/2373 symbols completed. GETY took 28.8s. Estimated remaining: 3h 23m 33s. Rate: 7.1 symbols/min [2025-10-09T19:08:42.592808] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-09T19:08:42.604457] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-09T19:08:44.685001] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-09T19:08:44.696866] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-09T19:08:46.966885] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-09T19:08:46.971440] [INFO ] [REMOTE ] GEV: Full fetch complete (76893 records). [2025-10-09T19:08:46.971551] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-09T19:08:47.365148] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-09T19:08:47.365227] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-09T19:08:47.366170] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-09T19:08:47.366248] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-09T19:08:47.367699] [DEBUG] [LOCAL ] GEV: Trimmed 76893 records to 53394 (keeping 200 days of data) [2025-10-09T19:08:47.695982] [DEBUG] [LOCAL ] GEV: Primary data saved (53394 records). [2025-10-09T19:08:47.696317] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-09T19:08:47.696395] [INFO ] [MAIN ] Update Progress: 920/2373 symbols completed. GEV took 29.3s. Estimated remaining: 3h 23m 19s. Rate: 7.1 symbols/min [2025-10-09T19:08:48.233958] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:48.393122] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:48.411171] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:48.363313] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:48.418258] [DEBUG] [LOCAL ] GF: Loaded 2781 existing records from primary storage. [2025-10-09T19:08:48.418678] [INFO ] [MAIN ] GF: Loaded 2781 existing records. [2025-10-09T19:08:48.575409] [DEBUG] [LOCAL ] GFF: Loaded 30233 existing records from primary storage. [2025-10-09T19:08:48.613533] [INFO ] [MAIN ] GFF: Loaded 30233 existing records. [2025-10-09T19:08:48.650181] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:48.719836] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-09T19:08:48.731503] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-09T19:08:48.779770] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-09T19:08:48.783764] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-09T19:08:48.784526] [DEBUG] [LOCAL ] GFL: Loaded 47875 existing records from primary storage. [2025-10-09T19:08:48.785680] [DEBUG] [LOCAL ] GFI: Loaded 53098 existing records from primary storage. [2025-10-09T19:08:48.823095] [INFO ] [MAIN ] GFL: Loaded 47875 existing records. [2025-10-09T19:08:48.898168] [INFO ] [MAIN ] GFI: Loaded 53098 existing records. [2025-10-09T19:08:49.140935] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:49.195093] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-09T19:08:49.222471] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-09T19:08:49.423715] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:49.412061] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-09T19:08:49.440517] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-09T19:08:49.488787] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-09T19:08:49.529025] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-09T19:08:49.538841] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:49.601737] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-09T19:08:49.596426] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-09T19:08:49.627781] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-09T19:08:49.633122] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-09T19:08:49.697096] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-09T19:08:49.755769] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-09T19:08:50.159171] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:50.236588] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-09T19:08:50.787116] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:50.799774] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:50.805407] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-09T19:08:50.812829] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-09T19:08:50.912942] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:50.913222] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-09T19:08:51.122331] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T19:08:51.124260] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-09T19:08:51.439246] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T19:08:51.440794] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-09T19:08:52.032469] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T19:08:52.034081] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-09T19:08:52.163410] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:08:52.169360] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-09T19:08:52.301499] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T19:08:52.310746] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-09T19:08:52.466769] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T19:08:52.469069] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-09T19:08:52.625350] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T19:08:52.635768] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-09T19:08:53.045220] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T19:08:53.046744] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-09T19:08:53.483274] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:08:53.489602] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-09T19:08:53.837176] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T19:08:53.839375] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-09T19:08:53.874272] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T19:08:54.178321] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:08:54.251794] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-09T19:08:54.396684] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-09T19:08:54.444501] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T19:08:54.718669] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T19:08:55.196708] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-09T19:08:55.996724] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-09T19:08:56.571838] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T19:08:56.796756] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-09T19:08:57.328153] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T19:08:57.596763] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-09T19:08:58.362203] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T19:08:58.396684] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-09T19:08:59.196763] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-09T19:08:59.261349] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T19:08:59.679242] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-09T19:08:59.906906] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T19:08:59.996764] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-09T19:09:00.796715] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-09T19:09:01.146468] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T19:09:01.596730] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-09T19:09:01.839694] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T19:09:02.007593] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T19:09:02.008429] [INFO ] [REMOTE ] GF: Full fetch complete (5049 records). [2025-10-09T19:09:02.008501] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-09T19:09:02.412159] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-09T19:09:02.456841] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-09T19:09:02.456938] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-09T19:09:02.457098] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-09T19:09:02.457138] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-09T19:09:02.457601] [DEBUG] [LOCAL ] GF: Trimmed 5049 records to 2790 (keeping 200 days of data) [2025-10-09T19:09:02.475673] [DEBUG] [LOCAL ] GF: Primary data saved (2790 records). [2025-10-09T19:09:02.475835] [INFO ] [MAIN ] GF: Full history saved. [2025-10-09T19:09:02.475945] [INFO ] [MAIN ] Update Progress: 921/2373 symbols completed. GF took 14.8s. Estimated remaining: 3h 23m 21s. Rate: 7.1 symbols/min [2025-10-09T19:09:02.656715] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:02.666774] [DEBUG] [LOCAL ] GFR: Loaded 7915 existing records from primary storage. [2025-10-09T19:09:02.667014] [INFO ] [MAIN ] GFR: Loaded 7915 existing records. [2025-10-09T19:09:02.855992] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:02.856231] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-09T19:09:02.856284] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-09T19:09:02.856502] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-09T19:09:02.856560] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-09T19:09:03.201857] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-09T19:09:03.235451] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:03.591387] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T19:09:03.996803] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-09T19:09:04.669867] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T19:09:04.796783] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-09T19:09:05.596759] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-09T19:09:05.703788] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T19:09:06.270471] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T19:09:06.396759] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-09T19:09:06.903276] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T19:09:07.196692] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-09T19:09:07.996765] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-09T19:09:08.077053] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:09:08.562447] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:09:08.796725] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-09T19:09:09.315335] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T19:09:09.596717] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-09T19:09:09.985430] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T19:09:10.396769] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-09T19:09:10.876522] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T19:09:10.888964] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T19:09:11.196730] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-09T19:09:11.996784] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-09T19:09:12.759808] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T19:09:12.796749] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-09T19:09:13.011803] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T19:09:13.580351] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:09:13.596672] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-09T19:09:14.353872] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:09:14.396697] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-09T19:09:14.918527] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T19:09:15.196757] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-09T19:09:15.996911] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-09T19:09:16.645136] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T19:09:16.796750] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-09T19:09:17.596752] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-09T19:09:17.905929] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T19:09:18.070376] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:09:18.396720] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-09T19:09:19.188750] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T19:09:19.198552] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-09T19:09:19.613253] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T19:09:19.616219] [INFO ] [REMOTE ] GFF: Full fetch complete (44066 records). [2025-10-09T19:09:19.616325] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-09T19:09:19.998824] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-09T19:09:20.011324] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-09T19:09:20.011409] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-09T19:09:20.012120] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-09T19:09:20.012292] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-09T19:09:20.013259] [DEBUG] [LOCAL ] GFF: Trimmed 44066 records to 30371 (keeping 200 days of data) [2025-10-09T19:09:20.111795] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:09:20.207371] [DEBUG] [LOCAL ] GFF: Primary data saved (30371 records). [2025-10-09T19:09:20.207513] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-09T19:09:20.207596] [INFO ] [MAIN ] Update Progress: 922/2373 symbols completed. GFF took 32.5s. Estimated remaining: 3h 23m 27s. Rate: 7.1 symbols/min [2025-10-09T19:09:20.373821] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:20.423577] [DEBUG] [LOCAL ] GGB: Loaded 51174 existing records from primary storage. [2025-10-09T19:09:20.423935] [INFO ] [MAIN ] GGB: Loaded 51174 existing records. [2025-10-09T19:09:20.600746] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:20.600961] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-09T19:09:20.601010] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-09T19:09:20.601232] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-09T19:09:20.601289] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-09T19:09:20.802941] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-09T19:09:20.956522] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:21.601977] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-09T19:09:21.619449] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T19:09:21.634687] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T19:09:22.396700] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-09T19:09:23.196755] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-09T19:09:23.456421] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T19:09:23.821058] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T19:09:24.001976] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-09T19:09:24.017273] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:09:24.796724] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-09T19:09:25.596782] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-09T19:09:25.783938] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T19:09:26.396693] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-09T19:09:26.780611] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T19:09:26.785092] [INFO ] [REMOTE ] GFI: Full fetch complete (76497 records). [2025-10-09T19:09:26.785366] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-09T19:09:27.126084] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T19:09:27.211463] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-09T19:09:27.215896] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-09T19:09:27.215953] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-09T19:09:27.216917] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-09T19:09:27.217106] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-09T19:09:27.218626] [DEBUG] [LOCAL ] GFI: Trimmed 76497 records to 53488 (keeping 200 days of data) [2025-10-09T19:09:27.543057] [DEBUG] [LOCAL ] GFI: Primary data saved (53488 records). [2025-10-09T19:09:27.543188] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-09T19:09:27.543267] [INFO ] [MAIN ] Update Progress: 923/2373 symbols completed. GFI took 39.8s. Estimated remaining: 3h 23m 17s. Rate: 7.1 symbols/min [2025-10-09T19:09:27.711391] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:27.749118] [DEBUG] [LOCAL ] GGG: Loaded 40765 existing records from primary storage. [2025-10-09T19:09:27.749404] [INFO ] [MAIN ] GGG: Loaded 40765 existing records. [2025-10-09T19:09:27.935755] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:27.935992] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-09T19:09:27.936048] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-09T19:09:27.936278] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-09T19:09:27.936373] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-09T19:09:28.001271] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-09T19:09:28.266375] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T19:09:28.353095] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:28.777757] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:09:28.796716] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-09T19:09:28.835366] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:09:28.840850] [INFO ] [REMOTE ] GFL: Full fetch complete (69204 records). [2025-10-09T19:09:28.841130] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-09T19:09:29.240348] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-09T19:09:29.240461] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-09T19:09:29.241428] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-09T19:09:29.241504] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-09T19:09:29.243801] [DEBUG] [LOCAL ] GFL: Trimmed 69204 records to 48223 (keeping 200 days of data) [2025-10-09T19:09:29.530059] [DEBUG] [LOCAL ] GFL: Primary data saved (48223 records). [2025-10-09T19:09:29.530184] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-09T19:09:29.531306] [INFO ] [MAIN ] Update Progress: 924/2373 symbols completed. GFL took 41.8s. Estimated remaining: 3h 22m 58s. Rate: 7.1 symbols/min [2025-10-09T19:09:29.606697] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-09T19:09:29.702477] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:29.718692] [DEBUG] [LOCAL ] GGT: Loaded 14116 existing records from primary storage. [2025-10-09T19:09:29.718941] [INFO ] [MAIN ] GGT: Loaded 14116 existing records. [2025-10-09T19:09:29.892267] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:29.892439] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-09T19:09:29.892486] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-09T19:09:29.892698] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-09T19:09:29.892755] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-09T19:09:30.253674] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:30.312455] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:09:30.396666] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-09T19:09:30.558856] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T19:09:30.560029] [INFO ] [REMOTE ] GFR: Full fetch complete (12336 records). [2025-10-09T19:09:30.560096] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-09T19:09:30.924698] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-09T19:09:30.924814] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-09T19:09:30.925113] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-09T19:09:30.925155] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-09T19:09:30.925772] [DEBUG] [LOCAL ] GFR: Trimmed 12336 records to 7968 (keeping 200 days of data) [2025-10-09T19:09:30.969789] [DEBUG] [LOCAL ] GFR: Primary data saved (7968 records). [2025-10-09T19:09:30.969927] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-09T19:09:30.970012] [INFO ] [MAIN ] Update Progress: 925/2373 symbols completed. GFR took 28.5s. Estimated remaining: 3h 22m 39s. Rate: 7.1 symbols/min [2025-10-09T19:09:31.138142] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:31.143468] [DEBUG] [LOCAL ] GGZ: Loaded 2428 existing records from primary storage. [2025-10-09T19:09:31.143667] [INFO ] [MAIN ] GGZ: Loaded 2428 existing records. [2025-10-09T19:09:31.204746] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-09T19:09:31.325849] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:31.326037] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-09T19:09:31.326084] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-09T19:09:31.326257] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-09T19:09:31.326314] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-09T19:09:31.674531] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:31.996701] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-09T19:09:32.139942] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:09:32.235034] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:09:32.590720] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T19:09:32.796740] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-09T19:09:33.282766] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T19:09:33.596733] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-09T19:09:33.997507] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-09T19:09:34.396743] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-09T19:09:35.105751] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T19:09:35.196728] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-09T19:09:35.732821] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T19:09:35.996706] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-09T19:09:36.796770] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-09T19:09:37.113729] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-09T19:09:37.596694] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-09T19:09:37.696635] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T19:09:38.348324] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T19:09:38.396683] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-09T19:09:38.960583] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T19:09:39.196734] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-09T19:09:39.701902] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T19:09:39.996718] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-09T19:09:40.388617] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T19:09:40.796723] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-09T19:09:41.596739] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-09T19:09:42.071163] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T19:09:42.310905] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:09:42.396846] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-09T19:09:42.825112] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T19:09:43.196743] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-09T19:09:43.653394] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T19:09:43.996734] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-09T19:09:44.796719] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-09T19:09:45.543751] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:09:45.596672] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-09T19:09:46.396699] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-09T19:09:46.421863] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:09:46.930996] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T19:09:46.931774] [INFO ] [REMOTE ] GGZ: Full fetch complete (4066 records). [2025-10-09T19:09:46.931843] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-09T19:09:47.197585] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-09T19:09:47.318892] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-09T19:09:47.319076] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-09T19:09:47.319271] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-09T19:09:47.319361] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-09T19:09:47.319974] [DEBUG] [LOCAL ] GGZ: Trimmed 4066 records to 2437 (keeping 200 days of data) [2025-10-09T19:09:47.335168] [DEBUG] [LOCAL ] GGZ: Primary data saved (2437 records). [2025-10-09T19:09:47.335229] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-09T19:09:47.335296] [INFO ] [MAIN ] Update Progress: 926/2373 symbols completed. GGZ took 16.4s. Estimated remaining: 3h 22m 43s. Rate: 7.1 symbols/min [2025-10-09T19:09:47.477828] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T19:09:47.544703] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:47.549784] [DEBUG] [LOCAL ] GHC: Loaded 2780 existing records from primary storage. [2025-10-09T19:09:47.549920] [INFO ] [MAIN ] GHC: Loaded 2780 existing records. [2025-10-09T19:09:47.724276] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:47.724508] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-09T19:09:47.724555] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-09T19:09:47.724910] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-09T19:09:47.724967] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-09T19:09:48.001930] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-09T19:09:48.070267] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:48.796709] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-09T19:09:48.943173] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T19:09:49.382779] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T19:09:49.596690] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-09T19:09:49.697430] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T19:09:50.396745] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-09T19:09:50.992882] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T19:09:51.031922] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T19:09:51.196724] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-09T19:09:51.996803] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-09T19:09:52.189333] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T19:09:52.796735] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-09T19:09:53.308768] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T19:09:53.596735] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-09T19:09:54.349042] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T19:09:54.396684] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-09T19:09:55.196702] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-09T19:09:55.230632] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:09:55.664866] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T19:09:55.996723] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-09T19:09:56.109369] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:09:56.796801] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-09T19:09:57.489008] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T19:09:57.596685] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-09T19:09:58.238620] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T19:09:58.396712] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-09T19:09:58.504183] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T19:09:58.882670] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T19:09:59.196795] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-09T19:09:59.688043] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T19:09:59.996791] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-09T19:10:00.796746] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-09T19:10:01.033777] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T19:10:01.596733] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-09T19:10:02.396703] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-09T19:10:02.464514] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T19:10:02.745134] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-09T19:10:03.196758] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-09T19:10:03.854079] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T19:10:03.861718] [INFO ] [REMOTE ] GGB: Full fetch complete (74116 records). [2025-10-09T19:10:03.861916] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-09T19:10:04.001837] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-09T19:10:04.290696] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-09T19:10:04.290853] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-09T19:10:04.292433] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-09T19:10:04.292545] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-09T19:10:04.296855] [DEBUG] [LOCAL ] GGB: Trimmed 74116 records to 51552 (keeping 200 days of data) [2025-10-09T19:10:04.606514] [DEBUG] [LOCAL ] GGB: Primary data saved (51552 records). [2025-10-09T19:10:04.606690] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-09T19:10:04.606805] [INFO ] [MAIN ] Update Progress: 927/2373 symbols completed. GGB took 44.4s. Estimated remaining: 3h 22m 49s. Rate: 7.1 symbols/min [2025-10-09T19:10:04.814862] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-09T19:10:04.817771] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:04.828483] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:10:04.833289] [INFO ] [REMOTE ] GGG: Full fetch complete (59392 records). [2025-10-09T19:10:04.833513] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-09T19:10:04.843464] [DEBUG] [LOCAL ] GHG: Loaded 3211 existing records from primary storage. [2025-10-09T19:10:04.882825] [INFO ] [MAIN ] GHG: Loaded 3211 existing records. [2025-10-09T19:10:05.003965] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T19:10:05.300955] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:05.324772] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-09T19:10:05.333033] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-09T19:10:05.335936] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-09T19:10:05.341576] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-09T19:10:05.546135] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T19:10:05.551554] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-09T19:10:05.563390] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-09T19:10:05.569338] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-09T19:10:05.574519] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-09T19:10:05.598391] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-09T19:10:05.742549] [DEBUG] [LOCAL ] GGG: Trimmed 59392 records to 41084 (keeping 200 days of data) [2025-10-09T19:10:05.917568] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:06.078760] [DEBUG] [LOCAL ] GGG: Primary data saved (41084 records). [2025-10-09T19:10:06.078884] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-09T19:10:06.078966] [INFO ] [MAIN ] Update Progress: 928/2373 symbols completed. GGG took 38.5s. Estimated remaining: 3h 22m 29s. Rate: 7.1 symbols/min [2025-10-09T19:10:06.193767] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T19:10:06.258975] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:06.268552] [DEBUG] [LOCAL ] GHI: Loaded 7185 existing records from primary storage. [2025-10-09T19:10:06.268798] [INFO ] [MAIN ] GHI: Loaded 7185 existing records. [2025-10-09T19:10:06.408793] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-09T19:10:06.462040] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:06.462297] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-09T19:10:06.462362] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-09T19:10:06.462569] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-09T19:10:06.462675] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-09T19:10:06.815781] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:07.196743] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-09T19:10:07.538945] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T19:10:07.540954] [INFO ] [REMOTE ] GGT: Full fetch complete (18715 records). [2025-10-09T19:10:07.541056] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-09T19:10:07.644860] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-09T19:10:07.910195] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-09T19:10:07.910276] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-09T19:10:07.910706] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-09T19:10:07.910767] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-09T19:10:07.911313] [DEBUG] [LOCAL ] GGT: Trimmed 18715 records to 14247 (keeping 200 days of data) [2025-10-09T19:10:07.997032] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-09T19:10:08.003537] [DEBUG] [LOCAL ] GGT: Primary data saved (14247 records). [2025-10-09T19:10:08.003742] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-09T19:10:08.003837] [INFO ] [MAIN ] Update Progress: 929/2373 symbols completed. GGT took 38.5s. Estimated remaining: 3h 22m 11s. Rate: 7.1 symbols/min [2025-10-09T19:10:08.170514] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:08.177554] [DEBUG] [LOCAL ] GHLD: Loaded 4184 existing records from primary storage. [2025-10-09T19:10:08.177765] [INFO ] [MAIN ] GHLD: Loaded 4184 existing records. [2025-10-09T19:10:08.351167] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:08.351368] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-09T19:10:08.351416] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-09T19:10:08.351590] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-09T19:10:08.351682] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-09T19:10:08.710300] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:08.796679] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-09T19:10:09.082859] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T19:10:09.236212] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-09T19:10:09.596732] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-09T19:10:10.041749] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T19:10:10.396780] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-09T19:10:10.896607] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T19:10:11.196738] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-09T19:10:12.003280] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-09T19:10:12.007221] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T19:10:12.716945] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:10:12.796714] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-09T19:10:13.343795] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T19:10:13.596704] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-09T19:10:14.304038] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-09T19:10:14.396739] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-09T19:10:15.003826] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T19:10:15.196760] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-09T19:10:15.994758] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T19:10:15.997211] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-09T19:10:16.661321] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T19:10:16.796727] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-09T19:10:17.361030] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T19:10:17.596752] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-09T19:10:18.062540] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T19:10:18.396745] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-09T19:10:19.164341] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T19:10:19.196732] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-09T19:10:19.942245] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:10:19.996717] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-09T19:10:20.348405] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T19:10:20.796729] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-09T19:10:21.594436] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T19:10:21.596923] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-09T19:10:22.054356] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T19:10:22.396746] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-09T19:10:22.860320] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T19:10:23.196720] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-09T19:10:23.676487] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T19:10:23.996795] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-09T19:10:24.404588] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-09T19:10:24.796723] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-09T19:10:25.596723] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-09T19:10:25.838829] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T19:10:25.840412] [INFO ] [REMOTE ] GHI: Full fetch complete (11377 records). [2025-10-09T19:10:25.840487] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-09T19:10:26.251294] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T19:10:26.264401] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-09T19:10:26.264514] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-09T19:10:26.265133] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-09T19:10:26.265202] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-09T19:10:26.265887] [DEBUG] [LOCAL ] GHI: Trimmed 11377 records to 7248 (keeping 200 days of data) [2025-10-09T19:10:26.312293] [DEBUG] [LOCAL ] GHI: Primary data saved (7248 records). [2025-10-09T19:10:26.312445] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-09T19:10:26.312542] [INFO ] [MAIN ] Update Progress: 930/2373 symbols completed. GHI took 20.2s. Estimated remaining: 3h 22m 18s. Rate: 7.1 symbols/min [2025-10-09T19:10:26.401984] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-09T19:10:26.485400] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:26.501084] [DEBUG] [LOCAL ] GHM: Loaded 14150 existing records from primary storage. [2025-10-09T19:10:26.501325] [INFO ] [MAIN ] GHM: Loaded 14150 existing records. [2025-10-09T19:10:26.674251] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:26.674499] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-09T19:10:26.674548] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-09T19:10:26.674767] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-09T19:10:26.674824] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-09T19:10:26.959117] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T19:10:27.033911] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:27.196733] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-09T19:10:27.638843] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T19:10:27.996732] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-09T19:10:28.584748] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T19:10:28.796715] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-09T19:10:29.358989] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T19:10:29.596748] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-09T19:10:30.111251] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T19:10:30.396726] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-09T19:10:31.149364] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:10:31.196729] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-09T19:10:31.996728] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-09T19:10:32.223568] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:10:32.614241] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T19:10:32.796739] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-09T19:10:33.596697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-09T19:10:33.635459] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T19:10:34.175929] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T19:10:34.396724] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-09T19:10:35.196743] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-09T19:10:35.532494] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T19:10:35.762425] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T19:10:35.996741] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-09T19:10:36.705410] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T19:10:36.706480] [INFO ] [REMOTE ] GHC: Full fetch complete (3534 records). [2025-10-09T19:10:36.706552] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-09T19:10:36.802362] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-09T19:10:37.061241] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-09T19:10:37.061328] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-09T19:10:37.061448] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-09T19:10:37.061489] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-09T19:10:37.061864] [DEBUG] [LOCAL ] GHC: Trimmed 3534 records to 2863 (keeping 200 days of data) [2025-10-09T19:10:37.080900] [DEBUG] [LOCAL ] GHC: Primary data saved (2863 records). [2025-10-09T19:10:37.081035] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-09T19:10:37.081131] [INFO ] [MAIN ] Update Progress: 931/2373 symbols completed. GHC took 49.7s. Estimated remaining: 3h 22m 13s. Rate: 7.1 symbols/min [2025-10-09T19:10:37.254693] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:37.276984] [DEBUG] [LOCAL ] GHY: Loaded 20935 existing records from primary storage. [2025-10-09T19:10:37.277254] [INFO ] [MAIN ] GHY: Loaded 20935 existing records. [2025-10-09T19:10:37.378919] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T19:10:37.459256] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:37.459494] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-09T19:10:37.459562] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-09T19:10:37.459805] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-09T19:10:37.459862] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-09T19:10:37.601806] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-09T19:10:37.822708] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:38.396696] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-09T19:10:38.706831] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T19:10:39.039886] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T19:10:39.040898] [INFO ] [REMOTE ] GHLD: Full fetch complete (4896 records). [2025-10-09T19:10:39.040991] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-09T19:10:39.198054] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-09T19:10:39.404331] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-09T19:10:39.404417] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-09T19:10:39.404591] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-09T19:10:39.404675] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-09T19:10:39.405072] [DEBUG] [LOCAL ] GHLD: Trimmed 4896 records to 4231 (keeping 200 days of data) [2025-10-09T19:10:39.431321] [DEBUG] [LOCAL ] GHLD: Primary data saved (4231 records). [2025-10-09T19:10:39.431417] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-09T19:10:39.431539] [INFO ] [MAIN ] Update Progress: 932/2373 symbols completed. GHLD took 31.4s. Estimated remaining: 3h 21m 55s. Rate: 7.1 symbols/min [2025-10-09T19:10:39.604196] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:39.639819] [DEBUG] [LOCAL ] GIB: Loaded 31842 existing records from primary storage. [2025-10-09T19:10:39.640107] [INFO ] [MAIN ] GIB: Loaded 31842 existing records. [2025-10-09T19:10:39.813264] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:39.813502] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-09T19:10:39.813550] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-09T19:10:39.813807] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-09T19:10:39.813864] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-09T19:10:39.998720] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-09T19:10:40.120488] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T19:10:40.199386] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:40.502744] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T19:10:40.796729] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-09T19:10:41.536984] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T19:10:41.596770] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-09T19:10:42.293981] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T19:10:42.396715] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-09T19:10:43.196796] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-09T19:10:43.677728] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:10:43.996756] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-09T19:10:44.426073] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:10:44.796926] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-09T19:10:44.801153] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T19:10:45.279767] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T19:10:45.280825] [INFO ] [REMOTE ] GHG: Full fetch complete (4092 records). [2025-10-09T19:10:45.280904] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-09T19:10:45.601808] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-09T19:10:45.664596] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-09T19:10:45.664697] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-09T19:10:45.664842] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-09T19:10:45.664884] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-09T19:10:45.665228] [DEBUG] [LOCAL ] GHG: Trimmed 4092 records to 3244 (keeping 200 days of data) [2025-10-09T19:10:45.683937] [DEBUG] [LOCAL ] GHG: Primary data saved (3244 records). [2025-10-09T19:10:45.684018] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-09T19:10:45.684092] [INFO ] [MAIN ] Update Progress: 933/2373 symbols completed. GHG took 41.1s. Estimated remaining: 3h 21m 44s. Rate: 7.1 symbols/min [2025-10-09T19:10:45.852552] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:45.870992] [DEBUG] [LOCAL ] GIC: Loaded 13439 existing records from primary storage. [2025-10-09T19:10:45.871225] [INFO ] [MAIN ] GIC: Loaded 13439 existing records. [2025-10-09T19:10:46.049773] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:46.049949] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-09T19:10:46.049997] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-09T19:10:46.050183] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-09T19:10:46.050241] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-09T19:10:46.401981] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:46.397437] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-09T19:10:46.979874] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T19:10:47.196720] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-09T19:10:47.396906] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:10:47.996699] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-09T19:10:48.142374] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T19:10:48.796743] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-09T19:10:49.450355] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:10:49.596754] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-09T19:10:49.757873] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T19:10:50.396773] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-09T19:10:50.715541] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T19:10:51.196698] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-09T19:10:51.318587] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T19:10:51.977298] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:10:51.996666] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-09T19:10:52.732196] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T19:10:52.796721] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-09T19:10:53.596715] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-09T19:10:53.869510] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T19:10:54.275811] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T19:10:54.396726] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-09T19:10:55.196724] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-09T19:10:55.917921] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:10:55.938947] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T19:10:55.996700] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-09T19:10:56.715897] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T19:10:56.796716] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-09T19:10:57.596705] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-09T19:10:57.636447] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T19:10:58.396710] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-09T19:10:58.415226] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T19:10:59.048859] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T19:10:59.050705] [INFO ] [REMOTE ] GHM: Full fetch complete (21907 records). [2025-10-09T19:10:59.050792] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-09T19:10:59.202095] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-09T19:10:59.421551] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-09T19:10:59.421630] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-09T19:10:59.422159] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-09T19:10:59.422208] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-09T19:10:59.422962] [DEBUG] [LOCAL ] GHM: Trimmed 21907 records to 14304 (keeping 200 days of data) [2025-10-09T19:10:59.509231] [DEBUG] [LOCAL ] GHM: Primary data saved (14304 records). [2025-10-09T19:10:59.509381] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-09T19:10:59.509486] [INFO ] [MAIN ] Update Progress: 934/2373 symbols completed. GHM took 33.2s. Estimated remaining: 3h 21m 44s. Rate: 7.1 symbols/min [2025-10-09T19:10:59.684931] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:59.725791] [DEBUG] [LOCAL ] GIL: Loaded 43687 existing records from primary storage. [2025-10-09T19:10:59.726103] [INFO ] [MAIN ] GIL: Loaded 43687 existing records. [2025-10-09T19:10:59.904035] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:59.904335] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-09T19:10:59.904397] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-09T19:10:59.904701] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-09T19:10:59.904780] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-09T19:11:00.001832] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-09T19:11:00.281017] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:00.420000] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:11:00.637843] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T19:11:00.796741] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-09T19:11:01.596779] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-09T19:11:01.949063] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T19:11:02.396803] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-09T19:11:02.574155] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T19:11:03.196747] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-09T19:11:03.293272] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T19:11:03.996710] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-09T19:11:04.248270] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T19:11:04.796750] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-09T19:11:05.370238] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T19:11:05.596203] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T19:11:05.599249] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-09T19:11:06.396692] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-09T19:11:06.614358] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T19:11:06.616893] [INFO ] [REMOTE ] GHY: Full fetch complete (32302 records). [2025-10-09T19:11:06.616975] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-09T19:11:07.035110] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-09T19:11:07.035208] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-09T19:11:07.035976] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-09T19:11:07.036044] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-09T19:11:07.036900] [DEBUG] [LOCAL ] GHY: Trimmed 32302 records to 21047 (keeping 200 days of data) [2025-10-09T19:11:07.185283] [DEBUG] [LOCAL ] GHY: Primary data saved (21047 records). [2025-10-09T19:11:07.185431] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-09T19:11:07.185571] [INFO ] [MAIN ] Update Progress: 935/2373 symbols completed. GHY took 30.1s. Estimated remaining: 3h 21m 34s. Rate: 7.1 symbols/min [2025-10-09T19:11:07.201982] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-09T19:11:07.396634] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:07.448055] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-09T19:11:07.448449] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-09T19:11:07.642283] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:07.642637] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-09T19:11:07.642726] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-09T19:11:07.642963] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-09T19:11:07.643022] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-09T19:11:07.797867] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:11:08.007624] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-09T19:11:08.052230] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:08.772180] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T19:11:08.796667] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-09T19:11:09.446955] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T19:11:09.596755] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-09T19:11:09.936531] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T19:11:10.396770] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-09T19:11:10.964765] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T19:11:11.196715] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-09T19:11:11.996710] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-09T19:11:12.270001] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T19:11:12.796688] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-09T19:11:12.824592] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:11:12.944358] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T19:11:12.947187] [INFO ] [REMOTE ] GIB: Full fetch complete (45709 records). [2025-10-09T19:11:12.947274] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-09T19:11:13.314000] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-09T19:11:13.314077] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-09T19:11:13.314772] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-09T19:11:13.314835] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-09T19:11:13.315782] [DEBUG] [LOCAL ] GIB: Trimmed 45709 records to 32024 (keeping 200 days of data) [2025-10-09T19:11:13.516073] [DEBUG] [LOCAL ] GIB: Primary data saved (32024 records). [2025-10-09T19:11:13.516213] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-09T19:11:13.517209] [INFO ] [MAIN ] Update Progress: 936/2373 symbols completed. GIB took 34.1s. Estimated remaining: 3h 21m 22s. Rate: 7.1 symbols/min [2025-10-09T19:11:13.605142] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-09T19:11:13.686460] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:13.728573] [DEBUG] [LOCAL ] GKOS: Loaded 42550 existing records from primary storage. [2025-10-09T19:11:13.728921] [INFO ] [MAIN ] GKOS: Loaded 42550 existing records. [2025-10-09T19:11:13.911826] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:13.912083] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-09T19:11:13.912146] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-09T19:11:13.912425] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-09T19:11:13.912501] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-09T19:11:14.288117] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:14.336570] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:11:14.396713] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-09T19:11:14.911687] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T19:11:15.196741] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-09T19:11:15.996682] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-09T19:11:16.005871] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T19:11:16.101344] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T19:11:16.796768] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-09T19:11:17.046457] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T19:11:17.596746] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-09T19:11:17.704483] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:11:18.396735] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-09T19:11:18.858951] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T19:11:19.196774] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-09T19:11:19.789863] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T19:11:19.996702] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-09T19:11:20.402397] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T19:11:20.796793] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-09T19:11:20.924121] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:11:21.596828] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-09T19:11:22.341285] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T19:11:22.396687] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-09T19:11:22.876493] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:11:23.196688] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-09T19:11:23.996755] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-09T19:11:24.351319] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T19:11:24.385914] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T19:11:24.796746] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-09T19:11:24.886751] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T19:11:25.596768] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-09T19:11:26.312822] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:11:26.396678] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-09T19:11:27.196727] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-09T19:11:27.254510] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T19:11:27.997124] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:11:27.997194] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-09T19:11:28.796735] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-09T19:11:28.840632] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:11:28.842111] [INFO ] [REMOTE ] GIC: Full fetch complete (20173 records). [2025-10-09T19:11:28.842184] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-09T19:11:29.214692] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-09T19:11:29.214776] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-09T19:11:29.215232] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-09T19:11:29.215274] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-09T19:11:29.216105] [DEBUG] [LOCAL ] GIC: Trimmed 20173 records to 13510 (keeping 200 days of data) [2025-10-09T19:11:29.322883] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-09T19:11:29.341800] [DEBUG] [LOCAL ] GIC: Primary data saved (13510 records). [2025-10-09T19:11:29.341929] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-09T19:11:29.342008] [INFO ] [MAIN ] Update Progress: 937/2373 symbols completed. GIC took 43.7s. Estimated remaining: 3h 21m 25s. Rate: 7.1 symbols/min [2025-10-09T19:11:29.527102] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:29.566511] [DEBUG] [LOCAL ] GL: Loaded 37792 existing records from primary storage. [2025-10-09T19:11:29.566837] [INFO ] [MAIN ] GL: Loaded 37792 existing records. [2025-10-09T19:11:29.601931] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-09T19:11:29.747410] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:29.747611] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-09T19:11:29.747694] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-09T19:11:29.748092] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-09T19:11:29.748149] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-09T19:11:30.105158] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:30.372748] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T19:11:30.396678] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-09T19:11:31.196689] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-09T19:11:31.277965] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:11:31.976269] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T19:11:31.996676] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-09T19:11:32.796753] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-09T19:11:33.213815] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T19:11:33.504061] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T19:11:33.596704] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-09T19:11:34.346031] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T19:11:34.351688] [INFO ] [REMOTE ] GIL: Full fetch complete (61852 records). [2025-10-09T19:11:34.351852] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-09T19:11:34.401870] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-09T19:11:34.741417] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-09T19:11:34.741536] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-09T19:11:34.742393] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-09T19:11:34.742458] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-09T19:11:34.744334] [DEBUG] [LOCAL ] GIL: Trimmed 61852 records to 44027 (keeping 200 days of data) [2025-10-09T19:11:35.014540] [DEBUG] [LOCAL ] GIL: Primary data saved (44027 records). [2025-10-09T19:11:35.014713] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-09T19:11:35.014811] [INFO ] [MAIN ] Update Progress: 938/2373 symbols completed. GIL took 35.5s. Estimated remaining: 3h 21m 13s. Rate: 7.1 symbols/min [2025-10-09T19:11:35.200082] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:35.198543] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-09T19:11:35.226344] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T19:11:35.273365] [DEBUG] [LOCAL ] GLOB: Loaded 47776 existing records from primary storage. [2025-10-09T19:11:35.273735] [INFO ] [MAIN ] GLOB: Loaded 47776 existing records. [2025-10-09T19:11:35.449806] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:35.450052] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-09T19:11:35.450100] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-09T19:11:35.450335] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-09T19:11:35.450394] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-09T19:11:35.800912] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:35.996717] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-09T19:11:36.507893] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T19:11:36.754790] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:11:36.796735] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-09T19:11:37.006586] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:11:37.596728] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-09T19:11:38.396769] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-09T19:11:38.468072] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T19:11:39.025563] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T19:11:39.196770] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-09T19:11:39.775004] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T19:11:39.996768] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-09T19:11:40.190966] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T19:11:40.796790] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-09T19:11:41.596718] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-09T19:11:41.669398] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T19:11:42.385881] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T19:11:42.397035] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-09T19:11:43.196743] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-09T19:11:43.259150] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:11:43.439952] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T19:11:43.996771] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-09T19:11:44.535508] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:11:44.539001] [INFO ] [REMOTE ] GKOS: Full fetch complete (60054 records). [2025-10-09T19:11:44.539128] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-09T19:11:44.801871] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-09T19:11:44.938891] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-09T19:11:44.938967] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-09T19:11:44.939776] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-09T19:11:44.939839] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-09T19:11:44.940960] [DEBUG] [LOCAL ] GKOS: Trimmed 60054 records to 42815 (keeping 200 days of data) [2025-10-09T19:11:45.197702] [DEBUG] [LOCAL ] GKOS: Primary data saved (42815 records). [2025-10-09T19:11:45.197905] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-09T19:11:45.198017] [INFO ] [MAIN ] Update Progress: 939/2373 symbols completed. GKOS took 31.7s. Estimated remaining: 3h 21m 7s. Rate: 7.1 symbols/min [2025-10-09T19:11:45.373255] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:45.384326] [DEBUG] [LOCAL ] GLP: Loaded 9242 existing records from primary storage. [2025-10-09T19:11:45.384572] [INFO ] [MAIN ] GLP: Loaded 9242 existing records. [2025-10-09T19:11:45.576699] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:45.577006] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-09T19:11:45.577222] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-09T19:11:45.577500] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-09T19:11:45.577734] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-09T19:11:45.601847] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-09T19:11:45.682138] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:11:46.016520] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:46.117856] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T19:11:46.396807] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-09T19:11:47.196694] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-09T19:11:47.563435] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:11:47.588862] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-09T19:11:47.595995] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-09T19:11:47.596203] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-09T19:11:47.803072] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T19:11:48.019534] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-09T19:11:48.023562] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-09T19:11:48.024829] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-09T19:11:48.025921] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-09T19:11:48.025988] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-09T19:11:48.027567] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54062 (keeping 200 days of data) [2025-10-09T19:11:48.354662] [DEBUG] [LOCAL ] GIS: Primary data saved (54062 records). [2025-10-09T19:11:48.354808] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-09T19:11:48.355453] [INFO ] [MAIN ] Update Progress: 940/2373 symbols completed. GIS took 41.2s. Estimated remaining: 3h 20m 51s. Rate: 7.1 symbols/min [2025-10-09T19:11:48.524212] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:48.577090] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-09T19:11:48.577440] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-09T19:11:48.771018] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:48.772011] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T19:11:48.774761] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-09T19:11:48.775542] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-09T19:11:48.775867] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-09T19:11:48.775924] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-09T19:11:48.804756] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-09T19:11:49.126874] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:49.444825] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T19:11:49.596731] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-09T19:11:50.396705] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-09T19:11:51.203826] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-09T19:11:51.210490] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T19:11:51.996813] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-09T19:11:52.660502] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-09T19:11:52.797887] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T19:11:52.796994] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-09T19:11:53.244246] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:11:53.596685] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-09T19:11:53.740115] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T19:11:54.396733] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-09T19:11:55.196733] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-09T19:11:55.250248] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T19:11:55.249211] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T19:11:55.996720] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-09T19:11:56.796701] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-09T19:11:56.847835] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T19:11:57.268091] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-09T19:11:57.596777] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-09T19:11:58.313620] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T19:11:58.396697] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-09T19:11:58.950872] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T19:11:59.196787] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-09T19:11:59.830067] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T19:11:59.996791] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-09T19:12:00.746889] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:12:00.796664] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-09T19:12:01.348705] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T19:12:01.352582] [INFO ] [REMOTE ] GL: Full fetch complete (55211 records). [2025-10-09T19:12:01.352704] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-09T19:12:01.602449] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-09T19:12:01.752498] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-09T19:12:01.752590] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-09T19:12:01.753452] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-09T19:12:01.753523] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-09T19:12:01.754780] [DEBUG] [LOCAL ] GL: Trimmed 55211 records to 38074 (keeping 200 days of data) [2025-10-09T19:12:02.015765] [DEBUG] [LOCAL ] GL: Primary data saved (38074 records). [2025-10-09T19:12:02.015921] [INFO ] [MAIN ] GL: Full history saved. [2025-10-09T19:12:02.016023] [INFO ] [MAIN ] Update Progress: 941/2373 symbols completed. GL took 32.7s. Estimated remaining: 3h 20m 50s. Rate: 7.1 symbols/min [2025-10-09T19:12:02.193924] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:02.249082] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-09T19:12:02.249449] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-09T19:12:02.404789] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-09T19:12:02.432760] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:02.433344] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-09T19:12:02.433556] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-09T19:12:02.433945] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-09T19:12:02.434061] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-09T19:12:02.581905] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T19:12:02.598135] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T19:12:02.853364] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:03.196722] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-09T19:12:03.837059] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-09T19:12:03.996694] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-09T19:12:04.094193] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T19:12:04.796739] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-09T19:12:05.596690] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-09T19:12:05.795447] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T19:12:06.396684] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-09T19:12:06.877015] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T19:12:07.116658] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T19:12:07.196692] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-09T19:12:07.369414] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:12:07.996706] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-09T19:12:08.205373] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T19:12:08.796738] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-09T19:12:09.596743] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-09T19:12:10.205589] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-09T19:12:10.396724] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-09T19:12:10.726168] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T19:12:11.176820] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T19:12:11.178571] [INFO ] [REMOTE ] GLP: Full fetch complete (14283 records). [2025-10-09T19:12:11.178729] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-09T19:12:11.202988] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-09T19:12:11.570380] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-09T19:12:11.570553] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-09T19:12:11.571033] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-09T19:12:11.571244] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-09T19:12:11.600531] [DEBUG] [LOCAL ] GLP: Trimmed 14283 records to 9309 (keeping 200 days of data) [2025-10-09T19:12:11.603283] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T19:12:11.678777] [DEBUG] [LOCAL ] GLP: Primary data saved (9309 records). [2025-10-09T19:12:11.678954] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-09T19:12:11.679062] [INFO ] [MAIN ] Update Progress: 942/2373 symbols completed. GLP took 26.5s. Estimated remaining: 3h 20m 44s. Rate: 7.1 symbols/min [2025-10-09T19:12:11.852589] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:11.909030] [DEBUG] [LOCAL ] GME: Loaded 53783 existing records from primary storage. [2025-10-09T19:12:11.909388] [INFO ] [MAIN ] GME: Loaded 53783 existing records. [2025-10-09T19:12:12.005058] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-09T19:12:12.088290] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:12.088536] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-09T19:12:12.088606] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-09T19:12:12.088940] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-09T19:12:12.089048] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-09T19:12:12.436196] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:12.796823] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-09T19:12:13.503365] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-09T19:12:13.596669] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-09T19:12:13.750949] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:12:14.396682] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-09T19:12:14.467593] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:12:14.471786] [INFO ] [REMOTE ] GLOB: Full fetch complete (64708 records). [2025-10-09T19:12:14.471890] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-09T19:12:14.877849] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-09T19:12:14.877929] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-09T19:12:14.878786] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-09T19:12:14.878853] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-09T19:12:14.880330] [DEBUG] [LOCAL ] GLOB: Trimmed 64708 records to 48132 (keeping 200 days of data) [2025-10-09T19:12:15.172551] [DEBUG] [LOCAL ] GLOB: Primary data saved (48132 records). [2025-10-09T19:12:15.172739] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-09T19:12:15.172841] [INFO ] [MAIN ] Update Progress: 943/2373 symbols completed. GLOB took 40.2s. Estimated remaining: 3h 20m 28s. Rate: 7.1 symbols/min [2025-10-09T19:12:15.204729] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-09T19:12:15.364610] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:15.413979] [DEBUG] [LOCAL ] GMED: Loaded 48352 existing records from primary storage. [2025-10-09T19:12:15.414344] [INFO ] [MAIN ] GMED: Loaded 48352 existing records. [2025-10-09T19:12:15.632701] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:15.632934] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-09T19:12:15.633007] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-09T19:12:15.633609] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-09T19:12:15.633702] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-09T19:12:16.043536] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-09T19:12:16.078178] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-09T19:12:16.098877] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:16.798193] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-09T19:12:16.803986] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-09T19:12:17.161890] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-09T19:12:17.596687] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-09T19:12:17.893616] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T19:12:18.365042] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:12:18.396679] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-09T19:12:19.196706] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-09T19:12:19.285569] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:12:19.762373] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T19:12:19.996720] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-09T19:12:20.796761] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-09T19:12:21.528542] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:12:21.586172] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-09T19:12:21.596843] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-09T19:12:22.396791] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-09T19:12:22.915765] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-09T19:12:23.196711] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-09T19:12:23.240614] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T19:12:23.996750] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-09T19:12:24.173280] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T19:12:24.796715] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-09T19:12:25.331364] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-09T19:12:25.336165] [INFO ] [REMOTE ] GLW: Full fetch complete (77622 records). [2025-10-09T19:12:25.336277] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-09T19:12:25.601924] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-09T19:12:25.769335] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-09T19:12:25.769488] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-09T19:12:25.771135] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-09T19:12:25.772727] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-09T19:12:25.772617] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T19:12:25.784601] [DEBUG] [LOCAL ] GLW: Trimmed 77622 records to 54026 (keeping 200 days of data) [2025-10-09T19:12:26.124096] [DEBUG] [LOCAL ] GLW: Primary data saved (54026 records). [2025-10-09T19:12:26.124238] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-09T19:12:26.124931] [INFO ] [MAIN ] Update Progress: 944/2373 symbols completed. GLW took 37.8s. Estimated remaining: 3h 20m 23s. Rate: 7.1 symbols/min [2025-10-09T19:12:26.297619] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:26.336963] [DEBUG] [LOCAL ] GMRE: Loaded 37133 existing records from primary storage. [2025-10-09T19:12:26.337246] [INFO ] [MAIN ] GMRE: Loaded 37133 existing records. [2025-10-09T19:12:26.400833] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-09T19:12:26.517192] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:26.517588] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-09T19:12:26.517776] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-09T19:12:26.518222] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-09T19:12:26.518280] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-09T19:12:26.924966] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:26.962280] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-09T19:12:27.196692] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-09T19:12:27.559265] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-09T19:12:27.996698] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-09T19:12:28.175685] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:12:28.569238] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T19:12:28.796705] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-09T19:12:29.596727] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-09T19:12:30.155843] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:12:30.396753] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-09T19:12:30.460693] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-09T19:12:31.189502] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T19:12:31.198792] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-09T19:12:31.694314] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T19:12:31.996771] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-09T19:12:32.796720] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-09T19:12:33.374020] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T19:12:33.596718] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-09T19:12:33.810470] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:12:34.396738] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-09T19:12:35.096231] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-09T19:12:35.196675] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-09T19:12:35.623830] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-09T19:12:35.724637] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T19:12:35.996815] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-09T19:12:36.796749] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-09T19:12:37.439574] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T19:12:37.541939] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-09T19:12:37.596689] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-09T19:12:38.396750] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-09T19:12:38.734963] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T19:12:38.857966] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T19:12:39.196764] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-09T19:12:39.728507] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T19:12:39.996719] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-09T19:12:40.796765] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-09T19:12:41.421783] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:12:41.596701] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-09T19:12:41.724780] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-09T19:12:42.070541] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:12:42.396770] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-09T19:12:42.652203] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T19:12:43.196771] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-09T19:12:43.996817] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-09T19:12:44.678855] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T19:12:44.683079] [INFO ] [REMOTE ] GMED: Full fetch complete (69721 records). [2025-10-09T19:12:44.683188] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-09T19:12:44.798739] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-09T19:12:45.113822] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-09T19:12:45.114054] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-09T19:12:45.115717] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-09T19:12:45.115813] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-09T19:12:45.117509] [DEBUG] [LOCAL ] GMED: Trimmed 69721 records to 48701 (keeping 200 days of data) [2025-10-09T19:12:45.242164] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-09T19:12:45.443372] [DEBUG] [LOCAL ] GMED: Primary data saved (48701 records). [2025-10-09T19:12:45.443506] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-09T19:12:45.443602] [INFO ] [MAIN ] Update Progress: 945/2373 symbols completed. GMED took 30.3s. Estimated remaining: 3h 20m 31s. Rate: 7.1 symbols/min [2025-10-09T19:12:45.611389] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-09T19:12:45.613891] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:45.632865] [DEBUG] [LOCAL ] GNE: Loaded 17869 existing records from primary storage. [2025-10-09T19:12:45.633100] [INFO ] [MAIN ] GNE: Loaded 17869 existing records. [2025-10-09T19:12:45.816307] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:45.816582] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-09T19:12:45.816669] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-09T19:12:45.816938] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-09T19:12:45.816996] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-09T19:12:46.079251] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-09T19:12:46.114147] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-09T19:12:46.117411] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-09T19:12:46.295401] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:46.326348] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:12:46.407186] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-09T19:12:46.626079] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-09T19:12:46.626166] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-09T19:12:46.627133] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-09T19:12:46.627199] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-09T19:12:46.628761] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54119 (keeping 200 days of data) [2025-10-09T19:12:46.965931] [DEBUG] [LOCAL ] GM: Primary data saved (54119 records). [2025-10-09T19:12:46.966072] [INFO ] [MAIN ] GM: Full history saved. [2025-10-09T19:12:46.966229] [INFO ] [MAIN ] Update Progress: 946/2373 symbols completed. GM took 45.0s. Estimated remaining: 3h 20m 12s. Rate: 7.1 symbols/min [2025-10-09T19:12:47.149314] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:47.188517] [DEBUG] [LOCAL ] GNK: Loaded 40257 existing records from primary storage. [2025-10-09T19:12:47.188872] [INFO ] [MAIN ] GNK: Loaded 40257 existing records. [2025-10-09T19:12:47.201826] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-09T19:12:47.384102] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:47.384357] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-09T19:12:47.384417] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-09T19:12:47.384682] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-09T19:12:47.384742] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-09T19:12:47.760309] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:47.943277] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T19:12:47.962134] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T19:12:48.002997] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-09T19:12:48.008541] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-09T19:12:48.801829] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-09T19:12:48.804381] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T19:12:49.596742] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-09T19:12:49.977824] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:12:49.980388] [INFO ] [REMOTE ] GMRE: Full fetch complete (52899 records). [2025-10-09T19:12:49.980480] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-09T19:12:50.397009] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-09T19:12:50.413361] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-09T19:12:50.413470] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-09T19:12:50.415439] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-09T19:12:50.416038] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-09T19:12:50.418123] [DEBUG] [LOCAL ] GMRE: Trimmed 52899 records to 37301 (keeping 200 days of data) [2025-10-09T19:12:50.774332] [DEBUG] [LOCAL ] GMRE: Primary data saved (37301 records). [2025-10-09T19:12:50.774716] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-09T19:12:50.775375] [INFO ] [MAIN ] Update Progress: 947/2373 symbols completed. GMRE took 24.7s. Estimated remaining: 3h 19m 57s. Rate: 7.1 symbols/min [2025-10-09T19:12:51.083812] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:51.109610] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:12:51.163239] [DEBUG] [LOCAL ] GNL: Loaded 46764 existing records from primary storage. [2025-10-09T19:12:51.163633] [INFO ] [MAIN ] GNL: Loaded 46764 existing records. [2025-10-09T19:12:51.201966] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-09T19:12:51.380462] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:51.380722] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-09T19:12:51.380780] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-09T19:12:51.381049] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-09T19:12:51.381107] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-09T19:12:51.760372] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:51.996721] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-09T19:12:52.635634] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T19:12:52.796771] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-09T19:12:52.996981] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-09T19:12:53.164330] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T19:12:53.537392] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T19:12:53.596703] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-09T19:12:54.195285] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T19:12:54.396802] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-09T19:12:55.196744] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-09T19:12:55.996713] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-09T19:12:56.061631] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T19:12:56.796795] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-09T19:12:57.376824] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T19:12:57.470404] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T19:12:57.596688] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-09T19:12:57.715156] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-09T19:12:57.719712] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-09T19:12:57.719827] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-09T19:12:58.116078] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-09T19:12:58.116282] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-09T19:12:58.117297] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-09T19:12:58.117364] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-09T19:12:58.119005] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54173 (keeping 200 days of data) [2025-10-09T19:12:58.402350] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-09T19:12:58.454702] [DEBUG] [LOCAL ] GME: Primary data saved (54173 records). [2025-10-09T19:12:58.454834] [INFO ] [MAIN ] GME: Full history saved. [2025-10-09T19:12:58.455724] [INFO ] [MAIN ] Update Progress: 948/2373 symbols completed. GME took 46.8s. Estimated remaining: 3h 19m 48s. Rate: 7.1 symbols/min [2025-10-09T19:12:58.633068] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:58.682164] [DEBUG] [LOCAL ] GNRC: Loaded 45257 existing records from primary storage. [2025-10-09T19:12:58.682485] [INFO ] [MAIN ] GNRC: Loaded 45257 existing records. [2025-10-09T19:12:58.871557] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:58.871826] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-09T19:12:58.871878] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-09T19:12:58.872144] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-09T19:12:58.872204] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-09T19:12:59.213493] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-09T19:12:59.256800] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:59.280730] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T19:12:59.375275] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T19:12:59.996734] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-09T19:13:00.796743] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-09T19:13:01.036610] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:13:01.596702] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-09T19:13:01.710885] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:13:02.192133] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T19:13:02.396755] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-09T19:13:03.196769] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-09T19:13:03.231388] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:13:03.919421] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T19:13:03.996690] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-09T19:13:04.796700] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-09T19:13:04.841614] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T19:13:05.275688] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T19:13:05.596741] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-09T19:13:06.259495] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:13:06.396732] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-09T19:13:06.739068] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T19:13:07.196761] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-09T19:13:07.830460] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:13:07.996689] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-09T19:13:08.357519] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T19:13:08.796743] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-09T19:13:09.475236] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:13:09.596685] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-09T19:13:09.881842] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:13:10.396799] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-09T19:13:10.841559] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T19:13:11.196725] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-09T19:13:11.330027] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T19:13:11.996691] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-09T19:13:12.699434] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:13:12.796739] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-09T19:13:13.456216] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:13:13.596796] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-09T19:13:14.396705] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-09T19:13:14.513792] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T19:13:14.515326] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T19:13:14.527030] [INFO ] [REMOTE ] GNE: Full fetch complete (22467 records). [2025-10-09T19:13:14.527392] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-09T19:13:14.901372] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-09T19:13:14.901445] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-09T19:13:14.901928] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-09T19:13:14.901990] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-09T19:13:14.902611] [DEBUG] [LOCAL ] GNE: Trimmed 22467 records to 17962 (keeping 200 days of data) [2025-10-09T19:13:15.022949] [DEBUG] [LOCAL ] GNE: Primary data saved (17962 records). [2025-10-09T19:13:15.023062] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-09T19:13:15.023142] [INFO ] [MAIN ] Update Progress: 949/2373 symbols completed. GNE took 29.6s. Estimated remaining: 3h 19m 51s. Rate: 7.1 symbols/min [2025-10-09T19:13:15.190735] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:15.196919] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-09T19:13:15.202361] [DEBUG] [LOCAL ] GNT: Loaded 8298 existing records from primary storage. [2025-10-09T19:13:15.202620] [INFO ] [MAIN ] GNT: Loaded 8298 existing records. [2025-10-09T19:13:15.395336] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:15.395552] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-09T19:13:15.395612] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-09T19:13:15.395863] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-09T19:13:15.395922] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-09T19:13:15.757771] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:15.790032] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T19:13:15.996738] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-09T19:13:16.390202] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:13:16.796733] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-09T19:13:17.525111] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:13:17.596678] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-09T19:13:18.061878] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T19:13:18.396721] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-09T19:13:18.838924] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:13:19.196781] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-09T19:13:19.642758] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:13:19.996753] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-09T19:13:20.287799] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:13:20.796773] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-09T19:13:21.083845] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T19:13:21.088879] [INFO ] [REMOTE ] GNL: Full fetch complete (68102 records). [2025-10-09T19:13:21.089015] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-09T19:13:21.473031] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-09T19:13:21.473122] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-09T19:13:21.474049] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-09T19:13:21.474115] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-09T19:13:21.475489] [DEBUG] [LOCAL ] GNL: Trimmed 68102 records to 47094 (keeping 200 days of data) [2025-10-09T19:13:21.638992] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-09T19:13:21.747729] [DEBUG] [LOCAL ] GNL: Primary data saved (47094 records). [2025-10-09T19:13:21.747876] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-09T19:13:21.748431] [INFO ] [MAIN ] Update Progress: 950/2373 symbols completed. GNL took 31.0s. Estimated remaining: 3h 19m 40s. Rate: 7.1 symbols/min [2025-10-09T19:13:21.916620] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:21.973017] [DEBUG] [LOCAL ] GNW: Loaded 51342 existing records from primary storage. [2025-10-09T19:13:21.973378] [INFO ] [MAIN ] GNW: Loaded 51342 existing records. [2025-10-09T19:13:22.138168] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:13:22.168333] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:22.168487] [INFO ] [REMOTE ] GNK: Full fetch complete (57204 records). [2025-10-09T19:13:22.168820] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-09T19:13:22.168988] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-09T19:13:22.169217] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-09T19:13:22.169736] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-09T19:13:22.200948] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-09T19:13:22.355052] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T19:13:22.397835] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-09T19:13:23.010804] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:23.011065] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-09T19:13:23.012212] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:13:23.012283] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-09T19:13:23.015545] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-09T19:13:23.015620] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-09T19:13:23.016854] [DEBUG] [LOCAL ] GNK: Trimmed 57204 records to 40519 (keeping 200 days of data) [2025-10-09T19:13:23.202789] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-09T19:13:23.290610] [DEBUG] [LOCAL ] GNK: Primary data saved (40519 records). [2025-10-09T19:13:23.290785] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-09T19:13:23.290878] [INFO ] [MAIN ] Update Progress: 951/2373 symbols completed. GNK took 36.3s. Estimated remaining: 3h 19m 22s. Rate: 7.1 symbols/min [2025-10-09T19:13:23.469630] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:23.512851] [DEBUG] [LOCAL ] GOF: Loaded 42523 existing records from primary storage. [2025-10-09T19:13:23.513208] [INFO ] [MAIN ] GOF: Loaded 42523 existing records. [2025-10-09T19:13:23.691283] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:23.691521] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-09T19:13:23.691589] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-09T19:13:23.692108] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-09T19:13:23.692169] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-09T19:13:23.864183] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T19:13:24.001795] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-09T19:13:24.066518] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:24.796729] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-09T19:13:25.596754] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-09T19:13:25.741975] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T19:13:26.251039] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:13:26.396754] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-09T19:13:27.024204] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:13:27.196709] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-09T19:13:27.996692] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-09T19:13:28.085402] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:13:28.528815] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:13:28.796798] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-09T19:13:29.343194] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:13:29.596731] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-09T19:13:30.125424] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T19:13:30.155880] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T19:13:30.396732] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-09T19:13:30.849964] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T19:13:31.196757] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-09T19:13:31.996732] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-09T19:13:32.700490] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T19:13:32.730158] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:13:32.796750] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-09T19:13:33.559768] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T19:13:33.596677] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-09T19:13:34.396746] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-09T19:13:34.403834] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T19:13:35.196770] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-09T19:13:35.996700] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-09T19:13:36.165953] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T19:13:36.728263] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:13:36.796688] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-09T19:13:37.407666] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T19:13:37.596697] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-09T19:13:38.152726] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:13:38.396724] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-09T19:13:39.014890] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T19:13:39.196698] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-09T19:13:39.256499] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:13:39.996770] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-09T19:13:40.796710] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-09T19:13:40.846511] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T19:13:41.326420] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T19:13:41.596718] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-09T19:13:41.662682] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:13:41.666636] [INFO ] [REMOTE ] GNRC: Full fetch complete (65372 records). [2025-10-09T19:13:41.666786] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-09T19:13:42.047986] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-09T19:13:42.048070] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-09T19:13:42.048951] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-09T19:13:42.049020] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-09T19:13:42.050359] [DEBUG] [LOCAL ] GNRC: Trimmed 65372 records to 45593 (keeping 200 days of data) [2025-10-09T19:13:42.326921] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T19:13:42.331120] [INFO ] [REMOTE ] GNT: Full fetch complete (11053 records). [2025-10-09T19:13:42.332256] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-09T19:13:42.397944] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-09T19:13:42.430593] [DEBUG] [LOCAL ] GNRC: Primary data saved (45593 records). [2025-10-09T19:13:42.441282] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-09T19:13:42.442148] [INFO ] [MAIN ] Update Progress: 952/2373 symbols completed. GNRC took 44.0s. Estimated remaining: 3h 19m 29s. Rate: 7.1 symbols/min [2025-10-09T19:13:42.812288] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:42.890838] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-09T19:13:42.890930] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-09T19:13:42.891217] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-09T19:13:42.891299] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-09T19:13:42.891913] [DEBUG] [LOCAL ] GNT: Trimmed 11053 records to 8376 (keeping 200 days of data) [2025-10-09T19:13:42.972701] [DEBUG] [LOCAL ] GOLF: Loaded 31026 existing records from primary storage. [2025-10-09T19:13:42.971611] [DEBUG] [LOCAL ] GNT: Primary data saved (8376 records). [2025-10-09T19:13:42.973095] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-09T19:13:42.973298] [INFO ] [MAIN ] GOLF: Loaded 31026 existing records. [2025-10-09T19:13:42.973446] [INFO ] [MAIN ] Update Progress: 953/2373 symbols completed. GNT took 28.0s. Estimated remaining: 3h 19m 9s. Rate: 7.1 symbols/min [2025-10-09T19:13:43.213696] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-09T19:13:43.416612] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:43.432890] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-09T19:13:43.432975] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-09T19:13:43.433310] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-09T19:13:43.433381] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-09T19:13:43.517327] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:43.884709] [DEBUG] [LOCAL ] GOOS: Loaded 44801 existing records from primary storage. [2025-10-09T19:13:43.908538] [INFO ] [MAIN ] GOOS: Loaded 44801 existing records. [2025-10-09T19:13:44.076526] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:44.087334] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-09T19:13:44.189331] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:44.189962] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-09T19:13:44.190036] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-09T19:13:44.202820] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-09T19:13:44.208042] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-09T19:13:44.324425] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T19:13:44.592124] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:44.796735] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-09T19:13:44.947673] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T19:13:44.997718] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T19:13:45.596794] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-09T19:13:46.396776] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-09T19:13:46.619780] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T19:13:46.657009] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T19:13:47.196766] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-09T19:13:47.962349] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:13:47.996789] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-09T19:13:48.716149] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T19:13:48.796765] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-09T19:13:49.096107] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T19:13:49.596760] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-09T19:13:50.350452] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:13:50.396680] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-09T19:13:51.196773] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-09T19:13:51.308630] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T19:13:51.996691] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-09T19:13:52.090129] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T19:13:52.696104] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T19:13:52.796710] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-09T19:13:53.439545] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:13:53.444097] [INFO ] [REMOTE ] GNW: Full fetch complete (73677 records). [2025-10-09T19:13:53.444221] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-09T19:13:53.602439] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-09T19:13:53.860057] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-09T19:13:53.860267] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-09T19:13:53.861286] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-09T19:13:53.861380] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-09T19:13:53.862904] [DEBUG] [LOCAL ] GNW: Trimmed 73677 records to 51730 (keeping 200 days of data) [2025-10-09T19:13:54.091536] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:13:54.199281] [DEBUG] [LOCAL ] GNW: Primary data saved (51730 records). [2025-10-09T19:13:54.199434] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-09T19:13:54.200034] [INFO ] [MAIN ] Update Progress: 954/2373 symbols completed. GNW took 32.5s. Estimated remaining: 3h 19m 5s. Rate: 7.1 symbols/min [2025-10-09T19:13:54.371989] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:54.396742] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-09T19:13:54.411547] [DEBUG] [LOCAL ] GOTU: Loaded 37800 existing records from primary storage. [2025-10-09T19:13:54.411883] [INFO ] [MAIN ] GOTU: Loaded 37800 existing records. [2025-10-09T19:13:54.597724] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:54.598277] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-09T19:13:54.598338] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-09T19:13:54.598964] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-09T19:13:54.599025] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-09T19:13:54.967431] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:55.138723] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:13:55.196702] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-09T19:13:55.892386] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T19:13:55.996745] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-09T19:13:56.301301] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T19:13:56.796746] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-09T19:13:57.439934] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:13:57.596701] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-09T19:13:58.396704] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-09T19:13:58.433227] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T19:13:58.777624] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T19:13:59.196725] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-09T19:13:59.921454] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:13:59.964428] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T19:13:59.996674] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-09T19:14:00.796718] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-09T19:14:01.156609] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T19:14:01.596697] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-09T19:14:02.161548] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:14:02.165198] [INFO ] [REMOTE ] GOF: Full fetch complete (62040 records). [2025-10-09T19:14:02.165298] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-09T19:14:02.401904] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-09T19:14:02.548980] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-09T19:14:02.549056] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-09T19:14:02.549873] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-09T19:14:02.549935] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-09T19:14:02.551105] [DEBUG] [LOCAL ] GOF: Trimmed 62040 records to 42828 (keeping 200 days of data) [2025-10-09T19:14:02.814094] [DEBUG] [LOCAL ] GOF: Primary data saved (42828 records). [2025-10-09T19:14:02.814224] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-09T19:14:02.814318] [INFO ] [MAIN ] Update Progress: 955/2373 symbols completed. GOF took 39.5s. Estimated remaining: 3h 18m 57s. Rate: 7.1 symbols/min [2025-10-09T19:14:02.978615] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:03.024876] [DEBUG] [LOCAL ] GPC: Loaded 46159 existing records from primary storage. [2025-10-09T19:14:03.025195] [INFO ] [MAIN ] GPC: Loaded 46159 existing records. [2025-10-09T19:14:03.202353] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-09T19:14:03.207983] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:03.208254] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-09T19:14:03.208309] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-09T19:14:03.208503] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-09T19:14:03.208559] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-09T19:14:03.410047] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T19:14:03.644680] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:03.646436] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T19:14:03.996773] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-09T19:14:04.331684] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:14:04.796720] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-09T19:14:05.517963] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:14:05.596672] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-09T19:14:06.008390] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:14:06.396724] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-09T19:14:07.139794] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:14:07.196669] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-09T19:14:07.996694] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-09T19:14:08.050742] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T19:14:08.758740] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:14:08.796664] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-09T19:14:09.151062] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T19:14:09.596781] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-09T19:14:10.309055] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T19:14:10.396676] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-09T19:14:11.196791] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-09T19:14:11.239514] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T19:14:11.605513] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T19:14:11.996750] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-09T19:14:12.321730] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:14:12.324377] [INFO ] [REMOTE ] GOLF: Full fetch complete (45076 records). [2025-10-09T19:14:12.324486] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-09T19:14:12.728979] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-09T19:14:12.729060] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-09T19:14:12.729819] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-09T19:14:12.729883] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-09T19:14:12.731195] [DEBUG] [LOCAL ] GOLF: Trimmed 45076 records to 31223 (keeping 200 days of data) [2025-10-09T19:14:12.802584] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-09T19:14:12.950791] [DEBUG] [LOCAL ] GOLF: Primary data saved (31223 records). [2025-10-09T19:14:12.950954] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-09T19:14:12.951046] [INFO ] [MAIN ] Update Progress: 956/2373 symbols completed. GOLF took 30.5s. Estimated remaining: 3h 18m 51s. Rate: 7.1 symbols/min [2025-10-09T19:14:13.153462] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:13.169790] [DEBUG] [LOCAL ] GPI: Loaded 14622 existing records from primary storage. [2025-10-09T19:14:13.170032] [INFO ] [MAIN ] GPI: Loaded 14622 existing records. [2025-10-09T19:14:13.380016] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:13.380310] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-09T19:14:13.380362] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-09T19:14:13.380527] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-09T19:14:13.380567] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-09T19:14:13.605485] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-09T19:14:13.822901] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:13.851198] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:14:14.315486] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T19:14:14.396668] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-09T19:14:15.117426] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T19:14:15.196735] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-09T19:14:15.854634] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:14:15.996711] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-09T19:14:16.741969] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:14:16.796674] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-09T19:14:17.433170] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T19:14:17.596725] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-09T19:14:17.873140] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T19:14:18.396779] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-09T19:14:18.831898] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:14:19.196742] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-09T19:14:19.665574] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:14:19.996760] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-09T19:14:20.796738] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-09T19:14:20.952171] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T19:14:21.457829] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T19:14:21.461662] [INFO ] [REMOTE ] GOOS: Full fetch complete (65114 records). [2025-10-09T19:14:21.461794] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-09T19:14:21.601883] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-09T19:14:21.851666] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-09T19:14:21.851872] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-09T19:14:21.852801] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-09T19:14:21.852894] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-09T19:14:21.854180] [DEBUG] [LOCAL ] GOOS: Trimmed 65114 records to 45117 (keeping 200 days of data) [2025-10-09T19:14:21.983820] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T19:14:22.147432] [DEBUG] [LOCAL ] GOOS: Primary data saved (45117 records). [2025-10-09T19:14:22.147565] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-09T19:14:22.147669] [INFO ] [MAIN ] Update Progress: 957/2373 symbols completed. GOOS took 39.2s. Estimated remaining: 3h 18m 44s. Rate: 7.1 symbols/min [2025-10-09T19:14:22.396677] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-09T19:14:22.602815] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T19:14:23.196793] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-09T19:14:23.544729] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T19:14:23.996730] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-09T19:14:24.751262] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T19:14:24.796688] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-09T19:14:25.413768] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T19:14:25.596735] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-09T19:14:26.060572] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T19:14:26.396736] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-09T19:14:26.511719] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T19:14:26.514679] [INFO ] [REMOTE ] GOTU: Full fetch complete (58701 records). [2025-10-09T19:14:26.514764] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-09T19:14:26.926439] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-09T19:14:26.926514] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-09T19:14:26.927317] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-09T19:14:26.927379] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-09T19:14:26.928454] [DEBUG] [LOCAL ] GOTU: Trimmed 58701 records to 37996 (keeping 200 days of data) [2025-10-09T19:14:27.145113] [DEBUG] [LOCAL ] GOTU: Primary data saved (37996 records). [2025-10-09T19:14:27.145295] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-09T19:14:27.145888] [INFO ] [MAIN ] Update Progress: 958/2373 symbols completed. GOTU took 32.9s. Estimated remaining: 3h 18m 30s. Rate: 7.1 symbols/min [2025-10-09T19:14:27.196756] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-09T19:14:27.879005] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T19:14:27.883489] [INFO ] [REMOTE ] GPC: Full fetch complete (68787 records). [2025-10-09T19:14:27.883631] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-09T19:14:28.222635] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T19:14:28.262192] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-09T19:14:28.301401] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-09T19:14:28.301487] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-09T19:14:28.302492] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-09T19:14:28.302564] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-09T19:14:28.304056] [DEBUG] [LOCAL ] GPC: Trimmed 68787 records to 46526 (keeping 200 days of data) [2025-10-09T19:14:28.607771] [DEBUG] [LOCAL ] GPC: Primary data saved (46526 records). [2025-10-09T19:14:28.607962] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-09T19:14:28.608057] [INFO ] [MAIN ] Update Progress: 959/2373 symbols completed. GPC took 25.8s. Estimated remaining: 3h 18m 12s. Rate: 7.1 symbols/min [2025-10-09T19:14:29.226740] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T19:14:29.229827] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-09T19:14:30.419600] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T19:14:30.423964] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-09T19:14:31.569840] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T19:14:31.574407] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-09T19:14:32.456254] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T19:14:32.459165] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-09T19:14:33.454948] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T19:14:33.458542] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-09T19:14:34.138802] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:14:34.142889] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-09T19:14:34.983377] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T19:14:34.986968] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-09T19:14:35.949281] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T19:14:35.955452] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-09T19:14:37.002354] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T19:14:37.004095] [INFO ] [REMOTE ] GPI: Full fetch complete (21138 records). [2025-10-09T19:14:37.004195] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-09T19:14:37.385313] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-09T19:14:37.385393] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-09T19:14:37.385901] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-09T19:14:37.385962] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-09T19:14:37.386519] [DEBUG] [LOCAL ] GPI: Trimmed 21138 records to 14741 (keeping 200 days of data) [2025-10-09T19:14:37.481965] [DEBUG] [LOCAL ] GPI: Primary data saved (14741 records). [2025-10-09T19:14:37.482119] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-09T19:14:37.482220] [INFO ] [MAIN ] Update Progress: 960/2373 symbols completed. GPI took 24.5s. Estimated remaining: 3h 18m 4s. Rate: 7.1 symbols/min [2025-10-09T19:14:38.062787] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:38.205036] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:38.252944] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:38.237809] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:38.270865] [DEBUG] [LOCAL ] GPJA: Loaded 4265 existing records from primary storage. [2025-10-09T19:14:38.271283] [INFO ] [MAIN ] GPJA: Loaded 4265 existing records. [2025-10-09T19:14:38.354138] [DEBUG] [LOCAL ] GPMT: Loaded 25869 existing records from primary storage. [2025-10-09T19:14:38.378591] [INFO ] [MAIN ] GPMT: Loaded 25869 existing records. [2025-10-09T19:14:38.624312] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:38.625135] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-09T19:14:38.625334] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-09T19:14:38.688421] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-09T19:14:38.689564] [DEBUG] [LOCAL ] GPK: Loaded 52672 existing records from primary storage. [2025-10-09T19:14:38.711973] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-09T19:14:38.737521] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:38.776617] [INFO ] [MAIN ] GPK: Loaded 52672 existing records. [2025-10-09T19:14:38.770861] [DEBUG] [LOCAL ] GPN: Loaded 52027 existing records from primary storage. [2025-10-09T19:14:38.796922] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-09T19:14:38.802445] [INFO ] [MAIN ] GPN: Loaded 52027 existing records. [2025-10-09T19:14:38.826675] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-09T19:14:38.896932] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-09T19:14:38.927803] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-09T19:14:39.487240] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:39.502830] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-09T19:14:39.492397] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:39.525467] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-09T19:14:39.562880] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-09T19:14:39.621842] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-09T19:14:39.611550] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-09T19:14:39.651207] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-09T19:14:39.769938] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-09T19:14:39.784635] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-09T19:14:40.078551] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:40.136030] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-09T19:14:40.218766] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:40.265007] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-09T19:14:40.539589] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:40.551505] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-09T19:14:40.658463] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:40.658874] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-09T19:14:40.885631] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T19:14:40.887790] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-09T19:14:41.574194] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T19:14:41.577355] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-09T19:14:41.614564] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:14:41.620919] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-09T19:14:41.829032] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:14:41.839197] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-09T19:14:42.171694] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:14:42.182068] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-09T19:14:42.186053] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T19:14:42.396744] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-09T19:14:42.634470] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:14:42.868838] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T19:14:43.196711] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-09T19:14:43.247902] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:14:43.511768] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:14:43.907408] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T19:14:43.996783] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-09T19:14:44.469546] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T19:14:44.796767] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-09T19:14:45.596715] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-09T19:14:45.936309] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T19:14:46.187206] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T19:14:46.396737] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-09T19:14:47.196784] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-09T19:14:48.002828] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-09T19:14:48.005420] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T19:14:48.796674] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-09T19:14:48.850638] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T19:14:49.108444] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T19:14:49.596722] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-09T19:14:50.162593] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T19:14:50.396688] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-09T19:14:50.566158] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T19:14:51.196809] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-09T19:14:51.616576] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-09T19:14:51.996687] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-09T19:14:52.117118] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:14:52.796715] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-09T19:14:53.282453] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:14:53.558921] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:14:53.596678] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-09T19:14:54.396781] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-09T19:14:55.196750] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-09T19:14:55.316717] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:14:55.772189] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T19:14:55.996761] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-09T19:14:56.796755] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-09T19:14:57.048206] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:14:57.183562] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T19:14:57.596800] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-09T19:14:58.079107] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T19:14:58.396734] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-09T19:14:59.029968] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:14:59.196700] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-09T19:14:59.943468] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:14:59.996692] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-09T19:15:00.796703] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-09T19:15:00.893322] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T19:15:01.404756] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T19:15:01.405679] [INFO ] [REMOTE ] GPJA: Full fetch complete (7182 records). [2025-10-09T19:15:01.405765] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-09T19:15:01.606226] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-09T19:15:01.801129] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-09T19:15:01.801338] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-09T19:15:01.801614] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-09T19:15:01.801732] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-09T19:15:01.802195] [DEBUG] [LOCAL ] GPJA: Trimmed 7182 records to 4288 (keeping 200 days of data) [2025-10-09T19:15:01.834850] [DEBUG] [LOCAL ] GPJA: Primary data saved (4288 records). [2025-10-09T19:15:01.866205] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-09T19:15:01.869526] [INFO ] [MAIN ] Update Progress: 961/2373 symbols completed. GPJA took 24.4s. Estimated remaining: 3h 18m 19s. Rate: 7.1 symbols/min [2025-10-09T19:15:01.904881] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T19:15:02.064200] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:02.093605] [DEBUG] [LOCAL ] GPOR: Loaded 23230 existing records from primary storage. [2025-10-09T19:15:02.093970] [INFO ] [MAIN ] GPOR: Loaded 23230 existing records. [2025-10-09T19:15:02.287535] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:02.287852] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-09T19:15:02.287909] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-09T19:15:02.288102] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-09T19:15:02.288159] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-09T19:15:02.401804] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-09T19:15:02.685782] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:02.807610] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T19:15:03.196717] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-09T19:15:03.996691] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-09T19:15:04.338889] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T19:15:04.593683] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-09T19:15:04.796734] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-09T19:15:04.988824] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T19:15:05.596757] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-09T19:15:06.396707] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-09T19:15:06.590853] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T19:15:07.196694] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-09T19:15:07.294394] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:15:07.600197] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T19:15:07.905112] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T19:15:07.996731] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-09T19:15:08.796785] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-09T19:15:08.878215] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T19:15:08.880280] [INFO ] [REMOTE ] GPMT: Full fetch complete (37014 records). [2025-10-09T19:15:08.880354] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-09T19:15:09.250178] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-09T19:15:09.250257] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-09T19:15:09.250878] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-09T19:15:09.250940] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-09T19:15:09.251777] [DEBUG] [LOCAL ] GPMT: Trimmed 37014 records to 26009 (keeping 200 days of data) [2025-10-09T19:15:09.401765] [DEBUG] [LOCAL ] GPMT: Primary data saved (26009 records). [2025-10-09T19:15:09.401899] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-09T19:15:09.402015] [INFO ] [MAIN ] Update Progress: 962/2373 symbols completed. GPMT took 31.9s. Estimated remaining: 3h 18m 9s. Rate: 7.1 symbols/min [2025-10-09T19:15:09.575633] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:09.598353] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-09T19:15:09.615404] [DEBUG] [LOCAL ] GPRK: Loaded 39463 existing records from primary storage. [2025-10-09T19:15:09.615748] [INFO ] [MAIN ] GPRK: Loaded 39463 existing records. [2025-10-09T19:15:09.790413] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:09.790696] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-09T19:15:09.790755] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-09T19:15:09.790996] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-09T19:15:09.791053] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-09T19:15:10.174216] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:10.396680] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-09T19:15:10.539444] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:15:11.126024] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:15:11.130742] [INFO ] [REMOTE ] GPK: Full fetch complete (75619 records). [2025-10-09T19:15:11.130895] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-09T19:15:11.201911] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-09T19:15:11.545888] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-09T19:15:11.546038] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-09T19:15:11.547017] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-09T19:15:11.547099] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-09T19:15:11.548601] [DEBUG] [LOCAL ] GPK: Trimmed 75619 records to 53056 (keeping 200 days of data) [2025-10-09T19:15:11.805483] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:15:11.910550] [DEBUG] [LOCAL ] GPK: Primary data saved (53056 records). [2025-10-09T19:15:11.910710] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-09T19:15:11.910806] [INFO ] [MAIN ] Update Progress: 963/2373 symbols completed. GPK took 34.4s. Estimated remaining: 3h 17m 52s. Rate: 7.1 symbols/min [2025-10-09T19:15:12.004008] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-09T19:15:12.085443] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:12.116936] [DEBUG] [LOCAL ] GRBK: Loaded 26912 existing records from primary storage. [2025-10-09T19:15:12.117526] [INFO ] [MAIN ] GRBK: Loaded 26912 existing records. [2025-10-09T19:15:12.297350] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:12.297610] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-09T19:15:12.297720] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-09T19:15:12.298088] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-09T19:15:12.298206] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-09T19:15:12.656074] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:12.796693] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-09T19:15:13.009452] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T19:15:13.312165] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:15:13.596766] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-09T19:15:13.971940] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T19:15:14.396686] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-09T19:15:14.808998] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T19:15:15.196721] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-09T19:15:15.996705] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-09T19:15:16.087812] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:15:16.425148] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T19:15:16.796782] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-09T19:15:17.295516] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T19:15:17.596720] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-09T19:15:18.396709] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-09T19:15:18.501309] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T19:15:18.506174] [INFO ] [REMOTE ] GPN: Full fetch complete (74908 records). [2025-10-09T19:15:18.506332] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-09T19:15:18.925973] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T19:15:18.926242] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-09T19:15:18.934534] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-09T19:15:18.935522] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-09T19:15:18.935603] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-09T19:15:18.937021] [DEBUG] [LOCAL ] GPN: Trimmed 74908 records to 52403 (keeping 200 days of data) [2025-10-09T19:15:19.218203] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-09T19:15:19.264450] [DEBUG] [LOCAL ] GPN: Primary data saved (52403 records). [2025-10-09T19:15:19.264581] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-09T19:15:19.265605] [INFO ] [MAIN ] Update Progress: 964/2373 symbols completed. GPN took 41.8s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-09T19:15:19.432911] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:19.444255] [DEBUG] [LOCAL ] GRC: Loaded 9202 existing records from primary storage. [2025-10-09T19:15:19.444477] [INFO ] [MAIN ] GRC: Loaded 9202 existing records. [2025-10-09T19:15:19.620956] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:19.633078] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-09T19:15:19.633725] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-09T19:15:19.634190] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T19:15:19.634233] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-09T19:15:19.639161] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-09T19:15:19.982089] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:19.996664] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-09T19:15:20.773596] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-09T19:15:20.796666] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-09T19:15:20.831446] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T19:15:21.593678] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T19:15:21.596672] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-09T19:15:22.396724] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-09T19:15:22.628961] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:15:23.196687] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-09T19:15:23.651147] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:15:23.996733] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-09T19:15:23.998482] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T19:15:24.796719] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-09T19:15:25.488020] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:15:25.596701] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-09T19:15:25.939708] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:15:26.396729] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-09T19:15:27.084028] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T19:15:27.196718] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-09T19:15:27.566892] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:15:27.996732] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-09T19:15:28.595573] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:15:28.627737] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T19:15:28.796751] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-09T19:15:29.579262] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:15:29.596720] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-09T19:15:30.396803] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-09T19:15:30.946781] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:15:31.146110] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T19:15:31.196689] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-09T19:15:31.937074] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T19:15:31.996693] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-09T19:15:32.748115] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T19:15:32.796751] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-09T19:15:33.596679] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-09T19:15:34.067382] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T19:15:34.363082] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T19:15:34.396720] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-09T19:15:35.196776] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-09T19:15:35.568250] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T19:15:35.996797] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-09T19:15:36.097333] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T19:15:36.796739] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-09T19:15:37.518100] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:15:37.596727] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-09T19:15:37.616844] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T19:15:37.618481] [INFO ] [REMOTE ] GRC: Full fetch complete (13254 records). [2025-10-09T19:15:37.618578] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-09T19:15:38.055456] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-09T19:15:38.055541] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-09T19:15:38.055913] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-09T19:15:38.055977] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-09T19:15:38.056612] [DEBUG] [LOCAL ] GRC: Trimmed 13254 records to 9268 (keeping 200 days of data) [2025-10-09T19:15:38.122947] [DEBUG] [LOCAL ] GRC: Primary data saved (9268 records). [2025-10-09T19:15:38.123127] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-09T19:15:38.123228] [INFO ] [MAIN ] Update Progress: 965/2373 symbols completed. GRC took 18.9s. Estimated remaining: 3h 17m 49s. Rate: 7.1 symbols/min [2025-10-09T19:15:38.322629] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:38.343974] [DEBUG] [LOCAL ] GRDN: Loaded 20937 existing records from primary storage. [2025-10-09T19:15:38.344218] [INFO ] [MAIN ] GRDN: Loaded 20937 existing records. [2025-10-09T19:15:38.403679] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-09T19:15:38.599730] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:38.599969] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-09T19:15:38.600018] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-09T19:15:38.600289] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-09T19:15:38.600349] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-09T19:15:38.988720] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:39.046602] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:15:39.196723] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-09T19:15:39.639206] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T19:15:39.641760] [INFO ] [REMOTE ] GPOR: Full fetch complete (35055 records). [2025-10-09T19:15:39.641838] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-09T19:15:40.000036] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-09T19:15:40.009356] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-09T19:15:40.010239] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-09T19:15:40.011020] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-09T19:15:40.011097] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-09T19:15:40.012194] [DEBUG] [LOCAL ] GPOR: Trimmed 35055 records to 23434 (keeping 200 days of data) [2025-10-09T19:15:40.154397] [DEBUG] [LOCAL ] GPOR: Primary data saved (23434 records). [2025-10-09T19:15:40.154530] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-09T19:15:40.154612] [INFO ] [MAIN ] Update Progress: 966/2373 symbols completed. GPOR took 38.3s. Estimated remaining: 3h 17m 31s. Rate: 7.1 symbols/min [2025-10-09T19:15:40.331868] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:40.372616] [DEBUG] [LOCAL ] GRMN: Loaded 40656 existing records from primary storage. [2025-10-09T19:15:40.372943] [INFO ] [MAIN ] GRMN: Loaded 40656 existing records. [2025-10-09T19:15:40.552802] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:40.553016] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-09T19:15:40.553064] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-09T19:15:40.554517] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-09T19:15:40.554576] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-09T19:15:40.710741] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T19:15:40.734756] [INFO ] [REMOTE ] GPRK: Full fetch complete (57695 records). [2025-10-09T19:15:40.754955] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-09T19:15:40.800927] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-09T19:15:41.132924] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:41.340522] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-09T19:15:41.340682] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-09T19:15:41.341485] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-09T19:15:41.341673] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-09T19:15:41.343019] [DEBUG] [LOCAL ] GPRK: Trimmed 57695 records to 39734 (keeping 200 days of data) [2025-10-09T19:15:41.449594] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T19:15:41.597183] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-09T19:15:41.628034] [DEBUG] [LOCAL ] GPRK: Primary data saved (39734 records). [2025-10-09T19:15:41.628184] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-09T19:15:41.628273] [INFO ] [MAIN ] Update Progress: 967/2373 symbols completed. GPRK took 32.2s. Estimated remaining: 3h 17m 13s. Rate: 7.1 symbols/min [2025-10-09T19:15:41.804353] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:41.850080] [DEBUG] [LOCAL ] GRND: Loaded 49969 existing records from primary storage. [2025-10-09T19:15:41.850468] [INFO ] [MAIN ] GRND: Loaded 49969 existing records. [2025-10-09T19:15:42.045771] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:15:42.044540] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:42.050758] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-09T19:15:42.050808] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-09T19:15:42.051012] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-09T19:15:42.051070] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-09T19:15:42.402440] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-09T19:15:42.450337] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:43.196698] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-09T19:15:43.273707] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:15:43.771585] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T19:15:43.996690] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-09T19:15:44.065141] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-09T19:15:44.796724] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-09T19:15:45.409356] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:15:45.596787] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-09T19:15:45.927508] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T19:15:46.396722] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-09T19:15:46.918166] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:15:47.196737] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-09T19:15:47.630506] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T19:15:47.996741] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-09T19:15:48.706138] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:15:48.796768] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-09T19:15:49.596746] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-09T19:15:49.764212] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T19:15:49.927098] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T19:15:50.098085] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T19:15:50.396783] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-09T19:15:51.196677] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-09T19:15:51.597407] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:15:51.996735] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-09T19:15:52.298960] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:15:52.796805] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-09T19:15:53.520878] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:15:53.596717] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-09T19:15:54.184150] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T19:15:54.396695] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-09T19:15:54.612413] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T19:15:55.196726] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-09T19:15:55.841524] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T19:15:55.996687] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-09T19:15:56.346564] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:15:56.349430] [INFO ] [REMOTE ] GRBK: Full fetch complete (40548 records). [2025-10-09T19:15:56.349505] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-09T19:15:56.737468] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-09T19:15:56.737549] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-09T19:15:56.738299] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-09T19:15:56.738362] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-09T19:15:56.739256] [DEBUG] [LOCAL ] GRBK: Trimmed 40548 records to 27216 (keeping 200 days of data) [2025-10-09T19:15:56.803341] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-09T19:15:56.908211] [DEBUG] [LOCAL ] GRBK: Primary data saved (27216 records). [2025-10-09T19:15:56.908351] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-09T19:15:56.908458] [INFO ] [MAIN ] Update Progress: 968/2373 symbols completed. GRBK took 45.0s. Estimated remaining: 3h 17m 14s. Rate: 7.1 symbols/min [2025-10-09T19:15:57.097850] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:57.131764] [DEBUG] [LOCAL ] GRNT: Loaded 33908 existing records from primary storage. [2025-10-09T19:15:57.132046] [INFO ] [MAIN ] GRNT: Loaded 33908 existing records. [2025-10-09T19:15:57.317725] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:57.318009] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-09T19:15:57.318083] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-09T19:15:57.319246] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-09T19:15:57.319308] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-09T19:15:57.605781] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-09T19:15:57.720123] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:57.753855] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:15:57.781339] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T19:15:58.396712] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-09T19:15:59.038752] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:15:59.196690] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-09T19:15:59.419714] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:15:59.996719] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-09T19:16:00.601983] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:16:00.796723] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-09T19:16:01.311517] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T19:16:01.596719] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-09T19:16:02.396743] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-09T19:16:02.550027] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T19:16:02.581271] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T19:16:03.196730] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-09T19:16:03.807924] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:16:03.996736] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-09T19:16:04.128601] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T19:16:04.796750] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-09T19:16:05.596689] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-09T19:16:05.723356] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:16:05.787707] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T19:16:06.396769] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-09T19:16:07.127887] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:16:07.196732] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-09T19:16:07.492888] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T19:16:07.996807] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-09T19:16:08.796684] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-09T19:16:08.851233] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T19:16:09.154284] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T19:16:09.596778] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-09T19:16:09.721139] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T19:16:10.396730] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-09T19:16:10.825763] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T19:16:10.829208] [INFO ] [REMOTE ] GRMN: Full fetch complete (59727 records). [2025-10-09T19:16:10.829313] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-09T19:16:11.198531] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-09T19:16:11.219544] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-09T19:16:11.219684] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-09T19:16:11.221561] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-09T19:16:11.221669] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-09T19:16:11.229434] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T19:16:11.232607] [DEBUG] [LOCAL ] GRMN: Trimmed 59727 records to 40895 (keeping 200 days of data) [2025-10-09T19:16:11.233770] [INFO ] [REMOTE ] GRDN: Full fetch complete (26298 records). [2025-10-09T19:16:11.233884] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-09T19:16:11.810955] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-09T19:16:11.811057] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-09T19:16:11.812115] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-09T19:16:11.812673] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-09T19:16:11.815498] [DEBUG] [LOCAL ] GRDN: Trimmed 26298 records to 21074 (keeping 200 days of data) [2025-10-09T19:16:12.019875] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-09T19:16:12.085382] [DEBUG] [LOCAL ] GRDN: Primary data saved (21074 records). [2025-10-09T19:16:12.086046] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-09T19:16:12.086379] [INFO ] [MAIN ] Update Progress: 969/2373 symbols completed. GRDN took 34.0s. Estimated remaining: 3h 17m 16s. Rate: 7.1 symbols/min [2025-10-09T19:16:12.265432] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:12.278445] [DEBUG] [LOCAL ] GRMN: Primary data saved (40895 records). [2025-10-09T19:16:12.278585] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-09T19:16:12.278703] [INFO ] [MAIN ] Update Progress: 970/2373 symbols completed. GRMN took 32.1s. Estimated remaining: 3h 16m 55s. Rate: 7.1 symbols/min [2025-10-09T19:16:12.362669] [DEBUG] [LOCAL ] GROV: Loaded 8857 existing records from primary storage. [2025-10-09T19:16:12.381579] [INFO ] [MAIN ] GROV: Loaded 8857 existing records. [2025-10-09T19:16:12.542201] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:12.655500] [DEBUG] [LOCAL ] GRX: Loaded 4764 existing records from primary storage. [2025-10-09T19:16:12.689219] [INFO ] [MAIN ] GRX: Loaded 4764 existing records. [2025-10-09T19:16:12.697233] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:12.733258] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-09T19:16:12.740581] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-09T19:16:12.778591] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-09T19:16:12.783889] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-09T19:16:12.993622] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:13.035847] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-09T19:16:13.067218] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-09T19:16:13.099352] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-09T19:16:13.136952] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-09T19:16:13.383491] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T19:16:13.381636] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:13.416116] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-09T19:16:13.602283] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-09T19:16:13.635565] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T19:16:13.736414] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:14.396786] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-09T19:16:14.429692] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:16:15.006355] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T19:16:15.138464] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:16:15.196698] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-09T19:16:15.805502] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:16:15.996722] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-09T19:16:16.796703] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-09T19:16:16.891225] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T19:16:17.596717] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-09T19:16:17.947303] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T19:16:18.005511] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T19:16:18.396722] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-09T19:16:19.196720] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-09T19:16:19.603703] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-09T19:16:19.996755] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-09T19:16:20.015362] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:16:20.019779] [INFO ] [REMOTE ] GRND: Full fetch complete (71139 records). [2025-10-09T19:16:20.019920] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-09T19:16:20.414962] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T19:16:20.418479] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-09T19:16:20.419880] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-09T19:16:20.421588] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-09T19:16:20.421682] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-09T19:16:20.423249] [DEBUG] [LOCAL ] GRND: Trimmed 71139 records to 50333 (keeping 200 days of data) [2025-10-09T19:16:20.720201] [DEBUG] [LOCAL ] GRND: Primary data saved (50333 records). [2025-10-09T19:16:20.720343] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-09T19:16:20.720426] [INFO ] [MAIN ] Update Progress: 971/2373 symbols completed. GRND took 39.1s. Estimated remaining: 3h 16m 47s. Rate: 7.1 symbols/min [2025-10-09T19:16:20.801853] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-09T19:16:20.895573] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:20.948897] [DEBUG] [LOCAL ] GS: Loaded 51771 existing records from primary storage. [2025-10-09T19:16:20.949245] [INFO ] [MAIN ] GS: Loaded 51771 existing records. [2025-10-09T19:16:21.133413] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:21.133693] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-09T19:16:21.133750] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-09T19:16:21.135070] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-09T19:16:21.135129] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-09T19:16:21.499051] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:21.596696] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-09T19:16:21.684525] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T19:16:22.396729] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-09T19:16:22.963625] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T19:16:23.196735] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-09T19:16:23.360032] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T19:16:23.996725] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-09T19:16:24.601884] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T19:16:24.796710] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-09T19:16:25.596691] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-09T19:16:25.736342] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:16:26.137933] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T19:16:26.192204] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T19:16:26.396714] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-09T19:16:27.162305] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:16:27.196727] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-09T19:16:27.867157] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T19:16:27.996753] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-09T19:16:28.796738] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-09T19:16:29.472552] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T19:16:29.596744] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-09T19:16:29.857638] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T19:16:30.084278] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:16:30.396733] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-09T19:16:31.196733] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-09T19:16:31.567474] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:16:31.996749] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-09T19:16:32.586456] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T19:16:32.587549] [INFO ] [REMOTE ] GRX: Full fetch complete (6570 records). [2025-10-09T19:16:32.587619] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-09T19:16:32.803090] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-09T19:16:32.956565] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-09T19:16:32.956694] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-09T19:16:32.956935] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-09T19:16:32.957015] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-09T19:16:32.957430] [DEBUG] [LOCAL ] GRX: Trimmed 6570 records to 4805 (keeping 200 days of data) [2025-10-09T19:16:32.989072] [DEBUG] [LOCAL ] GRX: Primary data saved (4805 records). [2025-10-09T19:16:32.989238] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-09T19:16:32.989341] [INFO ] [MAIN ] Update Progress: 972/2373 symbols completed. GRX took 20.7s. Estimated remaining: 3h 16m 44s. Rate: 7.1 symbols/min [2025-10-09T19:16:33.162280] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:33.207785] [DEBUG] [LOCAL ] GSBD: Loaded 39374 existing records from primary storage. [2025-10-09T19:16:33.208113] [INFO ] [MAIN ] GSBD: Loaded 39374 existing records. [2025-10-09T19:16:33.387323] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:33.387737] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-09T19:16:33.387848] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-09T19:16:33.399274] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-09T19:16:33.404478] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-09T19:16:33.488012] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-09T19:16:33.603556] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-09T19:16:33.720371] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T19:16:33.800318] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:34.396749] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-09T19:16:34.984864] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T19:16:35.196745] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-09T19:16:35.906932] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:16:35.960403] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-09T19:16:35.996673] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-09T19:16:36.796762] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-09T19:16:37.596741] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-09T19:16:37.868412] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T19:16:37.904910] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:16:38.396798] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-09T19:16:38.913510] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T19:16:39.196748] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-09T19:16:39.783221] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:16:39.996717] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-09T19:16:40.796843] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-09T19:16:40.967975] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T19:16:41.575298] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T19:16:41.596669] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-09T19:16:42.249750] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T19:16:42.396717] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-09T19:16:42.694282] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T19:16:43.196728] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-09T19:16:43.449339] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T19:16:43.996727] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-09T19:16:44.695607] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T19:16:44.796742] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-09T19:16:45.401784] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T19:16:45.441375] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-09T19:16:45.596707] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-09T19:16:46.396782] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-09T19:16:46.558359] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T19:16:46.561387] [INFO ] [REMOTE ] GRNT: Full fetch complete (48425 records). [2025-10-09T19:16:46.561474] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-09T19:16:46.961772] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-09T19:16:46.961850] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-09T19:16:46.962556] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-09T19:16:46.962596] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-09T19:16:46.963545] [DEBUG] [LOCAL ] GRNT: Trimmed 48425 records to 34158 (keeping 200 days of data) [2025-10-09T19:16:47.162484] [DEBUG] [LOCAL ] GRNT: Primary data saved (34158 records). [2025-10-09T19:16:47.162617] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-09T19:16:47.162728] [INFO ] [MAIN ] Update Progress: 973/2373 symbols completed. GRNT took 50.3s. Estimated remaining: 3h 16m 44s. Rate: 7.1 symbols/min [2025-10-09T19:16:47.204931] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-09T19:16:47.335328] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:47.384420] [DEBUG] [LOCAL ] GSK: Loaded 53500 existing records from primary storage. [2025-10-09T19:16:47.384753] [INFO ] [MAIN ] GSK: Loaded 53500 existing records. [2025-10-09T19:16:47.561259] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:47.561454] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-09T19:16:47.561501] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-09T19:16:47.562581] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-09T19:16:47.562668] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-09T19:16:47.858666] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T19:16:47.900708] [INFO ] [REMOTE ] GROV: Full fetch complete (14187 records). [2025-10-09T19:16:47.931700] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:47.932172] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-09T19:16:48.000940] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-09T19:16:48.223846] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T19:16:48.344122] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-09T19:16:48.344222] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-09T19:16:48.344569] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-09T19:16:48.344612] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-09T19:16:48.345132] [DEBUG] [LOCAL ] GROV: Trimmed 14187 records to 8881 (keeping 200 days of data) [2025-10-09T19:16:48.394794] [DEBUG] [LOCAL ] GROV: Primary data saved (8881 records). [2025-10-09T19:16:48.394917] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-09T19:16:48.395007] [INFO ] [MAIN ] Update Progress: 974/2373 symbols completed. GROV took 36.3s. Estimated remaining: 3h 16m 25s. Rate: 7.1 symbols/min [2025-10-09T19:16:48.560218] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:48.593684] [DEBUG] [LOCAL ] GSL: Loaded 33224 existing records from primary storage. [2025-10-09T19:16:48.593960] [INFO ] [MAIN ] GSL: Loaded 33224 existing records. [2025-10-09T19:16:48.767772] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:48.767986] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-09T19:16:48.768034] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-09T19:16:48.769034] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-09T19:16:48.769095] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-09T19:16:48.802010] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-09T19:16:49.127026] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:49.596688] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-09T19:16:50.037678] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T19:16:50.361488] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:16:50.396686] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-09T19:16:51.006913] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:16:51.196752] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-09T19:16:51.996747] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-09T19:16:52.139911] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:16:52.262382] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T19:16:52.796700] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-09T19:16:53.596811] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-09T19:16:53.756562] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T19:16:54.072846] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T19:16:54.396781] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-09T19:16:55.094671] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:16:55.196702] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-09T19:16:55.592200] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T19:16:55.996777] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-09T19:16:56.796690] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-09T19:16:57.190449] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-09T19:16:57.194799] [INFO ] [REMOTE ] GS: Full fetch complete (75635 records). [2025-10-09T19:16:57.194955] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-09T19:16:57.602078] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-09T19:16:57.615866] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-09T19:16:57.616916] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T19:16:57.624152] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-09T19:16:57.625396] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-09T19:16:57.625829] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-09T19:16:57.627348] [DEBUG] [LOCAL ] GS: Trimmed 75635 records to 52147 (keeping 200 days of data) [2025-10-09T19:16:57.970637] [DEBUG] [LOCAL ] GS: Primary data saved (52147 records). [2025-10-09T19:16:57.970831] [INFO ] [MAIN ] GS: Full history saved. [2025-10-09T19:16:57.971819] [INFO ] [MAIN ] Update Progress: 975/2373 symbols completed. GS took 37.3s. Estimated remaining: 3h 16m 18s. Rate: 7.1 symbols/min [2025-10-09T19:16:58.138767] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:58.194309] [DEBUG] [LOCAL ] GTES: Loaded 50433 existing records from primary storage. [2025-10-09T19:16:58.194627] [INFO ] [MAIN ] GTES: Loaded 50433 existing records. [2025-10-09T19:16:58.369989] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:58.370209] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-09T19:16:58.370265] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-09T19:16:58.371319] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-09T19:16:58.371379] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-09T19:16:58.402469] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-09T19:16:58.742236] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:58.773888] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T19:16:58.815674] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T19:16:59.196729] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-09T19:16:59.949725] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:16:59.996674] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-09T19:17:00.796745] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-09T19:17:00.974294] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:17:01.500150] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T19:17:01.596689] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-09T19:17:02.302491] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:17:02.396688] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-09T19:17:02.507168] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:17:03.196709] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-09T19:17:03.745931] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:17:03.996719] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-09T19:17:04.246011] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T19:17:04.796749] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-09T19:17:05.106676] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:17:05.596719] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-09T19:17:06.222462] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T19:17:06.396725] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-09T19:17:06.997088] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T19:17:07.196715] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-09T19:17:07.820556] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T19:17:07.996700] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-09T19:17:08.796696] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-09T19:17:08.923573] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T19:17:09.598237] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-09T19:17:09.603967] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T19:17:10.110839] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T19:17:10.396773] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-09T19:17:11.180128] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T19:17:11.184183] [INFO ] [REMOTE ] GSBD: Full fetch complete (58497 records). [2025-10-09T19:17:11.184275] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-09T19:17:11.205309] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-09T19:17:11.589525] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-09T19:17:11.589626] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-09T19:17:11.590627] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-09T19:17:11.590717] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-09T19:17:11.592022] [DEBUG] [LOCAL ] GSBD: Trimmed 58497 records to 39733 (keeping 200 days of data) [2025-10-09T19:17:11.852085] [DEBUG] [LOCAL ] GSBD: Primary data saved (39733 records). [2025-10-09T19:17:11.852262] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-09T19:17:11.852357] [INFO ] [MAIN ] Update Progress: 976/2373 symbols completed. GSBD took 38.9s. Estimated remaining: 3h 16m 18s. Rate: 7.1 symbols/min [2025-10-09T19:17:12.001774] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-09T19:17:12.025807] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:12.067819] [DEBUG] [LOCAL ] GTLS: Loaded 42973 existing records from primary storage. [2025-10-09T19:17:12.068107] [INFO ] [MAIN ] GTLS: Loaded 42973 existing records. [2025-10-09T19:17:12.245861] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:12.246181] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-09T19:17:12.246243] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-09T19:17:12.247482] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-09T19:17:12.247543] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-09T19:17:12.612873] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:12.642343] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-09T19:17:12.796695] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-09T19:17:12.961978] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T19:17:13.389923] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T19:17:13.392818] [INFO ] [REMOTE ] GSL: Full fetch complete (47969 records). [2025-10-09T19:17:13.392904] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-09T19:17:13.602019] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-09T19:17:13.782377] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-09T19:17:13.782468] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-09T19:17:13.783202] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-09T19:17:13.783265] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-09T19:17:13.784337] [DEBUG] [LOCAL ] GSL: Trimmed 47969 records to 33451 (keeping 200 days of data) [2025-10-09T19:17:13.990496] [DEBUG] [LOCAL ] GSL: Primary data saved (33451 records). [2025-10-09T19:17:13.990602] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-09T19:17:13.991554] [INFO ] [MAIN ] Update Progress: 977/2373 symbols completed. GSL took 25.6s. Estimated remaining: 3h 16m 0s. Rate: 7.1 symbols/min [2025-10-09T19:17:14.186219] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:14.189027] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:17:14.249982] [DEBUG] [LOCAL ] GTN: Loaded 45251 existing records from primary storage. [2025-10-09T19:17:14.250489] [INFO ] [MAIN ] GTN: Loaded 45251 existing records. [2025-10-09T19:17:14.401931] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-09T19:17:14.458614] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:14.458911] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-09T19:17:14.458970] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-09T19:17:14.460362] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-09T19:17:14.460447] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-09T19:17:14.834891] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:15.196766] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-09T19:17:15.369490] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:17:15.872555] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:17:15.996724] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-09T19:17:16.631264] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:17:16.796766] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-09T19:17:17.596689] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-09T19:17:17.637359] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T19:17:18.328556] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T19:17:18.396668] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-09T19:17:18.870201] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T19:17:19.196775] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-09T19:17:19.996700] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-09T19:17:20.072128] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T19:17:20.467263] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T19:17:20.796720] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-09T19:17:21.596780] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-09T19:17:21.802000] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T19:17:22.390001] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:17:22.398293] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-09T19:17:22.886250] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:17:23.196758] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-09T19:17:23.996699] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-09T19:17:24.294410] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T19:17:24.538452] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:17:24.796679] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-09T19:17:25.447697] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T19:17:25.596702] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-09T19:17:26.372882] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:17:26.396683] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-09T19:17:27.162575] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:17:27.196663] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-09T19:17:27.926107] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:17:27.996761] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-09T19:17:28.807204] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-09T19:17:28.814962] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T19:17:29.596736] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-09T19:17:29.699940] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:17:30.396708] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-09T19:17:30.533260] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:17:30.999630] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:17:31.196720] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-09T19:17:31.996677] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-09T19:17:32.338963] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T19:17:32.684839] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T19:17:32.796707] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-09T19:17:33.261246] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:17:33.596801] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-09T19:17:34.316734] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T19:17:34.321002] [INFO ] [REMOTE ] GTES: Full fetch complete (73784 records). [2025-10-09T19:17:34.321114] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-09T19:17:34.401966] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-09T19:17:34.717169] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-09T19:17:34.717253] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-09T19:17:34.718274] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-09T19:17:34.718341] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-09T19:17:34.719840] [DEBUG] [LOCAL ] GTES: Trimmed 73784 records to 50804 (keeping 200 days of data) [2025-10-09T19:17:35.052923] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:17:35.076011] [DEBUG] [LOCAL ] GTES: Primary data saved (50804 records). [2025-10-09T19:17:35.076205] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-09T19:17:35.076372] [INFO ] [MAIN ] Update Progress: 978/2373 symbols completed. GTES took 37.1s. Estimated remaining: 3h 16m 10s. Rate: 7.1 symbols/min [2025-10-09T19:17:35.201866] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-09T19:17:35.254222] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:35.283720] [DEBUG] [LOCAL ] GTY: Loaded 30191 existing records from primary storage. [2025-10-09T19:17:35.283995] [INFO ] [MAIN ] GTY: Loaded 30191 existing records. [2025-10-09T19:17:35.457848] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:35.458086] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-09T19:17:35.458135] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-09T19:17:35.459098] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-09T19:17:35.459174] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-09T19:17:35.822583] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:35.996747] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-09T19:17:36.138863] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:17:36.796695] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-09T19:17:36.981337] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:17:37.596703] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-09T19:17:37.890481] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T19:17:37.911405] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T19:17:37.915324] [INFO ] [REMOTE ] GTN: Full fetch complete (66207 records). [2025-10-09T19:17:37.915433] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-09T19:17:38.298462] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-09T19:17:38.298556] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-09T19:17:38.299496] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-09T19:17:38.299574] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-09T19:17:38.300992] [DEBUG] [LOCAL ] GTN: Trimmed 66207 records to 45558 (keeping 200 days of data) [2025-10-09T19:17:38.396860] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-09T19:17:38.571321] [DEBUG] [LOCAL ] GTN: Primary data saved (45558 records). [2025-10-09T19:17:38.571459] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-09T19:17:38.572300] [INFO ] [MAIN ] Update Progress: 979/2373 symbols completed. GTN took 24.6s. Estimated remaining: 3h 15m 54s. Rate: 7.1 symbols/min [2025-10-09T19:17:38.747676] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:38.762261] [DEBUG] [LOCAL ] GUG: Loaded 12241 existing records from primary storage. [2025-10-09T19:17:38.762487] [INFO ] [MAIN ] GUG: Loaded 12241 existing records. [2025-10-09T19:17:38.947337] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:38.947569] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-09T19:17:38.947616] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-09T19:17:38.948064] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-09T19:17:38.948123] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-09T19:17:39.206239] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-09T19:17:39.341406] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:39.343319] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T19:17:39.996709] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-09T19:17:40.311297] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-09T19:17:40.315938] [INFO ] [REMOTE ] GSK: Full fetch complete (77476 records). [2025-10-09T19:17:40.316075] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-09T19:17:40.648978] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T19:17:40.743323] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-09T19:17:40.743407] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-09T19:17:40.744375] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-09T19:17:40.744442] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-09T19:17:40.746040] [DEBUG] [LOCAL ] GSK: Trimmed 77476 records to 53890 (keeping 200 days of data) [2025-10-09T19:17:40.803259] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-09T19:17:41.087422] [DEBUG] [LOCAL ] GSK: Primary data saved (53890 records). [2025-10-09T19:17:41.087529] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-09T19:17:41.088116] [INFO ] [MAIN ] Update Progress: 980/2373 symbols completed. GSK took 53.9s. Estimated remaining: 3h 15m 37s. Rate: 7.1 symbols/min [2025-10-09T19:17:41.273347] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:41.289732] [DEBUG] [LOCAL ] GUT: Loaded 15479 existing records from primary storage. [2025-10-09T19:17:41.290027] [INFO ] [MAIN ] GUT: Loaded 15479 existing records. [2025-10-09T19:17:41.470583] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:41.470834] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-09T19:17:41.470891] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-09T19:17:41.471531] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-09T19:17:41.471590] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-09T19:17:41.585040] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T19:17:41.599243] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-09T19:17:41.634794] [INFO ] [REMOTE ] GTLS: Full fetch complete (61378 records). [2025-10-09T19:17:41.635156] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-09T19:17:41.956309] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T19:17:41.990732] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:42.265408] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-09T19:17:42.265488] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-09T19:17:42.266355] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-09T19:17:42.266417] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-09T19:17:42.268234] [DEBUG] [LOCAL ] GTLS: Trimmed 61378 records to 43271 (keeping 200 days of data) [2025-10-09T19:17:42.438205] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-09T19:17:42.532188] [DEBUG] [LOCAL ] GTLS: Primary data saved (43271 records). [2025-10-09T19:17:42.532336] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-09T19:17:42.532421] [INFO ] [MAIN ] Update Progress: 981/2373 symbols completed. GTLS took 30.7s. Estimated remaining: 3h 15m 19s. Rate: 7.1 symbols/min [2025-10-09T19:17:42.712025] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:42.744977] [DEBUG] [LOCAL ] GVA: Loaded 32831 existing records from primary storage. [2025-10-09T19:17:42.745316] [INFO ] [MAIN ] GVA: Loaded 32831 existing records. [2025-10-09T19:17:42.929173] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:42.929589] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-09T19:17:42.929682] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-09T19:17:42.936112] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-09T19:17:42.945233] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-09T19:17:43.007171] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:17:43.205034] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-09T19:17:43.338573] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:43.464606] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:17:43.996744] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-09T19:17:44.271109] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T19:17:44.796785] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-09T19:17:45.382104] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:17:45.596747] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-09T19:17:45.810942] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:17:46.388168] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T19:17:46.396668] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-09T19:17:47.196699] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-09T19:17:47.240452] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T19:17:47.996720] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-09T19:17:48.059156] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:17:48.796726] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-09T19:17:48.885921] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T19:17:49.596749] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-09T19:17:50.255531] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:17:50.396703] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-09T19:17:50.801094] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T19:17:50.953900] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T19:17:51.196785] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-09T19:17:51.996781] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-09T19:17:52.556010] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:17:52.796800] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-09T19:17:53.296969] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T19:17:53.596769] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-09T19:17:53.705826] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T19:17:54.396734] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-09T19:17:54.685884] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T19:17:55.196784] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-09T19:17:55.842039] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T19:17:55.866963] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:17:55.996730] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-09T19:17:56.796751] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-09T19:17:57.222795] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T19:17:57.596730] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-09T19:17:57.834940] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:17:58.396730] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-09T19:17:58.547489] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T19:17:59.198771] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-09T19:17:59.201230] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T19:17:59.996694] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-09T19:18:00.054457] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T19:18:00.796730] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-09T19:18:01.319874] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T19:18:01.596685] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-09T19:18:01.837808] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:18:02.396719] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-09T19:18:02.461404] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T19:18:03.196736] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-09T19:18:03.671976] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T19:18:03.996754] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-09T19:18:04.609603] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:18:04.796719] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-09T19:18:04.892969] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T19:18:05.596739] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-09T19:18:05.978779] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:18:06.312342] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T19:18:06.396719] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-09T19:18:07.196700] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-09T19:18:07.261413] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T19:18:07.996745] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-09T19:18:08.214469] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T19:18:08.779076] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T19:18:08.780604] [INFO ] [REMOTE ] GUG: Full fetch complete (19438 records). [2025-10-09T19:18:08.780705] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-09T19:18:08.803707] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-09T19:18:09.168257] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-09T19:18:09.168593] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-09T19:18:09.169117] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-09T19:18:09.169182] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-09T19:18:09.169966] [DEBUG] [LOCAL ] GUG: Trimmed 19438 records to 12290 (keeping 200 days of data) [2025-10-09T19:18:09.252694] [DEBUG] [LOCAL ] GUG: Primary data saved (12290 records). [2025-10-09T19:18:09.252873] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-09T19:18:09.252968] [INFO ] [MAIN ] Update Progress: 982/2373 symbols completed. GUG took 30.7s. Estimated remaining: 3h 15m 37s. Rate: 7.1 symbols/min [2025-10-09T19:18:09.433781] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:09.452379] [DEBUG] [LOCAL ] GWH: Loaded 17046 existing records from primary storage. [2025-10-09T19:18:09.452590] [INFO ] [MAIN ] GWH: Loaded 17046 existing records. [2025-10-09T19:18:09.600323] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-09T19:18:09.630258] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:09.630624] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-09T19:18:09.630730] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-09T19:18:09.631343] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-09T19:18:09.631405] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-09T19:18:10.055181] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:10.181087] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T19:18:10.396722] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-09T19:18:10.932146] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T19:18:11.196796] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-09T19:18:11.783113] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:18:11.996731] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-09T19:18:12.530734] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T19:18:12.533966] [INFO ] [REMOTE ] GVA: Full fetch complete (48424 records). [2025-10-09T19:18:12.534052] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-09T19:18:12.801895] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-09T19:18:12.934143] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-09T19:18:12.934284] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-09T19:18:12.935139] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-09T19:18:12.935254] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-09T19:18:12.936429] [DEBUG] [LOCAL ] GVA: Trimmed 48424 records to 33049 (keeping 200 days of data) [2025-10-09T19:18:13.040542] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T19:18:13.051886] [INFO ] [REMOTE ] GTY: Full fetch complete (43761 records). [2025-10-09T19:18:13.053283] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-09T19:18:13.551439] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-09T19:18:13.551536] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-09T19:18:13.552299] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-09T19:18:13.552687] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-09T19:18:13.556370] [DEBUG] [LOCAL ] GTY: Trimmed 43761 records to 30428 (keeping 200 days of data) [2025-10-09T19:18:13.560050] [DEBUG] [LOCAL ] GVA: Primary data saved (33049 records). [2025-10-09T19:18:13.560329] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-09T19:18:13.560440] [INFO ] [MAIN ] Update Progress: 983/2373 symbols completed. GVA took 31.0s. Estimated remaining: 3h 15m 22s. Rate: 7.1 symbols/min [2025-10-09T19:18:13.625375] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-09T19:18:13.845392] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:13.942474] [DEBUG] [LOCAL ] GWRE: Loaded 40142 existing records from primary storage. [2025-10-09T19:18:13.952438] [INFO ] [MAIN ] GWRE: Loaded 40142 existing records. [2025-10-09T19:18:14.034996] [DEBUG] [LOCAL ] GTY: Primary data saved (30428 records). [2025-10-09T19:18:14.052113] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-09T19:18:14.064361] [INFO ] [MAIN ] Update Progress: 984/2373 symbols completed. GTY took 39.0s. Estimated remaining: 3h 15m 3s. Rate: 7.1 symbols/min [2025-10-09T19:18:14.255518] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:14.265995] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-09T19:18:14.271187] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-09T19:18:14.291070] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-09T19:18:14.295852] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-09T19:18:14.341999] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:14.591538] [DEBUG] [LOCAL ] GWW: Loaded 19426 existing records from primary storage. [2025-10-09T19:18:14.613391] [INFO ] [MAIN ] GWW: Loaded 19426 existing records. [2025-10-09T19:18:14.765094] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:14.806401] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-09T19:18:14.798608] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T19:18:14.890984] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:14.891220] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-09T19:18:14.891274] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-09T19:18:14.891918] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-09T19:18:14.891976] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-09T19:18:15.203230] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-09T19:18:15.243834] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:15.996751] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-09T19:18:16.337070] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:18:16.380455] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (3.58 seconds). [2025-10-09T19:18:16.592117] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T19:18:16.789105] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T19:18:16.796670] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-09T19:18:17.596709] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-09T19:18:17.894681] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:18:18.396699] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-09T19:18:18.437728] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T19:18:19.196769] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-09T19:18:19.771323] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T19:18:19.974481] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T19:18:19.996673] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-09T19:18:20.741391] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T19:18:20.796710] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-09T19:18:21.596761] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-09T19:18:21.890245] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T19:18:22.396725] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-09T19:18:22.403228] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T19:18:22.405144] [INFO ] [REMOTE ] GUT: Full fetch complete (22617 records). [2025-10-09T19:18:22.405217] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-09T19:18:22.768732] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-09T19:18:22.768810] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-09T19:18:22.769266] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-09T19:18:22.769356] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-09T19:18:22.769999] [DEBUG] [LOCAL ] GUT: Trimmed 22617 records to 15593 (keeping 200 days of data) [2025-10-09T19:18:22.864122] [DEBUG] [LOCAL ] GUT: Primary data saved (15593 records). [2025-10-09T19:18:22.864245] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-09T19:18:22.864366] [INFO ] [MAIN ] Update Progress: 985/2373 symbols completed. GUT took 41.8s. Estimated remaining: 3h 14m 55s. Rate: 7.1 symbols/min [2025-10-09T19:18:23.046600] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:23.090949] [DEBUG] [LOCAL ] GXO: Loaded 47078 existing records from primary storage. [2025-10-09T19:18:23.091388] [INFO ] [MAIN ] GXO: Loaded 47078 existing records. [2025-10-09T19:18:23.173114] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:18:23.199060] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-09T19:18:23.282165] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:23.282378] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-09T19:18:23.282426] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-09T19:18:23.283777] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-09T19:18:23.283837] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-09T19:18:23.645985] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:23.996736] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-09T19:18:24.273147] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T19:18:24.796779] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-09T19:18:25.568984] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T19:18:25.596712] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-09T19:18:25.767923] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T19:18:26.396764] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-09T19:18:27.020490] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T19:18:27.196700] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-09T19:18:27.445454] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T19:18:27.996739] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-09T19:18:28.614757] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T19:18:28.650150] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T19:18:28.796867] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-09T19:18:29.596736] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-09T19:18:30.252425] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:18:30.302875] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:18:30.396679] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-09T19:18:31.196710] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-09T19:18:31.711924] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T19:18:31.996710] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-09T19:18:32.265061] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T19:18:32.796755] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-09T19:18:33.596776] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-09T19:18:33.642177] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T19:18:33.702693] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T19:18:34.341465] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T19:18:34.396671] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-09T19:18:35.196746] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-09T19:18:35.456751] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T19:18:35.996732] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-09T19:18:36.507720] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:18:36.796765] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-09T19:18:37.054268] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T19:18:37.596740] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-09T19:18:38.396715] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-09T19:18:38.470107] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T19:18:38.508763] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T19:18:39.196723] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-09T19:18:39.450525] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T19:18:39.996731] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-09T19:18:40.801859] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-09T19:18:40.820154] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T19:18:40.845822] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T19:18:40.847899] [INFO ] [REMOTE ] GWW: Full fetch complete (29112 records). [2025-10-09T19:18:40.847983] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-09T19:18:41.217488] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-09T19:18:41.217600] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-09T19:18:41.218128] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-09T19:18:41.218191] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-09T19:18:41.218949] [DEBUG] [LOCAL ] GWW: Trimmed 29112 records to 19575 (keeping 200 days of data) [2025-10-09T19:18:41.343769] [DEBUG] [LOCAL ] GWW: Primary data saved (19575 records). [2025-10-09T19:18:41.343902] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-09T19:18:41.343989] [INFO ] [MAIN ] Update Progress: 986/2373 symbols completed. GWW took 27.3s. Estimated remaining: 3h 15m 1s. Rate: 7.1 symbols/min [2025-10-09T19:18:41.512836] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:41.516262] [DEBUG] [LOCAL ] GYLD: Loaded 1535 existing records from primary storage. [2025-10-09T19:18:41.516403] [INFO ] [MAIN ] GYLD: Loaded 1535 existing records. [2025-10-09T19:18:41.606090] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-09T19:18:41.696882] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:41.697088] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-09T19:18:41.697142] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-09T19:18:41.697342] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-09T19:18:41.697401] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-09T19:18:42.044632] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:42.396742] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-09T19:18:42.463090] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:18:43.035565] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:18:43.196755] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-09T19:18:43.677707] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T19:18:43.680517] [INFO ] [REMOTE ] GWH: Full fetch complete (22117 records). [2025-10-09T19:18:43.680593] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-09T19:18:43.933952] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T19:18:44.003430] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-09T19:18:44.049847] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-09T19:18:44.050038] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-09T19:18:44.050516] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-09T19:18:44.050560] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-09T19:18:44.051309] [DEBUG] [LOCAL ] GWH: Trimmed 22117 records to 17262 (keeping 200 days of data) [2025-10-09T19:18:44.156290] [DEBUG] [LOCAL ] GWH: Primary data saved (17262 records). [2025-10-09T19:18:44.156450] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-09T19:18:44.156568] [INFO ] [MAIN ] Update Progress: 987/2373 symbols completed. GWH took 34.9s. Estimated remaining: 3h 14m 44s. Rate: 7.1 symbols/min [2025-10-09T19:18:44.332418] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:44.382637] [DEBUG] [LOCAL ] H: Loaded 44514 existing records from primary storage. [2025-10-09T19:18:44.383021] [INFO ] [MAIN ] H: Loaded 44514 existing records. [2025-10-09T19:18:44.565212] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:44.565404] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-09T19:18:44.565451] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-09T19:18:44.567046] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-09T19:18:44.567112] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-09T19:18:44.804224] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-09T19:18:44.934325] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:45.224128] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T19:18:45.534388] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:18:45.596686] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-09T19:18:46.396725] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-09T19:18:47.203893] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-09T19:18:47.209422] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T19:18:47.621525] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:18:47.636406] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T19:18:47.996746] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-09T19:18:48.796735] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-09T19:18:49.495081] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T19:18:49.596696] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-09T19:18:50.363532] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:18:50.396683] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-09T19:18:51.073864] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T19:18:51.196713] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-09T19:18:51.759987] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:18:51.996717] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-09T19:18:52.637796] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:18:52.641619] [INFO ] [REMOTE ] GXO: Full fetch complete (69729 records). [2025-10-09T19:18:52.641769] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-09T19:18:52.801990] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-09T19:18:53.029389] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-09T19:18:53.029480] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-09T19:18:53.030417] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-09T19:18:53.030482] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-09T19:18:53.031873] [DEBUG] [LOCAL ] GXO: Trimmed 69729 records to 47389 (keeping 200 days of data) [2025-10-09T19:18:53.271050] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:18:53.275030] [INFO ] [REMOTE ] GWRE: Full fetch complete (60477 records). [2025-10-09T19:18:53.275678] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-09T19:18:53.335936] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T19:18:53.601868] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-09T19:18:53.677743] [DEBUG] [LOCAL ] GXO: Primary data saved (47389 records). [2025-10-09T19:18:53.684004] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-09T19:18:53.695317] [INFO ] [MAIN ] Update Progress: 988/2373 symbols completed. GXO took 30.8s. Estimated remaining: 3h 14m 37s. Rate: 7.1 symbols/min [2025-10-09T19:18:53.906075] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-09T19:18:53.916478] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-09T19:18:53.943935] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-09T19:18:53.944057] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-09T19:18:53.961679] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:53.963540] [DEBUG] [LOCAL ] GWRE: Trimmed 60477 records to 40388 (keeping 200 days of data) [2025-10-09T19:18:54.105020] [DEBUG] [LOCAL ] HAE: Loaded 39439 existing records from primary storage. [2025-10-09T19:18:54.106432] [INFO ] [MAIN ] HAE: Loaded 39439 existing records. [2025-10-09T19:18:54.397719] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-09T19:18:54.401796] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:54.413973] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-09T19:18:54.414960] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-09T19:18:54.416431] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-09T19:18:54.416814] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-09T19:18:54.590767] [DEBUG] [LOCAL ] GWRE: Primary data saved (40388 records). [2025-10-09T19:18:54.632697] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-09T19:18:54.683472] [INFO ] [MAIN ] Update Progress: 989/2373 symbols completed. GWRE took 41.1s. Estimated remaining: 3h 14m 19s. Rate: 7.1 symbols/min [2025-10-09T19:18:54.882510] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T19:18:54.906582] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:54.980137] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:55.008156] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:18:55.049680] [DEBUG] [LOCAL ] HAFN: Loaded 43141 existing records from primary storage. [2025-10-09T19:18:55.050018] [INFO ] [MAIN ] HAFN: Loaded 43141 existing records. [2025-10-09T19:18:55.198092] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-09T19:18:55.227865] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:55.228078] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-09T19:18:55.228147] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-09T19:18:55.228760] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-09T19:18:55.228821] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-09T19:18:55.575152] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:55.646489] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T19:18:55.996743] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-09T19:18:56.796762] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-09T19:18:57.219893] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:18:57.311391] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:18:57.596701] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-09T19:18:58.396730] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-09T19:18:59.005155] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:18:59.196713] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-09T19:18:59.304346] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T19:18:59.996737] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-09T19:19:00.736862] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T19:19:00.796677] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-09T19:19:01.596725] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-09T19:19:01.737836] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T19:19:02.028778] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T19:19:02.396727] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-09T19:19:02.464963] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T19:19:03.196732] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-09T19:19:03.489489] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-09T19:19:03.959768] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T19:19:03.996673] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-09T19:19:04.796742] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-09T19:19:05.171475] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-09T19:19:05.580285] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T19:19:05.596668] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-09T19:19:06.396771] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-09T19:19:07.196749] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-09T19:19:07.445844] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T19:19:07.752957] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:19:07.882107] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T19:19:07.882885] [INFO ] [REMOTE ] GYLD: Full fetch complete (2083 records). [2025-10-09T19:19:07.882956] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-09T19:19:08.001862] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-09T19:19:08.242527] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-09T19:19:08.242619] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-09T19:19:08.242771] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-09T19:19:08.242823] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-09T19:19:08.243141] [DEBUG] [LOCAL ] GYLD: Trimmed 2083 records to 1552 (keeping 200 days of data) [2025-10-09T19:19:08.253366] [DEBUG] [LOCAL ] GYLD: Primary data saved (1552 records). [2025-10-09T19:19:08.253426] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-09T19:19:08.253521] [INFO ] [MAIN ] Update Progress: 990/2373 symbols completed. GYLD took 26.9s. Estimated remaining: 3h 14m 17s. Rate: 7.1 symbols/min [2025-10-09T19:19:08.430064] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:08.482011] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-09T19:19:08.482333] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-09T19:19:08.658338] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:08.658593] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-09T19:19:08.658679] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-09T19:19:08.660058] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-09T19:19:08.660121] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-09T19:19:08.803213] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-09T19:19:09.058243] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:09.586008] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:19:09.596667] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-09T19:19:10.396706] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-09T19:19:10.541779] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T19:19:11.196683] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-09T19:19:11.297952] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T19:19:11.996687] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-09T19:19:12.360551] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T19:19:12.796725] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-09T19:19:12.826289] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:19:13.389841] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:19:13.596772] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-09T19:19:14.411224] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-09T19:19:14.447150] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T19:19:15.103517] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T19:19:15.196708] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-09T19:19:15.996713] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-09T19:19:16.040090] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:19:16.618310] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T19:19:16.796761] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-09T19:19:16.903079] [DEBUG] [REMOTE ] HAE: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-09T19:19:16.903566] [WARN ] [REMOTE ] HAE: No data returned for month 2025-07 [2025-10-09T19:19:16.903702] [FATAL] [REMOTE ] HAE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:19:16.903816] [FATAL] [MAIN ] HAE: Failed to fetch primary data. [2025-10-09T19:19:16.903887] [WARN ] [MAIN ] HAE: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:19:16.903974] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-09T19:19:16.904360] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-09T19:19:16.904707] [INFO ] [LOCAL ] HAE: Starting deletion of derivative data. [2025-10-09T19:19:16.905056] [DEBUG] [LOCAL ] HAE: Deleted derivative data file. [2025-10-09T19:19:16.905440] [INFO ] [MAIN ] Update Progress: 991/2373 symbols completed. HAE took 23.2s. Estimated remaining: 3h 14m 9s. Rate: 7.1 symbols/min [2025-10-09T19:19:17.072476] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:17.119206] [DEBUG] [LOCAL ] HASI: Loaded 47306 existing records from primary storage. [2025-10-09T19:19:17.119522] [INFO ] [MAIN ] HASI: Loaded 47306 existing records. [2025-10-09T19:19:17.294046] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:17.294307] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-09T19:19:17.294357] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-09T19:19:17.295662] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-09T19:19:17.295724] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-09T19:19:17.601932] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-09T19:19:17.691090] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:17.724137] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T19:19:18.396731] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-09T19:19:19.065461] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:19:19.196707] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-09T19:19:19.595708] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T19:19:19.996778] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-09T19:19:20.380997] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T19:19:20.796713] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-09T19:19:21.596679] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-09T19:19:21.927594] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T19:19:22.333328] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T19:19:22.396694] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-09T19:19:23.198773] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-09T19:19:23.201104] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T19:19:23.996690] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-09T19:19:24.410116] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T19:19:24.796686] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-09T19:19:24.827346] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T19:19:25.596689] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-09T19:19:25.626063] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:19:26.396729] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-09T19:19:27.081079] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-09T19:19:27.149628] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:19:27.196668] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-09T19:19:27.891849] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T19:19:27.996707] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-09T19:19:28.631042] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T19:19:28.634889] [INFO ] [REMOTE ] H: Full fetch complete (62642 records). [2025-10-09T19:19:28.634998] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-09T19:19:28.807730] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-09T19:19:29.021553] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-09T19:19:29.021668] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-09T19:19:29.022548] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-09T19:19:29.022616] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-09T19:19:29.023999] [DEBUG] [LOCAL ] H: Trimmed 62642 records to 44843 (keeping 200 days of data) [2025-10-09T19:19:29.289008] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T19:19:29.371336] [DEBUG] [LOCAL ] H: Primary data saved (44843 records). [2025-10-09T19:19:29.371545] [INFO ] [MAIN ] H: Full history saved. [2025-10-09T19:19:29.373638] [INFO ] [MAIN ] Update Progress: 992/2373 symbols completed. H took 45.2s. Estimated remaining: 3h 14m 6s. Rate: 7.1 symbols/min [2025-10-09T19:19:29.556148] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:29.596761] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-09T19:19:29.622508] [DEBUG] [LOCAL ] HAYW: Loaded 48747 existing records from primary storage. [2025-10-09T19:19:29.623043] [INFO ] [MAIN ] HAYW: Loaded 48747 existing records. [2025-10-09T19:19:29.818174] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:29.818480] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-09T19:19:29.818533] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-09T19:19:29.819203] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-09T19:19:29.819266] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-09T19:19:30.194189] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:30.396755] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-09T19:19:30.474896] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T19:19:30.991826] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T19:19:31.196740] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-09T19:19:31.547370] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:19:31.551156] [INFO ] [REMOTE ] HAFN: Full fetch complete (65227 records). [2025-10-09T19:19:31.551262] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-09T19:19:31.927063] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-09T19:19:31.927145] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-09T19:19:31.927995] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-09T19:19:31.928058] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-09T19:19:31.929419] [DEBUG] [LOCAL ] HAFN: Trimmed 65227 records to 43476 (keeping 200 days of data) [2025-10-09T19:19:32.012252] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-09T19:19:32.177116] [DEBUG] [LOCAL ] HAFN: Primary data saved (43476 records). [2025-10-09T19:19:32.177252] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-09T19:19:32.177332] [INFO ] [MAIN ] Update Progress: 993/2373 symbols completed. HAFN took 37.5s. Estimated remaining: 3h 13m 50s. Rate: 7.1 symbols/min [2025-10-09T19:19:32.342400] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:32.350087] [DEBUG] [LOCAL ] HBB: Loaded 6485 existing records from primary storage. [2025-10-09T19:19:32.350253] [INFO ] [MAIN ] HBB: Loaded 6485 existing records. [2025-10-09T19:19:32.522569] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:32.522856] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-09T19:19:32.522909] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-09T19:19:32.523186] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-09T19:19:32.523245] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-09T19:19:32.797175] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-09T19:19:32.884241] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:33.004889] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:19:33.555835] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:19:33.596716] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-09T19:19:34.396756] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-09T19:19:34.458673] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T19:19:35.156788] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T19:19:35.196686] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-09T19:19:35.560294] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-09T19:19:35.996722] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-09T19:19:36.779203] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T19:19:36.796667] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-09T19:19:37.596713] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-09T19:19:37.825255] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:19:38.311463] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:19:38.396679] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-09T19:19:38.935145] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:19:39.196766] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-09T19:19:39.981043] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T19:19:39.996694] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-09T19:19:40.796723] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-09T19:19:40.817385] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:19:40.825773] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-09T19:19:40.825938] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-09T19:19:41.239126] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-09T19:19:41.239232] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-09T19:19:41.240451] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-09T19:19:41.240532] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-09T19:19:41.242214] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54108 (keeping 200 days of data) [2025-10-09T19:19:41.370908] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T19:19:41.518580] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:19:41.613071] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-09T19:19:41.645071] [DEBUG] [LOCAL ] HAL: Primary data saved (54108 records). [2025-10-09T19:19:41.645275] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-09T19:19:41.645442] [INFO ] [MAIN ] Update Progress: 994/2373 symbols completed. HAL took 33.4s. Estimated remaining: 3h 13m 43s. Rate: 7.1 symbols/min [2025-10-09T19:19:41.831403] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:41.881048] [DEBUG] [LOCAL ] HBI: Loaded 52987 existing records from primary storage. [2025-10-09T19:19:41.881385] [INFO ] [MAIN ] HBI: Loaded 52987 existing records. [2025-10-09T19:19:42.073971] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:42.079359] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-09T19:19:42.079176] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T19:19:42.079531] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-09T19:19:42.082420] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-09T19:19:42.082486] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-09T19:19:42.401985] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-09T19:19:42.443301] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:42.843151] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-09T19:19:43.196731] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-09T19:19:43.996752] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-09T19:19:44.449937] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:19:44.531520] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T19:19:44.796754] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-09T19:19:45.596743] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-09T19:19:46.204012] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T19:19:46.396704] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-09T19:19:47.076539] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:19:47.125553] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T19:19:47.196675] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-09T19:19:47.996700] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-09T19:19:48.796748] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-09T19:19:48.935068] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T19:19:49.462394] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:19:49.596741] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-09T19:19:50.396748] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-09T19:19:50.426325] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T19:19:51.003851] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-09T19:19:51.197139] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-09T19:19:51.198864] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T19:19:51.996776] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-09T19:19:52.683406] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T19:19:52.796679] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-09T19:19:53.510482] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T19:19:53.596697] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-09T19:19:54.261338] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:19:54.396695] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-09T19:19:54.623276] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T19:19:55.196802] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-09T19:19:55.738761] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T19:19:55.996755] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-09T19:19:56.796692] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-09T19:19:56.989494] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T19:19:57.524932] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T19:19:57.596736] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-09T19:19:58.109025] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:19:58.114462] [INFO ] [REMOTE ] HAYW: Full fetch complete (70752 records). [2025-10-09T19:19:58.114616] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-09T19:19:58.403345] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-09T19:19:58.506827] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-09T19:19:58.506926] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-09T19:19:58.507863] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-09T19:19:58.507927] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-09T19:19:58.509365] [DEBUG] [LOCAL ] HAYW: Trimmed 70752 records to 49097 (keeping 200 days of data) [2025-10-09T19:19:58.795947] [DEBUG] [LOCAL ] HAYW: Primary data saved (49097 records). [2025-10-09T19:19:58.796084] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-09T19:19:58.797054] [INFO ] [MAIN ] Update Progress: 995/2373 symbols completed. HAYW took 29.4s. Estimated remaining: 3h 13m 47s. Rate: 7.1 symbols/min [2025-10-09T19:19:58.964757] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:59.019711] [DEBUG] [LOCAL ] HBM: Loaded 52928 existing records from primary storage. [2025-10-09T19:19:59.020053] [INFO ] [MAIN ] HBM: Loaded 52928 existing records. [2025-10-09T19:19:59.204439] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:59.198700] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-09T19:19:59.206382] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-09T19:19:59.206497] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-09T19:19:59.208268] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-09T19:19:59.208330] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-09T19:19:59.597388] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T19:19:59.622443] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:59.933379] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T19:20:00.004408] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:20:00.005981] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-09T19:20:00.011425] [INFO ] [REMOTE ] HASI: Full fetch complete (68025 records). [2025-10-09T19:20:00.011560] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-09T19:20:00.446435] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-09T19:20:00.446530] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-09T19:20:00.447479] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-09T19:20:00.447545] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-09T19:20:00.449017] [DEBUG] [LOCAL ] HASI: Trimmed 68025 records to 47632 (keeping 200 days of data) [2025-10-09T19:20:00.746464] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T19:20:00.757951] [DEBUG] [LOCAL ] HASI: Primary data saved (47632 records). [2025-10-09T19:20:00.758104] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-09T19:20:00.758810] [INFO ] [MAIN ] Update Progress: 996/2373 symbols completed. HASI took 43.9s. Estimated remaining: 3h 13m 29s. Rate: 7.1 symbols/min [2025-10-09T19:20:00.801808] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-09T19:20:00.933468] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:00.980865] [DEBUG] [LOCAL ] HCA: Loaded 46889 existing records from primary storage. [2025-10-09T19:20:00.981227] [INFO ] [MAIN ] HCA: Loaded 46889 existing records. [2025-10-09T19:20:01.158764] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:01.159054] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-09T19:20:01.159102] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-09T19:20:01.160666] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-09T19:20:01.160729] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-09T19:20:01.442102] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T19:20:01.532589] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:01.596677] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-09T19:20:02.396732] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-09T19:20:03.196694] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-09T19:20:03.298958] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T19:20:03.730447] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T19:20:03.731392] [INFO ] [REMOTE ] HBB: Full fetch complete (9439 records). [2025-10-09T19:20:03.731461] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-09T19:20:04.001381] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-09T19:20:04.110461] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-09T19:20:04.110717] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-09T19:20:04.111003] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-09T19:20:04.111142] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-09T19:20:04.111825] [DEBUG] [LOCAL ] HBB: Trimmed 9439 records to 6516 (keeping 200 days of data) [2025-10-09T19:20:04.165598] [DEBUG] [LOCAL ] HBB: Primary data saved (6516 records). [2025-10-09T19:20:04.181700] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-09T19:20:04.181895] [INFO ] [MAIN ] Update Progress: 997/2373 symbols completed. HBB took 32.0s. Estimated remaining: 3h 13m 14s. Rate: 7.1 symbols/min [2025-10-09T19:20:04.183721] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T19:20:04.796748] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-09T19:20:05.596696] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-09T19:20:05.747219] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T19:20:06.292004] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T19:20:06.396733] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-09T19:20:06.707274] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T19:20:07.196774] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-09T19:20:07.717923] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:20:07.996730] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-09T19:20:08.796827] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-09T19:20:09.033314] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T19:20:09.596729] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-09T19:20:09.736097] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:20:10.110589] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:20:10.396723] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-09T19:20:11.196759] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-09T19:20:11.374988] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:20:11.996721] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-09T19:20:12.069491] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T19:20:12.796763] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-09T19:20:12.919900] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:20:13.427488] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T19:20:13.596730] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-09T19:20:14.396754] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-09T19:20:14.484953] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T19:20:15.196694] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-09T19:20:15.285875] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T19:20:15.996747] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-09T19:20:16.050908] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T19:20:16.055836] [INFO ] [REMOTE ] HBI: Full fetch complete (76872 records). [2025-10-09T19:20:16.055979] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-09T19:20:16.501087] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-09T19:20:16.501184] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-09T19:20:16.502245] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-09T19:20:16.502341] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-09T19:20:16.505744] [DEBUG] [LOCAL ] HBI: Trimmed 76872 records to 53371 (keeping 200 days of data) [2025-10-09T19:20:16.755146] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:20:16.809705] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-09T19:20:16.861972] [DEBUG] [LOCAL ] HBI: Primary data saved (53371 records). [2025-10-09T19:20:16.862142] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-09T19:20:16.862232] [INFO ] [MAIN ] Update Progress: 998/2373 symbols completed. HBI took 35.2s. Estimated remaining: 3h 13m 11s. Rate: 7.1 symbols/min [2025-10-09T19:20:17.651514] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T19:20:17.661201] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-09T19:20:18.288251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T19:20:18.396672] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-09T19:20:19.466257] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:20:19.477462] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-09T19:20:20.042317] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T19:20:20.053290] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-09T19:20:21.145426] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T19:20:21.155275] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-09T19:20:21.493806] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:20:21.596702] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-09T19:20:22.735345] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T19:20:22.750468] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-09T19:20:23.380163] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:20:23.391795] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-09T19:20:24.268851] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T19:20:24.273351] [INFO ] [REMOTE ] HCA: Full fetch complete (68748 records). [2025-10-09T19:20:24.273564] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-09T19:20:24.687370] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-09T19:20:24.687474] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-09T19:20:24.688548] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-09T19:20:24.688621] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-09T19:20:24.690151] [DEBUG] [LOCAL ] HCA: Trimmed 68748 records to 47261 (keeping 200 days of data) [2025-10-09T19:20:25.003268] [DEBUG] [LOCAL ] HCA: Primary data saved (47261 records). [2025-10-09T19:20:25.003441] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-09T19:20:25.004163] [INFO ] [MAIN ] Update Progress: 999/2373 symbols completed. HCA took 24.2s. Estimated remaining: 3h 13m 3s. Rate: 7.1 symbols/min [2025-10-09T19:20:25.197485] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T19:20:25.209275] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-09T19:20:26.978897] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T19:20:26.984105] [INFO ] [REMOTE ] HBM: Full fetch complete (76357 records). [2025-10-09T19:20:26.984217] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-09T19:20:27.384528] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-09T19:20:27.384606] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-09T19:20:27.385610] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-09T19:20:27.385695] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-09T19:20:27.387306] [DEBUG] [LOCAL ] HBM: Trimmed 76357 records to 53318 (keeping 200 days of data) [2025-10-09T19:20:27.719460] [DEBUG] [LOCAL ] HBM: Primary data saved (53318 records). [2025-10-09T19:20:27.719616] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-09T19:20:27.720717] [INFO ] [MAIN ] Update Progress: 1000/2373 symbols completed. HBM took 28.9s. Estimated remaining: 3h 12m 46s. Rate: 7.1 symbols/min [2025-10-09T19:20:28.521395] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:28.533339] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:28.544709] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-09T19:20:28.545981] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:28.537493] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:28.547381] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-09T19:20:28.547926] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-09T19:20:28.548200] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-09T19:20:28.548263] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-09T19:20:28.548298] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-09T19:20:28.668500] [DEBUG] [LOCAL ] HCI: Loaded 14077 existing records from primary storage. [2025-10-09T19:20:28.685028] [INFO ] [MAIN ] HCI: Loaded 14077 existing records. [2025-10-09T19:20:29.138775] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-09T19:20:29.101394] [DEBUG] [LOCAL ] HCC: Loaded 45290 existing records from primary storage. [2025-10-09T19:20:29.159798] [INFO ] [MAIN ] HCC: Loaded 45290 existing records. [2025-10-09T19:20:29.159373] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:29.217437] [INFO ] [MAIN ] HD: Loaded 53492 existing records. [2025-10-09T19:20:29.302260] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-09T19:20:29.377914] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-09T19:20:29.423894] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:29.442359] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-09T19:20:29.458001] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-09T19:20:29.464825] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-09T19:20:29.620024] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:29.713128] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-09T19:20:29.723448] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:29.723561] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-09T19:20:29.741083] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-09T19:20:29.748089] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-09T19:20:29.755620] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-09T19:20:29.759171] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-09T19:20:29.779709] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-09T19:20:29.843941] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-09T19:20:29.886926] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-09T19:20:30.013248] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-09T19:20:30.418310] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-09T19:20:30.502603] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-09T19:20:30.526015] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:30.573470] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-09T19:20:30.661544] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:30.674728] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-09T19:20:30.776939] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:30.777241] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-09T19:20:30.907336] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-09T19:20:30.908281] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-09T19:20:31.146692] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-09T19:20:31.147540] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-09T19:20:31.382586] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-09T19:20:31.383420] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-09T19:20:31.629519] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-09T19:20:31.648943] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:20:31.883824] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:20:31.996734] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-09T19:20:32.324261] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T19:20:32.796774] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-09T19:20:32.946885] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-09T19:20:33.596759] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-09T19:20:33.831452] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-09T19:20:34.109093] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:20:34.396718] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-09T19:20:34.702253] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-09T19:20:35.196776] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-09T19:20:35.431326] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-09T19:20:35.996758] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-09T19:20:36.736033] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T19:20:36.796677] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-09T19:20:37.596720] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-09T19:20:37.652781] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:20:38.396732] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-09T19:20:39.021965] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T19:20:39.196688] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-09T19:20:39.412958] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T19:20:39.996712] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-09T19:20:40.501426] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T19:20:40.586150] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T19:20:40.796750] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-09T19:20:41.223702] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T19:20:41.224332] [INFO ] [REMOTE ] HCXY: Full fetch complete (526 records). [2025-10-09T19:20:41.224397] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-09T19:20:41.396992] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-09T19:20:41.397154] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:20:41.397199] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:20:41.397268] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-09T19:20:41.397330] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-09T19:20:41.397366] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-09T19:20:41.397426] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-09T19:20:41.397503] [INFO ] [MAIN ] Update Progress: 1001/2373 symbols completed. HCXY took 13.7s. Estimated remaining: 3h 12m 45s. Rate: 7.1 symbols/min [2025-10-09T19:20:41.560659] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:41.607465] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-09T19:20:41.610346] [DEBUG] [LOCAL ] HDB: Loaded 51940 existing records from primary storage. [2025-10-09T19:20:41.610767] [INFO ] [MAIN ] HDB: Loaded 51940 existing records. [2025-10-09T19:20:41.788973] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:41.789219] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-09T19:20:41.789268] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-09T19:20:41.790575] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-09T19:20:41.790635] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-09T19:20:42.153677] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:42.396694] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-09T19:20:43.196740] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-09T19:20:43.370330] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:20:43.629781] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T19:20:43.996686] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-09T19:20:44.134031] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T19:20:44.796712] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-09T19:20:45.596698] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-09T19:20:45.639451] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:20:46.396761] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-09T19:20:46.547242] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:20:47.196734] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-09T19:20:47.380551] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T19:20:47.892763] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:20:47.996709] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-09T19:20:48.796715] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-09T19:20:48.835459] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:20:49.596736] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-09T19:20:49.968742] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T19:20:50.053806] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T19:20:50.396695] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-09T19:20:50.943538] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:20:51.196699] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-09T19:20:51.364998] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T19:20:51.996738] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-09T19:20:52.682463] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T19:20:52.796676] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-09T19:20:53.596696] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-09T19:20:54.072969] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-09T19:20:54.316213] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:20:54.396758] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-09T19:20:55.196700] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-09T19:20:55.396526] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T19:20:55.440581] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T19:20:55.996735] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-09T19:20:56.630980] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T19:20:56.635022] [INFO ] [REMOTE ] HCC: Full fetch complete (64613 records). [2025-10-09T19:20:56.635191] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-09T19:20:56.799605] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-09T19:20:57.011373] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:20:57.038282] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-09T19:20:57.038367] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-09T19:20:57.039446] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-09T19:20:57.039527] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-09T19:20:57.041032] [DEBUG] [LOCAL ] HCC: Trimmed 64613 records to 45604 (keeping 200 days of data) [2025-10-09T19:20:57.321890] [DEBUG] [LOCAL ] HCC: Primary data saved (45604 records). [2025-10-09T19:20:57.322034] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-09T19:20:57.322139] [INFO ] [MAIN ] Update Progress: 1002/2373 symbols completed. HCC took 29.6s. Estimated remaining: 3h 12m 47s. Rate: 7.1 symbols/min [2025-10-09T19:20:57.488367] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:57.538805] [DEBUG] [LOCAL ] HE: Loaded 48999 existing records from primary storage. [2025-10-09T19:20:57.539135] [INFO ] [MAIN ] HE: Loaded 48999 existing records. [2025-10-09T19:20:57.609013] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-09T19:20:57.755432] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:57.755703] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-09T19:20:57.755822] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-09T19:20:57.756091] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-09T19:20:57.756149] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-09T19:20:58.120360] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:58.396716] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-09T19:20:58.654331] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T19:20:59.053135] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T19:20:59.196717] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-09T19:20:59.857443] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T19:20:59.996739] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-09T19:21:00.796681] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-09T19:21:00.877867] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:21:00.970805] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T19:21:00.972555] [INFO ] [REMOTE ] HCI: Full fetch complete (19577 records). [2025-10-09T19:21:00.972631] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-09T19:21:01.342349] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-09T19:21:01.342435] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-09T19:21:01.342905] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-09T19:21:01.342968] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-09T19:21:01.343586] [DEBUG] [LOCAL ] HCI: Trimmed 19577 records to 14236 (keeping 200 days of data) [2025-10-09T19:21:01.438470] [DEBUG] [LOCAL ] HCI: Primary data saved (14236 records). [2025-10-09T19:21:01.438631] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-09T19:21:01.438760] [INFO ] [MAIN ] Update Progress: 1003/2373 symbols completed. HCI took 33.7s. Estimated remaining: 3h 12m 33s. Rate: 7.1 symbols/min [2025-10-09T19:21:01.601969] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-09T19:21:01.625335] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:01.665054] [DEBUG] [LOCAL ] HEI: Loaded 31659 existing records from primary storage. [2025-10-09T19:21:01.665524] [INFO ] [MAIN ] HEI: Loaded 31659 existing records. [2025-10-09T19:21:01.851770] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:21:01.851989] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-09T19:21:01.852037] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-09T19:21:01.852262] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-09T19:21:01.852321] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-09T19:21:02.215027] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:02.396748] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-09T19:21:02.619949] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T19:21:03.196746] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-09T19:21:03.657275] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-09T19:21:03.888930] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T19:21:03.996679] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-09T19:21:04.796762] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-09T19:21:05.105351] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T19:21:05.535173] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:21:05.596768] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-09T19:21:06.396747] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-09T19:21:06.714006] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T19:21:06.989565] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T19:21:07.196760] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-09T19:21:07.566977] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:21:07.996813] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-09T19:21:08.796752] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-09T19:21:08.951343] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T19:21:09.596686] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-09T19:21:10.216807] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T19:21:10.396689] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-09T19:21:10.553803] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T19:21:11.196687] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-09T19:21:11.277751] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T19:21:11.996697] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-09T19:21:12.469236] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-09T19:21:12.543846] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T19:21:12.796702] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-09T19:21:13.294324] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:21:13.596779] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-09T19:21:14.410249] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-09T19:21:14.448177] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T19:21:15.196750] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-09T19:21:15.693625] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-09T19:21:15.698243] [INFO ] [REMOTE ] HD: Full fetch complete (77446 records). [2025-10-09T19:21:15.698367] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-09T19:21:16.001264] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-09T19:21:16.109869] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-09T19:21:16.110028] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-09T19:21:16.111149] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-09T19:21:16.111287] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-09T19:21:16.133853] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:21:16.142082] [DEBUG] [LOCAL ] HD: Trimmed 77446 records to 53881 (keeping 200 days of data) [2025-10-09T19:21:16.488883] [DEBUG] [LOCAL ] HD: Primary data saved (53881 records). [2025-10-09T19:21:16.489045] [INFO ] [MAIN ] HD: Full history saved. [2025-10-09T19:21:16.490050] [INFO ] [MAIN ] Update Progress: 1004/2373 symbols completed. HD took 48.8s. Estimated remaining: 3h 12m 33s. Rate: 7.1 symbols/min [2025-10-09T19:21:16.664961] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:16.676026] [DEBUG] [LOCAL ] HEQ: Loaded 6596 existing records from primary storage. [2025-10-09T19:21:16.676322] [INFO ] [MAIN ] HEQ: Loaded 6596 existing records. [2025-10-09T19:21:16.801895] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-09T19:21:16.862813] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:21:16.863303] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-09T19:21:16.863418] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-09T19:21:16.863706] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-09T19:21:16.863807] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-09T19:21:17.061046] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T19:21:17.277802] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:17.596688] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-09T19:21:17.804323] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T19:21:18.200545] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T19:21:18.407461] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-09T19:21:18.409820] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T19:21:19.196729] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-09T19:21:19.676563] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T19:21:19.996723] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-09T19:21:20.236788] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T19:21:20.241370] [INFO ] [REMOTE ] HDB: Full fetch complete (75322 records). [2025-10-09T19:21:20.241495] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-09T19:21:20.661963] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-09T19:21:20.662060] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-09T19:21:20.663043] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-09T19:21:20.663179] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-09T19:21:20.664751] [DEBUG] [LOCAL ] HDB: Trimmed 75322 records to 52326 (keeping 200 days of data) [2025-10-09T19:21:20.800902] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-09T19:21:21.005764] [DEBUG] [LOCAL ] HDB: Primary data saved (52326 records). [2025-10-09T19:21:21.005926] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-09T19:21:21.006592] [INFO ] [MAIN ] Update Progress: 1005/2373 symbols completed. HDB took 39.6s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-09T19:21:21.188624] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:21.234040] [DEBUG] [LOCAL ] HESM: Loaded 48300 existing records from primary storage. [2025-10-09T19:21:21.234336] [INFO ] [MAIN ] HESM: Loaded 48300 existing records. [2025-10-09T19:21:21.411939] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:21:21.412484] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-09T19:21:21.412844] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-09T19:21:21.414156] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-09T19:21:21.414217] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-09T19:21:21.519815] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T19:21:21.607148] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-09T19:21:21.795141] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:21.834949] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T19:21:22.297540] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T19:21:22.396730] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-09T19:21:23.196768] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-09T19:21:23.806598] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T19:21:23.996739] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-09T19:21:24.224427] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:21:24.796706] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-09T19:21:25.596734] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-09T19:21:25.708510] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T19:21:26.145559] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T19:21:26.396736] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-09T19:21:27.188311] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T19:21:27.196714] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-09T19:21:27.692943] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T19:21:27.790867] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:21:27.996684] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-09T19:21:28.796733] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-09T19:21:28.866430] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-09T19:21:29.596768] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-09T19:21:30.102124] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:21:30.396746] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-09T19:21:31.029736] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T19:21:31.196710] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-09T19:21:31.585539] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T19:21:31.624416] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T19:21:31.996705] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-09T19:21:32.796696] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-09T19:21:33.246947] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:21:33.596729] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-09T19:21:34.396729] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-09T19:21:34.429459] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:21:34.440072] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:21:34.439820] [INFO ] [REMOTE ] HE: Full fetch complete (72200 records). [2025-10-09T19:21:34.442460] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-09T19:21:34.442947] [INFO ] [REMOTE ] HEI: Full fetch complete (47960 records). [2025-10-09T19:21:34.443149] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-09T19:21:34.926065] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T19:21:35.197576] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-09T19:21:35.314890] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-09T19:21:35.315235] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-09T19:21:35.315347] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-09T19:21:35.316373] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-09T19:21:35.316458] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-09T19:21:35.316589] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-09T19:21:35.317597] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-09T19:21:35.318296] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-09T19:21:35.319253] [DEBUG] [LOCAL ] HE: Trimmed 72200 records to 49337 (keeping 200 days of data) [2025-10-09T19:21:35.320505] [DEBUG] [LOCAL ] HEI: Trimmed 47960 records to 31775 (keeping 200 days of data) [2025-10-09T19:21:35.642776] [DEBUG] [LOCAL ] HEI: Primary data saved (31775 records). [2025-10-09T19:21:35.642931] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-09T19:21:35.643036] [INFO ] [MAIN ] Update Progress: 1006/2373 symbols completed. HEI took 34.2s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-09T19:21:35.908928] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:35.909747] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-09T19:21:35.910068] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-09T19:21:35.911031] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-09T19:21:35.911329] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-09T19:21:35.911952] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-09T19:21:35.912318] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-09T19:21:36.003895] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-09T19:21:36.290824] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:36.355134] [DEBUG] [LOCAL ] HE: Primary data saved (49337 records). [2025-10-09T19:21:36.355290] [INFO ] [MAIN ] HE: Full history saved. [2025-10-09T19:21:36.355386] [INFO ] [MAIN ] Update Progress: 1007/2373 symbols completed. HE took 39.0s. Estimated remaining: 3h 12m 1s. Rate: 7.1 symbols/min [2025-10-09T19:21:36.521737] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:36.521895] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-09T19:21:36.521950] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-09T19:21:36.522059] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-09T19:21:36.522101] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-09T19:21:36.522141] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-09T19:21:36.522172] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-09T19:21:36.806006] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T19:21:36.806191] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-09T19:21:36.922810] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:36.948613] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T19:21:37.129266] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-09T19:21:37.596747] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-09T19:21:37.902573] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-09T19:21:38.396733] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-09T19:21:38.840165] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-09T19:21:39.196730] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-09T19:21:39.454360] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-09T19:21:39.996804] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-09T19:21:40.575750] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T19:21:40.796799] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-09T19:21:41.050450] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-09T19:21:41.596722] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-09T19:21:41.835934] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-09T19:21:42.396801] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-09T19:21:42.981712] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T19:21:43.196754] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-09T19:21:43.539469] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T19:21:43.996763] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-09T19:21:44.251334] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-09T19:21:44.796720] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-09T19:21:45.596740] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-09T19:21:46.324107] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:21:46.396712] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-09T19:21:46.451039] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T19:21:46.452630] [INFO ] [REMOTE ] HEQ: Full fetch complete (9436 records). [2025-10-09T19:21:46.452732] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-09T19:21:46.813273] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-09T19:21:46.813355] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-09T19:21:46.813583] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-09T19:21:46.813624] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-09T19:21:46.814079] [DEBUG] [LOCAL ] HEQ: Trimmed 9436 records to 6643 (keeping 200 days of data) [2025-10-09T19:21:46.854242] [DEBUG] [LOCAL ] HEQ: Primary data saved (6643 records). [2025-10-09T19:21:46.854349] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-09T19:21:46.854435] [INFO ] [MAIN ] Update Progress: 1008/2373 symbols completed. HEQ took 30.4s. Estimated remaining: 3h 11m 55s. Rate: 7.1 symbols/min [2025-10-09T19:21:47.048961] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:47.067566] [DEBUG] [LOCAL ] HFRO: Loaded 17481 existing records from primary storage. [2025-10-09T19:21:47.067831] [INFO ] [MAIN ] HFRO: Loaded 17481 existing records. [2025-10-09T19:21:47.206392] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-09T19:21:47.249468] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:21:47.249892] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-09T19:21:47.249950] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-09T19:21:47.250501] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-09T19:21:47.250563] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-09T19:21:47.534066] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T19:21:47.617527] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:47.650231] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:21:47.996722] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-09T19:21:48.236482] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-09T19:21:48.796824] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-09T19:21:49.150896] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T19:21:49.596720] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-09T19:21:49.823612] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-09T19:21:50.396726] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-09T19:21:50.628295] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-09T19:21:51.196795] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-09T19:21:51.996759] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-09T19:21:52.081462] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:21:52.412315] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T19:21:52.796704] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-09T19:21:53.152808] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T19:21:53.153485] [INFO ] [REMOTE ] HF: Full fetch complete (443 records). [2025-10-09T19:21:53.153557] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-09T19:21:53.404340] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-09T19:21:53.404511] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:21:53.404581] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:21:53.404670] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-09T19:21:53.404778] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-09T19:21:53.404822] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-09T19:21:53.404864] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-09T19:21:53.404920] [INFO ] [MAIN ] Update Progress: 1009/2373 symbols completed. HF took 17.8s. Estimated remaining: 3h 11m 44s. Rate: 7.1 symbols/min [2025-10-09T19:21:53.568727] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:53.568865] [DEBUG] [LOCAL ] HGER: No existing data file found in primary storage. [2025-10-09T19:21:53.568901] [WARN ] [MAIN ] HGER: No existing data found, performing full refresh instead. [2025-10-09T19:21:53.569009] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-09T19:21:53.569048] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-09T19:21:53.569089] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-09T19:21:53.569120] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-09T19:21:53.601789] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-09T19:21:53.919100] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:54.396744] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-09T19:21:54.815837] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T19:21:55.208253] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-09T19:21:55.213586] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T19:21:55.996746] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-09T19:21:56.326682] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T19:21:56.711565] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T19:21:56.796703] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-09T19:21:57.596750] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-09T19:21:57.941793] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-09T19:21:58.231401] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T19:21:58.396761] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-09T19:21:59.117607] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:21:59.196729] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-09T19:21:59.556307] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-09T19:21:59.996737] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-09T19:22:00.789468] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T19:22:00.796675] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-09T19:22:01.596689] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-09T19:22:01.650613] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T19:22:02.396783] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-09T19:22:02.640462] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-09T19:22:03.196727] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-09T19:22:03.332578] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:22:03.956562] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T19:22:03.996689] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-09T19:22:04.761154] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T19:22:04.796668] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-09T19:22:05.311331] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T19:22:05.596718] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-09T19:22:06.396780] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-09T19:22:06.511772] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T19:22:06.822085] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T19:22:07.196751] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-09T19:22:07.996697] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-09T19:22:08.318365] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-09T19:22:08.332241] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T19:22:08.796741] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-09T19:22:09.248991] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T19:22:09.596727] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-09T19:22:10.381317] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:22:10.396665] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-09T19:22:11.196717] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-09T19:22:11.529370] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T19:22:11.531932] [INFO ] [REMOTE ] HGER: Full fetch complete (17783 records). [2025-10-09T19:22:11.532013] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-09T19:22:11.914492] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-09T19:22:11.914570] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-09T19:22:11.914963] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-09T19:22:11.915025] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-09T19:22:11.915598] [DEBUG] [LOCAL ] HGER: Trimmed 17783 records to 14502 (keeping 200 days of data) [2025-10-09T19:22:11.998023] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-09T19:22:12.002753] [DEBUG] [LOCAL ] HGER: Primary data saved (14502 records). [2025-10-09T19:22:12.002905] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-09T19:22:12.002981] [INFO ] [MAIN ] Update Progress: 1010/2373 symbols completed. HGER took 18.6s. Estimated remaining: 3h 11m 49s. Rate: 7.1 symbols/min [2025-10-09T19:22:12.169414] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:12.179432] [DEBUG] [LOCAL ] HGLB: Loaded 9688 existing records from primary storage. [2025-10-09T19:22:12.179636] [INFO ] [MAIN ] HGLB: Loaded 9688 existing records. [2025-10-09T19:22:12.351238] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:12.351468] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-09T19:22:12.351515] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-09T19:22:12.351963] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-09T19:22:12.352022] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-09T19:22:12.533075] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T19:22:12.606974] [INFO ] [REMOTE ] HFND: Full fetch complete (1788 records). [2025-10-09T19:22:12.618047] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-09T19:22:12.797683] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-09T19:22:12.828164] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:12.899344] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-09T19:22:12.899834] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:22:12.899984] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:22:12.900126] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-09T19:22:12.900229] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-09T19:22:12.900297] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-09T19:22:12.911916] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-09T19:22:12.913094] [INFO ] [MAIN ] Update Progress: 1011/2373 symbols completed. HFND took 36.6s. Estimated remaining: 3h 11m 31s. Rate: 7.1 symbols/min [2025-10-09T19:22:12.913565] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:22:12.981019] [INFO ] [REMOTE ] HESM: Full fetch complete (69401 records). [2025-10-09T19:22:12.981174] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-09T19:22:13.255301] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:13.476010] [DEBUG] [LOCAL ] HGTY: Loaded 13249 existing records from primary storage. [2025-10-09T19:22:13.515772] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-09T19:22:13.512299] [INFO ] [MAIN ] HGTY: Loaded 13249 existing records. [2025-10-09T19:22:13.521048] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-09T19:22:13.569905] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-09T19:22:13.602343] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-09T19:22:13.602413] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-09T19:22:13.655419] [DEBUG] [LOCAL ] HESM: Trimmed 69401 records to 48669 (keeping 200 days of data) [2025-10-09T19:22:13.824468] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:13.825295] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-09T19:22:13.825496] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-09T19:22:13.856693] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-09T19:22:13.857369] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-09T19:22:14.092705] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T19:22:14.390257] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:14.396840] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-09T19:22:14.425638] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:22:14.489951] [DEBUG] [LOCAL ] HESM: Primary data saved (48669 records). [2025-10-09T19:22:14.490115] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-09T19:22:14.490936] [INFO ] [MAIN ] Update Progress: 1012/2373 symbols completed. HESM took 53.5s. Estimated remaining: 3h 11m 13s. Rate: 7.1 symbols/min [2025-10-09T19:22:14.659188] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:14.705044] [DEBUG] [LOCAL ] HGV: Loaded 46408 existing records from primary storage. [2025-10-09T19:22:14.705385] [INFO ] [MAIN ] HGV: Loaded 46408 existing records. [2025-10-09T19:22:14.884193] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:14.884448] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-09T19:22:14.884519] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-09T19:22:14.884943] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-09T19:22:14.885003] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-09T19:22:15.206325] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-09T19:22:15.258063] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:15.266151] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T19:22:15.996713] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-09T19:22:16.198953] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T19:22:16.796719] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-09T19:22:17.335918] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T19:22:17.543028] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T19:22:17.596721] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-09T19:22:18.144583] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T19:22:18.396726] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-09T19:22:19.196691] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-09T19:22:19.206285] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T19:22:19.996687] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-09T19:22:20.050138] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T19:22:20.749698] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T19:22:20.796777] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-09T19:22:21.596685] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-09T19:22:21.713729] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:22:22.396721] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-09T19:22:23.052532] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:22:23.146068] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T19:22:23.196677] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-09T19:22:23.667797] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T19:22:23.996739] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-09T19:22:24.796704] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-09T19:22:25.027857] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:22:25.596794] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-09T19:22:26.158877] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T19:22:26.319473] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:22:26.396705] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-09T19:22:27.096121] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T19:22:27.196704] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-09T19:22:27.975542] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:22:27.996730] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-09T19:22:28.513030] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T19:22:28.796778] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-09T19:22:29.254354] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T19:22:29.596805] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-09T19:22:30.386244] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T19:22:30.396666] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-09T19:22:31.169370] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T19:22:31.196717] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-09T19:22:31.946030] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:22:31.996742] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-09T19:22:32.767970] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T19:22:32.796714] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-09T19:22:33.449220] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T19:22:33.450880] [INFO ] [REMOTE ] HGLB: Full fetch complete (14811 records). [2025-10-09T19:22:33.450975] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-09T19:22:33.601941] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-09T19:22:33.832716] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-09T19:22:33.832797] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-09T19:22:33.833141] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-09T19:22:33.833201] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-09T19:22:33.833714] [DEBUG] [LOCAL ] HGLB: Trimmed 14811 records to 9747 (keeping 200 days of data) [2025-10-09T19:22:33.891429] [DEBUG] [LOCAL ] HGLB: Primary data saved (9747 records). [2025-10-09T19:22:33.891532] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-09T19:22:33.891611] [INFO ] [MAIN ] Update Progress: 1013/2373 symbols completed. HGLB took 21.9s. Estimated remaining: 3h 11m 19s. Rate: 7.1 symbols/min [2025-10-09T19:22:34.055115] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:34.090524] [DEBUG] [LOCAL ] HHH: Loaded 32955 existing records from primary storage. [2025-10-09T19:22:34.090821] [INFO ] [MAIN ] HHH: Loaded 32955 existing records. [2025-10-09T19:22:34.263887] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:34.264127] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-09T19:22:34.264174] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-09T19:22:34.265066] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-09T19:22:34.265125] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-09T19:22:34.418170] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-09T19:22:34.558553] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T19:22:34.640866] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:35.196728] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-09T19:22:35.874269] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T19:22:35.996707] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-09T19:22:36.209783] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:22:36.796696] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-09T19:22:37.003264] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:22:37.596689] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-09T19:22:37.773665] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T19:22:38.396720] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-09T19:22:39.201802] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-09T19:22:39.220503] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T19:22:39.244752] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T19:22:39.996718] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-09T19:22:40.589612] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:22:40.796678] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-09T19:22:41.068200] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T19:22:41.596708] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-09T19:22:41.975756] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T19:22:42.396736] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-09T19:22:42.498975] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T19:22:42.500733] [INFO ] [REMOTE ] HFRO: Full fetch complete (28536 records). [2025-10-09T19:22:42.500813] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-09T19:22:42.866830] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-09T19:22:42.866910] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-09T19:22:42.867529] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-09T19:22:42.867569] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-09T19:22:42.868282] [DEBUG] [LOCAL ] HFRO: Trimmed 28536 records to 17557 (keeping 200 days of data) [2025-10-09T19:22:42.975875] [DEBUG] [LOCAL ] HFRO: Primary data saved (17557 records). [2025-10-09T19:22:42.976008] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-09T19:22:42.976103] [INFO ] [MAIN ] Update Progress: 1014/2373 symbols completed. HFRO took 56.1s. Estimated remaining: 3h 11m 12s. Rate: 7.1 symbols/min [2025-10-09T19:22:43.141785] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:43.177429] [DEBUG] [LOCAL ] HI: Loaded 35330 existing records from primary storage. [2025-10-09T19:22:43.177751] [INFO ] [MAIN ] HI: Loaded 35330 existing records. [2025-10-09T19:22:43.208034] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-09T19:22:43.271265] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T19:22:43.296537] [INFO ] [REMOTE ] HGTY: Full fetch complete (17309 records). [2025-10-09T19:22:43.307381] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-09T19:22:43.487867] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:43.498386] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-09T19:22:43.508728] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-09T19:22:43.542080] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-09T19:22:43.562109] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-09T19:22:43.939154] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-09T19:22:43.956871] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-09T19:22:43.969140] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-09T19:22:43.969234] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-09T19:22:44.002202] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-09T19:22:44.002703] [DEBUG] [LOCAL ] HGTY: Trimmed 17309 records to 13314 (keeping 200 days of data) [2025-10-09T19:22:44.207837] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:44.230608] [DEBUG] [LOCAL ] HGTY: Primary data saved (13314 records). [2025-10-09T19:22:44.230810] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-09T19:22:44.230924] [INFO ] [MAIN ] Update Progress: 1015/2373 symbols completed. HGTY took 31.3s. Estimated remaining: 3h 10m 54s. Rate: 7.1 symbols/min [2025-10-09T19:22:44.408013] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:44.466145] [DEBUG] [LOCAL ] HIG: Loaded 51163 existing records from primary storage. [2025-10-09T19:22:44.466515] [INFO ] [MAIN ] HIG: Loaded 51163 existing records. [2025-10-09T19:22:44.645882] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:44.646126] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-09T19:22:44.646195] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-09T19:22:44.647069] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-09T19:22:44.647128] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-09T19:22:44.803749] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-09T19:22:44.955449] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T19:22:45.043014] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:45.352798] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:22:45.596717] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-09T19:22:46.238506] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:22:46.396748] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-09T19:22:46.882378] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:22:47.196784] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-09T19:22:47.996798] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-09T19:22:48.195767] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T19:22:48.792429] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T19:22:48.800731] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-09T19:22:49.244771] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:22:49.596733] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-09T19:22:50.396907] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-09T19:22:50.470065] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T19:22:50.827822] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:22:51.196737] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-09T19:22:51.599100] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T19:22:51.996745] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-09T19:22:52.796733] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-09T19:22:53.596777] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-09T19:23:05.572936] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (11.98 seconds). [2025-10-09T19:23:05.579926] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-09T19:23:05.771407] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (13.77 seconds). [2025-10-09T19:23:05.779440] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-09T19:23:06.263442] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (15.07 seconds). [2025-10-09T19:23:06.273069] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-09T19:23:06.961269] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (14.16 seconds). [2025-10-09T19:23:06.973102] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-09T19:23:07.017610] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T19:23:07.025147] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-09T19:23:07.211947] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:23:07.220168] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-09T19:23:07.674244] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T19:23:07.685237] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-09T19:23:08.426544] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:23:08.434493] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-09T19:23:08.567394] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T19:23:08.578880] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-09T19:23:08.781496] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:23:08.791807] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-09T19:23:09.579484] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T19:23:09.591734] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-09T19:23:09.600470] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T19:23:09.604013] [INFO ] [REMOTE ] HHH: Full fetch complete (45710 records). [2025-10-09T19:23:09.604127] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-09T19:23:10.033737] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-09T19:23:10.033975] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-09T19:23:10.034869] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-09T19:23:10.034983] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-09T19:23:10.036236] [DEBUG] [LOCAL ] HHH: Trimmed 45710 records to 33138 (keeping 200 days of data) [2025-10-09T19:23:10.183798] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T19:23:10.204333] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-09T19:23:10.288910] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T19:23:10.308524] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-09T19:23:10.315531] [DEBUG] [LOCAL ] HHH: Primary data saved (33138 records). [2025-10-09T19:23:10.316737] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-09T19:23:10.316854] [INFO ] [MAIN ] Update Progress: 1016/2373 symbols completed. HHH took 36.4s. Estimated remaining: 3h 11m 9s. Rate: 7.1 symbols/min [2025-10-09T19:23:10.504534] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:10.546885] [DEBUG] [LOCAL ] HII: Loaded 34069 existing records from primary storage. [2025-10-09T19:23:10.547204] [INFO ] [MAIN ] HII: Loaded 34069 existing records. [2025-10-09T19:23:10.732035] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:10.732291] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-09T19:23:10.732341] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-09T19:23:10.733121] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-09T19:23:10.733180] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-09T19:23:11.104863] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:11.105243] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-09T19:23:11.274000] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:23:11.285250] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-09T19:23:11.699955] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:23:11.707206] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-09T19:23:12.252238] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T19:23:12.260234] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-09T19:23:12.851725] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T19:23:12.862816] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-09T19:23:13.076909] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T19:23:13.084606] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-09T19:23:13.752495] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T19:23:13.760232] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-09T19:23:14.512096] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T19:23:14.523573] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-09T19:23:14.569236] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T19:23:14.577568] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-09T19:23:15.221378] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T19:23:15.230225] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-09T19:23:15.557936] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T19:23:15.565450] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-09T19:23:15.751994] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:23:15.762792] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-09T19:23:16.199589] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (6.00 seconds). [2025-10-09T19:23:16.203936] [INFO ] [REMOTE ] HGV: Full fetch complete (65826 records). [2025-10-09T19:23:16.204083] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-09T19:23:16.599114] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-09T19:23:16.599214] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-09T19:23:16.600229] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-09T19:23:16.600381] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-09T19:23:16.603213] [DEBUG] [LOCAL ] HGV: Trimmed 65826 records to 46691 (keeping 200 days of data) [2025-10-09T19:23:16.746152] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:23:16.763348] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-09T19:23:16.862735] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T19:23:16.868208] [INFO ] [REMOTE ] HI: Full fetch complete (49975 records). [2025-10-09T19:23:16.869124] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-09T19:23:17.279367] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-09T19:23:17.279812] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-09T19:23:17.281333] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-09T19:23:17.281420] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-09T19:23:17.286095] [DEBUG] [LOCAL ] HI: Trimmed 49975 records to 35577 (keeping 200 days of data) [2025-10-09T19:23:17.460459] [DEBUG] [LOCAL ] HGV: Primary data saved (46691 records). [2025-10-09T19:23:17.460700] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-09T19:23:17.461405] [INFO ] [MAIN ] Update Progress: 1017/2373 symbols completed. HGV took 1m 3s. Estimated remaining: 3h 10m 59s. Rate: 7.1 symbols/min [2025-10-09T19:23:17.695776] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T19:23:17.761597] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:17.764744] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-09T19:23:17.785081] [DEBUG] [LOCAL ] HI: Primary data saved (35577 records). [2025-10-09T19:23:17.785201] [INFO ] [MAIN ] HI: Full history saved. [2025-10-09T19:23:17.786242] [INFO ] [MAIN ] Update Progress: 1018/2373 symbols completed. HI took 34.8s. Estimated remaining: 3h 10m 39s. Rate: 7.1 symbols/min [2025-10-09T19:23:17.996453] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:17.997723] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-09T19:23:17.998062] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-09T19:23:18.195176] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:18.195443] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-09T19:23:18.195549] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-09T19:23:18.196316] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-09T19:23:18.197238] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-09T19:23:18.197113] [DEBUG] [LOCAL ] HIO: Loaded 24054 existing records from primary storage. [2025-10-09T19:23:18.239365] [INFO ] [MAIN ] HIO: Loaded 24054 existing records. [2025-10-09T19:23:18.677827] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:18.693882] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-09T19:23:18.746335] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-09T19:23:18.764835] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-09T19:23:18.768971] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:18.765825] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-09T19:23:18.806547] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-09T19:23:19.056105] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-09T19:23:19.113249] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-09T19:23:19.206299] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:19.206832] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-09T19:23:19.219685] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:23:19.226015] [INFO ] [REMOTE ] HIG: Full fetch complete (73183 records). [2025-10-09T19:23:19.226198] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-09T19:23:19.623465] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-09T19:23:19.623572] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-09T19:23:19.624923] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-09T19:23:19.625023] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-09T19:23:19.626788] [DEBUG] [LOCAL ] HIG: Trimmed 73183 records to 51520 (keeping 200 days of data) [2025-10-09T19:23:19.970510] [DEBUG] [LOCAL ] HIG: Primary data saved (51520 records). [2025-10-09T19:23:19.970728] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-09T19:23:19.970833] [INFO ] [MAIN ] Update Progress: 1019/2373 symbols completed. HIG took 35.7s. Estimated remaining: 3h 10m 23s. Rate: 7.1 symbols/min [2025-10-09T19:23:20.140954] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:20.163888] [DEBUG] [LOCAL ] HIPO: Loaded 21980 existing records from primary storage. [2025-10-09T19:23:20.164150] [INFO ] [MAIN ] HIPO: Loaded 21980 existing records. [2025-10-09T19:23:20.345470] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:20.345814] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-09T19:23:20.345864] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-09T19:23:20.346127] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-09T19:23:20.346185] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-09T19:23:20.546745] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T19:23:20.600733] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-09T19:23:20.749771] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:23:20.770086] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:20.771968] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-09T19:23:20.771554] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-09T19:23:21.276129] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-09T19:23:21.288201] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-09T19:23:21.839681] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T19:23:21.844243] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-09T19:23:21.904235] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T19:23:22.183840] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:23:22.396790] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-09T19:23:22.626856] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T19:23:23.179151] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T19:23:23.196665] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-09T19:23:23.653306] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T19:23:23.996778] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-09T19:23:24.796822] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-09T19:23:25.286039] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T19:23:25.599227] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-09T19:23:25.604597] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-09T19:23:25.656872] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:23:26.396790] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-09T19:23:26.678547] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T19:23:27.196782] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-09T19:23:27.652013] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T19:23:27.996784] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-09T19:23:28.284218] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:23:28.796734] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-09T19:23:29.596740] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-09T19:23:29.979466] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T19:23:30.401936] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-09T19:23:30.422398] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-09T19:23:30.751129] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T19:23:31.196738] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-09T19:23:31.554596] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:23:31.558073] [INFO ] [REMOTE ] HII: Full fetch complete (52513 records). [2025-10-09T19:23:31.558205] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-09T19:23:31.945279] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-09T19:23:31.945387] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-09T19:23:31.946251] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-09T19:23:31.946315] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-09T19:23:31.947630] [DEBUG] [LOCAL ] HII: Trimmed 52513 records to 34262 (keeping 200 days of data) [2025-10-09T19:23:32.006058] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-09T19:23:32.168386] [DEBUG] [LOCAL ] HII: Primary data saved (34262 records). [2025-10-09T19:23:32.168541] [INFO ] [MAIN ] HII: Full history saved. [2025-10-09T19:23:32.168628] [INFO ] [MAIN ] Update Progress: 1020/2373 symbols completed. HII took 21.9s. Estimated remaining: 3h 10m 19s. Rate: 7.1 symbols/min [2025-10-09T19:23:32.334434] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:32.378527] [DEBUG] [LOCAL ] HIW: Loaded 44497 existing records from primary storage. [2025-10-09T19:23:32.378883] [INFO ] [MAIN ] HIW: Loaded 44497 existing records. [2025-10-09T19:23:32.557935] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:32.558166] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-09T19:23:32.558212] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-09T19:23:32.558684] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-09T19:23:32.558742] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-09T19:23:32.801821] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-09T19:23:32.913055] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:33.119621] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T19:23:33.476192] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T19:23:33.596695] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-09T19:23:33.834015] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T19:23:34.396728] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-09T19:23:34.613880] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:23:35.196732] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-09T19:23:35.242968] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T19:23:35.996748] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-09T19:23:36.440773] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:23:36.796685] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-09T19:23:36.893595] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T19:23:37.596718] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-09T19:23:38.396788] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-09T19:23:38.728250] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T19:23:39.196814] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-09T19:23:39.415772] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T19:23:39.521561] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-09T19:23:39.996728] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-09T19:23:40.586350] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:23:40.796707] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-09T19:23:41.008403] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:23:41.596724] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-09T19:23:42.328864] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T19:23:42.396679] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-09T19:23:42.633945] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T19:23:43.196751] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-09T19:23:43.874704] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:23:43.996721] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-09T19:23:44.796785] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-09T19:23:45.483721] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-09T19:23:45.502574] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T19:23:45.596671] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-09T19:23:45.627497] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T19:23:45.629398] [INFO ] [REMOTE ] HIPO: Full fetch complete (31397 records). [2025-10-09T19:23:45.629480] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-09T19:23:45.996871] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-09T19:23:45.996948] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-09T19:23:45.997562] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-09T19:23:45.997623] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-09T19:23:45.998393] [DEBUG] [LOCAL ] HIPO: Trimmed 31397 records to 22079 (keeping 200 days of data) [2025-10-09T19:23:46.127009] [DEBUG] [LOCAL ] HIPO: Primary data saved (22079 records). [2025-10-09T19:23:46.127134] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-09T19:23:46.127242] [INFO ] [MAIN ] Update Progress: 1021/2373 symbols completed. HIPO took 26.2s. Estimated remaining: 3h 10m 18s. Rate: 7.1 symbols/min [2025-10-09T19:23:46.292737] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:46.312979] [DEBUG] [LOCAL ] HIX: Loaded 20688 existing records from primary storage. [2025-10-09T19:23:46.313214] [INFO ] [MAIN ] HIX: Loaded 20688 existing records. [2025-10-09T19:23:46.404580] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-09T19:23:46.492287] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:46.492462] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-09T19:23:46.492509] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-09T19:23:46.492821] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-09T19:23:46.492878] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-09T19:23:46.844806] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:47.205023] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-09T19:23:47.221994] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:23:47.996732] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-09T19:23:48.489283] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T19:23:48.796765] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-09T19:23:49.094934] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T19:23:49.159439] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-09T19:23:49.596756] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-09T19:23:50.160036] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T19:23:50.396738] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-09T19:23:50.791720] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:23:50.795258] [INFO ] [REMOTE ] HIO: Full fetch complete (37783 records). [2025-10-09T19:23:50.795381] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-09T19:23:51.200048] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-09T19:23:51.264031] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-09T19:23:51.264165] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-09T19:23:51.264898] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-09T19:23:51.264962] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-09T19:23:51.265772] [DEBUG] [LOCAL ] HIO: Trimmed 37783 records to 24258 (keeping 200 days of data) [2025-10-09T19:23:51.407106] [DEBUG] [LOCAL ] HIO: Primary data saved (24258 records). [2025-10-09T19:23:51.407241] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-09T19:23:51.407341] [INFO ] [MAIN ] Update Progress: 1022/2373 symbols completed. HIO took 33.6s. Estimated remaining: 3h 10m 5s. Rate: 7.1 symbols/min [2025-10-09T19:23:51.573384] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:51.592344] [DEBUG] [LOCAL ] HKD: Loaded 18518 existing records from primary storage. [2025-10-09T19:23:51.592585] [INFO ] [MAIN ] HKD: Loaded 18518 existing records. [2025-10-09T19:23:51.765575] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:51.765789] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-09T19:23:51.765837] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-09T19:23:51.766071] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-09T19:23:51.766127] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-09T19:23:52.009621] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-09T19:23:52.139336] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:52.445724] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:23:52.647143] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-09T19:23:52.796730] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-09T19:23:53.300858] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:23:53.596739] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-09T19:23:54.102452] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:23:54.396735] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-09T19:23:55.105451] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T19:23:55.137968] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T19:23:55.196725] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-09T19:23:55.996740] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-09T19:23:56.370539] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T19:23:56.599879] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T19:23:56.796731] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-09T19:23:57.596731] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-09T19:23:57.828517] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T19:23:58.396736] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-09T19:23:59.201944] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-09T19:23:59.219103] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T19:23:59.268634] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T19:23:59.996762] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-09T19:24:00.796773] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-09T19:24:01.206076] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T19:24:01.490529] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-09T19:24:01.596673] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-09T19:24:02.381696] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T19:24:02.396682] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-09T19:24:03.196774] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-09T19:24:03.633539] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T19:24:03.996766] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-09T19:24:04.315447] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T19:24:04.332884] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-09T19:24:04.337482] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-09T19:24:04.337609] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-09T19:24:04.740878] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-09T19:24:04.741005] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-09T19:24:04.742007] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-09T19:24:04.742484] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-09T19:24:04.744075] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54207 (keeping 200 days of data) [2025-10-09T19:24:04.797131] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-09T19:24:05.075215] [DEBUG] [LOCAL ] HIMS: Primary data saved (54207 records). [2025-10-09T19:24:05.075359] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-09T19:24:05.076167] [INFO ] [MAIN ] Update Progress: 1023/2373 symbols completed. HIMS took 47.6s. Estimated remaining: 3h 10m 4s. Rate: 7.1 symbols/min [2025-10-09T19:24:05.250664] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:05.293700] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T19:24:05.297791] [INFO ] [REMOTE ] HIW: Full fetch complete (64767 records). [2025-10-09T19:24:05.297962] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-09T19:24:05.422768] [DEBUG] [LOCAL ] HL: Loaded 53672 existing records from primary storage. [2025-10-09T19:24:05.443553] [INFO ] [MAIN ] HL: Loaded 53672 existing records. [2025-10-09T19:24:05.618564] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-09T19:24:05.802053] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:05.806000] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-09T19:24:05.806407] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-09T19:24:05.817467] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-09T19:24:05.822696] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-09T19:24:05.990371] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-09T19:24:06.008791] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-09T19:24:06.023477] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-09T19:24:06.025221] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-09T19:24:06.048294] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T19:24:06.117061] [DEBUG] [LOCAL ] HIW: Trimmed 64767 records to 44796 (keeping 200 days of data) [2025-10-09T19:24:06.396396] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:06.397767] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-09T19:24:06.569278] [DEBUG] [LOCAL ] HIW: Primary data saved (44796 records). [2025-10-09T19:24:06.569421] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-09T19:24:06.569506] [INFO ] [MAIN ] Update Progress: 1024/2373 symbols completed. HIW took 34.4s. Estimated remaining: 3h 9m 46s. Rate: 7.1 symbols/min [2025-10-09T19:24:06.738968] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:06.775508] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T19:24:06.795793] [DEBUG] [LOCAL ] HLF: Loaded 48417 existing records from primary storage. [2025-10-09T19:24:06.796097] [INFO ] [MAIN ] HLF: Loaded 48417 existing records. [2025-10-09T19:24:06.970508] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:06.970772] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-09T19:24:06.970822] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-09T19:24:06.971176] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-09T19:24:06.971234] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-09T19:24:07.202028] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-09T19:24:07.327030] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:07.486084] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:24:07.996736] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-09T19:24:08.331040] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:24:08.746786] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T19:24:08.749919] [INFO ] [REMOTE ] HIX: Full fetch complete (30333 records). [2025-10-09T19:24:08.750069] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-09T19:24:08.802130] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-09T19:24:09.298866] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-09T19:24:09.298972] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-09T19:24:09.299850] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-09T19:24:09.299922] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-09T19:24:09.301062] [DEBUG] [LOCAL ] HIX: Trimmed 30333 records to 20748 (keeping 200 days of data) [2025-10-09T19:24:09.445901] [DEBUG] [LOCAL ] HIX: Primary data saved (20748 records). [2025-10-09T19:24:09.446088] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-09T19:24:09.446212] [INFO ] [MAIN ] Update Progress: 1025/2373 symbols completed. HIX took 23.3s. Estimated remaining: 3h 9m 30s. Rate: 7.1 symbols/min [2025-10-09T19:24:09.606633] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-09T19:24:09.641561] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:09.676660] [DEBUG] [LOCAL ] HLI: Loaded 30808 existing records from primary storage. [2025-10-09T19:24:09.676936] [INFO ] [MAIN ] HLI: Loaded 30808 existing records. [2025-10-09T19:24:09.855264] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:09.855510] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-09T19:24:09.855559] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-09T19:24:09.855864] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-09T19:24:09.855921] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-09T19:24:09.945494] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T19:24:10.218353] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:10.396732] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-09T19:24:11.196690] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-09T19:24:11.378997] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T19:24:11.559882] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T19:24:11.996751] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-09T19:24:12.796744] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-09T19:24:13.164422] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T19:24:13.214932] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:24:13.596790] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-09T19:24:14.154147] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:24:14.396725] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-09T19:24:15.196719] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-09T19:24:15.457408] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T19:24:15.498031] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T19:24:15.996734] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-09T19:24:16.542177] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:24:16.796771] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-09T19:24:17.352864] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T19:24:17.596736] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-09T19:24:18.396805] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-09T19:24:18.679358] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T19:24:18.822062] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:24:19.196725] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-09T19:24:19.353305] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T19:24:19.996828] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-09T19:24:20.513315] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:24:20.796754] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-09T19:24:21.596722] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-09T19:24:21.957759] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T19:24:21.994506] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T19:24:21.996893] [INFO ] [REMOTE ] HKD: Full fetch complete (28274 records). [2025-10-09T19:24:21.997002] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-09T19:24:22.396936] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-09T19:24:22.425456] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-09T19:24:22.425545] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-09T19:24:22.426180] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-09T19:24:22.426351] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-09T19:24:22.427307] [DEBUG] [LOCAL ] HKD: Trimmed 28274 records to 18664 (keeping 200 days of data) [2025-10-09T19:24:22.536623] [DEBUG] [LOCAL ] HKD: Primary data saved (18664 records). [2025-10-09T19:24:22.536807] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-09T19:24:22.536894] [INFO ] [MAIN ] Update Progress: 1026/2373 symbols completed. HKD took 31.1s. Estimated remaining: 3h 9m 28s. Rate: 7.1 symbols/min [2025-10-09T19:24:22.708046] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:22.745072] [DEBUG] [LOCAL ] HLIO: Loaded 27907 existing records from primary storage. [2025-10-09T19:24:22.745431] [INFO ] [MAIN ] HLIO: Loaded 27907 existing records. [2025-10-09T19:24:22.933890] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:22.934208] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-09T19:24:22.934371] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-09T19:24:22.934943] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-09T19:24:22.935012] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-09T19:24:23.075463] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:24:23.202089] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-09T19:24:23.397391] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:23.996715] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-09T19:24:24.431897] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T19:24:24.528069] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T19:24:24.796723] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-09T19:24:25.122478] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T19:24:25.596739] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-09T19:24:26.396701] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-09T19:24:26.802124] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T19:24:27.151732] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:24:27.196745] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-09T19:24:27.996676] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-09T19:24:28.032354] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:24:28.079908] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:24:28.796788] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-09T19:24:29.397808] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T19:24:29.467904] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T19:24:29.596729] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-09T19:24:30.396760] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-09T19:24:30.478312] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:24:31.196734] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-09T19:24:31.996710] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-09T19:24:32.103624] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T19:24:32.289675] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T19:24:32.796773] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-09T19:24:33.362884] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:24:33.596776] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-09T19:24:34.201236] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:24:34.396758] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-09T19:24:35.098430] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T19:24:35.196699] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-09T19:24:35.996680] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-09T19:24:36.230349] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T19:24:36.509737] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T19:24:36.796743] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-09T19:24:37.081226] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T19:24:37.596730] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-09T19:24:38.396789] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-09T19:24:38.764693] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T19:24:38.880602] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T19:24:39.196725] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-09T19:24:39.756775] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:24:39.996786] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-09T19:24:40.605177] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T19:24:40.796767] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-09T19:24:41.596779] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-09T19:24:41.761185] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T19:24:41.764409] [INFO ] [REMOTE ] HLI: Full fetch complete (45162 records). [2025-10-09T19:24:41.764529] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-09T19:24:42.170597] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-09T19:24:42.170739] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-09T19:24:42.171494] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-09T19:24:42.171565] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-09T19:24:42.172993] [DEBUG] [LOCAL ] HLI: Trimmed 45162 records to 31088 (keeping 200 days of data) [2025-10-09T19:24:42.203470] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-09T19:24:42.397283] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-09T19:24:42.417787] [DEBUG] [LOCAL ] HLI: Primary data saved (31088 records). [2025-10-09T19:24:42.417951] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-09T19:24:42.418038] [INFO ] [MAIN ] Update Progress: 1027/2373 symbols completed. HLI took 33.0s. Estimated remaining: 3h 9m 35s. Rate: 7.1 symbols/min [2025-10-09T19:24:42.586412] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:42.619465] [DEBUG] [LOCAL ] HLLY: Loaded 33454 existing records from primary storage. [2025-10-09T19:24:42.619847] [INFO ] [MAIN ] HLLY: Loaded 33454 existing records. [2025-10-09T19:24:42.801856] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:42.802239] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-09T19:24:42.802295] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-09T19:24:42.802570] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-09T19:24:42.802627] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-09T19:24:42.931753] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T19:24:42.969953] [INFO ] [REMOTE ] HLF: Full fetch complete (70955 records). [2025-10-09T19:24:42.978865] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-09T19:24:43.203452] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-09T19:24:43.445075] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:43.624161] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-09T19:24:43.624325] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-09T19:24:43.625307] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-09T19:24:43.625389] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-09T19:24:43.642298] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:24:43.648513] [DEBUG] [LOCAL ] HLF: Trimmed 70955 records to 48765 (keeping 200 days of data) [2025-10-09T19:24:43.935382] [DEBUG] [LOCAL ] HLF: Primary data saved (48765 records). [2025-10-09T19:24:43.935574] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-09T19:24:43.935707] [INFO ] [MAIN ] Update Progress: 1028/2373 symbols completed. HLF took 37.4s. Estimated remaining: 3h 9m 17s. Rate: 7.1 symbols/min [2025-10-09T19:24:44.001858] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-09T19:24:44.110750] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:44.160774] [DEBUG] [LOCAL ] HLN: Loaded 53097 existing records from primary storage. [2025-10-09T19:24:44.161113] [INFO ] [MAIN ] HLN: Loaded 53097 existing records. [2025-10-09T19:24:44.342697] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:44.342928] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-09T19:24:44.342977] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-09T19:24:44.343392] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-09T19:24:44.343455] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-09T19:24:44.699378] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:44.796667] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-09T19:24:45.330386] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T19:24:45.424125] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-09T19:24:45.431443] [INFO ] [REMOTE ] HL: Full fetch complete (77663 records). [2025-10-09T19:24:45.431570] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-09T19:24:45.602922] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-09T19:24:45.824369] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-09T19:24:45.824454] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-09T19:24:45.825442] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-09T19:24:45.825507] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-09T19:24:45.826942] [DEBUG] [LOCAL ] HL: Trimmed 77663 records to 54062 (keeping 200 days of data) [2025-10-09T19:24:46.161036] [DEBUG] [LOCAL ] HL: Primary data saved (54062 records). [2025-10-09T19:24:46.161465] [INFO ] [MAIN ] HL: Full history saved. [2025-10-09T19:24:46.162201] [INFO ] [MAIN ] Update Progress: 1029/2373 symbols completed. HL took 41.1s. Estimated remaining: 3h 9m 1s. Rate: 7.1 symbols/min [2025-10-09T19:24:46.334555] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:46.401337] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-09T19:24:46.403227] [DEBUG] [LOCAL ] HLT: Loaded 50612 existing records from primary storage. [2025-10-09T19:24:46.403493] [INFO ] [MAIN ] HLT: Loaded 50612 existing records. [2025-10-09T19:24:46.614969] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:46.617929] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-09T19:24:46.617989] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-09T19:24:46.619612] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-09T19:24:46.619565] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T19:24:46.623577] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-09T19:24:46.995141] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:47.049170] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:24:47.196729] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-09T19:24:47.694749] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:24:47.996729] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-09T19:24:48.796737] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-09T19:24:48.873193] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:24:49.194604] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T19:24:49.596746] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-09T19:24:50.140258] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T19:24:50.396746] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-09T19:24:50.629013] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T19:24:51.196764] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-09T19:24:51.731242] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T19:24:51.996746] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-09T19:24:52.429518] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:24:52.796716] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-09T19:24:53.086061] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:24:53.596784] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-09T19:24:53.666016] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T19:24:54.383184] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:24:54.396688] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-09T19:24:55.196722] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-09T19:24:55.541690] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T19:24:55.544635] [INFO ] [REMOTE ] HLIO: Full fetch complete (36417 records). [2025-10-09T19:24:55.544743] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-09T19:24:55.920103] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-09T19:24:55.920190] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-09T19:24:55.921014] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-09T19:24:55.921079] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-09T19:24:55.922022] [DEBUG] [LOCAL ] HLIO: Trimmed 36417 records to 28060 (keeping 200 days of data) [2025-10-09T19:24:56.017056] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-09T19:24:56.104403] [DEBUG] [LOCAL ] HLIO: Primary data saved (28060 records). [2025-10-09T19:24:56.104543] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-09T19:24:56.105488] [INFO ] [MAIN ] Update Progress: 1030/2373 symbols completed. HLIO took 33.6s. Estimated remaining: 3h 8m 54s. Rate: 7.1 symbols/min [2025-10-09T19:24:56.277250] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:56.329054] [DEBUG] [LOCAL ] HLX: Loaded 47588 existing records from primary storage. [2025-10-09T19:24:56.329402] [INFO ] [MAIN ] HLX: Loaded 47588 existing records. [2025-10-09T19:24:56.511727] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:56.512122] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-09T19:24:56.512223] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-09T19:24:56.512711] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-09T19:24:56.512781] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-09T19:24:56.800992] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-09T19:24:56.889584] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:56.915619] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T19:24:57.417170] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:24:57.596697] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-09T19:24:58.396703] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-09T19:24:58.546756] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T19:24:59.196766] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-09T19:24:59.337610] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T19:24:59.764907] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T19:24:59.996726] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-09T19:25:00.796701] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-09T19:25:01.008702] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T19:25:01.605050] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-09T19:25:01.646029] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T19:25:02.396722] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-09T19:25:02.683172] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T19:25:02.740798] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T19:25:03.196722] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-09T19:25:03.996739] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-09T19:25:04.103310] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T19:25:04.486240] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T19:25:04.796712] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-09T19:25:05.330084] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T19:25:05.596757] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-09T19:25:05.810328] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:25:06.396726] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-09T19:25:06.817479] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T19:25:07.196713] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-09T19:25:07.996690] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-09T19:25:08.447534] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T19:25:08.591144] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:25:08.796701] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-09T19:25:09.596710] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-09T19:25:09.721596] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T19:25:10.145270] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T19:25:10.396698] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-09T19:25:11.196727] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-09T19:25:11.293813] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T19:25:11.996757] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-09T19:25:12.087307] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T19:25:12.796815] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-09T19:25:13.091529] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T19:25:13.291765] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:25:13.596785] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-09T19:25:14.070255] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:25:14.073374] [INFO ] [REMOTE ] HLLY: Full fetch complete (46208 records). [2025-10-09T19:25:14.073456] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-09T19:25:14.401875] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-09T19:25:14.470069] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-09T19:25:14.470157] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-09T19:25:14.470912] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-09T19:25:14.470979] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-09T19:25:14.472282] [DEBUG] [LOCAL ] HLLY: Trimmed 46208 records to 33723 (keeping 200 days of data) [2025-10-09T19:25:14.667305] [DEBUG] [LOCAL ] HLLY: Primary data saved (33723 records). [2025-10-09T19:25:14.667451] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-09T19:25:14.667534] [INFO ] [MAIN ] Update Progress: 1031/2373 symbols completed. HLLY took 32.2s. Estimated remaining: 3h 8m 59s. Rate: 7.1 symbols/min [2025-10-09T19:25:14.834775] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:14.878853] [DEBUG] [LOCAL ] HMC: Loaded 46543 existing records from primary storage. [2025-10-09T19:25:14.879169] [INFO ] [MAIN ] HMC: Loaded 46543 existing records. [2025-10-09T19:25:15.057810] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:15.058091] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-09T19:25:15.058143] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-09T19:25:15.058475] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-09T19:25:15.058533] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-09T19:25:15.199690] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-09T19:25:15.413405] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:15.444905] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T19:25:15.854029] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T19:25:15.996728] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-09T19:25:16.804384] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-09T19:25:16.806901] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T19:25:17.366305] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T19:25:17.596735] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-09T19:25:18.396765] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-09T19:25:18.906763] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-09T19:25:19.196760] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-09T19:25:19.371606] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T19:25:19.753422] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:25:19.996732] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-09T19:25:20.590533] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:25:20.796740] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-09T19:25:21.596755] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-09T19:25:21.736713] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:25:22.094987] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T19:25:22.396758] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-09T19:25:23.196702] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-09T19:25:23.272569] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T19:25:23.276874] [INFO ] [REMOTE ] HLT: Full fetch complete (73515 records). [2025-10-09T19:25:23.276977] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-09T19:25:23.672972] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-09T19:25:23.673052] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-09T19:25:23.674012] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-09T19:25:23.674074] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-09T19:25:23.675507] [DEBUG] [LOCAL ] HLT: Trimmed 73515 records to 50968 (keeping 200 days of data) [2025-10-09T19:25:23.996787] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-09T19:25:24.010678] [DEBUG] [LOCAL ] HLT: Primary data saved (50968 records). [2025-10-09T19:25:24.010834] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-09T19:25:24.011401] [INFO ] [MAIN ] Update Progress: 1032/2373 symbols completed. HLT took 37.8s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-09T19:25:24.256626] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:24.255134] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T19:25:24.292549] [DEBUG] [LOCAL ] HMN: Loaded 23391 existing records from primary storage. [2025-10-09T19:25:24.292839] [INFO ] [MAIN ] HMN: Loaded 23391 existing records. [2025-10-09T19:25:24.477954] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:24.478293] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-09T19:25:24.478413] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-09T19:25:24.478834] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-09T19:25:24.479004] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-09T19:25:24.632519] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T19:25:24.801891] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-09T19:25:24.870516] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:25.596785] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-09T19:25:25.731552] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T19:25:26.396694] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-09T19:25:26.674862] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T19:25:26.712838] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T19:25:27.196757] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-09T19:25:27.996711] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-09T19:25:28.103145] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T19:25:28.107637] [INFO ] [REMOTE ] HLN: Full fetch complete (76828 records). [2025-10-09T19:25:28.107812] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-09T19:25:28.500720] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-09T19:25:28.500810] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-09T19:25:28.501774] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-09T19:25:28.501838] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-09T19:25:28.503209] [DEBUG] [LOCAL ] HLN: Trimmed 76828 records to 53487 (keeping 200 days of data) [2025-10-09T19:25:28.759896] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T19:25:28.769160] [INFO ] [REMOTE ] HLX: Full fetch complete (68987 records). [2025-10-09T19:25:28.769403] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-09T19:25:28.814426] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-09T19:25:28.911860] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T19:25:29.229311] [DEBUG] [LOCAL ] HLN: Primary data saved (53487 records). [2025-10-09T19:25:29.239495] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-09T19:25:29.249183] [INFO ] [MAIN ] Update Progress: 1033/2373 symbols completed. HLN took 45.3s. Estimated remaining: 3h 8m 39s. Rate: 7.1 symbols/min [2025-10-09T19:25:29.392808] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-09T19:25:29.408716] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-09T19:25:29.420493] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-09T19:25:29.433729] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-09T19:25:29.467621] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:29.470489] [DEBUG] [LOCAL ] HLX: Trimmed 68987 records to 47890 (keeping 200 days of data) [2025-10-09T19:25:29.605404] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-09T19:25:29.611203] [DEBUG] [LOCAL ] HMY: Loaded 53135 existing records from primary storage. [2025-10-09T19:25:29.612853] [INFO ] [MAIN ] HMY: Loaded 53135 existing records. [2025-10-09T19:25:29.884581] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:29.886699] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-09T19:25:29.887079] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-09T19:25:29.888576] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-09T19:25:29.888967] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-09T19:25:30.304116] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:30.339071] [DEBUG] [LOCAL ] HLX: Primary data saved (47890 records). [2025-10-09T19:25:30.339384] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-09T19:25:30.340581] [INFO ] [MAIN ] Update Progress: 1034/2373 symbols completed. HLX took 34.2s. Estimated remaining: 3h 8m 21s. Rate: 7.1 symbols/min [2025-10-09T19:25:30.405749] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-09T19:25:30.518949] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:30.519266] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-09T19:25:30.519375] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-09T19:25:30.519711] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-09T19:25:30.519772] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-09T19:25:30.519817] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-09T19:25:30.519851] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-09T19:25:30.629924] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T19:25:30.835728] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T19:25:30.940178] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:31.196759] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-09T19:25:31.445879] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:25:31.446264] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-09T19:25:31.446383] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:25:31.446446] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-09T19:25:31.446508] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:25:31.446586] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-09T19:25:31.446678] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-09T19:25:31.446736] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-09T19:25:31.446795] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-09T19:25:31.446867] [INFO ] [MAIN ] Update Progress: 1035/2373 symbols completed. HNGE took 1.1s. Estimated remaining: 3h 8m 3s. Rate: 7.1 symbols/min [2025-10-09T19:25:31.613266] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:31.650049] [DEBUG] [LOCAL ] HNI: Loaded 29303 existing records from primary storage. [2025-10-09T19:25:31.650355] [INFO ] [MAIN ] HNI: Loaded 29303 existing records. [2025-10-09T19:25:31.840987] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:31.841318] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-09T19:25:31.841387] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-09T19:25:31.841858] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-09T19:25:31.841921] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-09T19:25:32.007692] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-09T19:25:32.216036] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:32.253155] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T19:25:32.796770] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-09T19:25:33.493042] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:25:33.596793] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-09T19:25:34.396773] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-09T19:25:34.764210] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-09T19:25:35.026542] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:25:35.196702] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-09T19:25:35.282911] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T19:25:35.996740] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-09T19:25:36.188911] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T19:25:36.796725] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-09T19:25:37.596739] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-09T19:25:37.725681] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T19:25:38.062690] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T19:25:38.396733] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-09T19:25:38.896552] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T19:25:39.196761] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-09T19:25:39.739761] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T19:25:39.996733] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-09T19:25:40.796739] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-09T19:25:41.121498] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T19:25:41.160887] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T19:25:41.596683] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-09T19:25:41.707945] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T19:25:42.396737] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-09T19:25:42.588370] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T19:25:43.196742] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-09T19:25:43.996677] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-09T19:25:44.469113] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T19:25:44.635335] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-09T19:25:44.796732] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-09T19:25:45.283570] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T19:25:45.596746] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-09T19:25:46.396851] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-09T19:25:46.640797] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T19:25:46.934483] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T19:25:47.196676] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-09T19:25:47.234243] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T19:25:47.996711] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-09T19:25:48.792338] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:25:48.796346] [INFO ] [REMOTE ] HMC: Full fetch complete (69121 records). [2025-10-09T19:25:48.796495] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-09T19:25:48.796701] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-09T19:25:49.187990] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-09T19:25:49.188134] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-09T19:25:49.189150] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-09T19:25:49.189216] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-09T19:25:49.190599] [DEBUG] [LOCAL ] HMC: Trimmed 69121 records to 46880 (keeping 200 days of data) [2025-10-09T19:25:49.477012] [DEBUG] [LOCAL ] HMC: Primary data saved (46880 records). [2025-10-09T19:25:49.477299] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-09T19:25:49.477466] [INFO ] [MAIN ] Update Progress: 1036/2373 symbols completed. HMC took 34.8s. Estimated remaining: 3h 8m 7s. Rate: 7.1 symbols/min [2025-10-09T19:25:49.599983] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-09T19:25:49.668362] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:49.683824] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T19:25:49.735118] [DEBUG] [LOCAL ] HOG: Loaded 51002 existing records from primary storage. [2025-10-09T19:25:49.735456] [INFO ] [MAIN ] HOG: Loaded 51002 existing records. [2025-10-09T19:25:49.942402] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:49.942789] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-09T19:25:49.942880] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-09T19:25:49.943622] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-09T19:25:49.943851] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-09T19:25:50.134114] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T19:25:50.369584] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:50.396681] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-09T19:25:50.766399] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T19:25:51.196728] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-09T19:25:51.996682] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-09T19:25:52.090959] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T19:25:52.323391] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T19:25:52.796741] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-09T19:25:53.596754] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-09T19:25:53.967750] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T19:25:54.008504] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T19:25:54.396780] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-09T19:25:55.105199] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T19:25:55.196691] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-09T19:25:55.349881] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T19:25:55.351916] [INFO ] [REMOTE ] HMN: Full fetch complete (31453 records). [2025-10-09T19:25:55.351987] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-09T19:25:55.780757] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-09T19:25:55.780850] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-09T19:25:55.781531] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-09T19:25:55.781594] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-09T19:25:55.782371] [DEBUG] [LOCAL ] HMN: Trimmed 31453 records to 23567 (keeping 200 days of data) [2025-10-09T19:25:55.942920] [DEBUG] [LOCAL ] HMN: Primary data saved (23567 records). [2025-10-09T19:25:55.943090] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-09T19:25:55.943215] [INFO ] [MAIN ] Update Progress: 1037/2373 symbols completed. HMN took 31.9s. Estimated remaining: 3h 7m 56s. Rate: 7.1 symbols/min [2025-10-09T19:25:55.996709] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-09T19:25:56.796710] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-09T19:25:56.863129] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T19:25:57.068707] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T19:25:57.596745] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-09T19:25:58.280294] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:25:58.396699] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-09T19:25:59.196729] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-09T19:25:59.712862] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-09T19:25:59.996746] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-09T19:26:00.131107] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T19:26:00.288877] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T19:26:00.796752] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-09T19:26:01.596765] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-09T19:26:02.076934] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-09T19:26:02.081602] [INFO ] [REMOTE ] HMY: Full fetch complete (76772 records). [2025-10-09T19:26:02.081750] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-09T19:26:02.499800] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-09T19:26:02.500029] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-09T19:26:02.501971] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-09T19:26:02.502126] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-09T19:26:02.504435] [DEBUG] [LOCAL ] HMY: Trimmed 76772 records to 53525 (keeping 200 days of data) [2025-10-09T19:26:02.777580] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T19:26:02.795325] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-09T19:26:02.843262] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T19:26:02.948774] [DEBUG] [LOCAL ] HMY: Primary data saved (53525 records). [2025-10-09T19:26:02.948944] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-09T19:26:02.949033] [INFO ] [MAIN ] Update Progress: 1038/2373 symbols completed. HMY took 33.7s. Estimated remaining: 3h 7m 46s. Rate: 7.1 symbols/min [2025-10-09T19:26:03.196782] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-09T19:26:04.394754] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T19:26:04.407097] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-09T19:26:04.440859] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T19:26:04.796760] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-09T19:26:05.983298] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T19:26:05.994800] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-09T19:26:06.225439] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T19:26:06.229909] [INFO ] [REMOTE ] HNI: Full fetch complete (41904 records). [2025-10-09T19:26:06.230130] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-09T19:26:06.627565] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-09T19:26:06.627752] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-09T19:26:06.628592] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-09T19:26:06.628639] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-09T19:26:06.629745] [DEBUG] [LOCAL ] HNI: Trimmed 41904 records to 29530 (keeping 200 days of data) [2025-10-09T19:26:06.822301] [DEBUG] [LOCAL ] HNI: Primary data saved (29530 records). [2025-10-09T19:26:06.822449] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-09T19:26:06.823957] [INFO ] [MAIN ] Update Progress: 1039/2373 symbols completed. HNI took 35.4s. Estimated remaining: 3h 7m 31s. Rate: 7.1 symbols/min [2025-10-09T19:26:07.857945] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T19:26:07.869828] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-09T19:26:09.548306] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T19:26:09.559419] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-09T19:26:11.561418] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-09T19:26:11.574581] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-09T19:26:13.297245] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:26:13.301630] [INFO ] [REMOTE ] HOG: Full fetch complete (74122 records). [2025-10-09T19:26:13.301814] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-09T19:26:13.686448] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-09T19:26:13.686556] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-09T19:26:13.687533] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-09T19:26:13.687598] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-09T19:26:13.689119] [DEBUG] [LOCAL ] HOG: Trimmed 74122 records to 51361 (keeping 200 days of data) [2025-10-09T19:26:14.005038] [DEBUG] [LOCAL ] HOG: Primary data saved (51361 records). [2025-10-09T19:26:14.005184] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-09T19:26:14.005282] [INFO ] [MAIN ] Update Progress: 1040/2373 symbols completed. HOG took 24.5s. Estimated remaining: 3h 7m 21s. Rate: 7.1 symbols/min [2025-10-09T19:26:14.756389] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:14.730844] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:14.699364] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:14.763376] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:14.812837] [DEBUG] [LOCAL ] HOV: Loaded 13912 existing records from primary storage. [2025-10-09T19:26:14.827614] [INFO ] [MAIN ] HOV: Loaded 13912 existing records. [2025-10-09T19:26:14.965855] [DEBUG] [LOCAL ] HOMB: Loaded 43436 existing records from primary storage. [2025-10-09T19:26:14.979276] [DEBUG] [LOCAL ] HOUS: Loaded 44857 existing records from primary storage. [2025-10-09T19:26:14.986496] [INFO ] [MAIN ] HOMB: Loaded 43436 existing records. [2025-10-09T19:26:15.008427] [INFO ] [MAIN ] HOUS: Loaded 44857 existing records. [2025-10-09T19:26:15.008298] [DEBUG] [LOCAL ] HP: Loaded 51643 existing records from primary storage. [2025-10-09T19:26:15.123269] [INFO ] [MAIN ] HP: Loaded 51643 existing records. [2025-10-09T19:26:15.137457] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:15.187089] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-09T19:26:15.224575] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-09T19:26:15.349413] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-09T19:26:15.358236] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-09T19:26:15.705912] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:15.738739] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-09T19:26:15.745149] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-09T19:26:15.748307] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:15.783324] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-09T19:26:15.789586] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-09T19:26:15.814974] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-09T19:26:15.822581] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-09T19:26:15.834059] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:15.851090] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-09T19:26:15.875599] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-09T19:26:15.875704] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-09T19:26:15.940233] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-09T19:26:15.975707] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-09T19:26:15.986088] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-09T19:26:16.795480] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:16.902684] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-09T19:26:17.066024] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:17.078410] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-09T19:26:17.216287] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:17.236380] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-09T19:26:17.254127] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:17.254755] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-09T19:26:18.153058] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:26:18.156866] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-09T19:26:18.568368] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:26:18.578476] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-09T19:26:18.640837] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T19:26:18.649731] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-09T19:26:18.882832] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T19:26:18.892060] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-09T19:26:18.954704] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T19:26:18.957765] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-09T19:26:19.759031] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T19:26:19.762102] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-09T19:26:19.955967] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:26:19.964866] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-09T19:26:20.121008] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:26:20.130464] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-09T19:26:20.205761] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T19:26:20.218082] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-09T19:26:20.235797] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T19:26:20.239114] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-09T19:26:20.961798] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:26:20.970890] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-09T19:26:21.136001] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T19:26:21.138797] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T19:26:21.141286] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-09T19:26:21.559460] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T19:26:21.596671] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-09T19:26:21.918938] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:26:22.110301] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T19:26:22.396718] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-09T19:26:23.148339] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T19:26:23.196694] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-09T19:26:23.340557] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:26:23.996728] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-09T19:26:24.726292] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:26:24.796695] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-09T19:26:25.596700] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-09T19:26:25.855817] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T19:26:26.096924] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:26:26.396709] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-09T19:26:26.579893] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:26:27.196713] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-09T19:26:27.939027] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:26:27.996675] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-09T19:26:28.626338] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:26:28.796704] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-09T19:26:29.296451] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T19:26:29.596714] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-09T19:26:30.320751] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:26:30.396685] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-09T19:26:31.196759] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-09T19:26:31.395847] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T19:26:31.861456] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:26:31.879052] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T19:26:31.996740] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-09T19:26:32.796776] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-09T19:26:33.523592] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:26:33.596674] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-09T19:26:34.332705] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:26:34.396747] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-09T19:26:35.170005] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T19:26:35.196706] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-09T19:26:35.323925] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T19:26:35.996698] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-09T19:26:36.659327] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T19:26:36.796772] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-09T19:26:37.596773] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-09T19:26:37.666453] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T19:26:38.354021] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T19:26:38.396682] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-09T19:26:39.209172] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-09T19:26:39.215684] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:26:39.851058] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:26:39.855617] [INFO ] [REMOTE ] HOMB: Full fetch complete (63935 records). [2025-10-09T19:26:39.855819] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-09T19:26:40.001972] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-09T19:26:40.252080] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-09T19:26:40.252159] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-09T19:26:40.253028] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-09T19:26:40.253093] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-09T19:26:40.254397] [DEBUG] [LOCAL ] HOMB: Trimmed 63935 records to 43753 (keeping 200 days of data) [2025-10-09T19:26:40.522389] [DEBUG] [LOCAL ] HOMB: Primary data saved (43753 records). [2025-10-09T19:26:40.522528] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-09T19:26:40.523242] [INFO ] [MAIN ] Update Progress: 1041/2373 symbols completed. HOMB took 26.5s. Estimated remaining: 3h 7m 36s. Rate: 7.1 symbols/min [2025-10-09T19:26:40.692016] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:40.744542] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-09T19:26:40.744922] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-09T19:26:40.806448] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-09T19:26:40.925851] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:40.926073] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-09T19:26:40.926159] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-09T19:26:40.926864] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-09T19:26:40.927070] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-09T19:26:41.255228] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-09T19:26:41.341915] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:41.596700] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-09T19:26:41.661744] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T19:26:41.666460] [INFO ] [REMOTE ] HOUS: Full fetch complete (63929 records). [2025-10-09T19:26:41.666590] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-09T19:26:41.779590] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T19:26:41.826830] [INFO ] [REMOTE ] HOV: Full fetch complete (19052 records). [2025-10-09T19:26:41.854845] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-09T19:26:42.257511] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-09T19:26:42.258295] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-09T19:26:42.285158] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-09T19:26:42.285257] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-09T19:26:42.400040] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-09T19:26:42.394548] [DEBUG] [LOCAL ] HOUS: Trimmed 63929 records to 45220 (keeping 200 days of data) [2025-10-09T19:26:42.527278] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-09T19:26:42.535973] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-09T19:26:42.536239] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-09T19:26:42.536679] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-09T19:26:42.574829] [DEBUG] [LOCAL ] HOV: Trimmed 19052 records to 14000 (keeping 200 days of data) [2025-10-09T19:26:42.774886] [DEBUG] [LOCAL ] HOV: Primary data saved (14000 records). [2025-10-09T19:26:42.775923] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-09T19:26:42.776894] [INFO ] [MAIN ] Update Progress: 1042/2373 symbols completed. HOV took 28.8s. Estimated remaining: 3h 7m 20s. Rate: 7.1 symbols/min [2025-10-09T19:26:42.973965] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:43.015664] [DEBUG] [LOCAL ] HOUS: Primary data saved (45220 records). [2025-10-09T19:26:43.015909] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-09T19:26:43.016840] [INFO ] [MAIN ] Update Progress: 1043/2373 symbols completed. HOUS took 29.0s. Estimated remaining: 3h 7m 1s. Rate: 7.1 symbols/min [2025-10-09T19:26:43.102240] [DEBUG] [LOCAL ] HPF: Loaded 7485 existing records from primary storage. [2025-10-09T19:26:43.129747] [INFO ] [MAIN ] HPF: Loaded 7485 existing records. [2025-10-09T19:26:43.270394] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:43.376150] [DEBUG] [LOCAL ] HPI: Loaded 10608 existing records from primary storage. [2025-10-09T19:26:43.398290] [INFO ] [MAIN ] HPI: Loaded 10608 existing records. [2025-10-09T19:26:43.398011] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:43.419514] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-09T19:26:43.435247] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-09T19:26:43.477265] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-09T19:26:43.487722] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-09T19:26:43.687522] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:43.691366] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-09T19:26:43.696985] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-09T19:26:43.750121] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-09T19:26:43.806068] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-09T19:26:43.982955] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-09T19:26:44.056693] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-09T19:26:44.174827] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:44.177460] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-09T19:26:44.388091] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:44.418960] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T19:26:44.796756] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-09T19:26:45.064196] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T19:26:45.596789] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-09T19:26:46.234120] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-09T19:26:46.261965] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T19:26:46.396784] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-09T19:26:46.594972] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T19:26:47.196741] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-09T19:26:47.996719] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-09T19:26:48.255576] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T19:26:48.282926] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T19:26:48.796785] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-09T19:26:49.596704] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-09T19:26:49.613412] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:26:49.617859] [INFO ] [REMOTE ] HP: Full fetch complete (73923 records). [2025-10-09T19:26:49.617977] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-09T19:26:50.014254] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-09T19:26:50.014399] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-09T19:26:50.015462] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-09T19:26:50.015533] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-09T19:26:50.017039] [DEBUG] [LOCAL ] HP: Trimmed 73923 records to 51959 (keeping 200 days of data) [2025-10-09T19:26:50.318507] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:26:50.357296] [DEBUG] [LOCAL ] HP: Primary data saved (51959 records). [2025-10-09T19:26:50.357404] [INFO ] [MAIN ] HP: Full history saved. [2025-10-09T19:26:50.357482] [INFO ] [MAIN ] Update Progress: 1044/2373 symbols completed. HP took 36.3s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-09T19:26:50.400951] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-09T19:26:50.530910] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:50.580902] [DEBUG] [LOCAL ] HPP: Loaded 51041 existing records from primary storage. [2025-10-09T19:26:50.581230] [INFO ] [MAIN ] HPP: Loaded 51041 existing records. [2025-10-09T19:26:50.764955] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:50.765210] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-09T19:26:50.765343] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-09T19:26:50.765902] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-09T19:26:50.765962] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-09T19:26:50.885001] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T19:26:51.032189] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-09T19:26:51.190455] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:51.196671] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-09T19:26:51.996726] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-09T19:26:52.507517] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:26:52.796770] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-09T19:26:53.596749] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-09T19:26:54.124210] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T19:26:54.202795] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T19:26:54.396710] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-09T19:26:54.460873] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:26:55.196728] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-09T19:26:55.806701] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T19:26:55.996697] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-09T19:26:56.432065] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-09T19:26:56.796765] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-09T19:26:57.019943] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T19:26:57.596729] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-09T19:26:58.218524] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T19:26:58.396694] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-09T19:26:58.735687] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T19:26:59.175126] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:26:59.196665] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-09T19:26:59.996733] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-09T19:27:00.083711] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T19:27:00.796728] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-09T19:27:01.380440] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T19:27:01.596694] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-09T19:27:01.627889] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:27:02.334705] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T19:27:02.396725] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-09T19:27:03.168633] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:27:03.196667] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-09T19:27:03.941228] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T19:27:03.996758] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-09T19:27:04.796733] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-09T19:27:05.333844] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T19:27:05.581027] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:27:05.596664] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-09T19:27:06.396719] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-09T19:27:07.196719] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-09T19:27:07.444933] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:27:07.955262] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T19:27:07.996696] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-09T19:27:08.267607] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:27:08.473691] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T19:27:08.796787] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-09T19:27:09.596725] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-09T19:27:10.396862] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-09T19:27:10.551301] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:27:10.948877] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T19:27:10.950110] [INFO ] [REMOTE ] HPF: Full fetch complete (10714 records). [2025-10-09T19:27:10.950184] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-09T19:27:11.199422] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-09T19:27:11.324267] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-09T19:27:11.324427] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-09T19:27:11.324830] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-09T19:27:11.324907] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-09T19:27:11.325560] [DEBUG] [LOCAL ] HPF: Trimmed 10714 records to 7514 (keeping 200 days of data) [2025-10-09T19:27:11.399987] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T19:27:11.416545] [DEBUG] [LOCAL ] HPF: Primary data saved (7514 records). [2025-10-09T19:27:11.416810] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-09T19:27:11.417352] [INFO ] [MAIN ] Update Progress: 1045/2373 symbols completed. HPF took 28.6s. Estimated remaining: 3h 6m 59s. Rate: 7.1 symbols/min [2025-10-09T19:27:11.591898] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:11.650554] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-09T19:27:11.650960] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-09T19:27:11.825802] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:11.826002] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-09T19:27:11.826049] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-09T19:27:11.826533] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-09T19:27:11.826589] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-09T19:27:11.998844] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-09T19:27:12.176877] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:12.759833] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:27:12.796674] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-09T19:27:12.878409] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T19:27:13.596786] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-09T19:27:14.370095] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:27:14.391116] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T19:27:14.396669] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-09T19:27:15.196704] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-09T19:27:15.996810] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-09T19:27:16.188575] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T19:27:16.254608] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T19:27:16.796714] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-09T19:27:17.596713] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-09T19:27:17.679778] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T19:27:17.681330] [INFO ] [REMOTE ] HPI: Full fetch complete (13959 records). [2025-10-09T19:27:17.681402] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-09T19:27:18.046213] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-09T19:27:18.046350] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-09T19:27:18.046995] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-09T19:27:18.047248] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-09T19:27:18.048578] [DEBUG] [LOCAL ] HPI: Trimmed 13959 records to 10659 (keeping 200 days of data) [2025-10-09T19:27:18.147500] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-09T19:27:18.152591] [DEBUG] [LOCAL ] HPI: Primary data saved (10659 records). [2025-10-09T19:27:18.164895] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-09T19:27:18.165845] [INFO ] [MAIN ] Update Progress: 1046/2373 symbols completed. HPI took 35.1s. Estimated remaining: 3h 6m 48s. Rate: 7.1 symbols/min [2025-10-09T19:27:18.337408] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:18.351151] [DEBUG] [LOCAL ] HPS: Loaded 10270 existing records from primary storage. [2025-10-09T19:27:18.351392] [INFO ] [MAIN ] HPS: Loaded 10270 existing records. [2025-10-09T19:27:18.404243] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-09T19:27:18.534405] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:18.534721] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-09T19:27:18.534781] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-09T19:27:18.534972] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-09T19:27:18.535041] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-09T19:27:18.892685] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:19.196749] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-09T19:27:19.334929] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T19:27:19.339348] [INFO ] [REMOTE ] HPP: Full fetch complete (73290 records). [2025-10-09T19:27:19.339462] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-09T19:27:19.736975] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-09T19:27:19.737097] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-09T19:27:19.738156] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-09T19:27:19.738226] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-09T19:27:19.739773] [DEBUG] [LOCAL ] HPP: Trimmed 73290 records to 51424 (keeping 200 days of data) [2025-10-09T19:27:20.010444] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-09T19:27:20.027593] [DEBUG] [LOCAL ] HPP: Primary data saved (51424 records). [2025-10-09T19:27:20.027735] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-09T19:27:20.027826] [INFO ] [MAIN ] Update Progress: 1047/2373 symbols completed. HPP took 29.7s. Estimated remaining: 3h 6m 31s. Rate: 7.1 symbols/min [2025-10-09T19:27:20.153189] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T19:27:20.216112] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:20.245947] [DEBUG] [LOCAL ] HQH: Loaded 25511 existing records from primary storage. [2025-10-09T19:27:20.246265] [INFO ] [MAIN ] HQH: Loaded 25511 existing records. [2025-10-09T19:27:20.442118] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:20.442428] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-09T19:27:20.442561] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-09T19:27:20.443051] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-09T19:27:20.443108] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-09T19:27:20.696556] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-09T19:27:20.806536] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-09T19:27:20.845632] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:21.596738] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-09T19:27:21.897975] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T19:27:21.902805] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-09T19:27:21.902934] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-09T19:27:22.281674] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T19:27:22.307717] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-09T19:27:22.308685] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-09T19:27:22.309876] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-09T19:27:22.309965] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-09T19:27:22.311685] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54087 (keeping 200 days of data) [2025-10-09T19:27:22.405121] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-09T19:27:22.464352] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:27:22.709485] [DEBUG] [LOCAL ] HPE: Primary data saved (54087 records). [2025-10-09T19:27:22.709680] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-09T19:27:22.710256] [INFO ] [MAIN ] Update Progress: 1048/2373 symbols completed. HPE took 42.2s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-10-09T19:27:22.885760] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:22.911778] [DEBUG] [LOCAL ] HQL: Loaded 16673 existing records from primary storage. [2025-10-09T19:27:22.912058] [INFO ] [MAIN ] HQL: Loaded 16673 existing records. [2025-10-09T19:27:23.088836] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:23.089075] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-09T19:27:23.089122] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-09T19:27:23.089407] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-09T19:27:23.089465] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-09T19:27:23.201962] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-09T19:27:23.344008] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T19:27:23.462772] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:23.996788] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-09T19:27:24.796730] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-09T19:27:24.975826] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T19:27:25.023972] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T19:27:25.596749] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-09T19:27:25.707773] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T19:27:26.396775] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-09T19:27:27.201209] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-09T19:27:27.207330] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T19:27:27.480121] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T19:27:27.688486] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T19:27:27.996764] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-09T19:27:28.673317] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T19:27:28.796733] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-09T19:27:29.596730] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-09T19:27:29.752134] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T19:27:30.396710] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-09T19:27:31.196700] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-09T19:27:31.353148] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:27:31.376214] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T19:27:31.996700] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-09T19:27:32.019142] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:27:32.742855] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T19:27:32.796689] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-09T19:27:33.582855] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T19:27:33.596677] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-09T19:27:34.142799] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T19:27:34.396720] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-09T19:27:35.196707] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-09T19:27:35.215279] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T19:27:35.996790] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-09T19:27:36.162962] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T19:27:36.796769] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-09T19:27:37.596712] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-09T19:27:37.658439] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T19:27:37.788266] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T19:27:38.396734] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-09T19:27:38.469746] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T19:27:39.196714] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-09T19:27:39.237197] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T19:27:39.996713] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-09T19:27:40.180721] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T19:27:40.796777] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-09T19:27:41.596694] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-09T19:27:41.747301] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:27:41.823496] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:27:42.396696] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-09T19:27:42.621292] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T19:27:43.180954] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:27:43.196677] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-09T19:27:43.996777] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-09T19:27:44.755084] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T19:27:44.756547] [INFO ] [REMOTE ] HPS: Full fetch complete (15192 records). [2025-10-09T19:27:44.756618] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-09T19:27:44.801864] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-09T19:27:45.141193] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-09T19:27:45.141325] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-09T19:27:45.141736] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-09T19:27:45.141815] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-09T19:27:45.142749] [DEBUG] [LOCAL ] HPS: Trimmed 15192 records to 10353 (keeping 200 days of data) [2025-10-09T19:27:45.231260] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T19:27:45.261898] [DEBUG] [LOCAL ] HPS: Primary data saved (10353 records). [2025-10-09T19:27:45.262029] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-09T19:27:45.262154] [INFO ] [MAIN ] Update Progress: 1049/2373 symbols completed. HPS took 27.1s. Estimated remaining: 3h 6m 25s. Rate: 7.1 symbols/min [2025-10-09T19:27:45.435038] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:45.496036] [DEBUG] [LOCAL ] HR: Loaded 51997 existing records from primary storage. [2025-10-09T19:27:45.496390] [INFO ] [MAIN ] HR: Loaded 51997 existing records. [2025-10-09T19:27:45.599443] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-09T19:27:45.687068] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:45.687341] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-09T19:27:45.687581] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-09T19:27:45.694936] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-09T19:27:45.705951] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-09T19:27:45.712768] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T19:27:46.077136] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:46.396752] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-09T19:27:46.643559] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T19:27:47.196780] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-09T19:27:47.242944] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T19:27:47.996724] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-09T19:27:48.796784] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-09T19:27:49.013616] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T19:27:49.286439] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:27:49.596734] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-09T19:27:49.776738] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T19:27:50.396782] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-09T19:27:51.076687] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:27:51.196743] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-09T19:27:51.245534] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:27:51.996698] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-09T19:27:52.237562] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T19:27:52.240035] [INFO ] [REMOTE ] HQL: Full fetch complete (25098 records). [2025-10-09T19:27:52.240109] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-09T19:27:52.615088] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-09T19:27:52.615183] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-09T19:27:52.615780] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-09T19:27:52.615845] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-09T19:27:52.616785] [DEBUG] [LOCAL ] HQL: Trimmed 25098 records to 16859 (keeping 200 days of data) [2025-10-09T19:27:52.721392] [DEBUG] [LOCAL ] HQL: Primary data saved (16859 records). [2025-10-09T19:27:52.721547] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-09T19:27:52.721633] [INFO ] [MAIN ] Update Progress: 1050/2373 symbols completed. HQL took 30.0s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-10-09T19:27:52.801903] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-09T19:27:52.893823] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:52.948540] [DEBUG] [LOCAL ] HRB: Loaded 48391 existing records from primary storage. [2025-10-09T19:27:52.949010] [INFO ] [MAIN ] HRB: Loaded 48391 existing records. [2025-10-09T19:27:53.133820] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:53.134034] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-09T19:27:53.134081] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-09T19:27:53.134697] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-09T19:27:53.134775] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-09T19:27:53.519929] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:53.524414] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:27:53.596749] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-09T19:27:54.064041] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:27:54.396697] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-09T19:27:54.989595] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:27:55.196831] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-09T19:27:55.996721] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-09T19:27:56.093105] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T19:27:56.796702] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-09T19:27:57.062226] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T19:27:57.349555] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:27:57.596723] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-09T19:27:58.149189] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T19:27:58.292867] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T19:27:58.396710] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-09T19:27:59.196761] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-09T19:27:59.443700] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T19:27:59.446360] [INFO ] [REMOTE ] HQH: Full fetch complete (37291 records). [2025-10-09T19:27:59.446431] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-09T19:27:59.822678] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-09T19:27:59.822766] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-09T19:27:59.823467] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-09T19:27:59.823515] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-09T19:27:59.824347] [DEBUG] [LOCAL ] HQH: Trimmed 37291 records to 25751 (keeping 200 days of data) [2025-10-09T19:27:59.983920] [DEBUG] [LOCAL ] HQH: Primary data saved (25751 records). [2025-10-09T19:27:59.984054] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-09T19:27:59.984158] [INFO ] [MAIN ] Update Progress: 1051/2373 symbols completed. HQH took 40.0s. Estimated remaining: 3h 6m 5s. Rate: 7.1 symbols/min [2025-10-09T19:28:00.005720] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-09T19:28:00.164631] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:00.200069] [DEBUG] [LOCAL ] HRI: Loaded 32605 existing records from primary storage. [2025-10-09T19:28:00.200345] [INFO ] [MAIN ] HRI: Loaded 32605 existing records. [2025-10-09T19:28:00.381803] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:00.382065] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-09T19:28:00.382114] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-09T19:28:00.382466] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-09T19:28:00.382525] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-09T19:28:00.740571] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:00.796670] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-09T19:28:01.111489] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:28:01.596724] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-09T19:28:01.775205] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T19:28:01.810099] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T19:28:02.396709] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-09T19:28:02.848170] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:28:03.196727] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-09T19:28:03.661469] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T19:28:03.996771] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-09T19:28:04.715550] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T19:28:04.720366] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-09T19:28:04.720478] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-09T19:28:04.801954] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-09T19:28:05.108459] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-09T19:28:05.108538] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-09T19:28:05.109452] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-09T19:28:05.109516] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-09T19:28:05.110999] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 54058 (keeping 200 days of data) [2025-10-09T19:28:05.447978] [DEBUG] [LOCAL ] HPQ: Primary data saved (54058 records). [2025-10-09T19:28:05.448133] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-09T19:28:05.449518] [INFO ] [MAIN ] Update Progress: 1052/2373 symbols completed. HPQ took 54.0s. Estimated remaining: 3h 5m 53s. Rate: 7.1 symbols/min [2025-10-09T19:28:05.597585] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-09T19:28:05.624792] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:05.721228] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:28:05.734967] [DEBUG] [LOCAL ] HRL: Loaded 53097 existing records from primary storage. [2025-10-09T19:28:05.735409] [INFO ] [MAIN ] HRL: Loaded 53097 existing records. [2025-10-09T19:28:05.910480] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:05.910709] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-09T19:28:05.910768] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-09T19:28:05.911247] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-09T19:28:05.911305] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-09T19:28:06.264986] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:06.295196] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T19:28:06.396672] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-09T19:28:06.912466] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:28:07.196734] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-09T19:28:07.996708] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-09T19:28:08.097500] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T19:28:08.678323] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:28:08.796710] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-09T19:28:09.596734] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-09T19:28:09.682904] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T19:28:10.396704] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-09T19:28:10.552630] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T19:28:11.196754] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-09T19:28:11.300675] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T19:28:11.999294] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-09T19:28:12.005532] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T19:28:12.796719] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-09T19:28:12.829189] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:28:12.834062] [INFO ] [REMOTE ] HR: Full fetch complete (74818 records). [2025-10-09T19:28:12.834262] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-09T19:28:13.266109] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-09T19:28:13.266253] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-09T19:28:13.267469] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-09T19:28:13.267981] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-09T19:28:13.269885] [DEBUG] [LOCAL ] HR: Trimmed 74818 records to 52363 (keeping 200 days of data) [2025-10-09T19:28:13.544754] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:28:13.610407] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-09T19:28:13.635065] [DEBUG] [LOCAL ] HR: Primary data saved (52363 records). [2025-10-09T19:28:13.635235] [INFO ] [MAIN ] HR: Full history saved. [2025-10-09T19:28:13.635383] [INFO ] [MAIN ] Update Progress: 1053/2373 symbols completed. HR took 28.4s. Estimated remaining: 3h 5m 44s. Rate: 7.1 symbols/min [2025-10-09T19:28:13.801466] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:13.835609] [DEBUG] [LOCAL ] HRTG: Loaded 33817 existing records from primary storage. [2025-10-09T19:28:13.835926] [INFO ] [MAIN ] HRTG: Loaded 33817 existing records. [2025-10-09T19:28:14.010606] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:14.010853] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-09T19:28:14.010901] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-09T19:28:14.011279] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-09T19:28:14.011337] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-09T19:28:14.372867] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:14.396672] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-09T19:28:14.472071] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T19:28:15.043278] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:28:15.138783] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T19:28:15.196670] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-09T19:28:15.996751] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-09T19:28:16.229822] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T19:28:16.796753] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-09T19:28:17.596718] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-09T19:28:17.834851] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T19:28:17.941966] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T19:28:18.396744] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-09T19:28:19.160058] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T19:28:19.196695] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-09T19:28:19.996695] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-09T19:28:20.246281] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T19:28:20.346346] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T19:28:20.796705] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-09T19:28:21.333147] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T19:28:21.596704] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-09T19:28:22.291622] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T19:28:22.396675] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-09T19:28:22.957883] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T19:28:23.196769] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-09T19:28:23.761424] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T19:28:23.996731] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-09T19:28:24.796691] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-09T19:28:24.906412] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T19:28:25.596696] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-09T19:28:25.639985] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:28:25.874838] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T19:28:26.396771] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-09T19:28:26.665840] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T19:28:27.196727] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-09T19:28:27.691623] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:28:27.996754] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-09T19:28:28.486499] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T19:28:28.796756] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-09T19:28:29.503017] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T19:28:29.596775] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-09T19:28:30.167767] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T19:28:30.396760] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-09T19:28:31.048448] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T19:28:31.196728] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-09T19:28:31.622736] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T19:28:31.625476] [INFO ] [REMOTE ] HRI: Full fetch complete (46206 records). [2025-10-09T19:28:31.625554] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-09T19:28:32.010324] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-09T19:28:32.028082] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-09T19:28:32.028149] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-09T19:28:32.028903] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-09T19:28:32.029056] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-09T19:28:32.030120] [DEBUG] [LOCAL ] HRI: Trimmed 46206 records to 32776 (keeping 200 days of data) [2025-10-09T19:28:32.236847] [DEBUG] [LOCAL ] HRI: Primary data saved (32776 records). [2025-10-09T19:28:32.236991] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-09T19:28:32.237076] [INFO ] [MAIN ] Update Progress: 1054/2373 symbols completed. HRI took 32.3s. Estimated remaining: 3h 5m 49s. Rate: 7.1 symbols/min [2025-10-09T19:28:32.405552] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:32.463271] [DEBUG] [LOCAL ] HSBC: Loaded 50946 existing records from primary storage. [2025-10-09T19:28:32.463663] [INFO ] [MAIN ] HSBC: Loaded 50946 existing records. [2025-10-09T19:28:32.647066] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:32.647453] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-09T19:28:32.664184] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-09T19:28:32.668453] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:28:32.675544] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-09T19:28:32.676291] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-09T19:28:32.801923] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-09T19:28:33.042580] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:33.601769] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-09T19:28:33.604787] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T19:28:33.609482] [INFO ] [REMOTE ] HRB: Full fetch complete (69914 records). [2025-10-09T19:28:33.609572] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-09T19:28:34.009684] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-09T19:28:34.009805] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-09T19:28:34.010857] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-09T19:28:34.010921] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-09T19:28:34.012329] [DEBUG] [LOCAL ] HRB: Trimmed 69914 records to 48723 (keeping 200 days of data) [2025-10-09T19:28:34.266027] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:28:34.344946] [DEBUG] [LOCAL ] HRB: Primary data saved (48723 records). [2025-10-09T19:28:34.345085] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-09T19:28:34.345727] [INFO ] [MAIN ] Update Progress: 1055/2373 symbols completed. HRB took 41.6s. Estimated remaining: 3h 5m 32s. Rate: 7.1 symbols/min [2025-10-09T19:28:34.408494] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-09T19:28:34.516451] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:34.533537] [DEBUG] [LOCAL ] HSHP: Loaded 15044 existing records from primary storage. [2025-10-09T19:28:34.533807] [INFO ] [MAIN ] HSHP: Loaded 15044 existing records. [2025-10-09T19:28:34.712730] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:34.712944] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-09T19:28:34.712994] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-09T19:28:34.713238] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-09T19:28:34.713295] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-09T19:28:35.069885] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:35.202932] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-09T19:28:35.208930] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T19:28:35.840844] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T19:28:35.996716] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-09T19:28:36.717985] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:28:36.796751] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-09T19:28:37.596696] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-09T19:28:37.820822] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T19:28:38.401873] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-09T19:28:38.423485] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T19:28:38.735513] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T19:28:39.196794] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-09T19:28:39.996738] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-09T19:28:40.222166] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:28:40.240157] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T19:28:40.245262] [INFO ] [REMOTE ] HRL: Full fetch complete (76683 records). [2025-10-09T19:28:40.245395] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-09T19:28:40.643814] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-09T19:28:40.643925] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-09T19:28:40.645847] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-09T19:28:40.645919] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-09T19:28:40.647526] [DEBUG] [LOCAL ] HRL: Trimmed 76683 records to 53484 (keeping 200 days of data) [2025-10-09T19:28:40.830486] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-09T19:28:40.981803] [DEBUG] [LOCAL ] HRL: Primary data saved (53484 records). [2025-10-09T19:28:40.981972] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-09T19:28:40.982773] [INFO ] [MAIN ] Update Progress: 1056/2373 symbols completed. HRL took 35.5s. Estimated remaining: 3h 5m 21s. Rate: 7.1 symbols/min [2025-10-09T19:28:41.154813] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:41.217247] [DEBUG] [LOCAL ] HSY: Loaded 50345 existing records from primary storage. [2025-10-09T19:28:41.217713] [INFO ] [MAIN ] HSY: Loaded 50345 existing records. [2025-10-09T19:28:41.395754] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:41.403882] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-09T19:28:41.404547] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-09T19:28:41.404903] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T19:28:41.408059] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-09T19:28:41.408314] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-09T19:28:41.439545] [INFO ] [REMOTE ] HRTG: Full fetch complete (43497 records). [2025-10-09T19:28:41.471401] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-09T19:28:41.601755] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-09T19:28:41.770218] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T19:28:42.205315] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:42.205519] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-09T19:28:42.205845] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-09T19:28:42.206681] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-09T19:28:42.206746] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-09T19:28:42.207616] [DEBUG] [LOCAL ] HRTG: Trimmed 43497 records to 34091 (keeping 200 days of data) [2025-10-09T19:28:42.398371] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-09T19:28:42.408672] [DEBUG] [LOCAL ] HRTG: Primary data saved (34091 records). [2025-10-09T19:28:42.408759] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-09T19:28:42.408838] [INFO ] [MAIN ] Update Progress: 1057/2373 symbols completed. HRTG took 28.8s. Estimated remaining: 3h 5m 4s. Rate: 7.1 symbols/min [2025-10-09T19:28:42.582254] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:42.582497] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-09T19:28:42.582553] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-09T19:28:42.582699] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-09T19:28:42.582760] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-09T19:28:42.582831] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-09T19:28:42.582908] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-09T19:28:42.927919] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:43.196676] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-09T19:28:43.411297] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:28:43.411680] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-09T19:28:43.411773] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:28:43.411821] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-09T19:28:43.411856] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:28:43.411894] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-09T19:28:43.411951] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-09T19:28:43.411987] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-09T19:28:43.412043] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-09T19:28:43.412114] [INFO ] [MAIN ] Update Progress: 1058/2373 symbols completed. HTB took 1.0s. Estimated remaining: 3h 4m 47s. Rate: 7.1 symbols/min [2025-10-09T19:28:43.581872] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:43.614901] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-09T19:28:43.637525] [DEBUG] [LOCAL ] HTD: Loaded 13925 existing records from primary storage. [2025-10-09T19:28:43.637855] [INFO ] [MAIN ] HTD: Loaded 13925 existing records. [2025-10-09T19:28:43.818952] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:43.819430] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-09T19:28:43.819676] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-09T19:28:43.820116] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-09T19:28:43.820194] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-09T19:28:44.001944] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-09T19:28:44.181109] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:28:44.253039] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:44.796778] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-09T19:28:45.304736] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T19:28:45.596720] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-09T19:28:46.015932] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T19:28:46.396734] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-09T19:28:47.196718] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-09T19:28:47.553503] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T19:28:47.996806] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-09T19:28:48.188926] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T19:28:48.525863] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T19:28:48.778401] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T19:28:48.796666] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-09T19:28:49.555716] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T19:28:49.596689] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-09T19:28:50.396720] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-09T19:28:51.196737] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-09T19:28:51.426525] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T19:28:51.525552] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T19:28:51.996721] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-09T19:28:52.796736] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-09T19:28:53.062531] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T19:28:53.490059] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T19:28:53.596686] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-09T19:28:53.612167] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T19:28:54.396765] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-09T19:28:55.196702] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-09T19:28:55.453026] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T19:28:55.996705] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-09T19:28:56.184083] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T19:28:56.207963] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T19:28:56.796718] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-09T19:28:57.596693] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-09T19:28:57.795751] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T19:28:58.396786] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-09T19:28:58.412829] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T19:28:58.585359] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T19:28:59.196799] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-09T19:28:59.296244] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T19:28:59.996721] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-09T19:29:00.796741] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-09T19:29:01.060479] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T19:29:01.057482] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T19:29:01.596725] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-09T19:29:02.225510] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T19:29:02.258929] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:29:02.396689] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-09T19:29:03.196781] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-09T19:29:03.996696] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-09T19:29:04.060556] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:29:04.781635] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T19:29:04.796661] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-09T19:29:04.935614] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T19:29:04.939980] [INFO ] [REMOTE ] HSBC: Full fetch complete (73811 records). [2025-10-09T19:29:04.940212] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-09T19:29:05.326819] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-09T19:29:05.326903] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-09T19:29:05.327902] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-09T19:29:05.327968] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-09T19:29:05.329627] [DEBUG] [LOCAL ] HSBC: Trimmed 73811 records to 51335 (keeping 200 days of data) [2025-10-09T19:29:05.614397] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-09T19:29:05.663787] [DEBUG] [LOCAL ] HSBC: Primary data saved (51335 records). [2025-10-09T19:29:05.663985] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-09T19:29:05.664141] [INFO ] [MAIN ] Update Progress: 1059/2373 symbols completed. HSBC took 33.4s. Estimated remaining: 3h 4m 55s. Rate: 7.1 symbols/min [2025-10-09T19:29:05.856028] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:05.856290] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-09T19:29:05.856363] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-09T19:29:05.856483] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-09T19:29:05.856528] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-09T19:29:05.856570] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-09T19:29:05.856605] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-09T19:29:05.972801] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T19:29:06.230805] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:06.396694] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-09T19:29:06.730669] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-09T19:29:07.196692] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-09T19:29:07.428907] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:29:07.532146] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T19:29:07.996733] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-09T19:29:08.541462] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T19:29:08.796717] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-09T19:29:09.593542] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T19:29:09.596767] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-09T19:29:10.396690] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-09T19:29:10.420635] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T19:29:10.422082] [INFO ] [REMOTE ] HSHP: Full fetch complete (23157 records). [2025-10-09T19:29:10.422152] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-09T19:29:10.783907] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-09T19:29:10.783985] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-09T19:29:10.784511] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-09T19:29:10.784568] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-09T19:29:10.785190] [DEBUG] [LOCAL ] HSHP: Trimmed 23157 records to 15090 (keeping 200 days of data) [2025-10-09T19:29:10.876888] [DEBUG] [LOCAL ] HSHP: Primary data saved (15090 records). [2025-10-09T19:29:10.877045] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-09T19:29:10.877135] [INFO ] [MAIN ] Update Progress: 1060/2373 symbols completed. HSHP took 36.5s. Estimated remaining: 3h 4m 43s. Rate: 7.1 symbols/min [2025-10-09T19:29:11.056637] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:11.108425] [DEBUG] [LOCAL ] HTGC: Loaded 47466 existing records from primary storage. [2025-10-09T19:29:11.108827] [INFO ] [MAIN ] HTGC: Loaded 47466 existing records. [2025-10-09T19:29:11.201784] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-09T19:29:11.328441] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:11.328847] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-09T19:29:11.329076] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-09T19:29:11.329573] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-09T19:29:11.329635] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-09T19:29:11.463143] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T19:29:11.671506] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T19:29:11.782703] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:11.996729] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-09T19:29:12.796729] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-09T19:29:13.596772] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-09T19:29:13.626857] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T19:29:13.787519] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T19:29:13.923991] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-09T19:29:14.396735] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-09T19:29:15.196729] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-09T19:29:15.344161] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:29:15.996710] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-09T19:29:16.796759] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-09T19:29:16.915105] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T19:29:16.917309] [INFO ] [REMOTE ] HTD: Full fetch complete (19116 records). [2025-10-09T19:29:16.917699] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-09T19:29:17.355596] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-09T19:29:17.355847] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-09T19:29:17.366003] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-09T19:29:17.367173] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-09T19:29:17.367289] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-09T19:29:17.368460] [DEBUG] [LOCAL ] HTD: Trimmed 19116 records to 14048 (keeping 200 days of data) [2025-10-09T19:29:17.454079] [DEBUG] [LOCAL ] HTD: Primary data saved (14048 records). [2025-10-09T19:29:17.454219] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-09T19:29:17.454306] [INFO ] [MAIN ] Update Progress: 1061/2373 symbols completed. HTD took 34.0s. Estimated remaining: 3h 4m 32s. Rate: 7.1 symbols/min [2025-10-09T19:29:17.601829] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-09T19:29:17.633105] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:17.669300] [DEBUG] [LOCAL ] HTH: Loaded 32417 existing records from primary storage. [2025-10-09T19:29:17.669594] [INFO ] [MAIN ] HTH: Loaded 32417 existing records. [2025-10-09T19:29:17.843109] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:17.843349] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-09T19:29:17.843397] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-09T19:29:17.843774] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-09T19:29:17.843832] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-09T19:29:18.202108] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:18.403984] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-09T19:29:18.423455] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T19:29:18.840307] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:29:19.196725] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-09T19:29:19.293616] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T19:29:19.298104] [INFO ] [REMOTE ] HSY: Full fetch complete (73513 records). [2025-10-09T19:29:19.298245] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-09T19:29:19.586987] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T19:29:19.691889] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-09T19:29:19.691978] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-09T19:29:19.693036] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-09T19:29:19.693106] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-09T19:29:19.694695] [DEBUG] [LOCAL ] HSY: Trimmed 73513 records to 50708 (keeping 200 days of data) [2025-10-09T19:29:20.001503] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-09T19:29:20.021700] [DEBUG] [LOCAL ] HSY: Primary data saved (50708 records). [2025-10-09T19:29:20.021791] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-09T19:29:20.022681] [INFO ] [MAIN ] Update Progress: 1062/2373 symbols completed. HSY took 39.0s. Estimated remaining: 3h 4m 16s. Rate: 7.1 symbols/min [2025-10-09T19:29:20.190694] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:20.230832] [DEBUG] [LOCAL ] HUBB: Loaded 36591 existing records from primary storage. [2025-10-09T19:29:20.231118] [INFO ] [MAIN ] HUBB: Loaded 36591 existing records. [2025-10-09T19:29:20.388143] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T19:29:20.411128] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:20.412204] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-09T19:29:20.412253] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-09T19:29:20.413026] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-09T19:29:20.413087] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-09T19:29:20.763028] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:20.796664] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-09T19:29:21.596717] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-09T19:29:21.706180] [DEBUG] [REMOTE ] HTH: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-09T19:29:21.706415] [WARN ] [REMOTE ] HTH: No data returned for month 2024-12 [2025-10-09T19:29:21.706503] [FATAL] [REMOTE ] HTH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:29:21.706549] [FATAL] [MAIN ] HTH: Failed to fetch primary data. [2025-10-09T19:29:21.706582] [WARN ] [MAIN ] HTH: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:29:21.706619] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-09T19:29:21.706709] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-09T19:29:21.706769] [INFO ] [LOCAL ] HTH: Starting deletion of derivative data. [2025-10-09T19:29:21.707045] [DEBUG] [LOCAL ] HTH: Deleted derivative data file. [2025-10-09T19:29:21.707136] [INFO ] [MAIN ] Update Progress: 1063/2373 symbols completed. HTH took 4.3s. Estimated remaining: 3h 3m 60s. Rate: 7.1 symbols/min [2025-10-09T19:29:21.915103] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:21.950843] [DEBUG] [LOCAL ] HUBS: Loaded 39673 existing records from primary storage. [2025-10-09T19:29:21.951142] [INFO ] [MAIN ] HUBS: Loaded 39673 existing records. [2025-10-09T19:29:22.137602] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:22.138097] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-09T19:29:22.138184] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-09T19:29:22.145027] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-09T19:29:22.154776] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-09T19:29:22.189812] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:29:22.401906] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-09T19:29:22.547316] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:23.196718] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-09T19:29:23.993975] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T19:29:24.002712] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-09T19:29:24.659564] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T19:29:24.796695] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-09T19:29:25.522825] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T19:29:25.596664] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-09T19:29:26.122533] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:29:26.396724] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-09T19:29:26.635288] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T19:29:27.196791] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-09T19:29:27.842278] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T19:29:27.996703] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-09T19:29:28.522432] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T19:29:28.796783] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-09T19:29:29.052523] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-09T19:29:29.610690] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-09T19:29:29.612814] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T19:29:30.396729] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-09T19:29:30.612303] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-09T19:29:30.998738] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T19:29:31.196692] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-09T19:29:31.492302] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-09T19:29:31.996727] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-09T19:29:32.346971] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T19:29:32.347621] [INFO ] [REMOTE ] HTFC: Full fetch complete (846 records). [2025-10-09T19:29:32.347741] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-09T19:29:32.526892] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-09T19:29:32.527083] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:29:32.527154] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:29:32.527228] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-09T19:29:32.527292] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-09T19:29:32.527329] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-09T19:29:32.527389] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-09T19:29:32.527472] [INFO ] [MAIN ] Update Progress: 1064/2373 symbols completed. HTFC took 26.9s. Estimated remaining: 3h 3m 54s. Rate: 7.1 symbols/min [2025-10-09T19:29:32.693465] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:32.741780] [DEBUG] [LOCAL ] HUM: Loaded 49032 existing records from primary storage. [2025-10-09T19:29:32.742081] [INFO ] [MAIN ] HUM: Loaded 49032 existing records. [2025-10-09T19:29:32.802588] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-09T19:29:32.920313] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:32.920511] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-09T19:29:32.920562] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-09T19:29:32.922263] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-09T19:29:32.922327] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-09T19:29:33.274512] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:33.596771] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-09T19:29:34.396713] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-09T19:29:34.522046] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:29:35.196710] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-09T19:29:35.372519] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:29:35.593917] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T19:29:35.996775] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-09T19:29:36.790978] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T19:29:36.798979] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-09T19:29:37.596748] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-09T19:29:37.743906] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:29:38.396682] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-09T19:29:38.592150] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T19:29:38.823625] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:29:39.196730] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-09T19:29:39.986783] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T19:29:40.000041] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-09T19:29:40.796773] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-09T19:29:40.974597] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T19:29:41.457012] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:29:41.596727] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-09T19:29:42.215351] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T19:29:42.396754] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-09T19:29:42.802441] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T19:29:43.196725] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-09T19:29:43.996688] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-09T19:29:44.225984] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T19:29:44.789704] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T19:29:44.797459] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-09T19:29:45.514027] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T19:29:45.596672] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-09T19:29:46.396769] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-09T19:29:46.795125] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T19:29:46.846437] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T19:29:47.196739] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-09T19:29:47.371771] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T19:29:47.996739] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-09T19:29:48.391079] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:29:48.395046] [INFO ] [REMOTE ] HUBS: Full fetch complete (55995 records). [2025-10-09T19:29:48.395146] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-09T19:29:48.770103] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-09T19:29:48.770188] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-09T19:29:48.771020] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-09T19:29:48.771083] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-09T19:29:48.772256] [DEBUG] [LOCAL ] HUBS: Trimmed 55995 records to 40004 (keeping 200 days of data) [2025-10-09T19:29:48.825629] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-09T19:29:49.017618] [DEBUG] [LOCAL ] HUBS: Primary data saved (40004 records). [2025-10-09T19:29:49.017791] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-09T19:29:49.017904] [INFO ] [MAIN ] Update Progress: 1065/2373 symbols completed. HUBS took 27.3s. Estimated remaining: 3h 3m 56s. Rate: 7.1 symbols/min [2025-10-09T19:29:49.228084] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:49.278278] [DEBUG] [LOCAL ] HUN: Loaded 53202 existing records from primary storage. [2025-10-09T19:29:49.278677] [INFO ] [MAIN ] HUN: Loaded 53202 existing records. [2025-10-09T19:29:49.454735] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:49.454971] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-09T19:29:49.455023] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-09T19:29:49.456294] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-09T19:29:49.456354] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-09T19:29:49.605714] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-09T19:29:49.819013] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:49.849108] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:29:50.396689] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-09T19:29:50.556500] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:29:50.936512] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T19:29:51.196793] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-09T19:29:51.860013] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:29:51.996702] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-09T19:29:52.796735] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-09T19:29:52.871404] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T19:29:53.596772] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-09T19:29:53.870312] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:29:54.368395] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T19:29:54.396704] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-09T19:29:55.196709] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-09T19:29:55.255378] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:29:55.834830] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:29:55.839110] [INFO ] [REMOTE ] HTGC: Full fetch complete (68456 records). [2025-10-09T19:29:55.839235] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-09T19:29:56.001027] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-09T19:29:56.247057] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-09T19:29:56.247136] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-09T19:29:56.248113] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-09T19:29:56.248179] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-09T19:29:56.249505] [DEBUG] [LOCAL ] HTGC: Trimmed 68456 records to 47851 (keeping 200 days of data) [2025-10-09T19:29:56.550369] [DEBUG] [LOCAL ] HTGC: Primary data saved (47851 records). [2025-10-09T19:29:56.550500] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-09T19:29:56.551587] [INFO ] [MAIN ] Update Progress: 1066/2373 symbols completed. HTGC took 45.7s. Estimated remaining: 3h 3m 46s. Rate: 7.1 symbols/min [2025-10-09T19:29:56.740014] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:56.765285] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T19:29:56.796668] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-09T19:29:56.816480] [DEBUG] [LOCAL ] HUYA: Loaded 43890 existing records from primary storage. [2025-10-09T19:29:56.816898] [INFO ] [MAIN ] HUYA: Loaded 43890 existing records. [2025-10-09T19:29:56.997469] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:56.997730] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-09T19:29:56.997785] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-09T19:29:56.998189] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-09T19:29:56.998245] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-09T19:29:57.356666] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:57.596693] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-09T19:29:57.836201] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T19:29:58.187425] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T19:29:58.396717] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-09T19:29:59.108176] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:29:59.196674] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-09T19:29:59.960132] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:29:59.996686] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-09T19:30:00.796689] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-09T19:30:01.003895] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T19:30:01.391543] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:30:01.596776] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-09T19:30:02.396759] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-09T19:30:02.506332] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:30:03.196770] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-09T19:30:03.312287] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:30:03.315608] [INFO ] [REMOTE ] HUBB: Full fetch complete (53859 records). [2025-10-09T19:30:03.315881] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-09T19:30:03.701808] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-09T19:30:03.701906] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-09T19:30:03.702707] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-09T19:30:03.702771] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-09T19:30:03.703923] [DEBUG] [LOCAL ] HUBB: Trimmed 53859 records to 36829 (keeping 200 days of data) [2025-10-09T19:30:03.942368] [DEBUG] [LOCAL ] HUBB: Primary data saved (36829 records). [2025-10-09T19:30:03.942518] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-09T19:30:03.942614] [INFO ] [MAIN ] Update Progress: 1067/2373 symbols completed. HUBB took 43.9s. Estimated remaining: 3h 3m 36s. Rate: 7.1 symbols/min [2025-10-09T19:30:04.005966] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-09T19:30:04.142052] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:30:04.145228] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:04.171868] [DEBUG] [LOCAL ] HVT: Loaded 15297 existing records from primary storage. [2025-10-09T19:30:04.172149] [INFO ] [MAIN ] HVT: Loaded 15297 existing records. [2025-10-09T19:30:04.358296] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:04.358531] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-09T19:30:04.358580] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-09T19:30:04.358828] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-09T19:30:04.358885] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-09T19:30:04.735373] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:04.776899] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:30:04.796664] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-09T19:30:05.596748] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-09T19:30:06.064420] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-09T19:30:06.068761] [INFO ] [REMOTE ] HUM: Full fetch complete (70940 records). [2025-10-09T19:30:06.068866] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-09T19:30:06.421600] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-09T19:30:06.475398] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-09T19:30:06.475740] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-09T19:30:06.477365] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-09T19:30:06.477532] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-09T19:30:06.490074] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T19:30:06.494290] [DEBUG] [LOCAL ] HUM: Trimmed 70940 records to 49359 (keeping 200 days of data) [2025-10-09T19:30:06.646908] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:30:06.858335] [DEBUG] [LOCAL ] HUM: Primary data saved (49359 records). [2025-10-09T19:30:06.858499] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-09T19:30:06.858591] [INFO ] [MAIN ] Update Progress: 1068/2373 symbols completed. HUM took 34.3s. Estimated remaining: 3h 3m 21s. Rate: 7.1 symbols/min [2025-10-09T19:30:07.032942] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:07.084559] [DEBUG] [LOCAL ] HWM: Loaded 52895 existing records from primary storage. [2025-10-09T19:30:07.084995] [INFO ] [MAIN ] HWM: Loaded 52895 existing records. [2025-10-09T19:30:07.201936] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-09T19:30:07.263082] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:07.263307] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-09T19:30:07.263356] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-09T19:30:07.263612] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-09T19:30:07.263697] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-09T19:30:07.634375] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:07.662443] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T19:30:07.996768] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-09T19:30:08.796742] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-09T19:30:08.864633] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:30:09.596692] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-09T19:30:09.786726] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T19:30:10.361972] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T19:30:10.396708] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-09T19:30:11.196763] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-09T19:30:11.332192] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T19:30:11.996699] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-09T19:30:12.056942] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:30:12.137375] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T19:30:12.796707] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-09T19:30:13.596679] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-09T19:30:13.640409] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T19:30:13.719702] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T19:30:14.396785] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-09T19:30:15.196710] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-09T19:30:15.342265] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:30:15.450328] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T19:30:15.996774] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-09T19:30:16.668974] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:30:16.796706] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-09T19:30:17.596694] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-09T19:30:17.906585] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T19:30:17.960781] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T19:30:18.396718] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-09T19:30:18.790359] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T19:30:19.022089] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T19:30:19.196766] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-09T19:30:19.996725] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-09T19:30:20.650377] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:30:20.796709] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-09T19:30:21.526953] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T19:30:21.596746] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-09T19:30:22.396757] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-09T19:30:22.466888] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:30:22.472151] [INFO ] [REMOTE ] HUN: Full fetch complete (76725 records). [2025-10-09T19:30:22.472301] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-09T19:30:22.867409] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-09T19:30:22.867492] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-09T19:30:22.868624] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-09T19:30:22.868713] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-09T19:30:22.870307] [DEBUG] [LOCAL ] HUN: Trimmed 76725 records to 53591 (keeping 200 days of data) [2025-10-09T19:30:23.196807] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-09T19:30:23.217055] [DEBUG] [LOCAL ] HUN: Primary data saved (53591 records). [2025-10-09T19:30:23.217933] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-09T19:30:23.218107] [INFO ] [MAIN ] Update Progress: 1069/2373 symbols completed. HUN took 34.2s. Estimated remaining: 3h 3m 22s. Rate: 7.1 symbols/min [2025-10-09T19:30:23.389078] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:23.431226] [DEBUG] [LOCAL ] HXL: Loaded 45893 existing records from primary storage. [2025-10-09T19:30:23.431575] [INFO ] [MAIN ] HXL: Loaded 45893 existing records. [2025-10-09T19:30:23.624528] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:23.625254] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-09T19:30:23.625319] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-09T19:30:23.625561] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-09T19:30:23.625623] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-09T19:30:23.773768] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-09T19:30:23.999479] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-09T19:30:24.006802] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T19:30:24.082489] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:24.108887] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:30:24.796713] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-09T19:30:25.340462] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T19:30:25.596679] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-09T19:30:26.011983] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T19:30:26.396722] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-09T19:30:26.972938] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T19:30:27.196702] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-09T19:30:27.223148] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T19:30:27.996764] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-09T19:30:28.617382] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T19:30:28.796684] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-09T19:30:29.196808] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:30:29.596711] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-09T19:30:30.358257] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:30:30.396684] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-09T19:30:31.196727] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-09T19:30:31.855331] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-09T19:30:31.996759] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-09T19:30:32.143363] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T19:30:32.555975] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:30:32.563530] [INFO ] [REMOTE ] HUYA: Full fetch complete (63911 records). [2025-10-09T19:30:32.564143] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-09T19:30:32.802003] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-09T19:30:32.948460] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:30:33.205494] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-09T19:30:33.205592] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-09T19:30:33.206613] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-09T19:30:33.206734] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-09T19:30:33.208250] [DEBUG] [LOCAL ] HUYA: Trimmed 63911 records to 44268 (keeping 200 days of data) [2025-10-09T19:30:33.477712] [DEBUG] [LOCAL ] HUYA: Primary data saved (44268 records). [2025-10-09T19:30:33.477839] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-09T19:30:33.478461] [INFO ] [MAIN ] Update Progress: 1070/2373 symbols completed. HUYA took 36.9s. Estimated remaining: 3h 3m 16s. Rate: 7.1 symbols/min [2025-10-09T19:30:33.601942] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-09T19:30:33.645988] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:33.659615] [DEBUG] [LOCAL ] HY: Loaded 9989 existing records from primary storage. [2025-10-09T19:30:33.659862] [INFO ] [MAIN ] HY: Loaded 9989 existing records. [2025-10-09T19:30:33.833243] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:33.833421] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-09T19:30:33.833467] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-09T19:30:33.833689] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-09T19:30:33.833746] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-09T19:30:34.183417] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:34.396667] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-09T19:30:34.558386] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T19:30:34.560584] [INFO ] [REMOTE ] HVT: Full fetch complete (23266 records). [2025-10-09T19:30:34.560735] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-09T19:30:34.955604] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-09T19:30:34.955828] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-09T19:30:34.956444] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-09T19:30:34.956525] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-09T19:30:34.982942] [DEBUG] [LOCAL ] HVT: Trimmed 23266 records to 15407 (keeping 200 days of data) [2025-10-09T19:30:34.985020] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-09T19:30:35.093890] [DEBUG] [LOCAL ] HVT: Primary data saved (15407 records). [2025-10-09T19:30:35.094020] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-09T19:30:35.094104] [INFO ] [MAIN ] Update Progress: 1071/2373 symbols completed. HVT took 31.2s. Estimated remaining: 3h 2m 60s. Rate: 7.1 symbols/min [2025-10-09T19:30:35.201179] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-09T19:30:35.253154] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T19:30:35.290311] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:35.290443] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-09T19:30:35.290499] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-09T19:30:35.290612] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-09T19:30:35.290692] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-09T19:30:35.290771] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-09T19:30:35.290828] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-09T19:30:35.658988] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:35.996774] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-09T19:30:36.693561] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T19:30:36.796694] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-09T19:30:37.546345] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T19:30:37.596677] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-09T19:30:37.712930] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T19:30:38.396751] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-09T19:30:39.004422] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T19:30:39.165522] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:30:39.196701] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-09T19:30:39.996699] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-09T19:30:40.024824] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T19:30:40.796767] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-09T19:30:41.121827] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-09T19:30:41.571878] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T19:30:41.596716] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-09T19:30:42.396729] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-09T19:30:42.631765] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-09T19:30:43.196721] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-09T19:30:43.247202] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T19:30:43.996799] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-09T19:30:44.796690] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-09T19:30:45.084073] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T19:30:45.269221] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T19:30:45.596705] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-09T19:30:45.643969] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T19:30:46.396725] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-09T19:30:47.199429] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-09T19:30:47.210192] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T19:30:47.214606] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:30:47.534603] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-09T19:30:47.996743] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-09T19:30:48.728052] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T19:30:48.796707] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-09T19:30:49.593628] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T19:30:49.596719] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-09T19:30:50.396725] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-09T19:30:50.451252] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T19:30:51.196777] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-09T19:30:51.996749] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-09T19:30:52.181593] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T19:30:52.208870] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T19:30:52.212724] [INFO ] [REMOTE ] HXL: Full fetch complete (66222 records). [2025-10-09T19:30:52.212821] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-09T19:30:52.295519] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-09T19:30:52.621202] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-09T19:30:52.621346] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-09T19:30:52.622345] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-09T19:30:52.622410] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-09T19:30:52.623794] [DEBUG] [LOCAL ] HXL: Trimmed 66222 records to 46202 (keeping 200 days of data) [2025-10-09T19:30:52.799464] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-09T19:30:52.905382] [DEBUG] [LOCAL ] HXL: Primary data saved (46202 records). [2025-10-09T19:30:52.905517] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-09T19:30:52.905615] [INFO ] [MAIN ] Update Progress: 1072/2373 symbols completed. HXL took 29.7s. Estimated remaining: 3h 3m 2s. Rate: 7.1 symbols/min [2025-10-09T19:30:53.072722] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:53.072883] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-09T19:30:53.072938] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-09T19:30:53.073069] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-09T19:30:53.073117] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-09T19:30:53.073168] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-09T19:30:53.073206] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-09T19:30:53.425940] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:53.596735] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-09T19:30:53.644118] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T19:30:54.396725] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-09T19:30:55.059158] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T19:30:55.060552] [INFO ] [REMOTE ] HY: Full fetch complete (15047 records). [2025-10-09T19:30:55.060624] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-09T19:30:55.211599] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-09T19:30:55.482059] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T19:30:55.491681] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-09T19:30:55.491766] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-09T19:30:55.496204] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-09T19:30:55.496400] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-09T19:30:55.496969] [INFO ] [REMOTE ] HWM: Full fetch complete (76539 records). [2025-10-09T19:30:55.497267] [DEBUG] [LOCAL ] HY: Trimmed 15047 records to 10036 (keeping 200 days of data) [2025-10-09T19:30:55.497386] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-09T19:30:56.000627] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T19:30:56.000191] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-09T19:30:56.006445] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-09T19:30:56.008777] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-09T19:30:56.009092] [DEBUG] [LOCAL ] HY: Primary data saved (10036 records). [2025-10-09T19:30:56.011238] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-09T19:30:56.011582] [INFO ] [MAIN ] HY: Full history saved. [2025-10-09T19:30:56.011494] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-09T19:30:56.011820] [INFO ] [MAIN ] Update Progress: 1073/2373 symbols completed. HY took 22.5s. Estimated remaining: 3h 2m 48s. Rate: 7.1 symbols/min [2025-10-09T19:30:56.104040] [DEBUG] [LOCAL ] HWM: Trimmed 76539 records to 53247 (keeping 200 days of data) [2025-10-09T19:30:56.279619] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:56.294111] [DEBUG] [LOCAL ] HYI: Loaded 9914 existing records from primary storage. [2025-10-09T19:30:56.295346] [INFO ] [MAIN ] HYI: Loaded 9914 existing records. [2025-10-09T19:30:56.362710] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T19:30:56.489011] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:56.489993] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-09T19:30:56.490297] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-09T19:30:56.491138] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-09T19:30:56.491464] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-09T19:30:56.801767] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-09T19:30:56.894676] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:57.113600] [DEBUG] [LOCAL ] HWM: Primary data saved (53247 records). [2025-10-09T19:30:57.113763] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-09T19:30:57.113857] [INFO ] [MAIN ] Update Progress: 1074/2373 symbols completed. HWM took 50.3s. Estimated remaining: 3h 2m 30s. Rate: 7.1 symbols/min [2025-10-09T19:30:57.191808] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T19:30:57.289277] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:57.289464] [DEBUG] [LOCAL ] HYT: No existing data file found in primary storage. [2025-10-09T19:30:57.289502] [WARN ] [MAIN ] HYT: No existing data found, performing full refresh instead. [2025-10-09T19:30:57.289618] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-09T19:30:57.289693] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-09T19:30:57.289752] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-09T19:30:57.289786] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-09T19:30:57.615546] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-09T19:30:57.657393] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:58.195054] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T19:30:58.396751] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-09T19:30:59.196747] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-09T19:30:59.743010] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:30:59.755912] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T19:30:59.996795] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-09T19:31:00.796750] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-09T19:31:00.807384] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T19:31:01.596784] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-09T19:31:01.935328] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T19:31:02.077181] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:31:02.396761] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-09T19:31:03.196751] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-09T19:31:03.454450] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T19:31:03.518096] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T19:31:03.996792] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-09T19:31:04.796699] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-09T19:31:05.012303] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-09T19:31:05.360889] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:31:05.596718] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-09T19:31:05.857969] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-09T19:31:06.396726] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-09T19:31:07.134576] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T19:31:07.196691] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-09T19:31:07.589787] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-09T19:31:07.996720] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-09T19:31:08.796731] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-09T19:31:09.282877] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T19:31:09.457566] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T19:31:09.596724] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-09T19:31:10.396685] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-09T19:31:10.423733] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T19:31:10.708087] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-09T19:31:11.196768] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-09T19:31:11.610187] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-09T19:31:11.996746] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-09T19:31:12.282935] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-09T19:31:12.796763] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-09T19:31:13.596741] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-09T19:31:14.160910] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T19:31:14.183331] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:31:14.396737] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-09T19:31:14.727071] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-09T19:31:15.196730] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-09T19:31:15.460357] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-09T19:31:15.996754] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-09T19:31:16.796722] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-09T19:31:16.829572] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T19:31:17.596724] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-09T19:31:17.841609] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-09T19:31:18.209122] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:31:18.396732] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-09T19:31:19.196731] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-09T19:31:19.595179] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T19:31:19.595869] [INFO ] [REMOTE ] HYBX: Full fetch complete (728 records). [2025-10-09T19:31:19.595936] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-09T19:31:19.776309] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-09T19:31:19.776512] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:31:19.776770] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:31:19.776847] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-09T19:31:19.776933] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-09T19:31:19.777121] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-09T19:31:19.777210] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-09T19:31:19.777295] [INFO ] [MAIN ] Update Progress: 1075/2373 symbols completed. HYBX took 26.9s. Estimated remaining: 3h 2m 39s. Rate: 7.1 symbols/min [2025-10-09T19:31:19.951055] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T19:31:19.976559] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:19.990331] [DEBUG] [LOCAL ] HYTR: Loaded 3113 existing records from primary storage. [2025-10-09T19:31:19.990511] [INFO ] [MAIN ] HYTR: Loaded 3113 existing records. [2025-10-09T19:31:20.001770] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-09T19:31:20.170275] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:20.170483] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-09T19:31:20.170563] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-09T19:31:20.170891] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-09T19:31:20.170950] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-09T19:31:20.538043] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:20.542183] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T19:31:20.542793] [INFO ] [REMOTE ] HYAC: Full fetch complete (869 records). [2025-10-09T19:31:20.542861] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-09T19:31:20.719027] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-09T19:31:20.719229] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:31:20.719301] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:31:20.719350] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-09T19:31:20.719406] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-09T19:31:20.719440] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-09T19:31:20.719479] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-09T19:31:20.719535] [INFO ] [MAIN ] Update Progress: 1076/2373 symbols completed. HYAC took 45.6s. Estimated remaining: 3h 2m 22s. Rate: 7.1 symbols/min [2025-10-09T19:31:20.801977] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-09T19:31:20.888792] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:20.918388] [DEBUG] [LOCAL ] HZO: Loaded 29050 existing records from primary storage. [2025-10-09T19:31:20.918696] [INFO ] [MAIN ] HZO: Loaded 29050 existing records. [2025-10-09T19:31:21.097604] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:21.097860] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-09T19:31:21.097907] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-09T19:31:21.098161] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-09T19:31:21.098218] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-09T19:31:21.465843] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:21.527590] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T19:31:21.596735] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-09T19:31:22.396684] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-09T19:31:22.773069] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T19:31:23.194395] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T19:31:23.196688] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-09T19:31:23.728129] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T19:31:23.996721] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-09T19:31:24.796722] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-09T19:31:25.543542] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:31:25.596673] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-09T19:31:25.956278] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T19:31:26.396763] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-09T19:31:26.667862] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-09T19:31:27.013260] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T19:31:27.016513] [INFO ] [REMOTE ] HYT: Full fetch complete (47723 records). [2025-10-09T19:31:27.016597] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-09T19:31:27.203184] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-09T19:31:27.399532] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-09T19:31:27.399611] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-09T19:31:27.400355] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-09T19:31:27.400415] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-09T19:31:27.401450] [DEBUG] [LOCAL ] HYT: Trimmed 47723 records to 33742 (keeping 200 days of data) [2025-10-09T19:31:27.607054] [DEBUG] [LOCAL ] HYT: Primary data saved (33742 records). [2025-10-09T19:31:27.607212] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-09T19:31:27.607289] [INFO ] [MAIN ] Update Progress: 1077/2373 symbols completed. HYT took 30.5s. Estimated remaining: 3h 2m 11s. Rate: 7.1 symbols/min [2025-10-09T19:31:27.996693] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-09T19:31:28.068515] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T19:31:28.452444] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T19:31:28.796711] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-09T19:31:29.338233] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:31:29.596775] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-09T19:31:30.396697] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-09T19:31:30.788302] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T19:31:30.929510] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T19:31:31.196728] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-09T19:31:31.626832] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T19:31:31.996696] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-09T19:31:32.572406] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T19:31:32.796739] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-09T19:31:33.267041] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T19:31:33.596716] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-09T19:31:34.339836] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T19:31:34.396753] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-09T19:31:35.196732] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-09T19:31:35.209027] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T19:31:35.210942] [INFO ] [REMOTE ] HYI: Full fetch complete (13948 records). [2025-10-09T19:31:35.211014] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-09T19:31:35.648534] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T19:31:35.648719] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-09T19:31:35.650259] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-09T19:31:35.650582] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-09T19:31:35.650623] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-09T19:31:35.651157] [DEBUG] [LOCAL ] HYI: Trimmed 13948 records to 9984 (keeping 200 days of data) [2025-10-09T19:31:35.714965] [DEBUG] [LOCAL ] HYI: Primary data saved (9984 records). [2025-10-09T19:31:35.715106] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-09T19:31:35.715193] [INFO ] [MAIN ] Update Progress: 1078/2373 symbols completed. HYI took 39.7s. Estimated remaining: 3h 2m 2s. Rate: 7.1 symbols/min [2025-10-09T19:31:35.996727] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-09T19:31:36.796722] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-09T19:31:37.240284] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T19:31:37.254963] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T19:31:37.596792] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-09T19:31:38.396759] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-09T19:31:38.850801] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:31:38.888397] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:31:39.196772] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-09T19:31:39.996758] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-09T19:31:40.369345] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T19:31:40.627466] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T19:31:40.628850] [INFO ] [REMOTE ] HYTR: Full fetch complete (4611 records). [2025-10-09T19:31:40.628943] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-09T19:31:40.801997] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-09T19:31:41.177933] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-09T19:31:41.178032] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-09T19:31:41.178252] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-09T19:31:41.178298] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-09T19:31:41.178985] [DEBUG] [LOCAL ] HYTR: Trimmed 4611 records to 3138 (keeping 200 days of data) [2025-10-09T19:31:41.211822] [DEBUG] [LOCAL ] HYTR: Primary data saved (3138 records). [2025-10-09T19:31:41.212025] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-09T19:31:41.212183] [INFO ] [MAIN ] Update Progress: 1079/2373 symbols completed. HYTR took 21.4s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-09T19:31:42.047881] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:31:42.053928] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-09T19:31:43.359128] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T19:31:43.365920] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-09T19:31:44.543004] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:31:44.549242] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-09T19:31:45.738316] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T19:31:45.745555] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-09T19:31:46.862526] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:31:46.865334] [INFO ] [REMOTE ] HZO: Full fetch complete (41067 records). [2025-10-09T19:31:46.865433] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-09T19:31:47.258510] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-09T19:31:47.258593] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-09T19:31:47.259323] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-09T19:31:47.259389] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-09T19:31:47.260301] [DEBUG] [LOCAL ] HZO: Trimmed 41067 records to 29215 (keeping 200 days of data) [2025-10-09T19:31:47.431881] [DEBUG] [LOCAL ] HZO: Primary data saved (29215 records). [2025-10-09T19:31:47.432028] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-09T19:31:47.432115] [INFO ] [MAIN ] Update Progress: 1080/2373 symbols completed. HZO took 26.7s. Estimated remaining: 3h 1m 39s. Rate: 7.1 symbols/min [2025-10-09T19:31:48.103134] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:48.103945] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:48.150502] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:48.183184] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:48.190362] [DEBUG] [LOCAL ] IAE: Loaded 6125 existing records from primary storage. [2025-10-09T19:31:48.190795] [INFO ] [MAIN ] IAE: Loaded 6125 existing records. [2025-10-09T19:31:48.409294] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:48.437145] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-09T19:31:48.452197] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-09T19:31:48.453429] [DEBUG] [LOCAL ] IAG: Loaded 53473 existing records from primary storage. [2025-10-09T19:31:48.453692] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-09T19:31:48.454047] [INFO ] [MAIN ] IAG: Loaded 53473 existing records. [2025-10-09T19:31:48.453903] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-09T19:31:48.693703] [DEBUG] [LOCAL ] IBM: Loaded 53631 existing records from primary storage. [2025-10-09T19:31:48.692982] [DEBUG] [LOCAL ] IBN: Loaded 52860 existing records from primary storage. [2025-10-09T19:31:48.709928] [INFO ] [MAIN ] IBM: Loaded 53631 existing records. [2025-10-09T19:31:48.720565] [INFO ] [MAIN ] IBN: Loaded 52860 existing records. [2025-10-09T19:31:48.998344] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:49.058927] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-09T19:31:49.129600] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-09T19:31:49.183273] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-09T19:31:49.326064] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:49.334602] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-09T19:31:49.280238] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-09T19:31:49.355747] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-09T19:31:49.329218] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:49.399192] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-09T19:31:49.409321] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-09T19:31:49.429621] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-09T19:31:49.409404] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-09T19:31:49.435771] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:49.436164] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-09T19:31:49.499517] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-09T19:31:49.517840] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-09T19:31:50.319859] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:31:50.346807] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-09T19:31:50.465490] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:50.503383] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:50.544617] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-09T19:31:50.536936] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-09T19:31:50.565361] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:50.567014] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-09T19:31:51.074190] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T19:31:51.076524] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-09T19:31:51.695778] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T19:31:51.698096] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-09T19:31:51.945040] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:31:51.956001] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-09T19:31:52.226189] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:31:52.237055] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-09T19:31:52.256489] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T19:31:52.258847] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-09T19:31:52.341950] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T19:31:52.796721] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-09T19:31:52.867892] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T19:31:53.349001] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:31:53.596708] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-09T19:31:53.690927] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T19:31:53.990017] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T19:31:54.396686] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-09T19:31:54.604229] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T19:31:55.024395] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T19:31:55.196670] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-09T19:31:55.852758] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T19:31:55.996711] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-09T19:31:56.796734] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-09T19:31:57.596748] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-09T19:31:57.804190] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T19:31:58.103094] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T19:31:58.396746] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-09T19:31:58.604173] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T19:31:59.190403] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:31:59.196669] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-09T19:31:59.802123] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T19:31:59.803372] [INFO ] [REMOTE ] IAE: Full fetch complete (8815 records). [2025-10-09T19:31:59.803471] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-09T19:32:00.001937] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-09T19:32:00.158612] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-09T19:32:00.158730] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-09T19:32:00.158984] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-09T19:32:00.159025] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-09T19:32:00.159446] [DEBUG] [LOCAL ] IAE: Trimmed 8815 records to 6203 (keeping 200 days of data) [2025-10-09T19:32:00.196459] [DEBUG] [LOCAL ] IAE: Primary data saved (6203 records). [2025-10-09T19:32:00.196576] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-09T19:32:00.196678] [INFO ] [MAIN ] Update Progress: 1081/2373 symbols completed. IAE took 12.8s. Estimated remaining: 3h 1m 36s. Rate: 7.1 symbols/min [2025-10-09T19:32:00.366078] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:00.397296] [DEBUG] [LOCAL ] IBP: Loaded 28771 existing records from primary storage. [2025-10-09T19:32:00.397570] [INFO ] [MAIN ] IBP: Loaded 28771 existing records. [2025-10-09T19:32:00.568202] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:00.568476] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-09T19:32:00.568540] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-09T19:32:00.569008] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-09T19:32:00.569069] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-09T19:32:00.801936] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-09T19:32:00.914058] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:01.596768] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-09T19:32:02.265549] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-09T19:32:02.396744] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-09T19:32:02.543031] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:32:02.907632] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:32:03.196733] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-09T19:32:03.996730] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-09T19:32:04.459945] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T19:32:04.796710] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-09T19:32:05.116969] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T19:32:05.596765] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-09T19:32:05.750568] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T19:32:06.396692] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-09T19:32:06.601930] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:32:06.886671] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T19:32:07.196790] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-09T19:32:07.996701] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-09T19:32:08.207155] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T19:32:08.311926] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T19:32:08.796714] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-09T19:32:09.596785] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-09T19:32:09.877820] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T19:32:09.930040] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T19:32:10.396779] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-09T19:32:11.196747] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-09T19:32:11.381194] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T19:32:11.970991] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-09T19:32:11.996700] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-09T19:32:12.673818] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T19:32:12.796710] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-09T19:32:13.596731] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-09T19:32:14.396698] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-09T19:32:14.499693] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-09T19:32:14.556076] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T19:32:15.196683] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-09T19:32:15.429488] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T19:32:15.609292] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:32:15.996814] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-09T19:32:16.796715] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-09T19:32:17.144786] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T19:32:17.344532] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T19:32:17.596720] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-09T19:32:18.396831] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-09T19:32:19.204561] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-09T19:32:19.225303] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T19:32:19.283219] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-09T19:32:19.324478] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T19:32:19.996795] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-09T19:32:20.796690] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-09T19:32:21.083391] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T19:32:21.596733] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-09T19:32:22.396751] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-09T19:32:22.448069] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-09T19:32:22.981841] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-09T19:32:22.986614] [INFO ] [REMOTE ] IAG: Full fetch complete (77278 records). [2025-10-09T19:32:22.986816] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-09T19:32:23.197684] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-09T19:32:23.426900] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-09T19:32:23.427112] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-09T19:32:23.428343] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-09T19:32:23.428446] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-09T19:32:23.460678] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T19:32:23.471339] [DEBUG] [LOCAL ] IAG: Trimmed 77278 records to 53863 (keeping 200 days of data) [2025-10-09T19:32:23.589102] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:32:23.847621] [DEBUG] [LOCAL ] IAG: Primary data saved (53863 records). [2025-10-09T19:32:23.847818] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-09T19:32:23.848403] [INFO ] [MAIN ] Update Progress: 1082/2373 symbols completed. IAG took 36.4s. Estimated remaining: 3h 1m 46s. Rate: 7.1 symbols/min [2025-10-09T19:32:24.011828] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-09T19:32:24.014757] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:24.052107] [DEBUG] [LOCAL ] IBTA: Loaded 37145 existing records from primary storage. [2025-10-09T19:32:24.052428] [INFO ] [MAIN ] IBTA: Loaded 37145 existing records. [2025-10-09T19:32:24.227767] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:24.227992] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-09T19:32:24.228041] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-09T19:32:24.228313] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-09T19:32:24.228370] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-09T19:32:24.612797] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:24.796702] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-09T19:32:25.141996] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:32:25.596683] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-09T19:32:25.758314] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-09T19:32:25.762988] [INFO ] [REMOTE ] IBM: Full fetch complete (77623 records). [2025-10-09T19:32:25.763108] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-09T19:32:26.156630] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-09T19:32:26.156746] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-09T19:32:26.157841] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-09T19:32:26.157905] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-09T19:32:26.159525] [DEBUG] [LOCAL ] IBM: Trimmed 77623 records to 54021 (keeping 200 days of data) [2025-10-09T19:32:26.396827] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-09T19:32:26.522285] [DEBUG] [LOCAL ] IBM: Primary data saved (54021 records). [2025-10-09T19:32:26.522509] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-09T19:32:26.522767] [INFO ] [MAIN ] Update Progress: 1083/2373 symbols completed. IBM took 39.1s. Estimated remaining: 3h 1m 31s. Rate: 7.1 symbols/min [2025-10-09T19:32:26.676556] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T19:32:26.752680] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:26.805053] [DEBUG] [LOCAL ] ICE: Loaded 53012 existing records from primary storage. [2025-10-09T19:32:26.805402] [INFO ] [MAIN ] ICE: Loaded 53012 existing records. [2025-10-09T19:32:26.918013] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T19:32:26.966789] [INFO ] [REMOTE ] IBP: Full fetch complete (41167 records). [2025-10-09T19:32:26.992196] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-09T19:32:26.997264] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:26.997571] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-09T19:32:27.029224] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-09T19:32:27.066129] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-09T19:32:27.072237] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-09T19:32:27.207553] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-09T19:32:27.733086] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-09T19:32:27.738692] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-09T19:32:27.776678] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:27.770900] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-09T19:32:27.777101] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-09T19:32:27.778809] [DEBUG] [LOCAL ] IBP: Trimmed 41167 records to 29034 (keeping 200 days of data) [2025-10-09T19:32:27.795971] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T19:32:27.988432] [DEBUG] [LOCAL ] IBP: Primary data saved (29034 records). [2025-10-09T19:32:27.988598] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-09T19:32:27.988707] [INFO ] [MAIN ] Update Progress: 1084/2373 symbols completed. IBP took 27.8s. Estimated remaining: 3h 1m 14s. Rate: 7.1 symbols/min [2025-10-09T19:32:28.001836] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-09T19:32:28.157084] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:28.192974] [DEBUG] [LOCAL ] ICL: Loaded 38375 existing records from primary storage. [2025-10-09T19:32:28.193276] [INFO ] [MAIN ] ICL: Loaded 38375 existing records. [2025-10-09T19:32:28.363005] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:28.363208] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-09T19:32:28.363261] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-09T19:32:28.363516] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-09T19:32:28.363574] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-09T19:32:28.707621] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:28.796665] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-09T19:32:28.972958] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:32:29.596743] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-09T19:32:29.891524] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T19:32:30.227808] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:32:30.396738] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-09T19:32:31.101122] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T19:32:31.196680] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-09T19:32:31.213119] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T19:32:31.996738] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-09T19:32:32.796791] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-09T19:32:32.940142] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:32:33.596785] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-09T19:32:33.679865] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T19:32:33.686798] [INFO ] [REMOTE ] IBN: Full fetch complete (76330 records). [2025-10-09T19:32:33.687006] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-09T19:32:34.168012] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-09T19:32:34.168217] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-09T19:32:34.169241] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-09T19:32:34.169325] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-09T19:32:34.170889] [DEBUG] [LOCAL ] IBN: Trimmed 76330 records to 53246 (keeping 200 days of data) [2025-10-09T19:32:34.284886] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T19:32:34.418466] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-09T19:32:34.531208] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T19:32:34.555232] [DEBUG] [LOCAL ] IBN: Primary data saved (53246 records). [2025-10-09T19:32:34.555366] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-09T19:32:34.556295] [INFO ] [MAIN ] Update Progress: 1085/2373 symbols completed. IBN took 47.1s. Estimated remaining: 3h 1m 3s. Rate: 7.1 symbols/min [2025-10-09T19:32:34.727095] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:34.765099] [DEBUG] [LOCAL ] IDA: Loaded 32579 existing records from primary storage. [2025-10-09T19:32:34.765398] [INFO ] [MAIN ] IDA: Loaded 32579 existing records. [2025-10-09T19:32:34.948249] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:34.948461] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-09T19:32:34.948509] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-09T19:32:34.948763] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-09T19:32:34.948855] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-09T19:32:35.201869] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-09T19:32:35.308476] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:35.964759] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T19:32:35.996702] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-09T19:32:36.796735] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-09T19:32:36.980133] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T19:32:37.596694] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-09T19:32:37.793662] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T19:32:38.218495] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T19:32:38.396752] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-09T19:32:38.835907] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:32:39.196769] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-09T19:32:39.996753] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-09T19:32:40.305627] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T19:32:40.378721] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T19:32:40.796729] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-09T19:32:41.138770] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T19:32:41.596717] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-09T19:32:42.052730] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T19:32:42.396746] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-09T19:32:43.205875] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-09T19:32:43.224319] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:32:43.283399] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T19:32:43.996755] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-09T19:32:44.347476] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T19:32:44.796813] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-09T19:32:45.058591] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T19:32:45.596742] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-09T19:32:46.396704] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-09T19:32:46.709069] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:32:46.740561] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T19:32:47.196719] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-09T19:32:47.887808] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:32:47.996692] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-09T19:32:48.302873] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T19:32:48.796733] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-09T19:32:49.402138] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:32:49.596684] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-09T19:32:50.041714] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T19:32:50.396713] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-09T19:32:50.801331] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T19:32:51.196743] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-09T19:32:51.996685] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-09T19:32:52.195552] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T19:32:52.619996] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T19:32:52.796715] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-09T19:32:53.323049] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T19:32:53.596713] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-09T19:32:54.213314] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T19:32:54.396737] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-09T19:32:54.984070] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:32:55.196760] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-09T19:32:55.680060] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T19:32:55.684096] [INFO ] [REMOTE ] IBTA: Full fetch complete (50908 records). [2025-10-09T19:32:55.684478] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-09T19:32:56.001849] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-09T19:32:56.075226] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-09T19:32:56.075321] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-09T19:32:56.076267] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-09T19:32:56.076335] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-09T19:32:56.077493] [DEBUG] [LOCAL ] IBTA: Trimmed 50908 records to 37355 (keeping 200 days of data) [2025-10-09T19:32:56.292392] [DEBUG] [LOCAL ] IBTA: Primary data saved (37355 records). [2025-10-09T19:32:56.292543] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-09T19:32:56.293400] [INFO ] [MAIN ] Update Progress: 1086/2373 symbols completed. IBTA took 32.4s. Estimated remaining: 3h 1m 10s. Rate: 7.1 symbols/min [2025-10-09T19:32:56.403244] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T19:32:56.452036] [INFO ] [REMOTE ] ICL: Full fetch complete (55883 records). [2025-10-09T19:32:56.473768] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-09T19:32:56.476997] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:56.582285] [DEBUG] [LOCAL ] IDE: Loaded 8882 existing records from primary storage. [2025-10-09T19:32:56.605838] [INFO ] [MAIN ] IDE: Loaded 8882 existing records. [2025-10-09T19:32:56.797496] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-09T19:32:57.003998] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:57.055118] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-09T19:32:57.055801] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-09T19:32:57.066741] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-09T19:32:57.082436] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-09T19:32:57.250390] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-09T19:32:57.258404] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-09T19:32:57.262314] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-09T19:32:57.262813] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-09T19:32:57.324367] [DEBUG] [LOCAL ] ICL: Trimmed 55883 records to 38682 (keeping 200 days of data) [2025-10-09T19:32:57.611218] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:57.612368] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-09T19:32:57.761428] [DEBUG] [LOCAL ] ICL: Primary data saved (38682 records). [2025-10-09T19:32:57.761692] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-09T19:32:57.761844] [INFO ] [MAIN ] Update Progress: 1087/2373 symbols completed. ICL took 29.8s. Estimated remaining: 3h 0m 54s. Rate: 7.1 symbols/min [2025-10-09T19:32:57.954505] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:57.989548] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T19:32:58.015808] [DEBUG] [LOCAL ] IDT: Loaded 18163 existing records from primary storage. [2025-10-09T19:32:58.016077] [INFO ] [MAIN ] IDT: Loaded 18163 existing records. [2025-10-09T19:32:58.218102] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:58.218827] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-09T19:32:58.218936] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-09T19:32:58.219210] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-09T19:32:58.219273] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-09T19:32:58.441178] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-09T19:32:58.472405] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T19:32:58.589393] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T19:32:58.682999] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:59.196753] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-09T19:32:59.996708] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-09T19:33:00.050682] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T19:33:00.284829] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T19:33:00.796711] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-09T19:33:01.037614] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T19:33:01.578038] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T19:33:01.596686] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-09T19:33:02.366891] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:33:02.396703] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-09T19:33:03.016100] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T19:33:03.196732] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-09T19:33:03.996754] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-09T19:33:04.708674] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T19:33:04.796694] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-09T19:33:04.996637] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T19:33:05.584543] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T19:33:05.596689] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-09T19:33:06.396718] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-09T19:33:07.196749] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-09T19:33:07.227065] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T19:33:07.314430] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:33:07.319065] [INFO ] [REMOTE ] ICE: Full fetch complete (76764 records). [2025-10-09T19:33:07.319188] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-09T19:33:07.717972] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-09T19:33:07.718063] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-09T19:33:07.719150] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-09T19:33:07.719227] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-09T19:33:07.720790] [DEBUG] [LOCAL ] ICE: Trimmed 76764 records to 53402 (keeping 200 days of data) [2025-10-09T19:33:08.009225] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-09T19:33:08.062492] [DEBUG] [LOCAL ] ICE: Primary data saved (53402 records). [2025-10-09T19:33:08.062709] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-09T19:33:08.063917] [INFO ] [MAIN ] Update Progress: 1088/2373 symbols completed. ICE took 41.5s. Estimated remaining: 3h 0m 48s. Rate: 7.1 symbols/min [2025-10-09T19:33:08.234459] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:08.275258] [DEBUG] [LOCAL ] IEX: Loaded 38329 existing records from primary storage. [2025-10-09T19:33:08.275569] [INFO ] [MAIN ] IEX: Loaded 38329 existing records. [2025-10-09T19:33:08.454112] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:08.454344] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-09T19:33:08.454390] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-09T19:33:08.454600] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-09T19:33:08.454686] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-09T19:33:08.743693] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T19:33:08.803250] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-09T19:33:08.836215] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:08.860545] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T19:33:09.596776] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-09T19:33:09.649121] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T19:33:10.396755] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-09T19:33:10.826043] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:33:11.129150] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T19:33:11.196699] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-09T19:33:11.996693] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-09T19:33:12.447459] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:33:12.796796] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-09T19:33:12.824711] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T19:33:13.596771] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-09T19:33:13.894895] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T19:33:14.396725] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-09T19:33:14.903819] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:33:14.906757] [INFO ] [REMOTE ] IDA: Full fetch complete (45012 records). [2025-10-09T19:33:14.906841] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-09T19:33:15.197166] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-09T19:33:15.289465] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-09T19:33:15.289544] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-09T19:33:15.290295] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-09T19:33:15.290357] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-09T19:33:15.291686] [DEBUG] [LOCAL ] IDA: Trimmed 45012 records to 32825 (keeping 200 days of data) [2025-10-09T19:33:15.391427] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T19:33:15.509378] [DEBUG] [LOCAL ] IDA: Primary data saved (32825 records). [2025-10-09T19:33:15.509572] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-09T19:33:15.510298] [INFO ] [MAIN ] Update Progress: 1089/2373 symbols completed. IDA took 41.0s. Estimated remaining: 3h 0m 38s. Rate: 7.1 symbols/min [2025-10-09T19:33:15.674312] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:15.726769] [DEBUG] [LOCAL ] IFF: Loaded 51052 existing records from primary storage. [2025-10-09T19:33:15.727071] [INFO ] [MAIN ] IFF: Loaded 51052 existing records. [2025-10-09T19:33:15.899525] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:15.899783] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-09T19:33:15.899831] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-09T19:33:15.900149] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-09T19:33:15.900205] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-09T19:33:16.004129] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-09T19:33:16.322150] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:16.342981] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T19:33:16.796710] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-09T19:33:16.810598] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T19:33:17.596763] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-09T19:33:17.849544] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T19:33:18.341489] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T19:33:18.342913] [INFO ] [REMOTE ] IDE: Full fetch complete (12612 records). [2025-10-09T19:33:18.342989] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-09T19:33:18.401976] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-09T19:33:18.711851] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-09T19:33:18.711931] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-09T19:33:18.712214] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-09T19:33:18.712252] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-09T19:33:18.712729] [DEBUG] [LOCAL ] IDE: Trimmed 12612 records to 8984 (keeping 200 days of data) [2025-10-09T19:33:18.768796] [DEBUG] [LOCAL ] IDE: Primary data saved (8984 records). [2025-10-09T19:33:18.768930] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-09T19:33:18.769015] [INFO ] [MAIN ] Update Progress: 1090/2373 symbols completed. IDE took 22.5s. Estimated remaining: 3h 0m 23s. Rate: 7.1 symbols/min [2025-10-09T19:33:18.932152] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:18.952083] [DEBUG] [LOCAL ] IFN: Loaded 18362 existing records from primary storage. [2025-10-09T19:33:18.952328] [INFO ] [MAIN ] IFN: Loaded 18362 existing records. [2025-10-09T19:33:19.130305] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:19.130538] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-09T19:33:19.130584] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-09T19:33:19.130941] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-09T19:33:19.130999] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-09T19:33:19.202605] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-09T19:33:19.491164] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:19.579723] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T19:33:19.996686] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-09T19:33:20.243287] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:33:20.796721] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-09T19:33:21.084639] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T19:33:21.596767] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-09T19:33:21.927104] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:33:22.396755] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-09T19:33:22.674617] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T19:33:23.196738] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-09T19:33:23.698587] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T19:33:23.996807] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-09T19:33:24.632834] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T19:33:24.676230] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:33:24.796772] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-09T19:33:25.596712] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-09T19:33:25.730063] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:33:26.396810] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-09T19:33:27.083048] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T19:33:27.196775] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-09T19:33:27.525318] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:33:27.996735] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-09T19:33:28.679805] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T19:33:28.793209] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:33:28.801655] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-09T19:33:29.596724] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-09T19:33:30.396708] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-09T19:33:30.490138] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:33:30.646081] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T19:33:31.196718] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-09T19:33:31.578944] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T19:33:31.996765] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-09T19:33:32.554215] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:33:32.796700] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-09T19:33:33.077364] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T19:33:33.596691] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-09T19:33:33.821204] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:33:34.396724] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-09T19:33:34.885113] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T19:33:34.887587] [INFO ] [REMOTE ] IDT: Full fetch complete (23433 records). [2025-10-09T19:33:34.887713] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-09T19:33:35.204455] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-09T19:33:35.249903] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-09T19:33:35.249979] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-09T19:33:35.250478] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-09T19:33:35.250517] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-09T19:33:35.251194] [DEBUG] [LOCAL ] IDT: Trimmed 23433 records to 18343 (keeping 200 days of data) [2025-10-09T19:33:35.370457] [DEBUG] [LOCAL ] IDT: Primary data saved (18343 records). [2025-10-09T19:33:35.370594] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-09T19:33:35.370708] [INFO ] [MAIN ] Update Progress: 1091/2373 symbols completed. IDT took 37.6s. Estimated remaining: 3h 0m 25s. Rate: 7.1 symbols/min [2025-10-09T19:33:35.537896] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:35.559777] [DEBUG] [LOCAL ] IFS: Loaded 22937 existing records from primary storage. [2025-10-09T19:33:35.560028] [INFO ] [MAIN ] IFS: Loaded 22937 existing records. [2025-10-09T19:33:35.739451] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:35.739798] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-09T19:33:35.739951] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-09T19:33:35.740206] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-09T19:33:35.740284] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-09T19:33:36.001722] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-09T19:33:36.106439] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:36.134809] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T19:33:36.211139] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T19:33:36.796725] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-09T19:33:37.460800] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:33:37.596750] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-09T19:33:37.945235] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T19:33:38.167210] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T19:33:38.396778] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-09T19:33:39.196759] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-09T19:33:39.849586] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T19:33:39.869877] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T19:33:39.996668] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-09T19:33:40.796737] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-09T19:33:41.601905] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-09T19:33:41.618166] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T19:33:41.941335] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:33:42.396769] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-09T19:33:42.492040] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T19:33:43.196726] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-09T19:33:43.949530] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T19:33:43.972331] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T19:33:43.996673] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-09T19:33:44.796724] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-09T19:33:45.596771] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-09T19:33:45.720770] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T19:33:46.072411] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T19:33:46.396749] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-09T19:33:46.863293] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:33:47.196735] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-09T19:33:47.923411] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:33:47.928345] [INFO ] [REMOTE ] IEX: Full fetch complete (53428 records). [2025-10-09T19:33:47.928556] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-09T19:33:48.001849] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-09T19:33:48.346702] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-09T19:33:48.364266] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-09T19:33:48.367366] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T19:33:48.366255] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-09T19:33:48.374057] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-09T19:33:48.376464] [DEBUG] [LOCAL ] IEX: Trimmed 53428 records to 38578 (keeping 200 days of data) [2025-10-09T19:33:48.620821] [DEBUG] [LOCAL ] IEX: Primary data saved (38578 records). [2025-10-09T19:33:48.620967] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-09T19:33:48.621049] [INFO ] [MAIN ] Update Progress: 1092/2373 symbols completed. IEX took 40.6s. Estimated remaining: 3h 0m 22s. Rate: 7.1 symbols/min [2025-10-09T19:33:48.787865] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:48.800238] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-09T19:33:48.800762] [DEBUG] [LOCAL ] IGA: Loaded 10005 existing records from primary storage. [2025-10-09T19:33:48.801362] [INFO ] [MAIN ] IGA: Loaded 10005 existing records. [2025-10-09T19:33:48.976228] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:48.976459] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-09T19:33:48.976508] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-09T19:33:48.976721] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-09T19:33:48.976779] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-09T19:33:49.085278] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T19:33:49.108810] [INFO ] [REMOTE ] IFN: Full fetch complete (28776 records). [2025-10-09T19:33:49.132786] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-09T19:33:49.616490] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-09T19:33:49.635190] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:49.764279] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-09T19:33:49.764390] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-09T19:33:49.765237] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-09T19:33:49.765307] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-09T19:33:49.766497] [DEBUG] [LOCAL ] IFN: Trimmed 28776 records to 18452 (keeping 200 days of data) [2025-10-09T19:33:49.884810] [DEBUG] [LOCAL ] IFN: Primary data saved (18452 records). [2025-10-09T19:33:49.884974] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-09T19:33:49.885064] [INFO ] [MAIN ] Update Progress: 1093/2373 symbols completed. IFN took 31.1s. Estimated remaining: 3h 0m 5s. Rate: 7.1 symbols/min [2025-10-09T19:33:50.067952] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:50.085700] [DEBUG] [LOCAL ] IGD: Loaded 19218 existing records from primary storage. [2025-10-09T19:33:50.085936] [INFO ] [MAIN ] IGD: Loaded 19218 existing records. [2025-10-09T19:33:50.267406] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:50.267753] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-09T19:33:50.267813] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-09T19:33:50.268026] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-09T19:33:50.268088] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-09T19:33:50.409887] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-09T19:33:50.668339] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:50.725445] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T19:33:50.723698] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T19:33:51.073250] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T19:33:51.196731] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-09T19:33:51.996739] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-09T19:33:52.727126] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:33:52.762944] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:33:52.796675] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-09T19:33:53.226233] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T19:33:53.596726] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-09T19:33:54.396737] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-09T19:33:54.491106] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T19:33:55.128830] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T19:33:55.196694] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-09T19:33:55.996689] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-09T19:33:56.159101] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T19:33:56.796756] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-09T19:33:56.834088] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T19:33:57.596717] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-09T19:33:58.298724] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T19:33:58.396689] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-09T19:33:58.628791] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:33:59.070274] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T19:33:59.196724] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-09T19:33:59.996688] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-09T19:34:00.289351] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:34:00.796732] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-09T19:34:01.235281] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T19:34:01.596689] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-09T19:34:01.619120] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T19:34:02.396706] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-09T19:34:02.613992] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T19:34:03.102749] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:34:03.196695] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-09T19:34:03.996711] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-09T19:34:04.042997] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:34:04.796782] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-09T19:34:05.332715] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:34:05.337581] [INFO ] [REMOTE ] IFF: Full fetch complete (73199 records). [2025-10-09T19:34:05.337774] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-09T19:34:05.603879] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-09T19:34:05.740998] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-09T19:34:05.741088] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-09T19:34:05.742107] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-09T19:34:05.742173] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-09T19:34:05.743727] [DEBUG] [LOCAL ] IFF: Trimmed 73199 records to 51422 (keeping 200 days of data) [2025-10-09T19:34:05.984045] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:34:05.987902] [INFO ] [REMOTE ] IFS: Full fetch complete (31718 records). [2025-10-09T19:34:05.989120] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-09T19:34:06.396745] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-09T19:34:06.397427] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-09T19:34:06.398422] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-09T19:34:06.398521] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-09T19:34:06.398816] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-09T19:34:06.402452] [DEBUG] [LOCAL ] IFS: Trimmed 31718 records to 23061 (keeping 200 days of data) [2025-10-09T19:34:06.647535] [DEBUG] [LOCAL ] IFF: Primary data saved (51422 records). [2025-10-09T19:34:06.648563] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-09T19:34:06.649704] [INFO ] [MAIN ] Update Progress: 1094/2373 symbols completed. IFF took 51.1s. Estimated remaining: 3h 0m 6s. Rate: 7.1 symbols/min [2025-10-09T19:34:06.715731] [DEBUG] [LOCAL ] IFS: Primary data saved (23061 records). [2025-10-09T19:34:06.745438] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-09T19:34:06.753868] [INFO ] [MAIN ] Update Progress: 1095/2373 symbols completed. IFS took 31.4s. Estimated remaining: 2h 59m 48s. Rate: 7.1 symbols/min [2025-10-09T19:34:06.946231] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:07.024550] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:07.029731] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T19:34:07.038909] [DEBUG] [LOCAL ] IGI: Loaded 3787 existing records from primary storage. [2025-10-09T19:34:07.039189] [INFO ] [MAIN ] IGI: Loaded 3787 existing records. [2025-10-09T19:34:07.205446] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-09T19:34:07.253121] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T19:34:07.252707] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:07.257061] [DEBUG] [LOCAL ] IGR: Loaded 30399 existing records from primary storage. [2025-10-09T19:34:07.257531] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-09T19:34:07.258216] [INFO ] [MAIN ] IGR: Loaded 30399 existing records. [2025-10-09T19:34:07.258272] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-09T19:34:07.320688] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-09T19:34:07.331936] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-09T19:34:07.574287] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:07.592666] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-09T19:34:07.608484] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-09T19:34:07.679967] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-09T19:34:07.700925] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-09T19:34:07.913201] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:08.007783] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-09T19:34:08.156696] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:08.151621] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T19:34:08.796731] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-09T19:34:08.903953] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T19:34:09.596769] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-09T19:34:10.048637] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T19:34:10.357482] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T19:34:10.396669] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-09T19:34:11.196815] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-09T19:34:11.729675] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:34:11.980115] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:34:11.996666] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-09T19:34:12.796735] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-09T19:34:12.857085] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T19:34:12.858576] [INFO ] [REMOTE ] IGA: Full fetch complete (13904 records). [2025-10-09T19:34:12.858677] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-09T19:34:13.211736] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-09T19:34:13.211893] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-09T19:34:13.212222] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-09T19:34:13.212283] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-09T19:34:13.212822] [DEBUG] [LOCAL ] IGA: Trimmed 13904 records to 10089 (keeping 200 days of data) [2025-10-09T19:34:13.274848] [DEBUG] [LOCAL ] IGA: Primary data saved (10089 records). [2025-10-09T19:34:13.274980] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-09T19:34:13.275105] [INFO ] [MAIN ] Update Progress: 1096/2373 symbols completed. IGA took 24.7s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-09T19:34:13.439028] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:13.444338] [DEBUG] [LOCAL ] IH: Loaded 2853 existing records from primary storage. [2025-10-09T19:34:13.444498] [INFO ] [MAIN ] IH: Loaded 2853 existing records. [2025-10-09T19:34:13.613534] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-09T19:34:13.618861] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:13.619071] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-09T19:34:13.619167] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-09T19:34:13.619350] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-09T19:34:13.619408] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-09T19:34:13.971406] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:14.026280] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T19:34:14.151164] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:34:14.396723] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-09T19:34:15.196754] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-09T19:34:15.623946] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T19:34:15.807945] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T19:34:15.996747] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-09T19:34:16.717615] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:34:16.796734] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-09T19:34:17.398073] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T19:34:17.596729] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-09T19:34:18.396732] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-09T19:34:19.002990] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T19:34:19.196762] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-09T19:34:19.524334] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T19:34:19.720135] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T19:34:19.996761] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-09T19:34:20.472539] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T19:34:20.796778] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-09T19:34:21.317839] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T19:34:21.596746] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-09T19:34:22.396688] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-09T19:34:22.619224] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T19:34:23.196717] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-09T19:34:23.627494] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T19:34:23.947254] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T19:34:23.996705] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-09T19:34:24.461258] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T19:34:24.796751] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-09T19:34:25.596711] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-09T19:34:25.929428] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T19:34:26.396729] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-09T19:34:26.435816] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T19:34:26.846296] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T19:34:27.196710] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-09T19:34:27.996773] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-09T19:34:28.550877] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T19:34:28.796691] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-09T19:34:28.897586] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:34:29.399975] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T19:34:29.596720] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-09T19:34:30.396713] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-09T19:34:30.850278] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T19:34:30.955838] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T19:34:31.196719] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-09T19:34:31.996762] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-09T19:34:32.417380] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T19:34:32.796724] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-09T19:34:33.309403] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T19:34:33.438910] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T19:34:33.596779] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-09T19:34:34.396716] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-09T19:34:34.680589] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T19:34:35.196681] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-09T19:34:35.242146] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T19:34:35.244628] [INFO ] [REMOTE ] IGR: Full fetch complete (45155 records). [2025-10-09T19:34:35.244745] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-09T19:34:35.625399] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-09T19:34:35.625484] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-09T19:34:35.626248] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-09T19:34:35.626318] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-09T19:34:35.627379] [DEBUG] [LOCAL ] IGR: Trimmed 45155 records to 30591 (keeping 200 days of data) [2025-10-09T19:34:35.809410] [DEBUG] [LOCAL ] IGR: Primary data saved (30591 records). [2025-10-09T19:34:35.809549] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-09T19:34:35.809632] [INFO ] [MAIN ] Update Progress: 1097/2373 symbols completed. IGR took 29.1s. Estimated remaining: 2h 59m 45s. Rate: 7.1 symbols/min [2025-10-09T19:34:35.992304] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:35.998412] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-09T19:34:36.003983] [DEBUG] [LOCAL ] IHD: Loaded 7064 existing records from primary storage. [2025-10-09T19:34:36.004214] [INFO ] [MAIN ] IHD: Loaded 7064 existing records. [2025-10-09T19:34:36.191935] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:36.197495] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T19:34:36.199827] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-09T19:34:36.199961] [INFO ] [REMOTE ] IGD: Full fetch complete (29767 records). [2025-10-09T19:34:36.199895] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-09T19:34:36.200155] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-09T19:34:36.200284] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-09T19:34:36.200389] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-09T19:34:36.808776] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-09T19:34:36.834393] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T19:34:36.940827] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-09T19:34:36.948496] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-09T19:34:36.957866] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-09T19:34:36.967310] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-09T19:34:36.971052] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:36.971917] [DEBUG] [LOCAL ] IGD: Trimmed 29767 records to 19396 (keeping 200 days of data) [2025-10-09T19:34:37.086465] [DEBUG] [LOCAL ] IGD: Primary data saved (19396 records). [2025-10-09T19:34:37.086615] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-09T19:34:37.086734] [INFO ] [MAIN ] Update Progress: 1098/2373 symbols completed. IGD took 47.2s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-09T19:34:37.264169] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:37.295487] [DEBUG] [LOCAL ] IHG: Loaded 24221 existing records from primary storage. [2025-10-09T19:34:37.296117] [INFO ] [MAIN ] IHG: Loaded 24221 existing records. [2025-10-09T19:34:37.481821] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T19:34:37.487481] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:37.490278] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-09T19:34:37.490343] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-09T19:34:37.490602] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-09T19:34:37.490691] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-09T19:34:37.601832] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-09T19:34:37.868284] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:38.216700] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T19:34:38.217832] [INFO ] [REMOTE ] IGI: Full fetch complete (5387 records). [2025-10-09T19:34:38.217900] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-09T19:34:38.401912] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-09T19:34:38.584825] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-09T19:34:38.584959] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-09T19:34:38.585132] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-09T19:34:38.585173] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-09T19:34:38.585546] [DEBUG] [LOCAL ] IGI: Trimmed 5387 records to 3844 (keeping 200 days of data) [2025-10-09T19:34:38.609441] [DEBUG] [LOCAL ] IGI: Primary data saved (3844 records). [2025-10-09T19:34:38.609539] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-09T19:34:38.609660] [INFO ] [MAIN ] Update Progress: 1099/2373 symbols completed. IGI took 32.0s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-10-09T19:34:38.772593] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:38.811032] [DEBUG] [LOCAL ] IHS: Loaded 38329 existing records from primary storage. [2025-10-09T19:34:38.811314] [INFO ] [MAIN ] IHS: Loaded 38329 existing records. [2025-10-09T19:34:38.983008] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:38.983249] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-09T19:34:38.983296] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-09T19:34:38.983547] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-09T19:34:38.983604] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-09T19:34:39.210467] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-09T19:34:39.337704] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:39.431769] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:34:39.834493] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T19:34:39.996769] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-09T19:34:40.796739] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-09T19:34:41.033998] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T19:34:41.568634] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:34:41.596686] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-09T19:34:42.396693] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-09T19:34:42.678758] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T19:34:43.052413] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T19:34:43.196741] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-09T19:34:43.996692] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-09T19:34:44.200078] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:34:44.421015] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T19:34:44.796728] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-09T19:34:45.408879] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T19:34:45.596706] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-09T19:34:46.396730] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-09T19:34:46.996551] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T19:34:47.196750] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-09T19:34:47.293722] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T19:34:47.968430] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:34:47.996669] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-09T19:34:48.674394] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T19:34:48.796744] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-09T19:34:49.596716] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-09T19:34:50.197225] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:34:50.396734] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-09T19:34:50.787366] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T19:34:51.196714] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-09T19:34:51.655245] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T19:34:51.718269] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-09T19:34:51.996790] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-09T19:34:52.693479] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T19:34:52.796772] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-09T19:34:53.539185] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T19:34:53.596773] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-09T19:34:54.396732] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-09T19:34:54.717354] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T19:34:54.867250] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T19:34:55.196760] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-09T19:34:55.709226] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T19:34:55.710070] [INFO ] [REMOTE ] IH: Full fetch complete (4969 records). [2025-10-09T19:34:55.710138] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-09T19:34:56.002184] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-09T19:34:56.084779] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-09T19:34:56.084855] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-09T19:34:56.085017] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-09T19:34:56.085057] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-09T19:34:56.085425] [DEBUG] [LOCAL ] IH: Trimmed 4969 records to 2870 (keeping 200 days of data) [2025-10-09T19:34:56.101933] [DEBUG] [LOCAL ] IH: Primary data saved (2870 records). [2025-10-09T19:34:56.101999] [INFO ] [MAIN ] IH: Full history saved. [2025-10-09T19:34:56.102069] [INFO ] [MAIN ] Update Progress: 1100/2373 symbols completed. IH took 42.8s. Estimated remaining: 2h 59m 14s. Rate: 7.1 symbols/min [2025-10-09T19:34:56.278087] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:56.286790] [DEBUG] [LOCAL ] IIF: Loaded 5659 existing records from primary storage. [2025-10-09T19:34:56.287008] [INFO ] [MAIN ] IIF: Loaded 5659 existing records. [2025-10-09T19:34:56.468350] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:56.468607] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-09T19:34:56.468697] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-09T19:34:56.468895] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-09T19:34:56.468954] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-09T19:34:56.804545] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-09T19:34:56.835631] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:57.252053] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T19:34:57.596703] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-09T19:34:57.932078] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:34:58.371112] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T19:34:58.396698] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-09T19:34:59.142671] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T19:34:59.144052] [INFO ] [REMOTE ] IHD: Full fetch complete (11910 records). [2025-10-09T19:34:59.144122] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-09T19:34:59.205725] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-09T19:34:59.508497] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-09T19:34:59.508578] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-09T19:34:59.508922] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-09T19:34:59.508999] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-09T19:34:59.509464] [DEBUG] [LOCAL ] IHD: Trimmed 11910 records to 7145 (keeping 200 days of data) [2025-10-09T19:34:59.550967] [DEBUG] [LOCAL ] IHD: Primary data saved (7145 records). [2025-10-09T19:34:59.551062] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-09T19:34:59.551144] [INFO ] [MAIN ] Update Progress: 1101/2373 symbols completed. IHD took 23.7s. Estimated remaining: 2h 58m 60s. Rate: 7.1 symbols/min [2025-10-09T19:34:59.718706] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:59.735815] [DEBUG] [LOCAL ] IIIN: Loaded 16149 existing records from primary storage. [2025-10-09T19:34:59.736065] [INFO ] [MAIN ] IIIN: Loaded 16149 existing records. [2025-10-09T19:34:59.911318] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:59.911518] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-09T19:34:59.911567] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-09T19:34:59.911803] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-09T19:34:59.911861] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-09T19:35:00.001819] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-09T19:35:00.053989] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T19:35:00.310905] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:00.796772] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-09T19:35:01.517151] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:35:01.596747] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-09T19:35:02.060706] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:35:02.355328] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T19:35:02.396685] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-09T19:35:03.196759] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-09T19:35:03.642427] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:35:03.996776] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-09T19:35:04.343397] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T19:35:04.652150] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T19:35:04.796715] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-09T19:35:05.596741] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-09T19:35:05.884734] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:35:06.377136] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:35:06.396759] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-09T19:35:07.196772] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-09T19:35:07.942792] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:35:07.996674] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-09T19:35:08.302739] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T19:35:08.304958] [INFO ] [REMOTE ] IHG: Full fetch complete (33743 records). [2025-10-09T19:35:08.305047] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-09T19:35:08.671004] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-09T19:35:08.671080] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-09T19:35:08.671716] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-09T19:35:08.671777] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-09T19:35:08.672490] [DEBUG] [LOCAL ] IHG: Trimmed 33743 records to 24344 (keeping 200 days of data) [2025-10-09T19:35:08.797421] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-09T19:35:08.843529] [DEBUG] [LOCAL ] IHG: Primary data saved (24344 records). [2025-10-09T19:35:08.843701] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-09T19:35:08.843805] [INFO ] [MAIN ] Update Progress: 1102/2373 symbols completed. IHG took 31.8s. Estimated remaining: 2h 58m 52s. Rate: 7.1 symbols/min [2025-10-09T19:35:09.011494] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:09.028094] [DEBUG] [LOCAL ] IIM: Loaded 15846 existing records from primary storage. [2025-10-09T19:35:09.028336] [INFO ] [MAIN ] IIM: Loaded 15846 existing records. [2025-10-09T19:35:09.211758] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:09.212228] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-09T19:35:09.212322] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-09T19:35:09.212569] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-09T19:35:09.212628] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-09T19:35:09.425187] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:35:09.499960] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T19:35:09.596820] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-09T19:35:09.617798] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:10.396801] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-09T19:35:10.708504] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T19:35:10.910933] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T19:35:11.196777] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-09T19:35:11.996696] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-09T19:35:12.052928] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:35:12.644870] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T19:35:12.796718] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-09T19:35:13.596768] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-09T19:35:14.350878] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:35:14.375735] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T19:35:14.396666] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-09T19:35:15.196796] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-09T19:35:15.902974] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T19:35:15.996766] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-09T19:35:16.586496] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:35:16.640969] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T19:35:16.796690] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-09T19:35:17.252368] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T19:35:17.253221] [INFO ] [REMOTE ] IIF: Full fetch complete (9169 records). [2025-10-09T19:35:17.253289] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-09T19:35:17.606869] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-09T19:35:17.615293] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-09T19:35:17.615350] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-09T19:35:17.615569] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-09T19:35:17.615608] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-09T19:35:17.616095] [DEBUG] [LOCAL ] IIF: Trimmed 9169 records to 5676 (keeping 200 days of data) [2025-10-09T19:35:17.650866] [DEBUG] [LOCAL ] IIF: Primary data saved (5676 records). [2025-10-09T19:35:17.650979] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-09T19:35:17.651059] [INFO ] [MAIN ] Update Progress: 1103/2373 symbols completed. IIF took 21.5s. Estimated remaining: 2h 58m 44s. Rate: 7.1 symbols/min [2025-10-09T19:35:17.816898] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:17.851159] [DEBUG] [LOCAL ] IIPR: Loaded 29456 existing records from primary storage. [2025-10-09T19:35:17.851423] [INFO ] [MAIN ] IIPR: Loaded 29456 existing records. [2025-10-09T19:35:18.024762] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:18.025018] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-09T19:35:18.025066] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-09T19:35:18.025285] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-09T19:35:18.025345] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-09T19:35:18.385885] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:18.396685] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-09T19:35:18.970525] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:35:19.196759] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-09T19:35:19.455102] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:35:19.996825] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-09T19:35:20.552452] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:35:20.555482] [INFO ] [REMOTE ] IHS: Full fetch complete (51443 records). [2025-10-09T19:35:20.555598] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-09T19:35:20.805914] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-09T19:35:20.933350] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T19:35:20.963209] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-09T19:35:20.963354] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-09T19:35:20.965694] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-09T19:35:20.965775] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-09T19:35:20.966844] [DEBUG] [LOCAL ] IHS: Trimmed 51443 records to 38498 (keeping 200 days of data) [2025-10-09T19:35:21.185536] [DEBUG] [LOCAL ] IHS: Primary data saved (38498 records). [2025-10-09T19:35:21.185711] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-09T19:35:21.186927] [INFO ] [MAIN ] Update Progress: 1104/2373 symbols completed. IHS took 42.6s. Estimated remaining: 2h 58m 30s. Rate: 7.1 symbols/min [2025-10-09T19:35:21.352688] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:21.402296] [DEBUG] [LOCAL ] IMAX: Loaded 42877 existing records from primary storage. [2025-10-09T19:35:21.402632] [INFO ] [MAIN ] IMAX: Loaded 42877 existing records. [2025-10-09T19:35:21.578685] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:21.578936] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-09T19:35:21.578986] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-09T19:35:21.579276] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-09T19:35:21.579335] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-09T19:35:21.608999] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-09T19:35:21.902176] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:35:21.963913] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:22.358120] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T19:35:22.396686] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-09T19:35:23.196761] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-09T19:35:23.416817] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:35:23.996693] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-09T19:35:24.177923] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T19:35:24.796683] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-09T19:35:25.172513] [DEBUG] [REMOTE ] IIIN: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-09T19:35:25.172878] [WARN ] [REMOTE ] IIIN: No data returned for month 2025-06 [2025-10-09T19:35:25.172980] [FATAL] [REMOTE ] IIIN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:35:25.173063] [FATAL] [MAIN ] IIIN: Failed to fetch primary data. [2025-10-09T19:35:25.173125] [WARN ] [MAIN ] IIIN: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:35:25.173197] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-09T19:35:25.173275] [DEBUG] [LOCAL ] IIIN: No primary data file found to delete. [2025-10-09T19:35:25.173331] [INFO ] [LOCAL ] IIIN: Starting deletion of derivative data. [2025-10-09T19:35:25.173945] [DEBUG] [LOCAL ] IIIN: Deleted derivative data file. [2025-10-09T19:35:25.174060] [INFO ] [MAIN ] Update Progress: 1105/2373 symbols completed. IIIN took 25.6s. Estimated remaining: 2h 58m 17s. Rate: 7.1 symbols/min [2025-10-09T19:35:25.365418] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:25.366849] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T19:35:25.422929] [DEBUG] [LOCAL ] INFA: Loaded 49319 existing records from primary storage. [2025-10-09T19:35:25.423300] [INFO ] [MAIN ] INFA: Loaded 49319 existing records. [2025-10-09T19:35:25.600045] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-09T19:35:25.599897] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:25.600533] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-09T19:35:25.601514] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-09T19:35:25.601819] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-09T19:35:25.601878] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-09T19:35:25.948639] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:26.396787] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-09T19:35:26.977969] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T19:35:27.196781] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-09T19:35:27.682574] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:35:27.996785] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-09T19:35:28.796742] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-09T19:35:28.876609] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:35:29.384312] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T19:35:29.587419] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T19:35:29.596671] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-09T19:35:30.396758] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-09T19:35:30.719376] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T19:35:31.196726] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-09T19:35:31.938813] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:35:31.996715] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-09T19:35:32.436193] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T19:35:32.796725] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-09T19:35:33.543801] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T19:35:33.596671] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-09T19:35:33.962772] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:35:34.396727] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-09T19:35:35.196756] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-09T19:35:35.333093] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:35:35.397116] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T19:35:35.996742] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-09T19:35:36.545741] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:35:36.796719] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-09T19:35:36.981450] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:35:37.596724] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-09T19:35:38.303137] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:35:38.377620] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:35:38.396676] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-09T19:35:39.196724] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-09T19:35:39.889096] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T19:35:39.996684] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-09T19:35:40.796686] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-09T19:35:40.986276] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T19:35:41.592264] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:35:41.601910] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-09T19:35:41.703741] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:35:42.396747] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-09T19:35:43.138338] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:35:43.159009] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T19:35:43.196675] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-09T19:35:43.892529] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T19:35:43.996672] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-09T19:35:44.796758] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-09T19:35:45.596735] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-09T19:35:45.874417] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T19:35:45.923228] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T19:35:46.396709] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-09T19:35:46.688523] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:35:47.060909] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T19:35:47.062862] [INFO ] [REMOTE ] IIM: Full fetch complete (25373 records). [2025-10-09T19:35:47.062936] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-09T19:35:47.203826] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-09T19:35:47.442794] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-09T19:35:47.442876] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-09T19:35:47.443394] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-09T19:35:47.443433] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-09T19:35:47.444160] [DEBUG] [LOCAL ] IIM: Trimmed 25373 records to 15957 (keeping 200 days of data) [2025-10-09T19:35:47.542887] [DEBUG] [LOCAL ] IIM: Primary data saved (15957 records). [2025-10-09T19:35:47.543031] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-09T19:35:47.543119] [INFO ] [MAIN ] Update Progress: 1106/2373 symbols completed. IIM took 38.7s. Estimated remaining: 2h 58m 24s. Rate: 7.1 symbols/min [2025-10-09T19:35:47.719544] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:47.772500] [DEBUG] [LOCAL ] INFY: Loaded 53594 existing records from primary storage. [2025-10-09T19:35:47.772850] [INFO ] [MAIN ] INFY: Loaded 53594 existing records. [2025-10-09T19:35:47.961613] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:47.961838] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-09T19:35:47.961885] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-09T19:35:47.962111] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-09T19:35:47.962195] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-09T19:35:48.003470] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-09T19:35:48.318747] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:48.671634] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T19:35:48.674660] [INFO ] [REMOTE ] IIPR: Full fetch complete (44746 records). [2025-10-09T19:35:48.674762] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-09T19:35:48.801824] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-09T19:35:49.082062] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-09T19:35:49.082134] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-09T19:35:49.082868] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-09T19:35:49.082931] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-09T19:35:49.083999] [DEBUG] [LOCAL ] IIPR: Trimmed 44746 records to 29611 (keeping 200 days of data) [2025-10-09T19:35:49.278373] [DEBUG] [LOCAL ] IIPR: Primary data saved (29611 records). [2025-10-09T19:35:49.278523] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-09T19:35:49.278611] [INFO ] [MAIN ] Update Progress: 1107/2373 symbols completed. IIPR took 31.6s. Estimated remaining: 2h 58m 8s. Rate: 7.1 symbols/min [2025-10-09T19:35:49.456127] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:49.514751] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T19:35:49.540968] [DEBUG] [LOCAL ] ING: Loaded 50706 existing records from primary storage. [2025-10-09T19:35:49.541348] [INFO ] [MAIN ] ING: Loaded 50706 existing records. [2025-10-09T19:35:49.605750] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-09T19:35:49.724878] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:49.725102] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-09T19:35:49.725156] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-09T19:35:49.725334] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-09T19:35:49.725374] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-09T19:35:50.102081] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:50.396767] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-09T19:35:50.895699] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T19:35:50.975146] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:35:51.196716] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-09T19:35:51.996684] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-09T19:35:52.099100] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T19:35:52.541733] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T19:35:52.796717] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-09T19:35:53.346106] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:35:53.596771] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-09T19:35:54.345277] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:35:54.396760] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-09T19:35:54.985888] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:35:55.196789] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-09T19:35:55.996701] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-09T19:35:56.030537] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:35:56.562711] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T19:35:56.796721] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-09T19:35:57.279122] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T19:35:57.596757] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-09T19:35:58.396715] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-09T19:35:58.651796] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T19:35:59.066831] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T19:35:59.196772] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-09T19:35:59.705048] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T19:35:59.996743] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-09T19:36:00.796756] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-09T19:36:00.879397] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T19:36:01.334302] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:36:01.338125] [INFO ] [REMOTE ] IMAX: Full fetch complete (60112 records). [2025-10-09T19:36:01.338229] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-09T19:36:01.601934] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-09T19:36:01.758567] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-09T19:36:01.758693] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-09T19:36:01.759618] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-09T19:36:01.759694] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-09T19:36:01.760928] [DEBUG] [LOCAL ] IMAX: Trimmed 60112 records to 43236 (keeping 200 days of data) [2025-10-09T19:36:02.048733] [DEBUG] [LOCAL ] IMAX: Primary data saved (43236 records). [2025-10-09T19:36:02.048915] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-09T19:36:02.049039] [INFO ] [MAIN ] Update Progress: 1108/2373 symbols completed. IMAX took 40.9s. Estimated remaining: 2h 58m 5s. Rate: 7.1 symbols/min [2025-10-09T19:36:02.229423] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:02.261671] [DEBUG] [LOCAL ] INGM: Loaded 28664 existing records from primary storage. [2025-10-09T19:36:02.261958] [INFO ] [MAIN ] INGM: Loaded 28664 existing records. [2025-10-09T19:36:02.412468] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-09T19:36:02.442975] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:02.444372] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-09T19:36:02.444458] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-09T19:36:02.444804] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-09T19:36:02.444916] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-09T19:36:02.651791] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T19:36:02.845541] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:03.145413] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T19:36:03.196749] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-09T19:36:03.966928] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:36:03.996668] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-09T19:36:04.607014] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:36:04.796707] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-09T19:36:05.504039] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T19:36:05.596695] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-09T19:36:06.051368] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:36:06.396782] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-09T19:36:07.196728] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-09T19:36:07.533668] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T19:36:07.560945] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T19:36:07.996759] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-09T19:36:08.796741] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-09T19:36:08.998534] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T19:36:09.093578] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T19:36:09.596723] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-09T19:36:09.818687] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T19:36:09.822324] [INFO ] [REMOTE ] INFA: Full fetch complete (70865 records). [2025-10-09T19:36:09.822453] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-09T19:36:10.230683] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-09T19:36:10.230774] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-09T19:36:10.232371] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-09T19:36:10.232446] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-09T19:36:10.233919] [DEBUG] [LOCAL ] INFA: Trimmed 70865 records to 49552 (keeping 200 days of data) [2025-10-09T19:36:10.406367] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-09T19:36:10.534587] [DEBUG] [LOCAL ] INFA: Primary data saved (49552 records). [2025-10-09T19:36:10.534758] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-09T19:36:10.534866] [INFO ] [MAIN ] Update Progress: 1109/2373 symbols completed. INFA took 45.4s. Estimated remaining: 2h 57m 56s. Rate: 7.1 symbols/min [2025-10-09T19:36:10.706635] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:10.740026] [DEBUG] [LOCAL ] INGR: Loaded 33594 existing records from primary storage. [2025-10-09T19:36:10.740309] [INFO ] [MAIN ] INGR: Loaded 33594 existing records. [2025-10-09T19:36:10.915513] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:10.915834] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-09T19:36:10.915897] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-09T19:36:10.916103] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-09T19:36:10.916160] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-09T19:36:11.212181] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-09T19:36:11.266706] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:11.490588] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T19:36:11.820786] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T19:36:11.996748] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-09T19:36:12.684773] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T19:36:12.796747] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-09T19:36:13.338488] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T19:36:13.596746] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-09T19:36:14.396675] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-09T19:36:14.439965] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:36:14.795755] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T19:36:15.196782] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-09T19:36:15.873876] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:36:15.996669] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-09T19:36:16.299461] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T19:36:16.796802] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-09T19:36:17.153287] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T19:36:17.596742] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-09T19:36:18.396690] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-09T19:36:18.450126] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T19:36:18.680964] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T19:36:19.196739] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-09T19:36:19.927837] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:36:19.996809] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-09T19:36:20.796712] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-09T19:36:20.839956] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T19:36:21.191376] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:36:21.596718] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-09T19:36:21.796735] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T19:36:22.396749] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-09T19:36:23.196706] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-09T19:36:23.324307] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T19:36:23.325458] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T19:36:23.996718] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-09T19:36:24.796708] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-09T19:36:25.063922] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T19:36:25.075488] [INFO ] [REMOTE ] INFY: Full fetch complete (77545 records). [2025-10-09T19:36:25.076269] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T19:36:25.077354] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-09T19:36:25.079575] [INFO ] [REMOTE ] INGM: Full fetch complete (42142 records). [2025-10-09T19:36:25.079694] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-09T19:36:25.612797] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-09T19:36:25.924366] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-09T19:36:25.924232] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-09T19:36:25.924477] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-09T19:36:25.925008] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-09T19:36:25.925155] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-09T19:36:25.925092] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-09T19:36:25.926492] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-09T19:36:25.926894] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-09T19:36:25.927812] [DEBUG] [LOCAL ] INGM: Trimmed 42142 records to 28891 (keeping 200 days of data) [2025-10-09T19:36:25.929065] [DEBUG] [LOCAL ] INFY: Trimmed 77545 records to 53984 (keeping 200 days of data) [2025-10-09T19:36:26.336995] [DEBUG] [LOCAL ] INGM: Primary data saved (28891 records). [2025-10-09T19:36:26.337984] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-09T19:36:26.338449] [INFO ] [MAIN ] Update Progress: 1110/2373 symbols completed. INGM took 24.3s. Estimated remaining: 2h 57m 56s. Rate: 7.1 symbols/min [2025-10-09T19:36:26.528268] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:26.565702] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:36:26.580066] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-09T19:36:26.680795] [DEBUG] [LOCAL ] INN: Loaded 41765 existing records from primary storage. [2025-10-09T19:36:26.681998] [INFO ] [MAIN ] INN: Loaded 41765 existing records. [2025-10-09T19:36:26.873677] [DEBUG] [LOCAL ] INFY: Primary data saved (53984 records). [2025-10-09T19:36:26.895508] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:26.895896] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-09T19:36:26.895779] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-09T19:36:26.896705] [INFO ] [MAIN ] Update Progress: 1111/2373 symbols completed. INFY took 39.4s. Estimated remaining: 2h 57m 39s. Rate: 7.1 symbols/min [2025-10-09T19:36:26.908791] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-09T19:36:26.953723] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-09T19:36:26.967884] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-09T19:36:27.259491] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:27.302037] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-09T19:36:27.325716] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-09T19:36:27.373783] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-09T19:36:27.385965] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-09T19:36:27.388250] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T19:36:27.406095] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-09T19:36:27.422876] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-09T19:36:27.422991] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-09T19:36:27.488090] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:27.862524] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:27.996693] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-09T19:36:28.248509] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T19:36:28.343071] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:36:28.796730] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-09T19:36:29.372876] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T19:36:29.596733] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-09T19:36:29.790841] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:36:29.791161] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-09T19:36:29.791273] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:36:29.791334] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-09T19:36:29.791371] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:36:29.791410] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-09T19:36:29.791466] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-09T19:36:29.791502] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-09T19:36:29.791543] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-09T19:36:29.791590] [INFO ] [MAIN ] Update Progress: 1112/2373 symbols completed. INR took 2.9s. Estimated remaining: 2h 57m 24s. Rate: 7.1 symbols/min [2025-10-09T19:36:29.980470] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:30.019445] [DEBUG] [LOCAL ] INSP: Loaded 37638 existing records from primary storage. [2025-10-09T19:36:30.019811] [INFO ] [MAIN ] INSP: Loaded 37638 existing records. [2025-10-09T19:36:30.204723] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:30.205087] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-09T19:36:30.205197] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-09T19:36:30.215684] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-09T19:36:30.215804] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-09T19:36:30.247891] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:36:30.311143] [INFO ] [REMOTE ] ING: Full fetch complete (73611 records). [2025-10-09T19:36:30.321305] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-09T19:36:30.401838] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-09T19:36:30.914444] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:31.012358] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-09T19:36:31.012451] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-09T19:36:31.013467] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-09T19:36:31.013538] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-09T19:36:31.015174] [DEBUG] [LOCAL ] ING: Trimmed 73611 records to 51085 (keeping 200 days of data) [2025-10-09T19:36:31.198457] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-09T19:36:31.334419] [DEBUG] [LOCAL ] ING: Primary data saved (51085 records). [2025-10-09T19:36:31.334566] [INFO ] [MAIN ] ING: Full history saved. [2025-10-09T19:36:31.334672] [INFO ] [MAIN ] Update Progress: 1113/2373 symbols completed. ING took 42.1s. Estimated remaining: 2h 57m 8s. Rate: 7.1 symbols/min [2025-10-09T19:36:31.507513] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:31.543989] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:36:31.594565] [DEBUG] [LOCAL ] INSW: Loaded 39755 existing records from primary storage. [2025-10-09T19:36:31.595546] [INFO ] [MAIN ] INSW: Loaded 39755 existing records. [2025-10-09T19:36:31.787907] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:31.788248] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-09T19:36:31.788314] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-09T19:36:31.788603] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-09T19:36:31.788701] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-09T19:36:32.005634] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-09T19:36:32.194694] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:32.474685] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:36:32.796726] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-09T19:36:33.349533] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T19:36:33.596728] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-09T19:36:34.396751] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-09T19:36:34.455340] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T19:36:35.047829] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T19:36:35.196697] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-09T19:36:35.653889] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T19:36:35.996725] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-09T19:36:36.786835] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T19:36:36.796671] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-09T19:36:37.287432] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:36:37.596760] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-09T19:36:37.949587] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T19:36:38.396746] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-09T19:36:38.623224] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T19:36:39.196735] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-09T19:36:39.920185] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:36:39.996671] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-09T19:36:40.307013] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:36:40.796722] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-09T19:36:41.221009] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T19:36:41.596717] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-09T19:36:42.275273] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T19:36:42.396720] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-09T19:36:43.155033] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:36:43.196668] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-09T19:36:43.407762] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T19:36:43.411488] [INFO ] [REMOTE ] INGR: Full fetch complete (50433 records). [2025-10-09T19:36:43.411617] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-09T19:36:43.783262] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-09T19:36:43.783352] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-09T19:36:43.784152] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-09T19:36:43.784215] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-09T19:36:43.785229] [DEBUG] [LOCAL ] INGR: Trimmed 50433 records to 33896 (keeping 200 days of data) [2025-10-09T19:36:43.996922] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-09T19:36:44.001484] [DEBUG] [LOCAL ] INGR: Primary data saved (33896 records). [2025-10-09T19:36:44.001575] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-09T19:36:44.001683] [INFO ] [MAIN ] Update Progress: 1114/2373 symbols completed. INGR took 33.5s. Estimated remaining: 2h 57m 4s. Rate: 7.1 symbols/min [2025-10-09T19:36:44.170930] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:44.222259] [DEBUG] [LOCAL ] INVH: Loaded 53162 existing records from primary storage. [2025-10-09T19:36:44.222576] [INFO ] [MAIN ] INVH: Loaded 53162 existing records. [2025-10-09T19:36:44.401586] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:44.401850] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-09T19:36:44.401906] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-09T19:36:44.402133] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-09T19:36:44.402190] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-09T19:36:44.727275] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:36:44.791970] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:44.796679] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-09T19:36:45.585981] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T19:36:45.596669] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-09T19:36:45.683571] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T19:36:46.396702] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-09T19:36:46.779901] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:36:47.196740] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-09T19:36:47.711699] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:36:47.996691] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-09T19:36:48.720852] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:36:48.796675] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-09T19:36:49.374065] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T19:36:49.596733] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-09T19:36:50.138683] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:36:50.396711] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-09T19:36:50.953044] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:36:51.196729] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-09T19:36:51.448525] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T19:36:51.452036] [INFO ] [REMOTE ] INN: Full fetch complete (57810 records). [2025-10-09T19:36:51.452132] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-09T19:36:51.854785] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-09T19:36:51.854868] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-09T19:36:51.855784] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-09T19:36:51.855880] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-09T19:36:51.857062] [DEBUG] [LOCAL ] INN: Trimmed 57810 records to 42044 (keeping 200 days of data) [2025-10-09T19:36:52.023745] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-09T19:36:52.110942] [DEBUG] [LOCAL ] INN: Primary data saved (42044 records). [2025-10-09T19:36:52.111066] [INFO ] [MAIN ] INN: Full history saved. [2025-10-09T19:36:52.111159] [INFO ] [MAIN ] Update Progress: 1115/2373 symbols completed. INN took 25.8s. Estimated remaining: 2h 56m 55s. Rate: 7.1 symbols/min [2025-10-09T19:36:52.277832] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:52.310006] [DEBUG] [LOCAL ] INVX: Loaded 29189 existing records from primary storage. [2025-10-09T19:36:52.310322] [INFO ] [MAIN ] INVX: Loaded 29189 existing records. [2025-10-09T19:36:52.499787] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:52.499988] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-09T19:36:52.500035] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-09T19:36:52.500252] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-09T19:36:52.500310] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-09T19:36:52.800157] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-09T19:36:52.869007] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:52.895790] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T19:36:53.513752] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T19:36:53.596683] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-09T19:36:54.354394] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:36:54.396726] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-09T19:36:55.196726] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-09T19:36:55.340675] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:36:55.721793] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T19:36:55.996762] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-09T19:36:56.368732] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:36:56.796722] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-09T19:36:57.392752] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:36:57.596727] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-09T19:36:58.396700] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-09T19:36:58.433921] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T19:36:58.955517] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:36:59.196773] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-09T19:36:59.557006] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T19:36:59.996778] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-09T19:37:00.796739] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-09T19:37:01.107612] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:37:01.260395] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:37:01.596772] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-09T19:37:02.254316] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:37:02.396696] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-09T19:37:03.096093] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T19:37:03.196672] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-09T19:37:03.295455] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T19:37:03.996733] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-09T19:37:04.276948] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T19:37:04.280238] [INFO ] [REMOTE ] INSW: Full fetch complete (60234 records). [2025-10-09T19:37:04.280354] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-09T19:37:04.678601] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-09T19:37:04.678713] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-09T19:37:04.679551] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-09T19:37:04.679597] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-09T19:37:04.680783] [DEBUG] [LOCAL ] INSW: Trimmed 60234 records to 40038 (keeping 200 days of data) [2025-10-09T19:37:04.796818] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-09T19:37:04.929240] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T19:37:04.966565] [DEBUG] [LOCAL ] INSW: Primary data saved (40038 records). [2025-10-09T19:37:04.966745] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-09T19:37:04.966844] [INFO ] [MAIN ] Update Progress: 1116/2373 symbols completed. INSW took 33.6s. Estimated remaining: 2h 56m 52s. Rate: 7.1 symbols/min [2025-10-09T19:37:05.133617] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:05.184751] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-09T19:37:05.185101] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-09T19:37:05.369386] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:05.369697] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-09T19:37:05.369758] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-09T19:37:05.370105] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-09T19:37:05.370162] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-09T19:37:05.606950] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-09T19:37:05.771244] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:06.396688] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-09T19:37:06.431379] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T19:37:06.816720] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T19:37:07.196761] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-09T19:37:07.996706] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-09T19:37:08.249462] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T19:37:08.449184] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T19:37:08.796740] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-09T19:37:09.527060] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T19:37:09.596704] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-09T19:37:09.636371] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T19:37:10.396722] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-09T19:37:11.167253] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:37:11.196696] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-09T19:37:11.996786] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-09T19:37:12.796776] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-09T19:37:12.933968] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:37:13.217749] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-10-09T19:37:13.266232] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T19:37:13.596726] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-09T19:37:14.402575] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-09T19:37:14.418090] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:37:15.196751] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-09T19:37:15.913846] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-09T19:37:15.996672] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-09T19:37:16.110714] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T19:37:16.115560] [INFO ] [REMOTE ] INVH: Full fetch complete (76740 records). [2025-10-09T19:37:16.115744] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-09T19:37:16.517241] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-09T19:37:16.517341] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-09T19:37:16.518456] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-09T19:37:16.518538] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-09T19:37:16.520107] [DEBUG] [LOCAL ] INVH: Trimmed 76740 records to 53549 (keeping 200 days of data) [2025-10-09T19:37:16.818695] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-09T19:37:16.857455] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T19:37:16.862808] [INFO ] [REMOTE ] INSP: Full fetch complete (53303 records). [2025-10-09T19:37:16.863462] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-09T19:37:17.268904] [DEBUG] [LOCAL ] INVH: Primary data saved (53549 records). [2025-10-09T19:37:17.278283] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-09T19:37:17.278420] [INFO ] [MAIN ] Update Progress: 1117/2373 symbols completed. INVH took 33.3s. Estimated remaining: 2h 56m 48s. Rate: 7.1 symbols/min [2025-10-09T19:37:17.312762] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-09T19:37:17.312867] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-09T19:37:17.313753] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-09T19:37:17.313881] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-09T19:37:17.315142] [DEBUG] [LOCAL ] INSP: Trimmed 53303 records to 37994 (keeping 200 days of data) [2025-10-09T19:37:17.552503] [DEBUG] [LOCAL ] INSP: Primary data saved (37994 records). [2025-10-09T19:37:17.552695] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-09T19:37:17.553509] [INFO ] [MAIN ] Update Progress: 1118/2373 symbols completed. INSP took 47.8s. Estimated remaining: 2h 56m 30s. Rate: 7.1 symbols/min [2025-10-09T19:37:18.065904] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T19:37:18.072518] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-09T19:37:18.210580] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-09T19:37:18.396742] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-09T19:37:19.242821] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T19:37:19.249008] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-09T19:37:20.368332] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:37:20.372024] [INFO ] [REMOTE ] INVX: Full fetch complete (43627 records). [2025-10-09T19:37:20.372274] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-09T19:37:20.792196] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-09T19:37:20.792407] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-09T19:37:20.793242] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-09T19:37:20.793316] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-09T19:37:20.794288] [DEBUG] [LOCAL ] INVX: Trimmed 43627 records to 29349 (keeping 200 days of data) [2025-10-09T19:37:20.967861] [DEBUG] [LOCAL ] INVX: Primary data saved (29349 records). [2025-10-09T19:37:20.968239] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-09T19:37:20.968335] [INFO ] [MAIN ] Update Progress: 1119/2373 symbols completed. INVX took 28.9s. Estimated remaining: 2h 56m 16s. Rate: 7.1 symbols/min [2025-10-09T19:37:21.054557] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-09T19:37:21.065810] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-09T19:37:23.782292] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-09T19:37:23.793472] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-09T19:37:26.478044] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-09T19:37:26.493260] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-09T19:37:28.950406] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-09T19:37:28.961532] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-09T19:37:31.550788] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-09T19:37:31.563251] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-09T19:37:34.151824] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-09T19:37:34.164529] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-09T19:37:36.831508] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-09T19:37:36.843128] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-09T19:37:39.467455] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-09T19:37:39.471969] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-09T19:37:39.472081] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-09T19:37:39.871229] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-09T19:37:39.871316] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-09T19:37:39.872331] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-09T19:37:39.872399] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-09T19:37:39.874018] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-10-09T19:37:40.196115] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-10-09T19:37:40.196253] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-09T19:37:40.196353] [INFO ] [MAIN ] Update Progress: 1120/2373 symbols completed. IONQ took 35.2s. Estimated remaining: 2h 56m 20s. Rate: 7.1 symbols/min [2025-10-09T19:37:40.762408] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:40.868753] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:40.924359] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:40.923479] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:40.952081] [DEBUG] [LOCAL ] IPI: Loaded 21556 existing records from primary storage. [2025-10-09T19:37:40.952534] [INFO ] [MAIN ] IPI: Loaded 21556 existing records. [2025-10-09T19:37:41.179308] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:41.194626] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-09T19:37:41.194870] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-09T19:37:41.210208] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-09T19:37:41.210136] [DEBUG] [LOCAL ] IOT: Loaded 53475 existing records from primary storage. [2025-10-09T19:37:41.211096] [DEBUG] [LOCAL ] IP: Loaded 53317 existing records from primary storage. [2025-10-09T19:37:41.211799] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-09T19:37:41.211616] [INFO ] [MAIN ] IOT: Loaded 53475 existing records. [2025-10-09T19:37:41.232897] [INFO ] [MAIN ] IP: Loaded 53317 existing records. [2025-10-09T19:37:41.445956] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-09T19:37:41.540281] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-09T19:37:41.960467] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:42.025769] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-09T19:37:42.045028] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:42.045176] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-09T19:37:42.055820] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-09T19:37:42.071352] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-09T19:37:42.076817] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-09T19:37:42.076919] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-09T19:37:42.103736] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-09T19:37:42.120910] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-09T19:37:42.354278] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:42.401590] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-09T19:37:42.460178] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:42.472325] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-09T19:37:42.478811] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-09T19:37:42.494685] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-09T19:37:42.500972] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-09T19:37:43.270426] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:43.310727] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-09T19:37:43.337170] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:43.348168] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-09T19:37:43.449364] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:43.449757] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-09T19:37:43.557815] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:37:43.561974] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-09T19:37:44.477478] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T19:37:44.481393] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-09T19:37:44.872889] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:37:44.885004] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-09T19:37:44.957588] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:37:44.969619] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-09T19:37:45.029873] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T19:37:45.041374] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-09T19:37:45.432277] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T19:37:45.436388] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-09T19:37:46.609056] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T19:37:46.620330] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-09T19:37:46.654428] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T19:37:46.681384] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-09T19:37:46.683277] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T19:37:46.688805] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-09T19:37:46.842387] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T19:37:46.853527] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-09T19:37:47.821752] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:37:47.827827] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-09T19:37:48.035348] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T19:37:48.045685] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-09T19:37:48.107057] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T19:37:48.117625] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-09T19:37:48.598234] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T19:37:48.608832] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-09T19:37:49.079468] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T19:37:49.085612] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-09T19:37:49.710700] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:37:49.722935] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-09T19:37:49.754721] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:37:49.767239] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-09T19:37:50.090589] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T19:37:50.095369] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-09T19:37:50.550590] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T19:37:50.561849] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-09T19:37:51.064822] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T19:37:51.069383] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-09T19:37:51.363370] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:37:51.375509] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-09T19:37:51.480404] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:37:51.492052] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-09T19:37:52.070193] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T19:37:52.075156] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-09T19:37:52.111585] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:37:52.123086] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-09T19:37:52.857098] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T19:37:52.868937] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-09T19:37:52.882377] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T19:37:52.887371] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-09T19:37:53.263423] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:37:53.274903] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-09T19:37:53.977461] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:37:53.997803] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-09T19:37:53.998064] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T19:37:54.002826] [INFO ] [REMOTE ] IPI: Full fetch complete (29600 records). [2025-10-09T19:37:54.003108] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-09T19:37:54.395256] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-09T19:37:54.395429] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-09T19:37:54.396316] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-09T19:37:54.396401] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-09T19:37:54.397469] [DEBUG] [LOCAL ] IPI: Trimmed 29600 records to 21686 (keeping 200 days of data) [2025-10-09T19:37:54.527231] [DEBUG] [LOCAL ] IPI: Primary data saved (21686 records). [2025-10-09T19:37:54.527376] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-09T19:37:54.527465] [INFO ] [MAIN ] Update Progress: 1121/2373 symbols completed. IPI took 14.3s. Estimated remaining: 2h 56m 18s. Rate: 7.1 symbols/min [2025-10-09T19:37:54.710702] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:54.741840] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T19:37:54.759715] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-09T19:37:54.801066] [DEBUG] [LOCAL ] IQI: Loaded 17978 existing records from primary storage. [2025-10-09T19:37:54.801555] [INFO ] [MAIN ] IQI: Loaded 17978 existing records. [2025-10-09T19:37:54.838422] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:37:54.919999] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-09T19:37:55.000365] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:55.000616] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-09T19:37:55.000697] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-09T19:37:55.000944] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-09T19:37:55.001003] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-09T19:37:55.348783] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:55.349123] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-09T19:37:55.429104] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:37:55.441946] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-09T19:37:56.372812] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T19:37:56.377917] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-09T19:37:56.565359] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:37:56.584007] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-09T19:37:56.785975] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:37:56.798062] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-09T19:37:57.011688] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T19:37:57.015905] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-09T19:37:57.437784] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T19:37:57.596779] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-09T19:37:58.112852] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:37:58.140196] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T19:37:58.202068] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T19:37:58.396774] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-09T19:37:59.196728] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-09T19:37:59.347786] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T19:37:59.996786] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-09T19:38:00.227556] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:38:00.796747] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-09T19:38:01.074902] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T19:38:01.596694] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-09T19:38:01.786513] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T19:38:02.396683] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-09T19:38:02.536112] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T19:38:02.641279] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T19:38:02.645787] [INFO ] [REMOTE ] IP: Full fetch complete (77164 records). [2025-10-09T19:38:02.645893] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-09T19:38:03.069399] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-09T19:38:03.069523] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-09T19:38:03.071851] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-09T19:38:03.071928] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-09T19:38:03.073640] [DEBUG] [LOCAL ] IP: Trimmed 77164 records to 53701 (keeping 200 days of data) [2025-10-09T19:38:03.197556] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-09T19:38:03.414239] [DEBUG] [LOCAL ] IP: Primary data saved (53701 records). [2025-10-09T19:38:03.414401] [INFO ] [MAIN ] IP: Full history saved. [2025-10-09T19:38:03.415062] [INFO ] [MAIN ] Update Progress: 1122/2373 symbols completed. IP took 23.2s. Estimated remaining: 2h 56m 10s. Rate: 7.1 symbols/min [2025-10-09T19:38:03.581232] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:03.628873] [DEBUG] [LOCAL ] IQV: Loaded 50072 existing records from primary storage. [2025-10-09T19:38:03.629211] [INFO ] [MAIN ] IQV: Loaded 50072 existing records. [2025-10-09T19:38:03.809409] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:03.809675] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-09T19:38:03.809740] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-09T19:38:03.809981] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-09T19:38:03.810037] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-09T19:38:04.005349] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-09T19:38:04.167609] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:04.179858] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T19:38:04.184479] [INFO ] [REMOTE ] IOT: Full fetch complete (77391 records). [2025-10-09T19:38:04.184679] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-09T19:38:04.700765] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-09T19:38:04.700955] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-09T19:38:04.702927] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-09T19:38:04.703039] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-09T19:38:04.705214] [DEBUG] [LOCAL ] IOT: Trimmed 77391 records to 53862 (keeping 200 days of data) [2025-10-09T19:38:04.847243] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-09T19:38:05.048993] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T19:38:05.060122] [INFO ] [REMOTE ] IPG: Full fetch complete (77251 records). [2025-10-09T19:38:05.062089] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-09T19:38:05.386911] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T19:38:05.597806] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-09T19:38:05.698630] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-09T19:38:05.699268] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-09T19:38:05.700440] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-09T19:38:05.700528] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-09T19:38:05.707718] [DEBUG] [LOCAL ] IPG: Trimmed 77251 records to 53718 (keeping 200 days of data) [2025-10-09T19:38:05.810795] [DEBUG] [LOCAL ] IOT: Primary data saved (53862 records). [2025-10-09T19:38:05.812387] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-09T19:38:05.812549] [INFO ] [MAIN ] Update Progress: 1123/2373 symbols completed. IOT took 25.6s. Estimated remaining: 2h 55m 55s. Rate: 7.1 symbols/min [2025-10-09T19:38:06.037092] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:06.219415] [DEBUG] [LOCAL ] IR: Loaded 52750 existing records from primary storage. [2025-10-09T19:38:06.223784] [INFO ] [MAIN ] IR: Loaded 52750 existing records. [2025-10-09T19:38:06.502018] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:06.508418] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-09T19:38:06.513703] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-09T19:38:06.514954] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-09T19:38:06.516598] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-09T19:38:06.583423] [DEBUG] [LOCAL ] IPG: Primary data saved (53718 records). [2025-10-09T19:38:06.591684] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-09T19:38:06.592102] [INFO ] [MAIN ] Update Progress: 1124/2373 symbols completed. IPG took 26.4s. Estimated remaining: 2h 55m 38s. Rate: 7.1 symbols/min [2025-10-09T19:38:06.749609] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T19:38:06.780940] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-09T19:38:07.059148] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:07.108972] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-09T19:38:07.188787] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:07.205077] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-09T19:38:07.226597] [DEBUG] [LOCAL ] IRM: Loaded 49267 existing records from primary storage. [2025-10-09T19:38:07.227009] [INFO ] [MAIN ] IRM: Loaded 49267 existing records. [2025-10-09T19:38:07.407818] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:07.408132] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-09T19:38:07.408948] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-09T19:38:07.409194] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-09T19:38:07.409251] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-09T19:38:07.739792] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T19:38:07.831844] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:07.996695] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-09T19:38:08.796752] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-09T19:38:08.830725] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T19:38:09.596711] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-09T19:38:09.802515] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T19:38:09.825743] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:38:10.396740] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-09T19:38:10.952611] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:38:11.196757] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-09T19:38:11.996731] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-09T19:38:12.066866] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T19:38:12.605446] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:38:12.796826] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-09T19:38:13.464931] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T19:38:13.596719] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-09T19:38:14.396692] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-09T19:38:14.584618] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T19:38:15.147803] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:38:15.196686] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-09T19:38:15.506012] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T19:38:15.996770] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-09T19:38:16.590431] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T19:38:16.796728] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-09T19:38:17.596693] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-09T19:38:17.671159] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T19:38:17.771729] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T19:38:18.396725] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-09T19:38:19.026341] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T19:38:19.196757] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-09T19:38:19.289063] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T19:38:19.290976] [INFO ] [REMOTE ] IQI: Full fetch complete (26685 records). [2025-10-09T19:38:19.291060] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-09T19:38:19.673285] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-09T19:38:19.673370] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-09T19:38:19.673995] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-09T19:38:19.674060] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-09T19:38:19.674864] [DEBUG] [LOCAL ] IQI: Trimmed 26685 records to 18049 (keeping 200 days of data) [2025-10-09T19:38:19.784064] [DEBUG] [LOCAL ] IQI: Primary data saved (18049 records). [2025-10-09T19:38:19.784214] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-09T19:38:19.784326] [INFO ] [MAIN ] Update Progress: 1125/2373 symbols completed. IQI took 25.3s. Estimated remaining: 2h 55m 34s. Rate: 7.1 symbols/min [2025-10-09T19:38:19.971119] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:19.996681] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-09T19:38:19.998353] [DEBUG] [LOCAL ] IRS: Loaded 22476 existing records from primary storage. [2025-10-09T19:38:19.998634] [INFO ] [MAIN ] IRS: Loaded 22476 existing records. [2025-10-09T19:38:20.220423] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:20.220687] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-09T19:38:20.220748] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-09T19:38:20.221040] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-09T19:38:20.221099] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-09T19:38:20.579142] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:20.796743] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-09T19:38:21.042099] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T19:38:21.596694] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-09T19:38:21.771184] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:38:22.049981] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:38:22.396763] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-09T19:38:23.018992] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T19:38:23.196689] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-09T19:38:23.566331] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T19:38:23.996749] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-09T19:38:24.628246] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:38:24.796732] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-09T19:38:25.596709] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-09T19:38:25.639637] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:38:26.381708] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:38:26.396723] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-09T19:38:26.664709] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T19:38:27.196732] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-09T19:38:27.823925] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:38:27.860254] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T19:38:27.996694] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-09T19:38:28.796747] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-09T19:38:29.596763] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-09T19:38:29.777103] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T19:38:30.396710] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-09T19:38:30.479858] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T19:38:31.041088] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:38:31.196708] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-09T19:38:31.996691] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-09T19:38:32.143477] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T19:38:32.796742] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-09T19:38:32.893334] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:38:33.029639] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T19:38:33.596732] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-09T19:38:34.396712] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-09T19:38:34.488762] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T19:38:34.957726] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T19:38:35.196725] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-09T19:38:35.996764] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-09T19:38:36.113922] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T19:38:36.737074] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:38:36.796682] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-09T19:38:37.010967] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T19:38:37.596762] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-09T19:38:38.159901] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:38:38.396731] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-09T19:38:39.024172] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T19:38:39.196699] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-09T19:38:39.287070] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T19:38:39.295938] [INFO ] [REMOTE ] IR: Full fetch complete (76231 records). [2025-10-09T19:38:39.296204] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-09T19:38:39.699272] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-09T19:38:39.699374] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-09T19:38:39.700457] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-09T19:38:39.700526] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-09T19:38:39.702098] [DEBUG] [LOCAL ] IR: Trimmed 76231 records to 53136 (keeping 200 days of data) [2025-10-09T19:38:40.012619] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-09T19:38:40.037194] [DEBUG] [LOCAL ] IR: Primary data saved (53136 records). [2025-10-09T19:38:40.037344] [INFO ] [MAIN ] IR: Full history saved. [2025-10-09T19:38:40.037453] [INFO ] [MAIN ] Update Progress: 1126/2373 symbols completed. IR took 34.2s. Estimated remaining: 2h 55m 39s. Rate: 7.1 symbols/min [2025-10-09T19:38:40.202960] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:40.249113] [DEBUG] [LOCAL ] IRT: Loaded 50424 existing records from primary storage. [2025-10-09T19:38:40.249438] [INFO ] [MAIN ] IRT: Loaded 50424 existing records. [2025-10-09T19:38:40.439681] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:40.439909] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-09T19:38:40.439958] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-09T19:38:40.440179] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-09T19:38:40.440237] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-09T19:38:40.817152] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:40.817276] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-09T19:38:40.850581] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T19:38:41.092754] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T19:38:41.596759] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-09T19:38:42.396764] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-09T19:38:42.442024] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:38:42.446357] [INFO ] [REMOTE ] IQV: Full fetch complete (72146 records). [2025-10-09T19:38:42.446459] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-09T19:38:42.831450] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-09T19:38:42.831551] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-09T19:38:42.832592] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-09T19:38:42.832692] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-09T19:38:42.834173] [DEBUG] [LOCAL ] IQV: Trimmed 72146 records to 50443 (keeping 200 days of data) [2025-10-09T19:38:43.167935] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:38:43.186172] [DEBUG] [LOCAL ] IQV: Primary data saved (50443 records). [2025-10-09T19:38:43.186324] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-09T19:38:43.187132] [INFO ] [MAIN ] Update Progress: 1127/2373 symbols completed. IQV took 39.8s. Estimated remaining: 2h 55m 25s. Rate: 7.1 symbols/min [2025-10-09T19:38:43.201845] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-09T19:38:43.355223] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:43.373759] [DEBUG] [LOCAL ] ISD: Loaded 15838 existing records from primary storage. [2025-10-09T19:38:43.374010] [INFO ] [MAIN ] ISD: Loaded 15838 existing records. [2025-10-09T19:38:43.545774] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:43.545972] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-09T19:38:43.546019] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-09T19:38:43.546255] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-09T19:38:43.546323] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-09T19:38:43.899740] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:43.994192] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:38:43.998499] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-09T19:38:44.000349] [INFO ] [REMOTE ] IRM: Full fetch complete (72257 records). [2025-10-09T19:38:44.000741] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-09T19:38:44.384246] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-09T19:38:44.384340] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-09T19:38:44.385356] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-09T19:38:44.385422] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-09T19:38:44.387066] [DEBUG] [LOCAL ] IRM: Trimmed 72257 records to 49607 (keeping 200 days of data) [2025-10-09T19:38:44.700186] [DEBUG] [LOCAL ] IRM: Primary data saved (49607 records). [2025-10-09T19:38:44.700466] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-09T19:38:44.700679] [INFO ] [MAIN ] Update Progress: 1128/2373 symbols completed. IRM took 38.1s. Estimated remaining: 2h 55m 9s. Rate: 7.1 symbols/min [2025-10-09T19:38:44.798688] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-09T19:38:44.905880] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T19:38:44.910969] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:44.962486] [DEBUG] [LOCAL ] IT: Loaded 42164 existing records from primary storage. [2025-10-09T19:38:44.968165] [INFO ] [MAIN ] IT: Loaded 42164 existing records. [2025-10-09T19:38:45.046136] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T19:38:45.161002] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:45.161226] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-09T19:38:45.161278] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-09T19:38:45.161528] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-09T19:38:45.161585] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-09T19:38:45.514740] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:45.596714] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-09T19:38:45.906504] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T19:38:46.396713] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-09T19:38:47.190879] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:38:47.200615] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-09T19:38:47.662598] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:38:47.996679] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-09T19:38:48.078739] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T19:38:48.796745] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-09T19:38:49.596773] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-09T19:38:49.639146] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T19:38:49.731492] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T19:38:50.396794] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-09T19:38:51.196682] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-09T19:38:51.374573] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T19:38:51.389009] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T19:38:51.389135] [INFO ] [REMOTE ] IRS: Full fetch complete (32374 records). [2025-10-09T19:38:51.393114] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-09T19:38:51.755855] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-09T19:38:51.755937] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-09T19:38:51.756549] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-09T19:38:51.756589] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-09T19:38:51.757326] [DEBUG] [LOCAL ] IRS: Trimmed 32374 records to 22729 (keeping 200 days of data) [2025-10-09T19:38:51.892239] [DEBUG] [LOCAL ] IRS: Primary data saved (22729 records). [2025-10-09T19:38:51.892366] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-09T19:38:51.892445] [INFO ] [MAIN ] Update Progress: 1129/2373 symbols completed. IRS took 32.1s. Estimated remaining: 2h 54m 59s. Rate: 7.1 symbols/min [2025-10-09T19:38:51.996687] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-09T19:38:52.103784] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:52.137063] [DEBUG] [LOCAL ] ITGR: Loaded 31212 existing records from primary storage. [2025-10-09T19:38:52.137332] [INFO ] [MAIN ] ITGR: Loaded 31212 existing records. [2025-10-09T19:38:52.314200] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:52.314434] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-09T19:38:52.314661] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-09T19:38:52.320248] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-09T19:38:52.329524] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-09T19:38:52.372576] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T19:38:52.692800] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:52.796687] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-09T19:38:53.489088] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T19:38:53.596761] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-09T19:38:53.666413] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T19:38:54.396740] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-09T19:38:54.714211] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T19:38:55.045204] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T19:38:55.196691] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-09T19:38:55.996735] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-09T19:38:56.657773] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:38:56.796745] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-09T19:38:57.077051] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T19:38:57.596734] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-09T19:38:58.393862] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T19:38:58.404149] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-09T19:38:58.941444] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T19:38:59.196703] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-09T19:38:59.763048] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:38:59.996693] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-09T19:39:00.077134] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-09T19:39:00.796756] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-09T19:39:01.547058] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T19:39:01.596734] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-09T19:39:02.314125] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:39:02.396681] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-09T19:39:03.196702] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-09T19:39:03.303671] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T19:39:03.439109] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:39:03.996738] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-09T19:39:04.232397] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:39:04.796748] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-09T19:39:05.559336] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T19:39:05.564097] [INFO ] [REMOTE ] IRT: Full fetch complete (72763 records). [2025-10-09T19:39:05.564224] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-09T19:39:05.606496] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-09T19:39:05.967544] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-09T19:39:05.967766] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-09T19:39:05.968838] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-09T19:39:05.968904] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-09T19:39:05.970300] [DEBUG] [LOCAL ] IRT: Trimmed 72763 records to 50811 (keeping 200 days of data) [2025-10-09T19:39:06.104488] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T19:39:06.315244] [DEBUG] [LOCAL ] IRT: Primary data saved (50811 records). [2025-10-09T19:39:06.315398] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-09T19:39:06.315487] [INFO ] [MAIN ] Update Progress: 1130/2373 symbols completed. IRT took 26.3s. Estimated remaining: 2h 54m 57s. Rate: 7.1 symbols/min [2025-10-09T19:39:06.401932] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-09T19:39:06.496382] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:06.530763] [DEBUG] [LOCAL ] ITT: Loaded 32595 existing records from primary storage. [2025-10-09T19:39:06.531087] [INFO ] [MAIN ] ITT: Loaded 32595 existing records. [2025-10-09T19:39:06.706991] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:06.707233] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-09T19:39:06.707282] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-09T19:39:06.707780] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-09T19:39:06.707840] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-09T19:39:07.059716] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:07.079775] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T19:39:07.196680] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-09T19:39:07.821384] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T19:39:07.996755] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-09T19:39:08.150406] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T19:39:08.774099] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T19:39:08.796676] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-09T19:39:09.596735] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-09T19:39:10.050353] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:39:10.396728] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-09T19:39:10.933969] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T19:39:11.196740] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-09T19:39:11.728465] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T19:39:11.731255] [INFO ] [REMOTE ] ITGR: Full fetch complete (42262 records). [2025-10-09T19:39:11.731331] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-09T19:39:12.002063] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-09T19:39:12.111780] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-09T19:39:12.111918] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-09T19:39:12.112623] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-09T19:39:12.112698] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-09T19:39:12.113635] [DEBUG] [LOCAL ] ITGR: Trimmed 42262 records to 31372 (keeping 200 days of data) [2025-10-09T19:39:12.307548] [DEBUG] [LOCAL ] ITGR: Primary data saved (31372 records). [2025-10-09T19:39:12.307755] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-09T19:39:12.307853] [INFO ] [MAIN ] Update Progress: 1131/2373 symbols completed. ITGR took 20.4s. Estimated remaining: 2h 54m 46s. Rate: 7.1 symbols/min [2025-10-09T19:39:12.475422] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:12.525402] [DEBUG] [LOCAL ] ITUB: Loaded 53313 existing records from primary storage. [2025-10-09T19:39:12.525745] [INFO ] [MAIN ] ITUB: Loaded 53313 existing records. [2025-10-09T19:39:12.702748] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:12.702940] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-09T19:39:12.703090] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-09T19:39:12.703370] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-09T19:39:12.703429] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-09T19:39:12.797522] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-09T19:39:13.068559] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T19:39:13.121247] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:13.471393] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T19:39:13.596786] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-09T19:39:13.852701] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T19:39:14.396701] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-09T19:39:15.169166] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:39:15.196672] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-09T19:39:15.507638] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T19:39:15.996716] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-09T19:39:16.796780] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-09T19:39:16.981122] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:39:17.013192] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T19:39:17.596721] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-09T19:39:18.243212] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T19:39:18.396735] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-09T19:39:18.560444] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:39:19.196724] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-09T19:39:19.937434] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T19:39:19.996691] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-09T19:39:20.722680] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:39:20.796750] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-09T19:39:21.437286] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T19:39:21.596723] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-09T19:39:22.284816] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:39:22.396671] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-09T19:39:23.196742] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-09T19:39:23.372752] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T19:39:23.438313] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:39:23.996769] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-09T19:39:24.630439] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T19:39:24.682995] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T19:39:24.796675] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-09T19:39:25.596715] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-09T19:39:25.930873] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T19:39:26.396734] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-09T19:39:27.196732] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-09T19:39:27.308828] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T19:39:27.350747] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T19:39:27.996694] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-09T19:39:28.080415] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T19:39:28.082530] [INFO ] [REMOTE ] ISD: Full fetch complete (24104 records). [2025-10-09T19:39:28.082606] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-09T19:39:28.445254] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-09T19:39:28.445331] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-09T19:39:28.445814] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-09T19:39:28.445877] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-09T19:39:28.446443] [DEBUG] [LOCAL ] ISD: Trimmed 24104 records to 15962 (keeping 200 days of data) [2025-10-09T19:39:28.544860] [DEBUG] [LOCAL ] ISD: Primary data saved (15962 records). [2025-10-09T19:39:28.545009] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-09T19:39:28.545111] [INFO ] [MAIN ] Update Progress: 1132/2373 symbols completed. ISD took 45.4s. Estimated remaining: 2h 54m 46s. Rate: 7.1 symbols/min [2025-10-09T19:39:28.709219] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:28.755623] [DEBUG] [LOCAL ] ITW: Loaded 45750 existing records from primary storage. [2025-10-09T19:39:28.755935] [INFO ] [MAIN ] ITW: Loaded 45750 existing records. [2025-10-09T19:39:28.801960] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-09T19:39:28.945170] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:28.945617] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-09T19:39:28.945805] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-09T19:39:28.946370] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-09T19:39:28.946431] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-09T19:39:29.142042] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T19:39:29.330989] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:29.596766] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-09T19:39:30.396706] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-09T19:39:30.575353] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:39:31.107566] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T19:39:31.196694] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-09T19:39:31.347052] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:39:31.996720] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-09T19:39:32.796765] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-09T19:39:32.893678] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T19:39:33.179104] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:39:33.181984] [INFO ] [REMOTE ] ITT: Full fetch complete (46943 records). [2025-10-09T19:39:33.182127] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-09T19:39:33.561484] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-09T19:39:33.561564] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-09T19:39:33.562372] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-09T19:39:33.562448] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-09T19:39:33.563503] [DEBUG] [LOCAL ] ITT: Trimmed 46943 records to 32802 (keeping 200 days of data) [2025-10-09T19:39:33.623670] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-09T19:39:33.781605] [DEBUG] [LOCAL ] ITT: Primary data saved (32802 records). [2025-10-09T19:39:33.781773] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-09T19:39:33.781861] [INFO ] [MAIN ] Update Progress: 1133/2373 symbols completed. ITT took 27.5s. Estimated remaining: 2h 54m 34s. Rate: 7.1 symbols/min [2025-10-09T19:39:33.953235] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:33.995664] [DEBUG] [LOCAL ] IVR: Loaded 48111 existing records from primary storage. [2025-10-09T19:39:33.996002] [INFO ] [MAIN ] IVR: Loaded 48111 existing records. [2025-10-09T19:39:34.181588] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:34.181996] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-09T19:39:34.182058] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-09T19:39:34.182266] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-09T19:39:34.182323] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-09T19:39:34.405267] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-09T19:39:34.524225] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T19:39:34.589226] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:34.840550] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T19:39:35.196723] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-09T19:39:35.950542] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:39:35.996674] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-09T19:39:36.796732] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-09T19:39:37.095445] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T19:39:37.596739] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-09T19:39:37.637088] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T19:39:37.644904] [INFO ] [REMOTE ] IT: Full fetch complete (56762 records). [2025-10-09T19:39:37.645063] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-09T19:39:38.035184] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-09T19:39:38.035271] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-09T19:39:38.036132] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-09T19:39:38.036197] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-09T19:39:38.037369] [DEBUG] [LOCAL ] IT: Trimmed 56762 records to 42507 (keeping 200 days of data) [2025-10-09T19:39:38.301417] [DEBUG] [LOCAL ] IT: Primary data saved (42507 records). [2025-10-09T19:39:38.301569] [INFO ] [MAIN ] IT: Full history saved. [2025-10-09T19:39:38.301688] [INFO ] [MAIN ] Update Progress: 1134/2373 symbols completed. IT took 53.6s. Estimated remaining: 2h 54m 21s. Rate: 7.1 symbols/min [2025-10-09T19:39:38.401692] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-09T19:39:38.488520] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:38.558684] [DEBUG] [LOCAL ] IVT: Loaded 30981 existing records from primary storage. [2025-10-09T19:39:38.559099] [INFO ] [MAIN ] IVT: Loaded 30981 existing records. [2025-10-09T19:39:38.631686] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T19:39:38.761077] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:38.761338] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-09T19:39:38.761389] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-09T19:39:38.761719] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-09T19:39:38.761781] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-09T19:39:39.150625] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:39.180632] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T19:39:39.196676] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-09T19:39:39.996769] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-09T19:39:40.158694] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T19:39:40.796712] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-09T19:39:41.064734] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T19:39:41.180057] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T19:39:41.596799] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-09T19:39:42.346059] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:39:42.396679] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-09T19:39:43.196714] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-09T19:39:43.364246] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:39:43.798892] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T19:39:43.996746] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-09T19:39:44.161317] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T19:39:44.796749] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-09T19:39:45.596756] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-09T19:39:45.734125] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:39:45.980221] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T19:39:46.396754] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-09T19:39:47.128054] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:39:47.196671] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-09T19:39:47.327058] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T19:39:47.996770] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-09T19:39:48.796767] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-09T19:39:48.842033] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T19:39:49.596737] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-09T19:39:49.751482] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T19:39:50.396744] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-09T19:39:50.466638] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:39:50.472414] [INFO ] [REMOTE ] ITUB: Full fetch complete (77152 records). [2025-10-09T19:39:50.472573] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-09T19:39:50.935153] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-09T19:39:50.935314] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-09T19:39:50.936462] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-09T19:39:50.936680] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-09T19:39:50.938461] [DEBUG] [LOCAL ] ITUB: Trimmed 77152 records to 53698 (keeping 200 days of data) [2025-10-09T19:39:51.201695] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-09T19:39:51.206383] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T19:39:51.331117] [DEBUG] [LOCAL ] ITUB: Primary data saved (53698 records). [2025-10-09T19:39:51.331264] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-09T19:39:51.331351] [INFO ] [MAIN ] Update Progress: 1135/2373 symbols completed. ITUB took 39.0s. Estimated remaining: 2h 54m 18s. Rate: 7.1 symbols/min [2025-10-09T19:39:51.504493] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:51.556203] [DEBUG] [LOCAL ] IVZ: Loaded 53114 existing records from primary storage. [2025-10-09T19:39:51.556562] [INFO ] [MAIN ] IVZ: Loaded 53114 existing records. [2025-10-09T19:39:51.735325] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:51.735514] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-09T19:39:51.735560] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-09T19:39:51.736304] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-09T19:39:51.736362] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-09T19:39:51.996897] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-09T19:39:52.100844] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:52.137995] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:39:52.513319] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T19:39:52.796742] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-09T19:39:53.596731] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-09T19:39:53.737958] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T19:39:54.396776] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-09T19:39:54.433124] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:39:54.872606] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:39:55.196772] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-09T19:39:55.996774] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-09T19:39:56.048774] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T19:39:56.796701] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-09T19:39:56.873576] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T19:39:57.539278] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T19:39:57.543186] [INFO ] [REMOTE ] ITW: Full fetch complete (66417 records). [2025-10-09T19:39:57.543301] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-09T19:39:57.604981] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-09T19:39:57.992307] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-09T19:39:57.992410] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-09T19:39:57.993533] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-09T19:39:57.993606] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-09T19:39:57.995121] [DEBUG] [LOCAL ] ITW: Trimmed 66417 records to 46099 (keeping 200 days of data) [2025-10-09T19:39:58.260058] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T19:39:58.342230] [DEBUG] [LOCAL ] ITW: Primary data saved (46099 records). [2025-10-09T19:39:58.342382] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-09T19:39:58.343003] [INFO ] [MAIN ] Update Progress: 1136/2373 symbols completed. ITW took 29.8s. Estimated remaining: 2h 54m 8s. Rate: 7.1 symbols/min [2025-10-09T19:39:58.405564] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-09T19:39:58.512895] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:58.536583] [DEBUG] [LOCAL ] IX: Loaded 22302 existing records from primary storage. [2025-10-09T19:39:58.536905] [INFO ] [MAIN ] IX: Loaded 22302 existing records. [2025-10-09T19:39:58.707887] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:58.708117] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-09T19:39:58.708164] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-09T19:39:58.708559] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-09T19:39:58.708617] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-09T19:39:59.112140] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:59.196796] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-09T19:39:59.241578] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:39:59.306676] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T19:39:59.996726] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-09T19:40:00.796726] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-09T19:40:01.157146] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-09T19:40:01.596693] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-09T19:40:01.703127] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:40:01.741847] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T19:40:02.396745] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-09T19:40:02.520555] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:40:03.196784] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-09T19:40:03.996698] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-09T19:40:04.231581] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T19:40:04.796750] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-09T19:40:04.916765] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T19:40:04.993158] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T19:40:05.596733] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-09T19:40:06.253297] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:40:06.396733] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-09T19:40:06.584031] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T19:40:07.196717] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-09T19:40:07.963462] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T19:40:07.996739] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-09T19:40:08.730291] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T19:40:08.796689] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-09T19:40:08.853622] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:40:09.596775] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-09T19:40:10.398992] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-09T19:40:10.401119] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T19:40:10.522412] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-09T19:40:10.526682] [INFO ] [REMOTE ] IVR: Full fetch complete (69159 records). [2025-10-09T19:40:10.526786] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-09T19:40:10.918313] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-09T19:40:10.918412] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-09T19:40:10.919455] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-09T19:40:10.919522] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-09T19:40:10.920907] [DEBUG] [LOCAL ] IVR: Trimmed 69159 records to 48445 (keeping 200 days of data) [2025-10-09T19:40:11.196742] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-09T19:40:11.205092] [DEBUG] [LOCAL ] IVR: Primary data saved (48445 records). [2025-10-09T19:40:11.205185] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-09T19:40:11.205322] [INFO ] [MAIN ] Update Progress: 1137/2373 symbols completed. IVR took 37.4s. Estimated remaining: 2h 54m 4s. Rate: 7.1 symbols/min [2025-10-09T19:40:11.380221] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:11.420551] [DEBUG] [LOCAL ] J: Loaded 40192 existing records from primary storage. [2025-10-09T19:40:11.420926] [INFO ] [MAIN ] J: Loaded 40192 existing records. [2025-10-09T19:40:11.601047] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:11.601321] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-09T19:40:11.601368] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-09T19:40:11.601728] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-09T19:40:11.601796] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-09T19:40:11.975627] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:11.996684] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-09T19:40:12.293314] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T19:40:12.332159] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T19:40:12.796736] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-09T19:40:13.520503] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:40:13.596762] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-09T19:40:14.396759] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-09T19:40:14.695324] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T19:40:15.138328] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:40:15.196675] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-09T19:40:15.484923] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T19:40:15.996706] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-09T19:40:16.801791] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-09T19:40:16.816037] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T19:40:17.596686] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-09T19:40:17.822296] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:40:18.078637] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T19:40:18.396761] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-09T19:40:19.144174] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:40:19.196675] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-09T19:40:19.979678] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T19:40:19.984759] [INFO ] [REMOTE ] IVZ: Full fetch complete (76806 records). [2025-10-09T19:40:19.984942] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-09T19:40:20.002011] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-09T19:40:20.412218] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-09T19:40:20.412347] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-09T19:40:20.413700] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-09T19:40:20.413856] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-09T19:40:20.415466] [DEBUG] [LOCAL ] IVZ: Trimmed 76806 records to 53491 (keeping 200 days of data) [2025-10-09T19:40:20.661067] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T19:40:20.784988] [DEBUG] [LOCAL ] IVZ: Primary data saved (53491 records). [2025-10-09T19:40:20.785124] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-09T19:40:20.785220] [INFO ] [MAIN ] Update Progress: 1138/2373 symbols completed. IVZ took 29.5s. Estimated remaining: 2h 53m 57s. Rate: 7.1 symbols/min [2025-10-09T19:40:20.806029] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-09T19:40:20.955037] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:20.996349] [DEBUG] [LOCAL ] JBGS: Loaded 42213 existing records from primary storage. [2025-10-09T19:40:20.996680] [INFO ] [MAIN ] JBGS: Loaded 42213 existing records. [2025-10-09T19:40:21.189253] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:40:21.193812] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:21.197392] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-09T19:40:21.197452] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-09T19:40:21.197549] [INFO ] [REMOTE ] IVT: Full fetch complete (45666 records). [2025-10-09T19:40:21.197723] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-09T19:40:21.198027] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-09T19:40:21.198087] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-09T19:40:21.616886] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-09T19:40:22.001202] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:22.002005] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-09T19:40:22.002279] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-09T19:40:22.003702] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-09T19:40:22.003797] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-09T19:40:22.022018] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T19:40:22.029353] [DEBUG] [LOCAL ] IVT: Trimmed 45666 records to 31295 (keeping 200 days of data) [2025-10-09T19:40:22.239784] [DEBUG] [LOCAL ] IVT: Primary data saved (31295 records). [2025-10-09T19:40:22.239988] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-09T19:40:22.240110] [INFO ] [MAIN ] Update Progress: 1139/2373 symbols completed. IVT took 43.9s. Estimated remaining: 2h 53m 41s. Rate: 7.1 symbols/min [2025-10-09T19:40:22.411878] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-09T19:40:22.416535] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:22.466967] [DEBUG] [LOCAL ] JBI: Loaded 43319 existing records from primary storage. [2025-10-09T19:40:22.467479] [INFO ] [MAIN ] JBI: Loaded 43319 existing records. [2025-10-09T19:40:22.659594] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:22.659934] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-09T19:40:22.659997] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-09T19:40:22.660849] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-09T19:40:22.660920] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-09T19:40:23.020749] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:23.196693] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-09T19:40:23.293117] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:40:23.581122] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T19:40:23.996690] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-09T19:40:24.267012] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T19:40:24.796750] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-09T19:40:24.977205] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T19:40:25.598467] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-09T19:40:25.601106] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T19:40:26.396776] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-09T19:40:27.066063] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:40:27.196698] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-09T19:40:27.619902] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T19:40:27.996715] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-09T19:40:28.750535] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T19:40:28.796741] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-09T19:40:29.121041] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T19:40:29.596731] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-09T19:40:30.233522] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:40:30.396739] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-09T19:40:30.982317] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T19:40:31.196733] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-09T19:40:31.918631] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T19:40:31.996668] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-09T19:40:32.745980] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:40:32.796674] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-09T19:40:33.273788] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T19:40:33.596716] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-09T19:40:33.915388] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T19:40:34.396763] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-09T19:40:35.036411] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:40:35.040092] [INFO ] [REMOTE ] J: Full fetch complete (59161 records). [2025-10-09T19:40:35.040183] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-09T19:40:35.202534] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-09T19:40:35.432686] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-09T19:40:35.432776] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-09T19:40:35.433601] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-09T19:40:35.433662] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-09T19:40:35.434867] [DEBUG] [LOCAL ] J: Trimmed 59161 records to 40500 (keeping 200 days of data) [2025-10-09T19:40:35.686615] [DEBUG] [LOCAL ] J: Primary data saved (40500 records). [2025-10-09T19:40:35.686858] [INFO ] [MAIN ] J: Full history saved. [2025-10-09T19:40:35.687072] [INFO ] [MAIN ] Update Progress: 1140/2373 symbols completed. J took 24.5s. Estimated remaining: 2h 53m 38s. Rate: 7.1 symbols/min [2025-10-09T19:40:35.885639] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:35.888231] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:40:35.933332] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T19:40:35.954946] [DEBUG] [LOCAL ] JBL: Loaded 48364 existing records from primary storage. [2025-10-09T19:40:35.955254] [INFO ] [MAIN ] JBL: Loaded 48364 existing records. [2025-10-09T19:40:36.001839] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-09T19:40:36.132943] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:36.133166] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-09T19:40:36.133221] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-09T19:40:36.133889] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-09T19:40:36.133949] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-09T19:40:36.481110] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:36.796739] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-09T19:40:37.478051] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T19:40:37.596675] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-09T19:40:38.396777] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-09T19:40:38.531031] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T19:40:38.887795] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T19:40:39.048481] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T19:40:39.196756] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-09T19:40:39.996791] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-09T19:40:40.413858] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T19:40:40.796770] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-09T19:40:41.462002] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T19:40:41.596688] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-09T19:40:42.395480] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:40:42.405106] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-09T19:40:43.196687] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-09T19:40:43.296512] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T19:40:43.862313] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T19:40:43.996678] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-09T19:40:44.032938] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:40:44.034984] [INFO ] [REMOTE ] IX: Full fetch complete (27781 records). [2025-10-09T19:40:44.035061] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-09T19:40:44.398121] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-09T19:40:44.398203] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-09T19:40:44.398774] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-09T19:40:44.398836] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-09T19:40:44.399491] [DEBUG] [LOCAL ] IX: Trimmed 27781 records to 22441 (keeping 200 days of data) [2025-10-09T19:40:44.527816] [DEBUG] [LOCAL ] IX: Primary data saved (22441 records). [2025-10-09T19:40:44.527944] [INFO ] [MAIN ] IX: Full history saved. [2025-10-09T19:40:44.528023] [INFO ] [MAIN ] Update Progress: 1141/2373 symbols completed. IX took 46.2s. Estimated remaining: 2h 53m 30s. Rate: 7.1 symbols/min [2025-10-09T19:40:44.694086] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:44.720659] [DEBUG] [LOCAL ] JBND: Loaded 26515 existing records from primary storage. [2025-10-09T19:40:44.720915] [INFO ] [MAIN ] JBND: Loaded 26515 existing records. [2025-10-09T19:40:44.801973] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-09T19:40:44.898662] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:44.898842] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-09T19:40:44.898888] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-09T19:40:44.899186] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-09T19:40:44.899245] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-09T19:40:45.270053] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:45.393013] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:40:45.596723] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-09T19:40:46.364443] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T19:40:46.396673] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-09T19:40:46.992952] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T19:40:46.997973] [INFO ] [REMOTE ] JBI: Full fetch complete (64061 records). [2025-10-09T19:40:46.998194] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-09T19:40:47.203372] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-09T19:40:47.389635] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-09T19:40:47.389755] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-09T19:40:47.390833] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-09T19:40:47.390902] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-09T19:40:47.392361] [DEBUG] [LOCAL ] JBI: Trimmed 64061 records to 43587 (keeping 200 days of data) [2025-10-09T19:40:47.630615] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:40:47.675781] [DEBUG] [LOCAL ] JBI: Primary data saved (43587 records). [2025-10-09T19:40:47.675925] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-09T19:40:47.676010] [INFO ] [MAIN ] Update Progress: 1142/2373 symbols completed. JBI took 25.4s. Estimated remaining: 2h 53m 16s. Rate: 7.1 symbols/min [2025-10-09T19:40:47.840444] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:47.840612] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-09T19:40:47.840689] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-09T19:40:47.840811] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-09T19:40:47.840852] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-09T19:40:47.840892] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-09T19:40:47.840923] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-09T19:40:47.997130] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-09T19:40:48.167811] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T19:40:48.228260] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:48.796805] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-09T19:40:49.396429] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:40:49.596763] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-09T19:40:49.718743] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T19:40:49.792539] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:40:49.792874] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-09T19:40:49.792983] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:40:49.793056] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-09T19:40:49.793119] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:40:49.793187] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-09T19:40:49.793248] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-09T19:40:49.793284] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-09T19:40:49.793322] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-09T19:40:49.793381] [INFO ] [MAIN ] Update Progress: 1143/2373 symbols completed. JBS took 2.1s. Estimated remaining: 2h 53m 0s. Rate: 7.1 symbols/min [2025-10-09T19:40:49.962590] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:49.962817] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-09T19:40:49.962859] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-09T19:40:49.962974] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-09T19:40:49.963016] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-09T19:40:49.963056] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-09T19:40:49.963088] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-09T19:40:50.335559] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:50.396687] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-09T19:40:50.590466] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:40:50.590968] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-09T19:40:50.591072] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:40:50.591128] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-09T19:40:50.591162] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:40:50.591232] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-09T19:40:50.591305] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-09T19:40:50.591342] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-09T19:40:50.591382] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-09T19:40:50.591438] [INFO ] [MAIN ] Update Progress: 1144/2373 symbols completed. JBTM took 0.8s. Estimated remaining: 2h 52m 44s. Rate: 7.1 symbols/min [2025-10-09T19:40:50.796097] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:50.806309] [DEBUG] [LOCAL ] JCE: Loaded 7134 existing records from primary storage. [2025-10-09T19:40:50.806548] [INFO ] [MAIN ] JCE: Loaded 7134 existing records. [2025-10-09T19:40:51.032116] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:51.032347] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-09T19:40:51.032465] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-09T19:40:51.032725] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-09T19:40:51.032786] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-09T19:40:51.210727] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-09T19:40:51.395348] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:51.996684] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-09T19:40:52.291288] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T19:40:52.481735] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-09T19:40:52.796724] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-09T19:40:53.407432] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:40:53.596729] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-09T19:40:54.168927] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T19:40:54.396732] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-09T19:40:55.196756] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-09T19:40:55.831338] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T19:40:55.996723] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-09T19:40:56.796688] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-09T19:40:57.130437] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T19:40:57.526563] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T19:40:57.593958] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T19:40:57.599905] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-09T19:40:58.396811] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-09T19:40:58.731610] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:40:59.196772] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-09T19:40:59.648512] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T19:40:59.654359] [INFO ] [REMOTE ] JBGS: Full fetch complete (59337 records). [2025-10-09T19:40:59.654617] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-09T19:41:00.001879] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-09T19:41:00.091578] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-09T19:41:00.091683] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-09T19:41:00.092624] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-09T19:41:00.092702] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-09T19:41:00.093937] [DEBUG] [LOCAL ] JBGS: Trimmed 59337 records to 42466 (keeping 200 days of data) [2025-10-09T19:41:00.355974] [DEBUG] [LOCAL ] JBGS: Primary data saved (42466 records). [2025-10-09T19:41:00.356103] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-09T19:41:00.356180] [INFO ] [MAIN ] Update Progress: 1145/2373 symbols completed. JBGS took 39.6s. Estimated remaining: 2h 52m 37s. Rate: 7.1 symbols/min [2025-10-09T19:41:00.523954] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:00.574402] [DEBUG] [LOCAL ] JCI: Loaded 53539 existing records from primary storage. [2025-10-09T19:41:00.574761] [INFO ] [MAIN ] JCI: Loaded 53539 existing records. [2025-10-09T19:41:00.750236] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:00.750474] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-09T19:41:00.750524] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-09T19:41:00.750778] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-09T19:41:00.750839] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-09T19:41:00.809840] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-09T19:41:01.123984] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:01.571112] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:41:01.596684] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-09T19:41:01.622459] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T19:41:01.694961] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-09T19:41:02.396788] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-09T19:41:03.196738] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-09T19:41:03.251780] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T19:41:03.345737] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T19:41:03.952178] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T19:41:03.996696] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-09T19:41:04.796741] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-09T19:41:05.006895] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T19:41:05.375833] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T19:41:05.596770] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-09T19:41:06.396752] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-09T19:41:07.196699] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-09T19:41:07.247001] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T19:41:07.908782] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:41:08.001842] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-09T19:41:08.015248] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T19:41:08.796761] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-09T19:41:09.266379] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:41:09.596738] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-09T19:41:10.164844] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T19:41:10.396701] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-09T19:41:11.062736] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:41:11.196695] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-09T19:41:11.996749] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-09T19:41:12.272049] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T19:41:12.674568] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T19:41:12.796727] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-09T19:41:13.391576] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:41:13.596729] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-09T19:41:14.396691] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-09T19:41:14.787556] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-09T19:41:14.836238] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T19:41:14.839329] [INFO ] [REMOTE ] JBND: Full fetch complete (34905 records). [2025-10-09T19:41:14.839425] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-09T19:41:15.202183] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-09T19:41:15.205120] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-09T19:41:15.205188] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-09T19:41:15.205959] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-09T19:41:15.206035] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-09T19:41:15.207263] [DEBUG] [LOCAL ] JBND: Trimmed 34905 records to 26753 (keeping 200 days of data) [2025-10-09T19:41:15.376928] [DEBUG] [LOCAL ] JBND: Primary data saved (26753 records). [2025-10-09T19:41:15.377060] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-09T19:41:15.377141] [INFO ] [MAIN ] Update Progress: 1146/2373 symbols completed. JBND took 30.8s. Estimated remaining: 2h 52m 35s. Rate: 7.1 symbols/min [2025-10-09T19:41:15.549427] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:15.595402] [DEBUG] [LOCAL ] JEF: Loaded 50129 existing records from primary storage. [2025-10-09T19:41:15.595755] [INFO ] [MAIN ] JEF: Loaded 50129 existing records. [2025-10-09T19:41:15.772337] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:15.772679] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-09T19:41:15.772755] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-09T19:41:15.773264] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-09T19:41:15.773326] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-09T19:41:15.879417] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:41:16.002376] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-09T19:41:16.147904] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:16.174116] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:41:16.646130] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T19:41:16.796687] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-09T19:41:17.560254] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T19:41:17.596668] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-09T19:41:18.257588] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T19:41:18.259305] [INFO ] [REMOTE ] JCE: Full fetch complete (9648 records). [2025-10-09T19:41:18.259378] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-09T19:41:18.400119] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-09T19:41:18.620265] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-09T19:41:18.620378] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-09T19:41:18.620628] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-09T19:41:18.620703] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-09T19:41:18.621122] [DEBUG] [LOCAL ] JCE: Trimmed 9648 records to 7225 (keeping 200 days of data) [2025-10-09T19:41:18.664230] [DEBUG] [LOCAL ] JCE: Primary data saved (7225 records). [2025-10-09T19:41:18.664320] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-09T19:41:18.664394] [INFO ] [MAIN ] Update Progress: 1147/2373 symbols completed. JCE took 28.1s. Estimated remaining: 2h 52m 21s. Rate: 7.1 symbols/min [2025-10-09T19:41:18.829597] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:18.870381] [DEBUG] [LOCAL ] JELD: Loaded 46112 existing records from primary storage. [2025-10-09T19:41:18.870791] [INFO ] [MAIN ] JELD: Loaded 46112 existing records. [2025-10-09T19:41:19.043517] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:19.043749] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-09T19:41:19.043806] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-09T19:41:19.044081] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-09T19:41:19.044137] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-09T19:41:19.214831] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-09T19:41:19.397752] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:19.996374] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T19:41:20.000434] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-09T19:41:20.796736] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-09T19:41:21.150310] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T19:41:21.480316] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T19:41:21.596775] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-09T19:41:22.321347] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T19:41:22.396682] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-09T19:41:22.573935] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T19:41:23.196729] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-09T19:41:23.892876] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:41:23.996694] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-09T19:41:24.628600] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T19:41:24.633019] [INFO ] [REMOTE ] JBL: Full fetch complete (70369 records). [2025-10-09T19:41:24.633160] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-09T19:41:24.799248] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-09T19:41:25.032089] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-09T19:41:25.032173] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-09T19:41:25.033281] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-09T19:41:25.033348] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-09T19:41:25.034706] [DEBUG] [LOCAL ] JBL: Trimmed 70369 records to 48733 (keeping 200 days of data) [2025-10-09T19:41:25.354263] [DEBUG] [LOCAL ] JBL: Primary data saved (48733 records). [2025-10-09T19:41:25.354637] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-09T19:41:25.354775] [INFO ] [MAIN ] Update Progress: 1148/2373 symbols completed. JBL took 49.7s. Estimated remaining: 2h 52m 11s. Rate: 7.1 symbols/min [2025-10-09T19:41:25.522894] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:25.534187] [DEBUG] [LOCAL ] JEQ: Loaded 8667 existing records from primary storage. [2025-10-09T19:41:25.534391] [INFO ] [MAIN ] JEQ: Loaded 8667 existing records. [2025-10-09T19:41:25.597582] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-09T19:41:25.714868] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:25.715363] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-09T19:41:25.715443] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-09T19:41:25.716045] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-09T19:41:25.716105] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-09T19:41:26.107747] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:26.110255] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T19:41:26.363938] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T19:41:26.396666] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-09T19:41:27.029194] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T19:41:27.196717] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-09T19:41:27.571585] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-09T19:41:27.996736] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-09T19:41:28.058267] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T19:41:28.415414] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T19:41:28.796745] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-09T19:41:29.348908] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T19:41:29.596696] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-09T19:41:30.396708] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-09T19:41:30.777162] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T19:41:31.196718] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-09T19:41:31.938718] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T19:41:31.996682] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-09T19:41:32.102256] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:41:32.796741] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-09T19:41:33.343745] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:41:33.596777] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-09T19:41:34.141026] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:41:34.396725] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-09T19:41:35.041905] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:41:35.196763] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-09T19:41:35.996729] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-09T19:41:36.064390] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T19:41:36.553605] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:41:36.757441] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:41:36.796744] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-09T19:41:37.596701] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-09T19:41:38.404561] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-09T19:41:38.407409] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T19:41:39.016262] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T19:41:39.061874] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T19:41:39.066365] [INFO ] [REMOTE ] JCI: Full fetch complete (77411 records). [2025-10-09T19:41:39.066497] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-09T19:41:39.205722] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-09T19:41:39.460069] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-09T19:41:39.460154] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-09T19:41:39.461149] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-09T19:41:39.461214] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-09T19:41:39.462789] [DEBUG] [LOCAL ] JCI: Trimmed 77411 records to 53928 (keeping 200 days of data) [2025-10-09T19:41:39.815276] [DEBUG] [LOCAL ] JCI: Primary data saved (53928 records). [2025-10-09T19:41:39.815423] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-09T19:41:39.815536] [INFO ] [MAIN ] Update Progress: 1149/2373 symbols completed. JCI took 39.5s. Estimated remaining: 2h 52m 9s. Rate: 7.1 symbols/min [2025-10-09T19:41:39.981021] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:39.998932] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-09T19:41:40.012232] [DEBUG] [LOCAL ] JFR: Loaded 31030 existing records from primary storage. [2025-10-09T19:41:40.012780] [INFO ] [MAIN ] JFR: Loaded 31030 existing records. [2025-10-09T19:41:40.187069] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:40.187283] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-09T19:41:40.187329] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-09T19:41:40.187556] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-09T19:41:40.187612] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-09T19:41:40.539742] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:40.796702] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-09T19:41:40.888867] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T19:41:41.365896] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:41:41.596724] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-09T19:41:41.796922] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T19:41:42.014814] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:41:42.396699] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-09T19:41:43.196777] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-09T19:41:43.996708] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-09T19:41:44.038686] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T19:41:44.073963] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T19:41:44.796725] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-09T19:41:45.446358] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T19:41:45.542465] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T19:41:45.596691] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-09T19:41:46.396781] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-09T19:41:46.694281] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:41:47.196730] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-09T19:41:47.676796] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T19:41:47.996693] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-09T19:41:48.160032] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:41:48.528056] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T19:41:48.529636] [INFO ] [REMOTE ] JEQ: Full fetch complete (11898 records). [2025-10-09T19:41:48.529734] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-09T19:41:48.801838] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-09T19:41:48.891598] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-09T19:41:48.891698] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-09T19:41:48.891981] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-09T19:41:48.892022] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-09T19:41:48.892473] [DEBUG] [LOCAL ] JEQ: Trimmed 11898 records to 8743 (keeping 200 days of data) [2025-10-09T19:41:48.944216] [DEBUG] [LOCAL ] JEQ: Primary data saved (8743 records). [2025-10-09T19:41:48.944355] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-09T19:41:48.944439] [INFO ] [MAIN ] Update Progress: 1150/2373 symbols completed. JEQ took 23.6s. Estimated remaining: 2h 52m 1s. Rate: 7.1 symbols/min [2025-10-09T19:41:49.110813] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:49.124331] [DEBUG] [LOCAL ] JGH: Loaded 11365 existing records from primary storage. [2025-10-09T19:41:49.124572] [INFO ] [MAIN ] JGH: Loaded 11365 existing records. [2025-10-09T19:41:49.303895] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:49.304133] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-09T19:41:49.304181] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-09T19:41:49.304354] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-09T19:41:49.304411] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-09T19:41:49.601911] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-09T19:41:49.812151] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:50.231688] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T19:41:50.396774] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-09T19:41:51.196742] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-09T19:41:51.294525] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:41:51.630747] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T19:41:51.996730] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-09T19:41:52.796715] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-09T19:41:52.972988] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T19:41:53.539149] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T19:41:53.596674] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-09T19:41:54.156940] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:41:54.396732] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-09T19:41:55.153554] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T19:41:55.157914] [INFO ] [REMOTE ] JELD: Full fetch complete (64136 records). [2025-10-09T19:41:55.158066] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-09T19:41:55.201939] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-09T19:41:55.538326] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-09T19:41:55.538443] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-09T19:41:55.539287] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-09T19:41:55.539349] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-09T19:41:55.540610] [DEBUG] [LOCAL ] JELD: Trimmed 64136 records to 46434 (keeping 200 days of data) [2025-10-09T19:41:55.805694] [DEBUG] [LOCAL ] JELD: Primary data saved (46434 records). [2025-10-09T19:41:55.805863] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-09T19:41:55.806001] [INFO ] [MAIN ] Update Progress: 1151/2373 symbols completed. JELD took 37.1s. Estimated remaining: 2h 51m 51s. Rate: 7.1 symbols/min [2025-10-09T19:41:55.975498] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:55.998315] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-09T19:41:56.018445] [DEBUG] [LOCAL ] JHG: Loaded 47568 existing records from primary storage. [2025-10-09T19:41:56.018782] [INFO ] [MAIN ] JHG: Loaded 47568 existing records. [2025-10-09T19:41:56.131824] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T19:41:56.157698] [INFO ] [REMOTE ] JEF: Full fetch complete (73024 records). [2025-10-09T19:41:56.185605] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-09T19:41:56.215926] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:56.236254] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-09T19:41:56.258006] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:41:56.257773] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-09T19:41:56.293173] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-09T19:41:56.298834] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-09T19:41:56.798505] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-09T19:41:57.011361] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-09T19:41:57.007759] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:57.011921] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-09T19:41:57.012977] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-09T19:41:57.013086] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-09T19:41:57.014713] [DEBUG] [LOCAL ] JEF: Trimmed 73024 records to 50519 (keeping 200 days of data) [2025-10-09T19:41:57.126053] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T19:41:57.349299] [DEBUG] [LOCAL ] JEF: Primary data saved (50519 records). [2025-10-09T19:41:57.349433] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-09T19:41:57.350127] [INFO ] [MAIN ] Update Progress: 1152/2373 symbols completed. JEF took 42.0s. Estimated remaining: 2h 51m 36s. Rate: 7.1 symbols/min [2025-10-09T19:41:57.528555] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:57.536066] [DEBUG] [LOCAL ] JHI: Loaded 3717 existing records from primary storage. [2025-10-09T19:41:57.536294] [INFO ] [MAIN ] JHI: Loaded 3717 existing records. [2025-10-09T19:41:57.603667] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-09T19:41:57.743068] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:57.743346] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-09T19:41:57.743396] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-09T19:41:57.743566] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-09T19:41:57.743694] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-09T19:41:57.856843] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T19:41:58.110305] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:58.396777] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-09T19:41:58.716575] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T19:41:59.196746] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-09T19:41:59.809583] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T19:41:59.996729] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-09T19:42:00.336665] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-09T19:42:00.796753] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-09T19:42:01.411272] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:42:01.596742] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-09T19:42:01.720545] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T19:42:02.396729] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-09T19:42:03.137234] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:42:03.196685] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-09T19:42:03.666928] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T19:42:04.001877] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-09T19:42:04.004088] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T19:42:04.796719] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-09T19:42:05.448472] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T19:42:05.596721] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-09T19:42:05.642618] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:42:06.190006] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T19:42:06.396757] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-09T19:42:06.951996] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T19:42:07.196795] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-09T19:42:07.753859] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T19:42:07.996718] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-09T19:42:08.801951] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-09T19:42:08.804107] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T19:42:09.596700] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-09T19:42:09.978554] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T19:42:10.396852] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-09T19:42:11.064967] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:42:11.196759] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-09T19:42:11.252865] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T19:42:11.996711] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-09T19:42:12.505061] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:42:12.508293] [INFO ] [REMOTE ] JFR: Full fetch complete (48219 records). [2025-10-09T19:42:12.508378] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-09T19:42:12.692072] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T19:42:12.801863] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-09T19:42:12.929612] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-09T19:42:12.929741] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-09T19:42:12.930530] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-09T19:42:12.930573] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-09T19:42:12.931576] [DEBUG] [LOCAL ] JFR: Trimmed 48219 records to 31188 (keeping 200 days of data) [2025-10-09T19:42:13.120742] [DEBUG] [LOCAL ] JFR: Primary data saved (31188 records). [2025-10-09T19:42:13.120893] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-09T19:42:13.120979] [INFO ] [MAIN ] Update Progress: 1153/2373 symbols completed. JFR took 33.3s. Estimated remaining: 2h 51m 35s. Rate: 7.1 symbols/min [2025-10-09T19:42:13.286752] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:42:13.292184] [DEBUG] [LOCAL ] JHS: Loaded 2900 existing records from primary storage. [2025-10-09T19:42:13.292347] [INFO ] [MAIN ] JHS: Loaded 2900 existing records. [2025-10-09T19:42:13.464328] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:42:13.464567] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-09T19:42:13.464614] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-09T19:42:13.464807] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-09T19:42:13.464863] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-09T19:42:13.606796] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-09T19:42:13.832058] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:42:14.146602] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:42:14.396689] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-09T19:42:14.591454] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T19:42:14.719332] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-09T19:42:15.196737] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-09T19:42:15.996719] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-09T19:42:16.163074] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T19:42:16.165605] [INFO ] [REMOTE ] JGH: Full fetch complete (15392 records). [2025-10-09T19:42:16.165795] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-09T19:42:16.459753] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T19:42:16.549521] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-09T19:42:16.549599] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-09T19:42:16.549987] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-09T19:42:16.550053] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-09T19:42:16.550606] [DEBUG] [LOCAL ] JGH: Trimmed 15392 records to 11697 (keeping 200 days of data) [2025-10-09T19:42:16.624534] [DEBUG] [LOCAL ] JGH: Primary data saved (11697 records). [2025-10-09T19:42:16.624696] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-09T19:42:16.624857] [INFO ] [MAIN ] Update Progress: 1154/2373 symbols completed. JGH took 27.7s. Estimated remaining: 2h 51m 21s. Rate: 7.1 symbols/min [2025-10-09T19:42:16.795762] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:42:16.796691] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-09T19:42:16.848423] [DEBUG] [LOCAL ] JHX: Loaded 53151 existing records from primary storage. [2025-10-09T19:42:16.848805] [INFO ] [MAIN ] JHX: Loaded 53151 existing records. [2025-10-09T19:42:17.032970] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:42:17.033232] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-09T19:42:17.033286] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-09T19:42:17.033520] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-09T19:42:17.033577] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-09T19:42:17.376663] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T19:42:17.398701] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:42:17.596713] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-09T19:42:18.181578] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T19:42:18.396731] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-09T19:42:19.196732] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-09T19:42:19.727568] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T19:42:19.996688] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-09T19:42:20.281265] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:42:20.796727] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-09T19:42:21.558197] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:42:21.596679] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-09T19:42:21.611532] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T19:42:22.266327] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T19:42:22.396753] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-09T19:42:23.196712] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-09T19:42:23.216191] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:42:23.996731] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-09T19:42:24.434671] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T19:42:24.796681] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-09T19:42:24.876738] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T19:42:25.161896] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T19:42:25.596707] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-09T19:42:25.947580] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T19:42:26.396730] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-09T19:42:26.791361] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-09T19:42:27.196750] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-09T19:42:27.996766] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-09T19:42:28.796753] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-09T19:42:28.829633] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T19:42:28.956360] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T19:42:29.284977] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T19:42:29.596708] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-09T19:42:30.040412] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T19:42:30.396730] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-09T19:42:30.854707] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T19:42:31.196772] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-09T19:42:31.677731] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T19:42:31.996751] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-09T19:42:32.488828] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T19:42:32.796742] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-09T19:42:33.369239] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T19:42:33.596734] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-09T19:42:34.396730] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-09T19:42:34.913480] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T19:42:34.916685] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T19:42:35.196710] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-09T19:42:35.718366] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T19:42:35.719234] [INFO ] [REMOTE ] JHS: Full fetch complete (4495 records). [2025-10-09T19:42:35.719302] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-09T19:42:36.001846] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-09T19:42:36.074834] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-09T19:42:36.074909] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-09T19:42:36.075051] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-09T19:42:36.075088] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-09T19:42:36.075437] [DEBUG] [LOCAL ] JHS: Trimmed 4495 records to 2942 (keeping 200 days of data) [2025-10-09T19:42:36.093600] [DEBUG] [LOCAL ] JHS: Primary data saved (2942 records). [2025-10-09T19:42:36.093689] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-09T19:42:36.093793] [INFO ] [MAIN ] Update Progress: 1155/2373 symbols completed. JHS took 23.0s. Estimated remaining: 2h 51m 24s. Rate: 7.1 symbols/min [2025-10-09T19:42:36.263841] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:42:36.281460] [DEBUG] [LOCAL ] JILL: Loaded 16249 existing records from primary storage. [2025-10-09T19:42:36.281717] [INFO ] [MAIN ] JILL: Loaded 16249 existing records. [2025-10-09T19:42:36.457221] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:42:36.457429] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-09T19:42:36.457487] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-09T19:42:36.457711] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-09T19:42:36.457772] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-09T19:42:36.559446] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T19:42:36.809476] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-09T19:42:36.815140] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:42:37.596724] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-09T19:42:38.194861] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T19:42:38.199516] [INFO ] [REMOTE ] JHG: Full fetch complete (68261 records). [2025-10-09T19:42:38.199761] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-09T19:42:38.411308] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-09T19:42:38.667753] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-09T19:42:38.667881] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-09T19:42:38.669186] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-09T19:42:38.669259] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-09T19:42:38.671037] [DEBUG] [LOCAL ] JHG: Trimmed 68261 records to 47922 (keeping 200 days of data) [2025-10-09T19:42:38.987883] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T19:42:38.990321] [INFO ] [REMOTE ] JHI: Full fetch complete (5435 records). [2025-10-09T19:42:38.991058] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-09T19:42:39.231143] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:42:39.218671] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-09T19:42:39.338969] [DEBUG] [LOCAL ] JHG: Primary data saved (47922 records). [2025-10-09T19:42:39.347422] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-09T19:42:39.349889] [INFO ] [MAIN ] Update Progress: 1156/2373 symbols completed. JHG took 43.5s. Estimated remaining: 2h 51m 11s. Rate: 7.1 symbols/min [2025-10-09T19:42:39.558889] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-09T19:42:39.564568] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-09T19:42:39.569972] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-09T19:42:39.580308] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-09T19:42:39.604554] [DEBUG] [LOCAL ] JHI: Trimmed 5435 records to 3850 (keeping 200 days of data) [2025-10-09T19:42:39.641226] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:42:39.666995] [DEBUG] [LOCAL ] JHI: Primary data saved (3850 records). [2025-10-09T19:42:39.667232] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-09T19:42:39.667340] [INFO ] [MAIN ] Update Progress: 1157/2373 symbols completed. JHI took 42.3s. Estimated remaining: 2h 50m 54s. Rate: 7.1 symbols/min [2025-10-09T19:42:39.697551] [DEBUG] [LOCAL ] JKS: Loaded 39841 existing records from primary storage. [2025-10-09T19:42:39.697920] [INFO ] [MAIN ] JKS: Loaded 39841 existing records. [2025-10-09T19:42:39.875483] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:42:39.875724] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-09T19:42:39.875780] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-09T19:42:39.876058] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-09T19:42:39.876117] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-09T19:42:40.001864] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-09T19:42:40.239417] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:42:40.250721] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:42:40.796732] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-09T19:42:41.591620] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T19:42:41.596672] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-09T19:42:41.847585] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:42:42.375170] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T19:42:42.396668] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-09T19:42:43.196702] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-09T19:42:43.384636] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T19:42:43.996760] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-09T19:42:44.561397] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T19:42:44.796702] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-09T19:42:44.973529] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T19:42:45.596729] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-09T19:42:46.396700] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-09T19:42:46.549291] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T19:42:47.031081] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:42:47.196691] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-09T19:42:47.395719] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T19:42:47.996730] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-09T19:42:48.796743] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-09T19:42:49.159638] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-09T19:42:49.256756] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T19:42:49.426286] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T19:42:49.596763] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-09T19:42:50.396738] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-09T19:42:51.145857] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:42:51.196675] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-09T19:42:51.905083] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:42:51.996735] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-09T19:42:52.677293] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:42:52.796732] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-09T19:42:53.011575] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-09T19:42:53.018240] [INFO ] [REMOTE ] JHX: Full fetch complete (60093 records). [2025-10-09T19:42:53.018389] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-09T19:42:53.410055] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-09T19:42:53.410170] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-09T19:42:53.411100] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-09T19:42:53.411168] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-09T19:42:53.415506] [DEBUG] [LOCAL ] JHX: Trimmed 60093 records to 53541 (keeping 200 days of data) [2025-10-09T19:42:53.619482] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-09T19:42:53.736293] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-09T19:42:53.758782] [DEBUG] [LOCAL ] JHX: Primary data saved (53541 records). [2025-10-09T19:42:53.758940] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-09T19:42:53.759046] [INFO ] [MAIN ] Update Progress: 1158/2373 symbols completed. JHX took 37.1s. Estimated remaining: 2h 50m 51s. Rate: 7.1 symbols/min [2025-10-09T19:42:54.396757] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-09T19:42:55.206245] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:42:55.215668] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-09T19:42:55.348201] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:42:55.996840] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-09T19:42:56.836464] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:42:56.838494] [INFO ] [REMOTE ] JILL: Full fetch complete (22566 records). [2025-10-09T19:42:56.838575] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-09T19:42:57.232992] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-09T19:42:57.243569] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-09T19:42:57.249809] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-09T19:42:57.249904] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-09T19:42:57.264589] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T19:42:57.264790] [DEBUG] [LOCAL ] JILL: Trimmed 22566 records to 16360 (keeping 200 days of data) [2025-10-09T19:42:57.277581] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-09T19:42:57.393944] [DEBUG] [LOCAL ] JILL: Primary data saved (16360 records). [2025-10-09T19:42:57.394177] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-09T19:42:57.394289] [INFO ] [MAIN ] Update Progress: 1159/2373 symbols completed. JILL took 21.3s. Estimated remaining: 2h 50m 38s. Rate: 7.1 symbols/min [2025-10-09T19:42:58.746029] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:42:58.754493] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-09T19:43:00.173264] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T19:43:00.183327] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-09T19:43:01.808380] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:43:01.818081] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-09T19:43:03.041037] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T19:43:03.048743] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-09T19:43:04.670495] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:43:04.679362] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-09T19:43:06.124994] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:43:06.128672] [INFO ] [REMOTE ] JKS: Full fetch complete (58740 records). [2025-10-09T19:43:06.128771] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-09T19:43:06.511825] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-09T19:43:06.511920] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-09T19:43:06.512790] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-09T19:43:06.512856] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-09T19:43:06.514201] [DEBUG] [LOCAL ] JKS: Trimmed 58740 records to 40155 (keeping 200 days of data) [2025-10-09T19:43:06.759827] [DEBUG] [LOCAL ] JKS: Primary data saved (40155 records). [2025-10-09T19:43:06.759959] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-09T19:43:06.760041] [INFO ] [MAIN ] Update Progress: 1160/2373 symbols completed. JKS took 27.4s. Estimated remaining: 2h 50m 30s. Rate: 7.1 symbols/min [2025-10-09T19:43:07.387354] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:07.456795] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:07.491798] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:07.507781] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-09T19:43:07.535526] [DEBUG] [LOCAL ] JLS: Loaded 4144 existing records from primary storage. [2025-10-09T19:43:07.545756] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-09T19:43:07.569478] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-09T19:43:07.569151] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:07.543331] [INFO ] [MAIN ] JLS: Loaded 4144 existing records. [2025-10-09T19:43:07.575376] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-09T19:43:07.591381] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-09T19:43:07.613134] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-09T19:43:07.918400] [DEBUG] [LOCAL ] JLL: Loaded 31422 existing records from primary storage. [2025-10-09T19:43:07.960299] [INFO ] [MAIN ] JLL: Loaded 31422 existing records. [2025-10-09T19:43:08.026978] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:08.044109] [DEBUG] [LOCAL ] JMIA: Loaded 50849 existing records from primary storage. [2025-10-09T19:43:08.056925] [INFO ] [MAIN ] JMIA: Loaded 50849 existing records. [2025-10-09T19:43:08.057019] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-09T19:43:08.125874] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-09T19:43:08.278425] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-09T19:43:08.347588] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-09T19:43:08.557746] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:08.678366] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:08.666353] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-09T19:43:08.678740] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-09T19:43:08.691020] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-09T19:43:08.717058] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:08.733937] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-09T19:43:08.733867] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-09T19:43:08.751861] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-09T19:43:08.757105] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-09T19:43:08.773164] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-09T19:43:08.830095] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-09T19:43:09.477595] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T19:43:09.538680] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:09.564687] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-09T19:43:09.594821] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-09T19:43:09.738510] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:09.761219] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-09T19:43:09.760908] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:09.762340] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-09T19:43:10.066841] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T19:43:10.067978] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-09T19:43:10.210984] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T19:43:10.212470] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-09T19:43:10.502066] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T19:43:10.503228] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-09T19:43:10.702987] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T19:43:10.704569] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-09T19:43:10.820618] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-09T19:43:10.821539] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-09T19:43:11.046006] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:43:11.051615] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-09T19:43:11.272816] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T19:43:11.272707] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T19:43:11.274158] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-09T19:43:11.276222] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-09T19:43:11.632263] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T19:43:11.635732] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T19:43:11.650602] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T19:43:11.996715] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-09T19:43:12.014461] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T19:43:12.569289] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T19:43:12.796720] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-09T19:43:13.154394] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T19:43:13.596754] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-09T19:43:14.147280] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T19:43:14.396732] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-09T19:43:14.759914] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-09T19:43:15.196729] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-09T19:43:15.996694] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-09T19:43:16.608267] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T19:43:16.796704] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-09T19:43:16.888932] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T19:43:17.161291] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T19:43:17.596728] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-09T19:43:18.396770] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-09T19:43:18.965163] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T19:43:19.196723] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-09T19:43:19.241538] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:43:19.996777] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-09T19:43:20.432618] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T19:43:20.447064] [INFO ] [REMOTE ] JMM: Full fetch complete (2313 records). [2025-10-09T19:43:20.449359] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-09T19:43:20.450170] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T19:43:20.630433] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-09T19:43:20.630611] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:43:20.630691] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:43:20.630748] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-09T19:43:20.630809] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-09T19:43:20.630844] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-09T19:43:20.630902] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-09T19:43:20.630979] [INFO ] [MAIN ] Update Progress: 1161/2373 symbols completed. JMM took 13.9s. Estimated remaining: 2h 50m 27s. Rate: 7.1 symbols/min [2025-10-09T19:43:20.793619] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:20.796728] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-09T19:43:20.844782] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-09T19:43:20.845094] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-09T19:43:21.024498] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:21.024778] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-09T19:43:21.024855] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-09T19:43:21.025097] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-09T19:43:21.025152] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-09T19:43:21.368687] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:21.596711] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-09T19:43:22.396745] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-09T19:43:22.587108] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T19:43:23.196749] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-09T19:43:23.750614] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:43:23.796258] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T19:43:23.996694] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-09T19:43:24.046809] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-09T19:43:24.796717] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-09T19:43:25.071834] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T19:43:25.596756] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-09T19:43:26.396744] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-09T19:43:26.983376] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T19:43:27.037275] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-09T19:43:27.196692] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-09T19:43:27.803212] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T19:43:27.996738] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-09T19:43:28.796734] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-09T19:43:28.918283] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T19:43:29.285103] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:43:29.596747] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-09T19:43:30.396713] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-09T19:43:30.624037] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T19:43:30.957251] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T19:43:31.196741] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-09T19:43:31.690207] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:43:31.811814] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-09T19:43:31.996717] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-09T19:43:32.796779] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-09T19:43:33.362783] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T19:43:33.596715] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-09T19:43:34.126354] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T19:43:34.219061] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T19:43:34.220099] [INFO ] [REMOTE ] JLS: Full fetch complete (5823 records). [2025-10-09T19:43:34.220173] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-09T19:43:34.406243] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-09T19:43:34.610238] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-09T19:43:34.610321] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-09T19:43:34.610498] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-09T19:43:34.610537] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-09T19:43:34.610931] [DEBUG] [LOCAL ] JLS: Trimmed 5823 records to 4181 (keeping 200 days of data) [2025-10-09T19:43:34.636659] [DEBUG] [LOCAL ] JLS: Primary data saved (4181 records). [2025-10-09T19:43:34.636735] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-09T19:43:34.636885] [INFO ] [MAIN ] Update Progress: 1162/2373 symbols completed. JLS took 27.9s. Estimated remaining: 2h 50m 25s. Rate: 7.1 symbols/min [2025-10-09T19:43:34.801147] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:34.851939] [DEBUG] [LOCAL ] JOBY: Loaded 53801 existing records from primary storage. [2025-10-09T19:43:34.852250] [INFO ] [MAIN ] JOBY: Loaded 53801 existing records. [2025-10-09T19:43:35.030627] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:35.031679] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-09T19:43:35.031738] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-09T19:43:35.032400] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-09T19:43:35.032458] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-09T19:43:35.202088] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-09T19:43:35.382058] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:35.996744] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-09T19:43:36.796774] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-09T19:43:36.889503] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-09T19:43:36.955698] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T19:43:37.204435] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T19:43:37.596727] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-09T19:43:38.396721] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-09T19:43:39.196701] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-09T19:43:39.377595] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-09T19:43:39.818669] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-09T19:43:39.996693] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-09T19:43:40.138737] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T19:43:40.540458] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-09T19:43:40.796719] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-09T19:43:41.596727] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-09T19:43:42.396699] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-09T19:43:42.522168] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-09T19:43:42.733756] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T19:43:42.736404] [INFO ] [REMOTE ] JLL: Full fetch complete (44741 records). [2025-10-09T19:43:42.736548] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-09T19:43:43.104603] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-09T19:43:43.159477] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-09T19:43:43.159573] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-09T19:43:43.160377] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-09T19:43:43.160474] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-09T19:43:43.161939] [DEBUG] [LOCAL ] JLL: Trimmed 44741 records to 31654 (keeping 200 days of data) [2025-10-09T19:43:43.217240] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-09T19:43:43.361987] [DEBUG] [LOCAL ] JLL: Primary data saved (31654 records). [2025-10-09T19:43:43.362136] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-09T19:43:43.362221] [INFO ] [MAIN ] Update Progress: 1163/2373 symbols completed. JLL took 36.6s. Estimated remaining: 2h 50m 17s. Rate: 7.1 symbols/min [2025-10-09T19:43:43.526456] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:43.548365] [DEBUG] [LOCAL ] JOE: Loaded 23935 existing records from primary storage. [2025-10-09T19:43:43.548604] [INFO ] [MAIN ] JOE: Loaded 23935 existing records. [2025-10-09T19:43:43.723558] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:43.723838] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-09T19:43:43.723889] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-09T19:43:43.724109] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-09T19:43:43.724168] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-09T19:43:43.999270] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-09T19:43:44.080726] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:44.550639] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-09T19:43:44.796784] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-09T19:43:45.596770] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-09T19:43:45.683434] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-09T19:43:46.320289] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-09T19:43:46.396677] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-09T19:43:46.699710] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-09T19:43:46.704430] [INFO ] [REMOTE ] JMIA: Full fetch complete (73287 records). [2025-10-09T19:43:46.704570] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-09T19:43:47.051554] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:43:47.155843] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-09T19:43:47.155940] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-09T19:43:47.156937] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-09T19:43:47.157011] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-09T19:43:47.158747] [DEBUG] [LOCAL ] JMIA: Trimmed 73287 records to 51233 (keeping 200 days of data) [2025-10-09T19:43:47.207478] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-09T19:43:47.460337] [DEBUG] [LOCAL ] JMIA: Primary data saved (51233 records). [2025-10-09T19:43:47.460474] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-09T19:43:47.462115] [INFO ] [MAIN ] Update Progress: 1164/2373 symbols completed. JMIA took 40.7s. Estimated remaining: 2h 50m 4s. Rate: 7.1 symbols/min [2025-10-09T19:43:47.627733] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:47.639773] [DEBUG] [LOCAL ] JOF: Loaded 6878 existing records from primary storage. [2025-10-09T19:43:47.640028] [INFO ] [MAIN ] JOF: Loaded 6878 existing records. [2025-10-09T19:43:47.813085] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:47.813278] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-09T19:43:47.813323] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-09T19:43:47.813478] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-09T19:43:47.813536] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-09T19:43:48.016795] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-09T19:43:48.167118] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:48.336702] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T19:43:48.593308] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T19:43:48.796760] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-09T19:43:49.596731] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-09T19:43:49.902769] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:43:50.396740] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-09T19:43:50.506021] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-09T19:43:51.196792] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-09T19:43:51.509501] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T19:43:51.566913] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:43:51.906600] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T19:43:51.996814] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-09T19:43:52.796765] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-09T19:43:53.596725] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-09T19:43:53.854268] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T19:43:54.204265] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:43:54.382244] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-09T19:43:54.396669] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-09T19:43:55.196731] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-09T19:43:55.996791] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-09T19:43:56.796741] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-09T19:43:56.978619] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-09T19:43:57.097904] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-09T19:43:57.102812] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-09T19:43:57.102958] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-09T19:43:57.293934] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:43:57.423276] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T19:43:57.531322] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-09T19:43:57.531412] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-09T19:43:57.532492] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-09T19:43:57.532559] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-09T19:43:57.534257] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54143 (keeping 200 days of data) [2025-10-09T19:43:57.603086] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-09T19:43:57.885894] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-10-09T19:43:57.886051] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-09T19:43:57.886140] [INFO ] [MAIN ] Update Progress: 1165/2373 symbols completed. JNJ took 37.3s. Estimated remaining: 2h 49m 57s. Rate: 7.1 symbols/min [2025-10-09T19:43:58.052192] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:58.086569] [DEBUG] [LOCAL ] JPC: Loaded 37230 existing records from primary storage. [2025-10-09T19:43:58.086898] [INFO ] [MAIN ] JPC: Loaded 37230 existing records. [2025-10-09T19:43:58.267005] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:58.267243] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-09T19:43:58.267300] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-09T19:43:58.267514] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-09T19:43:58.267570] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-09T19:43:58.384106] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:43:58.401568] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-09T19:43:58.641760] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:59.196717] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-09T19:43:59.996685] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-09T19:44:00.021301] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T19:44:00.796775] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-09T19:44:00.804812] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T19:44:00.968309] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-09T19:44:01.596737] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-09T19:44:01.948611] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T19:44:02.396739] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-09T19:44:02.832914] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:44:03.196726] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-09T19:44:03.480849] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T19:44:03.996801] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-09T19:44:04.796684] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-09T19:44:05.193259] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:44:05.393983] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T19:44:05.596726] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-09T19:44:05.712956] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-09T19:44:05.977832] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-09T19:44:06.396723] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-09T19:44:07.085610] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T19:44:07.196698] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-09T19:44:07.996700] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-09T19:44:08.557458] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T19:44:08.796732] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-09T19:44:09.596744] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-09T19:44:09.946374] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:44:09.952133] [INFO ] [REMOTE ] JOE: Full fetch complete (35723 records). [2025-10-09T19:44:09.952251] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-09T19:44:10.275497] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-10-09T19:44:10.309515] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T19:44:10.382153] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-09T19:44:10.382226] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-09T19:44:10.382894] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-09T19:44:10.382956] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-09T19:44:10.383736] [DEBUG] [LOCAL ] JOE: Trimmed 35723 records to 24061 (keeping 200 days of data) [2025-10-09T19:44:10.438542] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-09T19:44:10.542995] [DEBUG] [LOCAL ] JOE: Primary data saved (24061 records). [2025-10-09T19:44:10.543127] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-09T19:44:10.543210] [INFO ] [MAIN ] Update Progress: 1166/2373 symbols completed. JOE took 27.2s. Estimated remaining: 2h 49m 53s. Rate: 7.1 symbols/min [2025-10-09T19:44:10.708630] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:10.761610] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-09T19:44:10.762019] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-09T19:44:10.936119] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:10.936388] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-09T19:44:10.936447] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-09T19:44:10.936721] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-09T19:44:10.936780] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-09T19:44:11.203730] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-09T19:44:11.285602] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:11.709603] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T19:44:11.982965] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T19:44:11.984075] [INFO ] [REMOTE ] JOF: Full fetch complete (9478 records). [2025-10-09T19:44:11.984144] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-09T19:44:12.004380] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-09T19:44:12.359006] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-09T19:44:12.359099] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-09T19:44:12.359338] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-09T19:44:12.359378] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-09T19:44:12.359828] [DEBUG] [LOCAL ] JOF: Trimmed 9478 records to 6915 (keeping 200 days of data) [2025-10-09T19:44:12.400731] [DEBUG] [LOCAL ] JOF: Primary data saved (6915 records). [2025-10-09T19:44:12.400832] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-09T19:44:12.400908] [INFO ] [MAIN ] Update Progress: 1167/2373 symbols completed. JOF took 24.9s. Estimated remaining: 2h 49m 38s. Rate: 7.1 symbols/min [2025-10-09T19:44:12.569451] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:12.605472] [DEBUG] [LOCAL ] JQC: Loaded 34236 existing records from primary storage. [2025-10-09T19:44:12.605788] [INFO ] [MAIN ] JQC: Loaded 34236 existing records. [2025-10-09T19:44:12.818893] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:12.814089] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-09T19:44:12.819782] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-09T19:44:12.819836] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-09T19:44:12.820078] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-09T19:44:12.820145] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-09T19:44:13.187139] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:13.596699] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-09T19:44:13.885807] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T19:44:14.403354] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-09T19:44:14.409581] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-09T19:44:15.196722] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-09T19:44:15.818016] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T19:44:15.946952] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-09T19:44:15.996676] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-09T19:44:16.796728] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-09T19:44:17.595053] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-09T19:44:17.606738] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-09T19:44:18.088761] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:44:18.396726] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-09T19:44:18.744222] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-09T19:44:18.749554] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-09T19:44:18.749721] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-09T19:44:19.206684] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-09T19:44:19.231267] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-09T19:44:19.231399] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-09T19:44:19.232478] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-09T19:44:19.232837] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-09T19:44:19.266552] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:44:19.266716] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54191 (keeping 200 days of data) [2025-10-09T19:44:19.610274] [DEBUG] [LOCAL ] JOBY: Primary data saved (54191 records). [2025-10-09T19:44:19.610462] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-09T19:44:19.610562] [INFO ] [MAIN ] Update Progress: 1168/2373 symbols completed. JOBY took 45.0s. Estimated remaining: 2h 49m 28s. Rate: 7.1 symbols/min [2025-10-09T19:44:19.780388] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:19.797535] [DEBUG] [LOCAL ] JRI: Loaded 15167 existing records from primary storage. [2025-10-09T19:44:19.797870] [INFO ] [MAIN ] JRI: Loaded 15167 existing records. [2025-10-09T19:44:19.993069] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:19.993358] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-09T19:44:19.993426] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-09T19:44:19.993678] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-09T19:44:19.993764] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-09T19:44:20.028791] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-09T19:44:20.384399] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:20.556712] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-09T19:44:20.625130] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T19:44:20.796716] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-09T19:44:21.492526] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:44:21.596680] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-09T19:44:21.761889] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T19:44:22.396775] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-09T19:44:22.683207] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T19:44:23.196693] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-09T19:44:23.349361] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T19:44:23.996714] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-09T19:44:24.696538] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T19:44:24.796718] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-09T19:44:24.904046] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T19:44:25.596712] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-09T19:44:25.869675] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:44:26.396685] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-09T19:44:27.168947] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:44:27.196687] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-09T19:44:27.999966] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-09T19:44:28.005978] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-09T19:44:28.639146] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:44:28.796706] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-09T19:44:28.900590] [DEBUG] [REMOTE ] JPC: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-09T19:44:28.900888] [WARN ] [REMOTE ] JPC: No data returned for month 2025-08 [2025-10-09T19:44:28.900991] [FATAL] [REMOTE ] JPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:44:28.901088] [FATAL] [MAIN ] JPC: Failed to fetch primary data. [2025-10-09T19:44:28.901151] [WARN ] [MAIN ] JPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:44:28.901222] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-09T19:44:28.901284] [DEBUG] [LOCAL ] JPC: No primary data file found to delete. [2025-10-09T19:44:28.901319] [INFO ] [LOCAL ] JPC: Starting deletion of derivative data. [2025-10-09T19:44:28.901578] [DEBUG] [LOCAL ] JPC: Deleted derivative data file. [2025-10-09T19:44:28.901710] [INFO ] [MAIN ] Update Progress: 1169/2373 symbols completed. JPC took 31.0s. Estimated remaining: 2h 49m 21s. Rate: 7.1 symbols/min [2025-10-09T19:44:29.069842] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:29.082433] [DEBUG] [LOCAL ] JRS: Loaded 11551 existing records from primary storage. [2025-10-09T19:44:29.082631] [INFO ] [MAIN ] JRS: Loaded 11551 existing records. [2025-10-09T19:44:29.261077] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:29.261255] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-09T19:44:29.261301] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-09T19:44:29.261459] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-09T19:44:29.261516] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-09T19:44:29.571357] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:44:29.600097] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-09T19:44:29.662189] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:30.396720] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-09T19:44:31.196730] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-09T19:44:31.519727] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T19:44:31.905171] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-09T19:44:31.951279] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T19:44:31.996726] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-09T19:44:32.796738] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-09T19:44:33.427307] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T19:44:33.596718] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-09T19:44:33.721126] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T19:44:34.396716] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-09T19:44:34.724009] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T19:44:35.200448] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-09T19:44:35.203283] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T19:44:35.996685] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-09T19:44:36.021378] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T19:44:36.766631] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:44:36.796679] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-09T19:44:37.340792] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:44:37.596727] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-09T19:44:38.396728] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-09T19:44:38.885253] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T19:44:39.196790] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-09T19:44:39.996774] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-09T19:44:40.151224] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T19:44:40.394368] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T19:44:40.587239] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-09T19:44:40.796715] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-09T19:44:41.596777] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-09T19:44:42.319951] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T19:44:42.396766] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-09T19:44:42.938714] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T19:44:43.183235] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T19:44:43.196668] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-09T19:44:43.996774] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-09T19:44:44.181277] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T19:44:44.752177] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:44:44.796780] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-09T19:44:45.596741] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-09T19:44:45.917209] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:44:45.920591] [INFO ] [REMOTE ] JQC: Full fetch complete (49423 records). [2025-10-09T19:44:45.920729] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-09T19:44:46.305104] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-09T19:44:46.305183] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-09T19:44:46.306073] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-09T19:44:46.306138] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-09T19:44:46.307131] [DEBUG] [LOCAL ] JQC: Trimmed 49423 records to 34386 (keeping 200 days of data) [2025-10-09T19:44:46.401304] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-09T19:44:46.510862] [DEBUG] [LOCAL ] JQC: Primary data saved (34386 records). [2025-10-09T19:44:46.511007] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-09T19:44:46.511093] [INFO ] [MAIN ] Update Progress: 1170/2373 symbols completed. JQC took 34.1s. Estimated remaining: 2h 49m 22s. Rate: 7.1 symbols/min [2025-10-09T19:44:46.645811] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T19:44:46.693059] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:46.734697] [DEBUG] [LOCAL ] JXN: Loaded 45065 existing records from primary storage. [2025-10-09T19:44:46.735021] [INFO ] [MAIN ] JXN: Loaded 45065 existing records. [2025-10-09T19:44:46.916414] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:46.916716] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-09T19:44:46.916778] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-09T19:44:46.916965] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-09T19:44:46.917022] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-09T19:44:47.197529] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-09T19:44:47.276244] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:47.996767] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-09T19:44:48.009044] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T19:44:48.646517] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-09T19:44:48.796702] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-09T19:44:49.074943] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:44:49.596745] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-09T19:44:50.306542] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T19:44:50.308751] [INFO ] [REMOTE ] JRI: Full fetch complete (23286 records). [2025-10-09T19:44:50.308840] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-09T19:44:50.403979] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-09T19:44:50.671404] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-09T19:44:50.671482] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-09T19:44:50.672012] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-09T19:44:50.672074] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-09T19:44:50.672699] [DEBUG] [LOCAL ] JRI: Trimmed 23286 records to 15351 (keeping 200 days of data) [2025-10-09T19:44:50.770848] [DEBUG] [LOCAL ] JRI: Primary data saved (15351 records). [2025-10-09T19:44:50.771042] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-09T19:44:50.771191] [INFO ] [MAIN ] Update Progress: 1171/2373 symbols completed. JRI took 31.2s. Estimated remaining: 2h 49m 9s. Rate: 7.1 symbols/min [2025-10-09T19:44:50.942465] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:50.988058] [DEBUG] [LOCAL ] K: Loaded 50112 existing records from primary storage. [2025-10-09T19:44:50.988406] [INFO ] [MAIN ] K: Loaded 50112 existing records. [2025-10-09T19:44:51.166453] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:51.166760] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-09T19:44:51.166819] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-09T19:44:51.167149] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-09T19:44:51.167256] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-09T19:44:51.198112] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-09T19:44:51.317894] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-09T19:44:51.625062] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:51.889837] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T19:44:51.996676] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-09T19:44:52.228585] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:44:52.796698] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-09T19:44:53.419027] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T19:44:53.596499] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T19:44:53.599515] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-09T19:44:54.396721] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-09T19:44:55.137956] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T19:44:55.196682] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-09T19:44:55.996746] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-09T19:44:56.009291] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T19:44:56.011106] [INFO ] [REMOTE ] JRS: Full fetch complete (16338 records). [2025-10-09T19:44:56.011179] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-09T19:44:56.434056] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-09T19:44:56.472469] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-09T19:44:56.472713] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-09T19:44:56.473183] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-09T19:44:56.473253] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-09T19:44:56.474560] [DEBUG] [LOCAL ] JRS: Trimmed 16338 records to 11656 (keeping 200 days of data) [2025-10-09T19:44:56.547725] [DEBUG] [LOCAL ] JRS: Primary data saved (11656 records). [2025-10-09T19:44:56.547884] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-09T19:44:56.547983] [INFO ] [MAIN ] Update Progress: 1172/2373 symbols completed. JRS took 27.6s. Estimated remaining: 2h 48m 58s. Rate: 7.1 symbols/min [2025-10-09T19:44:56.716904] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:56.731865] [DEBUG] [LOCAL ] KAI: Loaded 13277 existing records from primary storage. [2025-10-09T19:44:56.732108] [INFO ] [MAIN ] KAI: Loaded 13277 existing records. [2025-10-09T19:44:56.805627] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-09T19:44:56.911562] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:56.911866] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-09T19:44:56.911915] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-09T19:44:56.912144] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-09T19:44:56.912201] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-09T19:44:57.263921] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:57.596785] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-09T19:44:57.819086] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:44:58.240887] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T19:44:58.396735] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-09T19:44:59.197447] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-09T19:44:59.197056] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-09T19:44:59.203448] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-09T19:44:59.203549] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-09T19:44:59.614530] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-09T19:44:59.614669] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-09T19:44:59.615829] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-09T19:44:59.615936] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-09T19:44:59.617548] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54184 (keeping 200 days of data) [2025-10-09T19:44:59.888733] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T19:45:00.002513] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-09T19:45:00.006825] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-10-09T19:45:00.007165] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-09T19:45:00.007930] [INFO ] [MAIN ] Update Progress: 1173/2373 symbols completed. JPM took 49.5s. Estimated remaining: 2h 48m 44s. Rate: 7.1 symbols/min [2025-10-09T19:45:00.176665] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:00.214748] [DEBUG] [LOCAL ] KAR: Loaded 40090 existing records from primary storage. [2025-10-09T19:45:00.215043] [INFO ] [MAIN ] KAR: Loaded 40090 existing records. [2025-10-09T19:45:00.386246] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:00.386458] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-09T19:45:00.386504] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-09T19:45:00.386797] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-09T19:45:00.386868] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-09T19:45:00.743355] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:00.770030] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:45:00.796665] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-09T19:45:01.584413] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:45:01.596673] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-09T19:45:02.210168] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:45:02.396747] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-09T19:45:03.051608] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T19:45:03.196778] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-09T19:45:03.578281] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T19:45:03.996692] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-09T19:45:04.773021] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T19:45:04.796708] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-09T19:45:04.959417] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T19:45:05.596777] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-09T19:45:05.970249] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:45:06.396729] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-09T19:45:06.834433] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T19:45:07.196777] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-09T19:45:07.996691] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-09T19:45:08.221334] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:45:08.256356] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T19:45:08.796735] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-09T19:45:09.523578] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:45:09.596698] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-09T19:45:10.054777] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T19:45:10.396715] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-09T19:45:11.201871] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-09T19:45:11.217241] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:45:11.562440] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:45:11.996721] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-09T19:45:12.796690] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-09T19:45:12.937955] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T19:45:13.444360] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T19:45:13.596690] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-09T19:45:13.636138] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T19:45:14.396743] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-09T19:45:14.786740] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:45:14.791120] [INFO ] [REMOTE ] JXN: Full fetch complete (65125 records). [2025-10-09T19:45:14.791273] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-09T19:45:15.208849] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-09T19:45:15.212210] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-09T19:45:15.213294] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-09T19:45:15.214250] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-09T19:45:15.214322] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-09T19:45:15.215961] [DEBUG] [LOCAL ] JXN: Trimmed 65125 records to 45365 (keeping 200 days of data) [2025-10-09T19:45:15.500617] [DEBUG] [LOCAL ] JXN: Primary data saved (45365 records). [2025-10-09T19:45:15.500784] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-09T19:45:15.500874] [INFO ] [MAIN ] Update Progress: 1174/2373 symbols completed. JXN took 29.0s. Estimated remaining: 2h 48m 43s. Rate: 7.1 symbols/min [2025-10-09T19:45:15.667439] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:15.691333] [DEBUG] [LOCAL ] KB: Loaded 23644 existing records from primary storage. [2025-10-09T19:45:15.691593] [INFO ] [MAIN ] KB: Loaded 23644 existing records. [2025-10-09T19:45:15.868302] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:15.868540] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-09T19:45:15.868591] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-09T19:45:15.868844] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-09T19:45:15.868903] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-09T19:45:16.011455] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-09T19:45:16.234860] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:16.265044] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T19:45:16.274022] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:45:16.796731] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-09T19:45:17.485069] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:45:17.596694] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-09T19:45:17.717350] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:45:18.396740] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-09T19:45:19.196700] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-09T19:45:19.461887] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T19:45:19.570321] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T19:45:19.848719] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T19:45:19.996702] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-09T19:45:20.796731] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-09T19:45:21.596720] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-09T19:45:21.789917] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T19:45:22.083442] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T19:45:22.396737] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-09T19:45:22.851516] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:45:23.096611] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T19:45:23.196714] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-09T19:45:23.996710] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-09T19:45:24.434544] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T19:45:24.616156] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T19:45:24.796719] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-09T19:45:25.323888] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T19:45:25.596723] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-09T19:45:26.396702] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-09T19:45:26.712577] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T19:45:27.196785] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-09T19:45:27.995345] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:45:27.998830] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-09T19:45:27.999902] [INFO ] [REMOTE ] KAR: Full fetch complete (56830 records). [2025-10-09T19:45:28.000040] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-09T19:45:28.386494] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-09T19:45:28.386572] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-09T19:45:28.387420] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-09T19:45:28.387481] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-09T19:45:28.388676] [DEBUG] [LOCAL ] KAR: Trimmed 56830 records to 40359 (keeping 200 days of data) [2025-10-09T19:45:28.639752] [DEBUG] [LOCAL ] KAR: Primary data saved (40359 records). [2025-10-09T19:45:28.640009] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-09T19:45:28.640682] [INFO ] [MAIN ] Update Progress: 1175/2373 symbols completed. KAR took 28.6s. Estimated remaining: 2h 48m 39s. Rate: 7.1 symbols/min [2025-10-09T19:45:28.797523] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-09T19:45:28.818213] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:28.845125] [DEBUG] [LOCAL ] KBDC: Loaded 21569 existing records from primary storage. [2025-10-09T19:45:28.845394] [INFO ] [MAIN ] KBDC: Loaded 21569 existing records. [2025-10-09T19:45:28.994417] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T19:45:29.018380] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T19:45:29.093923] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:29.094273] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-09T19:45:29.094329] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-09T19:45:29.094594] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-09T19:45:29.094695] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-09T19:45:29.445114] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:29.596689] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-09T19:45:29.931822] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:45:30.396702] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-09T19:45:30.473480] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:45:31.196769] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-09T19:45:31.682439] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T19:45:31.956107] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T19:45:31.996698] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-09T19:45:32.796741] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-09T19:45:33.596744] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-09T19:45:33.813276] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-09T19:45:33.823276] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T19:45:33.825632] [INFO ] [REMOTE ] K: Full fetch complete (72084 records). [2025-10-09T19:45:33.826257] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-09T19:45:33.826340] [INFO ] [REMOTE ] KAI: Full fetch complete (18812 records). [2025-10-09T19:45:33.826578] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-09T19:45:34.401806] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-09T19:45:34.604577] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-09T19:45:34.622473] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-09T19:45:34.622680] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-09T19:45:34.621770] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-09T19:45:34.623098] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-09T19:45:34.624170] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-09T19:45:34.624284] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-09T19:45:34.624387] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-09T19:45:34.625807] [DEBUG] [LOCAL ] KAI: Trimmed 18812 records to 13436 (keeping 200 days of data) [2025-10-09T19:45:34.626608] [DEBUG] [LOCAL ] K: Trimmed 72084 records to 50465 (keeping 200 days of data) [2025-10-09T19:45:34.812852] [DEBUG] [LOCAL ] KAI: Primary data saved (13436 records). [2025-10-09T19:45:34.813463] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-09T19:45:34.813869] [INFO ] [MAIN ] Update Progress: 1176/2373 symbols completed. KAI took 38.3s. Estimated remaining: 2h 48m 29s. Rate: 7.1 symbols/min [2025-10-09T19:45:34.968484] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T19:45:35.041411] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:35.170844] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:45:35.202538] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-09T19:45:35.205884] [DEBUG] [LOCAL ] KBH: Loaded 48855 existing records from primary storage. [2025-10-09T19:45:35.206941] [INFO ] [MAIN ] KBH: Loaded 48855 existing records. [2025-10-09T19:45:35.452535] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:35.453295] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-09T19:45:35.453686] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-09T19:45:35.454354] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-09T19:45:35.454427] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-09T19:45:35.567393] [DEBUG] [LOCAL ] K: Primary data saved (50465 records). [2025-10-09T19:45:35.578091] [INFO ] [MAIN ] K: Full history saved. [2025-10-09T19:45:35.583315] [INFO ] [MAIN ] Update Progress: 1177/2373 symbols completed. K took 44.8s. Estimated remaining: 2h 48m 12s. Rate: 7.1 symbols/min [2025-10-09T19:45:35.938021] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:35.999098] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-09T19:45:35.998931] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:36.040936] [DEBUG] [LOCAL ] KBR: Loaded 47850 existing records from primary storage. [2025-10-09T19:45:36.041236] [INFO ] [MAIN ] KBR: Loaded 47850 existing records. [2025-10-09T19:45:36.222504] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:36.222823] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-09T19:45:36.222880] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-09T19:45:36.223071] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-09T19:45:36.223130] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-09T19:45:36.535539] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T19:45:36.616744] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:36.796774] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-09T19:45:36.831112] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T19:45:37.596768] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-09T19:45:38.396693] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-09T19:45:38.572846] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:45:38.888520] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:45:39.196697] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-09T19:45:39.266709] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T19:45:39.996684] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-09T19:45:40.383622] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T19:45:40.796778] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-09T19:45:41.399235] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:45:41.596685] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-09T19:45:41.839392] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:45:42.396741] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-09T19:45:42.911118] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:45:43.196732] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-09T19:45:43.936779] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:45:43.996704] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-09T19:45:44.074577] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:45:44.624736] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T19:45:44.796717] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-09T19:45:45.596738] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-09T19:45:45.802497] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T19:45:46.396768] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-09T19:45:47.079703] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:45:47.196790] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-09T19:45:47.662684] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T19:45:47.925691] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T19:45:47.996765] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-09T19:45:48.796693] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-09T19:45:49.028467] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:45:49.596774] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-09T19:45:50.396749] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-09T19:45:50.465359] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T19:45:50.913003] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T19:45:51.196836] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-09T19:45:51.493176] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T19:45:51.996732] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-09T19:45:52.494945] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T19:45:52.796694] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-09T19:45:53.052753] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T19:45:53.596778] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-09T19:45:54.124765] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T19:45:54.128010] [INFO ] [REMOTE ] KBDC: Full fetch complete (29669 records). [2025-10-09T19:45:54.128093] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-09T19:45:54.405360] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-09T19:45:54.504892] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-09T19:45:54.504965] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-09T19:45:54.505577] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-09T19:45:54.505638] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-09T19:45:54.506340] [DEBUG] [LOCAL ] KBDC: Trimmed 29669 records to 21910 (keeping 200 days of data) [2025-10-09T19:45:54.638384] [DEBUG] [LOCAL ] KBDC: Primary data saved (21910 records). [2025-10-09T19:45:54.638515] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-09T19:45:54.638617] [INFO ] [MAIN ] Update Progress: 1178/2373 symbols completed. KBDC took 26.0s. Estimated remaining: 2h 48m 15s. Rate: 7.1 symbols/min [2025-10-09T19:45:54.804188] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:54.858333] [DEBUG] [LOCAL ] KD: Loaded 52320 existing records from primary storage. [2025-10-09T19:45:54.858713] [INFO ] [MAIN ] KD: Loaded 52320 existing records. [2025-10-09T19:45:55.038027] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:55.038262] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-09T19:45:55.038312] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-09T19:45:55.038556] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-09T19:45:55.038614] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-09T19:45:55.224910] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-09T19:45:55.408413] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:55.518017] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T19:45:55.996771] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-09T19:45:56.129363] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:45:56.236611] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T19:45:56.238777] [INFO ] [REMOTE ] KB: Full fetch complete (33736 records). [2025-10-09T19:45:56.238857] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-09T19:45:56.616505] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-09T19:45:56.616579] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-09T19:45:56.617236] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-09T19:45:56.617299] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-09T19:45:56.618121] [DEBUG] [LOCAL ] KB: Trimmed 33736 records to 23768 (keeping 200 days of data) [2025-10-09T19:45:56.762017] [DEBUG] [LOCAL ] KB: Primary data saved (23768 records). [2025-10-09T19:45:56.762147] [INFO ] [MAIN ] KB: Full history saved. [2025-10-09T19:45:56.762241] [INFO ] [MAIN ] Update Progress: 1179/2373 symbols completed. KB took 41.3s. Estimated remaining: 2h 47m 60s. Rate: 7.1 symbols/min [2025-10-09T19:45:56.804585] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-09T19:45:56.933840] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:56.941199] [DEBUG] [LOCAL ] KEN: Loaded 4677 existing records from primary storage. [2025-10-09T19:45:56.941424] [INFO ] [MAIN ] KEN: Loaded 4677 existing records. [2025-10-09T19:45:57.117611] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:57.117902] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-09T19:45:57.117949] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-09T19:45:57.118105] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-09T19:45:57.118164] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-09T19:45:57.496614] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:57.596700] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-09T19:45:57.679421] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T19:45:58.396751] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-09T19:45:58.572679] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:45:59.027130] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T19:45:59.196694] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-09T19:45:59.278073] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:45:59.996719] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-09T19:46:00.724746] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:46:00.796668] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-09T19:46:01.596706] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-09T19:46:01.818364] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T19:46:02.166250] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T19:46:02.396692] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-09T19:46:02.573269] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T19:46:03.196742] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-09T19:46:03.959916] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T19:46:03.996682] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-09T19:46:04.619500] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T19:46:04.796747] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-09T19:46:05.329160] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T19:46:05.596743] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-09T19:46:06.040904] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T19:46:06.094524] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T19:46:06.396726] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-09T19:46:07.196723] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-09T19:46:07.996718] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-09T19:46:08.098664] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T19:46:08.103041] [INFO ] [REMOTE ] KBH: Full fetch complete (70810 records). [2025-10-09T19:46:08.103159] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-09T19:46:08.519493] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-09T19:46:08.519576] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-09T19:46:08.520750] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-09T19:46:08.520815] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-09T19:46:08.522233] [DEBUG] [LOCAL ] KBH: Trimmed 70810 records to 49233 (keeping 200 days of data) [2025-10-09T19:46:08.799207] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-09T19:46:08.803740] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T19:46:08.840410] [DEBUG] [LOCAL ] KBH: Primary data saved (49233 records). [2025-10-09T19:46:08.856863] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-09T19:46:08.864189] [INFO ] [MAIN ] Update Progress: 1180/2373 symbols completed. KBH took 34.0s. Estimated remaining: 2h 47m 55s. Rate: 7.1 symbols/min [2025-10-09T19:46:08.939521] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:46:09.049834] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:09.080605] [DEBUG] [LOCAL ] KEP: Loaded 31433 existing records from primary storage. [2025-10-09T19:46:09.080927] [INFO ] [MAIN ] KEP: Loaded 31433 existing records. [2025-10-09T19:46:09.253932] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:09.254130] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-09T19:46:09.254176] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-09T19:46:09.254374] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-09T19:46:09.254430] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-09T19:46:09.602084] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-09T19:46:09.607618] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:10.396761] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-09T19:46:10.556709] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T19:46:11.003827] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:46:11.156336] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:46:11.196673] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-09T19:46:11.802442] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T19:46:11.996708] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-09T19:46:12.613774] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T19:46:12.796739] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-09T19:46:13.596772] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-09T19:46:14.077121] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:46:14.242504] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T19:46:14.396715] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-09T19:46:15.196757] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-09T19:46:15.972790] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T19:46:15.976940] [INFO ] [REMOTE ] KBR: Full fetch complete (69751 records). [2025-10-09T19:46:15.977061] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-09T19:46:16.001405] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-09T19:46:16.405150] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-09T19:46:16.405851] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-09T19:46:16.406323] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T19:46:16.407327] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-09T19:46:16.412472] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-09T19:46:16.414427] [DEBUG] [LOCAL ] KBR: Trimmed 69751 records to 48203 (keeping 200 days of data) [2025-10-09T19:46:16.530985] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T19:46:16.732716] [DEBUG] [LOCAL ] KBR: Primary data saved (48203 records). [2025-10-09T19:46:16.732855] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-09T19:46:16.732937] [INFO ] [MAIN ] Update Progress: 1181/2373 symbols completed. KBR took 41.1s. Estimated remaining: 2h 47m 46s. Rate: 7.1 symbols/min [2025-10-09T19:46:16.801880] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-09T19:46:16.917636] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:16.960219] [DEBUG] [LOCAL ] KEX: Loaded 38497 existing records from primary storage. [2025-10-09T19:46:16.960517] [INFO ] [MAIN ] KEX: Loaded 38497 existing records. [2025-10-09T19:46:17.138080] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:17.138282] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-09T19:46:17.138329] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-09T19:46:17.138545] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-09T19:46:17.138602] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-09T19:46:17.264615] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T19:46:17.516436] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:17.596674] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-09T19:46:18.396749] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-09T19:46:18.601724] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T19:46:19.045030] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T19:46:19.045862] [INFO ] [REMOTE ] KEN: Full fetch complete (5948 records). [2025-10-09T19:46:19.045930] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-09T19:46:19.200565] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-09T19:46:19.405927] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-09T19:46:19.406029] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-09T19:46:19.406221] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-09T19:46:19.406263] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-09T19:46:19.406770] [DEBUG] [LOCAL ] KEN: Trimmed 5948 records to 4702 (keeping 200 days of data) [2025-10-09T19:46:19.434590] [DEBUG] [LOCAL ] KEN: Primary data saved (4702 records). [2025-10-09T19:46:19.434728] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-09T19:46:19.434819] [INFO ] [MAIN ] Update Progress: 1182/2373 symbols completed. KEN took 22.7s. Estimated remaining: 2h 47m 32s. Rate: 7.1 symbols/min [2025-10-09T19:46:19.600256] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:19.600446] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-09T19:46:19.600484] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-09T19:46:19.600623] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-09T19:46:19.600698] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-09T19:46:19.600753] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-09T19:46:19.600787] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-09T19:46:19.948825] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:19.996713] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-09T19:46:20.163135] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T19:46:20.796720] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-09T19:46:21.601871] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-09T19:46:21.628284] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T19:46:22.270984] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:46:22.396729] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-09T19:46:22.868832] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T19:46:23.196721] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-09T19:46:23.996704] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-09T19:46:24.108898] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T19:46:24.538552] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T19:46:24.796764] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-09T19:46:25.496252] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T19:46:25.596733] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-09T19:46:26.160220] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T19:46:26.396699] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-09T19:46:26.913198] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T19:46:27.196745] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-09T19:46:27.636701] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T19:46:27.996775] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-09T19:46:28.796787] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-09T19:46:28.882940] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:46:29.596766] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-09T19:46:29.661375] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:46:30.319282] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T19:46:30.396672] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-09T19:46:31.049443] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:46:31.196786] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-09T19:46:31.611149] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T19:46:31.996730] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-09T19:46:32.652984] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T19:46:32.796717] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-09T19:46:33.184848] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:46:33.596755] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-09T19:46:34.098628] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:46:34.396741] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-09T19:46:34.927529] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T19:46:35.196766] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-09T19:46:35.430350] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:46:35.996798] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-09T19:46:36.796764] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-09T19:46:37.018546] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:46:37.313730] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T19:46:37.316886] [INFO ] [REMOTE ] KEP: Full fetch complete (41877 records). [2025-10-09T19:46:37.316976] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-09T19:46:37.601920] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-09T19:46:37.725981] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-09T19:46:37.726064] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-09T19:46:37.726805] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-09T19:46:37.726872] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-09T19:46:37.727883] [DEBUG] [LOCAL ] KEP: Trimmed 41877 records to 31601 (keeping 200 days of data) [2025-10-09T19:46:37.910939] [DEBUG] [LOCAL ] KEP: Primary data saved (31601 records). [2025-10-09T19:46:37.911080] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-09T19:46:37.911204] [INFO ] [MAIN ] Update Progress: 1183/2373 symbols completed. KEP took 29.0s. Estimated remaining: 2h 47m 33s. Rate: 7.1 symbols/min [2025-10-09T19:46:38.081342] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:38.123305] [DEBUG] [LOCAL ] KEYS: Loaded 43126 existing records from primary storage. [2025-10-09T19:46:38.123610] [INFO ] [MAIN ] KEYS: Loaded 43126 existing records. [2025-10-09T19:46:38.307476] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:38.307806] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-09T19:46:38.307936] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-09T19:46:38.308216] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-09T19:46:38.308273] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-09T19:46:38.397427] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-09T19:46:38.701094] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T19:46:38.706211] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:39.196685] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-09T19:46:39.253180] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T19:46:39.541698] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:46:39.996723] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-09T19:46:40.796680] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-09T19:46:41.136182] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T19:46:41.205238] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T19:46:41.596709] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-09T19:46:42.222368] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:46:42.396702] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-09T19:46:43.196727] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-09T19:46:43.479768] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T19:46:43.996687] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-09T19:46:44.178103] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T19:46:44.330553] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:46:44.796772] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-09T19:46:45.315224] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T19:46:45.596810] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-09T19:46:46.396708] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-09T19:46:46.503886] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T19:46:46.508448] [INFO ] [REMOTE ] KD: Full fetch complete (75713 records). [2025-10-09T19:46:46.508573] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-09T19:46:46.897110] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-09T19:46:46.897191] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-09T19:46:46.898295] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-09T19:46:46.898360] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-09T19:46:46.899780] [DEBUG] [LOCAL ] KD: Trimmed 75713 records to 52707 (keeping 200 days of data) [2025-10-09T19:46:47.197491] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-09T19:46:47.211285] [DEBUG] [LOCAL ] KD: Primary data saved (52707 records). [2025-10-09T19:46:47.211371] [INFO ] [MAIN ] KD: Full history saved. [2025-10-09T19:46:47.211961] [INFO ] [MAIN ] Update Progress: 1184/2373 symbols completed. KD took 52.6s. Estimated remaining: 2h 47m 26s. Rate: 7.1 symbols/min [2025-10-09T19:46:47.387062] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:47.413128] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T19:46:47.412338] [DEBUG] [LOCAL ] KF: Loaded 2375 existing records from primary storage. [2025-10-09T19:46:47.421535] [INFO ] [MAIN ] KF: Loaded 2375 existing records. [2025-10-09T19:46:47.620588] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:47.620819] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-09T19:46:47.620874] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-09T19:46:47.621066] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-09T19:46:47.621122] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-09T19:46:47.746044] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T19:46:47.796950] [INFO ] [REMOTE ] KEX: Full fetch complete (55775 records). [2025-10-09T19:46:47.812632] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-09T19:46:48.015765] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-09T19:46:48.128783] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:48.380845] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-09T19:46:48.380921] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-09T19:46:48.381762] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-09T19:46:48.381825] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-09T19:46:48.382953] [DEBUG] [LOCAL ] KEX: Trimmed 55775 records to 38809 (keeping 200 days of data) [2025-10-09T19:46:48.611562] [DEBUG] [LOCAL ] KEX: Primary data saved (38809 records). [2025-10-09T19:46:48.611728] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-09T19:46:48.611845] [INFO ] [MAIN ] Update Progress: 1185/2373 symbols completed. KEX took 31.9s. Estimated remaining: 2h 47m 10s. Rate: 7.1 symbols/min [2025-10-09T19:46:48.785248] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:48.796718] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-09T19:46:48.806633] [DEBUG] [LOCAL ] KFRC: Loaded 20015 existing records from primary storage. [2025-10-09T19:46:48.807003] [INFO ] [MAIN ] KFRC: Loaded 20015 existing records. [2025-10-09T19:46:49.006027] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:46:49.040838] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:49.041102] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-09T19:46:49.041150] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-09T19:46:49.041469] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-09T19:46:49.041528] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-09T19:46:49.349621] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T19:46:49.450887] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:49.491848] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:46:49.596793] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-09T19:46:50.396756] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-09T19:46:51.169951] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:46:51.196705] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-09T19:46:51.320385] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T19:46:51.996724] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-09T19:46:52.572212] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T19:46:52.794639] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T19:46:52.797072] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-09T19:46:53.354091] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T19:46:53.596731] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-09T19:46:54.396716] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-09T19:46:54.421475] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:46:55.196728] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-09T19:46:55.728049] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T19:46:55.998152] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-09T19:46:56.014261] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T19:46:56.796724] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-09T19:46:57.386254] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T19:46:57.390919] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-09T19:46:57.391036] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-09T19:46:57.609099] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-09T19:46:57.608953] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T19:46:57.611929] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T19:46:57.611412] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:46:57.615683] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:46:57.616438] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-09T19:46:57.616519] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-09T19:46:57.616557] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-09T19:46:57.616614] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-09T19:46:57.616738] [INFO ] [MAIN ] Update Progress: 1186/2373 symbols completed. KEY took 38.2s. Estimated remaining: 2h 47m 3s. Rate: 7.1 symbols/min [2025-10-09T19:46:57.784240] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:57.795230] [DEBUG] [LOCAL ] KFS: Loaded 8566 existing records from primary storage. [2025-10-09T19:46:57.795455] [INFO ] [MAIN ] KFS: Loaded 8566 existing records. [2025-10-09T19:46:57.971015] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:57.971361] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-09T19:46:57.971421] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-09T19:46:57.971682] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-09T19:46:57.971742] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-09T19:46:58.247668] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T19:46:58.325105] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:58.396739] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-09T19:46:58.956370] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T19:46:59.196769] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-09T19:46:59.774244] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T19:46:59.996776] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-09T19:47:00.500260] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-09T19:47:00.796791] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-09T19:47:01.596774] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-09T19:47:02.296426] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T19:47:02.376597] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:47:02.396665] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-09T19:47:03.112585] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T19:47:03.196674] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-09T19:47:03.996745] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-09T19:47:04.485527] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T19:47:04.796694] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-09T19:47:04.833199] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:47:05.596735] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-09T19:47:05.675982] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:47:06.016158] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:47:06.396744] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-09T19:47:06.976083] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T19:47:07.196728] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-09T19:47:07.996715] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-09T19:47:08.568597] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T19:47:08.638932] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:47:08.796707] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-09T19:47:09.596736] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-09T19:47:09.914247] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T19:47:10.059147] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T19:47:10.396739] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-09T19:47:10.999775] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T19:47:11.196723] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-09T19:47:11.925794] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T19:47:11.996680] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-09T19:47:12.762625] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T19:47:12.796676] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-09T19:47:13.596721] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-09T19:47:14.023607] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:47:14.094529] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T19:47:14.396718] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-09T19:47:15.134441] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T19:47:15.196681] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-09T19:47:15.960713] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T19:47:15.996676] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-09T19:47:16.759372] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T19:47:16.796721] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-09T19:47:17.304539] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T19:47:17.305530] [INFO ] [REMOTE ] KF: Full fetch complete (3544 records). [2025-10-09T19:47:17.305610] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-09T19:47:17.601883] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-09T19:47:17.699453] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-09T19:47:17.699548] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-09T19:47:17.699720] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-09T19:47:17.699783] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-09T19:47:17.700145] [DEBUG] [LOCAL ] KF: Trimmed 3544 records to 2381 (keeping 200 days of data) [2025-10-09T19:47:17.715169] [DEBUG] [LOCAL ] KF: Primary data saved (2381 records). [2025-10-09T19:47:17.715265] [INFO ] [MAIN ] KF: Full history saved. [2025-10-09T19:47:17.715362] [INFO ] [MAIN ] Update Progress: 1187/2373 symbols completed. KF took 30.5s. Estimated remaining: 2h 47m 6s. Rate: 7.1 symbols/min [2025-10-09T19:47:17.881541] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:17.912591] [DEBUG] [LOCAL ] KFY: Loaded 29870 existing records from primary storage. [2025-10-09T19:47:17.912896] [INFO ] [MAIN ] KFY: Loaded 29870 existing records. [2025-10-09T19:47:18.088491] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:18.088765] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-09T19:47:18.088818] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-09T19:47:18.089036] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-09T19:47:18.089093] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-09T19:47:18.401880] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-09T19:47:18.459664] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:18.878404] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T19:47:19.196697] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-09T19:47:19.589498] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T19:47:19.996704] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-09T19:47:20.284198] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T19:47:20.796700] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-09T19:47:21.111038] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T19:47:21.113543] [INFO ] [REMOTE ] KFRC: Full fetch complete (26139 records). [2025-10-09T19:47:21.113635] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-09T19:47:21.500201] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T19:47:21.531163] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-09T19:47:21.531248] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-09T19:47:21.531868] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-09T19:47:21.531930] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-09T19:47:21.532696] [DEBUG] [LOCAL ] KFRC: Trimmed 26139 records to 20191 (keeping 200 days of data) [2025-10-09T19:47:21.622010] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-09T19:47:21.668834] [DEBUG] [LOCAL ] KFRC: Primary data saved (20191 records). [2025-10-09T19:47:21.668981] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-09T19:47:21.669066] [INFO ] [MAIN ] Update Progress: 1188/2373 symbols completed. KFRC took 33.1s. Estimated remaining: 2h 46m 53s. Rate: 7.1 symbols/min [2025-10-09T19:47:21.879201] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:21.938553] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-09T19:47:21.938918] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-09T19:47:22.156043] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:22.156303] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-09T19:47:22.156358] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-09T19:47:22.156580] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-09T19:47:22.156639] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-09T19:47:22.275581] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T19:47:22.401984] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-09T19:47:22.548713] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:23.196730] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-09T19:47:23.624445] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T19:47:23.996709] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-09T19:47:24.640410] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T19:47:24.796731] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-09T19:47:25.133372] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T19:47:25.596708] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-09T19:47:26.137335] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:47:26.141603] [INFO ] [REMOTE ] KEYS: Full fetch complete (62595 records). [2025-10-09T19:47:26.141788] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-09T19:47:26.322717] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T19:47:26.400587] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-09T19:47:26.401161] [INFO ] [REMOTE ] KFS: Full fetch complete (10734 records). [2025-10-09T19:47:26.418830] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-09T19:47:26.775987] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-09T19:47:26.835726] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-09T19:47:26.847868] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-09T19:47:26.853101] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-09T19:47:26.896076] [DEBUG] [LOCAL ] KEYS: Trimmed 62595 records to 43424 (keeping 200 days of data) [2025-10-09T19:47:27.015568] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-09T19:47:27.015730] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-09T19:47:27.015896] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-09T19:47:27.015969] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-09T19:47:27.045502] [DEBUG] [LOCAL ] KFS: Trimmed 10734 records to 8608 (keeping 200 days of data) [2025-10-09T19:47:27.115594] [DEBUG] [LOCAL ] KFS: Primary data saved (8608 records). [2025-10-09T19:47:27.117509] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-09T19:47:27.118505] [INFO ] [MAIN ] Update Progress: 1189/2373 symbols completed. KFS took 29.5s. Estimated remaining: 2h 46m 41s. Rate: 7.1 symbols/min [2025-10-09T19:47:27.201096] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-09T19:47:27.304048] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:27.441942] [DEBUG] [LOCAL ] KGS: Loaded 45924 existing records from primary storage. [2025-10-09T19:47:27.443075] [INFO ] [MAIN ] KGS: Loaded 45924 existing records. [2025-10-09T19:47:27.632461] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:27.633857] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-09T19:47:27.634228] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-09T19:47:27.635709] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-09T19:47:27.638748] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-09T19:47:27.815943] [DEBUG] [LOCAL ] KEYS: Primary data saved (43424 records). [2025-10-09T19:47:27.824458] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-09T19:47:27.856732] [INFO ] [MAIN ] Update Progress: 1190/2373 symbols completed. KEYS took 49.9s. Estimated remaining: 2h 46m 25s. Rate: 7.1 symbols/min [2025-10-09T19:47:28.190131] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:28.219154] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-09T19:47:28.254529] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:28.288873] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T19:47:28.343888] [DEBUG] [LOCAL ] KIM: Loaded 53001 existing records from primary storage. [2025-10-09T19:47:28.344212] [INFO ] [MAIN ] KIM: Loaded 53001 existing records. [2025-10-09T19:47:28.524954] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:28.525448] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-09T19:47:28.525596] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-09T19:47:28.525976] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-09T19:47:28.526059] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-09T19:47:28.675220] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:47:28.802424] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-09T19:47:28.926324] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:29.482062] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T19:47:29.596673] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-09T19:47:30.396701] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-09T19:47:30.696914] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T19:47:31.100911] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T19:47:31.196716] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-09T19:47:31.441964] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T19:47:31.996726] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-09T19:47:32.796835] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-09T19:47:32.955267] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T19:47:33.223461] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-09T19:47:33.596791] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-09T19:47:34.396718] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-09T19:47:34.536312] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T19:47:35.136775] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T19:47:35.196706] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-09T19:47:35.526541] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:47:35.996782] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-09T19:47:36.658111] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:47:36.796691] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-09T19:47:37.535062] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:47:37.596682] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-09T19:47:38.396775] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-09T19:47:38.470866] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T19:47:38.931441] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T19:47:39.196801] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-09T19:47:39.785707] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T19:47:39.996736] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-09T19:47:40.796702] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-09T19:47:40.844170] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T19:47:41.596699] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-09T19:47:41.701549] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T19:47:41.931743] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T19:47:42.396753] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-09T19:47:43.196691] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-09T19:47:43.283825] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T19:47:43.442852] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T19:47:43.996754] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-09T19:47:44.631533] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T19:47:44.796695] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-09T19:47:45.328140] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T19:47:45.596713] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-09T19:47:46.396738] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-09T19:47:46.593772] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T19:47:46.935980] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:47:46.938847] [INFO ] [REMOTE ] KFY: Full fetch complete (43187 records). [2025-10-09T19:47:46.939030] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-09T19:47:47.201842] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-09T19:47:47.344742] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-09T19:47:47.344867] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-09T19:47:47.346090] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-09T19:47:47.346374] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-09T19:47:47.347970] [DEBUG] [LOCAL ] KFY: Trimmed 43187 records to 30040 (keeping 200 days of data) [2025-10-09T19:47:47.549283] [DEBUG] [LOCAL ] KFY: Primary data saved (30040 records). [2025-10-09T19:47:47.549420] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-09T19:47:47.550135] [INFO ] [MAIN ] Update Progress: 1191/2373 symbols completed. KFY took 29.8s. Estimated remaining: 2h 46m 28s. Rate: 7.1 symbols/min [2025-10-09T19:47:47.717943] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:47.740159] [DEBUG] [LOCAL ] KIO: Loaded 21461 existing records from primary storage. [2025-10-09T19:47:47.740430] [INFO ] [MAIN ] KIO: Loaded 21461 existing records. [2025-10-09T19:47:47.913239] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:47.913393] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-09T19:47:47.913439] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-09T19:47:47.913624] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-09T19:47:47.913716] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-09T19:47:48.002261] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-09T19:47:48.274249] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:48.409847] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T19:47:48.796705] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-09T19:47:48.952939] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:47:49.129777] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T19:47:49.596697] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-09T19:47:49.619145] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:47:50.396759] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-09T19:47:51.196772] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-09T19:47:51.384567] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T19:47:52.001818] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-09T19:47:52.016547] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T19:47:52.217723] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:47:52.796725] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-09T19:47:53.590695] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T19:47:53.596670] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-09T19:47:53.803700] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T19:47:54.396684] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-09T19:47:54.709526] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T19:47:55.196753] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-09T19:47:55.996688] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-09T19:47:56.180392] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T19:47:56.695244] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T19:47:56.796699] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-09T19:47:57.596741] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-09T19:47:57.716154] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T19:47:58.396694] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-09T19:47:58.518420] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:47:58.523185] [INFO ] [REMOTE ] KIM: Full fetch complete (76798 records). [2025-10-09T19:47:58.523319] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-09T19:47:58.914199] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-09T19:47:58.914288] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-09T19:47:58.915282] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-09T19:47:58.915349] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-09T19:47:58.916862] [DEBUG] [LOCAL ] KIM: Trimmed 76798 records to 53373 (keeping 200 days of data) [2025-10-09T19:47:59.203165] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-09T19:47:59.256903] [DEBUG] [LOCAL ] KIM: Primary data saved (53373 records). [2025-10-09T19:47:59.257069] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-09T19:47:59.257334] [INFO ] [MAIN ] Update Progress: 1192/2373 symbols completed. KIM took 31.4s. Estimated remaining: 2h 46m 23s. Rate: 7.1 symbols/min [2025-10-09T19:47:59.369881] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T19:47:59.472174] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:59.485688] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T19:47:59.537508] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-10-09T19:47:59.537888] [INFO ] [MAIN ] KKR: Loaded 53502 existing records. [2025-10-09T19:47:59.711850] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:59.712126] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-09T19:47:59.712173] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-09T19:47:59.712473] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-09T19:47:59.712529] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-09T19:48:00.001818] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-09T19:48:00.069202] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:00.796762] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-09T19:48:01.221463] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T19:48:01.434695] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-09T19:48:01.596685] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-09T19:48:02.396691] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-09T19:48:02.548012] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T19:48:02.552027] [INFO ] [REMOTE ] KGS: Full fetch complete (66361 records). [2025-10-09T19:48:02.552131] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-09T19:48:02.931783] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-09T19:48:02.931867] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-09T19:48:02.932819] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-09T19:48:02.932884] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-09T19:48:02.934308] [DEBUG] [LOCAL ] KGS: Trimmed 66361 records to 46271 (keeping 200 days of data) [2025-10-09T19:48:03.197692] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-09T19:48:03.202796] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T19:48:03.268911] [DEBUG] [LOCAL ] KGS: Primary data saved (46271 records). [2025-10-09T19:48:03.269067] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-09T19:48:03.269175] [INFO ] [MAIN ] Update Progress: 1193/2373 symbols completed. KGS took 36.2s. Estimated remaining: 2h 46m 10s. Rate: 7.1 symbols/min [2025-10-09T19:48:03.434555] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:03.443251] [DEBUG] [LOCAL ] KKRS: Loaded 5729 existing records from primary storage. [2025-10-09T19:48:03.443469] [INFO ] [MAIN ] KKRS: Loaded 5729 existing records. [2025-10-09T19:48:03.616433] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:03.616689] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-09T19:48:03.616747] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-09T19:48:03.616935] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-09T19:48:03.616991] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-09T19:48:03.972814] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:03.996670] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-09T19:48:04.182165] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T19:48:04.523550] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-09T19:48:04.722580] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T19:48:04.796727] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-09T19:48:05.596761] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-09T19:48:06.396717] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-09T19:48:06.481816] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T19:48:06.796144] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T19:48:07.196728] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-09T19:48:07.786574] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-09T19:48:07.996789] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-09T19:48:08.536957] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:48:08.796727] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-09T19:48:08.931325] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T19:48:09.596776] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-09T19:48:09.646698] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:48:10.396728] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-09T19:48:11.196699] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-09T19:48:11.276707] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T19:48:11.511731] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T19:48:11.721270] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T19:48:11.996708] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-09T19:48:12.796756] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-09T19:48:13.130009] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:48:13.234556] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:48:13.596719] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-09T19:48:14.396688] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-09T19:48:14.511098] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T19:48:14.513588] [INFO ] [REMOTE ] KIO: Full fetch complete (31505 records). [2025-10-09T19:48:14.513694] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-09T19:48:14.884586] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-09T19:48:14.884693] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-09T19:48:14.885380] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-09T19:48:14.885442] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-09T19:48:14.886206] [DEBUG] [LOCAL ] KIO: Trimmed 31505 records to 21605 (keeping 200 days of data) [2025-10-09T19:48:15.021928] [DEBUG] [LOCAL ] KIO: Primary data saved (21605 records). [2025-10-09T19:48:15.022061] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-09T19:48:15.022153] [INFO ] [MAIN ] Update Progress: 1194/2373 symbols completed. KIO took 27.5s. Estimated remaining: 2h 46m 5s. Rate: 7.1 symbols/min [2025-10-09T19:48:15.202300] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-09T19:48:15.209771] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:15.210984] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-09T19:48:15.211033] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-09T19:48:15.211148] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-09T19:48:15.211190] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-09T19:48:15.211231] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-09T19:48:15.211263] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-09T19:48:15.576580] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:15.996746] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-09T19:48:16.306108] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T19:48:16.729783] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T19:48:16.796713] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-09T19:48:17.176055] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-09T19:48:17.180763] [INFO ] [REMOTE ] KGC: Full fetch complete (77701 records). [2025-10-09T19:48:17.180887] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-09T19:48:17.304048] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T19:48:17.579669] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-09T19:48:17.579769] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-09T19:48:17.580783] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-09T19:48:17.580849] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-09T19:48:17.582319] [DEBUG] [LOCAL ] KGC: Trimmed 77701 records to 54089 (keeping 200 days of data) [2025-10-09T19:48:17.643530] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-09T19:48:17.907855] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:48:17.910139] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-09T19:48:17.910770] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:48:17.911923] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-09T19:48:17.912941] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:48:17.913249] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-09T19:48:17.913876] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-09T19:48:17.914451] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-09T19:48:17.915078] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-09T19:48:17.915182] [INFO ] [MAIN ] Update Progress: 1195/2373 symbols completed. KKRT took 2.9s. Estimated remaining: 2h 45m 51s. Rate: 7.1 symbols/min [2025-10-09T19:48:18.142286] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:18.143333] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-09T19:48:18.143427] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-09T19:48:18.145085] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-09T19:48:18.145726] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-09T19:48:18.146556] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-09T19:48:18.147159] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-09T19:48:18.281994] [DEBUG] [LOCAL ] KGC: Primary data saved (54089 records). [2025-10-09T19:48:18.288290] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-09T19:48:18.288425] [INFO ] [MAIN ] Update Progress: 1196/2373 symbols completed. KGC took 56.6s. Estimated remaining: 2h 45m 34s. Rate: 7.1 symbols/min [2025-10-09T19:48:18.406226] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-09T19:48:18.706313] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:18.779474] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:18.810029] [DEBUG] [LOCAL ] KLC: Loaded 36726 existing records from primary storage. [2025-10-09T19:48:18.810359] [INFO ] [MAIN ] KLC: Loaded 36726 existing records. [2025-10-09T19:48:18.986512] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:18.986780] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-09T19:48:18.986834] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-09T19:48:18.987099] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-09T19:48:18.987157] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-09T19:48:19.201910] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-09T19:48:19.333136] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:19.880371] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:48:19.996721] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-09T19:48:20.209396] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T19:48:20.343599] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-09T19:48:20.796741] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-09T19:48:21.001210] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:48:21.001536] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-09T19:48:21.001628] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:48:21.001739] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-09T19:48:21.001830] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:48:21.001911] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-09T19:48:21.001995] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-09T19:48:21.002034] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-09T19:48:21.002096] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-09T19:48:21.002170] [INFO ] [MAIN ] Update Progress: 1197/2373 symbols completed. KLAR took 3.1s. Estimated remaining: 2h 45m 20s. Rate: 7.1 symbols/min [2025-10-09T19:48:21.596803] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-09T19:48:22.396804] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-09T19:48:23.038445] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:48:23.196706] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-09T19:48:23.919979] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:48:23.996717] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-09T19:48:24.552857] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T19:48:24.803705] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-09T19:48:24.830289] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:48:25.353533] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T19:48:25.354617] [INFO ] [REMOTE ] KKRS: Full fetch complete (7744 records). [2025-10-09T19:48:25.354733] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-09T19:48:25.603594] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-09T19:48:25.710381] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-09T19:48:25.710447] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-09T19:48:25.710696] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-09T19:48:25.710761] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-09T19:48:25.711240] [DEBUG] [LOCAL ] KKRS: Trimmed 7744 records to 5747 (keeping 200 days of data) [2025-10-09T19:48:25.747082] [DEBUG] [LOCAL ] KKRS: Primary data saved (5747 records). [2025-10-09T19:48:25.747172] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-09T19:48:25.747250] [INFO ] [MAIN ] Update Progress: 1198/2373 symbols completed. KKRS took 22.5s. Estimated remaining: 2h 45m 8s. Rate: 7.1 symbols/min [2025-10-09T19:48:26.396769] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-09T19:48:26.589905] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T19:48:27.196691] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-09T19:48:28.011772] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:48:28.017293] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-09T19:48:28.089140] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:48:28.796745] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-09T19:48:29.394783] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T19:48:29.596731] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-09T19:48:30.469109] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T19:48:30.488451] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-09T19:48:30.702368] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T19:48:31.196769] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-09T19:48:32.044621] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T19:48:32.049235] [INFO ] [REMOTE ] KKR: Full fetch complete (77452 records). [2025-10-09T19:48:32.049345] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-09T19:48:32.438939] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-09T19:48:32.439022] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-09T19:48:32.440018] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-09T19:48:32.440082] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-09T19:48:32.441729] [DEBUG] [LOCAL ] KKR: Trimmed 77452 records to 53892 (keeping 200 days of data) [2025-10-09T19:48:32.693980] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T19:48:32.704755] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-09T19:48:32.821409] [DEBUG] [LOCAL ] KKR: Primary data saved (53892 records). [2025-10-09T19:48:32.821549] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-09T19:48:32.821632] [INFO ] [MAIN ] Update Progress: 1199/2373 symbols completed. KKR took 33.6s. Estimated remaining: 2h 44m 58s. Rate: 7.1 symbols/min [2025-10-09T19:48:34.080638] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T19:48:34.088115] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-09T19:48:35.134459] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T19:48:35.142257] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-09T19:48:36.557037] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T19:48:36.565569] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-09T19:48:37.987099] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T19:48:37.995775] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-09T19:48:39.271198] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T19:48:39.274838] [INFO ] [REMOTE ] KLC: Full fetch complete (50552 records). [2025-10-09T19:48:39.274951] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-09T19:48:39.648848] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-09T19:48:39.648924] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-09T19:48:39.649688] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-09T19:48:39.649750] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-09T19:48:39.650766] [DEBUG] [LOCAL ] KLC: Trimmed 50552 records to 37008 (keeping 200 days of data) [2025-10-09T19:48:39.860919] [DEBUG] [LOCAL ] KLC: Primary data saved (37008 records). [2025-10-09T19:48:39.861052] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-09T19:48:39.861135] [INFO ] [MAIN ] Update Progress: 1200/2373 symbols completed. KLC took 21.6s. Estimated remaining: 2h 44m 49s. Rate: 7.1 symbols/min [2025-10-09T19:48:40.520353] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:40.512121] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:40.570977] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:40.592496] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:40.599842] [DEBUG] [LOCAL ] KMPB: Loaded 3832 existing records from primary storage. [2025-10-09T19:48:40.600250] [INFO ] [MAIN ] KMPB: Loaded 3832 existing records. [2025-10-09T19:48:40.831781] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:40.832255] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-09T19:48:40.832315] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-09T19:48:40.832482] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-09T19:48:40.832538] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-09T19:48:40.924158] [DEBUG] [LOCAL ] KMPR: Loaded 39350 existing records from primary storage. [2025-10-09T19:48:40.982184] [DEBUG] [LOCAL ] KMT: Loaded 42969 existing records from primary storage. [2025-10-09T19:48:40.976044] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-09T19:48:40.975201] [INFO ] [MAIN ] KMPR: Loaded 39350 existing records. [2025-10-09T19:48:40.987771] [INFO ] [MAIN ] KMT: Loaded 42969 existing records. [2025-10-09T19:48:41.009373] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-09T19:48:41.604992] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:41.677582] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-09T19:48:41.724078] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:41.741208] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-09T19:48:41.760910] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-09T19:48:41.771106] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-09T19:48:41.773879] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-09T19:48:41.760806] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:41.796241] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-09T19:48:41.797385] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-09T19:48:41.798219] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-09T19:48:41.798148] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-09T19:48:41.821994] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:41.830671] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-09T19:48:41.831002] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-09T19:48:41.880048] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-09T19:48:41.880240] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-09T19:48:42.605746] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T19:48:42.628062] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-09T19:48:42.749368] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:42.804836] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-09T19:48:42.913463] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:42.907756] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:42.913813] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-09T19:48:42.914108] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-09T19:48:43.187526] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T19:48:43.188764] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-09T19:48:43.644064] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T19:48:43.645310] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-09T19:48:43.960947] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T19:48:43.966753] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-09T19:48:43.992576] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-09T19:48:43.994235] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-09T19:48:44.382795] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:48:44.395917] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-09T19:48:44.610340] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T19:48:44.612376] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-09T19:48:44.614030] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T19:48:44.796672] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-09T19:48:44.855136] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T19:48:44.951198] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T19:48:45.596728] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-09T19:48:45.840052] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T19:48:46.396688] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-09T19:48:46.453037] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:48:46.543822] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:48:46.968491] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T19:48:47.196744] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-09T19:48:47.996716] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-09T19:48:48.315801] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T19:48:48.732230] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T19:48:48.796754] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-09T19:48:49.596714] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-09T19:48:50.179306] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T19:48:50.396725] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-09T19:48:51.125812] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:48:51.196675] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-09T19:48:51.795560] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:48:51.996718] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-09T19:48:52.570390] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T19:48:52.796787] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-09T19:48:53.349844] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T19:48:53.596744] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-09T19:48:54.396109] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T19:48:54.405216] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-09T19:48:54.639027] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:48:55.196767] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-09T19:48:55.764824] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T19:48:55.990381] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:48:56.003533] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-09T19:48:56.796748] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-09T19:48:57.441444] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T19:48:57.441210] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:48:57.596682] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-09T19:48:58.396756] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-09T19:48:59.196703] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-09T19:48:59.310004] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:48:59.625475] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:48:59.996747] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-09T19:49:00.796706] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-09T19:49:01.318015] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T19:49:01.420376] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-09T19:49:01.596731] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-09T19:49:02.113524] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T19:49:02.114462] [INFO ] [REMOTE ] KMPB: Full fetch complete (5074 records). [2025-10-09T19:49:02.114532] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-09T19:49:02.399209] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-09T19:49:02.494772] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-09T19:49:02.495097] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-09T19:49:02.495415] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-09T19:49:02.495505] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-09T19:49:02.511169] [DEBUG] [LOCAL ] KMPB: Trimmed 5074 records to 3842 (keeping 200 days of data) [2025-10-09T19:49:02.534790] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T19:49:02.561049] [DEBUG] [LOCAL ] KMPB: Primary data saved (3842 records). [2025-10-09T19:49:02.561208] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-09T19:49:02.561364] [INFO ] [MAIN ] Update Progress: 1201/2373 symbols completed. KMPB took 22.7s. Estimated remaining: 2h 44m 54s. Rate: 7.1 symbols/min [2025-10-09T19:49:02.729665] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:02.779320] [DEBUG] [LOCAL ] KMX: Loaded 53215 existing records from primary storage. [2025-10-09T19:49:02.779676] [INFO ] [MAIN ] KMX: Loaded 53215 existing records. [2025-10-09T19:49:02.961347] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:02.961679] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-09T19:49:02.961740] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-09T19:49:02.962019] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-09T19:49:02.962077] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-09T19:49:03.203006] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-09T19:49:03.320835] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:03.996750] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-09T19:49:04.381969] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:49:04.386073] [INFO ] [REMOTE ] KMPR: Full fetch complete (52099 records). [2025-10-09T19:49:04.386183] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-09T19:49:04.770853] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-09T19:49:04.816347] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-09T19:49:04.823817] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-09T19:49:04.824290] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-09T19:49:04.825532] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-09T19:49:04.826285] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-09T19:49:04.827853] [DEBUG] [LOCAL ] KMPR: Trimmed 52099 records to 39672 (keeping 200 days of data) [2025-10-09T19:49:05.078964] [DEBUG] [LOCAL ] KMPR: Primary data saved (39672 records). [2025-10-09T19:49:05.079200] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-09T19:49:05.079325] [INFO ] [MAIN ] Update Progress: 1202/2373 symbols completed. KMPR took 25.2s. Estimated remaining: 2h 44m 40s. Rate: 7.1 symbols/min [2025-10-09T19:49:05.246314] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:05.284071] [DEBUG] [LOCAL ] KN: Loaded 38528 existing records from primary storage. [2025-10-09T19:49:05.284380] [INFO ] [MAIN ] KN: Loaded 38528 existing records. [2025-10-09T19:49:05.473425] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:05.473748] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-09T19:49:05.473823] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-09T19:49:05.474186] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-09T19:49:05.474263] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-09T19:49:05.600744] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-09T19:49:05.781764] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T19:49:05.910238] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:06.186447] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T19:49:06.396707] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-09T19:49:07.196697] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-09T19:49:07.359799] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T19:49:07.646077] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:49:07.996752] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-09T19:49:08.589780] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:49:08.796736] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-09T19:49:09.602301] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-09T19:49:09.607879] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T19:49:10.396684] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-09T19:49:10.555782] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T19:49:11.196765] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-09T19:49:11.234970] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T19:49:11.403213] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:49:11.996768] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-09T19:49:12.656455] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T19:49:12.660457] [INFO ] [REMOTE ] KMT: Full fetch complete (61918 records). [2025-10-09T19:49:12.660600] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-09T19:49:12.811541] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-09T19:49:13.076208] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-09T19:49:13.076371] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-09T19:49:13.077708] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-09T19:49:13.077777] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-09T19:49:13.079571] [DEBUG] [LOCAL ] KMT: Trimmed 61918 records to 43222 (keeping 200 days of data) [2025-10-09T19:49:13.366369] [DEBUG] [LOCAL ] KMT: Primary data saved (43222 records). [2025-10-09T19:49:13.366572] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-09T19:49:13.366693] [INFO ] [MAIN ] Update Progress: 1203/2373 symbols completed. KMT took 33.5s. Estimated remaining: 2h 44m 31s. Rate: 7.1 symbols/min [2025-10-09T19:49:13.539807] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:13.574530] [DEBUG] [LOCAL ] KNF: Loaded 36214 existing records from primary storage. [2025-10-09T19:49:13.575046] [INFO ] [MAIN ] KNF: Loaded 36214 existing records. [2025-10-09T19:49:13.606948] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-09T19:49:13.760384] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:13.760775] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-09T19:49:13.760940] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-09T19:49:13.761228] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-09T19:49:13.761287] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-09T19:49:14.107573] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-09T19:49:14.180433] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:14.396740] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-09T19:49:14.683794] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:49:14.731200] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T19:49:15.196717] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-09T19:49:15.996694] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-09T19:49:16.375728] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T19:49:16.428584] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T19:49:16.796722] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-09T19:49:16.955030] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T19:49:17.596773] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-09T19:49:18.396778] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-09T19:49:18.566235] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:49:18.876195] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:49:19.196764] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-09T19:49:19.996706] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-09T19:49:20.224066] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T19:49:20.421754] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T19:49:20.796740] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-09T19:49:21.340457] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T19:49:21.596691] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-09T19:49:22.376814] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:49:22.396679] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-09T19:49:23.198695] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-09T19:49:23.223585] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:49:23.487807] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T19:49:23.996731] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-09T19:49:24.796783] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-09T19:49:25.112024] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T19:49:25.596710] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-09T19:49:25.824526] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T19:49:26.197483] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T19:49:26.396756] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-09T19:49:27.077461] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T19:49:27.196731] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-09T19:49:27.996686] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-09T19:49:28.032286] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:49:28.796689] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-09T19:49:28.825339] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:49:28.829884] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-09T19:49:28.830002] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-09T19:49:29.226308] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-09T19:49:29.226435] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-09T19:49:29.227521] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-09T19:49:29.227694] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-09T19:49:29.229273] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54083 (keeping 200 days of data) [2025-10-09T19:49:29.468347] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:49:29.591175] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-10-09T19:49:29.591306] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-09T19:49:29.592012] [INFO ] [MAIN ] Update Progress: 1204/2373 symbols completed. KMI took 49.7s. Estimated remaining: 2h 44m 31s. Rate: 7.1 symbols/min [2025-10-09T19:49:29.603043] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-09T19:49:29.767709] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:29.780274] [DEBUG] [LOCAL ] KNOP: Loaded 10498 existing records from primary storage. [2025-10-09T19:49:29.780499] [INFO ] [MAIN ] KNOP: Loaded 10498 existing records. [2025-10-09T19:49:29.981177] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:29.981384] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-09T19:49:29.981430] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-09T19:49:29.981708] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-09T19:49:29.981767] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-09T19:49:30.329340] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:30.396705] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-09T19:49:31.011371] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:49:31.028326] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T19:49:31.196740] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-09T19:49:31.961876] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:49:31.996701] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-09T19:49:32.694213] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T19:49:32.796734] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-09T19:49:33.453227] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (4.66 seconds). [2025-10-09T19:49:33.458717] [INFO ] [REMOTE ] KMX: Full fetch complete (75709 records). [2025-10-09T19:49:33.458953] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-09T19:49:33.460173] [FATAL] [VALIDATOR ] KMX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T19:49:33.460289] [FATAL] [MAIN ] KMX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:49:33.460334] [WARN ] [MAIN ] KMX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:49:33.460406] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-09T19:49:33.460730] [DEBUG] [LOCAL ] KMX: No primary data file found to delete. [2025-10-09T19:49:33.460972] [INFO ] [LOCAL ] KMX: Starting deletion of derivative data. [2025-10-09T19:49:33.461487] [DEBUG] [LOCAL ] KMX: Deleted derivative data file. [2025-10-09T19:49:33.461665] [INFO ] [MAIN ] Update Progress: 1205/2373 symbols completed. KMX took 30.9s. Estimated remaining: 2h 44m 18s. Rate: 7.1 symbols/min [2025-10-09T19:49:33.606542] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-09T19:49:33.642960] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:33.650964] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T19:49:33.672880] [DEBUG] [LOCAL ] KNSL: Loaded 18414 existing records from primary storage. [2025-10-09T19:49:33.673198] [INFO ] [MAIN ] KNSL: Loaded 18414 existing records. [2025-10-09T19:49:33.861293] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:33.861525] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-09T19:49:33.861580] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-09T19:49:33.861972] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-09T19:49:33.862030] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-09T19:49:34.222460] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:34.396723] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-09T19:49:34.724584] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T19:49:35.197351] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-09T19:49:35.198343] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T19:49:35.996720] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-09T19:49:36.185039] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T19:49:36.796696] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-09T19:49:36.907856] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T19:49:37.596724] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-09T19:49:37.945273] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T19:49:38.396807] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-09T19:49:38.750429] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T19:49:39.196836] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-09T19:49:39.592168] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:49:39.996726] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-09T19:49:40.344529] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T19:49:40.505155] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T19:49:40.796764] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-09T19:49:41.596706] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-09T19:49:41.633822] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T19:49:42.396787] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-09T19:49:42.835621] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-09T19:49:43.032006] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:49:43.038123] [INFO ] [REMOTE ] KNF: Full fetch complete (51035 records). [2025-10-09T19:49:43.038282] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-09T19:49:43.200265] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-09T19:49:43.433800] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-09T19:49:43.433877] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-09T19:49:43.434630] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-09T19:49:43.434708] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-09T19:49:43.435738] [DEBUG] [LOCAL ] KNF: Trimmed 51035 records to 36539 (keeping 200 days of data) [2025-10-09T19:49:43.652227] [DEBUG] [LOCAL ] KNF: Primary data saved (36539 records). [2025-10-09T19:49:43.652369] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-09T19:49:43.652451] [INFO ] [MAIN ] Update Progress: 1206/2373 symbols completed. KNF took 30.3s. Estimated remaining: 2h 44m 11s. Rate: 7.1 symbols/min [2025-10-09T19:49:43.820163] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:43.862477] [DEBUG] [LOCAL ] KNTK: Loaded 46585 existing records from primary storage. [2025-10-09T19:49:43.862861] [INFO ] [MAIN ] KNTK: Loaded 46585 existing records. [2025-10-09T19:49:44.002205] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-09T19:49:44.045548] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:44.045937] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-09T19:49:44.045987] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-09T19:49:44.046306] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-09T19:49:44.046365] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-09T19:49:44.396515] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:44.784588] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T19:49:44.807585] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-09T19:49:44.809990] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T19:49:45.528495] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T19:49:45.596725] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-09T19:49:46.396726] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-09T19:49:46.981724] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T19:49:46.985224] [INFO ] [REMOTE ] KN: Full fetch complete (56451 records). [2025-10-09T19:49:46.985315] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-09T19:49:47.201922] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-09T19:49:47.376716] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-09T19:49:47.376806] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-09T19:49:47.377726] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-09T19:49:47.377791] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-09T19:49:47.378986] [DEBUG] [LOCAL ] KN: Trimmed 56451 records to 38814 (keeping 200 days of data) [2025-10-09T19:49:47.608309] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:49:47.639760] [DEBUG] [LOCAL ] KN: Primary data saved (38814 records). [2025-10-09T19:49:47.639893] [INFO ] [MAIN ] KN: Full history saved. [2025-10-09T19:49:47.639977] [INFO ] [MAIN ] Update Progress: 1207/2373 symbols completed. KN took 42.6s. Estimated remaining: 2h 43m 58s. Rate: 7.1 symbols/min [2025-10-09T19:49:47.804101] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:47.854496] [DEBUG] [LOCAL ] KNX: Loaded 52596 existing records from primary storage. [2025-10-09T19:49:47.854836] [INFO ] [MAIN ] KNX: Loaded 52596 existing records. [2025-10-09T19:49:48.006353] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-09T19:49:48.036732] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:48.037895] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-09T19:49:48.038013] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-09T19:49:48.038552] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-09T19:49:48.038892] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-09T19:49:48.213694] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T19:49:48.421417] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:48.796682] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-09T19:49:48.894939] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T19:49:49.596784] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-09T19:49:49.806703] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T19:49:50.229596] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T19:49:50.231036] [INFO ] [REMOTE ] KNOP: Full fetch complete (14606 records). [2025-10-09T19:49:50.231107] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-09T19:49:50.407705] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-09T19:49:50.602910] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-09T19:49:50.603009] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-09T19:49:50.603544] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-09T19:49:50.603587] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-09T19:49:50.604252] [DEBUG] [LOCAL ] KNOP: Trimmed 14606 records to 10559 (keeping 200 days of data) [2025-10-09T19:49:50.669394] [DEBUG] [LOCAL ] KNOP: Primary data saved (10559 records). [2025-10-09T19:49:50.669538] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-09T19:49:50.669667] [INFO ] [MAIN ] Update Progress: 1208/2373 symbols completed. KNOP took 21.1s. Estimated remaining: 2h 43m 44s. Rate: 7.1 symbols/min [2025-10-09T19:49:50.838917] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:50.839193] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-09T19:49:50.839244] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-09T19:49:50.839360] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-09T19:49:50.839402] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-09T19:49:50.839443] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-09T19:49:50.839476] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-09T19:49:51.193524] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:51.196672] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-09T19:49:51.785869] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T19:49:51.996782] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-09T19:49:52.796778] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-09T19:49:52.986436] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T19:49:53.327086] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-09T19:49:53.596733] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-09T19:49:53.657962] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T19:49:54.396719] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-09T19:49:54.894732] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T19:49:55.196734] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-09T19:49:55.764398] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T19:49:55.996754] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-09T19:49:56.483965] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:49:56.796719] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-09T19:49:57.596766] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-09T19:49:58.182682] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T19:49:58.259424] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-09T19:49:58.291832] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T19:49:58.396682] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-09T19:49:59.196696] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-09T19:49:59.321490] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:49:59.996724] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-09T19:50:00.796697] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-09T19:50:01.079329] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T19:50:01.162785] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T19:50:01.596744] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-09T19:50:02.396777] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-09T19:50:02.966423] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T19:50:03.121502] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-09T19:50:03.196669] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-09T19:50:03.474667] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T19:50:03.996705] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-09T19:50:04.796791] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-09T19:50:05.409673] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T19:50:05.596734] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-09T19:50:05.792360] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-09T19:50:06.401862] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-09T19:50:06.416830] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T19:50:07.180538] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:50:07.196665] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-09T19:50:07.418237] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T19:50:07.996749] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-09T19:50:08.184333] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T19:50:08.186925] [INFO ] [REMOTE ] KNSL: Full fetch complete (26835 records). [2025-10-09T19:50:08.187048] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-09T19:50:08.554776] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-09T19:50:08.554880] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-09T19:50:08.555478] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-09T19:50:08.555520] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-09T19:50:08.556190] [DEBUG] [LOCAL ] KNSL: Trimmed 26835 records to 18524 (keeping 200 days of data) [2025-10-09T19:50:08.674812] [DEBUG] [LOCAL ] KNSL: Primary data saved (18524 records). [2025-10-09T19:50:08.674969] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-09T19:50:08.675106] [INFO ] [MAIN ] Update Progress: 1209/2373 symbols completed. KNSL took 35.2s. Estimated remaining: 2h 43m 45s. Rate: 7.1 symbols/min [2025-10-09T19:50:08.801869] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-09T19:50:08.855808] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:08.897577] [DEBUG] [LOCAL ] KODK: Loaded 43452 existing records from primary storage. [2025-10-09T19:50:08.897976] [INFO ] [MAIN ] KODK: Loaded 43452 existing records. [2025-10-09T19:50:09.078725] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:09.078945] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-09T19:50:09.078994] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-09T19:50:09.079221] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-09T19:50:09.079279] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-09T19:50:09.452203] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:09.596726] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-09T19:50:09.660681] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T19:50:10.396755] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-09T19:50:11.196714] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-09T19:50:11.306979] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T19:50:11.529298] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-09T19:50:11.940811] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T19:50:11.996679] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-09T19:50:12.796718] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-09T19:50:12.964349] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:50:13.596702] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-09T19:50:13.659093] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:50:14.265008] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:50:14.396721] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-09T19:50:14.854510] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T19:50:15.196799] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-09T19:50:15.954471] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:50:15.996685] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-09T19:50:16.758043] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:50:16.796750] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-09T19:50:17.591285] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:50:17.599881] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-09T19:50:18.201413] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T19:50:18.205854] [INFO ] [REMOTE ] KNTK: Full fetch complete (64963 records). [2025-10-09T19:50:18.205964] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-09T19:50:18.402001] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-09T19:50:18.594172] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-09T19:50:18.594255] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-09T19:50:18.595157] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-09T19:50:18.595222] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-09T19:50:18.596527] [DEBUG] [LOCAL ] KNTK: Trimmed 64963 records to 46944 (keeping 200 days of data) [2025-10-09T19:50:18.888851] [DEBUG] [LOCAL ] KNTK: Primary data saved (46944 records). [2025-10-09T19:50:18.889006] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-09T19:50:18.889120] [INFO ] [MAIN ] Update Progress: 1210/2373 symbols completed. KNTK took 35.2s. Estimated remaining: 2h 43m 39s. Rate: 7.1 symbols/min [2025-10-09T19:50:19.061264] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:19.087519] [DEBUG] [LOCAL ] KOF: Loaded 26540 existing records from primary storage. [2025-10-09T19:50:19.087827] [INFO ] [MAIN ] KOF: Loaded 26540 existing records. [2025-10-09T19:50:19.201283] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-09T19:50:19.272916] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:19.273436] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-09T19:50:19.273556] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-09T19:50:19.273927] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-09T19:50:19.274080] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-09T19:50:19.607448] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T19:50:19.676172] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:19.996805] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-09T19:50:20.451342] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:50:20.796695] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-09T19:50:20.895529] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-09T19:50:21.275573] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T19:50:21.596729] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-09T19:50:22.039117] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T19:50:22.396694] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-09T19:50:23.196822] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-09T19:50:23.425527] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:50:23.996757] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-09T19:50:24.059352] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-09T19:50:24.260859] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:50:24.796693] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-09T19:50:25.596707] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-09T19:50:25.867218] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:50:26.396706] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-09T19:50:26.694052] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-09T19:50:26.698714] [INFO ] [REMOTE ] KNX: Full fetch complete (75914 records). [2025-10-09T19:50:26.698833] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-09T19:50:27.093382] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-09T19:50:27.093555] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-09T19:50:27.094779] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-09T19:50:27.094853] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-09T19:50:27.096505] [DEBUG] [LOCAL ] KNX: Trimmed 75914 records to 52986 (keeping 200 days of data) [2025-10-09T19:50:27.196895] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-09T19:50:27.428176] [DEBUG] [LOCAL ] KNX: Primary data saved (52986 records). [2025-10-09T19:50:27.428364] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-09T19:50:27.428483] [INFO ] [MAIN ] Update Progress: 1211/2373 symbols completed. KNX took 39.8s. Estimated remaining: 2h 43m 30s. Rate: 7.1 symbols/min [2025-10-09T19:50:27.597210] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:27.615421] [DEBUG] [LOCAL ] KOP: Loaded 17423 existing records from primary storage. [2025-10-09T19:50:27.615697] [INFO ] [MAIN ] KOP: Loaded 17423 existing records. [2025-10-09T19:50:27.815584] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:27.816126] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-09T19:50:27.816201] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-09T19:50:27.816617] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-09T19:50:27.816718] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-09T19:50:28.045676] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T19:50:28.123608] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-09T19:50:28.272169] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:28.275577] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-09T19:50:28.354034] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T19:50:28.796724] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-09T19:50:29.596699] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-09T19:50:29.736800] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T19:50:29.869150] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T19:50:30.272948] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T19:50:30.396690] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-09T19:50:31.196763] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-09T19:50:31.437234] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T19:50:31.996810] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-09T19:50:32.728357] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:50:32.732284] [INFO ] [REMOTE ] KODK: Full fetch complete (63331 records). [2025-10-09T19:50:32.732388] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-09T19:50:32.805735] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-09T19:50:33.113223] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-09T19:50:33.113309] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-09T19:50:33.114226] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-09T19:50:33.114293] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-09T19:50:33.115707] [DEBUG] [LOCAL ] KODK: Trimmed 63331 records to 43771 (keeping 200 days of data) [2025-10-09T19:50:33.366928] [DEBUG] [LOCAL ] KODK: Primary data saved (43771 records). [2025-10-09T19:50:33.367315] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-09T19:50:33.367418] [INFO ] [MAIN ] Update Progress: 1212/2373 symbols completed. KODK took 24.7s. Estimated remaining: 2h 43m 19s. Rate: 7.1 symbols/min [2025-10-09T19:50:33.535465] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:33.544101] [DEBUG] [LOCAL ] KORE: Loaded 2116 existing records from primary storage. [2025-10-09T19:50:33.544266] [INFO ] [MAIN ] KORE: Loaded 2116 existing records. [2025-10-09T19:50:33.607080] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-09T19:50:33.721370] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:33.721608] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-09T19:50:33.721683] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-09T19:50:33.722142] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-09T19:50:33.722200] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-09T19:50:33.998257] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T19:50:34.142393] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:34.396730] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-09T19:50:34.538222] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-09T19:50:34.825275] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T19:50:35.196735] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-09T19:50:35.288485] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T19:50:35.996702] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-09T19:50:36.326373] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T19:50:36.551673] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-09T19:50:36.796718] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-09T19:50:37.596740] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-09T19:50:37.926153] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:50:38.396685] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-09T19:50:38.658461] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T19:50:39.196746] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-09T19:50:39.393140] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T19:50:39.662974] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T19:50:39.996754] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-09T19:50:40.274341] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-09T19:50:40.796719] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-09T19:50:41.241801] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T19:50:41.596712] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-09T19:50:42.396678] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-09T19:50:42.493110] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T19:50:43.196724] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-09T19:50:43.922377] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T19:50:43.996690] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-09T19:50:44.684559] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-09T19:50:44.796694] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-09T19:50:44.989760] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T19:50:45.114323] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-09T19:50:45.596730] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-09T19:50:46.396707] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-09T19:50:46.773985] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-09T19:50:47.196794] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-09T19:50:47.724324] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T19:50:47.799499] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-09T19:50:47.804192] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-09T19:50:47.804326] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-09T19:50:48.000144] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-09T19:50:47.999964] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T19:50:48.002953] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:50:48.004126] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:50:48.004212] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-09T19:50:48.004284] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-09T19:50:48.004321] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-09T19:50:48.004376] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-09T19:50:48.004470] [INFO ] [MAIN ] Update Progress: 1213/2373 symbols completed. KO took 57.3s. Estimated remaining: 2h 43m 17s. Rate: 7.1 symbols/min [2025-10-09T19:50:48.209439] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:48.262772] [DEBUG] [LOCAL ] KOS: Loaded 53075 existing records from primary storage. [2025-10-09T19:50:48.263136] [INFO ] [MAIN ] KOS: Loaded 53075 existing records. [2025-10-09T19:50:48.442194] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:48.442433] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-09T19:50:48.442486] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-09T19:50:48.442818] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-09T19:50:48.442878] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-09T19:50:48.553622] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T19:50:48.801364] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-09T19:50:48.801253] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:49.596774] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-09T19:50:50.080832] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T19:50:50.396745] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-09T19:50:51.133154] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T19:50:51.196688] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-09T19:50:51.862892] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T19:50:51.996730] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-09T19:50:52.796748] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-09T19:50:52.961964] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T19:50:53.218715] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T19:50:53.234072] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T19:50:53.596749] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-09T19:50:54.396754] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-09T19:50:55.001627] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T19:50:55.196713] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-09T19:50:55.597350] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:50:55.996730] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-09T19:50:56.566748] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T19:50:56.796761] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-09T19:50:56.971541] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T19:50:57.318994] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T19:50:57.320100] [INFO ] [REMOTE ] KORE: Full fetch complete (5646 records). [2025-10-09T19:50:57.320173] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-09T19:50:57.601866] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-09T19:50:57.676671] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-09T19:50:57.676771] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-09T19:50:57.676946] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-09T19:50:57.676988] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-09T19:50:57.677349] [DEBUG] [LOCAL ] KORE: Trimmed 5646 records to 2137 (keeping 200 days of data) [2025-10-09T19:50:57.689995] [DEBUG] [LOCAL ] KORE: Primary data saved (2137 records). [2025-10-09T19:50:57.690065] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-09T19:50:57.690142] [INFO ] [MAIN ] Update Progress: 1214/2373 symbols completed. KORE took 24.3s. Estimated remaining: 2h 43m 10s. Rate: 7.1 symbols/min [2025-10-09T19:50:57.859358] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:57.908331] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-09T19:50:57.908712] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-09T19:50:58.082568] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:58.082777] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-09T19:50:58.082823] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-09T19:50:58.083051] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-09T19:50:58.083107] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-09T19:50:58.401853] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-09T19:50:58.431166] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:58.875363] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:50:58.878311] [INFO ] [REMOTE ] KOF: Full fetch complete (37640 records). [2025-10-09T19:50:58.878401] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-09T19:50:59.204439] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-09T19:50:59.256560] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-09T19:50:59.256632] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-09T19:50:59.257429] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-09T19:50:59.257508] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-09T19:50:59.258514] [DEBUG] [LOCAL ] KOF: Trimmed 37640 records to 26683 (keeping 200 days of data) [2025-10-09T19:50:59.429611] [DEBUG] [LOCAL ] KOF: Primary data saved (26683 records). [2025-10-09T19:50:59.429787] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-09T19:50:59.429893] [INFO ] [MAIN ] Update Progress: 1215/2373 symbols completed. KOF took 40.5s. Estimated remaining: 2h 42m 55s. Rate: 7.1 symbols/min [2025-10-09T19:50:59.609112] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:59.654668] [DEBUG] [LOCAL ] KRC: Loaded 48354 existing records from primary storage. [2025-10-09T19:50:59.655027] [INFO ] [MAIN ] KRC: Loaded 48354 existing records. [2025-10-09T19:50:59.841817] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:59.842020] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-09T19:50:59.842068] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-09T19:50:59.842516] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-09T19:50:59.842576] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-09T19:51:00.001475] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-09T19:51:00.224085] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:00.253362] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T19:51:00.796692] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-09T19:51:01.133602] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:51:01.255997] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-09T19:51:01.596724] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-09T19:51:02.397629] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-09T19:51:02.405465] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T19:51:03.196733] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-09T19:51:03.358331] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T19:51:03.360254] [INFO ] [REMOTE ] KOP: Full fetch complete (25505 records). [2025-10-09T19:51:03.360322] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-09T19:51:03.699169] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-09T19:51:03.766420] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-09T19:51:03.766512] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-09T19:51:03.767055] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-09T19:51:03.767116] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-09T19:51:03.767770] [DEBUG] [LOCAL ] KOP: Trimmed 25505 records to 17572 (keeping 200 days of data) [2025-10-09T19:51:03.879685] [DEBUG] [LOCAL ] KOP: Primary data saved (17572 records). [2025-10-09T19:51:03.879835] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-09T19:51:03.879921] [INFO ] [MAIN ] Update Progress: 1216/2373 symbols completed. KOP took 36.5s. Estimated remaining: 2h 42m 42s. Rate: 7.1 symbols/min [2025-10-09T19:51:04.001779] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-09T19:51:04.052749] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:04.094437] [DEBUG] [LOCAL ] KREF: Loaded 37756 existing records from primary storage. [2025-10-09T19:51:04.094750] [INFO ] [MAIN ] KREF: Loaded 37756 existing records. [2025-10-09T19:51:04.268322] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:04.268549] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-09T19:51:04.268605] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-09T19:51:04.269132] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-09T19:51:04.269190] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-09T19:51:04.635620] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:04.796668] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-09T19:51:05.109846] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T19:51:05.596767] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-09T19:51:05.694228] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:51:06.205911] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:51:06.396679] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-09T19:51:07.196830] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-09T19:51:07.238169] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:51:07.702494] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:51:07.996709] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-09T19:51:08.762676] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:51:08.796671] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-09T19:51:08.851999] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:51:09.596741] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-09T19:51:10.239907] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:51:10.396736] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-09T19:51:11.196688] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-09T19:51:11.278490] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T19:51:11.899413] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T19:51:11.996722] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-09T19:51:12.418266] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T19:51:12.796721] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-09T19:51:13.596699] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-09T19:51:13.733869] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T19:51:14.363538] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T19:51:14.396665] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-09T19:51:15.196750] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-09T19:51:15.260667] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T19:51:15.996776] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-09T19:51:16.105831] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T19:51:16.796694] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-09T19:51:17.044541] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:51:17.150666] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T19:51:17.596741] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-09T19:51:18.396691] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-09T19:51:18.483846] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T19:51:18.987895] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T19:51:19.196779] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-09T19:51:19.996770] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-09T19:51:20.300925] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T19:51:20.796796] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-09T19:51:20.879144] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T19:51:21.304439] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T19:51:21.596725] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-09T19:51:22.396730] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-09T19:51:22.572038] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:51:23.156590] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:51:23.196781] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-09T19:51:24.002027] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-09T19:51:24.031411] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T19:51:24.796777] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-09T19:51:25.020680] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T19:51:25.230154] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T19:51:25.596733] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-09T19:51:26.403465] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-09T19:51:26.409525] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T19:51:27.141000] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T19:51:27.145812] [INFO ] [REMOTE ] KOS: Full fetch complete (76870 records). [2025-10-09T19:51:27.145928] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-09T19:51:27.202029] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-09T19:51:27.540357] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-09T19:51:27.540457] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-09T19:51:27.541512] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-09T19:51:27.541581] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-09T19:51:27.543174] [DEBUG] [LOCAL ] KOS: Trimmed 76870 records to 53462 (keeping 200 days of data) [2025-10-09T19:51:27.859459] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T19:51:27.892674] [DEBUG] [LOCAL ] KOS: Primary data saved (53462 records). [2025-10-09T19:51:27.892879] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-09T19:51:27.893724] [INFO ] [MAIN ] Update Progress: 1217/2373 symbols completed. KOS took 39.9s. Estimated remaining: 2h 42m 49s. Rate: 7.1 symbols/min [2025-10-09T19:51:28.002003] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-09T19:51:28.077195] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:28.130627] [DEBUG] [LOCAL ] KRG: Loaded 49171 existing records from primary storage. [2025-10-09T19:51:28.131012] [INFO ] [MAIN ] KRG: Loaded 49171 existing records. [2025-10-09T19:51:28.332907] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:28.333192] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-09T19:51:28.333245] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-09T19:51:28.333505] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-09T19:51:28.333565] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-09T19:51:28.735143] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:28.796801] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-09T19:51:29.342430] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-09T19:51:29.490635] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T19:51:29.596750] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-09T19:51:30.032499] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:51:30.396796] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-09T19:51:31.046778] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:51:31.050899] [INFO ] [REMOTE ] KREF: Full fetch complete (52766 records). [2025-10-09T19:51:31.050999] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-09T19:51:31.221534] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-09T19:51:31.426509] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-09T19:51:31.426590] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-09T19:51:31.427427] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-09T19:51:31.427494] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-09T19:51:31.428723] [DEBUG] [LOCAL ] KREF: Trimmed 52766 records to 38087 (keeping 200 days of data) [2025-10-09T19:51:31.665280] [DEBUG] [LOCAL ] KREF: Primary data saved (38087 records). [2025-10-09T19:51:31.665425] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-09T19:51:31.665521] [INFO ] [MAIN ] Update Progress: 1218/2373 symbols completed. KREF took 27.8s. Estimated remaining: 2h 42m 36s. Rate: 7.1 symbols/min [2025-10-09T19:51:31.836817] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:31.837060] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-09T19:51:31.837115] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-09T19:51:31.837227] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-09T19:51:31.837268] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-09T19:51:31.837307] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-09T19:51:31.837339] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-09T19:51:32.005830] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-09T19:51:32.186936] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:32.651102] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T19:51:32.678958] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-09T19:51:32.683507] [INFO ] [REMOTE ] KR: Full fetch complete (77680 records). [2025-10-09T19:51:32.683619] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-09T19:51:32.801677] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-09T19:51:33.028841] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:51:33.050409] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-09T19:51:33.098617] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:51:33.120417] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-09T19:51:33.124221] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:51:33.124344] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-09T19:51:33.124415] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-09T19:51:33.124518] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-09T19:51:33.125965] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-09T19:51:33.126044] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-09T19:51:33.124617] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-09T19:51:33.126298] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-09T19:51:33.126384] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-09T19:51:33.126460] [INFO ] [MAIN ] Update Progress: 1219/2373 symbols completed. KRMN took 1.5s. Estimated remaining: 2h 42m 21s. Rate: 7.1 symbols/min [2025-10-09T19:51:33.228194] [DEBUG] [LOCAL ] KR: Trimmed 77680 records to 54071 (keeping 200 days of data) [2025-10-09T19:51:33.355293] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:33.538056] [DEBUG] [LOCAL ] KRO: Loaded 26221 existing records from primary storage. [2025-10-09T19:51:33.539351] [INFO ] [MAIN ] KRO: Loaded 26221 existing records. [2025-10-09T19:51:33.602784] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-09T19:51:33.732786] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:33.733764] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-09T19:51:33.736875] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-09T19:51:33.740044] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-09T19:51:33.740633] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-09T19:51:33.883217] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T19:51:34.154796] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:34.252712] [DEBUG] [LOCAL ] KR: Primary data saved (54071 records). [2025-10-09T19:51:34.252869] [INFO ] [MAIN ] KR: Full history saved. [2025-10-09T19:51:34.253772] [INFO ] [MAIN ] Update Progress: 1220/2373 symbols completed. KR took 36.6s. Estimated remaining: 2h 42m 6s. Rate: 7.1 symbols/min [2025-10-09T19:51:34.402215] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-09T19:51:34.422696] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:34.465199] [DEBUG] [LOCAL ] KRP: Loaded 36701 existing records from primary storage. [2025-10-09T19:51:34.465509] [INFO ] [MAIN ] KRP: Loaded 36701 existing records. [2025-10-09T19:51:34.640272] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:34.640507] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-09T19:51:34.640554] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-09T19:51:34.640911] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-09T19:51:34.640971] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-09T19:51:34.999913] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:35.189316] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:51:35.198274] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-09T19:51:35.602114] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T19:51:35.996779] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-09T19:51:36.791804] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T19:51:36.797237] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-09T19:51:36.799119] [INFO ] [REMOTE ] KRC: Full fetch complete (69895 records). [2025-10-09T19:51:36.799237] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-09T19:51:37.190202] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-09T19:51:37.190296] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-09T19:51:37.191250] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-09T19:51:37.191317] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-09T19:51:37.192794] [DEBUG] [LOCAL ] KRC: Trimmed 69895 records to 48686 (keeping 200 days of data) [2025-10-09T19:51:37.499533] [DEBUG] [LOCAL ] KRC: Primary data saved (48686 records). [2025-10-09T19:51:37.499804] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-09T19:51:37.499934] [INFO ] [MAIN ] Update Progress: 1221/2373 symbols completed. KRC took 38.1s. Estimated remaining: 2h 41m 52s. Rate: 7.1 symbols/min [2025-10-09T19:51:37.597739] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-09T19:51:37.677707] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:37.706241] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:51:37.763276] [DEBUG] [LOCAL ] KSS: Loaded 53597 existing records from primary storage. [2025-10-09T19:51:37.763636] [INFO ] [MAIN ] KSS: Loaded 53597 existing records. [2025-10-09T19:51:37.941020] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:37.941253] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-09T19:51:37.941300] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-09T19:51:37.941959] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-09T19:51:37.942018] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-09T19:51:38.294233] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:38.388124] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T19:51:38.396679] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-09T19:51:38.677464] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T19:51:39.196740] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-09T19:51:39.726284] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:51:39.996755] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-09T19:51:40.757571] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T19:51:40.796698] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-09T19:51:41.266277] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-09T19:51:41.596715] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-09T19:51:41.856332] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T19:51:42.396789] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-09T19:51:43.054025] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T19:51:43.196765] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-09T19:51:43.996777] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-09T19:51:44.057529] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:51:44.796761] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-09T19:51:45.074365] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T19:51:45.596758] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-09T19:51:45.658540] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T19:51:46.110367] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T19:51:46.396742] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-09T19:51:47.033744] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:51:47.196736] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-09T19:51:47.996806] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-09T19:51:48.048049] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T19:51:48.668505] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T19:51:48.796731] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-09T19:51:49.136467] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T19:51:49.596744] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-09T19:51:50.259455] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:51:50.396741] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-09T19:51:50.795086] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T19:51:51.196755] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-09T19:51:51.659201] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:51:51.996753] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-09T19:51:52.698808] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T19:51:52.796749] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-09T19:51:53.596761] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-09T19:51:54.050371] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T19:51:54.370252] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T19:51:54.396675] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-09T19:51:54.515948] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:51:55.196735] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-09T19:51:55.926084] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:51:55.930535] [INFO ] [REMOTE ] KRG: Full fetch complete (71089 records). [2025-10-09T19:51:55.930711] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-09T19:51:56.005386] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-09T19:51:56.325724] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-09T19:51:56.325837] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-09T19:51:56.326829] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-09T19:51:56.326903] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-09T19:51:56.328460] [DEBUG] [LOCAL ] KRG: Trimmed 71089 records to 49521 (keeping 200 days of data) [2025-10-09T19:51:56.635317] [DEBUG] [LOCAL ] KRG: Primary data saved (49521 records). [2025-10-09T19:51:56.635463] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-09T19:51:56.636061] [INFO ] [MAIN ] Update Progress: 1222/2373 symbols completed. KRG took 28.7s. Estimated remaining: 2h 41m 54s. Rate: 7.1 symbols/min [2025-10-09T19:51:56.805105] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:56.803541] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-09T19:51:56.851149] [DEBUG] [LOCAL ] KT: Loaded 45551 existing records from primary storage. [2025-10-09T19:51:56.851490] [INFO ] [MAIN ] KT: Loaded 45551 existing records. [2025-10-09T19:51:57.063106] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:57.063474] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-09T19:51:57.063629] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-09T19:51:57.064198] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-09T19:51:57.064261] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-09T19:51:57.394193] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T19:51:57.489688] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T19:51:57.518781] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:57.596680] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-09T19:51:57.989266] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T19:51:58.396744] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-09T19:51:59.152420] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T19:51:59.196679] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-09T19:51:59.862000] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T19:51:59.996776] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-09T19:52:00.292317] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:52:00.796759] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-09T19:52:01.374625] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T19:52:01.596764] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-09T19:52:02.091781] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T19:52:02.396711] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-09T19:52:02.731733] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:52:03.196749] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-09T19:52:03.544855] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T19:52:03.996733] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-09T19:52:04.555355] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:52:04.558337] [INFO ] [REMOTE ] KRO: Full fetch complete (35094 records). [2025-10-09T19:52:04.558527] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-09T19:52:04.802013] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-09T19:52:04.956826] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-09T19:52:04.956894] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-09T19:52:04.957670] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-09T19:52:04.957768] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-09T19:52:04.958737] [DEBUG] [LOCAL ] KRO: Trimmed 35094 records to 26410 (keeping 200 days of data) [2025-10-09T19:52:05.114504] [DEBUG] [LOCAL ] KRO: Primary data saved (26410 records). [2025-10-09T19:52:05.114707] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-09T19:52:05.114828] [INFO ] [MAIN ] Update Progress: 1223/2373 symbols completed. KRO took 32.0s. Estimated remaining: 2h 41m 45s. Rate: 7.1 symbols/min [2025-10-09T19:52:05.298329] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:05.294949] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T19:52:05.301825] [INFO ] [REMOTE ] KRP: Full fetch complete (54798 records). [2025-10-09T19:52:05.301907] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-09T19:52:05.601825] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-09T19:52:05.632190] [DEBUG] [LOCAL ] KTB: Loaded 40584 existing records from primary storage. [2025-10-09T19:52:05.633469] [INFO ] [MAIN ] KTB: Loaded 40584 existing records. [2025-10-09T19:52:05.828358] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-09T19:52:05.833901] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-09T19:52:05.834872] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-09T19:52:05.834957] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-09T19:52:05.889173] [DEBUG] [LOCAL ] KRP: Trimmed 54798 records to 36952 (keeping 200 days of data) [2025-10-09T19:52:05.912009] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:05.912288] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-09T19:52:05.912353] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-09T19:52:05.912743] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-09T19:52:05.912815] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-09T19:52:06.388269] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:06.396897] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-09T19:52:06.514684] [DEBUG] [LOCAL ] KRP: Primary data saved (36952 records). [2025-10-09T19:52:06.514855] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-09T19:52:06.514943] [INFO ] [MAIN ] Update Progress: 1224/2373 symbols completed. KRP took 32.3s. Estimated remaining: 2h 41m 30s. Rate: 7.1 symbols/min [2025-10-09T19:52:06.692244] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:06.705899] [DEBUG] [LOCAL ] KTF: Loaded 12064 existing records from primary storage. [2025-10-09T19:52:06.706210] [INFO ] [MAIN ] KTF: Loaded 12064 existing records. [2025-10-09T19:52:06.884810] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:06.885165] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-09T19:52:06.885431] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-09T19:52:06.885832] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-09T19:52:06.885985] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-09T19:52:07.199279] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-09T19:52:07.236269] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-09T19:52:07.309051] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:07.334732] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T19:52:07.452686] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:52:07.996723] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-09T19:52:08.659056] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T19:52:08.796718] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-09T19:52:09.596716] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-09T19:52:09.664352] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T19:52:09.759773] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T19:52:10.396730] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-09T19:52:11.196776] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-09T19:52:11.595576] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T19:52:11.955417] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T19:52:11.996665] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-09T19:52:12.069429] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T19:52:12.796693] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-09T19:52:12.807897] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T19:52:13.596767] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-09T19:52:14.108141] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T19:52:14.396726] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-09T19:52:14.537057] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:52:15.196784] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-09T19:52:15.933480] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T19:52:15.998369] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-09T19:52:16.006090] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T19:52:16.796789] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-09T19:52:17.044166] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T19:52:17.596733] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-09T19:52:18.269787] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T19:52:18.396729] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-09T19:52:18.759457] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T19:52:19.196724] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-09T19:52:19.996732] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-09T19:52:20.373402] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T19:52:20.456836] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T19:52:20.648514] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:52:20.796736] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-09T19:52:21.596748] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-09T19:52:21.714757] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:52:22.396730] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-09T19:52:23.127400] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T19:52:23.196761] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-09T19:52:23.488954] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T19:52:23.494316] [INFO ] [REMOTE ] KSS: Full fetch complete (77627 records). [2025-10-09T19:52:23.494540] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-09T19:52:23.934579] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-09T19:52:23.934710] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-09T19:52:23.935758] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-09T19:52:23.935824] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-09T19:52:23.937341] [DEBUG] [LOCAL ] KSS: Trimmed 77627 records to 53986 (keeping 200 days of data) [2025-10-09T19:52:23.998514] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-09T19:52:24.270242] [DEBUG] [LOCAL ] KSS: Primary data saved (53986 records). [2025-10-09T19:52:24.270396] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-09T19:52:24.270482] [INFO ] [MAIN ] Update Progress: 1225/2373 symbols completed. KSS took 46.8s. Estimated remaining: 2h 41m 31s. Rate: 7.1 symbols/min [2025-10-09T19:52:24.442713] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:24.442932] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-09T19:52:24.442979] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-09T19:52:24.443094] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-09T19:52:24.443137] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-09T19:52:24.443179] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-09T19:52:24.443212] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-09T19:52:24.752132] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:52:24.805503] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-09T19:52:24.837862] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:24.863065] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T19:52:25.592824] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:52:25.596683] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-09T19:52:26.396747] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-09T19:52:27.090215] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T19:52:27.118205] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:52:27.196746] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-09T19:52:27.996737] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-09T19:52:28.732426] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T19:52:28.733760] [INFO ] [REMOTE ] KTF: Full fetch complete (17490 records). [2025-10-09T19:52:28.733833] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-09T19:52:28.799088] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-09T19:52:29.038482] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T19:52:29.161125] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-09T19:52:29.161230] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-09T19:52:29.161675] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-09T19:52:29.161739] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-09T19:52:29.162307] [DEBUG] [LOCAL ] KTF: Trimmed 17490 records to 12113 (keeping 200 days of data) [2025-10-09T19:52:29.240236] [DEBUG] [LOCAL ] KTF: Primary data saved (12113 records). [2025-10-09T19:52:29.240393] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-09T19:52:29.240482] [INFO ] [MAIN ] Update Progress: 1226/2373 symbols completed. KTF took 22.7s. Estimated remaining: 2h 41m 19s. Rate: 7.1 symbols/min [2025-10-09T19:52:29.412413] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:29.466901] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-09T19:52:29.467248] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-09T19:52:29.607860] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-09T19:52:29.652206] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:29.652590] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-09T19:52:29.652662] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-09T19:52:29.653239] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-09T19:52:29.653299] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-09T19:52:30.009315] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:30.396696] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-09T19:52:30.569488] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:52:31.196753] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-09T19:52:31.257433] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T19:52:31.996776] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-09T19:52:32.198004] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T19:52:32.414382] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T19:52:32.796802] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-09T19:52:33.188342] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:52:33.192280] [INFO ] [REMOTE ] KT: Full fetch complete (66452 records). [2025-10-09T19:52:33.192384] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-09T19:52:33.591494] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T19:52:33.613905] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-09T19:52:33.618521] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-09T19:52:33.618858] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-09T19:52:33.620616] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-09T19:52:33.620847] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-09T19:52:33.622354] [DEBUG] [LOCAL ] KT: Trimmed 66452 records to 45849 (keeping 200 days of data) [2025-10-09T19:52:33.916330] [DEBUG] [LOCAL ] KT: Primary data saved (45849 records). [2025-10-09T19:52:33.916528] [INFO ] [MAIN ] KT: Full history saved. [2025-10-09T19:52:33.917197] [INFO ] [MAIN ] Update Progress: 1227/2373 symbols completed. KT took 37.3s. Estimated remaining: 2h 41m 7s. Rate: 7.1 symbols/min [2025-10-09T19:52:34.085937] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:34.132256] [DEBUG] [LOCAL ] KVYO: Loaded 50429 existing records from primary storage. [2025-10-09T19:52:34.132558] [INFO ] [MAIN ] KVYO: Loaded 50429 existing records. [2025-10-09T19:52:34.310699] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:34.310951] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-09T19:52:34.311002] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-09T19:52:34.311281] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-09T19:52:34.311339] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-09T19:52:34.401904] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-09T19:52:34.672103] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:34.927141] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T19:52:35.121296] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T19:52:35.196715] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-09T19:52:35.996752] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-09T19:52:36.796730] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-09T19:52:36.839705] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T19:52:36.908850] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T19:52:37.596732] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-09T19:52:38.300264] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T19:52:38.396696] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-09T19:52:38.458236] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:52:38.765082] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-09T19:52:39.196750] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-09T19:52:39.510921] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-09T19:52:39.996770] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-09T19:52:40.796785] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-09T19:52:41.219604] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-09T19:52:41.588637] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T19:52:41.598292] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-09T19:52:42.396756] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-09T19:52:42.975356] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T19:52:43.196781] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-09T19:52:43.611687] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T19:52:43.761434] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T19:52:43.996724] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-09T19:52:44.796724] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-09T19:52:45.388805] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:52:45.403349] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T19:52:45.596737] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-09T19:52:46.396752] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-09T19:52:46.968391] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T19:52:46.972120] [INFO ] [REMOTE ] KTB: Full fetch complete (57931 records). [2025-10-09T19:52:46.972294] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-09T19:52:47.206359] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-09T19:52:47.370664] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-09T19:52:47.370763] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-09T19:52:47.371662] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-09T19:52:47.371725] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-09T19:52:47.372978] [DEBUG] [LOCAL ] KTB: Trimmed 57931 records to 40852 (keeping 200 days of data) [2025-10-09T19:52:47.630944] [DEBUG] [LOCAL ] KTB: Primary data saved (40852 records). [2025-10-09T19:52:47.631081] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-09T19:52:47.631163] [INFO ] [MAIN ] Update Progress: 1228/2373 symbols completed. KTB took 42.5s. Estimated remaining: 2h 41m 4s. Rate: 7.1 symbols/min [2025-10-09T19:52:47.816727] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:47.854893] [DEBUG] [LOCAL ] KW: Loaded 40373 existing records from primary storage. [2025-10-09T19:52:47.855189] [INFO ] [MAIN ] KW: Loaded 40373 existing records. [2025-10-09T19:52:47.999359] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-09T19:52:48.038679] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:48.040249] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-09T19:52:48.040321] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-09T19:52:48.040943] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-09T19:52:48.041156] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-09T19:52:48.353178] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T19:52:48.444884] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:48.796769] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-09T19:52:49.007248] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T19:52:49.059989] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T19:52:49.061537] [INFO ] [REMOTE ] KUKE: Full fetch complete (8794 records). [2025-10-09T19:52:49.061607] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-09T19:52:49.242728] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T19:52:49.242954] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:52:49.243020] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:52:49.243074] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-09T19:52:49.243131] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-09T19:52:49.243193] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-09T19:52:49.243235] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-09T19:52:49.243290] [INFO ] [MAIN ] Update Progress: 1229/2373 symbols completed. KUKE took 25.0s. Estimated remaining: 2h 40m 49s. Rate: 7.1 symbols/min [2025-10-09T19:52:49.408145] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:49.429543] [DEBUG] [LOCAL ] KWR: Loaded 16250 existing records from primary storage. [2025-10-09T19:52:49.429829] [INFO ] [MAIN ] KWR: Loaded 16250 existing records. [2025-10-09T19:52:49.601979] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-09T19:52:49.604201] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:49.605348] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-09T19:52:49.605400] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-09T19:52:49.605621] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-09T19:52:49.605715] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-09T19:52:49.963640] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:50.396755] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-09T19:52:50.444340] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T19:52:51.075419] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:52:51.196766] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-09T19:52:51.754116] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:52:51.996780] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-09T19:52:52.796682] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-09T19:52:52.832736] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:52:52.953495] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T19:52:53.596734] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-09T19:52:53.823357] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T19:52:54.396729] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-09T19:52:55.022399] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T19:52:55.196698] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-09T19:52:55.682374] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T19:52:55.996777] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-09T19:52:56.796762] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-09T19:52:57.022610] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T19:52:57.046332] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:52:57.500819] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T19:52:57.596717] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-09T19:52:58.396756] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-09T19:52:58.597928] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:52:59.196722] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-09T19:52:59.996773] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-09T19:53:00.037917] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T19:53:00.289871] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T19:53:00.796722] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-09T19:53:00.853222] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T19:53:01.596725] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-09T19:53:02.379872] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T19:53:02.396672] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-09T19:53:03.130388] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:53:03.196715] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-09T19:53:03.955030] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:53:03.996669] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-09T19:53:04.126421] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:53:04.736339] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T19:53:04.796717] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-09T19:53:05.596713] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-09T19:53:06.084476] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:53:06.350734] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T19:53:06.396677] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-09T19:53:07.196772] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-09T19:53:07.382551] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T19:53:07.996817] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-09T19:53:08.636300] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:53:08.770213] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T19:53:08.796752] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-09T19:53:09.596751] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-09T19:53:09.644235] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T19:53:10.396813] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-09T19:53:11.196823] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-09T19:53:11.351434] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T19:53:11.353094] [INFO ] [REMOTE ] KWR: Full fetch complete (23799 records). [2025-10-09T19:53:11.353163] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-09T19:53:11.768993] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-09T19:53:11.769183] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-09T19:53:11.769823] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-09T19:53:11.769888] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-09T19:53:11.770746] [DEBUG] [LOCAL ] KWR: Trimmed 23799 records to 16328 (keeping 200 days of data) [2025-10-09T19:53:11.877241] [DEBUG] [LOCAL ] KWR: Primary data saved (16328 records). [2025-10-09T19:53:11.877521] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-09T19:53:11.877697] [INFO ] [MAIN ] Update Progress: 1230/2373 symbols completed. KWR took 22.6s. Estimated remaining: 2h 40m 54s. Rate: 7.1 symbols/min [2025-10-09T19:53:11.998791] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-09T19:53:12.089276] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:12.091814] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-09T19:53:12.138922] [DEBUG] [LOCAL ] KYN: Loaded 30062 existing records from primary storage. [2025-10-09T19:53:12.139345] [INFO ] [MAIN ] KYN: Loaded 30062 existing records. [2025-10-09T19:53:12.338302] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:12.338525] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-09T19:53:12.338574] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-09T19:53:12.338821] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-09T19:53:12.338879] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-09T19:53:12.697706] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:12.725701] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:53:12.796715] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-09T19:53:13.516186] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T19:53:13.596717] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-09T19:53:13.941531] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T19:53:14.396727] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-09T19:53:14.948829] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:53:15.196771] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-09T19:53:16.001036] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-09T19:53:16.014301] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T19:53:16.216713] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:53:16.796809] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-09T19:53:17.596733] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-09T19:53:18.202580] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T19:53:18.277431] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-09T19:53:18.282399] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-09T19:53:18.282573] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-09T19:53:18.401911] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-09T19:53:18.675287] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-09T19:53:18.675382] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-09T19:53:18.676569] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-09T19:53:18.676636] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-09T19:53:18.678236] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 54057 (keeping 200 days of data) [2025-10-09T19:53:18.908607] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:53:18.928570] [INFO ] [REMOTE ] KW: Full fetch complete (57106 records). [2025-10-09T19:53:18.929338] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-09T19:53:19.197892] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-09T19:53:19.440269] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-09T19:53:19.440727] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-09T19:53:19.441720] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-09T19:53:19.441799] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-09T19:53:19.447449] [DEBUG] [LOCAL ] KW: Trimmed 57106 records to 40664 (keeping 200 days of data) [2025-10-09T19:53:19.524257] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-10-09T19:53:19.550733] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-09T19:53:19.553741] [INFO ] [MAIN ] Update Progress: 1231/2373 symbols completed. KVUE took 50.3s. Estimated remaining: 2h 40m 44s. Rate: 7.1 symbols/min [2025-10-09T19:53:19.766301] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:19.767299] [DEBUG] [LOCAL ] L: No existing data file found in primary storage. [2025-10-09T19:53:19.767667] [WARN ] [MAIN ] L: No existing data found, performing full refresh instead. [2025-10-09T19:53:19.770899] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-09T19:53:19.784161] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-09T19:53:19.795520] [DEBUG] [LOCAL ] L: No primary data file found to delete. [2025-10-09T19:53:19.798150] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-09T19:53:19.797929] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T19:53:20.010096] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-09T19:53:20.334193] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:20.348826] [DEBUG] [LOCAL ] KW: Primary data saved (40664 records). [2025-10-09T19:53:20.349000] [INFO ] [MAIN ] KW: Full history saved. [2025-10-09T19:53:20.349097] [INFO ] [MAIN ] Update Progress: 1232/2373 symbols completed. KW took 32.7s. Estimated remaining: 2h 40m 29s. Rate: 7.1 symbols/min [2025-10-09T19:53:20.535960] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:20.589356] [DEBUG] [LOCAL ] LAC: Loaded 52443 existing records from primary storage. [2025-10-09T19:53:20.589835] [INFO ] [MAIN ] LAC: Loaded 52443 existing records. [2025-10-09T19:53:20.788589] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:20.789125] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-09T19:53:20.789214] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-09T19:53:20.789614] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-09T19:53:20.789748] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-09T19:53:20.816442] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-09T19:53:21.180917] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:53:21.228424] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:21.266622] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-09T19:53:21.596719] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-09T19:53:21.944370] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:53:22.396733] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-09T19:53:22.662291] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:53:23.196751] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-09T19:53:23.754123] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:53:23.758934] [INFO ] [REMOTE ] KVYO: Full fetch complete (71770 records). [2025-10-09T19:53:23.759060] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-09T19:53:24.001938] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-09T19:53:24.164857] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-09T19:53:24.164966] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-09T19:53:24.166068] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-09T19:53:24.166178] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-09T19:53:24.167626] [DEBUG] [LOCAL ] KVYO: Trimmed 71770 records to 50818 (keeping 200 days of data) [2025-10-09T19:53:24.491333] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T19:53:24.514927] [DEBUG] [LOCAL ] KVYO: Primary data saved (50818 records). [2025-10-09T19:53:24.515118] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-09T19:53:24.515786] [INFO ] [MAIN ] Update Progress: 1233/2373 symbols completed. KVYO took 50.6s. Estimated remaining: 2h 40m 16s. Rate: 7.1 symbols/min [2025-10-09T19:53:24.690692] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:24.715744] [DEBUG] [LOCAL ] LAD: Loaded 23558 existing records from primary storage. [2025-10-09T19:53:24.716008] [INFO ] [MAIN ] LAD: Loaded 23558 existing records. [2025-10-09T19:53:24.803470] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-09T19:53:24.893083] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:24.893298] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-09T19:53:24.893344] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-09T19:53:24.893562] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-09T19:53:24.893619] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-09T19:53:25.244530] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:25.328097] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T19:53:25.596742] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-09T19:53:26.047447] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T19:53:26.396762] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-09T19:53:26.430700] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T19:53:27.196734] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-09T19:53:27.911144] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T19:53:27.996785] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-09T19:53:28.447207] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T19:53:28.796734] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-09T19:53:29.529571] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:53:29.596709] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-09T19:53:30.396743] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-09T19:53:30.722956] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T19:53:30.774710] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:53:31.196729] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-09T19:53:31.703983] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:53:31.996787] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-09T19:53:32.725523] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:53:32.796732] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-09T19:53:33.596788] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-09T19:53:33.883895] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T19:53:34.044093] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:53:34.396693] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-09T19:53:34.420239] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T19:53:35.196777] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-09T19:53:35.612555] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:53:35.996716] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-09T19:53:36.519746] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:53:36.796721] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-09T19:53:36.848003] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T19:53:37.596715] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-09T19:53:38.396775] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-09T19:53:38.663925] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T19:53:38.800833] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:53:39.196757] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-09T19:53:39.330089] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T19:53:39.996732] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-09T19:53:40.796699] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-09T19:53:41.189558] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-09T19:53:41.358125] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:53:41.596701] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-09T19:53:42.112179] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T19:53:42.396734] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-09T19:53:43.196720] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-09T19:53:43.548454] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-09T19:53:43.776972] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T19:53:43.915297] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T19:53:43.996678] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-09T19:53:44.715532] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T19:53:44.796682] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-09T19:53:45.596835] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-09T19:53:45.775941] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:53:46.396741] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-09T19:53:47.196762] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-09T19:53:47.494230] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T19:53:47.496746] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T19:53:47.514873] [INFO ] [REMOTE ] KYN: Full fetch complete (44337 records). [2025-10-09T19:53:47.515560] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-09T19:53:47.900578] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-09T19:53:47.900685] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-09T19:53:47.901516] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-09T19:53:47.901579] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-09T19:53:47.902632] [DEBUG] [LOCAL ] KYN: Trimmed 44337 records to 30315 (keeping 200 days of data) [2025-10-09T19:53:47.996777] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-09T19:53:48.091843] [DEBUG] [LOCAL ] KYN: Primary data saved (30315 records). [2025-10-09T19:53:48.092014] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-09T19:53:48.092182] [INFO ] [MAIN ] Update Progress: 1234/2373 symbols completed. KYN took 36.2s. Estimated remaining: 2h 40m 22s. Rate: 7.1 symbols/min [2025-10-09T19:53:48.258632] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:48.294174] [DEBUG] [LOCAL ] LADR: Loaded 39156 existing records from primary storage. [2025-10-09T19:53:48.294457] [INFO ] [MAIN ] LADR: Loaded 39156 existing records. [2025-10-09T19:53:48.484607] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:48.485086] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-09T19:53:48.485148] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-09T19:53:48.485403] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-09T19:53:48.485460] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-09T19:53:48.799555] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:53:48.799732] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-09T19:53:48.850212] [INFO ] [REMOTE ] L: Full fetch complete (59358 records). [2025-10-09T19:53:48.872994] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-09T19:53:48.872809] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:49.302148] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T19:53:49.329620] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-09T19:53:49.329759] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-09T19:53:49.331092] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-09T19:53:49.331162] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-09T19:53:49.332435] [DEBUG] [LOCAL ] L: Trimmed 59358 records to 41365 (keeping 200 days of data) [2025-10-09T19:53:49.591352] [DEBUG] [LOCAL ] L: Primary data saved (41365 records). [2025-10-09T19:53:49.591502] [INFO ] [MAIN ] L: Full history saved. [2025-10-09T19:53:49.591589] [INFO ] [MAIN ] Update Progress: 1235/2373 symbols completed. L took 30.0s. Estimated remaining: 2h 40m 7s. Rate: 7.1 symbols/min [2025-10-09T19:53:49.602833] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-09T19:53:49.778449] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:49.783766] [DEBUG] [LOCAL ] LANV: Loaded 2763 existing records from primary storage. [2025-10-09T19:53:49.783930] [INFO ] [MAIN ] LANV: Loaded 2763 existing records. [2025-10-09T19:53:49.962580] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:49.962864] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-09T19:53:49.962913] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-09T19:53:49.963097] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-09T19:53:49.963155] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-09T19:53:50.326210] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:50.396700] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-09T19:53:50.758971] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T19:53:51.013904] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T19:53:51.020173] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-09T19:53:51.196718] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-09T19:53:51.526831] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-09T19:53:51.996713] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-09T19:53:52.456826] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T19:53:52.796733] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-09T19:53:53.281525] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-09T19:53:53.596729] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-09T19:53:54.396753] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-09T19:53:54.716277] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:53:54.718675] [INFO ] [REMOTE ] LAD: Full fetch complete (35304 records). [2025-10-09T19:53:54.718839] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-09T19:53:54.895579] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T19:53:55.093689] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-09T19:53:55.093800] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-09T19:53:55.094495] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-09T19:53:55.094541] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-09T19:53:55.095314] [DEBUG] [LOCAL ] LAD: Trimmed 35304 records to 23719 (keeping 200 days of data) [2025-10-09T19:53:55.197784] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-09T19:53:55.245248] [DEBUG] [LOCAL ] LAD: Primary data saved (23719 records). [2025-10-09T19:53:55.245395] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-09T19:53:55.245498] [INFO ] [MAIN ] Update Progress: 1236/2373 symbols completed. LAD took 30.7s. Estimated remaining: 2h 39m 56s. Rate: 7.1 symbols/min [2025-10-09T19:53:55.411970] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:55.412216] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-09T19:53:55.412273] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-09T19:53:55.412419] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-09T19:53:55.412486] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-09T19:53:55.412541] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-09T19:53:55.412575] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-09T19:53:55.633801] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T19:53:55.766618] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:55.996718] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-09T19:53:56.796698] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-09T19:53:56.987436] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:53:56.987805] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-09T19:53:56.987908] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:53:56.987974] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-09T19:53:56.988033] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:53:56.988083] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-09T19:53:56.988156] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-09T19:53:56.988206] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-09T19:53:56.988291] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-09T19:53:56.988342] [INFO ] [MAIN ] Update Progress: 1237/2373 symbols completed. LAR took 1.7s. Estimated remaining: 2h 39m 42s. Rate: 7.1 symbols/min [2025-10-09T19:53:57.369068] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T19:53:57.596715] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-09T19:53:58.396726] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-09T19:53:59.056305] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:53:59.196760] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-09T19:53:59.996719] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-09T19:54:00.390802] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T19:54:00.414450] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:54:00.615448] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T19:54:00.796746] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-09T19:54:01.596772] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-09T19:54:01.945539] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-09T19:54:01.966904] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:54:02.396747] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-09T19:54:02.870942] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-09T19:54:03.196721] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-09T19:54:03.996746] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-09T19:54:04.696171] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T19:54:04.724752] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:54:04.796675] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-09T19:54:05.596774] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-09T19:54:05.981282] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T19:54:06.040617] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T19:54:06.041497] [INFO ] [REMOTE ] LANV: Full fetch complete (4356 records). [2025-10-09T19:54:06.041565] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-09T19:54:06.393626] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-09T19:54:06.393743] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-09T19:54:06.393944] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-09T19:54:06.393984] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-09T19:54:06.394345] [DEBUG] [LOCAL ] LANV: Trimmed 4356 records to 2790 (keeping 200 days of data) [2025-10-09T19:54:06.400611] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-09T19:54:06.410586] [DEBUG] [LOCAL ] LANV: Primary data saved (2790 records). [2025-10-09T19:54:06.410717] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-09T19:54:06.410868] [INFO ] [MAIN ] Update Progress: 1238/2373 symbols completed. LANV took 16.8s. Estimated remaining: 2h 39m 34s. Rate: 7.1 symbols/min [2025-10-09T19:54:07.196764] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-09T19:54:07.909532] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T19:54:07.996778] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-09T19:54:09.105384] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T19:54:09.120549] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-09T19:54:09.596948] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T19:54:09.607815] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-09T19:54:10.784269] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:54:10.793814] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-09T19:54:12.003405] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-09T19:54:12.009999] [INFO ] [REMOTE ] LAC: Full fetch complete (76003 records). [2025-10-09T19:54:12.010227] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-09T19:54:12.184135] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:54:12.230156] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-09T19:54:12.490961] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-09T19:54:12.491058] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-09T19:54:12.492122] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-09T19:54:12.492194] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-09T19:54:12.493848] [DEBUG] [LOCAL ] LAC: Trimmed 76003 records to 52833 (keeping 200 days of data) [2025-10-09T19:54:12.802698] [DEBUG] [LOCAL ] LAC: Primary data saved (52833 records). [2025-10-09T19:54:12.802864] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-09T19:54:12.802970] [INFO ] [MAIN ] Update Progress: 1239/2373 symbols completed. LAC took 52.5s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-09T19:54:13.884359] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T19:54:13.891428] [INFO ] [REMOTE ] LADR: Full fetch complete (55571 records). [2025-10-09T19:54:13.891581] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-09T19:54:14.311745] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-09T19:54:14.311867] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-09T19:54:14.313115] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-09T19:54:14.313199] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-09T19:54:14.314886] [DEBUG] [LOCAL ] LADR: Trimmed 55571 records to 39462 (keeping 200 days of data) [2025-10-09T19:54:14.570105] [DEBUG] [LOCAL ] LADR: Primary data saved (39462 records). [2025-10-09T19:54:14.570257] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-09T19:54:14.570343] [INFO ] [MAIN ] Update Progress: 1240/2373 symbols completed. LADR took 26.5s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-09T19:54:15.241192] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:15.278854] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:15.318476] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:15.333988] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:15.370347] [DEBUG] [LOCAL ] LAW: Loaded 14259 existing records from primary storage. [2025-10-09T19:54:15.370912] [INFO ] [MAIN ] LAW: Loaded 14259 existing records. [2025-10-09T19:54:15.559961] [DEBUG] [LOCAL ] LBRT: Loaded 52937 existing records from primary storage. [2025-10-09T19:54:15.548188] [DEBUG] [LOCAL ] LB: Loaded 37667 existing records from primary storage. [2025-10-09T19:54:15.542879] [DEBUG] [LOCAL ] LAZ: Loaded 44782 existing records from primary storage. [2025-10-09T19:54:15.571272] [INFO ] [MAIN ] LAZ: Loaded 44782 existing records. [2025-10-09T19:54:15.571580] [INFO ] [MAIN ] LB: Loaded 37667 existing records. [2025-10-09T19:54:15.571393] [INFO ] [MAIN ] LBRT: Loaded 52937 existing records. [2025-10-09T19:54:16.006337] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:16.071451] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-09T19:54:16.138592] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:16.147749] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-09T19:54:16.205351] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:16.242879] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-09T19:54:16.242709] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-09T19:54:16.243027] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-09T19:54:16.242503] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:16.243420] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-09T19:54:16.243691] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-09T19:54:16.243826] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-09T19:54:16.244081] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-09T19:54:16.244127] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-09T19:54:16.249473] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-09T19:54:16.249724] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-09T19:54:16.255683] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-09T19:54:16.275055] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-09T19:54:16.255611] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-09T19:54:16.275205] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-09T19:54:17.919404] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:18.045183] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-09T19:54:18.034519] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:18.094548] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-09T19:54:18.086144] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:18.117882] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:18.114505] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-09T19:54:18.119699] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-09T19:54:19.274413] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T19:54:19.278328] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-09T19:54:19.549080] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:54:19.559725] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-09T19:54:19.637930] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:54:19.646245] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-09T19:54:19.799496] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T19:54:19.808710] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-09T19:54:20.159603] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T19:54:20.163051] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-09T19:54:21.049311] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:54:21.058574] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-09T19:54:21.141017] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T19:54:21.145896] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-09T19:54:21.177472] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T19:54:21.188479] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-09T19:54:21.281293] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T19:54:21.596732] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-09T19:54:21.949430] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T19:54:22.166467] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:54:22.396718] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-09T19:54:22.699762] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:54:23.188988] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T19:54:23.196667] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-09T19:54:23.340744] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T19:54:23.996694] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-09T19:54:24.214884] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:54:24.796744] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-09T19:54:25.582713] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:54:25.596851] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-09T19:54:25.624349] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T19:54:26.396738] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-09T19:54:27.196748] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-09T19:54:27.227368] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:54:27.996698] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-09T19:54:28.046077] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T19:54:28.122963] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T19:54:28.796773] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-09T19:54:29.569495] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T19:54:29.596666] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-09T19:54:30.396700] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-09T19:54:30.509020] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T19:54:30.900833] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T19:54:30.947001] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T19:54:31.196766] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-09T19:54:31.996691] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-09T19:54:32.119676] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T19:54:32.796715] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-09T19:54:33.596698] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-09T19:54:33.786432] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T19:54:34.219277] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T19:54:34.396706] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-09T19:54:34.519666] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T19:54:34.522097] [INFO ] [REMOTE ] LAW: Full fetch complete (20687 records). [2025-10-09T19:54:34.522210] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-09T19:54:34.899268] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-09T19:54:34.899352] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-09T19:54:34.900004] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-09T19:54:34.900074] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-09T19:54:34.900750] [DEBUG] [LOCAL ] LAW: Trimmed 20687 records to 14351 (keeping 200 days of data) [2025-10-09T19:54:34.984673] [DEBUG] [LOCAL ] LAW: Primary data saved (14351 records). [2025-10-09T19:54:34.984848] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-09T19:54:34.984971] [INFO ] [MAIN ] Update Progress: 1241/2373 symbols completed. LAW took 20.4s. Estimated remaining: 2h 39m 12s. Rate: 7.1 symbols/min [2025-10-09T19:54:35.162278] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:35.207323] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-09T19:54:35.210402] [DEBUG] [LOCAL ] LC: Loaded 47939 existing records from primary storage. [2025-10-09T19:54:35.210767] [INFO ] [MAIN ] LC: Loaded 47939 existing records. [2025-10-09T19:54:35.393686] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:35.393932] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-09T19:54:35.393981] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-09T19:54:35.394188] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-09T19:54:35.394246] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-09T19:54:35.763371] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:35.996708] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-09T19:54:36.057388] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:54:36.803993] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-09T19:54:36.809135] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T19:54:37.596683] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-09T19:54:38.024021] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T19:54:38.396724] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-09T19:54:38.647742] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T19:54:38.984544] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:54:39.196755] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-09T19:54:39.996751] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-09T19:54:40.097920] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T19:54:40.801892] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-09T19:54:40.814625] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T19:54:41.560291] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:54:41.596810] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-09T19:54:42.378599] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T19:54:42.396689] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-09T19:54:43.196795] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-09T19:54:43.358672] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:54:43.996753] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-09T19:54:44.222301] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T19:54:44.318346] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T19:54:44.796726] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-09T19:54:45.596709] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-09T19:54:45.667393] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T19:54:46.294959] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T19:54:46.396694] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-09T19:54:47.207234] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-09T19:54:47.213866] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:54:47.658743] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T19:54:47.662206] [INFO ] [REMOTE ] LB: Full fetch complete (55871 records). [2025-10-09T19:54:47.662311] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-09T19:54:48.002429] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-09T19:54:48.065851] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-09T19:54:48.065940] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-09T19:54:48.066943] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-09T19:54:48.067013] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-09T19:54:48.068470] [DEBUG] [LOCAL ] LB: Trimmed 55871 records to 37931 (keeping 200 days of data) [2025-10-09T19:54:48.306576] [DEBUG] [LOCAL ] LB: Primary data saved (37931 records). [2025-10-09T19:54:48.306756] [INFO ] [MAIN ] LB: Full history saved. [2025-10-09T19:54:48.306849] [INFO ] [MAIN ] Update Progress: 1242/2373 symbols completed. LB took 33.7s. Estimated remaining: 2h 39m 8s. Rate: 7.1 symbols/min [2025-10-09T19:54:48.481536] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:48.512480] [DEBUG] [LOCAL ] LCII: Loaded 27674 existing records from primary storage. [2025-10-09T19:54:48.522502] [INFO ] [MAIN ] LCII: Loaded 27674 existing records. [2025-10-09T19:54:48.641447] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T19:54:48.730500] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:48.730762] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-09T19:54:48.730845] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-09T19:54:48.731074] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-09T19:54:48.731131] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-09T19:54:48.804225] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-09T19:54:49.096722] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:49.527358] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T19:54:49.532340] [INFO ] [REMOTE ] LBRT: Full fetch complete (76626 records). [2025-10-09T19:54:49.532490] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-09T19:54:49.601902] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-09T19:54:50.010228] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-09T19:54:50.010353] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-09T19:54:50.011540] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-09T19:54:50.011635] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-09T19:54:50.013428] [DEBUG] [LOCAL ] LBRT: Trimmed 76626 records to 53323 (keeping 200 days of data) [2025-10-09T19:54:50.399596] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-09T19:54:50.406995] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T19:54:50.433673] [DEBUG] [LOCAL ] LBRT: Primary data saved (53323 records). [2025-10-09T19:54:50.433805] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-09T19:54:50.434617] [INFO ] [MAIN ] Update Progress: 1243/2373 symbols completed. LBRT took 35.8s. Estimated remaining: 2h 38m 54s. Rate: 7.1 symbols/min [2025-10-09T19:54:50.616728] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:50.666104] [DEBUG] [LOCAL ] LDI: Loaded 44485 existing records from primary storage. [2025-10-09T19:54:50.666425] [INFO ] [MAIN ] LDI: Loaded 44485 existing records. [2025-10-09T19:54:50.797147] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T19:54:50.875755] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:50.876415] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-09T19:54:50.876538] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-09T19:54:50.877228] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-09T19:54:50.877303] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-09T19:54:51.201967] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-09T19:54:51.240550] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:51.980813] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:54:51.996667] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-09T19:54:52.411787] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T19:54:52.796736] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-09T19:54:53.285948] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:54:53.596756] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-09T19:54:53.981287] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:54:53.985008] [INFO ] [REMOTE ] LAZ: Full fetch complete (65719 records). [2025-10-09T19:54:53.985111] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-09T19:54:54.363152] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-09T19:54:54.363243] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-09T19:54:54.364174] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-09T19:54:54.364240] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-09T19:54:54.365626] [DEBUG] [LOCAL ] LAZ: Trimmed 65719 records to 45066 (keeping 200 days of data) [2025-10-09T19:54:54.425727] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-09T19:54:54.648877] [DEBUG] [LOCAL ] LAZ: Primary data saved (45066 records). [2025-10-09T19:54:54.649016] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-09T19:54:54.649101] [INFO ] [MAIN ] Update Progress: 1244/2373 symbols completed. LAZ took 40.1s. Estimated remaining: 2h 38m 41s. Rate: 7.1 symbols/min [2025-10-09T19:54:54.845604] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:54:54.849535] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:54.899639] [DEBUG] [LOCAL ] LDOS: Loaded 45346 existing records from primary storage. [2025-10-09T19:54:54.900013] [INFO ] [MAIN ] LDOS: Loaded 45346 existing records. [2025-10-09T19:54:55.087859] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:55.088089] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-09T19:54:55.088144] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-09T19:54:55.088352] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-09T19:54:55.088412] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-09T19:54:55.201974] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-09T19:54:55.467099] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:55.750324] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T19:54:55.996739] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-09T19:54:56.373538] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:54:56.796747] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-09T19:54:57.106339] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T19:54:57.596760] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-09T19:54:58.400825] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-09T19:54:58.406375] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T19:54:58.578825] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T19:54:59.196746] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-09T19:54:59.996749] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-09T19:55:00.116530] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T19:55:00.504511] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T19:55:00.796741] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-09T19:55:01.596849] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-09T19:55:01.733207] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:55:01.896144] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T19:55:02.396786] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-09T19:55:02.593434] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T19:55:03.196727] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-09T19:55:03.996732] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-09T19:55:04.158784] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T19:55:04.796707] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-09T19:55:04.875560] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T19:55:05.302532] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T19:55:05.596742] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-09T19:55:06.369133] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T19:55:06.396672] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-09T19:55:06.798398] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T19:55:07.196705] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-09T19:55:07.996747] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-09T19:55:08.079399] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T19:55:08.667402] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:55:08.796786] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-09T19:55:09.086634] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T19:55:09.596811] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-09T19:55:10.056104] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T19:55:10.396699] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-09T19:55:10.766030] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:55:11.196786] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-09T19:55:11.996721] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-09T19:55:12.066772] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:55:12.071261] [INFO ] [REMOTE ] LC: Full fetch complete (70493 records). [2025-10-09T19:55:12.071386] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-09T19:55:12.502834] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-09T19:55:12.508081] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-09T19:55:12.519561] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-09T19:55:12.523021] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-09T19:55:12.522866] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T19:55:12.531630] [DEBUG] [LOCAL ] LC: Trimmed 70493 records to 48313 (keeping 200 days of data) [2025-10-09T19:55:12.798562] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-09T19:55:12.829281] [DEBUG] [LOCAL ] LC: Primary data saved (48313 records). [2025-10-09T19:55:12.829386] [INFO ] [MAIN ] LC: Full history saved. [2025-10-09T19:55:12.830076] [INFO ] [MAIN ] Update Progress: 1245/2373 symbols completed. LC took 37.8s. Estimated remaining: 2h 38m 42s. Rate: 7.1 symbols/min [2025-10-09T19:55:13.010200] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:13.026312] [DEBUG] [LOCAL ] LDP: Loaded 12929 existing records from primary storage. [2025-10-09T19:55:13.026550] [INFO ] [MAIN ] LDP: Loaded 12929 existing records. [2025-10-09T19:55:13.202053] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:13.202251] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-09T19:55:13.202297] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-09T19:55:13.202459] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-09T19:55:13.202496] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-09T19:55:13.561485] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:13.596673] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-09T19:55:13.780382] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T19:55:13.843206] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:55:14.133972] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T19:55:14.396737] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-09T19:55:15.196716] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-09T19:55:15.996692] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-09T19:55:16.106682] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T19:55:16.436475] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T19:55:16.796711] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-09T19:55:17.029827] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T19:55:17.596715] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-09T19:55:18.354572] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:55:18.396690] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-09T19:55:18.821673] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T19:55:19.196728] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-09T19:55:19.623259] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:55:19.850241] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T19:55:19.996757] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-09T19:55:20.796745] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-09T19:55:21.140492] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T19:55:21.142940] [INFO ] [REMOTE ] LCII: Full fetch complete (39085 records). [2025-10-09T19:55:21.143020] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-09T19:55:21.515452] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-09T19:55:21.515534] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-09T19:55:21.516237] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-09T19:55:21.516301] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-09T19:55:21.517211] [DEBUG] [LOCAL ] LCII: Trimmed 39085 records to 27795 (keeping 200 days of data) [2025-10-09T19:55:21.611804] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-09T19:55:21.700804] [DEBUG] [LOCAL ] LCII: Primary data saved (27795 records). [2025-10-09T19:55:21.700962] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-09T19:55:21.701053] [INFO ] [MAIN ] Update Progress: 1246/2373 symbols completed. LCII took 33.4s. Estimated remaining: 2h 38m 34s. Rate: 7.1 symbols/min [2025-10-09T19:55:21.870389] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:21.916216] [DEBUG] [LOCAL ] LEA: Loaded 41557 existing records from primary storage. [2025-10-09T19:55:21.916565] [INFO ] [MAIN ] LEA: Loaded 41557 existing records. [2025-10-09T19:55:22.090835] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:22.091042] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-09T19:55:22.091089] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-09T19:55:22.091366] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-09T19:55:22.091423] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-09T19:55:22.411282] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-09T19:55:22.460739] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:22.462942] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T19:55:22.981136] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-09T19:55:23.196724] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-09T19:55:23.610758] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:55:23.996765] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-09T19:55:24.796761] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-09T19:55:25.482032] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T19:55:25.535453] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-09T19:55:25.540707] [INFO ] [REMOTE ] LDI: Full fetch complete (61147 records). [2025-10-09T19:55:25.540864] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-09T19:55:25.609751] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-09T19:55:25.936410] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-09T19:55:25.936515] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-09T19:55:25.937503] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-09T19:55:25.937573] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-09T19:55:25.939088] [DEBUG] [LOCAL ] LDI: Trimmed 61147 records to 44871 (keeping 200 days of data) [2025-10-09T19:55:26.209907] [DEBUG] [LOCAL ] LDI: Primary data saved (44871 records). [2025-10-09T19:55:26.210046] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-09T19:55:26.210134] [INFO ] [MAIN ] Update Progress: 1247/2373 symbols completed. LDI took 35.8s. Estimated remaining: 2h 38m 22s. Rate: 7.1 symbols/min [2025-10-09T19:55:26.375186] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T19:55:26.393000] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:26.396963] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-09T19:55:26.397662] [INFO ] [REMOTE ] LDOS: Full fetch complete (67321 records). [2025-10-09T19:55:26.398709] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-09T19:55:26.502076] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T19:55:26.745551] [DEBUG] [LOCAL ] LEG: Loaded 50168 existing records from primary storage. [2025-10-09T19:55:26.756876] [INFO ] [MAIN ] LEG: Loaded 50168 existing records. [2025-10-09T19:55:26.970735] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-09T19:55:26.981145] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-09T19:55:27.001013] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-09T19:55:27.006252] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-09T19:55:27.046039] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:27.046417] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-09T19:55:27.046477] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-09T19:55:27.046595] [DEBUG] [LOCAL ] LDOS: Trimmed 67321 records to 45603 (keeping 200 days of data) [2025-10-09T19:55:27.046706] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-09T19:55:27.047062] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-09T19:55:27.201950] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-09T19:55:27.532756] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:27.716262] [DEBUG] [LOCAL ] LDOS: Primary data saved (45603 records). [2025-10-09T19:55:27.716462] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-09T19:55:27.717479] [INFO ] [MAIN ] Update Progress: 1248/2373 symbols completed. LDOS took 33.1s. Estimated remaining: 2h 38m 7s. Rate: 7.1 symbols/min [2025-10-09T19:55:27.887278] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:27.946794] [DEBUG] [LOCAL ] LEN: Loaded 53170 existing records from primary storage. [2025-10-09T19:55:27.947173] [INFO ] [MAIN ] LEN: Loaded 53170 existing records. [2025-10-09T19:55:28.002101] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-09T19:55:28.134466] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:55:28.164876] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:28.166106] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-09T19:55:28.176203] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-09T19:55:28.176847] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-09T19:55:28.177343] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-09T19:55:28.177204] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T19:55:28.545696] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:28.796737] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-09T19:55:29.469883] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T19:55:29.596780] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-09T19:55:29.747176] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T19:55:30.396702] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-09T19:55:31.073903] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:55:31.196681] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-09T19:55:31.996686] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-09T19:55:32.074400] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:55:32.407467] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T19:55:32.796811] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-09T19:55:33.162383] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:55:33.596734] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-09T19:55:34.396803] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-09T19:55:34.734091] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T19:55:35.000955] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:55:35.196737] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-09T19:55:35.996690] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-09T19:55:36.165804] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:55:36.689571] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T19:55:36.796676] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-09T19:55:37.433118] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:55:37.596687] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-09T19:55:38.396753] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-09T19:55:38.449760] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T19:55:39.119981] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T19:55:39.196678] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-09T19:55:39.260098] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T19:55:39.891684] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T19:55:39.996770] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-09T19:55:40.778494] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:55:40.796691] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-09T19:55:41.557510] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T19:55:41.559951] [INFO ] [REMOTE ] LDP: Full fetch complete (19053 records). [2025-10-09T19:55:41.560048] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-09T19:55:41.604782] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-09T19:55:41.960030] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-09T19:55:41.960137] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-09T19:55:41.960560] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-09T19:55:41.960601] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-09T19:55:41.961156] [DEBUG] [LOCAL ] LDP: Trimmed 19053 records to 13016 (keeping 200 days of data) [2025-10-09T19:55:42.042596] [DEBUG] [LOCAL ] LDP: Primary data saved (13016 records). [2025-10-09T19:55:42.042773] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-09T19:55:42.042865] [INFO ] [MAIN ] Update Progress: 1249/2373 symbols completed. LDP took 29.2s. Estimated remaining: 2h 38m 4s. Rate: 7.1 symbols/min [2025-10-09T19:55:42.213506] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:42.230314] [DEBUG] [LOCAL ] LEO: Loaded 16882 existing records from primary storage. [2025-10-09T19:55:42.230580] [INFO ] [MAIN ] LEO: Loaded 16882 existing records. [2025-10-09T19:55:42.404014] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-09T19:55:42.411601] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:42.411924] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-09T19:55:42.411974] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-09T19:55:42.412189] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-09T19:55:42.412248] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-09T19:55:42.769149] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:43.196732] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-09T19:55:43.260684] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:55:43.927799] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:55:43.928629] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T19:55:43.996682] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-09T19:55:44.796741] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-09T19:55:45.022778] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T19:55:45.596698] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-09T19:55:46.306621] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T19:55:46.396699] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-09T19:55:46.694228] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T19:55:47.196718] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-09T19:55:47.573301] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:55:47.996711] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-09T19:55:48.796726] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-09T19:55:48.974171] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T19:55:49.468098] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T19:55:49.543041] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T19:55:49.596690] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-09T19:55:50.396788] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-09T19:55:51.165127] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T19:55:51.169417] [INFO ] [REMOTE ] LEA: Full fetch complete (60660 records). [2025-10-09T19:55:51.169732] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-09T19:55:51.202177] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-09T19:55:51.568418] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-09T19:55:51.568510] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-09T19:55:51.569481] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-09T19:55:51.569549] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-09T19:55:51.570937] [DEBUG] [LOCAL ] LEA: Trimmed 60660 records to 41878 (keeping 200 days of data) [2025-10-09T19:55:51.839658] [DEBUG] [LOCAL ] LEA: Primary data saved (41878 records). [2025-10-09T19:55:51.839809] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-09T19:55:51.839916] [INFO ] [MAIN ] Update Progress: 1250/2373 symbols completed. LEA took 30.1s. Estimated remaining: 2h 37m 57s. Rate: 7.1 symbols/min [2025-10-09T19:55:52.008812] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:52.007673] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-09T19:55:52.065933] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T19:55:52.093287] [DEBUG] [LOCAL ] LEVI: Loaded 51674 existing records from primary storage. [2025-10-09T19:55:52.093742] [INFO ] [MAIN ] LEVI: Loaded 51674 existing records. [2025-10-09T19:55:52.152439] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T19:55:52.300555] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:52.300815] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-09T19:55:52.300864] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-09T19:55:52.301123] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-09T19:55:52.301181] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-09T19:55:52.652784] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:52.796702] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-09T19:55:53.596731] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-09T19:55:53.685727] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T19:55:54.108931] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:55:54.396731] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-09T19:55:55.096185] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:55:55.177310] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:55:55.196671] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-09T19:55:55.996686] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-09T19:55:56.232606] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:55:56.796725] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-09T19:55:57.596730] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-09T19:55:58.175533] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-09T19:55:58.396731] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-09T19:55:58.673144] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T19:55:59.196727] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-09T19:55:59.373797] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T19:55:59.769445] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:55:59.996721] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-09T19:56:00.796714] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-09T19:56:00.887443] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:56:01.597014] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-09T19:56:01.715670] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T19:56:02.396758] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-09T19:56:02.772842] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T19:56:02.953313] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:56:03.196738] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-09T19:56:03.713460] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T19:56:03.996750] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-09T19:56:04.796747] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-09T19:56:04.825845] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:56:04.830355] [INFO ] [REMOTE ] LEG: Full fetch complete (72988 records). [2025-10-09T19:56:04.830521] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-09T19:56:05.242541] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-09T19:56:05.242671] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-09T19:56:05.243671] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-09T19:56:05.243734] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-09T19:56:05.245114] [DEBUG] [LOCAL ] LEG: Trimmed 72988 records to 50535 (keeping 200 days of data) [2025-10-09T19:56:05.519814] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:56:05.596748] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-09T19:56:05.606686] [DEBUG] [LOCAL ] LEG: Primary data saved (50535 records). [2025-10-09T19:56:05.606819] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-09T19:56:05.606931] [INFO ] [MAIN ] Update Progress: 1251/2373 symbols completed. LEG took 39.4s. Estimated remaining: 2h 37m 53s. Rate: 7.1 symbols/min [2025-10-09T19:56:05.781574] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:05.800140] [DEBUG] [LOCAL ] LFT: Loaded 18400 existing records from primary storage. [2025-10-09T19:56:05.800402] [INFO ] [MAIN ] LFT: Loaded 18400 existing records. [2025-10-09T19:56:05.909238] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T19:56:05.991211] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:05.991477] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-09T19:56:05.991532] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-09T19:56:05.991792] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-09T19:56:05.991851] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-09T19:56:06.335217] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:06.396678] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-09T19:56:07.074117] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T19:56:07.196700] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-09T19:56:07.654594] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T19:56:07.996717] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-09T19:56:08.133147] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T19:56:08.796775] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-09T19:56:09.596761] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-09T19:56:09.615005] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:56:09.896087] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T19:56:10.396734] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-09T19:56:10.522747] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:56:11.196723] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-09T19:56:11.311109] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T19:56:11.996742] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-09T19:56:12.297253] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T19:56:12.796748] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-09T19:56:13.543590] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:56:13.596681] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-09T19:56:14.396793] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-09T19:56:14.804320] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-09T19:56:14.808883] [INFO ] [REMOTE ] LEN: Full fetch complete (77046 records). [2025-10-09T19:56:14.808994] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-09T19:56:15.217362] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-09T19:56:15.216979] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-09T19:56:15.217714] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-09T19:56:15.225754] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-09T19:56:15.241864] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-09T19:56:15.260013] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T19:56:15.262539] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T19:56:15.278469] [DEBUG] [LOCAL ] LEN: Trimmed 77046 records to 53560 (keeping 200 days of data) [2025-10-09T19:56:15.616812] [DEBUG] [LOCAL ] LEN: Primary data saved (53560 records). [2025-10-09T19:56:15.616963] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-09T19:56:15.618073] [INFO ] [MAIN ] Update Progress: 1252/2373 symbols completed. LEN took 47.9s. Estimated remaining: 2h 37m 46s. Rate: 7.1 symbols/min [2025-10-09T19:56:15.802276] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:15.816447] [DEBUG] [LOCAL ] LGI: Loaded 9878 existing records from primary storage. [2025-10-09T19:56:15.816710] [INFO ] [MAIN ] LGI: Loaded 9878 existing records. [2025-10-09T19:56:16.017417] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-09T19:56:16.022882] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:16.028190] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T19:56:16.028413] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-09T19:56:16.030242] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-09T19:56:16.030604] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-09T19:56:16.030733] [INFO ] [REMOTE ] LEO: Full fetch complete (26650 records). [2025-10-09T19:56:16.030788] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-09T19:56:16.043066] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-09T19:56:16.762974] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:16.808029] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-09T19:56:16.809824] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-09T19:56:16.809899] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-09T19:56:16.811329] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-09T19:56:16.811394] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-09T19:56:16.812360] [DEBUG] [LOCAL ] LEO: Trimmed 26650 records to 17020 (keeping 200 days of data) [2025-10-09T19:56:16.917899] [DEBUG] [LOCAL ] LEO: Primary data saved (17020 records). [2025-10-09T19:56:16.918055] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-09T19:56:16.918143] [INFO ] [MAIN ] Update Progress: 1253/2373 symbols completed. LEO took 34.9s. Estimated remaining: 2h 37m 31s. Rate: 7.1 symbols/min [2025-10-09T19:56:17.057550] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:56:17.117191] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:17.158684] [DEBUG] [LOCAL ] LH: Loaded 37766 existing records from primary storage. [2025-10-09T19:56:17.159046] [INFO ] [MAIN ] LH: Loaded 37766 existing records. [2025-10-09T19:56:17.350615] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:17.350847] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-09T19:56:17.350913] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-09T19:56:17.351178] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-09T19:56:17.351237] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-09T19:56:17.606284] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-09T19:56:17.726883] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:18.396765] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-09T19:56:18.664190] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T19:56:18.710495] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T19:56:19.148013] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T19:56:19.196740] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-09T19:56:19.996734] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-09T19:56:20.318572] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T19:56:20.634312] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T19:56:20.796796] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-09T19:56:21.596854] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-09T19:56:21.598277] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T19:56:22.396768] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-09T19:56:23.196757] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-09T19:56:23.361069] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:56:23.387258] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T19:56:23.996699] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-09T19:56:24.479076] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:56:24.626707] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T19:56:24.796704] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-09T19:56:25.596751] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-09T19:56:25.738948] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T19:56:25.740744] [INFO ] [REMOTE ] LFT: Full fetch complete (24061 records). [2025-10-09T19:56:25.740838] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-09T19:56:26.104405] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-09T19:56:26.104480] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-09T19:56:26.104981] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-09T19:56:26.105046] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-09T19:56:26.105715] [DEBUG] [LOCAL ] LFT: Trimmed 24061 records to 18493 (keeping 200 days of data) [2025-10-09T19:56:26.214894] [DEBUG] [LOCAL ] LFT: Primary data saved (18493 records). [2025-10-09T19:56:26.215029] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-09T19:56:26.215110] [INFO ] [MAIN ] Update Progress: 1254/2373 symbols completed. LFT took 20.6s. Estimated remaining: 2h 37m 23s. Rate: 7.1 symbols/min [2025-10-09T19:56:26.391468] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:26.396745] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-09T19:56:26.437404] [DEBUG] [LOCAL ] LHX: Loaded 48559 existing records from primary storage. [2025-10-09T19:56:26.437825] [INFO ] [MAIN ] LHX: Loaded 48559 existing records. [2025-10-09T19:56:26.613635] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:26.613868] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-09T19:56:26.613924] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-09T19:56:26.614140] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-09T19:56:26.614196] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-09T19:56:26.973175] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:26.993596] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:56:27.196677] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-09T19:56:27.670350] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:56:27.996757] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-09T19:56:28.727451] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T19:56:28.796724] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-09T19:56:29.596834] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-09T19:56:29.698169] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T19:56:29.703218] [INFO ] [REMOTE ] LEVI: Full fetch complete (74556 records). [2025-10-09T19:56:29.703381] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-09T19:56:30.121267] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-09T19:56:30.121435] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-09T19:56:30.122693] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-09T19:56:30.122778] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-09T19:56:30.124524] [DEBUG] [LOCAL ] LEVI: Trimmed 74556 records to 52062 (keeping 200 days of data) [2025-10-09T19:56:30.395000] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T19:56:30.397147] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-09T19:56:30.489522] [DEBUG] [LOCAL ] LEVI: Primary data saved (52062 records). [2025-10-09T19:56:30.489689] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-09T19:56:30.489806] [INFO ] [MAIN ] Update Progress: 1255/2373 symbols completed. LEVI took 38.6s. Estimated remaining: 2h 37m 11s. Rate: 7.1 symbols/min [2025-10-09T19:56:30.666014] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:30.694435] [DEBUG] [LOCAL ] LII: Loaded 28016 existing records from primary storage. [2025-10-09T19:56:30.694758] [INFO ] [MAIN ] LII: Loaded 28016 existing records. [2025-10-09T19:56:30.880821] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:30.881069] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-09T19:56:30.881118] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-09T19:56:30.881363] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-09T19:56:30.881422] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-09T19:56:31.184932] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T19:56:31.201935] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-09T19:56:31.272022] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:31.292823] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T19:56:31.731203] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T19:56:31.996739] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-09T19:56:32.796756] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-09T19:56:33.290061] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:56:33.596749] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-09T19:56:34.396768] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-09T19:56:34.537090] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T19:56:34.603136] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:56:35.175301] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:56:35.196672] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-09T19:56:35.925496] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T19:56:35.996727] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-09T19:56:36.105262] [DEBUG] [REMOTE ] LGI: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-09T19:56:36.105540] [WARN ] [REMOTE ] LGI: No data returned for month 2025-07 [2025-10-09T19:56:36.105631] [FATAL] [REMOTE ] LGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:56:36.105751] [FATAL] [MAIN ] LGI: Failed to fetch primary data. [2025-10-09T19:56:36.105817] [WARN ] [MAIN ] LGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:56:36.105886] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-09T19:56:36.105951] [DEBUG] [LOCAL ] LGI: No primary data file found to delete. [2025-10-09T19:56:36.106025] [INFO ] [LOCAL ] LGI: Starting deletion of derivative data. [2025-10-09T19:56:36.106326] [DEBUG] [LOCAL ] LGI: Deleted derivative data file. [2025-10-09T19:56:36.106415] [INFO ] [MAIN ] Update Progress: 1256/2373 symbols completed. LGI took 20.5s. Estimated remaining: 2h 37m 0s. Rate: 7.1 symbols/min [2025-10-09T19:56:36.273510] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:36.320246] [DEBUG] [LOCAL ] LION: Loaded 45437 existing records from primary storage. [2025-10-09T19:56:36.320584] [INFO ] [MAIN ] LION: Loaded 45437 existing records. [2025-10-09T19:56:36.508928] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:36.509156] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-09T19:56:36.509204] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-09T19:56:36.509442] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-09T19:56:36.509501] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-09T19:56:36.801888] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-09T19:56:36.865809] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:37.596723] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-09T19:56:38.268882] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:56:38.396675] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-09T19:56:39.129307] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:56:39.196730] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-09T19:56:39.403535] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:56:39.996752] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-09T19:56:40.736433] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T19:56:40.796683] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-09T19:56:41.069366] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T19:56:41.596722] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-09T19:56:42.009724] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:56:42.396694] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-09T19:56:42.597107] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:56:43.196718] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-09T19:56:43.535235] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T19:56:43.996725] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-09T19:56:44.602227] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T19:56:44.796712] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-09T19:56:45.555936] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:56:45.601807] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-09T19:56:45.610437] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T19:56:46.396792] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-09T19:56:46.790792] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:56:47.196716] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-09T19:56:47.270548] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T19:56:47.996734] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-09T19:56:48.796726] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-09T19:56:48.966185] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:56:49.411766] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T19:56:49.596714] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-09T19:56:50.363409] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:56:50.396674] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-09T19:56:51.196692] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-09T19:56:51.228952] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:56:51.975620] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T19:56:51.996697] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-09T19:56:52.796748] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-09T19:56:53.122352] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T19:56:53.318534] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T19:56:53.596773] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-09T19:56:54.095813] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T19:56:54.396763] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-09T19:56:54.801874] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T19:56:55.196769] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-09T19:56:55.698073] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T19:56:55.701432] [INFO ] [REMOTE ] LH: Full fetch complete (54982 records). [2025-10-09T19:56:55.701519] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-09T19:56:56.001833] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-09T19:56:56.092040] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-09T19:56:56.092255] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-09T19:56:56.093186] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-09T19:56:56.093250] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-09T19:56:56.094404] [DEBUG] [LOCAL ] LH: Trimmed 54982 records to 37996 (keeping 200 days of data) [2025-10-09T19:56:56.229858] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:56:56.366134] [DEBUG] [LOCAL ] LH: Primary data saved (37996 records). [2025-10-09T19:56:56.366278] [INFO ] [MAIN ] LH: Full history saved. [2025-10-09T19:56:56.366372] [INFO ] [MAIN ] Update Progress: 1257/2373 symbols completed. LH took 39.4s. Estimated remaining: 2h 37m 2s. Rate: 7.1 symbols/min [2025-10-09T19:56:56.533465] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:56.540272] [DEBUG] [LOCAL ] LITB: Loaded 4249 existing records from primary storage. [2025-10-09T19:56:56.540437] [INFO ] [MAIN ] LITB: Loaded 4249 existing records. [2025-10-09T19:56:56.715146] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:56.715360] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-09T19:56:56.715407] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-09T19:56:56.715597] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-09T19:56:56.715684] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-09T19:56:56.804783] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-09T19:56:57.073592] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:57.596738] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-09T19:56:57.885117] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T19:56:57.937799] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-09T19:56:58.396693] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-09T19:56:58.569482] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T19:56:59.196746] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-09T19:56:59.538093] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T19:56:59.996732] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-09T19:57:00.564394] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T19:57:00.796789] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-09T19:57:01.524221] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-09T19:57:01.596716] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-09T19:57:02.250172] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:57:02.396723] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-09T19:57:02.836502] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T19:57:03.196744] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-09T19:57:03.490718] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T19:57:03.740175] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T19:57:03.996698] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-09T19:57:04.796746] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-09T19:57:05.596744] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-09T19:57:05.758056] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T19:57:06.396818] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-09T19:57:06.557720] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:57:06.835961] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T19:57:06.838849] [INFO ] [REMOTE ] LII: Full fetch complete (41371 records). [2025-10-09T19:57:06.838935] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-09T19:57:07.201674] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-09T19:57:07.241987] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-09T19:57:07.242069] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-09T19:57:07.242905] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-09T19:57:07.242970] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-09T19:57:07.244091] [DEBUG] [LOCAL ] LII: Trimmed 41371 records to 28203 (keeping 200 days of data) [2025-10-09T19:57:07.431212] [DEBUG] [LOCAL ] LII: Primary data saved (28203 records). [2025-10-09T19:57:07.431353] [INFO ] [MAIN ] LII: Full history saved. [2025-10-09T19:57:07.431438] [INFO ] [MAIN ] Update Progress: 1258/2373 symbols completed. LII took 36.9s. Estimated remaining: 2h 36m 56s. Rate: 7.1 symbols/min [2025-10-09T19:57:07.600430] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:07.653305] [DEBUG] [LOCAL ] LLY: Loaded 53293 existing records from primary storage. [2025-10-09T19:57:07.653696] [INFO ] [MAIN ] LLY: Loaded 53293 existing records. [2025-10-09T19:57:07.831881] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:07.832088] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-09T19:57:07.832135] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-09T19:57:07.832344] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-09T19:57:07.832400] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-09T19:57:08.010669] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-09T19:57:08.154800] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T19:57:08.220004] [INFO ] [REMOTE ] LHX: Full fetch complete (70636 records). [2025-10-09T19:57:08.219888] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:08.220397] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-09T19:57:08.633592] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-09T19:57:08.634224] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-09T19:57:08.635473] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-09T19:57:08.638983] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-09T19:57:08.643466] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T19:57:08.647360] [DEBUG] [LOCAL ] LHX: Trimmed 70636 records to 48939 (keeping 200 days of data) [2025-10-09T19:57:08.800383] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-09T19:57:08.820167] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:57:09.013994] [DEBUG] [LOCAL ] LHX: Primary data saved (48939 records). [2025-10-09T19:57:09.014298] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-09T19:57:09.014400] [INFO ] [MAIN ] Update Progress: 1259/2373 symbols completed. LHX took 42.8s. Estimated remaining: 2h 36m 42s. Rate: 7.1 symbols/min [2025-10-09T19:57:09.180375] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:09.228718] [DEBUG] [LOCAL ] LMND: Loaded 51987 existing records from primary storage. [2025-10-09T19:57:09.229035] [INFO ] [MAIN ] LMND: Loaded 51987 existing records. [2025-10-09T19:57:09.403314] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:09.403547] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-09T19:57:09.403594] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-09T19:57:09.403830] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-09T19:57:09.403887] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-09T19:57:09.612299] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-09T19:57:09.797727] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:10.396749] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-09T19:57:11.142510] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-09T19:57:11.196679] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-09T19:57:11.288216] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T19:57:11.292613] [INFO ] [REMOTE ] LION: Full fetch complete (56226 records). [2025-10-09T19:57:11.292772] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-09T19:57:11.696393] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-09T19:57:11.696474] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-09T19:57:11.697307] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-09T19:57:11.697437] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-09T19:57:11.698772] [DEBUG] [LOCAL ] LION: Trimmed 56226 records to 45809 (keeping 200 days of data) [2025-10-09T19:57:11.965618] [DEBUG] [LOCAL ] LION: Primary data saved (45809 records). [2025-10-09T19:57:11.965781] [INFO ] [MAIN ] LION: Full history saved. [2025-10-09T19:57:11.965873] [INFO ] [MAIN ] Update Progress: 1260/2373 symbols completed. LION took 35.9s. Estimated remaining: 2h 36m 28s. Rate: 7.1 symbols/min [2025-10-09T19:57:12.002687] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-09T19:57:12.140958] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:12.173722] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:57:12.226138] [DEBUG] [LOCAL ] LMT: Loaded 49773 existing records from primary storage. [2025-10-09T19:57:12.226454] [INFO ] [MAIN ] LMT: Loaded 49773 existing records. [2025-10-09T19:57:12.416380] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:12.416628] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-09T19:57:12.416736] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-09T19:57:12.417006] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-09T19:57:12.417073] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-09T19:57:12.658004] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T19:57:12.796900] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-09T19:57:12.819111] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:13.046433] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T19:57:13.596780] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-09T19:57:13.914905] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T19:57:14.396784] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-09T19:57:14.605161] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T19:57:15.196774] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-09T19:57:15.677197] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T19:57:15.996779] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-09T19:57:16.307225] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T19:57:16.796782] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-09T19:57:17.596744] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-09T19:57:17.908281] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T19:57:18.396741] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-09T19:57:18.816791] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-09T19:57:19.196723] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-09T19:57:19.996729] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-09T19:57:20.063722] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-09T19:57:20.235745] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T19:57:20.489827] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T19:57:20.796697] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-09T19:57:21.250333] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-09T19:57:21.596761] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-09T19:57:22.051864] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T19:57:22.396706] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-09T19:57:23.005498] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-09T19:57:23.196703] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-09T19:57:23.730945] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T19:57:23.996749] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-09T19:57:24.796796] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-09T19:57:25.301092] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T19:57:25.301992] [INFO ] [REMOTE ] LITB: Full fetch complete (5650 records). [2025-10-09T19:57:25.302061] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-09T19:57:25.610681] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-09T19:57:25.674819] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-09T19:57:25.674954] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-09T19:57:25.675314] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-09T19:57:25.675394] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-09T19:57:25.676361] [DEBUG] [LOCAL ] LITB: Trimmed 5650 records to 4269 (keeping 200 days of data) [2025-10-09T19:57:25.704009] [DEBUG] [LOCAL ] LITB: Primary data saved (4269 records). [2025-10-09T19:57:25.704210] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-09T19:57:25.704411] [INFO ] [MAIN ] Update Progress: 1261/2373 symbols completed. LITB took 29.3s. Estimated remaining: 2h 36m 25s. Rate: 7.1 symbols/min [2025-10-09T19:57:25.885667] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-09T19:57:25.930761] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:25.988096] [DEBUG] [LOCAL ] LNC: Loaded 51610 existing records from primary storage. [2025-10-09T19:57:25.988437] [INFO ] [MAIN ] LNC: Loaded 51610 existing records. [2025-10-09T19:57:26.169695] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:26.170002] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-09T19:57:26.185248] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-09T19:57:26.195355] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-09T19:57:26.195499] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-09T19:57:26.261528] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-09T19:57:26.406608] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-09T19:57:26.567846] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:27.196744] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-09T19:57:27.641443] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-09T19:57:27.996790] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-09T19:57:28.266758] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T19:57:28.796833] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-09T19:57:29.312245] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-09T19:57:29.596765] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-09T19:57:29.691923] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T19:57:30.396743] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-09T19:57:30.597387] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T19:57:31.196770] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-09T19:57:31.996775] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-09T19:57:32.046893] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-09T19:57:32.268847] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T19:57:32.796791] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-09T19:57:32.947760] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T19:57:33.596731] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-09T19:57:33.625575] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T19:57:34.396761] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-09T19:57:35.196704] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-09T19:57:35.450638] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-09T19:57:35.606453] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T19:57:35.951859] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-09T19:57:35.996695] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-09T19:57:36.796714] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-09T19:57:37.162052] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T19:57:37.596700] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-09T19:57:38.248969] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:57:38.337066] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-09T19:57:38.396686] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-09T19:57:39.196730] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-09T19:57:39.996796] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-09T19:57:40.193315] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-09T19:57:40.537079] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-09T19:57:40.796672] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-09T19:57:40.913564] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T19:57:41.503854] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T19:57:41.508893] [INFO ] [REMOTE ] LLY: Full fetch complete (77253 records). [2025-10-09T19:57:41.533593] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-09T19:57:41.538755] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T19:57:41.599114] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-09T19:57:41.963230] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-09T19:57:41.963323] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-09T19:57:41.964510] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-09T19:57:41.964581] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-09T19:57:41.966508] [DEBUG] [LOCAL ] LLY: Trimmed 77253 records to 53664 (keeping 200 days of data) [2025-10-09T19:57:42.313255] [DEBUG] [LOCAL ] LLY: Primary data saved (53664 records). [2025-10-09T19:57:42.313406] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-09T19:57:42.313536] [INFO ] [MAIN ] Update Progress: 1262/2373 symbols completed. LLY took 34.9s. Estimated remaining: 2h 36m 23s. Rate: 7.1 symbols/min [2025-10-09T19:57:42.406430] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-09T19:57:42.487538] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:42.495117] [DEBUG] [LOCAL ] LND: Loaded 4976 existing records from primary storage. [2025-10-09T19:57:42.495334] [INFO ] [MAIN ] LND: Loaded 4976 existing records. [2025-10-09T19:57:42.668749] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:42.668957] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-09T19:57:42.669004] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-09T19:57:42.669248] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-09T19:57:42.669305] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-09T19:57:43.089852] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:43.196718] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-09T19:57:43.657933] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-09T19:57:43.909834] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T19:57:43.996699] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-09T19:57:44.180392] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:57:44.602501] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:57:44.796780] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-09T19:57:45.596755] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-09T19:57:46.396716] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-09T19:57:46.479572] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T19:57:47.196761] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-09T19:57:47.821480] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-09T19:57:47.996721] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-09T19:57:48.260527] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-09T19:57:48.264950] [INFO ] [REMOTE ] LMT: Full fetch complete (72352 records). [2025-10-09T19:57:48.265116] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-09T19:57:48.660966] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-09T19:57:48.661055] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-09T19:57:48.662145] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-09T19:57:48.662214] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-09T19:57:48.663630] [DEBUG] [LOCAL ] LMT: Trimmed 72352 records to 50089 (keeping 200 days of data) [2025-10-09T19:57:48.799426] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-09T19:57:49.008660] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:57:49.037754] [DEBUG] [LOCAL ] LMT: Primary data saved (50089 records). [2025-10-09T19:57:49.037921] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-09T19:57:49.038987] [INFO ] [MAIN ] Update Progress: 1263/2373 symbols completed. LMT took 37.1s. Estimated remaining: 2h 36m 13s. Rate: 7.1 symbols/min [2025-10-09T19:57:49.209816] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:49.261930] [DEBUG] [LOCAL ] LNG: Loaded 51319 existing records from primary storage. [2025-10-09T19:57:49.262245] [INFO ] [MAIN ] LNG: Loaded 51319 existing records. [2025-10-09T19:57:49.381106] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T19:57:49.449632] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:49.449866] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-09T19:57:49.449915] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-09T19:57:49.450173] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-09T19:57:49.450233] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-09T19:57:49.601842] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-09T19:57:49.826623] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:50.174760] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-09T19:57:50.179446] [INFO ] [REMOTE ] LMND: Full fetch complete (75329 records). [2025-10-09T19:57:50.179575] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-09T19:57:50.378097] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:57:50.399333] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-09T19:57:50.600103] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-09T19:57:50.600216] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-09T19:57:50.601239] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-09T19:57:50.601305] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-09T19:57:50.602801] [DEBUG] [LOCAL ] LMND: Trimmed 75329 records to 52371 (keeping 200 days of data) [2025-10-09T19:57:50.912533] [DEBUG] [LOCAL ] LMND: Primary data saved (52371 records). [2025-10-09T19:57:50.912699] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-09T19:57:50.912807] [INFO ] [MAIN ] Update Progress: 1264/2373 symbols completed. LMND took 41.9s. Estimated remaining: 2h 35m 59s. Rate: 7.1 symbols/min [2025-10-09T19:57:51.079116] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:51.092627] [DEBUG] [LOCAL ] LNN: Loaded 11300 existing records from primary storage. [2025-10-09T19:57:51.092871] [INFO ] [MAIN ] LNN: Loaded 11300 existing records. [2025-10-09T19:57:51.201830] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-09T19:57:51.269180] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:51.269406] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-09T19:57:51.269454] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-09T19:57:51.269703] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-09T19:57:51.269762] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-09T19:57:51.611736] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:51.996744] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-09T19:57:52.154537] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:57:52.638518] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T19:57:52.796716] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-09T19:57:52.949690] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T19:57:53.596719] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-09T19:57:54.396696] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-09T19:57:54.417952] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:57:54.533071] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:57:55.196770] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-09T19:57:55.864906] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T19:57:55.996813] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-09T19:57:56.201390] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T19:57:56.796772] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-09T19:57:57.596750] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-09T19:57:57.614718] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:57:57.619370] [INFO ] [REMOTE ] LNC: Full fetch complete (74345 records). [2025-10-09T19:57:57.619549] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-09T19:57:58.009842] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-09T19:57:58.009931] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-09T19:57:58.010952] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-09T19:57:58.011017] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-09T19:57:58.012505] [DEBUG] [LOCAL ] LNC: Trimmed 74345 records to 51968 (keeping 200 days of data) [2025-10-09T19:57:58.340779] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T19:57:58.359328] [DEBUG] [LOCAL ] LNC: Primary data saved (51968 records). [2025-10-09T19:57:58.359507] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-09T19:57:58.360295] [INFO ] [MAIN ] Update Progress: 1265/2373 symbols completed. LNC took 32.7s. Estimated remaining: 2h 35m 50s. Rate: 7.1 symbols/min [2025-10-09T19:57:58.406354] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-09T19:57:58.548729] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:58.592255] [DEBUG] [LOCAL ] LOAR: Loaded 42082 existing records from primary storage. [2025-10-09T19:57:58.592818] [INFO ] [MAIN ] LOAR: Loaded 42082 existing records. [2025-10-09T19:57:58.782153] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:58.782527] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-09T19:57:58.782586] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-09T19:57:58.797824] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-09T19:57:58.807753] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-09T19:57:58.882706] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-09T19:57:59.141532] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T19:57:59.198192] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-09T19:57:59.221464] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:59.769605] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T19:57:59.996744] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-09T19:58:00.796729] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-09T19:58:01.518162] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:58:01.596729] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-09T19:58:01.839722] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T19:58:02.396747] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-09T19:58:02.479269] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T19:58:03.197243] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-09T19:58:03.203967] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T19:58:03.996760] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-09T19:58:04.805727] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-09T19:58:04.829252] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:58:04.853361] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T19:58:05.596759] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-09T19:58:06.080469] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T19:58:06.396743] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-09T19:58:07.099945] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T19:58:07.196798] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-09T19:58:07.473577] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T19:58:07.996815] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-09T19:58:08.256633] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T19:58:08.639685] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T19:58:08.796770] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-09T19:58:09.596741] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-09T19:58:10.364901] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T19:58:10.396680] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-09T19:58:11.129555] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:58:11.196772] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-09T19:58:11.996741] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-09T19:58:12.164161] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:58:12.796780] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-09T19:58:12.814939] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T19:58:12.990859] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T19:58:13.596729] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-09T19:58:14.350974] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:58:14.396679] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-09T19:58:15.196694] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-09T19:58:15.243403] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T19:58:15.261248] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T19:58:15.573486] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-09T19:58:15.996725] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-09T19:58:16.796699] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-09T19:58:17.366763] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T19:58:17.464083] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T19:58:17.596714] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-09T19:58:18.396747] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-09T19:58:18.879999] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T19:58:19.196735] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-09T19:58:19.459179] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T19:58:19.460623] [INFO ] [REMOTE ] LNN: Full fetch complete (15570 records). [2025-10-09T19:58:19.460729] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-09T19:58:19.843309] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T19:58:19.854904] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-09T19:58:19.855287] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-09T19:58:19.855743] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-09T19:58:19.855805] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-09T19:58:19.856377] [DEBUG] [LOCAL ] LNN: Trimmed 15570 records to 11354 (keeping 200 days of data) [2025-10-09T19:58:19.932668] [DEBUG] [LOCAL ] LNN: Primary data saved (11354 records). [2025-10-09T19:58:19.932830] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-09T19:58:19.932936] [INFO ] [MAIN ] Update Progress: 1266/2373 symbols completed. LNN took 29.0s. Estimated remaining: 2h 35m 53s. Rate: 7.1 symbols/min [2025-10-09T19:58:20.001940] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-09T19:58:20.106615] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:20.133345] [DEBUG] [LOCAL ] LOB: Loaded 27185 existing records from primary storage. [2025-10-09T19:58:20.133680] [INFO ] [MAIN ] LOB: Loaded 27185 existing records. [2025-10-09T19:58:20.306734] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:20.306964] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-09T19:58:20.307012] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-09T19:58:20.307230] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-09T19:58:20.307287] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-09T19:58:20.649461] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:20.796822] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-09T19:58:21.430365] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T19:58:21.596703] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-09T19:58:21.900353] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T19:58:22.396722] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-09T19:58:22.869511] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:58:22.873152] [INFO ] [REMOTE ] LOAR: Full fetch complete (56099 records). [2025-10-09T19:58:22.873262] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-09T19:58:23.201795] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-09T19:58:23.314210] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-09T19:58:23.314287] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-09T19:58:23.315233] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-09T19:58:23.315298] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-09T19:58:23.316493] [DEBUG] [LOCAL ] LOAR: Trimmed 56099 records to 42335 (keeping 200 days of data) [2025-10-09T19:58:23.573102] [DEBUG] [LOCAL ] LOAR: Primary data saved (42335 records). [2025-10-09T19:58:23.573229] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-09T19:58:23.573312] [INFO ] [MAIN ] Update Progress: 1267/2373 symbols completed. LOAR took 25.2s. Estimated remaining: 2h 35m 40s. Rate: 7.1 symbols/min [2025-10-09T19:58:23.743019] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:23.748764] [DEBUG] [LOCAL ] LOCL: Loaded 3627 existing records from primary storage. [2025-10-09T19:58:23.749464] [INFO ] [MAIN ] LOCL: Loaded 3627 existing records. [2025-10-09T19:58:23.928124] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:23.932410] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T19:58:23.932176] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-09T19:58:23.933980] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-09T19:58:23.934183] [INFO ] [REMOTE ] LND: Full fetch complete (8082 records). [2025-10-09T19:58:23.934246] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-09T19:58:23.934325] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-09T19:58:23.934467] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-09T19:58:24.000343] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-09T19:58:24.624057] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-09T19:58:24.641059] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-09T19:58:24.660095] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-09T19:58:24.663810] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-09T19:58:24.666498] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-09T19:58:24.667240] [DEBUG] [LOCAL ] LND: Trimmed 8082 records to 4996 (keeping 200 days of data) [2025-10-09T19:58:24.779980] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:24.789815] [DEBUG] [LOCAL ] LND: Primary data saved (4996 records). [2025-10-09T19:58:24.789984] [INFO ] [MAIN ] LND: Full history saved. [2025-10-09T19:58:24.790089] [INFO ] [MAIN ] Update Progress: 1268/2373 symbols completed. LND took 42.5s. Estimated remaining: 2h 35m 26s. Rate: 7.1 symbols/min [2025-10-09T19:58:24.801780] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-09T19:58:24.969916] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:25.005085] [DEBUG] [LOCAL ] LOMA: Loaded 32180 existing records from primary storage. [2025-10-09T19:58:25.005405] [INFO ] [MAIN ] LOMA: Loaded 32180 existing records. [2025-10-09T19:58:25.186113] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:25.186387] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-09T19:58:25.186437] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-09T19:58:25.186745] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-09T19:58:25.186806] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-09T19:58:25.480635] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:58:25.566939] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:25.596670] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-09T19:58:26.330692] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T19:58:26.396686] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-09T19:58:26.722089] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:58:27.196754] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-09T19:58:27.893145] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T19:58:27.897526] [INFO ] [REMOTE ] LNG: Full fetch complete (74647 records). [2025-10-09T19:58:27.897760] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-09T19:58:27.998418] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-09T19:58:28.292387] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-09T19:58:28.292566] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-09T19:58:28.293613] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-09T19:58:28.293777] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-09T19:58:28.306854] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:58:28.312846] [DEBUG] [LOCAL ] LNG: Trimmed 74647 records to 51690 (keeping 200 days of data) [2025-10-09T19:58:28.642776] [DEBUG] [LOCAL ] LNG: Primary data saved (51690 records). [2025-10-09T19:58:28.642929] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-09T19:58:28.643021] [INFO ] [MAIN ] Update Progress: 1269/2373 symbols completed. LNG took 39.6s. Estimated remaining: 2h 35m 13s. Rate: 7.1 symbols/min [2025-10-09T19:58:28.804968] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-09T19:58:28.808343] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:28.868253] [DEBUG] [LOCAL ] LOW: Loaded 52977 existing records from primary storage. [2025-10-09T19:58:28.868549] [INFO ] [MAIN ] LOW: Loaded 52977 existing records. [2025-10-09T19:58:29.046238] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:29.046547] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-09T19:58:29.046696] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-09T19:58:29.047284] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-09T19:58:29.047393] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-09T19:58:29.189003] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T19:58:29.439067] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:29.596723] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-09T19:58:30.170132] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T19:58:30.396686] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-09T19:58:30.461379] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:58:31.196724] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-09T19:58:31.899863] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T19:58:31.996719] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-09T19:58:32.483590] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:58:32.796735] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-09T19:58:33.596739] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-09T19:58:33.804939] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T19:58:34.088790] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:58:34.218221] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T19:58:34.396726] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-09T19:58:34.832520] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-09T19:58:35.196729] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-09T19:58:35.996698] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-09T19:58:36.328334] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T19:58:36.796751] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-09T19:58:37.060826] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-09T19:58:37.596696] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-09T19:58:37.681619] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T19:58:38.027986] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T19:58:38.396732] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-09T19:58:39.196706] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-09T19:58:39.255101] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T19:58:39.996753] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-09T19:58:40.223412] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T19:58:40.291337] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-09T19:58:40.796798] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-09T19:58:41.120874] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T19:58:41.596746] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-09T19:58:42.396770] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-09T19:58:43.196754] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-09T19:58:43.446518] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T19:58:43.555843] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T19:58:43.583299] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-09T19:58:43.996709] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-09T19:58:44.796790] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-09T19:58:44.921034] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T19:58:45.596691] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-09T19:58:45.912733] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T19:58:46.396776] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-09T19:58:47.196741] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-09T19:58:47.418732] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T19:58:47.420196] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:58:47.996773] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-09T19:58:48.121734] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T19:58:48.454621] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T19:58:48.796730] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-09T19:58:49.230721] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T19:58:49.596758] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-09T19:58:50.396772] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-09T19:58:51.043338] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:58:51.196714] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-09T19:58:51.532509] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T19:58:51.996719] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-09T19:58:52.453398] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T19:58:52.456832] [INFO ] [REMOTE ] LOMA: Full fetch complete (47742 records). [2025-10-09T19:58:52.456970] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-09T19:58:52.801873] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-09T19:58:52.855735] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-09T19:58:52.855823] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-09T19:58:52.856623] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-09T19:58:52.856776] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-09T19:58:52.858409] [DEBUG] [LOCAL ] LOMA: Trimmed 47742 records to 32538 (keeping 200 days of data) [2025-10-09T19:58:53.051548] [DEBUG] [LOCAL ] LOMA: Primary data saved (32538 records). [2025-10-09T19:58:53.051717] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-09T19:58:53.051815] [INFO ] [MAIN ] Update Progress: 1270/2373 symbols completed. LOMA took 28.3s. Estimated remaining: 2h 35m 19s. Rate: 7.1 symbols/min [2025-10-09T19:58:53.221615] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:53.238222] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T19:58:53.280509] [DEBUG] [LOCAL ] LPG: Loaded 39690 existing records from primary storage. [2025-10-09T19:58:53.280856] [INFO ] [MAIN ] LPG: Loaded 39690 existing records. [2025-10-09T19:58:53.455697] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:53.455920] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-09T19:58:53.455969] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-09T19:58:53.456420] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-09T19:58:53.456479] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-09T19:58:53.597054] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-09T19:58:53.810087] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:54.396737] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-09T19:58:54.538905] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T19:58:54.541618] [INFO ] [REMOTE ] LOB: Full fetch complete (38031 records). [2025-10-09T19:58:54.541733] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-09T19:58:54.711140] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T19:58:54.955351] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-09T19:58:54.955432] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-09T19:58:54.956149] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-09T19:58:54.956212] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-09T19:58:54.957078] [DEBUG] [LOCAL ] LOB: Trimmed 38031 records to 27349 (keeping 200 days of data) [2025-10-09T19:58:54.963661] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T19:58:54.964486] [INFO ] [REMOTE ] LOCL: Full fetch complete (4488 records). [2025-10-09T19:58:54.964555] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-09T19:58:55.200774] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-09T19:58:55.561741] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-09T19:58:55.563679] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-09T19:58:55.566723] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-09T19:58:55.566835] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-09T19:58:55.573844] [DEBUG] [LOCAL ] LOCL: Trimmed 4488 records to 3651 (keeping 200 days of data) [2025-10-09T19:58:55.673034] [DEBUG] [LOCAL ] LOB: Primary data saved (27349 records). [2025-10-09T19:58:55.674740] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-09T19:58:55.680560] [DEBUG] [LOCAL ] LOCL: Primary data saved (3651 records). [2025-10-09T19:58:55.680932] [INFO ] [MAIN ] Update Progress: 1271/2373 symbols completed. LOB took 35.7s. Estimated remaining: 2h 35m 5s. Rate: 7.1 symbols/min [2025-10-09T19:58:55.681115] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-09T19:58:55.686727] [INFO ] [MAIN ] Update Progress: 1272/2373 symbols completed. LOCL took 32.1s. Estimated remaining: 2h 34m 49s. Rate: 7.1 symbols/min [2025-10-09T19:58:56.007331] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-09T19:58:56.166864] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:56.199304] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:56.262592] [DEBUG] [LOCAL ] LPL: Loaded 27378 existing records from primary storage. [2025-10-09T19:58:56.263391] [DEBUG] [LOCAL ] LPX: Loaded 39813 existing records from primary storage. [2025-10-09T19:58:56.263774] [INFO ] [MAIN ] LPX: Loaded 39813 existing records. [2025-10-09T19:58:56.263674] [INFO ] [MAIN ] LPL: Loaded 27378 existing records. [2025-10-09T19:58:56.635882] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:56.639936] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:56.640284] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-09T19:58:56.640532] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-09T19:58:56.640478] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-09T19:58:56.640717] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-09T19:58:56.640947] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-09T19:58:56.641020] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-09T19:58:56.672227] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-09T19:58:56.672324] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-09T19:58:57.322465] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:57.337045] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-09T19:58:57.378575] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:57.413725] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-09T19:58:57.596714] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-09T19:58:57.657321] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T19:58:58.396684] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-09T19:58:58.423104] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T19:58:58.875890] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T19:58:59.196716] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-09T19:58:59.996704] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-09T19:59:00.250678] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T19:59:00.323337] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T19:59:00.796747] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-09T19:59:01.479505] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:59:01.596760] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-09T19:59:02.396749] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-09T19:59:02.726123] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T19:59:02.978992] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T19:59:03.196734] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-09T19:59:03.830320] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T19:59:03.996792] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-09T19:59:04.796723] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-09T19:59:05.116902] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T19:59:05.595226] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T19:59:05.603789] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-09T19:59:06.272989] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:59:06.396665] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-09T19:59:06.410968] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T19:59:07.196765] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-09T19:59:08.001923] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-09T19:59:08.013462] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T19:59:08.188193] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T19:59:08.796733] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-09T19:59:09.596709] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-09T19:59:09.763407] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T19:59:10.378785] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T19:59:10.396688] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-09T19:59:11.127481] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:59:11.196674] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-09T19:59:11.891147] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T19:59:11.996676] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-09T19:59:12.653923] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:59:12.756975] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:59:12.796681] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-09T19:59:13.596733] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-09T19:59:14.327827] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:59:14.396686] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-09T19:59:14.805023] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T19:59:15.196736] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-09T19:59:15.906699] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T19:59:15.996669] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-09T19:59:16.202314] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T19:59:16.796735] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-09T19:59:17.478087] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T19:59:17.596778] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-09T19:59:17.848472] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T19:59:18.396770] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-09T19:59:19.196745] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-09T19:59:19.314408] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:59:19.319393] [INFO ] [REMOTE ] LOW: Full fetch complete (76524 records). [2025-10-09T19:59:19.319504] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-09T19:59:19.744512] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-09T19:59:19.745166] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-09T19:59:19.745676] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T19:59:19.746713] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-09T19:59:19.752250] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-09T19:59:19.754074] [DEBUG] [LOCAL ] LOW: Trimmed 76524 records to 53366 (keeping 200 days of data) [2025-10-09T19:59:19.997405] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-09T19:59:20.090755] [DEBUG] [LOCAL ] LOW: Primary data saved (53366 records). [2025-10-09T19:59:20.090904] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-09T19:59:20.091861] [INFO ] [MAIN ] Update Progress: 1273/2373 symbols completed. LOW took 51.4s. Estimated remaining: 2h 34m 55s. Rate: 7.1 symbols/min [2025-10-09T19:59:20.262166] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:59:20.304821] [DEBUG] [LOCAL ] LRN: Loaded 39676 existing records from primary storage. [2025-10-09T19:59:20.305104] [INFO ] [MAIN ] LRN: Loaded 39676 existing records. [2025-10-09T19:59:20.480722] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:59:20.481106] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-09T19:59:20.481185] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-09T19:59:20.481834] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-09T19:59:20.481896] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-09T19:59:20.803904] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T19:59:20.797266] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-09T19:59:20.873064] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:59:21.380169] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T19:59:21.596707] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-09T19:59:22.396701] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-09T19:59:22.467120] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T19:59:22.708008] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T19:59:23.196695] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-09T19:59:23.907483] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T19:59:23.996716] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-09T19:59:24.635816] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T19:59:24.796715] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-09T19:59:25.287672] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T19:59:25.291193] [INFO ] [REMOTE ] LPG: Full fetch complete (59273 records). [2025-10-09T19:59:25.291296] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-09T19:59:25.601849] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-09T19:59:25.670999] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-09T19:59:25.671082] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-09T19:59:25.671986] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-09T19:59:25.672049] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-09T19:59:25.673329] [DEBUG] [LOCAL ] LPG: Trimmed 59273 records to 39911 (keeping 200 days of data) [2025-10-09T19:59:25.915219] [DEBUG] [LOCAL ] LPG: Primary data saved (39911 records). [2025-10-09T19:59:25.915452] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-09T19:59:25.915776] [INFO ] [MAIN ] Update Progress: 1274/2373 symbols completed. LPG took 32.9s. Estimated remaining: 2h 34m 44s. Rate: 7.1 symbols/min [2025-10-09T19:59:26.045944] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:59:26.129755] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:59:26.173336] [DEBUG] [LOCAL ] LSPD: Loaded 42846 existing records from primary storage. [2025-10-09T19:59:26.173704] [INFO ] [MAIN ] LSPD: Loaded 42846 existing records. [2025-10-09T19:59:26.354469] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:59:26.354747] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-09T19:59:26.354801] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-09T19:59:26.355375] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-09T19:59:26.355435] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-09T19:59:26.401956] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-09T19:59:26.725053] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:59:26.992211] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:59:27.196700] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-09T19:59:27.935131] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:59:27.938820] [INFO ] [REMOTE ] LPL: Full fetch complete (36310 records). [2025-10-09T19:59:27.938898] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-09T19:59:28.001971] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-09T19:59:28.309985] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-09T19:59:28.310161] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-09T19:59:28.310892] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-09T19:59:28.310954] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-09T19:59:28.311826] [DEBUG] [LOCAL ] LPL: Trimmed 36310 records to 27712 (keeping 200 days of data) [2025-10-09T19:59:28.464339] [DEBUG] [LOCAL ] LPL: Primary data saved (27712 records). [2025-10-09T19:59:28.464472] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-09T19:59:28.464601] [INFO ] [MAIN ] Update Progress: 1275/2373 symbols completed. LPL took 32.8s. Estimated remaining: 2h 34m 30s. Rate: 7.1 symbols/min [2025-10-09T19:59:28.635753] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:59:28.659366] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T19:59:28.694624] [DEBUG] [LOCAL ] LTC: Loaded 30272 existing records from primary storage. [2025-10-09T19:59:28.694908] [INFO ] [MAIN ] LTC: Loaded 30272 existing records. [2025-10-09T19:59:28.801816] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-09T19:59:28.900721] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:59:28.900968] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-09T19:59:28.901022] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-09T19:59:28.901192] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-09T19:59:28.901231] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-09T19:59:29.263778] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:59:29.287114] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T19:59:29.596731] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-09T19:59:30.299136] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T19:59:30.302869] [INFO ] [REMOTE ] LPX: Full fetch complete (58833 records). [2025-10-09T19:59:30.302957] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-09T19:59:30.401938] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-09T19:59:30.687971] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-09T19:59:30.688150] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-09T19:59:30.689022] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-09T19:59:30.703085] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-09T19:59:30.704287] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T19:59:30.710875] [DEBUG] [LOCAL ] LPX: Trimmed 58833 records to 40167 (keeping 200 days of data) [2025-10-09T19:59:30.955541] [DEBUG] [LOCAL ] LPX: Primary data saved (40167 records). [2025-10-09T19:59:30.955728] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-09T19:59:30.956529] [INFO ] [MAIN ] Update Progress: 1276/2373 symbols completed. LPX took 35.3s. Estimated remaining: 2h 34m 17s. Rate: 7.1 symbols/min [2025-10-09T19:59:31.123364] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:59:31.173283] [DEBUG] [LOCAL ] LTH: Loaded 51722 existing records from primary storage. [2025-10-09T19:59:31.173579] [INFO ] [MAIN ] LTH: Loaded 51722 existing records. [2025-10-09T19:59:31.203604] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-09T19:59:31.350436] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:59:31.350666] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-09T19:59:31.350728] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-09T19:59:31.350970] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-09T19:59:31.351026] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-09T19:59:31.702810] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:59:31.799194] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:59:31.996770] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-09T19:59:32.755731] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:59:32.796667] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-09T19:59:33.557403] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:59:33.596694] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-09T19:59:34.198168] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:59:34.396736] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-09T19:59:35.202205] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-09T19:59:35.207285] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T19:59:35.571973] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T19:59:35.996758] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-09T19:59:36.558342] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:59:36.796732] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-09T19:59:37.605965] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-09T19:59:37.625997] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:59:38.082621] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T19:59:38.396698] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-09T19:59:38.872767] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T19:59:39.196705] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-09T19:59:39.862196] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:59:39.996763] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-09T19:59:40.484931] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:59:40.796743] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-09T19:59:41.470262] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T19:59:41.596708] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-09T19:59:42.132555] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:59:42.396729] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-09T19:59:43.110039] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T19:59:43.196744] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-09T19:59:43.715446] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T19:59:43.996717] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-09T19:59:44.789864] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T19:59:44.798919] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-09T19:59:45.052116] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T19:59:45.596766] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-09T19:59:46.306884] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T19:59:46.396715] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-09T19:59:46.681162] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:59:47.196734] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-09T19:59:47.402272] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T19:59:47.996762] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-09T19:59:48.576888] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T19:59:48.581732] [INFO ] [REMOTE ] LRN: Full fetch complete (58378 records). [2025-10-09T19:59:48.581973] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-09T19:59:48.813412] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-09T19:59:49.110546] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-09T19:59:49.110709] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-09T19:59:49.112000] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-09T19:59:49.112087] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-09T19:59:49.113443] [DEBUG] [LOCAL ] LRN: Trimmed 58378 records to 39921 (keeping 200 days of data) [2025-10-09T19:59:49.369638] [DEBUG] [LOCAL ] LRN: Primary data saved (39921 records). [2025-10-09T19:59:49.369889] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-09T19:59:49.370087] [INFO ] [MAIN ] Update Progress: 1277/2373 symbols completed. LRN took 29.3s. Estimated remaining: 2h 34m 17s. Rate: 7.1 symbols/min [2025-10-09T19:59:49.596712] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-09T19:59:49.718228] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T19:59:50.335183] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:59:50.396705] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-09T19:59:50.713635] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T19:59:51.196742] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-09T19:59:52.007299] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-09T19:59:52.015796] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T19:59:52.644790] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T19:59:52.796707] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-09T19:59:52.995230] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T19:59:53.596734] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-09T19:59:54.159911] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:59:54.396728] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-09T19:59:55.008844] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T19:59:55.196751] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-09T19:59:55.996697] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-09T19:59:56.141203] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T19:59:56.486940] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T19:59:56.490028] [INFO ] [REMOTE ] LTC: Full fetch complete (43487 records). [2025-10-09T19:59:56.490120] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-09T19:59:56.801794] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-09T19:59:56.875403] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-09T19:59:56.875488] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-09T19:59:56.876277] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-09T19:59:56.876342] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-09T19:59:56.877422] [DEBUG] [LOCAL ] LTC: Trimmed 43487 records to 30454 (keeping 200 days of data) [2025-10-09T19:59:57.071409] [DEBUG] [LOCAL ] LTC: Primary data saved (30454 records). [2025-10-09T19:59:57.071536] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-09T19:59:57.071615] [INFO ] [MAIN ] Update Progress: 1278/2373 symbols completed. LTC took 28.6s. Estimated remaining: 2h 34m 8s. Rate: 7.1 symbols/min [2025-10-09T19:59:57.443152] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:59:57.447284] [INFO ] [REMOTE ] LSPD: Full fetch complete (61706 records). [2025-10-09T19:59:57.447393] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-09T19:59:57.844220] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-09T19:59:57.844303] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-09T19:59:57.845204] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-09T19:59:57.845267] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-09T19:59:57.846580] [DEBUG] [LOCAL ] LSPD: Trimmed 61706 records to 43111 (keeping 200 days of data) [2025-10-09T19:59:58.105518] [DEBUG] [LOCAL ] LSPD: Primary data saved (43111 records). [2025-10-09T19:59:58.105950] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-09T19:59:58.106118] [INFO ] [MAIN ] Update Progress: 1279/2373 symbols completed. LSPD took 32.2s. Estimated remaining: 2h 33m 53s. Rate: 7.1 symbols/min [2025-10-09T19:59:58.507945] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T19:59:58.519567] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-09T20:00:00.094168] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T20:00:00.104884] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-09T20:00:01.852845] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T20:00:01.866518] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-09T20:00:04.058237] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-09T20:00:04.069801] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-09T20:00:05.725600] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T20:00:05.738214] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-09T20:00:07.612909] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T20:00:07.617285] [INFO ] [REMOTE ] LTH: Full fetch complete (74386 records). [2025-10-09T20:00:07.617401] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-09T20:00:08.018574] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-09T20:00:08.018692] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-09T20:00:08.019732] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-09T20:00:08.019797] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-09T20:00:08.021232] [DEBUG] [LOCAL ] LTH: Trimmed 74386 records to 52105 (keeping 200 days of data) [2025-10-09T20:00:08.329617] [DEBUG] [LOCAL ] LTH: Primary data saved (52105 records). [2025-10-09T20:00:08.329797] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-09T20:00:08.330498] [INFO ] [MAIN ] Update Progress: 1280/2373 symbols completed. LTH took 37.4s. Estimated remaining: 2h 33m 46s. Rate: 7.1 symbols/min [2025-10-09T20:00:08.996034] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:09.146036] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:09.172463] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:09.168316] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:09.191445] [DEBUG] [LOCAL ] LUCK: Loaded 24438 existing records from primary storage. [2025-10-09T20:00:09.191784] [INFO ] [MAIN ] LUCK: Loaded 24438 existing records. [2025-10-09T20:00:09.422634] [DEBUG] [LOCAL ] LTM: Loaded 37874 existing records from primary storage. [2025-10-09T20:00:09.421296] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:00:09.436299] [INFO ] [MAIN ] LTM: Loaded 37874 existing records. [2025-10-09T20:00:09.436401] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-09T20:00:09.442398] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-09T20:00:09.482469] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-09T20:00:09.511233] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-09T20:00:09.625533] [DEBUG] [LOCAL ] LU: Loaded 48971 existing records from primary storage. [2025-10-09T20:00:09.615925] [DEBUG] [LOCAL ] LUMN: Loaded 53641 existing records from primary storage. [2025-10-09T20:00:09.671569] [INFO ] [MAIN ] LUMN: Loaded 53641 existing records. [2025-10-09T20:00:09.710825] [INFO ] [MAIN ] LU: Loaded 48971 existing records. [2025-10-09T20:00:09.819837] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:00:09.882133] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-09T20:00:09.931911] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-09T20:00:09.988859] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-09T20:00:10.096379] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-09T20:00:10.415033] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:00:10.419153] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:00:10.458049] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-09T20:00:10.469055] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-09T20:00:10.510772] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-09T20:00:10.525619] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-09T20:00:10.559521] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-09T20:00:10.596102] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:10.596248] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-09T20:00:10.606870] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-09T20:00:10.612018] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-09T20:00:10.678745] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-09T20:00:11.401568] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:11.449452] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-09T20:00:11.697118] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:11.744290] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:11.737599] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-09T20:00:11.744872] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-09T20:00:11.770127] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T20:00:11.775262] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-09T20:00:12.773975] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T20:00:12.779875] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-09T20:00:13.247602] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T20:00:13.256348] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-09T20:00:13.350361] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T20:00:13.360584] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-09T20:00:13.670340] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T20:00:13.687636] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-09T20:00:13.864878] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T20:00:13.870159] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-09T20:00:14.469685] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T20:00:14.477271] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-09T20:00:14.641695] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T20:00:14.647423] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-09T20:00:14.843917] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T20:00:14.854031] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-09T20:00:15.537961] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T20:00:15.544866] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-09T20:00:15.575373] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T20:00:15.587258] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-09T20:00:15.752387] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T20:00:15.758989] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-09T20:00:16.086470] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T20:00:16.096535] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-09T20:00:16.929488] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T20:00:16.936243] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-09T20:00:17.011203] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T20:00:17.019766] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-09T20:00:17.064187] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T20:00:17.074815] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-09T20:00:18.056961] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T20:00:18.068022] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-09T20:00:18.239622] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T20:00:18.378945] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T20:00:18.396682] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-09T20:00:18.969910] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T20:00:19.196797] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-09T20:00:19.373478] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T20:00:19.431871] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T20:00:19.941950] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T20:00:19.996799] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-09T20:00:20.796783] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-09T20:00:21.508463] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T20:00:21.596755] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-09T20:00:22.396784] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-09T20:00:22.540220] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T20:00:23.010833] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T20:00:23.196715] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-09T20:00:23.899129] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T20:00:23.996769] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-09T20:00:24.796713] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-09T20:00:24.803232] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T20:00:25.392191] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T20:00:25.596777] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-09T20:00:25.850276] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T20:00:26.396766] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-09T20:00:27.196760] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-09T20:00:27.220050] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T20:00:27.224282] [INFO ] [REMOTE ] LTM: Full fetch complete (49108 records). [2025-10-09T20:00:27.224385] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-09T20:00:27.592900] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-09T20:00:27.592981] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-09T20:00:27.593797] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-09T20:00:27.593860] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-09T20:00:27.594945] [DEBUG] [LOCAL ] LTM: Trimmed 49108 records to 38258 (keeping 200 days of data) [2025-10-09T20:00:27.817455] [DEBUG] [LOCAL ] LTM: Primary data saved (38258 records). [2025-10-09T20:00:27.817596] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-09T20:00:27.817717] [INFO ] [MAIN ] Update Progress: 1281/2373 symbols completed. LTM took 19.5s. Estimated remaining: 2h 33m 47s. Rate: 7.1 symbols/min [2025-10-09T20:00:27.991867] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:27.996728] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-09T20:00:28.059450] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T20:00:28.088209] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-09T20:00:28.088532] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-09T20:00:28.260604] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:00:28.260845] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-09T20:00:28.260892] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-09T20:00:28.261112] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-09T20:00:28.261169] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-09T20:00:28.606052] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:28.796673] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-09T20:00:28.841063] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T20:00:28.890424] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T20:00:29.596728] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-09T20:00:30.396771] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-09T20:00:30.854283] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T20:00:31.183080] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T20:00:31.196684] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-09T20:00:31.980206] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T20:00:31.996668] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-09T20:00:32.796716] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-09T20:00:32.942620] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T20:00:33.596691] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-09T20:00:33.678242] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T20:00:34.396746] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-09T20:00:34.664580] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T20:00:34.718555] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T20:00:35.196768] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-09T20:00:35.659661] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T20:00:35.664042] [INFO ] [REMOTE ] LU: Full fetch complete (70420 records). [2025-10-09T20:00:35.664215] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-09T20:00:36.011025] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-09T20:00:36.069277] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-09T20:00:36.069372] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-09T20:00:36.070395] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-09T20:00:36.070471] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-09T20:00:36.072061] [DEBUG] [LOCAL ] LU: Trimmed 70420 records to 49350 (keeping 200 days of data) [2025-10-09T20:00:36.355676] [DEBUG] [LOCAL ] LU: Primary data saved (49350 records). [2025-10-09T20:00:36.355878] [INFO ] [MAIN ] LU: Full history saved. [2025-10-09T20:00:36.356000] [INFO ] [MAIN ] Update Progress: 1282/2373 symbols completed. LU took 28.0s. Estimated remaining: 2h 33m 39s. Rate: 7.1 symbols/min [2025-10-09T20:00:36.525489] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:36.525693] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-09T20:00:36.525806] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-09T20:00:36.525889] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-09T20:00:36.525926] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-09T20:00:36.525967] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-09T20:00:36.525999] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-09T20:00:36.801820] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-09T20:00:36.875597] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:37.139628] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-09T20:00:37.596719] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-09T20:00:37.859111] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T20:00:37.862211] [INFO ] [REMOTE ] LUCK: Full fetch complete (40476 records). [2025-10-09T20:00:37.862320] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-09T20:00:38.277018] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-09T20:00:38.277186] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-09T20:00:38.278181] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-09T20:00:38.278286] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-09T20:00:38.291285] [DEBUG] [LOCAL ] LUCK: Trimmed 40476 records to 24525 (keeping 200 days of data) [2025-10-09T20:00:38.312274] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-09T20:00:38.411118] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-09T20:00:38.476875] [DEBUG] [LOCAL ] LUCK: Primary data saved (24525 records). [2025-10-09T20:00:38.477024] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-09T20:00:38.477114] [INFO ] [MAIN ] Update Progress: 1283/2373 symbols completed. LUCK took 30.1s. Estimated remaining: 2h 33m 25s. Rate: 7.1 symbols/min [2025-10-09T20:00:38.630346] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:00:38.661448] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-09T20:00:38.665431] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:00:38.665331] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:38.665547] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-09T20:00:38.665751] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:00:38.666211] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-09T20:00:38.666293] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-09T20:00:38.666332] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-09T20:00:38.666388] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-09T20:00:38.666467] [INFO ] [MAIN ] Update Progress: 1284/2373 symbols completed. LUXE took 2.3s. Estimated remaining: 2h 33m 10s. Rate: 7.1 symbols/min [2025-10-09T20:00:38.841516] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:38.873174] [DEBUG] [LOCAL ] LVWR: Loaded 18174 existing records from primary storage. [2025-10-09T20:00:38.873436] [INFO ] [MAIN ] LVWR: Loaded 18174 existing records. [2025-10-09T20:00:39.004865] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-09T20:00:39.021257] [INFO ] [MAIN ] LVS: Loaded 53569 existing records. [2025-10-09T20:00:39.175963] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:00:39.196862] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-09T20:00:39.202059] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-09T20:00:39.242564] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-09T20:00:39.272145] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-09T20:00:39.286912] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:00:39.287158] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-09T20:00:39.319881] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-09T20:00:39.334161] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-09T20:00:39.364162] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-09T20:00:39.376628] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-09T20:00:40.029468] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-09T20:00:40.039486] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:40.061296] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-09T20:00:40.121462] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:40.759574] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T20:00:40.796803] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-09T20:00:41.349239] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-09T20:00:41.596724] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-09T20:00:42.241473] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T20:00:42.396683] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-09T20:00:42.964412] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-09T20:00:42.984083] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T20:00:43.196731] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-09T20:00:43.780139] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T20:00:43.996732] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-09T20:00:44.481831] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T20:00:44.796707] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-09T20:00:45.596684] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-09T20:00:45.876976] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T20:00:46.396701] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-09T20:00:47.196764] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-09T20:00:47.392362] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T20:00:47.996760] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-09T20:00:48.563669] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-09T20:00:48.583719] [INFO ] [REMOTE ] LUMN: Full fetch complete (77636 records). [2025-10-09T20:00:48.592808] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-09T20:00:48.594321] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T20:00:48.801848] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-09T20:00:49.009871] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-09T20:00:49.009978] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-09T20:00:49.011059] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-09T20:00:49.011193] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-09T20:00:49.012759] [DEBUG] [LOCAL ] LUMN: Trimmed 77636 records to 54030 (keeping 200 days of data) [2025-10-09T20:00:49.325829] [DEBUG] [LOCAL ] LUMN: Primary data saved (54030 records). [2025-10-09T20:00:49.325978] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-09T20:00:49.326065] [INFO ] [MAIN ] Update Progress: 1285/2373 symbols completed. LUMN took 41.0s. Estimated remaining: 2h 33m 3s. Rate: 7.1 symbols/min [2025-10-09T20:00:49.497597] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:00:49.559087] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T20:00:49.589015] [DEBUG] [LOCAL ] LW: Loaded 51218 existing records from primary storage. [2025-10-09T20:00:49.589394] [INFO ] [MAIN ] LW: Loaded 51218 existing records. [2025-10-09T20:00:49.602633] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-09T20:00:49.777955] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:00:49.779266] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-09T20:00:49.779326] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-09T20:00:49.780040] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-09T20:00:49.780098] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-09T20:00:50.138046] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:00:50.396694] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-09T20:00:50.659138] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T20:00:50.763604] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T20:00:51.196716] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-09T20:00:51.996744] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-09T20:00:52.160783] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T20:00:52.637842] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T20:00:52.796726] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-09T20:00:53.596740] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-09T20:00:53.739679] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T20:00:54.396705] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-09T20:00:54.470886] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T20:00:54.593603] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T20:00:55.196806] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-09T20:00:55.996790] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-09T20:00:56.046734] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T20:00:56.179629] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T20:00:56.796771] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-09T20:00:57.596805] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-09T20:00:57.752730] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T20:00:58.396746] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-09T20:00:58.709183] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T20:00:58.849541] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T20:00:59.196722] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-09T20:00:59.990370] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T20:01:00.001153] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-09T20:01:00.101136] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T20:01:00.102917] [INFO ] [REMOTE ] LVWR: Full fetch complete (20369 records). [2025-10-09T20:01:00.102994] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-09T20:01:00.481108] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-09T20:01:00.481189] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-09T20:01:00.481846] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-09T20:01:00.481909] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-09T20:01:00.482806] [DEBUG] [LOCAL ] LVWR: Trimmed 20369 records to 18268 (keeping 200 days of data) [2025-10-09T20:01:00.586364] [DEBUG] [LOCAL ] LVWR: Primary data saved (18268 records). [2025-10-09T20:01:00.586517] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-09T20:01:00.586606] [INFO ] [MAIN ] Update Progress: 1286/2373 symbols completed. LVWR took 21.9s. Estimated remaining: 2h 32m 57s. Rate: 7.1 symbols/min [2025-10-09T20:01:00.753984] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:01:00.771264] [DEBUG] [LOCAL ] LXFR: Loaded 16738 existing records from primary storage. [2025-10-09T20:01:00.771508] [INFO ] [MAIN ] LXFR: Loaded 16738 existing records. [2025-10-09T20:01:00.801998] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-09T20:01:00.951267] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:01:00.951504] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-09T20:01:00.951580] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-09T20:01:00.951792] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-09T20:01:00.951850] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-09T20:01:01.361604] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:01:01.596788] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-09T20:01:01.932988] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-09T20:01:01.939202] [INFO ] [REMOTE ] LUV: Full fetch complete (77729 records). [2025-10-09T20:01:01.939476] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-09T20:01:02.382116] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-09T20:01:02.382200] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-09T20:01:02.383299] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-09T20:01:02.383366] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-09T20:01:02.385137] [DEBUG] [LOCAL ] LUV: Trimmed 77729 records to 54079 (keeping 200 days of data) [2025-10-09T20:01:02.442326] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-09T20:01:02.724243] [DEBUG] [LOCAL ] LUV: Primary data saved (54079 records). [2025-10-09T20:01:02.724426] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-09T20:01:02.724614] [INFO ] [MAIN ] Update Progress: 1287/2373 symbols completed. LUV took 34.9s. Estimated remaining: 2h 32m 43s. Rate: 7.1 symbols/min [2025-10-09T20:01:02.899393] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:01:02.944170] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T20:01:02.949922] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-09T20:01:03.009432] [DEBUG] [LOCAL ] LXP: Loaded 50725 existing records from primary storage. [2025-10-09T20:01:03.009799] [INFO ] [MAIN ] LXP: Loaded 50725 existing records. [2025-10-09T20:01:03.196886] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-09T20:01:03.196772] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:01:03.198442] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-09T20:01:03.198539] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-09T20:01:03.198857] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-09T20:01:03.198941] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-09T20:01:03.610053] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:01:03.996775] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-09T20:01:04.107106] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T20:01:04.247862] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T20:01:04.796785] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-09T20:01:05.596810] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-09T20:01:05.858620] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T20:01:05.882846] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T20:01:06.396744] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-09T20:01:07.196699] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-09T20:01:07.618121] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T20:01:07.996744] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-09T20:01:08.188893] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T20:01:08.271722] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T20:01:08.796735] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-09T20:01:09.566171] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T20:01:09.602571] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-09T20:01:09.615194] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T20:01:10.396721] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-09T20:01:11.158587] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T20:01:11.196671] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-09T20:01:11.670980] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T20:01:11.996722] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-09T20:01:12.796768] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-09T20:01:13.049638] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T20:01:13.533466] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T20:01:13.596690] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-09T20:01:13.975972] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T20:01:14.169002] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T20:01:14.396791] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-09T20:01:15.196703] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-09T20:01:15.996741] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-09T20:01:16.237420] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T20:01:16.242704] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T20:01:16.796727] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-09T20:01:17.493350] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T20:01:17.582562] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T20:01:17.596746] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-09T20:01:18.396724] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-09T20:01:18.517068] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:01:19.196726] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-09T20:01:19.996705] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-09T20:01:20.114859] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T20:01:20.703281] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T20:01:20.796675] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-09T20:01:21.571996] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T20:01:21.596676] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-09T20:01:22.356197] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T20:01:22.396713] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-09T20:01:23.196708] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-09T20:01:23.317267] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T20:01:23.826771] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T20:01:23.829454] [INFO ] [REMOTE ] LXFR: Full fetch complete (24776 records). [2025-10-09T20:01:23.829772] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-09T20:01:23.996762] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-09T20:01:24.222441] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T20:01:24.237683] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-09T20:01:24.241983] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-09T20:01:24.242989] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-09T20:01:24.243232] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-09T20:01:24.243175] [INFO ] [REMOTE ] LW: Full fetch complete (74668 records). [2025-10-09T20:01:24.243512] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-09T20:01:24.250055] [DEBUG] [LOCAL ] LXFR: Trimmed 24776 records to 16823 (keeping 200 days of data) [2025-10-09T20:01:24.688269] [DEBUG] [LOCAL ] LXFR: Primary data saved (16823 records). [2025-10-09T20:01:24.690850] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-09T20:01:24.691286] [INFO ] [MAIN ] Update Progress: 1288/2373 symbols completed. LXFR took 24.1s. Estimated remaining: 2h 32m 46s. Rate: 7.1 symbols/min [2025-10-09T20:01:24.798856] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-09T20:01:24.925612] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-09T20:01:24.925865] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-09T20:01:24.927299] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-09T20:01:24.933189] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-09T20:01:24.988313] [DEBUG] [LOCAL ] LW: Trimmed 74668 records to 51599 (keeping 200 days of data) [2025-10-09T20:01:25.008224] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:01:25.258675] [DEBUG] [LOCAL ] LXU: Loaded 31834 existing records from primary storage. [2025-10-09T20:01:25.260868] [INFO ] [MAIN ] LXU: Loaded 31834 existing records. [2025-10-09T20:01:25.457839] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:01:25.458695] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-09T20:01:25.459327] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-09T20:01:25.459696] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-09T20:01:25.459774] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-09T20:01:25.897583] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:01:25.907570] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-09T20:01:25.911413] [DEBUG] [LOCAL ] LW: Primary data saved (51599 records). [2025-10-09T20:01:25.911556] [INFO ] [MAIN ] LW: Full history saved. [2025-10-09T20:01:25.912460] [INFO ] [MAIN ] Update Progress: 1289/2373 symbols completed. LW took 36.6s. Estimated remaining: 2h 32m 32s. Rate: 7.1 symbols/min [2025-10-09T20:01:26.079630] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:01:26.132925] [DEBUG] [LOCAL ] LYB: Loaded 53610 existing records from primary storage. [2025-10-09T20:01:26.133237] [INFO ] [MAIN ] LYB: Loaded 53610 existing records. [2025-10-09T20:01:26.309229] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:01:26.309448] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-09T20:01:26.309494] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-09T20:01:26.309750] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-09T20:01:26.309845] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-09T20:01:26.667323] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:01:26.667804] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-09T20:01:26.697922] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T20:01:27.043862] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T20:01:27.196696] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-09T20:01:27.320427] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (3.32 seconds). [2025-10-09T20:01:27.325080] [INFO ] [REMOTE ] LVS: Full fetch complete (77519 records). [2025-10-09T20:01:27.325188] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-09T20:01:27.720304] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-09T20:01:27.720399] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-09T20:01:27.721529] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-09T20:01:27.721606] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-09T20:01:27.723263] [DEBUG] [LOCAL ] LVS: Trimmed 77519 records to 53959 (keeping 200 days of data) [2025-10-09T20:01:28.010891] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-09T20:01:28.063392] [DEBUG] [LOCAL ] LVS: Primary data saved (53959 records). [2025-10-09T20:01:28.063529] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-09T20:01:28.063621] [INFO ] [MAIN ] Update Progress: 1290/2373 symbols completed. LVS took 49.6s. Estimated remaining: 2h 32m 18s. Rate: 7.1 symbols/min [2025-10-09T20:01:28.242844] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:01:28.266181] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T20:01:28.321021] [DEBUG] [LOCAL ] LYG: Loaded 52778 existing records from primary storage. [2025-10-09T20:01:28.321379] [INFO ] [MAIN ] LYG: Loaded 52778 existing records. [2025-10-09T20:01:28.499937] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:01:28.500221] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-09T20:01:28.500295] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-09T20:01:28.500580] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-09T20:01:28.500675] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-09T20:01:28.715876] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-09T20:01:28.803120] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-09T20:01:28.923353] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:01:29.596726] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-09T20:01:29.763266] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T20:01:29.957373] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T20:01:30.396731] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-09T20:01:31.196803] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-09T20:01:31.495676] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T20:01:31.967579] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T20:01:31.996678] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-09T20:01:32.796802] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-09T20:01:33.067528] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T20:01:33.408423] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T20:01:33.598460] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-09T20:01:33.600483] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T20:01:34.396720] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-09T20:01:35.101243] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T20:01:35.196725] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-09T20:01:35.996789] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-09T20:01:36.064740] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T20:01:36.562514] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T20:01:36.796781] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-09T20:01:37.202314] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T20:01:37.596739] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-09T20:01:38.396702] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-09T20:01:38.685747] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-09T20:01:39.196717] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-09T20:01:39.211355] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T20:01:39.215823] [INFO ] [REMOTE ] LXP: Full fetch complete (72698 records). [2025-10-09T20:01:39.215942] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-09T20:01:39.607923] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-09T20:01:39.608015] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-09T20:01:39.609127] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-09T20:01:39.609195] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-09T20:01:39.610632] [DEBUG] [LOCAL ] LXP: Trimmed 72698 records to 51100 (keeping 200 days of data) [2025-10-09T20:01:39.925742] [DEBUG] [LOCAL ] LXP: Primary data saved (51100 records). [2025-10-09T20:01:39.925953] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-09T20:01:39.926210] [INFO ] [MAIN ] Update Progress: 1291/2373 symbols completed. LXP took 37.2s. Estimated remaining: 2h 32m 12s. Rate: 7.1 symbols/min [2025-10-09T20:01:39.999131] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-09T20:01:40.123615] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:01:40.195953] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T20:01:40.225537] [DEBUG] [LOCAL ] LYV: Loaded 51124 existing records from primary storage. [2025-10-09T20:01:40.225937] [INFO ] [MAIN ] LYV: Loaded 51124 existing records. [2025-10-09T20:01:40.399636] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:01:40.399880] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-09T20:01:40.399927] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-09T20:01:40.400150] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-09T20:01:40.400206] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-09T20:01:40.768125] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:01:40.796679] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-09T20:01:41.085175] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T20:01:41.486529] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T20:01:41.596701] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-09T20:01:42.396713] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-09T20:01:42.469859] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T20:01:42.784951] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T20:01:43.196746] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-09T20:01:43.903326] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T20:01:43.996735] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-09T20:01:44.803102] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-09T20:01:44.820720] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T20:01:45.596719] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-09T20:01:45.830323] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T20:01:46.102618] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T20:01:46.396698] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-09T20:01:47.196772] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-09T20:01:47.278685] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T20:01:47.764745] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T20:01:47.996715] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-09T20:01:48.796753] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-09T20:01:48.924595] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T20:01:49.053436] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T20:01:49.596702] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-09T20:01:50.396773] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-09T20:01:50.653442] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T20:01:50.666812] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T20:01:51.196760] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-09T20:01:51.996742] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-09T20:01:52.221402] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T20:01:52.796736] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-09T20:01:53.113683] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T20:01:53.181212] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T20:01:53.596760] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-09T20:01:54.396719] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-09T20:01:54.664913] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T20:01:55.196749] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-09T20:01:55.424463] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T20:01:55.996808] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-09T20:01:56.796797] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-09T20:02:00.342077] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (5.95 seconds). [2025-10-09T20:02:00.346638] [INFO ] [REMOTE ] LXU: Full fetch complete (45022 records). [2025-10-09T20:02:00.347072] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-09T20:02:00.747304] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-09T20:02:00.747424] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-09T20:02:00.748236] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-09T20:02:00.748299] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-09T20:02:00.749331] [DEBUG] [LOCAL ] LXU: Trimmed 45022 records to 32021 (keeping 200 days of data) [2025-10-09T20:02:00.937330] [DEBUG] [LOCAL ] LXU: Primary data saved (32021 records). [2025-10-09T20:02:00.937487] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-09T20:02:00.937612] [INFO ] [MAIN ] Update Progress: 1292/2373 symbols completed. LXU took 36.2s. Estimated remaining: 2h 32m 14s. Rate: 7.1 symbols/min [2025-10-09T20:02:01.128788] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:02:01.164415] [DEBUG] [LOCAL ] LZB: Loaded 35057 existing records from primary storage. [2025-10-09T20:02:01.164832] [INFO ] [MAIN ] LZB: Loaded 35057 existing records. [2025-10-09T20:02:01.367728] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:02:01.368096] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-09T20:02:01.368203] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-09T20:02:01.368620] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-09T20:02:01.368741] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-09T20:02:01.550697] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (5.55 seconds). [2025-10-09T20:02:01.693433] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-09T20:02:01.801470] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:02:01.801967] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-09T20:02:01.849629] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (5.05 seconds). [2025-10-09T20:02:01.863572] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-09T20:02:01.902978] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (6.71 seconds). [2025-10-09T20:02:01.915248] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-09T20:02:03.005330] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T20:02:03.011790] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-09T20:02:03.618910] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T20:02:03.630365] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-09T20:02:03.717257] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-09T20:02:03.722468] [INFO ] [REMOTE ] LYG: Full fetch complete (76071 records). [2025-10-09T20:02:03.722633] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-09T20:02:04.170178] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-09T20:02:04.171015] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-09T20:02:04.172364] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-09T20:02:04.172551] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-09T20:02:04.206938] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-09T20:02:04.220360] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-09T20:02:04.219842] [DEBUG] [LOCAL ] LYG: Trimmed 76071 records to 53160 (keeping 200 days of data) [2025-10-09T20:02:04.336829] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T20:02:04.346811] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-09T20:02:04.572466] [DEBUG] [LOCAL ] LYG: Primary data saved (53160 records). [2025-10-09T20:02:04.573094] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-09T20:02:04.573334] [INFO ] [MAIN ] Update Progress: 1293/2373 symbols completed. LYG took 36.5s. Estimated remaining: 2h 32m 2s. Rate: 7.1 symbols/min [2025-10-09T20:02:04.747587] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:02:04.764888] [DEBUG] [LOCAL ] LZM: Loaded 14323 existing records from primary storage. [2025-10-09T20:02:04.765156] [INFO ] [MAIN ] LZM: Loaded 14323 existing records. [2025-10-09T20:02:04.945973] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:02:04.946246] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-09T20:02:04.946298] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-09T20:02:04.946494] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-09T20:02:04.946553] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-09T20:02:05.316805] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:02:05.317267] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-09T20:02:05.504518] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T20:02:05.516088] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-09T20:02:05.786602] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T20:02:05.819030] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-09T20:02:05.818681] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T20:02:06.009085] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T20:02:06.396697] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-09T20:02:06.898728] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T20:02:07.196728] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-09T20:02:07.290864] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T20:02:07.676228] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T20:02:07.996782] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-09T20:02:08.796716] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-09T20:02:09.071951] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T20:02:09.171175] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T20:02:09.529138] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T20:02:09.596696] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-09T20:02:10.396726] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-09T20:02:11.108334] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T20:02:11.196745] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-09T20:02:11.905069] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T20:02:11.910493] [INFO ] [REMOTE ] LYV: Full fetch complete (73830 records). [2025-10-09T20:02:11.910625] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-09T20:02:12.000756] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-09T20:02:12.006931] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T20:02:12.355941] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-09T20:02:12.356027] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-09T20:02:12.357005] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-09T20:02:12.357092] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-09T20:02:12.358508] [DEBUG] [LOCAL ] LYV: Trimmed 73830 records to 51511 (keeping 200 days of data) [2025-10-09T20:02:12.679633] [DEBUG] [LOCAL ] LYV: Primary data saved (51511 records). [2025-10-09T20:02:12.680363] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-09T20:02:12.680450] [INFO ] [MAIN ] Update Progress: 1294/2373 symbols completed. LYV took 32.8s. Estimated remaining: 2h 31m 53s. Rate: 7.1 symbols/min [2025-10-09T20:02:12.801793] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-09T20:02:12.856514] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:02:12.906880] [DEBUG] [LOCAL ] M: Loaded 53540 existing records from primary storage. [2025-10-09T20:02:12.907202] [INFO ] [MAIN ] M: Loaded 53540 existing records. [2025-10-09T20:02:13.082743] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:02:13.082981] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-09T20:02:13.083036] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-09T20:02:13.083246] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-09T20:02:13.083303] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-09T20:02:13.426452] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:02:13.596680] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-09T20:02:13.780001] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T20:02:13.784728] [INFO ] [REMOTE ] LYB: Full fetch complete (77459 records). [2025-10-09T20:02:13.784909] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-09T20:02:13.936893] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T20:02:14.199685] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-09T20:02:14.199777] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-09T20:02:14.200822] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-09T20:02:14.200945] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-09T20:02:14.202419] [DEBUG] [LOCAL ] LYB: Trimmed 77459 records to 53999 (keeping 200 days of data) [2025-10-09T20:02:14.398638] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-09T20:02:14.547914] [DEBUG] [LOCAL ] LYB: Primary data saved (53999 records). [2025-10-09T20:02:14.548052] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-09T20:02:14.548767] [INFO ] [MAIN ] Update Progress: 1295/2373 symbols completed. LYB took 48.6s. Estimated remaining: 2h 31m 39s. Rate: 7.1 symbols/min [2025-10-09T20:02:14.713767] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:02:14.764634] [DEBUG] [LOCAL ] MA: Loaded 52489 existing records from primary storage. [2025-10-09T20:02:14.765028] [INFO ] [MAIN ] MA: Loaded 52489 existing records. [2025-10-09T20:02:14.939989] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:02:14.940257] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-09T20:02:14.940307] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-09T20:02:14.940511] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-09T20:02:14.940568] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-09T20:02:15.203199] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T20:02:15.202320] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-09T20:02:15.348378] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:02:15.402714] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T20:02:15.996724] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-09T20:02:16.769972] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T20:02:16.796664] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-09T20:02:17.601796] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-09T20:02:17.620496] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T20:02:18.200008] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T20:02:18.396729] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-09T20:02:19.196769] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-09T20:02:19.396940] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T20:02:19.679973] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T20:02:19.996714] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-09T20:02:20.796765] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-09T20:02:21.157230] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T20:02:21.596759] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-09T20:02:21.803718] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T20:02:21.928676] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-09T20:02:22.396717] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-09T20:02:22.780568] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T20:02:23.196763] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-09T20:02:23.898032] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T20:02:23.996727] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-09T20:02:24.574386] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T20:02:24.796774] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-09T20:02:25.571681] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T20:02:25.596668] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-09T20:02:25.930826] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T20:02:26.396721] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-09T20:02:27.196770] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-09T20:02:27.592638] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-09T20:02:27.996706] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-09T20:02:28.028401] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T20:02:28.539248] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T20:02:28.544365] [INFO ] [REMOTE ] LZB: Full fetch complete (50566 records). [2025-10-09T20:02:28.544450] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-09T20:02:28.801951] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-09T20:02:28.926838] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-09T20:02:28.926912] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-09T20:02:28.927728] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-09T20:02:28.927793] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-09T20:02:28.928879] [DEBUG] [LOCAL ] LZB: Trimmed 50566 records to 35263 (keeping 200 days of data) [2025-10-09T20:02:29.141081] [DEBUG] [LOCAL ] LZB: Primary data saved (35263 records). [2025-10-09T20:02:29.141216] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-09T20:02:29.141300] [INFO ] [MAIN ] Update Progress: 1296/2373 symbols completed. LZB took 28.2s. Estimated remaining: 2h 31m 36s. Rate: 7.1 symbols/min [2025-10-09T20:02:29.307449] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:02:29.350974] [DEBUG] [LOCAL ] MAA: Loaded 42651 existing records from primary storage. [2025-10-09T20:02:29.351265] [INFO ] [MAIN ] MAA: Loaded 42651 existing records. [2025-10-09T20:02:29.526473] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:02:29.526698] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-09T20:02:29.526766] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-09T20:02:29.527023] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-09T20:02:29.527083] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-09T20:02:29.604211] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-09T20:02:29.824007] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T20:02:29.908522] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:02:29.966082] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-09T20:02:30.396705] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-09T20:02:31.196710] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-09T20:02:31.284962] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T20:02:31.645468] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-09T20:02:31.996726] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-09T20:02:32.691688] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T20:02:32.796728] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-09T20:02:33.596684] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-09T20:02:33.810741] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T20:02:34.324571] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T20:02:34.396678] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-09T20:02:35.144977] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T20:02:35.147312] [INFO ] [REMOTE ] LZM: Full fetch complete (18927 records). [2025-10-09T20:02:35.147407] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-09T20:02:35.207310] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-09T20:02:35.528428] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-09T20:02:35.528585] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-09T20:02:35.529043] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-09T20:02:35.529173] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-09T20:02:35.530163] [DEBUG] [LOCAL ] LZM: Trimmed 18927 records to 14501 (keeping 200 days of data) [2025-10-09T20:02:35.641471] [DEBUG] [LOCAL ] LZM: Primary data saved (14501 records). [2025-10-09T20:02:35.643066] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T20:02:35.641899] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-09T20:02:35.643236] [INFO ] [MAIN ] Update Progress: 1297/2373 symbols completed. LZM took 31.1s. Estimated remaining: 2h 31m 26s. Rate: 7.1 symbols/min [2025-10-09T20:02:35.831272] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:02:35.875883] [DEBUG] [LOCAL ] MAC: Loaded 49609 existing records from primary storage. [2025-10-09T20:02:35.876247] [INFO ] [MAIN ] MAC: Loaded 49609 existing records. [2025-10-09T20:02:36.001815] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-09T20:02:36.058616] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:02:36.058870] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-09T20:02:36.058918] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-09T20:02:36.059121] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-09T20:02:36.059177] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-09T20:02:36.404105] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:02:36.796694] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-09T20:02:37.168038] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-09T20:02:37.419547] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T20:02:37.596686] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-09T20:02:38.396780] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-09T20:02:38.876132] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-09T20:02:39.151750] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T20:02:39.196671] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-09T20:02:39.996680] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-09T20:02:40.260083] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T20:02:40.796691] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-09T20:02:41.045990] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T20:02:41.050594] [INFO ] [REMOTE ] M: Full fetch complete (77519 records). [2025-10-09T20:02:41.050738] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-09T20:02:41.443672] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-09T20:02:41.443814] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-09T20:02:41.444916] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-09T20:02:41.444980] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-09T20:02:41.446428] [DEBUG] [LOCAL ] M: Trimmed 77519 records to 53930 (keeping 200 days of data) [2025-10-09T20:02:41.597325] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T20:02:41.598344] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-09T20:02:41.843623] [DEBUG] [LOCAL ] M: Primary data saved (53930 records). [2025-10-09T20:02:41.843809] [INFO ] [MAIN ] M: Full history saved. [2025-10-09T20:02:41.843924] [INFO ] [MAIN ] Update Progress: 1298/2373 symbols completed. M took 29.2s. Estimated remaining: 2h 31m 16s. Rate: 7.1 symbols/min [2025-10-09T20:02:42.023613] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:02:42.058621] [DEBUG] [LOCAL ] MAGN: Loaded 35662 existing records from primary storage. [2025-10-09T20:02:42.058948] [INFO ] [MAIN ] MAGN: Loaded 35662 existing records. [2025-10-09T20:02:42.271566] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:02:42.264943] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T20:02:42.271826] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-09T20:02:42.280874] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-09T20:02:42.281844] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-09T20:02:42.281905] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-09T20:02:42.401957] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-09T20:02:42.668434] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:02:43.196838] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-09T20:02:43.794596] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-09T20:02:44.000263] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-09T20:02:44.012126] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T20:02:44.572857] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T20:02:44.796725] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-09T20:02:45.360884] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T20:02:45.596792] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-09T20:02:45.990736] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T20:02:46.396829] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-09T20:02:46.556486] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T20:02:47.196777] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-09T20:02:47.930587] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T20:02:47.996687] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-09T20:02:48.129953] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T20:02:48.796699] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-09T20:02:49.570155] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T20:02:49.596680] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-09T20:02:50.219676] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T20:02:50.396725] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-09T20:02:50.933698] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T20:02:51.196736] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-09T20:02:51.989982] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T20:02:52.000984] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-09T20:02:52.446475] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T20:02:52.796724] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-09T20:02:53.324332] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T20:02:53.596737] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-09T20:02:54.396682] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-09T20:02:54.906885] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T20:02:55.024028] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T20:02:55.196749] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-09T20:02:55.876937] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T20:02:55.996790] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-09T20:02:56.796699] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-09T20:02:56.892704] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T20:02:57.277957] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T20:02:57.596767] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-09T20:02:57.865238] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T20:02:58.396736] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-09T20:02:59.136162] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T20:02:59.196688] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-09T20:02:59.996683] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-09T20:03:00.382026] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-09T20:03:00.386910] [INFO ] [REMOTE ] MA: Full fetch complete (76241 records). [2025-10-09T20:03:00.387038] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-09T20:03:00.805629] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T20:03:00.800524] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-09T20:03:00.837260] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-09T20:03:00.837938] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-09T20:03:00.839260] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-09T20:03:00.839553] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-09T20:03:00.841450] [DEBUG] [LOCAL ] MA: Trimmed 76241 records to 52878 (keeping 200 days of data) [2025-10-09T20:03:01.191185] [DEBUG] [LOCAL ] MA: Primary data saved (52878 records). [2025-10-09T20:03:01.191315] [INFO ] [MAIN ] MA: Full history saved. [2025-10-09T20:03:01.191997] [INFO ] [MAIN ] Update Progress: 1299/2373 symbols completed. MA took 46.6s. Estimated remaining: 2h 31m 16s. Rate: 7.1 symbols/min [2025-10-09T20:03:01.365972] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:03:01.397760] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T20:03:01.445169] [DEBUG] [LOCAL ] MAIN: Loaded 41339 existing records from primary storage. [2025-10-09T20:03:01.445466] [INFO ] [MAIN ] MAIN: Loaded 41339 existing records. [2025-10-09T20:03:01.607442] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-09T20:03:01.630319] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:03:01.631541] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-09T20:03:01.631595] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-09T20:03:01.631847] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-09T20:03:01.631906] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-09T20:03:02.031084] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:03:02.172072] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T20:03:02.396726] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-09T20:03:03.048626] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T20:03:03.196699] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-09T20:03:04.007111] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-09T20:03:04.009698] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T20:03:04.418961] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T20:03:04.423309] [INFO ] [REMOTE ] MAC: Full fetch complete (71377 records). [2025-10-09T20:03:04.423472] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-09T20:03:04.806390] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-09T20:03:04.810054] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-09T20:03:04.811061] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-09T20:03:04.812092] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-09T20:03:04.812254] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-09T20:03:04.813746] [DEBUG] [LOCAL ] MAC: Trimmed 71377 records to 49954 (keeping 200 days of data) [2025-10-09T20:03:05.120675] [DEBUG] [LOCAL ] MAC: Primary data saved (49954 records). [2025-10-09T20:03:05.120811] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-09T20:03:05.120896] [INFO ] [MAIN ] Update Progress: 1300/2373 symbols completed. MAC took 29.5s. Estimated remaining: 2h 31m 4s. Rate: 7.1 symbols/min [2025-10-09T20:03:05.283313] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T20:03:05.299967] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:03:05.304243] [INFO ] [REMOTE ] MAA: Full fetch complete (61249 records). [2025-10-09T20:03:05.304338] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-09T20:03:05.597135] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-09T20:03:05.639723] [DEBUG] [LOCAL ] MAN: Loaded 43573 existing records from primary storage. [2025-10-09T20:03:05.661318] [INFO ] [MAIN ] MAN: Loaded 43573 existing records. [2025-10-09T20:03:05.844317] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-09T20:03:05.861603] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-09T20:03:05.867791] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-09T20:03:05.882783] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-09T20:03:05.924241] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:03:05.924509] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-09T20:03:05.924611] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-09T20:03:05.925109] [DEBUG] [LOCAL ] MAA: Trimmed 61249 records to 42937 (keeping 200 days of data) [2025-10-09T20:03:05.925176] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-09T20:03:05.925505] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-09T20:03:06.474470] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:03:06.475898] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-09T20:03:06.506026] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T20:03:06.680090] [DEBUG] [LOCAL ] MAA: Primary data saved (42937 records). [2025-10-09T20:03:06.680232] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-09T20:03:06.680316] [INFO ] [MAIN ] Update Progress: 1301/2373 symbols completed. MAA took 37.5s. Estimated remaining: 2h 30m 50s. Rate: 7.1 symbols/min [2025-10-09T20:03:06.864946] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:03:06.892756] [DEBUG] [LOCAL ] MANU: Loaded 26742 existing records from primary storage. [2025-10-09T20:03:06.893155] [INFO ] [MAIN ] MANU: Loaded 26742 existing records. [2025-10-09T20:03:07.110409] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T20:03:07.116707] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:03:07.125776] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-09T20:03:07.125875] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-09T20:03:07.126497] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-09T20:03:07.126562] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-09T20:03:07.202027] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-09T20:03:07.474537] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:03:07.715742] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T20:03:07.996785] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-09T20:03:08.796752] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-09T20:03:08.901858] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T20:03:09.497077] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T20:03:09.596694] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-09T20:03:09.842309] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T20:03:10.396733] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-09T20:03:10.484145] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T20:03:11.196743] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-09T20:03:11.991929] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T20:03:12.000413] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-09T20:03:12.486903] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T20:03:12.490937] [INFO ] [REMOTE ] MAGN: Full fetch complete (51492 records). [2025-10-09T20:03:12.491042] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-09T20:03:12.801784] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-09T20:03:12.879097] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-09T20:03:12.879390] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-09T20:03:12.880278] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-09T20:03:12.880540] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-09T20:03:12.896258] [DEBUG] [LOCAL ] MAGN: Trimmed 51492 records to 35945 (keeping 200 days of data) [2025-10-09T20:03:12.897863] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T20:03:13.115260] [DEBUG] [LOCAL ] MAGN: Primary data saved (35945 records). [2025-10-09T20:03:13.115416] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-09T20:03:13.115507] [INFO ] [MAIN ] Update Progress: 1302/2373 symbols completed. MAGN took 31.3s. Estimated remaining: 2h 30m 40s. Rate: 7.1 symbols/min [2025-10-09T20:03:13.285395] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:03:13.333770] [DEBUG] [LOCAL ] MAS: Loaded 52277 existing records from primary storage. [2025-10-09T20:03:13.334114] [INFO ] [MAIN ] MAS: Loaded 52277 existing records. [2025-10-09T20:03:13.511258] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:03:13.511516] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-09T20:03:13.511586] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-09T20:03:13.511892] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-09T20:03:13.511961] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-09T20:03:13.601844] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-09T20:03:13.867948] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:03:14.156329] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T20:03:14.302117] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:03:14.396735] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-09T20:03:15.196687] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-09T20:03:15.550615] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T20:03:15.996733] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-09T20:03:16.796714] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-09T20:03:16.961218] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T20:03:17.529631] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T20:03:17.596744] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-09T20:03:17.671494] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T20:03:18.396745] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-09T20:03:19.202003] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-09T20:03:19.214130] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T20:03:19.867884] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T20:03:19.996719] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-09T20:03:20.798059] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-09T20:03:20.797909] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T20:03:20.981920] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T20:03:21.596734] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-09T20:03:21.716958] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T20:03:22.396784] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-09T20:03:23.141829] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T20:03:23.196689] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-09T20:03:23.659257] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T20:03:23.996725] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-09T20:03:24.796806] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-09T20:03:24.941817] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T20:03:25.205157] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T20:03:25.596775] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-09T20:03:26.012684] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T20:03:26.396733] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-09T20:03:26.712477] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T20:03:27.196709] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-09T20:03:27.996693] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-09T20:03:28.139206] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T20:03:28.668612] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T20:03:28.796716] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-09T20:03:29.400008] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T20:03:29.596719] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-09T20:03:30.339357] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T20:03:30.396677] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-09T20:03:30.853237] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T20:03:31.196743] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-09T20:03:31.563614] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T20:03:31.996769] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-09T20:03:32.796739] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-09T20:03:32.926625] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T20:03:33.551635] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T20:03:33.596678] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-09T20:03:33.949003] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T20:03:34.396715] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-09T20:03:35.022522] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T20:03:35.026854] [INFO ] [REMOTE ] MAN: Full fetch complete (62266 records). [2025-10-09T20:03:35.027007] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-09T20:03:35.200004] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-09T20:03:35.522912] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-09T20:03:35.523211] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-09T20:03:35.525491] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-09T20:03:35.525780] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-09T20:03:35.554566] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T20:03:35.562115] [DEBUG] [LOCAL ] MAN: Trimmed 62266 records to 43985 (keeping 200 days of data) [2025-10-09T20:03:35.951913] [DEBUG] [LOCAL ] MAN: Primary data saved (43985 records). [2025-10-09T20:03:35.952112] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-09T20:03:35.952243] [INFO ] [MAIN ] Update Progress: 1303/2373 symbols completed. MAN took 30.8s. Estimated remaining: 2h 30m 43s. Rate: 7.1 symbols/min [2025-10-09T20:03:36.001927] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-09T20:03:36.192519] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:03:36.247842] [DEBUG] [LOCAL ] MATV: Loaded 35918 existing records from primary storage. [2025-10-09T20:03:36.248164] [INFO ] [MAIN ] MATV: Loaded 35918 existing records. [2025-10-09T20:03:36.430801] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:03:36.431039] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-09T20:03:36.431089] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-09T20:03:36.431293] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-09T20:03:36.431349] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-09T20:03:36.788226] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:03:36.800946] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T20:03:36.797579] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-09T20:03:36.807007] [INFO ] [REMOTE ] MAIN: Full fetch complete (60085 records). [2025-10-09T20:03:36.807208] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-09T20:03:37.237438] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-09T20:03:37.237556] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-09T20:03:37.239158] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-09T20:03:37.239293] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-09T20:03:37.241069] [DEBUG] [LOCAL ] MAIN: Trimmed 60085 records to 41726 (keeping 200 days of data) [2025-10-09T20:03:37.501449] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T20:03:37.561079] [DEBUG] [LOCAL ] MAIN: Primary data saved (41726 records). [2025-10-09T20:03:37.561281] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-09T20:03:37.562070] [INFO ] [MAIN ] Update Progress: 1304/2373 symbols completed. MAIN took 36.4s. Estimated remaining: 2h 30m 29s. Rate: 7.1 symbols/min [2025-10-09T20:03:37.601957] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-09T20:03:37.751983] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:03:37.792085] [DEBUG] [LOCAL ] MATX: Loaded 31313 existing records from primary storage. [2025-10-09T20:03:37.792474] [INFO ] [MAIN ] MATX: Loaded 31313 existing records. [2025-10-09T20:03:37.979108] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:03:37.979415] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-09T20:03:37.979465] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-09T20:03:37.979739] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-09T20:03:37.979799] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-09T20:03:38.392191] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:03:38.405133] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-09T20:03:38.429317] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T20:03:39.081462] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T20:03:39.196733] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-09T20:03:39.225993] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T20:03:39.996697] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-09T20:03:40.200325] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T20:03:40.796732] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-09T20:03:41.117963] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T20:03:41.120802] [INFO ] [REMOTE ] MANU: Full fetch complete (38327 records). [2025-10-09T20:03:41.120894] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-09T20:03:41.547421] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-09T20:03:41.547510] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-09T20:03:41.548283] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-09T20:03:41.548346] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-09T20:03:41.549221] [DEBUG] [LOCAL ] MANU: Trimmed 38327 records to 26944 (keeping 200 days of data) [2025-10-09T20:03:41.598004] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-09T20:03:41.726701] [DEBUG] [LOCAL ] MANU: Primary data saved (26944 records). [2025-10-09T20:03:41.726850] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-09T20:03:41.726939] [INFO ] [MAIN ] Update Progress: 1305/2373 symbols completed. MANU took 35.0s. Estimated remaining: 2h 30m 17s. Rate: 7.1 symbols/min [2025-10-09T20:03:41.924825] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:03:41.955996] [DEBUG] [LOCAL ] MAX: Loaded 30989 existing records from primary storage. [2025-10-09T20:03:41.956279] [INFO ] [MAIN ] MAX: Loaded 30989 existing records. [2025-10-09T20:03:42.140251] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:03:42.140499] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-09T20:03:42.140584] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-09T20:03:42.140841] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-09T20:03:42.140900] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-09T20:03:42.408619] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-09T20:03:42.521179] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:03:42.564248] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:03:42.590295] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T20:03:43.196694] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-09T20:03:43.587164] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T20:03:43.996687] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-09T20:03:44.227058] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T20:03:44.796718] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-09T20:03:45.361074] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T20:03:45.596700] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-09T20:03:46.123252] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T20:03:46.396692] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-09T20:03:46.554752] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T20:03:47.196713] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-09T20:03:47.955415] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T20:03:47.996715] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-09T20:03:48.553567] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T20:03:48.796781] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-09T20:03:49.047082] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T20:03:49.596806] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-09T20:03:50.111982] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T20:03:50.391549] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T20:03:50.397530] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-09T20:03:51.196778] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-09T20:03:51.835793] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T20:03:51.996721] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-09T20:03:52.674729] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T20:03:52.679994] [INFO ] [REMOTE ] MAS: Full fetch complete (74888 records). [2025-10-09T20:03:52.680209] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-09T20:03:52.802042] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-09T20:03:53.125670] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-09T20:03:53.126723] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-09T20:03:53.126585] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T20:03:53.128128] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-09T20:03:53.134939] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-09T20:03:53.137335] [DEBUG] [LOCAL ] MAS: Trimmed 74888 records to 52645 (keeping 200 days of data) [2025-10-09T20:03:53.469068] [DEBUG] [LOCAL ] MAS: Primary data saved (52645 records). [2025-10-09T20:03:53.469291] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-09T20:03:53.469450] [INFO ] [MAIN ] Update Progress: 1306/2373 symbols completed. MAS took 40.4s. Estimated remaining: 2h 30m 11s. Rate: 7.1 symbols/min [2025-10-09T20:03:53.601941] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-09T20:03:53.686744] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:03:53.731104] [DEBUG] [LOCAL ] MBC: Loaded 43559 existing records from primary storage. [2025-10-09T20:03:53.731432] [INFO ] [MAIN ] MBC: Loaded 43559 existing records. [2025-10-09T20:03:53.904632] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:03:53.904892] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-09T20:03:53.904940] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-09T20:03:53.905223] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-09T20:03:53.905281] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-09T20:03:54.295541] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:03:54.402064] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-09T20:03:54.416997] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T20:03:55.124726] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T20:03:55.196685] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-09T20:03:55.542230] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T20:03:55.996748] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-09T20:03:56.769134] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T20:03:56.796700] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-09T20:03:57.462181] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T20:03:57.596740] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-09T20:03:57.927209] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T20:03:58.396791] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-09T20:03:58.486696] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T20:03:59.196720] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-09T20:03:59.311558] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T20:03:59.996753] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-09T20:04:00.645221] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T20:04:00.796754] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-09T20:04:01.459965] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T20:04:01.596840] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-09T20:04:02.004433] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T20:04:02.396786] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-09T20:04:03.013133] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T20:04:03.196764] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-09T20:04:03.469964] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T20:04:03.996742] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-09T20:04:04.545856] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T20:04:04.796736] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-09T20:04:04.970057] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T20:04:04.973406] [INFO ] [REMOTE ] MATV: Full fetch complete (52170 records). [2025-10-09T20:04:04.973573] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-09T20:04:05.369764] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-09T20:04:05.369873] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-09T20:04:05.370758] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-09T20:04:05.370825] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-09T20:04:05.372117] [DEBUG] [LOCAL ] MATV: Trimmed 52170 records to 36134 (keeping 200 days of data) [2025-10-09T20:04:05.589759] [DEBUG] [LOCAL ] MATV: Primary data saved (36134 records). [2025-10-09T20:04:05.589915] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-09T20:04:05.590005] [INFO ] [MAIN ] Update Progress: 1307/2373 symbols completed. MATV took 29.6s. Estimated remaining: 2h 30m 6s. Rate: 7.1 symbols/min [2025-10-09T20:04:05.602435] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-09T20:04:05.763000] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:04:05.787551] [DEBUG] [LOCAL ] MBI: Loaded 24241 existing records from primary storage. [2025-10-09T20:04:05.787851] [INFO ] [MAIN ] MBI: Loaded 24241 existing records. [2025-10-09T20:04:05.970340] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:04:05.970556] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-09T20:04:05.970604] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-09T20:04:05.970860] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-09T20:04:05.970918] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-09T20:04:06.179345] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T20:04:06.390736] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:04:06.396667] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-09T20:04:06.633465] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T20:04:07.196709] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-09T20:04:07.565343] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T20:04:07.996738] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-09T20:04:08.300179] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T20:04:08.796796] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-09T20:04:09.430856] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T20:04:09.596778] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-09T20:04:09.992579] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T20:04:09.995334] [INFO ] [REMOTE ] MATX: Full fetch complete (42952 records). [2025-10-09T20:04:09.995438] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-09T20:04:10.385078] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-09T20:04:10.385167] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-09T20:04:10.385946] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-09T20:04:10.386032] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-09T20:04:10.386985] [DEBUG] [LOCAL ] MATX: Trimmed 42952 records to 31582 (keeping 200 days of data) [2025-10-09T20:04:10.443899] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-09T20:04:10.592705] [DEBUG] [LOCAL ] MATX: Primary data saved (31582 records). [2025-10-09T20:04:10.592852] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-09T20:04:10.593512] [INFO ] [MAIN ] Update Progress: 1308/2373 symbols completed. MATX took 33.0s. Estimated remaining: 2h 29m 55s. Rate: 7.1 symbols/min [2025-10-09T20:04:10.765514] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:04:10.806943] [DEBUG] [LOCAL ] MC: Loaded 43924 existing records from primary storage. [2025-10-09T20:04:10.807243] [INFO ] [MAIN ] MC: Loaded 43924 existing records. [2025-10-09T20:04:10.985422] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:04:10.985779] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-09T20:04:10.985925] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-09T20:04:10.986184] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-09T20:04:10.986241] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-09T20:04:11.199583] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-09T20:04:11.364120] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T20:04:11.397450] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:04:11.654111] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T20:04:11.996712] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-09T20:04:12.313542] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T20:04:12.796726] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-09T20:04:13.526172] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T20:04:13.596688] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-09T20:04:13.914000] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T20:04:14.396730] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-09T20:04:14.989231] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T20:04:15.196714] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-09T20:04:15.802968] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T20:04:15.996741] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-09T20:04:16.537426] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T20:04:16.782548] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T20:04:16.796672] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-09T20:04:17.596770] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-09T20:04:17.881384] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T20:04:18.396774] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-09T20:04:18.921104] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T20:04:19.196713] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-09T20:04:19.567098] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T20:04:19.996751] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-09T20:04:20.796749] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-09T20:04:20.874086] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T20:04:21.475126] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T20:04:21.596701] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-09T20:04:21.879807] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T20:04:22.396701] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-09T20:04:22.914410] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T20:04:23.196749] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-09T20:04:23.358486] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T20:04:23.996791] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-09T20:04:24.628814] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T20:04:24.633286] [INFO ] [REMOTE ] MBC: Full fetch complete (63154 records). [2025-10-09T20:04:24.633434] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-09T20:04:24.806987] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-09T20:04:25.067180] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-09T20:04:25.067437] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-09T20:04:25.069164] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-09T20:04:25.069336] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-09T20:04:25.071307] [DEBUG] [LOCAL ] MBC: Trimmed 63154 records to 43932 (keeping 200 days of data) [2025-10-09T20:04:25.324859] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T20:04:25.382931] [DEBUG] [LOCAL ] MBC: Primary data saved (43932 records). [2025-10-09T20:04:25.383071] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-09T20:04:25.383169] [INFO ] [MAIN ] Update Progress: 1309/2373 symbols completed. MBC took 31.9s. Estimated remaining: 2h 29m 51s. Rate: 7.1 symbols/min [2025-10-09T20:04:25.549120] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:04:25.561782] [DEBUG] [LOCAL ] MCB: Loaded 11261 existing records from primary storage. [2025-10-09T20:04:25.562012] [INFO ] [MAIN ] MCB: Loaded 11261 existing records. [2025-10-09T20:04:25.603674] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-09T20:04:25.744486] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:04:25.744851] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-09T20:04:25.744920] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-09T20:04:25.745174] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-09T20:04:25.745242] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-09T20:04:25.913696] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T20:04:26.129890] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:04:26.396723] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-09T20:04:27.196692] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-09T20:04:27.355980] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T20:04:27.559333] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T20:04:27.562767] [INFO ] [REMOTE ] MAX: Full fetch complete (45423 records). [2025-10-09T20:04:27.562862] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-09T20:04:28.002610] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-09T20:04:28.071049] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-09T20:04:28.072454] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-09T20:04:28.074111] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-09T20:04:28.074350] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-09T20:04:28.076097] [DEBUG] [LOCAL ] MAX: Trimmed 45423 records to 31210 (keeping 200 days of data) [2025-10-09T20:04:28.334895] [DEBUG] [LOCAL ] MAX: Primary data saved (31210 records). [2025-10-09T20:04:28.335116] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-09T20:04:28.335250] [INFO ] [MAIN ] Update Progress: 1310/2373 symbols completed. MAX took 46.6s. Estimated remaining: 2h 29m 39s. Rate: 7.1 symbols/min [2025-10-09T20:04:28.610568] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:04:28.610970] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-09T20:04:28.611214] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-09T20:04:28.611551] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-09T20:04:28.611602] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-09T20:04:28.611738] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-09T20:04:28.629580] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-09T20:04:28.697423] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T20:04:28.799787] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-09T20:04:29.072864] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:04:29.482071] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T20:04:29.596699] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-09T20:04:29.841862] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T20:04:30.396706] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-09T20:04:30.475389] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T20:04:30.932289] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-09T20:04:31.196742] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-09T20:04:31.996721] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-09T20:04:32.131398] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T20:04:32.133974] [INFO ] [REMOTE ] MBI: Full fetch complete (36592 records). [2025-10-09T20:04:32.134080] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-09T20:04:32.509015] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-09T20:04:32.509093] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-09T20:04:32.509804] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-09T20:04:32.509865] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-09T20:04:32.510665] [DEBUG] [LOCAL ] MBI: Trimmed 36592 records to 24418 (keeping 200 days of data) [2025-10-09T20:04:32.647490] [DEBUG] [LOCAL ] MBI: Primary data saved (24418 records). [2025-10-09T20:04:32.647666] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-09T20:04:32.647810] [INFO ] [MAIN ] Update Progress: 1311/2373 symbols completed. MBI took 27.1s. Estimated remaining: 2h 29m 27s. Rate: 7.1 symbols/min [2025-10-09T20:04:32.799813] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-09T20:04:32.824546] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:04:32.834785] [DEBUG] [LOCAL ] MCI: Loaded 6483 existing records from primary storage. [2025-10-09T20:04:32.835044] [INFO ] [MAIN ] MCI: Loaded 6483 existing records. [2025-10-09T20:04:33.017884] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:04:33.018092] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-09T20:04:33.018144] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-09T20:04:33.018324] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-09T20:04:33.018383] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-09T20:04:33.385544] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:04:33.511345] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T20:04:33.596692] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-09T20:04:34.051237] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T20:04:34.136790] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T20:04:34.396687] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-09T20:04:35.094231] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:04:35.196714] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-09T20:04:35.738037] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T20:04:35.996762] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-09T20:04:36.796760] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-09T20:04:37.409697] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T20:04:37.521885] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T20:04:37.596721] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-09T20:04:38.396759] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-09T20:04:38.967746] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T20:04:39.196701] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-09T20:04:39.996764] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-09T20:04:40.454256] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-09T20:04:40.491601] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T20:04:40.688219] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T20:04:40.796724] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-09T20:04:41.411297] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T20:04:41.596763] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-09T20:04:42.396773] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-09T20:04:43.085561] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T20:04:43.196732] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-09T20:04:43.481818] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-09T20:04:43.649688] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-09T20:04:43.996784] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-09T20:04:44.796774] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-09T20:04:45.596715] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-09T20:04:45.982622] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-09T20:04:46.016233] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T20:04:46.319722] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T20:04:46.396739] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-09T20:04:47.196709] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-09T20:04:47.987331] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T20:04:47.996756] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-09T20:04:48.796683] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-09T20:04:48.869630] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-09T20:04:49.233851] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T20:04:49.376380] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T20:04:49.596690] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-09T20:04:50.396755] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-09T20:04:51.036247] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T20:04:51.111484] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T20:04:51.115562] [INFO ] [REMOTE ] MC: Full fetch complete (62638 records). [2025-10-09T20:04:51.115731] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-09T20:04:51.202012] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-09T20:04:51.513882] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-09T20:04:51.513991] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-09T20:04:51.514951] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-09T20:04:51.515016] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-09T20:04:51.516327] [DEBUG] [LOCAL ] MC: Trimmed 62638 records to 44235 (keeping 200 days of data) [2025-10-09T20:04:51.794546] [DEBUG] [LOCAL ] MC: Primary data saved (44235 records). [2025-10-09T20:04:51.794723] [INFO ] [MAIN ] MC: Full history saved. [2025-10-09T20:04:51.795404] [INFO ] [MAIN ] Update Progress: 1312/2373 symbols completed. MC took 41.2s. Estimated remaining: 2h 29m 27s. Rate: 7.1 symbols/min [2025-10-09T20:04:51.967105] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:04:51.996762] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-09T20:04:52.014020] [DEBUG] [LOCAL ] MCK: Loaded 38873 existing records from primary storage. [2025-10-09T20:04:52.014363] [INFO ] [MAIN ] MCK: Loaded 38873 existing records. [2025-10-09T20:04:52.157687] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T20:04:52.235022] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:04:52.235307] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-09T20:04:52.235357] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-09T20:04:52.235681] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-09T20:04:52.235740] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-09T20:04:52.586312] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:04:52.772601] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T20:04:52.796742] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-09T20:04:53.596729] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-09T20:04:54.325399] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T20:04:54.396717] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-09T20:04:55.196728] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-09T20:04:55.482927] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T20:04:55.967968] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-09T20:04:55.969525] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T20:04:55.979154] [INFO ] [REMOTE ] MCB: Full fetch complete (16354 records). [2025-10-09T20:04:55.979941] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-09T20:04:56.001937] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-09T20:04:56.348094] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-09T20:04:56.348188] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-09T20:04:56.348561] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-09T20:04:56.348603] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-09T20:04:56.349182] [DEBUG] [LOCAL ] MCB: Trimmed 16354 records to 11314 (keeping 200 days of data) [2025-10-09T20:04:56.418424] [DEBUG] [LOCAL ] MCB: Primary data saved (11314 records). [2025-10-09T20:04:56.418564] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-09T20:04:56.418672] [INFO ] [MAIN ] Update Progress: 1313/2373 symbols completed. MCB took 31.0s. Estimated remaining: 2h 29m 15s. Rate: 7.1 symbols/min [2025-10-09T20:04:56.585277] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:04:56.595078] [DEBUG] [LOCAL ] MCN: Loaded 8177 existing records from primary storage. [2025-10-09T20:04:56.595300] [INFO ] [MAIN ] MCN: Loaded 8177 existing records. [2025-10-09T20:04:56.716033] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T20:04:56.780173] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:04:56.780390] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-09T20:04:56.780438] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-09T20:04:56.780718] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-09T20:04:56.780775] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-09T20:04:56.801920] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-09T20:04:57.136182] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:04:57.445399] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T20:04:57.596782] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-09T20:04:58.396737] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-09T20:04:58.873608] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T20:04:59.133697] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T20:04:59.196681] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-09T20:04:59.996727] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-09T20:05:00.637909] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T20:05:00.796733] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-09T20:05:00.932176] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T20:05:01.596708] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-09T20:05:02.396771] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-09T20:05:02.935455] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T20:05:03.197188] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-09T20:05:03.200466] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T20:05:03.453266] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T20:05:03.996723] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-09T20:05:04.796751] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-09T20:05:05.362357] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-09T20:05:05.540254] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T20:05:05.596721] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-09T20:05:05.613258] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T20:05:06.327054] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:05:06.328308] [INFO ] [REMOTE ] MCI: Full fetch complete (9990 records). [2025-10-09T20:05:06.328382] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-09T20:05:06.401900] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-09T20:05:06.690991] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-09T20:05:06.691074] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-09T20:05:06.691316] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-09T20:05:06.691356] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-09T20:05:06.691887] [DEBUG] [LOCAL ] MCI: Trimmed 9990 records to 6510 (keeping 200 days of data) [2025-10-09T20:05:06.733752] [DEBUG] [LOCAL ] MCI: Primary data saved (6510 records). [2025-10-09T20:05:06.733897] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-09T20:05:06.734000] [INFO ] [MAIN ] Update Progress: 1314/2373 symbols completed. MCI took 34.1s. Estimated remaining: 2h 29m 8s. Rate: 7.1 symbols/min [2025-10-09T20:05:06.902463] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:05:06.943454] [DEBUG] [LOCAL ] MCO: Loaded 39229 existing records from primary storage. [2025-10-09T20:05:06.943808] [INFO ] [MAIN ] MCO: Loaded 39229 existing records. [2025-10-09T20:05:07.118522] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:05:07.118833] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-09T20:05:07.118900] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-09T20:05:07.119187] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-09T20:05:07.119265] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-09T20:05:07.201783] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-09T20:05:07.476529] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:05:07.996764] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-09T20:05:08.100896] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T20:05:08.796743] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-09T20:05:09.184919] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T20:05:09.418939] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T20:05:09.596736] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-09T20:05:09.962498] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T20:05:10.396740] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-09T20:05:11.196722] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-09T20:05:11.591770] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T20:05:11.782390] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-09T20:05:11.813419] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-09T20:05:11.996722] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-09T20:05:12.796751] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-09T20:05:12.825775] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T20:05:13.596736] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-09T20:05:14.177330] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T20:05:14.182330] [INFO ] [REMOTE ] MCD: Full fetch complete (77030 records). [2025-10-09T20:05:14.182464] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-09T20:05:14.398836] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T20:05:14.398940] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-09T20:05:14.402924] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T20:05:14.401411] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:05:14.410795] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:05:14.411138] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-09T20:05:14.411334] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-09T20:05:14.411392] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-09T20:05:14.411457] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-09T20:05:14.411883] [INFO ] [MAIN ] Update Progress: 1315/2373 symbols completed. MCD took 46.1s. Estimated remaining: 2h 28m 59s. Rate: 7.1 symbols/min [2025-10-09T20:05:14.617061] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:05:14.628074] [DEBUG] [LOCAL ] MCR: Loaded 8911 existing records from primary storage. [2025-10-09T20:05:14.628324] [INFO ] [MAIN ] MCR: Loaded 8911 existing records. [2025-10-09T20:05:14.800007] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:05:14.800240] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-09T20:05:14.800294] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-09T20:05:14.800473] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-09T20:05:14.800529] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-09T20:05:15.097905] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:05:15.183016] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:05:15.196678] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-09T20:05:15.800259] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T20:05:15.996727] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-09T20:05:16.755059] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T20:05:16.796691] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-09T20:05:17.596735] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-09T20:05:18.150363] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T20:05:18.154309] [INFO ] [REMOTE ] MCK: Full fetch complete (56894 records). [2025-10-09T20:05:18.154427] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-09T20:05:18.401961] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-09T20:05:18.614541] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-09T20:05:18.614741] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-09T20:05:18.615835] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-09T20:05:18.615909] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-09T20:05:18.617260] [DEBUG] [LOCAL ] MCK: Trimmed 56894 records to 39077 (keeping 200 days of data) [2025-10-09T20:05:18.906304] [DEBUG] [LOCAL ] MCK: Primary data saved (39077 records). [2025-10-09T20:05:18.906461] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-09T20:05:18.906548] [INFO ] [MAIN ] Update Progress: 1316/2373 symbols completed. MCK took 27.1s. Estimated remaining: 2h 28m 48s. Rate: 7.1 symbols/min [2025-10-09T20:05:19.114788] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:05:19.150047] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T20:05:19.148004] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T20:05:19.179895] [DEBUG] [LOCAL ] MCS: Loaded 20952 existing records from primary storage. [2025-10-09T20:05:19.180170] [INFO ] [MAIN ] MCS: Loaded 20952 existing records. [2025-10-09T20:05:19.202874] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-09T20:05:19.361060] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:05:19.361280] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-09T20:05:19.361326] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-09T20:05:19.361527] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-09T20:05:19.361584] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-09T20:05:19.715364] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:05:19.996713] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-09T20:05:20.792716] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T20:05:20.796703] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-09T20:05:20.833585] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T20:05:21.538005] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T20:05:21.596726] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-09T20:05:22.165383] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T20:05:22.396710] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-09T20:05:23.044961] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:05:23.047151] [INFO ] [REMOTE ] MCN: Full fetch complete (11695 records). [2025-10-09T20:05:23.047587] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-09T20:05:23.201592] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-09T20:05:23.413984] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-09T20:05:23.414096] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-09T20:05:23.414525] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-09T20:05:23.414600] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-09T20:05:23.415321] [DEBUG] [LOCAL ] MCN: Trimmed 11695 records to 8218 (keeping 200 days of data) [2025-10-09T20:05:23.468205] [DEBUG] [LOCAL ] MCN: Primary data saved (8218 records). [2025-10-09T20:05:23.468352] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-09T20:05:23.468443] [INFO ] [MAIN ] Update Progress: 1317/2373 symbols completed. MCN took 27.0s. Estimated remaining: 2h 28m 36s. Rate: 7.1 symbols/min [2025-10-09T20:05:23.996685] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-09T20:05:24.375300] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T20:05:24.796716] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-09T20:05:25.468243] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T20:05:25.596685] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-09T20:05:25.840170] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T20:05:26.396721] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-09T20:05:27.164605] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T20:05:27.196673] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-09T20:05:27.363567] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T20:05:27.684317] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T20:05:27.996723] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-09T20:05:28.796694] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-09T20:05:28.830499] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T20:05:29.596704] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-09T20:05:29.847437] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T20:05:30.396740] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-09T20:05:30.992082] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T20:05:31.198626] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-09T20:05:31.201538] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T20:05:31.996714] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-09T20:05:32.506898] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T20:05:32.796756] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-09T20:05:33.118868] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T20:05:33.596794] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-09T20:05:34.396703] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-09T20:05:34.520526] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T20:05:34.576129] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T20:05:35.173577] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T20:05:35.196676] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-09T20:05:35.999413] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-09T20:05:36.001563] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T20:05:36.707012] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-09T20:05:36.796770] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-09T20:05:37.596714] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-09T20:05:37.679315] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T20:05:38.396786] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-09T20:05:38.807369] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T20:05:38.978272] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T20:05:39.196779] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-09T20:05:39.996724] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-09T20:05:40.652052] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T20:05:40.720697] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T20:05:40.796702] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-09T20:05:41.596807] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-09T20:05:42.373226] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T20:05:42.376945] [INFO ] [REMOTE ] MCO: Full fetch complete (57260 records). [2025-10-09T20:05:42.377042] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-09T20:05:42.409126] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-09T20:05:42.773811] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-09T20:05:42.773937] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-09T20:05:42.782973] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-09T20:05:42.789601] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T20:05:42.789044] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-09T20:05:42.796632] [DEBUG] [LOCAL ] MCO: Trimmed 57260 records to 39546 (keeping 200 days of data) [2025-10-09T20:05:43.022369] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T20:05:43.026703] [INFO ] [REMOTE ] MCR: Full fetch complete (14062 records). [2025-10-09T20:05:43.027520] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-09T20:05:43.198252] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-09T20:05:43.423619] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-09T20:05:43.424066] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-09T20:05:43.424811] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-09T20:05:43.425152] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-09T20:05:43.427566] [DEBUG] [LOCAL ] MCR: Trimmed 14062 records to 8949 (keeping 200 days of data) [2025-10-09T20:05:43.493171] [DEBUG] [LOCAL ] MCO: Primary data saved (39546 records). [2025-10-09T20:05:43.494986] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-09T20:05:43.495148] [INFO ] [MAIN ] Update Progress: 1318/2373 symbols completed. MCO took 36.8s. Estimated remaining: 2h 28m 37s. Rate: 7.1 symbols/min [2025-10-09T20:05:43.498237] [DEBUG] [LOCAL ] MCR: Primary data saved (8949 records). [2025-10-09T20:05:43.498323] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-09T20:05:43.498403] [INFO ] [MAIN ] Update Progress: 1319/2373 symbols completed. MCR took 29.1s. Estimated remaining: 2h 28m 22s. Rate: 7.1 symbols/min [2025-10-09T20:05:44.273870] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T20:05:44.279535] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-09T20:05:45.322077] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T20:05:45.327158] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-09T20:05:46.403985] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T20:05:46.406366] [INFO ] [REMOTE ] MCS: Full fetch complete (30528 records). [2025-10-09T20:05:46.406437] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-09T20:05:46.779303] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-09T20:05:46.779389] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-09T20:05:46.780048] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-09T20:05:46.780111] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-09T20:05:46.780863] [DEBUG] [LOCAL ] MCS: Trimmed 30528 records to 21106 (keeping 200 days of data) [2025-10-09T20:05:46.913485] [DEBUG] [LOCAL ] MCS: Primary data saved (21106 records). [2025-10-09T20:05:46.913620] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-09T20:05:46.913742] [INFO ] [MAIN ] Update Progress: 1320/2373 symbols completed. MCS took 28.0s. Estimated remaining: 2h 28m 9s. Rate: 7.1 symbols/min [2025-10-09T20:05:47.514950] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:05:47.657013] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:05:47.633552] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:05:47.738271] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:05:47.753147] [DEBUG] [LOCAL ] MDST: Loaded 5734 existing records from primary storage. [2025-10-09T20:05:47.753772] [INFO ] [MAIN ] MDST: Loaded 5734 existing records. [2025-10-09T20:05:47.809665] [DEBUG] [LOCAL ] MCY: Loaded 23972 existing records from primary storage. [2025-10-09T20:05:47.837715] [INFO ] [MAIN ] MCY: Loaded 23972 existing records. [2025-10-09T20:05:48.122826] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:05:48.119606] [DEBUG] [LOCAL ] MD: Loaded 38488 existing records from primary storage. [2025-10-09T20:05:48.153018] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-09T20:05:48.152919] [INFO ] [MAIN ] MD: Loaded 38488 existing records. [2025-10-09T20:05:48.195411] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-09T20:05:48.198592] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:05:48.209357] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-09T20:05:48.195344] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-09T20:05:48.218905] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-09T20:05:48.233062] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-09T20:05:48.310425] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-09T20:05:48.260998] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-09T20:05:48.399283] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-09T20:05:48.442063] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-09T20:05:48.668707] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:05:48.734179] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-09T20:05:48.785730] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-09T20:05:48.875199] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-09T20:05:48.874050] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:05:48.906625] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-09T20:05:48.986953] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-09T20:05:49.052169] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-09T20:05:49.185020] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-09T20:05:49.272962] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-09T20:05:49.672391] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:05:49.711999] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:05:49.722698] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-09T20:05:49.752160] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-09T20:05:50.133628] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:05:50.149632] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-09T20:05:50.154748] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:05:50.155763] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-09T20:05:50.538013] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T20:05:50.539967] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-09T20:05:50.790093] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T20:05:50.795991] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-09T20:05:51.018764] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T20:05:51.020916] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-09T20:05:51.231373] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T20:05:51.242293] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-09T20:05:51.462248] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T20:05:51.624735] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T20:05:51.996702] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-09T20:05:52.080774] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T20:05:52.596246] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T20:05:52.796716] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-09T20:05:53.597182] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-09T20:05:53.602962] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T20:05:54.103386] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T20:05:54.362400] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:05:54.396719] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-09T20:05:55.196763] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-09T20:05:55.920276] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T20:05:55.996683] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-09T20:05:56.796711] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-09T20:05:56.825846] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T20:05:57.422597] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T20:05:57.596745] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-09T20:05:57.987762] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-09T20:05:58.272087] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T20:05:58.396772] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-09T20:05:59.196733] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-09T20:05:59.497173] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T20:05:59.996735] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-09T20:06:00.655922] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T20:06:00.769379] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T20:06:00.796682] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-09T20:06:01.596734] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-09T20:06:02.396703] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-09T20:06:02.790420] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-09T20:06:03.004570] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T20:06:03.196704] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-09T20:06:03.578341] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T20:06:03.996792] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-09T20:06:04.651433] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T20:06:04.679718] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T20:06:04.796743] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-09T20:06:05.596731] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-09T20:06:06.396703] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-09T20:06:06.458087] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T20:06:07.196735] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-09T20:06:07.339774] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T20:06:07.906097] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T20:06:07.996694] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-09T20:06:08.653325] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T20:06:08.796697] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-09T20:06:09.104925] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T20:06:09.243903] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T20:06:09.596747] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-09T20:06:10.396693] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-09T20:06:10.520315] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T20:06:11.196690] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-09T20:06:11.996687] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-09T20:06:12.118006] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T20:06:12.273869] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T20:06:12.277585] [INFO ] [REMOTE ] MD: Full fetch complete (55148 records). [2025-10-09T20:06:12.277717] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-09T20:06:12.661419] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-09T20:06:12.661521] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-09T20:06:12.662610] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-09T20:06:12.662699] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-09T20:06:12.663955] [DEBUG] [LOCAL ] MD: Trimmed 55148 records to 38768 (keeping 200 days of data) [2025-10-09T20:06:12.829374] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-09T20:06:12.895391] [DEBUG] [LOCAL ] MD: Primary data saved (38768 records). [2025-10-09T20:06:12.895521] [INFO ] [MAIN ] MD: Full history saved. [2025-10-09T20:06:12.895690] [INFO ] [MAIN ] Update Progress: 1321/2373 symbols completed. MD took 26.0s. Estimated remaining: 2h 28m 15s. Rate: 7.1 symbols/min [2025-10-09T20:06:13.064318] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:06:13.102605] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T20:06:13.121967] [DEBUG] [LOCAL ] MDU: Loaded 47997 existing records from primary storage. [2025-10-09T20:06:13.122316] [INFO ] [MAIN ] MDU: Loaded 47997 existing records. [2025-10-09T20:06:13.294732] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:06:13.294929] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-09T20:06:13.294977] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-09T20:06:13.295197] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-09T20:06:13.295254] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-09T20:06:13.607137] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-09T20:06:13.650529] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:06:14.292352] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T20:06:14.396675] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-09T20:06:14.525130] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T20:06:15.196723] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-09T20:06:15.996751] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-09T20:06:16.052864] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T20:06:16.796698] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-09T20:06:16.810736] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T20:06:17.107687] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T20:06:17.484595] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T20:06:17.596736] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-09T20:06:18.168737] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T20:06:18.170013] [INFO ] [REMOTE ] MDST: Full fetch complete (8606 records). [2025-10-09T20:06:18.170085] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-09T20:06:18.401803] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-09T20:06:18.578358] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-09T20:06:18.578453] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-09T20:06:18.578793] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-09T20:06:18.578863] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-09T20:06:18.579342] [DEBUG] [LOCAL ] MDST: Trimmed 8606 records to 5842 (keeping 200 days of data) [2025-10-09T20:06:18.623623] [DEBUG] [LOCAL ] MDST: Primary data saved (5842 records). [2025-10-09T20:06:18.623814] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-09T20:06:18.623916] [INFO ] [MAIN ] Update Progress: 1322/2373 symbols completed. MDST took 31.7s. Estimated remaining: 2h 28m 4s. Rate: 7.1 symbols/min [2025-10-09T20:06:18.804474] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:06:18.815085] [DEBUG] [LOCAL ] MDV: Loaded 8529 existing records from primary storage. [2025-10-09T20:06:18.815282] [INFO ] [MAIN ] MDV: Loaded 8529 existing records. [2025-10-09T20:06:18.988621] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:06:18.988807] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-09T20:06:18.988857] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-09T20:06:18.989033] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-09T20:06:18.989091] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-09T20:06:19.202849] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-09T20:06:19.337129] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:06:19.996706] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-09T20:06:20.307919] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T20:06:20.311790] [INFO ] [REMOTE ] MCY: Full fetch complete (41168 records). [2025-10-09T20:06:20.312008] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-09T20:06:20.524556] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T20:06:20.667950] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T20:06:20.787607] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-09T20:06:20.787746] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-09T20:06:20.788511] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-09T20:06:20.788554] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-09T20:06:20.789574] [DEBUG] [LOCAL ] MCY: Trimmed 41168 records to 24125 (keeping 200 days of data) [2025-10-09T20:06:20.846070] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-09T20:06:20.953687] [DEBUG] [LOCAL ] MCY: Primary data saved (24125 records). [2025-10-09T20:06:20.953847] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-09T20:06:20.953962] [INFO ] [MAIN ] Update Progress: 1323/2373 symbols completed. MCY took 34.0s. Estimated remaining: 2h 27m 51s. Rate: 7.1 symbols/min [2025-10-09T20:06:21.156098] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:06:21.174084] [DEBUG] [LOCAL ] MEC: Loaded 16257 existing records from primary storage. [2025-10-09T20:06:21.174359] [INFO ] [MAIN ] MEC: Loaded 16257 existing records. [2025-10-09T20:06:21.359508] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:06:21.359758] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-09T20:06:21.359812] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-09T20:06:21.360026] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-09T20:06:21.360102] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-09T20:06:21.602017] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-09T20:06:21.729476] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:06:22.396719] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-09T20:06:22.476557] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T20:06:22.994783] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T20:06:23.157203] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T20:06:23.196689] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-09T20:06:23.996757] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-09T20:06:24.568495] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T20:06:24.796741] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-09T20:06:25.041953] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T20:06:25.423793] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T20:06:25.596718] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-09T20:06:26.396713] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-09T20:06:27.199871] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-09T20:06:27.206098] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T20:06:27.306861] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T20:06:27.996716] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-09T20:06:28.649782] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T20:06:28.654420] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-09T20:06:28.654553] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-09T20:06:28.802952] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-09T20:06:28.891624] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T20:06:29.164383] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-09T20:06:29.164537] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-09T20:06:29.166139] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-09T20:06:29.166247] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-09T20:06:29.168523] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 54068 (keeping 200 days of data) [2025-10-09T20:06:29.624865] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-09T20:06:29.707112] [DEBUG] [LOCAL ] MDT: Primary data saved (54068 records). [2025-10-09T20:06:29.707547] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-09T20:06:29.707938] [INFO ] [MAIN ] Update Progress: 1324/2373 symbols completed. MDT took 42.8s. Estimated remaining: 2h 27m 43s. Rate: 7.1 symbols/min [2025-10-09T20:06:29.971330] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:06:29.996867] [DEBUG] [LOCAL ] MED: Loaded 21379 existing records from primary storage. [2025-10-09T20:06:29.997176] [INFO ] [MAIN ] MED: Loaded 21379 existing records. [2025-10-09T20:06:30.190307] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:06:30.190539] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-09T20:06:30.190589] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-09T20:06:30.190874] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-09T20:06:30.190935] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-09T20:06:30.374168] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T20:06:30.397165] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-09T20:06:30.602943] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:06:30.627916] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T20:06:31.196683] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-09T20:06:31.567090] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T20:06:31.996783] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-09T20:06:32.599463] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T20:06:32.796738] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-09T20:06:33.021052] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T20:06:33.596787] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-09T20:06:34.224104] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T20:06:34.396681] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-09T20:06:34.480836] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T20:06:35.196738] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-09T20:06:35.419567] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T20:06:35.996756] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-09T20:06:36.377994] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T20:06:36.749443] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T20:06:36.796711] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-09T20:06:37.508187] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T20:06:37.596738] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-09T20:06:38.396716] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-09T20:06:38.771524] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T20:06:39.196698] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-09T20:06:39.440152] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T20:06:39.996679] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-09T20:06:40.287617] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T20:06:40.796776] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-09T20:06:41.265638] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T20:06:41.586865] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T20:06:41.596675] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-09T20:06:42.275298] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T20:06:42.396708] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-09T20:06:43.064361] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T20:06:43.196761] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-09T20:06:43.996751] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-09T20:06:44.107517] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T20:06:44.796727] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-09T20:06:45.115992] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T20:06:45.596751] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-09T20:06:45.844321] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T20:06:46.396735] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-09T20:06:47.095067] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T20:06:47.197927] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-09T20:06:47.199805] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T20:06:47.884436] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T20:06:47.885704] [INFO ] [REMOTE ] MDV: Full fetch complete (11783 records). [2025-10-09T20:06:47.885778] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-09T20:06:48.002231] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-09T20:06:48.254637] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-09T20:06:48.254750] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-09T20:06:48.255081] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-09T20:06:48.255121] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-09T20:06:48.255561] [DEBUG] [LOCAL ] MDV: Trimmed 11783 records to 8589 (keeping 200 days of data) [2025-10-09T20:06:48.309327] [DEBUG] [LOCAL ] MDV: Primary data saved (8589 records). [2025-10-09T20:06:48.309465] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-09T20:06:48.309558] [INFO ] [MAIN ] Update Progress: 1325/2373 symbols completed. MDV took 29.7s. Estimated remaining: 2h 27m 42s. Rate: 7.1 symbols/min [2025-10-09T20:06:48.484247] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:06:48.519536] [DEBUG] [LOCAL ] MEG: Loaded 31440 existing records from primary storage. [2025-10-09T20:06:48.519864] [INFO ] [MAIN ] MEG: Loaded 31440 existing records. [2025-10-09T20:06:48.703047] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:06:48.703283] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-09T20:06:48.703332] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-09T20:06:48.703557] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-09T20:06:48.703616] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-09T20:06:48.802026] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-09T20:06:49.070204] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:06:49.254528] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T20:06:49.259070] [INFO ] [REMOTE ] MDU: Full fetch complete (70374 records). [2025-10-09T20:06:49.259187] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-09T20:06:49.598224] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-09T20:06:49.646172] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T20:06:49.664271] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-09T20:06:49.666501] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-09T20:06:49.667880] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-09T20:06:49.668086] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-09T20:06:49.668005] [INFO ] [REMOTE ] MEC: Full fetch complete (22782 records). [2025-10-09T20:06:49.668379] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-09T20:06:49.745830] [DEBUG] [LOCAL ] MDU: Trimmed 70374 records to 48351 (keeping 200 days of data) [2025-10-09T20:06:50.190544] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-09T20:06:50.190971] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-09T20:06:50.191816] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-09T20:06:50.192158] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-09T20:06:50.195525] [DEBUG] [LOCAL ] MEC: Trimmed 22782 records to 16410 (keeping 200 days of data) [2025-10-09T20:06:50.401565] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-09T20:06:50.474102] [DEBUG] [LOCAL ] MEC: Primary data saved (16410 records). [2025-10-09T20:06:50.474256] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-09T20:06:50.474346] [INFO ] [MAIN ] Update Progress: 1326/2373 symbols completed. MEC took 29.5s. Estimated remaining: 2h 27m 29s. Rate: 7.1 symbols/min [2025-10-09T20:06:50.655530] [DEBUG] [LOCAL ] MDU: Primary data saved (48351 records). [2025-10-09T20:06:50.674471] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:06:50.674670] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-09T20:06:50.674844] [INFO ] [MAIN ] Update Progress: 1327/2373 symbols completed. MDU took 37.8s. Estimated remaining: 2h 27m 14s. Rate: 7.1 symbols/min [2025-10-09T20:06:50.859630] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:06:50.860192] [DEBUG] [LOCAL ] MEGI: Loaded 20022 existing records from primary storage. [2025-10-09T20:06:50.860759] [INFO ] [MAIN ] MEGI: Loaded 20022 existing records. [2025-10-09T20:06:51.059248] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:06:51.070177] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-09T20:06:51.091506] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-09T20:06:51.092718] [DEBUG] [LOCAL ] MEI: Loaded 31802 existing records from primary storage. [2025-10-09T20:06:51.093759] [INFO ] [MAIN ] MEI: Loaded 31802 existing records. [2025-10-09T20:06:51.095044] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T20:06:51.135582] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-09T20:06:51.167372] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-09T20:06:51.213723] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-09T20:06:51.428598] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:06:51.489387] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-09T20:06:51.511612] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-09T20:06:51.554970] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-09T20:06:51.568420] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-09T20:06:51.771178] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T20:06:51.752999] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:06:52.008245] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-09T20:06:52.047301] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:06:52.679501] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T20:06:52.796697] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-09T20:06:52.821619] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T20:06:53.596756] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-09T20:06:53.965806] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T20:06:54.396741] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-09T20:06:54.701866] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T20:06:55.196789] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-09T20:06:55.516620] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T20:06:55.969315] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T20:06:55.996686] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-09T20:06:56.796738] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-09T20:06:57.132242] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T20:06:57.596757] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-09T20:06:58.188369] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T20:06:58.396761] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-09T20:06:58.948028] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T20:06:59.196773] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-09T20:06:59.695011] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T20:06:59.996775] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-09T20:07:00.285094] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T20:07:00.796769] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-09T20:07:01.290879] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T20:07:01.565266] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T20:07:01.596704] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-09T20:07:02.396739] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-09T20:07:02.699264] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T20:07:03.116855] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T20:07:03.196701] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-09T20:07:03.996744] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-09T20:07:04.191236] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T20:07:04.796782] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-09T20:07:04.818733] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T20:07:05.579901] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T20:07:05.582024] [INFO ] [REMOTE ] MED: Full fetch complete (32276 records). [2025-10-09T20:07:05.582140] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-09T20:07:05.601874] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-09T20:07:05.968723] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-09T20:07:05.968810] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-09T20:07:05.969486] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-09T20:07:05.969526] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-09T20:07:05.970255] [DEBUG] [LOCAL ] MED: Trimmed 32276 records to 21505 (keeping 200 days of data) [2025-10-09T20:07:06.117856] [DEBUG] [LOCAL ] MED: Primary data saved (21505 records). [2025-10-09T20:07:06.118033] [INFO ] [MAIN ] MED: Full history saved. [2025-10-09T20:07:06.118167] [INFO ] [MAIN ] Update Progress: 1328/2373 symbols completed. MED took 36.4s. Estimated remaining: 2h 27m 11s. Rate: 7.1 symbols/min [2025-10-09T20:07:06.289124] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:07:06.340468] [DEBUG] [LOCAL ] MET: Loaded 53326 existing records from primary storage. [2025-10-09T20:07:06.340859] [INFO ] [MAIN ] MET: Loaded 53326 existing records. [2025-10-09T20:07:06.402552] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-09T20:07:06.517235] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:07:06.517441] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-09T20:07:06.517487] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-09T20:07:06.517785] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-09T20:07:06.517843] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-09T20:07:06.872925] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:07:07.200733] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-09T20:07:07.203080] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T20:07:07.312619] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T20:07:07.996696] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-09T20:07:08.140909] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T20:07:08.796749] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-09T20:07:09.248422] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T20:07:09.559545] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T20:07:09.596767] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-09T20:07:10.396766] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-09T20:07:10.844768] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T20:07:11.196743] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-09T20:07:11.996761] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-09T20:07:12.180667] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T20:07:12.298604] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T20:07:12.796757] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-09T20:07:13.193312] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T20:07:13.390801] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T20:07:13.596757] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-09T20:07:14.396815] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-09T20:07:14.504961] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T20:07:15.196698] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-09T20:07:15.229249] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T20:07:15.996693] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-09T20:07:16.372962] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T20:07:16.796728] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-09T20:07:17.596698] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-09T20:07:17.652210] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T20:07:18.210818] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T20:07:18.396710] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-09T20:07:18.695286] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T20:07:19.196745] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-09T20:07:19.562309] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T20:07:19.565843] [INFO ] [REMOTE ] MEG: Full fetch complete (47515 records). [2025-10-09T20:07:19.565938] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-09T20:07:19.976324] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-09T20:07:19.976570] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-09T20:07:19.977821] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-09T20:07:19.978005] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-09T20:07:19.979530] [DEBUG] [LOCAL ] MEG: Trimmed 47515 records to 31669 (keeping 200 days of data) [2025-10-09T20:07:20.039600] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-09T20:07:20.099205] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T20:07:20.217227] [DEBUG] [LOCAL ] MEG: Primary data saved (31669 records). [2025-10-09T20:07:20.217409] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-09T20:07:20.217512] [INFO ] [MAIN ] Update Progress: 1329/2373 symbols completed. MEG took 31.9s. Estimated remaining: 2h 27m 7s. Rate: 7.1 symbols/min [2025-10-09T20:07:20.388627] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:07:20.431753] [DEBUG] [LOCAL ] MFA: Loaded 45676 existing records from primary storage. [2025-10-09T20:07:20.432104] [INFO ] [MAIN ] MFA: Loaded 45676 existing records. [2025-10-09T20:07:20.609609] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:07:20.609907] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-09T20:07:20.609955] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-09T20:07:20.610193] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-09T20:07:20.610250] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-09T20:07:20.805732] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-09T20:07:20.993371] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:07:21.596816] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-09T20:07:21.840888] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T20:07:22.064715] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T20:07:22.396758] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-09T20:07:22.476810] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T20:07:22.479753] [INFO ] [REMOTE ] MEGI: Full fetch complete (29867 records). [2025-10-09T20:07:22.479945] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-09T20:07:23.034793] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-09T20:07:23.034918] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-09T20:07:23.035629] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-09T20:07:23.035727] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-09T20:07:23.036874] [DEBUG] [LOCAL ] MEGI: Trimmed 29867 records to 20095 (keeping 200 days of data) [2025-10-09T20:07:23.167511] [DEBUG] [LOCAL ] MEGI: Primary data saved (20095 records). [2025-10-09T20:07:23.167667] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-09T20:07:23.167829] [INFO ] [MAIN ] Update Progress: 1330/2373 symbols completed. MEGI took 32.7s. Estimated remaining: 2h 26m 54s. Rate: 7.1 symbols/min [2025-10-09T20:07:23.201461] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-09T20:07:23.353061] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:07:23.360853] [DEBUG] [LOCAL ] MFAN: Loaded 4377 existing records from primary storage. [2025-10-09T20:07:23.361077] [INFO ] [MAIN ] MFAN: Loaded 4377 existing records. [2025-10-09T20:07:23.553232] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:07:23.553476] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-09T20:07:23.553528] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-09T20:07:23.553824] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-09T20:07:23.553884] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-09T20:07:23.947182] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:07:23.996671] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-09T20:07:24.153584] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T20:07:24.805797] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-09T20:07:24.808438] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T20:07:25.324494] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T20:07:25.596736] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-09T20:07:26.396745] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-09T20:07:26.637425] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T20:07:26.679192] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-09T20:07:27.191813] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T20:07:27.200120] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-09T20:07:27.996722] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-09T20:07:28.626685] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T20:07:28.796782] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-09T20:07:29.329755] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T20:07:29.596748] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-09T20:07:30.396701] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-09T20:07:30.770871] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T20:07:30.775812] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T20:07:30.790289] [INFO ] [REMOTE ] MEI: Full fetch complete (45521 records). [2025-10-09T20:07:30.790621] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-09T20:07:31.189811] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-09T20:07:31.189910] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-09T20:07:31.190778] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-09T20:07:31.190843] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-09T20:07:31.192061] [DEBUG] [LOCAL ] MEI: Trimmed 45521 records to 32020 (keeping 200 days of data) [2025-10-09T20:07:31.243308] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-09T20:07:31.408228] [DEBUG] [LOCAL ] MEI: Primary data saved (32020 records). [2025-10-09T20:07:31.408404] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-09T20:07:31.408529] [INFO ] [MAIN ] Update Progress: 1331/2373 symbols completed. MEI took 40.7s. Estimated remaining: 2h 26m 46s. Rate: 7.1 symbols/min [2025-10-09T20:07:31.584563] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:07:31.591955] [DEBUG] [LOCAL ] MFAO: Loaded 3946 existing records from primary storage. [2025-10-09T20:07:31.592167] [INFO ] [MAIN ] MFAO: Loaded 3946 existing records. [2025-10-09T20:07:31.767684] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:07:31.767916] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-09T20:07:31.767964] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-09T20:07:31.768118] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-09T20:07:31.768174] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-09T20:07:32.005269] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-09T20:07:32.132593] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:07:32.158966] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T20:07:32.361361] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-09T20:07:32.796697] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-09T20:07:33.110464] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T20:07:33.596762] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-09T20:07:34.396762] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-09T20:07:34.534539] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T20:07:34.785952] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-09T20:07:35.196701] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-09T20:07:35.420507] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T20:07:35.645462] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T20:07:35.996742] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-09T20:07:36.527841] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T20:07:36.796732] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-09T20:07:37.441564] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T20:07:37.596743] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-09T20:07:38.396732] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-09T20:07:38.978808] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T20:07:39.196705] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-09T20:07:39.228243] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T20:07:39.996754] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-09T20:07:40.695840] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T20:07:40.796680] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-09T20:07:41.021013] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T20:07:41.181624] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-09T20:07:41.596725] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-09T20:07:42.396808] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-09T20:07:43.039555] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T20:07:43.196745] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-09T20:07:43.996745] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-09T20:07:44.295968] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T20:07:44.630284] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T20:07:44.796709] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-09T20:07:44.863398] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T20:07:45.358978] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T20:07:45.596738] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-09T20:07:46.396772] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-09T20:07:46.945782] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T20:07:46.975669] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T20:07:47.196753] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-09T20:07:47.661104] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:07:47.662432] [INFO ] [REMOTE ] MFAN: Full fetch complete (5864 records). [2025-10-09T20:07:47.662506] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-09T20:07:48.001880] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-09T20:07:48.073042] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-09T20:07:48.073130] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-09T20:07:48.073354] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-09T20:07:48.073420] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-09T20:07:48.073928] [DEBUG] [LOCAL ] MFAN: Trimmed 5864 records to 4401 (keeping 200 days of data) [2025-10-09T20:07:48.105091] [DEBUG] [LOCAL ] MFAN: Primary data saved (4401 records). [2025-10-09T20:07:48.105236] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-09T20:07:48.105333] [INFO ] [MAIN ] Update Progress: 1332/2373 symbols completed. MFAN took 24.9s. Estimated remaining: 2h 26m 44s. Rate: 7.1 symbols/min [2025-10-09T20:07:48.282727] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:07:48.333525] [DEBUG] [LOCAL ] MFC: Loaded 51103 existing records from primary storage. [2025-10-09T20:07:48.333869] [INFO ] [MAIN ] MFC: Loaded 51103 existing records. [2025-10-09T20:07:48.509108] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:07:48.509343] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-09T20:07:48.509390] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-09T20:07:48.509569] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-09T20:07:48.509607] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-09T20:07:48.801919] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-09T20:07:48.869453] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:07:49.353972] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T20:07:49.596719] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-09T20:07:50.396746] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-09T20:07:50.637910] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T20:07:50.642594] [INFO ] [REMOTE ] MET: Full fetch complete (77120 records). [2025-10-09T20:07:50.642748] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-09T20:07:50.950413] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T20:07:51.062004] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-09T20:07:51.062106] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-09T20:07:51.063187] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-09T20:07:51.063253] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-09T20:07:51.064746] [DEBUG] [LOCAL ] MET: Trimmed 77120 records to 53712 (keeping 200 days of data) [2025-10-09T20:07:51.182561] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T20:07:51.197087] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-09T20:07:51.196390] [INFO ] [REMOTE ] MFA: Full fetch complete (65334 records). [2025-10-09T20:07:51.199354] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-09T20:07:51.734402] [DEBUG] [LOCAL ] MET: Primary data saved (53712 records). [2025-10-09T20:07:51.744854] [INFO ] [MAIN ] MET: Full history saved. [2025-10-09T20:07:51.766052] [INFO ] [MAIN ] Update Progress: 1333/2373 symbols completed. MET took 45.6s. Estimated remaining: 2h 26m 31s. Rate: 7.1 symbols/min [2025-10-09T20:07:51.935053] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-09T20:07:51.940916] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-09T20:07:51.947241] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-09T20:07:51.952460] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-09T20:07:52.007986] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:07:52.008263] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-09T20:07:52.008811] [DEBUG] [LOCAL ] MFA: Trimmed 65334 records to 46023 (keeping 200 days of data) [2025-10-09T20:07:52.155238] [DEBUG] [LOCAL ] MFG: Loaded 49362 existing records from primary storage. [2025-10-09T20:07:52.156758] [INFO ] [MAIN ] MFG: Loaded 49362 existing records. [2025-10-09T20:07:52.407745] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:07:52.435212] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-09T20:07:52.435846] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-09T20:07:52.436483] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-09T20:07:52.436877] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-09T20:07:52.546887] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T20:07:52.799462] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-09T20:07:52.834732] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:07:52.893156] [DEBUG] [LOCAL ] MFA: Primary data saved (46023 records). [2025-10-09T20:07:52.893317] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-09T20:07:52.893431] [INFO ] [MAIN ] Update Progress: 1334/2373 symbols completed. MFA took 32.7s. Estimated remaining: 2h 26m 17s. Rate: 7.1 symbols/min [2025-10-09T20:07:53.063965] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:07:53.092975] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T20:07:53.114868] [DEBUG] [LOCAL ] MFM: Loaded 14800 existing records from primary storage. [2025-10-09T20:07:53.115121] [INFO ] [MAIN ] MFM: Loaded 14800 existing records. [2025-10-09T20:07:53.293606] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:07:53.298494] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-09T20:07:53.298587] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-09T20:07:53.299162] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-09T20:07:53.299343] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T20:07:53.299552] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-09T20:07:53.602064] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-09T20:07:53.700853] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:07:54.396728] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-09T20:07:55.185837] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T20:07:55.196675] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-09T20:07:55.235555] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T20:07:55.941954] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T20:07:55.996679] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-09T20:07:56.796746] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-09T20:07:56.836576] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T20:07:57.369296] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T20:07:57.596795] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-09T20:07:58.396744] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-09T20:07:58.422869] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T20:07:59.196716] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-09T20:07:59.703381] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T20:07:59.996724] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-09T20:08:00.021527] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T20:08:00.796753] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-09T20:08:01.364979] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T20:08:01.596777] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-09T20:08:01.705914] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T20:08:02.396724] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-09T20:08:03.196717] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-09T20:08:03.270063] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T20:08:03.314225] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T20:08:03.996776] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-09T20:08:04.798729] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-09T20:08:04.802138] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T20:08:04.967450] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T20:08:05.378618] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T20:08:05.596757] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-09T20:08:06.396783] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-09T20:08:07.082885] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T20:08:07.196780] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-09T20:08:07.260429] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T20:08:07.520816] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T20:08:07.996759] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-09T20:08:08.711569] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T20:08:08.796784] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-09T20:08:09.413356] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T20:08:09.596721] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-09T20:08:10.259576] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:08:10.396760] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-09T20:08:11.196720] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-09T20:08:11.791746] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T20:08:11.793040] [INFO ] [REMOTE ] MFAO: Full fetch complete (5429 records). [2025-10-09T20:08:11.793113] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-09T20:08:12.005919] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-09T20:08:12.172978] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-09T20:08:12.173111] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-09T20:08:12.173495] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-09T20:08:12.173560] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-09T20:08:12.173999] [DEBUG] [LOCAL ] MFAO: Trimmed 5429 records to 3989 (keeping 200 days of data) [2025-10-09T20:08:12.200028] [DEBUG] [LOCAL ] MFAO: Primary data saved (3989 records). [2025-10-09T20:08:12.200115] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-09T20:08:12.200311] [INFO ] [MAIN ] Update Progress: 1335/2373 symbols completed. MFAO took 40.8s. Estimated remaining: 2h 26m 17s. Rate: 7.1 symbols/min [2025-10-09T20:08:12.383576] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-09T20:08:12.404837] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:08:12.419967] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-09T20:08:12.420207] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-09T20:08:12.420400] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-09T20:08:12.420478] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-09T20:08:12.421007] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-09T20:08:12.421068] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-09T20:08:12.767370] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:08:12.796667] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-09T20:08:12.948158] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T20:08:12.950406] [INFO ] [REMOTE ] MFM: Full fetch complete (19673 records). [2025-10-09T20:08:12.950483] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-09T20:08:13.284729] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-09T20:08:13.319411] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-09T20:08:13.319495] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-09T20:08:13.319983] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-09T20:08:13.320047] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-09T20:08:13.320709] [DEBUG] [LOCAL ] MFM: Trimmed 19673 records to 14939 (keeping 200 days of data) [2025-10-09T20:08:13.408908] [DEBUG] [LOCAL ] MFM: Primary data saved (14939 records). [2025-10-09T20:08:13.409066] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-09T20:08:13.409194] [INFO ] [MAIN ] Update Progress: 1336/2373 symbols completed. MFM took 20.5s. Estimated remaining: 2h 26m 3s. Rate: 7.1 symbols/min [2025-10-09T20:08:13.577752] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:08:13.586088] [DEBUG] [LOCAL ] MFSG: Loaded 5540 existing records from primary storage. [2025-10-09T20:08:13.586287] [INFO ] [MAIN ] MFSG: Loaded 5540 existing records. [2025-10-09T20:08:13.606707] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-09T20:08:13.776042] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:08:13.776305] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-09T20:08:13.776357] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-09T20:08:13.776526] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-09T20:08:13.776584] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-09T20:08:14.134106] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:08:14.396785] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-09T20:08:15.130377] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T20:08:15.196808] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-09T20:08:15.558717] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-09T20:08:15.966233] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T20:08:15.996681] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-09T20:08:16.796748] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-09T20:08:17.053144] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-09T20:08:17.596741] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-09T20:08:17.744970] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T20:08:18.028585] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-09T20:08:18.396730] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-09T20:08:19.196748] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-09T20:08:19.996752] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-09T20:08:20.053354] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T20:08:20.429789] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T20:08:20.505130] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T20:08:20.796724] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-09T20:08:21.596764] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-09T20:08:22.044735] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T20:08:22.396695] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-09T20:08:22.772453] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T20:08:23.196745] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-09T20:08:23.507860] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-09T20:08:24.003943] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-09T20:08:24.010485] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T20:08:24.461956] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T20:08:24.796773] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-09T20:08:25.596775] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-09T20:08:25.847503] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-09T20:08:26.372683] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T20:08:26.396678] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-09T20:08:27.196783] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-09T20:08:27.428609] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-09T20:08:27.996744] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-09T20:08:28.087855] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T20:08:28.595834] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T20:08:28.796733] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-09T20:08:29.121338] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-09T20:08:29.596704] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-09T20:08:29.932260] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T20:08:30.396690] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-09T20:08:31.196734] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-09T20:08:31.597949] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-09T20:08:31.693717] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T20:08:31.996706] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-09T20:08:32.796806] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-09T20:08:33.392995] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T20:08:33.467487] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T20:08:33.596684] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-09T20:08:34.396761] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-09T20:08:34.736674] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T20:08:34.928752] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T20:08:34.932977] [INFO ] [REMOTE ] MFC: Full fetch complete (74128 records). [2025-10-09T20:08:34.933072] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-09T20:08:35.201843] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-09T20:08:35.317183] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-09T20:08:35.317256] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-09T20:08:35.318266] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-09T20:08:35.318351] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-09T20:08:35.320014] [DEBUG] [LOCAL ] MFC: Trimmed 74128 records to 51462 (keeping 200 days of data) [2025-10-09T20:08:35.634120] [DEBUG] [LOCAL ] MFC: Primary data saved (51462 records). [2025-10-09T20:08:35.634291] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-09T20:08:35.634430] [INFO ] [MAIN ] Update Progress: 1337/2373 symbols completed. MFC took 47.5s. Estimated remaining: 2h 26m 5s. Rate: 7.1 symbols/min [2025-10-09T20:08:35.802612] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:08:35.816403] [DEBUG] [LOCAL ] MFSI: Loaded 11732 existing records from primary storage. [2025-10-09T20:08:35.816619] [INFO ] [MAIN ] MFSI: Loaded 11732 existing records. [2025-10-09T20:08:35.990362] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:08:35.990547] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-09T20:08:35.990595] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-09T20:08:35.990807] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-09T20:08:35.990864] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-09T20:08:36.001779] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-09T20:08:36.339947] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:08:36.756277] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T20:08:36.782440] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T20:08:36.796670] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-09T20:08:37.329879] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T20:08:37.596798] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-09T20:08:38.276142] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T20:08:38.277335] [INFO ] [REMOTE ] MFSG: Full fetch complete (6376 records). [2025-10-09T20:08:38.277402] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-09T20:08:38.401878] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-09T20:08:38.629341] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-09T20:08:38.629423] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-09T20:08:38.629590] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-09T20:08:38.629628] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-09T20:08:38.630107] [DEBUG] [LOCAL ] MFSG: Trimmed 6376 records to 5647 (keeping 200 days of data) [2025-10-09T20:08:38.665059] [DEBUG] [LOCAL ] MFSG: Primary data saved (5647 records). [2025-10-09T20:08:38.665205] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-09T20:08:38.665293] [INFO ] [MAIN ] Update Progress: 1338/2373 symbols completed. MFSG took 25.3s. Estimated remaining: 2h 25m 53s. Rate: 7.1 symbols/min [2025-10-09T20:08:38.832673] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:08:38.837473] [DEBUG] [LOCAL ] MFSV: Loaded 2679 existing records from primary storage. [2025-10-09T20:08:38.837613] [INFO ] [MAIN ] MFSV: Loaded 2679 existing records. [2025-10-09T20:08:38.939855] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T20:08:39.024772] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:08:39.025133] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-09T20:08:39.025198] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-09T20:08:39.025423] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-09T20:08:39.025481] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-09T20:08:39.202021] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-09T20:08:39.373166] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:08:39.927809] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T20:08:39.996742] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-09T20:08:40.312529] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-09T20:08:40.796723] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-09T20:08:41.130843] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-09T20:08:41.596724] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-09T20:08:42.250724] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:08:42.251627] [INFO ] [REMOTE ] MFSB: Full fetch complete (1781 records). [2025-10-09T20:08:42.251720] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-09T20:08:42.406673] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-09T20:08:42.429792] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-09T20:08:42.430572] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:08:42.430638] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:08:42.430724] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-09T20:08:42.430779] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-09T20:08:42.430815] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-09T20:08:42.430869] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-09T20:08:42.430962] [INFO ] [MAIN ] Update Progress: 1339/2373 symbols completed. MFSB took 30.2s. Estimated remaining: 2h 25m 41s. Rate: 7.1 symbols/min [2025-10-09T20:08:42.627675] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:08:42.651215] [DEBUG] [LOCAL ] MG: Loaded 16154 existing records from primary storage. [2025-10-09T20:08:42.651538] [INFO ] [MAIN ] MG: Loaded 16154 existing records. [2025-10-09T20:08:42.832772] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:08:42.833038] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-09T20:08:42.833094] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-09T20:08:42.833299] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-09T20:08:42.833357] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-09T20:08:42.991477] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T20:08:43.188210] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:08:43.196678] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-09T20:08:43.996742] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-09T20:08:44.109404] [DEBUG] [REMOTE ] MFG: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-09T20:08:44.109768] [WARN ] [REMOTE ] MFG: No data returned for month 2025-10 [2025-10-09T20:08:44.109874] [FATAL] [REMOTE ] MFG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:08:44.109978] [FATAL] [MAIN ] MFG: Failed to fetch primary data. [2025-10-09T20:08:44.110040] [WARN ] [MAIN ] MFG: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:08:44.110100] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-09T20:08:44.110202] [DEBUG] [LOCAL ] MFG: No primary data file found to delete. [2025-10-09T20:08:44.110261] [INFO ] [LOCAL ] MFG: Starting deletion of derivative data. [2025-10-09T20:08:44.110498] [DEBUG] [LOCAL ] MFG: Deleted derivative data file. [2025-10-09T20:08:44.110594] [INFO ] [MAIN ] Update Progress: 1340/2373 symbols completed. MFG took 52.3s. Estimated remaining: 2h 25m 27s. Rate: 7.1 symbols/min [2025-10-09T20:08:44.277847] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:08:44.290804] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T20:08:44.338957] [DEBUG] [LOCAL ] MGA: Loaded 50675 existing records from primary storage. [2025-10-09T20:08:44.339326] [INFO ] [MAIN ] MGA: Loaded 50675 existing records. [2025-10-09T20:08:44.511998] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:08:44.512220] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-09T20:08:44.512267] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-09T20:08:44.512697] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-09T20:08:44.512803] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-09T20:08:44.801827] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-09T20:08:44.868062] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:08:45.292598] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T20:08:45.596705] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-09T20:08:46.185697] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T20:08:46.396761] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-09T20:08:46.786039] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T20:08:47.196769] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-09T20:08:47.873511] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T20:08:47.996728] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-09T20:08:48.796787] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-09T20:08:49.119303] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T20:08:49.596693] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-09T20:08:49.643156] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T20:08:50.145511] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T20:08:50.396713] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-09T20:08:50.817177] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-09T20:08:51.196749] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-09T20:08:51.765514] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T20:08:51.996751] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-09T20:08:52.494042] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T20:08:52.796755] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-09T20:08:53.596749] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-09T20:08:54.184715] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T20:08:54.396729] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-09T20:08:54.445892] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T20:08:55.001104] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T20:08:55.002706] [INFO ] [REMOTE ] MFSV: Full fetch complete (3381 records). [2025-10-09T20:08:55.002802] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-09T20:08:55.201893] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-09T20:08:55.366129] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-09T20:08:55.366225] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-09T20:08:55.366385] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-09T20:08:55.366426] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-09T20:08:55.366820] [DEBUG] [LOCAL ] MFSV: Trimmed 3381 records to 2715 (keeping 200 days of data) [2025-10-09T20:08:55.383718] [DEBUG] [LOCAL ] MFSV: Primary data saved (2715 records). [2025-10-09T20:08:55.383784] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-09T20:08:55.383858] [INFO ] [MAIN ] Update Progress: 1341/2373 symbols completed. MFSV took 16.7s. Estimated remaining: 2h 25m 21s. Rate: 7.1 symbols/min [2025-10-09T20:08:55.557484] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:08:55.565070] [DEBUG] [LOCAL ] MGF: Loaded 4286 existing records from primary storage. [2025-10-09T20:08:55.565316] [INFO ] [MAIN ] MGF: Loaded 4286 existing records. [2025-10-09T20:08:55.740849] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:08:55.741066] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-09T20:08:55.741124] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-09T20:08:55.741320] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-09T20:08:55.741378] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-09T20:08:56.000913] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-09T20:08:56.102165] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:08:56.147411] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T20:08:56.796774] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-09T20:08:57.408193] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T20:08:57.596714] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-09T20:08:57.629938] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T20:08:58.396705] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-09T20:08:58.684192] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T20:08:58.940274] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T20:08:59.196732] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-09T20:08:59.996693] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-09T20:09:00.072453] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-09T20:09:00.796798] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-09T20:09:01.476333] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T20:09:01.596812] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-09T20:09:01.655446] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T20:09:01.987193] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-09T20:09:02.396760] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-09T20:09:03.196780] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-09T20:09:03.800405] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T20:09:03.970981] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T20:09:03.996672] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-09T20:09:04.796738] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-09T20:09:05.596723] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-09T20:09:05.733832] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T20:09:05.789895] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T20:09:06.072881] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-09T20:09:06.396748] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-09T20:09:07.093394] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T20:09:07.196746] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-09T20:09:07.996750] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-09T20:09:08.527575] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T20:09:08.796745] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-09T20:09:08.851347] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T20:09:09.416250] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T20:09:09.596722] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-09T20:09:10.396817] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-09T20:09:11.204421] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-09T20:09:11.210569] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T20:09:11.403904] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T20:09:11.870022] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T20:09:11.996705] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-09T20:09:12.796707] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-09T20:09:13.420500] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T20:09:13.596728] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-09T20:09:13.636116] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T20:09:14.396730] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-09T20:09:14.462975] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T20:09:14.992637] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T20:09:15.196683] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-09T20:09:15.774876] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-09T20:09:15.996728] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-09T20:09:16.710891] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T20:09:16.796677] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-09T20:09:17.596744] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-09T20:09:17.737037] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-09T20:09:18.038424] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T20:09:18.396736] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-09T20:09:19.196719] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-09T20:09:19.220717] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T20:09:19.996685] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-09T20:09:20.193629] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T20:09:20.563432] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T20:09:20.796807] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-09T20:09:21.596706] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-09T20:09:21.678683] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T20:09:21.680905] [INFO ] [REMOTE ] MFSI: Full fetch complete (14159 records). [2025-10-09T20:09:21.681155] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-09T20:09:22.050717] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-09T20:09:22.050804] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-09T20:09:22.051223] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-09T20:09:22.051272] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-09T20:09:22.051848] [DEBUG] [LOCAL ] MFSI: Trimmed 14159 records to 11854 (keeping 200 days of data) [2025-10-09T20:09:22.122795] [DEBUG] [LOCAL ] MFSI: Primary data saved (11854 records). [2025-10-09T20:09:22.122933] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-09T20:09:22.123032] [INFO ] [MAIN ] Update Progress: 1342/2373 symbols completed. MFSI took 46.5s. Estimated remaining: 2h 25m 26s. Rate: 7.1 symbols/min [2025-10-09T20:09:22.288318] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:09:22.340385] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-09T20:09:22.340754] [INFO ] [MAIN ] MGM: Loaded 53607 existing records. [2025-10-09T20:09:22.402043] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-09T20:09:22.516533] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:09:22.516789] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-09T20:09:22.516839] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-09T20:09:22.517191] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-09T20:09:22.517250] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-09T20:09:22.915107] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:09:23.152107] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T20:09:23.153626] [INFO ] [REMOTE ] MGF: Full fetch complete (5879 records). [2025-10-09T20:09:23.153751] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-09T20:09:23.201911] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-09T20:09:23.692124] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-09T20:09:23.697495] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-09T20:09:23.724692] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-09T20:09:23.724876] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-09T20:09:23.725882] [DEBUG] [LOCAL ] MGF: Trimmed 5879 records to 4311 (keeping 200 days of data) [2025-10-09T20:09:23.729851] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-09T20:09:23.779349] [DEBUG] [LOCAL ] MGF: Primary data saved (4311 records). [2025-10-09T20:09:23.779511] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-09T20:09:23.779603] [INFO ] [MAIN ] Update Progress: 1343/2373 symbols completed. MGF took 28.4s. Estimated remaining: 2h 25m 13s. Rate: 7.1 symbols/min [2025-10-09T20:09:23.979531] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:09:23.989298] [DEBUG] [LOCAL ] MGR: Loaded 5606 existing records from primary storage. [2025-10-09T20:09:23.989534] [INFO ] [MAIN ] MGR: Loaded 5606 existing records. [2025-10-09T20:09:24.002581] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-09T20:09:24.182194] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:09:24.182564] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-09T20:09:24.182682] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-09T20:09:24.182988] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-09T20:09:24.183047] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-09T20:09:24.582433] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:09:24.796688] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-09T20:09:24.839501] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T20:09:25.596737] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-09T20:09:25.678948] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T20:09:25.683811] [INFO ] [REMOTE ] MGA: Full fetch complete (73677 records). [2025-10-09T20:09:25.683931] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-09T20:09:25.847015] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T20:09:26.097116] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-09T20:09:26.097200] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-09T20:09:26.098256] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-09T20:09:26.098321] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-09T20:09:26.099747] [DEBUG] [LOCAL ] MGA: Trimmed 73677 records to 51027 (keeping 200 days of data) [2025-10-09T20:09:26.399724] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-09T20:09:26.420387] [DEBUG] [LOCAL ] MGA: Primary data saved (51027 records). [2025-10-09T20:09:26.420471] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-09T20:09:26.421050] [INFO ] [MAIN ] Update Progress: 1344/2373 symbols completed. MGA took 42.3s. Estimated remaining: 2h 24m 60s. Rate: 7.1 symbols/min [2025-10-09T20:09:26.587901] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:09:26.597125] [DEBUG] [LOCAL ] MGRB: Loaded 4067 existing records from primary storage. [2025-10-09T20:09:26.597336] [INFO ] [MAIN ] MGRB: Loaded 4067 existing records. [2025-10-09T20:09:26.775662] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:09:26.775948] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-09T20:09:26.776003] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-09T20:09:26.776188] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-09T20:09:26.776244] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-09T20:09:27.130499] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T20:09:27.199883] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-09T20:09:27.214985] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:09:27.347243] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T20:09:27.996685] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-09T20:09:28.194616] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T20:09:28.196367] [INFO ] [REMOTE ] MG: Full fetch complete (23735 records). [2025-10-09T20:09:28.196448] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-09T20:09:28.607921] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-09T20:09:28.608018] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-09T20:09:28.608602] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-09T20:09:28.608689] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-09T20:09:28.609635] [DEBUG] [LOCAL ] MG: Trimmed 23735 records to 16256 (keeping 200 days of data) [2025-10-09T20:09:28.720471] [DEBUG] [LOCAL ] MG: Primary data saved (16256 records). [2025-10-09T20:09:28.720623] [INFO ] [MAIN ] MG: Full history saved. [2025-10-09T20:09:28.720763] [INFO ] [MAIN ] Update Progress: 1345/2373 symbols completed. MG took 46.3s. Estimated remaining: 2h 24m 47s. Rate: 7.1 symbols/min [2025-10-09T20:09:28.807065] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-09T20:09:28.858042] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T20:09:28.944428] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:09:28.949888] [DEBUG] [LOCAL ] MGRD: Loaded 2240 existing records from primary storage. [2025-10-09T20:09:28.950073] [INFO ] [MAIN ] MGRD: Loaded 2240 existing records. [2025-10-09T20:09:29.162879] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:09:29.163173] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-09T20:09:29.163250] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-09T20:09:29.163510] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-09T20:09:29.163592] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-09T20:09:29.601488] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-09T20:09:29.606034] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:09:30.202728] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T20:09:30.396701] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-09T20:09:30.436821] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T20:09:30.794529] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T20:09:31.196771] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-09T20:09:31.996718] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-09T20:09:32.533396] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T20:09:32.614586] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T20:09:32.796787] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-09T20:09:33.269849] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T20:09:33.596746] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-09T20:09:34.069897] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T20:09:34.396722] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-09T20:09:35.015800] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T20:09:35.196755] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-09T20:09:35.802684] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T20:09:35.996712] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-09T20:09:36.796723] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-09T20:09:37.174987] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T20:09:37.343429] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T20:09:37.596733] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-09T20:09:38.253462] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T20:09:38.396709] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-09T20:09:38.980394] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T20:09:39.196744] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-09T20:09:39.728227] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-09T20:09:39.996699] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-09T20:09:40.427038] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T20:09:40.796807] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-09T20:09:41.220833] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T20:09:41.596740] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-09T20:09:42.348047] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T20:09:42.396681] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-09T20:09:42.973140] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T20:09:43.196788] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-09T20:09:43.637806] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T20:09:43.996740] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-09T20:09:44.414983] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T20:09:44.796736] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-09T20:09:45.238214] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T20:09:45.596755] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-09T20:09:46.064561] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T20:09:46.065594] [INFO ] [REMOTE ] MGR: Full fetch complete (8014 records). [2025-10-09T20:09:46.065704] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-09T20:09:46.401907] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-09T20:09:46.462754] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-09T20:09:46.462825] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-09T20:09:46.463032] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-09T20:09:46.463071] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-09T20:09:46.463458] [DEBUG] [LOCAL ] MGR: Trimmed 8014 records to 5676 (keeping 200 days of data) [2025-10-09T20:09:46.500754] [DEBUG] [LOCAL ] MGR: Primary data saved (5676 records). [2025-10-09T20:09:46.500904] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-09T20:09:46.501005] [INFO ] [MAIN ] Update Progress: 1346/2373 symbols completed. MGR took 22.7s. Estimated remaining: 2h 24m 45s. Rate: 7.1 symbols/min [2025-10-09T20:09:46.672284] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:09:46.681803] [DEBUG] [LOCAL ] MGRE: Loaded 6697 existing records from primary storage. [2025-10-09T20:09:46.681999] [INFO ] [MAIN ] MGRE: Loaded 6697 existing records. [2025-10-09T20:09:46.854458] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:09:46.854691] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-09T20:09:46.854752] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-09T20:09:46.854962] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-09T20:09:46.855019] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-09T20:09:46.962493] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T20:09:47.210117] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-09T20:09:47.215916] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:09:47.996730] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-09T20:09:48.495126] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-09T20:09:48.796699] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-09T20:09:49.126722] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T20:09:49.377443] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T20:09:49.596748] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-09T20:09:50.021283] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T20:09:50.396759] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-09T20:09:51.196724] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-09T20:09:51.645834] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T20:09:51.996691] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-09T20:09:52.056275] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T20:09:52.631684] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T20:09:52.796747] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-09T20:09:53.145823] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-09T20:09:53.596709] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-09T20:09:54.396724] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-09T20:09:54.818130] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T20:09:55.196748] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-09T20:09:55.614470] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T20:09:55.836192] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T20:09:55.996725] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-09T20:09:56.659662] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T20:09:56.796719] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-09T20:09:57.207309] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-09T20:09:57.596734] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-09T20:09:58.165867] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T20:09:58.396779] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-09T20:09:58.858588] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T20:09:59.196732] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-09T20:09:59.996728] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-09T20:10:00.566367] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T20:10:00.796710] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-09T20:10:00.992024] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T20:10:01.354435] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:10:01.355256] [INFO ] [REMOTE ] MGRD: Full fetch complete (3501 records). [2025-10-09T20:10:01.355336] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-09T20:10:01.601913] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-09T20:10:01.745393] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-09T20:10:01.745499] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-09T20:10:01.745993] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-09T20:10:01.746065] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-09T20:10:01.746473] [DEBUG] [LOCAL ] MGRD: Trimmed 3501 records to 2259 (keeping 200 days of data) [2025-10-09T20:10:01.764521] [DEBUG] [LOCAL ] MGRD: Primary data saved (2259 records). [2025-10-09T20:10:01.764762] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-09T20:10:01.764948] [INFO ] [MAIN ] Update Progress: 1347/2373 symbols completed. MGRD took 33.0s. Estimated remaining: 2h 24m 42s. Rate: 7.1 symbols/min [2025-10-09T20:10:01.970554] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:02.105441] [DEBUG] [LOCAL ] MGY: Loaded 52395 existing records from primary storage. [2025-10-09T20:10:02.105927] [INFO ] [MAIN ] MGY: Loaded 52395 existing records. [2025-10-09T20:10:02.340767] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T20:10:02.344897] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:10:02.347606] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-09T20:10:02.347751] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-09T20:10:02.348157] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-09T20:10:02.348220] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-09T20:10:02.401967] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-09T20:10:02.716099] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:03.194588] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T20:10:03.197066] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-09T20:10:03.878551] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T20:10:03.996772] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-09T20:10:04.796736] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-09T20:10:05.351007] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T20:10:05.596687] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-09T20:10:06.073877] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-09T20:10:06.396728] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-09T20:10:06.805938] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-09T20:10:07.196697] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-09T20:10:07.674561] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T20:10:07.705690] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T20:10:07.996733] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-09T20:10:08.621503] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T20:10:08.622576] [INFO ] [REMOTE ] MGRE: Full fetch complete (9394 records). [2025-10-09T20:10:08.622682] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-09T20:10:08.802224] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-09T20:10:08.985946] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-09T20:10:08.986025] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-09T20:10:08.986288] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-09T20:10:08.986329] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-09T20:10:08.986781] [DEBUG] [LOCAL ] MGRE: Trimmed 9394 records to 6738 (keeping 200 days of data) [2025-10-09T20:10:09.029830] [DEBUG] [LOCAL ] MGRE: Primary data saved (6738 records). [2025-10-09T20:10:09.029992] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-09T20:10:09.030086] [INFO ] [MAIN ] Update Progress: 1348/2373 symbols completed. MGRE took 22.5s. Estimated remaining: 2h 24m 33s. Rate: 7.1 symbols/min [2025-10-09T20:10:09.194514] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:09.194741] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-09T20:10:09.194791] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-09T20:10:09.194900] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-09T20:10:09.194942] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-09T20:10:09.194982] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-09T20:10:09.195014] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-09T20:10:09.542541] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:09.596668] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-09T20:10:09.803874] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:10:09.804213] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-09T20:10:09.804307] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:10:09.804355] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-09T20:10:09.804390] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:10:09.804432] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-09T20:10:09.804488] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-09T20:10:09.804601] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-09T20:10:09.804701] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-09T20:10:09.804767] [INFO ] [MAIN ] Update Progress: 1349/2373 symbols completed. MH took 0.8s. Estimated remaining: 2h 24m 18s. Rate: 7.1 symbols/min [2025-10-09T20:10:09.987460] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:10.005022] [DEBUG] [LOCAL ] MHD: Loaded 12479 existing records from primary storage. [2025-10-09T20:10:10.005347] [INFO ] [MAIN ] MHD: Loaded 12479 existing records. [2025-10-09T20:10:10.205097] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:10:10.205306] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-09T20:10:10.205354] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-09T20:10:10.205637] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-09T20:10:10.205746] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-09T20:10:10.396770] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-09T20:10:10.587606] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:10.767739] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-09T20:10:10.772603] [INFO ] [REMOTE ] MGM: Full fetch complete (77604 records). [2025-10-09T20:10:10.772774] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-09T20:10:11.158504] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-09T20:10:11.158595] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-09T20:10:11.159691] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-09T20:10:11.159757] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-09T20:10:11.161318] [DEBUG] [LOCAL ] MGM: Trimmed 77604 records to 53997 (keeping 200 days of data) [2025-10-09T20:10:11.211688] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-09T20:10:11.223779] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T20:10:11.255079] [INFO ] [REMOTE ] MGRB: Full fetch complete (5823 records). [2025-10-09T20:10:11.256967] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-09T20:10:11.658722] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-09T20:10:11.659418] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-09T20:10:11.660328] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-09T20:10:11.660680] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-09T20:10:11.663838] [DEBUG] [LOCAL ] MGRB: Trimmed 5823 records to 4084 (keeping 200 days of data) [2025-10-09T20:10:11.778169] [DEBUG] [LOCAL ] MGRB: Primary data saved (4084 records). [2025-10-09T20:10:11.778938] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-09T20:10:11.779345] [INFO ] [MAIN ] Update Progress: 1350/2373 symbols completed. MGRB took 45.4s. Estimated remaining: 2h 24m 5s. Rate: 7.1 symbols/min [2025-10-09T20:10:11.966375] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:11.981104] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T20:10:11.995920] [DEBUG] [LOCAL ] MHF: Loaded 8688 existing records from primary storage. [2025-10-09T20:10:11.997185] [INFO ] [MAIN ] MHF: Loaded 8688 existing records. [2025-10-09T20:10:11.996998] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-09T20:10:12.196950] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:10:12.200283] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-09T20:10:12.201460] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-09T20:10:12.202764] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-09T20:10:12.203096] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-09T20:10:12.658734] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:12.674682] [DEBUG] [LOCAL ] MGM: Primary data saved (53997 records). [2025-10-09T20:10:12.674818] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-09T20:10:12.674949] [INFO ] [MAIN ] Update Progress: 1351/2373 symbols completed. MGM took 50.6s. Estimated remaining: 2h 23m 51s. Rate: 7.1 symbols/min [2025-10-09T20:10:12.803680] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-09T20:10:12.842298] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T20:10:12.900983] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:12.946633] [DEBUG] [LOCAL ] MHK: Loaded 42238 existing records from primary storage. [2025-10-09T20:10:12.946985] [INFO ] [MAIN ] MHK: Loaded 42238 existing records. [2025-10-09T20:10:13.155432] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:10:13.155689] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-09T20:10:13.155749] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-09T20:10:13.156232] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-09T20:10:13.156292] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-09T20:10:13.515158] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T20:10:13.530789] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:13.596674] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-09T20:10:14.396746] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-09T20:10:15.113585] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T20:10:15.196731] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-09T20:10:15.926617] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T20:10:16.000893] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-09T20:10:16.005891] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T20:10:16.796718] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-09T20:10:17.365269] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T20:10:17.596727] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-09T20:10:17.938309] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T20:10:18.396722] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-09T20:10:18.427412] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T20:10:19.196709] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-09T20:10:19.893962] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:10:19.996728] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-09T20:10:20.053557] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T20:10:20.796691] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-09T20:10:20.933610] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T20:10:21.596749] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-09T20:10:22.350601] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T20:10:22.397780] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-09T20:10:22.398754] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T20:10:23.196743] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-09T20:10:23.883731] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T20:10:23.996714] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-09T20:10:24.796694] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-09T20:10:24.828958] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T20:10:25.320073] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T20:10:25.367597] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T20:10:25.596715] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-09T20:10:26.298709] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T20:10:26.396776] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-09T20:10:27.196770] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-09T20:10:27.930017] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T20:10:27.967162] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T20:10:27.996673] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-09T20:10:28.796795] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-09T20:10:29.412017] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T20:10:29.596757] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-09T20:10:29.668424] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T20:10:30.356818] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T20:10:30.396744] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-09T20:10:31.196691] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-09T20:10:31.263713] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T20:10:31.265399] [INFO ] [REMOTE ] MHD: Full fetch complete (18594 records). [2025-10-09T20:10:31.265479] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-09T20:10:31.693227] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-09T20:10:31.693317] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-09T20:10:31.693805] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-09T20:10:31.693871] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-09T20:10:31.694482] [DEBUG] [LOCAL ] MHD: Trimmed 18594 records to 12533 (keeping 200 days of data) [2025-10-09T20:10:31.772363] [DEBUG] [LOCAL ] MHD: Primary data saved (12533 records). [2025-10-09T20:10:31.772505] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-09T20:10:31.772633] [INFO ] [MAIN ] Update Progress: 1352/2373 symbols completed. MHD took 22.0s. Estimated remaining: 2h 23m 50s. Rate: 7.1 symbols/min [2025-10-09T20:10:31.949856] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:31.950154] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-09T20:10:31.950213] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-09T20:10:31.950331] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-09T20:10:31.950375] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-09T20:10:31.950419] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-09T20:10:31.950477] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-09T20:10:32.003743] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-09T20:10:32.325309] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:32.805083] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-09T20:10:32.836147] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T20:10:33.601813] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-09T20:10:33.619117] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T20:10:34.148709] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T20:10:34.396694] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-09T20:10:35.196723] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-09T20:10:35.956303] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T20:10:35.996776] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-09T20:10:36.582004] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T20:10:36.796787] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-09T20:10:37.137256] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T20:10:37.186570] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (4.38 seconds). [2025-10-09T20:10:37.479491] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T20:10:37.596730] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-09T20:10:38.396727] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-09T20:10:39.007811] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T20:10:39.014537] [INFO ] [REMOTE ] MGY: Full fetch complete (75728 records). [2025-10-09T20:10:39.014709] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-09T20:10:39.187795] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T20:10:39.208724] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-09T20:10:39.448255] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-09T20:10:39.448357] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-09T20:10:39.449620] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-09T20:10:39.449734] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-09T20:10:39.451851] [DEBUG] [LOCAL ] MGY: Trimmed 75728 records to 52781 (keeping 200 days of data) [2025-10-09T20:10:39.767258] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T20:10:39.790730] [DEBUG] [LOCAL ] MGY: Primary data saved (52781 records). [2025-10-09T20:10:39.790840] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-09T20:10:39.790915] [INFO ] [MAIN ] Update Progress: 1353/2373 symbols completed. MGY took 38.0s. Estimated remaining: 2h 23m 42s. Rate: 7.1 symbols/min [2025-10-09T20:10:39.960589] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:39.972126] [DEBUG] [LOCAL ] MHN: Loaded 7586 existing records from primary storage. [2025-10-09T20:10:39.972354] [INFO ] [MAIN ] MHN: Loaded 7586 existing records. [2025-10-09T20:10:40.001861] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-09T20:10:40.163427] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:10:40.163688] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-09T20:10:40.163790] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-09T20:10:40.163996] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-09T20:10:40.164052] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-09T20:10:40.450948] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-09T20:10:40.528970] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:40.796724] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-09T20:10:41.596775] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-09T20:10:41.620819] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T20:10:42.292299] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:10:42.396731] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-09T20:10:43.196721] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-09T20:10:43.991282] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T20:10:44.000881] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-09T20:10:44.032053] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T20:10:44.796740] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-09T20:10:44.823143] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T20:10:45.596721] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-09T20:10:46.278403] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T20:10:46.324954] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T20:10:46.396684] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-09T20:10:46.710773] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-09T20:10:47.196723] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-09T20:10:47.795029] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T20:10:47.996782] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-09T20:10:48.725226] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T20:10:48.796742] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-09T20:10:49.536297] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T20:10:49.596732] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-09T20:10:50.331088] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T20:10:50.396676] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-09T20:10:51.196784] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-09T20:10:51.465366] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T20:10:51.466784] [INFO ] [REMOTE ] MHF: Full fetch complete (12686 records). [2025-10-09T20:10:51.466884] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-09T20:10:51.851114] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-09T20:10:51.851203] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-09T20:10:51.851521] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-09T20:10:51.851569] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-09T20:10:51.852091] [DEBUG] [LOCAL ] MHF: Trimmed 12686 records to 8854 (keeping 200 days of data) [2025-10-09T20:10:51.906029] [DEBUG] [LOCAL ] MHF: Primary data saved (8854 records). [2025-10-09T20:10:51.906173] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-09T20:10:51.906270] [INFO ] [MAIN ] Update Progress: 1354/2373 symbols completed. MHF took 40.1s. Estimated remaining: 2h 23m 36s. Rate: 7.1 symbols/min [2025-10-09T20:10:52.005153] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-09T20:10:52.090687] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:52.114799] [DEBUG] [LOCAL ] MHO: Loaded 23737 existing records from primary storage. [2025-10-09T20:10:52.115216] [INFO ] [MAIN ] MHO: Loaded 23737 existing records. [2025-10-09T20:10:52.305367] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:10:52.305700] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-09T20:10:52.305832] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-09T20:10:52.306069] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-09T20:10:52.306128] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-09T20:10:52.690147] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:52.714184] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T20:10:52.786289] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T20:10:52.796698] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-09T20:10:53.517686] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T20:10:53.596759] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-09T20:10:54.396723] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-09T20:10:54.858289] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T20:10:55.191489] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T20:10:55.196668] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-09T20:10:55.945518] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T20:10:55.996679] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-09T20:10:56.677618] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T20:10:56.796716] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-09T20:10:57.563815] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T20:10:57.596686] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-09T20:10:58.118185] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T20:10:58.396748] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-09T20:10:59.032769] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T20:10:59.033889] [INFO ] [REMOTE ] MHN: Full fetch complete (11655 records). [2025-10-09T20:10:59.033961] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-09T20:10:59.197152] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-09T20:10:59.415373] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-09T20:10:59.415453] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-09T20:10:59.415759] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-09T20:10:59.415826] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-09T20:10:59.416278] [DEBUG] [LOCAL ] MHN: Trimmed 11655 records to 7623 (keeping 200 days of data) [2025-10-09T20:10:59.467028] [DEBUG] [LOCAL ] MHN: Primary data saved (7623 records). [2025-10-09T20:10:59.467162] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-09T20:10:59.467273] [INFO ] [MAIN ] Update Progress: 1355/2373 symbols completed. MHN took 19.7s. Estimated remaining: 2h 23m 27s. Rate: 7.1 symbols/min [2025-10-09T20:10:59.645261] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:10:59.647352] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-09T20:10:59.648043] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T20:10:59.647937] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-09T20:10:59.649347] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-09T20:10:59.649401] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-09T20:10:59.649447] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-09T20:10:59.649480] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-09T20:11:00.001750] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:10:59.998416] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-09T20:11:00.796722] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-09T20:11:00.996195] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:11:00.996508] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-09T20:11:00.996612] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:11:00.996698] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-09T20:11:00.996744] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:11:00.996788] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-09T20:11:00.996847] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-09T20:11:00.996901] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-09T20:11:00.997006] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-09T20:11:00.997105] [INFO ] [MAIN ] Update Progress: 1356/2373 symbols completed. MIAX took 1.5s. Estimated remaining: 2h 23m 13s. Rate: 7.1 symbols/min [2025-10-09T20:11:01.167294] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:11:01.182482] [DEBUG] [LOCAL ] MIN: Loaded 13585 existing records from primary storage. [2025-10-09T20:11:01.182772] [INFO ] [MAIN ] MIN: Loaded 13585 existing records. [2025-10-09T20:11:01.365835] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:11:01.366111] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-09T20:11:01.366165] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-09T20:11:01.366347] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-09T20:11:01.366404] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-09T20:11:01.482432] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T20:11:01.540436] [INFO ] [REMOTE ] MHK: Full fetch complete (60915 records). [2025-10-09T20:11:01.542357] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-09T20:11:01.601792] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-09T20:11:01.908072] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:11:02.072019] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T20:11:02.200442] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-09T20:11:02.200537] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-09T20:11:02.201459] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-09T20:11:02.201571] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-09T20:11:02.202947] [DEBUG] [LOCAL ] MHK: Trimmed 60915 records to 42490 (keeping 200 days of data) [2025-10-09T20:11:02.407087] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-09T20:11:02.461861] [DEBUG] [LOCAL ] MHK: Primary data saved (42490 records). [2025-10-09T20:11:02.462004] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-09T20:11:02.462095] [INFO ] [MAIN ] Update Progress: 1357/2373 symbols completed. MHK took 49.8s. Estimated remaining: 2h 22m 59s. Rate: 7.1 symbols/min [2025-10-09T20:11:02.740415] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-09T20:11:03.196743] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-09T20:11:03.538614] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T20:11:03.996732] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-09T20:11:04.356429] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T20:11:04.357154] [INFO ] [REMOTE ] MHLA: Full fetch complete (1524 records). [2025-10-09T20:11:04.357222] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-09T20:11:04.357574] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:11:04.357682] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:11:04.357767] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:11:04.357848] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-09T20:11:04.357939] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-09T20:11:04.357998] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-09T20:11:04.358044] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-09T20:11:04.358100] [INFO ] [MAIN ] Update Progress: 1358/2373 symbols completed. MHLA took 32.6s. Estimated remaining: 2h 22m 46s. Rate: 7.1 symbols/min [2025-10-09T20:11:04.796731] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-09T20:11:05.596720] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-09T20:11:05.839017] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T20:11:06.396733] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-09T20:11:06.973782] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T20:11:07.185429] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T20:11:07.196669] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-09T20:11:07.827382] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T20:11:07.996822] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-09T20:11:08.788957] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T20:11:08.796666] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-09T20:11:09.562995] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T20:11:09.596673] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-09T20:11:10.375454] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T20:11:10.396695] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-09T20:11:11.196717] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-09T20:11:11.213961] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T20:11:11.996779] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-09T20:11:12.554507] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T20:11:12.796723] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-09T20:11:12.838591] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T20:11:13.596770] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-09T20:11:14.305973] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T20:11:14.324432] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T20:11:14.396719] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-09T20:11:15.196830] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-09T20:11:15.682183] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T20:11:15.947956] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T20:11:15.996684] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-09T20:11:16.796723] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-09T20:11:16.984324] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T20:11:16.986350] [INFO ] [REMOTE ] MIN: Full fetch complete (18080 records). [2025-10-09T20:11:16.986422] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-09T20:11:17.351354] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-09T20:11:17.351459] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-09T20:11:17.351870] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-09T20:11:17.351932] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-09T20:11:17.352476] [DEBUG] [LOCAL ] MIN: Trimmed 18080 records to 13702 (keeping 200 days of data) [2025-10-09T20:11:17.431086] [DEBUG] [LOCAL ] MIN: Primary data saved (13702 records). [2025-10-09T20:11:17.431222] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-09T20:11:17.431317] [INFO ] [MAIN ] Update Progress: 1359/2373 symbols completed. MIN took 16.4s. Estimated remaining: 2h 22m 41s. Rate: 7.1 symbols/min [2025-10-09T20:11:17.744761] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T20:11:17.749909] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-09T20:11:18.637151] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T20:11:18.643025] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-09T20:11:19.925300] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T20:11:19.932132] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-09T20:11:21.203574] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T20:11:21.209804] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-09T20:11:22.389304] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T20:11:22.397143] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-09T20:11:23.528473] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T20:11:23.531238] [INFO ] [REMOTE ] MHO: Full fetch complete (36894 records). [2025-10-09T20:11:23.531410] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-09T20:11:23.922895] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-09T20:11:23.922975] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-09T20:11:23.923725] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-09T20:11:23.923787] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-09T20:11:23.924639] [DEBUG] [LOCAL ] MHO: Trimmed 36894 records to 23931 (keeping 200 days of data) [2025-10-09T20:11:24.073416] [DEBUG] [LOCAL ] MHO: Primary data saved (23931 records). [2025-10-09T20:11:24.073574] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-09T20:11:24.073694] [INFO ] [MAIN ] Update Progress: 1360/2373 symbols completed. MHO took 32.2s. Estimated remaining: 2h 22m 31s. Rate: 7.1 symbols/min [2025-10-09T20:11:24.626966] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:11:24.770462] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:11:24.769121] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:11:24.790581] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-09T20:11:24.817210] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:11:24.817269] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-09T20:11:24.819055] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-09T20:11:24.819178] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-09T20:11:24.819395] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-09T20:11:24.819602] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-09T20:11:24.903878] [DEBUG] [LOCAL ] MITP: Loaded 2361 existing records from primary storage. [2025-10-09T20:11:24.963504] [INFO ] [MAIN ] MITP: Loaded 2361 existing records. [2025-10-09T20:11:24.976226] [DEBUG] [LOCAL ] MITT: Loaded 22667 existing records from primary storage. [2025-10-09T20:11:25.008774] [INFO ] [MAIN ] MITT: Loaded 22667 existing records. [2025-10-09T20:11:25.370478] [DEBUG] [LOCAL ] MIR: Loaded 51139 existing records from primary storage. [2025-10-09T20:11:25.455968] [INFO ] [MAIN ] MIR: Loaded 51139 existing records. [2025-10-09T20:11:25.497020] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:11:25.582048] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-09T20:11:25.635600] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-09T20:11:25.630319] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:11:25.692862] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-09T20:11:25.692815] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-09T20:11:25.729369] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-09T20:11:25.746670] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-09T20:11:25.791570] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:11:25.825367] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-09T20:11:25.831381] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-09T20:11:25.831248] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-09T20:11:26.056302] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:11:26.087216] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-09T20:11:26.099740] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-09T20:11:26.189898] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-09T20:11:26.242592] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-09T20:11:26.255201] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-09T20:11:26.341911] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-09T20:11:26.860739] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:11:26.890440] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-09T20:11:26.923009] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:11:26.952205] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-09T20:11:26.973853] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T20:11:26.986825] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-09T20:11:27.085198] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:11:27.085553] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-09T20:11:27.367681] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T20:11:27.368908] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-09T20:11:27.423704] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T20:11:27.424706] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-09T20:11:27.663236] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-09T20:11:27.996780] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-09T20:11:28.067416] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T20:11:28.160957] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T20:11:28.273438] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-09T20:11:28.735088] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T20:11:28.796736] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-09T20:11:29.596722] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-09T20:11:30.006555] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T20:11:30.396720] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-09T20:11:30.941549] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-09T20:11:31.196688] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-09T20:11:31.260909] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T20:11:31.536566] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-09T20:11:31.996789] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-09T20:11:32.444674] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T20:11:32.796726] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-09T20:11:33.351763] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T20:11:33.596718] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-09T20:11:34.396697] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-09T20:11:34.660678] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T20:11:35.196794] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-09T20:11:35.752729] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T20:11:35.970000] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:11:35.996689] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-09T20:11:36.340426] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T20:11:36.796728] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-09T20:11:37.110031] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-09T20:11:37.596723] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-09T20:11:38.019586] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-09T20:11:38.396787] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-09T20:11:39.196767] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-09T20:11:39.773458] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T20:11:39.996759] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-09T20:11:40.129104] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T20:11:40.259499] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-09T20:11:40.796746] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-09T20:11:41.596740] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-09T20:11:42.125282] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T20:11:42.396716] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-09T20:11:43.208484] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-09T20:11:43.214010] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T20:11:43.458012] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T20:11:43.616185] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-09T20:11:43.996750] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-09T20:11:44.331200] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T20:11:44.796749] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-09T20:11:45.204696] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T20:11:45.205470] [INFO ] [REMOTE ] MITN: Full fetch complete (2360 records). [2025-10-09T20:11:45.205574] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-09T20:11:45.405663] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T20:11:45.405910] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:11:45.405983] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:11:45.406058] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-09T20:11:45.406124] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-09T20:11:45.406161] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-09T20:11:45.406201] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-09T20:11:45.406258] [INFO ] [MAIN ] Update Progress: 1361/2373 symbols completed. MITN took 21.3s. Estimated remaining: 2h 22m 32s. Rate: 7.1 symbols/min [2025-10-09T20:11:45.578773] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:11:45.588398] [DEBUG] [LOCAL ] MIY: Loaded 6115 existing records from primary storage. [2025-10-09T20:11:45.588588] [INFO ] [MAIN ] MIY: Loaded 6115 existing records. [2025-10-09T20:11:45.601889] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-09T20:11:45.779060] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:11:45.779286] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-09T20:11:45.779354] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-09T20:11:45.779612] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-09T20:11:45.779739] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-09T20:11:46.142004] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:11:46.142173] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T20:11:46.396709] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-09T20:11:47.196742] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-09T20:11:47.281215] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T20:11:47.996743] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-09T20:11:48.380564] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-09T20:11:48.796708] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-09T20:11:48.977635] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T20:11:49.166558] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T20:11:49.167320] [INFO ] [REMOTE ] MITP: Full fetch complete (3307 records). [2025-10-09T20:11:49.167388] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-09T20:11:49.536490] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-09T20:11:49.536577] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-09T20:11:49.536762] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-09T20:11:49.536827] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-09T20:11:49.537218] [DEBUG] [LOCAL ] MITP: Trimmed 3307 records to 2367 (keeping 200 days of data) [2025-10-09T20:11:49.551600] [DEBUG] [LOCAL ] MITP: Primary data saved (2367 records). [2025-10-09T20:11:49.551709] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-09T20:11:49.551798] [INFO ] [MAIN ] Update Progress: 1362/2373 symbols completed. MITP took 25.5s. Estimated remaining: 2h 22m 21s. Rate: 7.1 symbols/min [2025-10-09T20:11:49.601931] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-09T20:11:49.731285] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:11:49.781599] [DEBUG] [LOCAL ] MKC: Loaded 52525 existing records from primary storage. [2025-10-09T20:11:49.781978] [INFO ] [MAIN ] MKC: Loaded 52525 existing records. [2025-10-09T20:11:49.964562] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:11:49.964821] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-09T20:11:49.964870] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-09T20:11:49.965281] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-09T20:11:49.965339] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-09T20:11:50.310976] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:11:50.330864] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T20:11:50.396688] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-09T20:11:51.196734] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-09T20:11:51.897829] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T20:11:51.996824] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-09T20:11:52.515281] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T20:11:52.796725] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-09T20:11:53.599140] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-09T20:11:53.602234] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T20:11:53.799942] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T20:11:54.396722] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-09T20:11:55.196724] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-09T20:11:55.375555] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T20:11:55.407027] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T20:11:55.996698] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-09T20:11:56.769112] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:11:56.796732] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-09T20:11:57.236683] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T20:11:57.596738] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-09T20:11:58.396730] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-09T20:11:58.611925] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T20:11:58.993149] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T20:11:59.155359] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T20:11:59.196730] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-09T20:11:59.996795] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-09T20:12:00.796764] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-09T20:12:01.201585] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T20:12:01.264811] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T20:12:01.325157] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T20:12:01.596728] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-09T20:12:02.396752] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-09T20:12:02.709478] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T20:12:02.711638] [INFO ] [REMOTE ] MITT: Full fetch complete (34386 records). [2025-10-09T20:12:02.711757] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-09T20:12:03.081990] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-09T20:12:03.082073] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-09T20:12:03.082801] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-09T20:12:03.082864] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-09T20:12:03.083751] [DEBUG] [LOCAL ] MITT: Trimmed 34386 records to 22868 (keeping 200 days of data) [2025-10-09T20:12:03.196813] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-09T20:12:03.223718] [DEBUG] [LOCAL ] MITT: Primary data saved (22868 records). [2025-10-09T20:12:03.223850] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-09T20:12:03.223934] [INFO ] [MAIN ] Update Progress: 1363/2373 symbols completed. MITT took 39.1s. Estimated remaining: 2h 22m 16s. Rate: 7.1 symbols/min [2025-10-09T20:12:03.393322] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:12:03.429604] [DEBUG] [LOCAL ] MKL: Loaded 34148 existing records from primary storage. [2025-10-09T20:12:03.429927] [INFO ] [MAIN ] MKL: Loaded 34148 existing records. [2025-10-09T20:12:03.605914] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:12:03.606175] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-09T20:12:03.606223] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-09T20:12:03.606713] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-09T20:12:03.606773] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-09T20:12:03.970167] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:12:03.996718] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-09T20:12:04.171318] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T20:12:04.801870] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-09T20:12:04.807746] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T20:12:04.944146] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T20:12:05.596758] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-09T20:12:06.396702] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-09T20:12:06.514090] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T20:12:06.606513] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T20:12:07.020948] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T20:12:07.196795] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-09T20:12:07.771140] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T20:12:07.996694] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-09T20:12:08.796712] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-09T20:12:09.596709] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-09T20:12:09.659700] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T20:12:09.664738] [INFO ] [REMOTE ] MIR: Full fetch complete (73532 records). [2025-10-09T20:12:09.664961] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-09T20:12:10.062953] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-09T20:12:10.063163] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-09T20:12:10.064146] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-09T20:12:10.064211] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-09T20:12:10.065617] [DEBUG] [LOCAL ] MIR: Trimmed 73532 records to 51525 (keeping 200 days of data) [2025-10-09T20:12:10.252345] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-09T20:12:10.398019] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-09T20:12:10.408154] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T20:12:10.429955] [DEBUG] [LOCAL ] MIR: Primary data saved (51525 records). [2025-10-09T20:12:10.430114] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-09T20:12:10.430208] [INFO ] [MAIN ] Update Progress: 1364/2373 symbols completed. MIR took 46.4s. Estimated remaining: 2h 22m 7s. Rate: 7.1 symbols/min [2025-10-09T20:12:10.596914] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:12:10.638572] [DEBUG] [LOCAL ] MLI: Loaded 43470 existing records from primary storage. [2025-10-09T20:12:10.638891] [INFO ] [MAIN ] MLI: Loaded 43470 existing records. [2025-10-09T20:12:10.813386] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:12:10.813608] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-09T20:12:10.813681] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-09T20:12:10.814103] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-09T20:12:10.814161] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-09T20:12:11.100638] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T20:12:11.179887] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:12:11.196669] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-09T20:12:11.996724] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-09T20:12:12.796701] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-09T20:12:12.920087] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T20:12:13.402025] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T20:12:13.596736] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-09T20:12:14.256205] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T20:12:14.396685] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-09T20:12:14.946404] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T20:12:15.196689] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-09T20:12:15.591529] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T20:12:15.791095] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T20:12:15.996807] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-09T20:12:16.706635] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T20:12:16.796705] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-09T20:12:17.521839] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:12:17.523179] [INFO ] [REMOTE ] MIY: Full fetch complete (8993 records). [2025-10-09T20:12:17.523271] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-09T20:12:17.601927] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-09T20:12:17.891502] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-09T20:12:17.891582] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-09T20:12:17.891833] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-09T20:12:17.891895] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-09T20:12:17.892308] [DEBUG] [LOCAL ] MIY: Trimmed 8993 records to 6177 (keeping 200 days of data) [2025-10-09T20:12:17.930966] [DEBUG] [LOCAL ] MIY: Primary data saved (6177 records). [2025-10-09T20:12:17.931090] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-09T20:12:17.931170] [INFO ] [MAIN ] Update Progress: 1365/2373 symbols completed. MIY took 32.5s. Estimated remaining: 2h 21m 58s. Rate: 7.1 symbols/min [2025-10-09T20:12:18.108974] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:12:18.138777] [DEBUG] [LOCAL ] MLM: Loaded 29400 existing records from primary storage. [2025-10-09T20:12:18.139100] [INFO ] [MAIN ] MLM: Loaded 29400 existing records. [2025-10-09T20:12:18.324021] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:12:18.324229] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-09T20:12:18.324277] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-09T20:12:18.324480] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-09T20:12:18.324540] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-09T20:12:18.402690] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-09T20:12:18.696636] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:12:19.196754] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-09T20:12:19.382305] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T20:12:19.785492] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T20:12:19.996789] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-09T20:12:20.187429] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T20:12:20.796776] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-09T20:12:21.578789] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T20:12:21.596678] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-09T20:12:22.156064] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T20:12:22.396727] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-09T20:12:23.006104] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T20:12:23.196712] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-09T20:12:23.996693] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-09T20:12:24.264959] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T20:12:24.635406] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T20:12:24.796779] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-09T20:12:25.596788] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-09T20:12:25.722195] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T20:12:26.396710] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-09T20:12:26.454507] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T20:12:26.460191] [INFO ] [REMOTE ] MKC: Full fetch complete (75679 records). [2025-10-09T20:12:26.460324] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-09T20:12:26.871566] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-09T20:12:26.871722] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-09T20:12:26.873034] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-09T20:12:26.873125] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-09T20:12:26.875027] [DEBUG] [LOCAL ] MKC: Trimmed 75679 records to 52908 (keeping 200 days of data) [2025-10-09T20:12:26.999527] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T20:12:27.201607] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-09T20:12:27.241307] [DEBUG] [LOCAL ] MKC: Primary data saved (52908 records). [2025-10-09T20:12:27.241458] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-09T20:12:27.241586] [INFO ] [MAIN ] Update Progress: 1366/2373 symbols completed. MKC took 37.7s. Estimated remaining: 2h 21m 50s. Rate: 7.1 symbols/min [2025-10-09T20:12:27.413746] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:12:27.441417] [DEBUG] [LOCAL ] MLNK: Loaded 25802 existing records from primary storage. [2025-10-09T20:12:27.441736] [INFO ] [MAIN ] MLNK: Loaded 25802 existing records. [2025-10-09T20:12:27.663179] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:12:27.663547] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-09T20:12:27.663639] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-09T20:12:27.664136] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-09T20:12:27.664213] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-09T20:12:27.931071] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T20:12:28.001918] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-09T20:12:28.057839] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:12:28.351252] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T20:12:28.796715] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-09T20:12:29.094957] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T20:12:29.596735] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-09T20:12:29.904965] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T20:12:30.396718] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-09T20:12:30.972176] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T20:12:31.196734] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-09T20:12:31.494405] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T20:12:31.996723] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-09T20:12:32.410486] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T20:12:32.730746] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T20:12:32.796733] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-09T20:12:33.596779] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-09T20:12:34.096701] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T20:12:34.100019] [INFO ] [REMOTE ] MKL: Full fetch complete (49775 records). [2025-10-09T20:12:34.100148] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-09T20:12:34.401825] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-09T20:12:34.488861] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-09T20:12:34.488987] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-09T20:12:34.489845] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-09T20:12:34.489910] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-09T20:12:34.491195] [DEBUG] [LOCAL ] MKL: Trimmed 49775 records to 34417 (keeping 200 days of data) [2025-10-09T20:12:34.713230] [DEBUG] [LOCAL ] MKL: Primary data saved (34417 records). [2025-10-09T20:12:34.713354] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-09T20:12:34.714123] [INFO ] [MAIN ] Update Progress: 1367/2373 symbols completed. MKL took 31.5s. Estimated remaining: 2h 21m 41s. Rate: 7.1 symbols/min [2025-10-09T20:12:34.881122] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:12:34.887209] [DEBUG] [LOCAL ] MLP: Loaded 3000 existing records from primary storage. [2025-10-09T20:12:34.887400] [INFO ] [MAIN ] MLP: Loaded 3000 existing records. [2025-10-09T20:12:35.063173] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:12:35.063466] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-09T20:12:35.063685] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-09T20:12:35.063897] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-09T20:12:35.063968] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-09T20:12:35.200258] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-09T20:12:35.470999] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:12:35.473449] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T20:12:35.633558] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T20:12:35.996724] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-09T20:12:36.663709] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T20:12:36.796697] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-09T20:12:37.542562] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T20:12:37.596753] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-09T20:12:37.966996] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T20:12:38.396756] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-09T20:12:38.926500] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T20:12:39.196686] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-09T20:12:39.278277] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-09T20:12:39.787431] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T20:12:39.996755] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-09T20:12:40.581955] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T20:12:40.796724] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-09T20:12:41.596774] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-09T20:12:41.865240] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T20:12:42.079544] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T20:12:42.396718] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-09T20:12:43.196748] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-09T20:12:43.619560] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T20:12:43.996745] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-09T20:12:44.803845] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-09T20:12:44.806155] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T20:12:45.288277] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-09T20:12:45.348281] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T20:12:45.596735] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-09T20:12:46.396712] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-09T20:12:47.035991] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T20:12:47.196696] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-09T20:12:47.230136] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T20:12:47.235855] [INFO ] [REMOTE ] MLI: Full fetch complete (63127 records). [2025-10-09T20:12:47.236001] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-09T20:12:47.643003] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-09T20:12:47.643117] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-09T20:12:47.644102] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-09T20:12:47.644165] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-09T20:12:47.645499] [DEBUG] [LOCAL ] MLI: Trimmed 63127 records to 43753 (keeping 200 days of data) [2025-10-09T20:12:47.864712] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T20:12:47.921218] [DEBUG] [LOCAL ] MLI: Primary data saved (43753 records). [2025-10-09T20:12:47.921348] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-09T20:12:47.921428] [INFO ] [MAIN ] Update Progress: 1368/2373 symbols completed. MLI took 37.5s. Estimated remaining: 2h 21m 36s. Rate: 7.1 symbols/min [2025-10-09T20:12:48.001921] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-09T20:12:48.090681] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:12:48.103985] [DEBUG] [LOCAL ] MLR: Loaded 12370 existing records from primary storage. [2025-10-09T20:12:48.104206] [INFO ] [MAIN ] MLR: Loaded 12370 existing records. [2025-10-09T20:12:48.285063] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:12:48.285261] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-09T20:12:48.285308] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-09T20:12:48.285472] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-09T20:12:48.285528] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-09T20:12:48.643040] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:12:48.796685] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-09T20:12:49.160824] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T20:12:49.596699] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-09T20:12:49.675444] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T20:12:50.396745] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-09T20:12:50.809112] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T20:12:51.138275] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T20:12:51.196687] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-09T20:12:51.996744] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-09T20:12:52.423045] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T20:12:52.426040] [INFO ] [REMOTE ] MLM: Full fetch complete (45237 records). [2025-10-09T20:12:52.426127] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-09T20:12:52.801860] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-09T20:12:52.803201] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T20:12:52.821968] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-09T20:12:52.825150] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-09T20:12:52.826879] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-09T20:12:52.827315] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-09T20:12:52.828415] [DEBUG] [LOCAL ] MLM: Trimmed 45237 records to 29591 (keeping 200 days of data) [2025-10-09T20:12:53.023965] [DEBUG] [LOCAL ] MLM: Primary data saved (29591 records). [2025-10-09T20:12:53.024109] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-09T20:12:53.024207] [INFO ] [MAIN ] Update Progress: 1369/2373 symbols completed. MLM took 35.1s. Estimated remaining: 2h 21m 25s. Rate: 7.1 symbols/min [2025-10-09T20:12:53.191443] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:12:53.246246] [DEBUG] [LOCAL ] MMC: Loaded 51871 existing records from primary storage. [2025-10-09T20:12:53.246608] [INFO ] [MAIN ] MMC: Loaded 51871 existing records. [2025-10-09T20:12:53.432145] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:12:53.436005] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T20:12:53.436173] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-09T20:12:53.437983] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-09T20:12:53.438252] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-09T20:12:53.438318] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-09T20:12:53.608829] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-09T20:12:53.802660] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:12:54.251573] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-09T20:12:54.396715] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-09T20:12:55.196696] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-09T20:12:55.281935] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T20:12:55.657446] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T20:12:55.996725] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-09T20:12:56.350081] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T20:12:56.796739] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-09T20:12:57.423340] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T20:12:57.424508] [INFO ] [REMOTE ] MLP: Full fetch complete (4498 records). [2025-10-09T20:12:57.424587] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-09T20:12:57.596903] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-09T20:12:57.832385] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-09T20:12:57.832555] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-09T20:12:57.833039] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-09T20:12:57.833111] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-09T20:12:57.833619] [DEBUG] [LOCAL ] MLP: Trimmed 4498 records to 3019 (keeping 200 days of data) [2025-10-09T20:12:57.854445] [DEBUG] [LOCAL ] MLP: Primary data saved (3019 records). [2025-10-09T20:12:57.854631] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-09T20:12:57.854802] [INFO ] [MAIN ] Update Progress: 1370/2373 symbols completed. MLP took 23.1s. Estimated remaining: 2h 21m 14s. Rate: 7.1 symbols/min [2025-10-09T20:12:58.040343] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:12:58.056413] [DEBUG] [LOCAL ] MMD: Loaded 11207 existing records from primary storage. [2025-10-09T20:12:58.056766] [INFO ] [MAIN ] MMD: Loaded 11207 existing records. [2025-10-09T20:12:58.261017] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:12:58.261325] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-09T20:12:58.261379] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-09T20:12:58.261607] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-09T20:12:58.261729] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-09T20:12:58.401893] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-09T20:12:58.676203] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:12:59.196770] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-09T20:12:59.349081] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T20:12:59.399410] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T20:12:59.996761] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-09T20:13:00.363579] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T20:13:00.533730] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T20:13:00.796754] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-09T20:13:01.427020] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T20:13:01.596737] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-09T20:13:02.396695] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-09T20:13:02.594808] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T20:13:03.196730] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-09T20:13:03.985218] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T20:13:03.996670] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-09T20:13:04.289947] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T20:13:04.796729] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-09T20:13:05.596694] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-09T20:13:05.616233] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T20:13:05.695530] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T20:13:06.231051] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T20:13:06.396749] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-09T20:13:07.200857] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-09T20:13:07.207222] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T20:13:07.996710] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-09T20:13:08.160969] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T20:13:08.796731] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-09T20:13:09.005554] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T20:13:09.596799] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-09T20:13:09.661732] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T20:13:10.396777] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-09T20:13:10.901380] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T20:13:10.904495] [INFO ] [REMOTE ] MLNK: Full fetch complete (36280 records). [2025-10-09T20:13:10.904576] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-09T20:13:11.179511] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T20:13:11.202264] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-09T20:13:11.298356] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-09T20:13:11.298437] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-09T20:13:11.299167] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-09T20:13:11.299230] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-09T20:13:11.300105] [DEBUG] [LOCAL ] MLNK: Trimmed 36280 records to 26036 (keeping 200 days of data) [2025-10-09T20:13:11.451877] [DEBUG] [LOCAL ] MLNK: Primary data saved (26036 records). [2025-10-09T20:13:11.452009] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-09T20:13:11.452093] [INFO ] [MAIN ] Update Progress: 1371/2373 symbols completed. MLNK took 44.2s. Estimated remaining: 2h 21m 9s. Rate: 7.1 symbols/min [2025-10-09T20:13:11.627720] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:13:11.645048] [DEBUG] [LOCAL ] MMI: Loaded 15200 existing records from primary storage. [2025-10-09T20:13:11.645294] [INFO ] [MAIN ] MMI: Loaded 15200 existing records. [2025-10-09T20:13:11.822519] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:13:11.822825] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-09T20:13:11.822884] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-09T20:13:11.823086] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-09T20:13:11.823142] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-09T20:13:12.001948] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-09T20:13:12.190079] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:13:12.796705] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-09T20:13:12.971416] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T20:13:13.035630] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T20:13:13.418821] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T20:13:13.596788] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-09T20:13:14.396725] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-09T20:13:15.196760] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-09T20:13:15.278383] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T20:13:15.420147] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T20:13:15.996694] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-09T20:13:16.137085] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T20:13:16.139042] [INFO ] [REMOTE ] MLR: Full fetch complete (18871 records). [2025-10-09T20:13:16.139126] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-09T20:13:16.535909] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-09T20:13:16.535998] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-09T20:13:16.536436] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-09T20:13:16.536476] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-09T20:13:16.537056] [DEBUG] [LOCAL ] MLR: Trimmed 18871 records to 12506 (keeping 200 days of data) [2025-10-09T20:13:16.615140] [DEBUG] [LOCAL ] MLR: Primary data saved (12506 records). [2025-10-09T20:13:16.615274] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-09T20:13:16.615369] [INFO ] [MAIN ] Update Progress: 1372/2373 symbols completed. MLR took 28.7s. Estimated remaining: 2h 20m 58s. Rate: 7.1 symbols/min [2025-10-09T20:13:16.791818] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:13:16.792041] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-09T20:13:16.792089] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-09T20:13:16.792200] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-09T20:13:16.792244] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-09T20:13:16.792294] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-09T20:13:16.792328] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-09T20:13:16.803755] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-09T20:13:17.163563] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:13:17.596725] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-09T20:13:17.761784] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T20:13:17.821147] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T20:13:18.310270] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T20:13:18.396676] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-09T20:13:19.196696] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-09T20:13:19.322380] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T20:13:19.996777] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-09T20:13:20.796713] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-09T20:13:20.885493] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T20:13:20.932756] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T20:13:20.992520] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:13:20.992892] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-09T20:13:20.993024] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:13:20.993124] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-09T20:13:20.993210] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:13:20.993307] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-09T20:13:20.993390] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-09T20:13:20.993429] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-09T20:13:20.993468] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-09T20:13:20.993516] [INFO ] [MAIN ] Update Progress: 1373/2373 symbols completed. MMID took 4.4s. Estimated remaining: 2h 20m 47s. Rate: 7.1 symbols/min [2025-10-09T20:13:21.166049] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:13:21.166271] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-09T20:13:21.166317] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-09T20:13:21.166432] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-09T20:13:21.166474] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-09T20:13:21.166515] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-09T20:13:21.166549] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-09T20:13:21.523158] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:13:21.596793] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-09T20:13:22.060098] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T20:13:22.396724] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-09T20:13:22.831521] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T20:13:23.196739] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-09T20:13:23.960926] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T20:13:23.996677] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-09T20:13:24.796758] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-09T20:13:24.963091] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T20:13:25.414100] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T20:13:25.596762] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-09T20:13:26.396691] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-09T20:13:26.476712] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T20:13:27.145626] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T20:13:27.196732] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-09T20:13:27.996697] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-09T20:13:28.161933] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T20:13:28.796738] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-09T20:13:28.812370] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T20:13:29.112885] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T20:13:29.596745] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-09T20:13:30.396726] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-09T20:13:31.196694] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-09T20:13:31.235979] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T20:13:31.300259] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T20:13:31.996745] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-09T20:13:32.023383] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T20:13:32.796738] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-09T20:13:33.596704] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-09T20:13:33.763592] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T20:13:33.798249] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T20:13:33.800230] [INFO ] [REMOTE ] MMI: Full fetch complete (21402 records). [2025-10-09T20:13:33.800304] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-09T20:13:33.906793] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-09T20:13:34.201532] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-09T20:13:34.201615] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-09T20:13:34.202112] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-09T20:13:34.202169] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-09T20:13:34.202800] [DEBUG] [LOCAL ] MMI: Trimmed 21402 records to 15336 (keeping 200 days of data) [2025-10-09T20:13:34.300752] [DEBUG] [LOCAL ] MMI: Primary data saved (15336 records). [2025-10-09T20:13:34.300945] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-09T20:13:34.301084] [INFO ] [MAIN ] Update Progress: 1374/2373 symbols completed. MMI took 22.8s. Estimated remaining: 2h 20m 42s. Rate: 7.1 symbols/min [2025-10-09T20:13:34.401915] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-09T20:13:34.473508] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:13:34.524666] [DEBUG] [LOCAL ] MMM: Loaded 53127 existing records from primary storage. [2025-10-09T20:13:34.525014] [INFO ] [MAIN ] MMM: Loaded 53127 existing records. [2025-10-09T20:13:34.697618] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:13:34.697876] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-09T20:13:34.697925] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-09T20:13:34.698155] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-09T20:13:34.698213] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-09T20:13:34.950164] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T20:13:35.053005] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:13:35.196684] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-09T20:13:35.996735] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-09T20:13:36.425499] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T20:13:36.796839] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-09T20:13:37.066940] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T20:13:37.188255] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T20:13:37.596731] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-09T20:13:37.931523] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-09T20:13:38.396753] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-09T20:13:39.196868] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-09T20:13:39.794874] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T20:13:39.996745] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-09T20:13:40.062418] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T20:13:40.796804] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-09T20:13:40.834096] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T20:13:40.835696] [INFO ] [REMOTE ] MMD: Full fetch complete (17633 records). [2025-10-09T20:13:40.835771] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-09T20:13:41.196388] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-09T20:13:41.196466] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-09T20:13:41.196889] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-09T20:13:41.196949] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-09T20:13:41.197434] [DEBUG] [LOCAL ] MMD: Trimmed 17633 records to 11288 (keeping 200 days of data) [2025-10-09T20:13:41.254095] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T20:13:41.275068] [DEBUG] [LOCAL ] MMD: Primary data saved (11288 records). [2025-10-09T20:13:41.275157] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-09T20:13:41.275243] [INFO ] [MAIN ] Update Progress: 1375/2373 symbols completed. MMD took 43.4s. Estimated remaining: 2h 20m 32s. Rate: 7.1 symbols/min [2025-10-09T20:13:41.441345] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:13:41.483636] [DEBUG] [LOCAL ] MMS: Loaded 33877 existing records from primary storage. [2025-10-09T20:13:41.483955] [INFO ] [MAIN ] MMS: Loaded 33877 existing records. [2025-10-09T20:13:41.601948] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-09T20:13:41.667615] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:13:41.668100] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-09T20:13:41.668162] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-09T20:13:41.668404] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-09T20:13:41.668462] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-09T20:13:42.015943] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:13:42.396770] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-09T20:13:43.196746] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-09T20:13:43.581075] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-09T20:13:43.627142] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-09T20:13:43.996709] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-09T20:13:44.098519] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T20:13:44.103146] [INFO ] [REMOTE ] MMC: Full fetch complete (74768 records). [2025-10-09T20:13:44.103284] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-09T20:13:44.539490] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-09T20:13:44.539577] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-09T20:13:44.540606] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-09T20:13:44.540734] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-09T20:13:44.542280] [DEBUG] [LOCAL ] MMC: Trimmed 74768 records to 52256 (keeping 200 days of data) [2025-10-09T20:13:44.799633] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-09T20:13:44.910014] [DEBUG] [LOCAL ] MMC: Primary data saved (52256 records). [2025-10-09T20:13:44.910172] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-09T20:13:44.910263] [INFO ] [MAIN ] Update Progress: 1376/2373 symbols completed. MMC took 51.9s. Estimated remaining: 2h 20m 20s. Rate: 7.1 symbols/min [2025-10-09T20:13:45.089960] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:13:45.102080] [DEBUG] [LOCAL ] MMT: Loaded 10386 existing records from primary storage. [2025-10-09T20:13:45.102265] [INFO ] [MAIN ] MMT: Loaded 10386 existing records. [2025-10-09T20:13:45.289178] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T20:13:45.296163] [INFO ] [REMOTE ] MMKT: Full fetch complete (2119 records). [2025-10-09T20:13:45.295246] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:13:45.296331] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-09T20:13:45.296425] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-09T20:13:45.296501] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-09T20:13:45.329740] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-09T20:13:45.368101] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-09T20:13:45.592332] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T20:13:45.598182] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-09T20:13:45.608739] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:13:45.620140] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:13:45.645043] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-09T20:13:45.709802] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-09T20:13:45.734795] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-09T20:13:45.765291] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-09T20:13:45.783478] [INFO ] [MAIN ] Update Progress: 1377/2373 symbols completed. MMKT took 24.8s. Estimated remaining: 2h 20m 6s. Rate: 7.1 symbols/min [2025-10-09T20:13:45.992969] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:13:46.046498] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:13:46.076161] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-09T20:13:46.097492] [DEBUG] [LOCAL ] MMU: Loaded 16804 existing records from primary storage. [2025-10-09T20:13:46.097816] [INFO ] [MAIN ] MMU: Loaded 16804 existing records. [2025-10-09T20:13:46.280286] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:13:46.280514] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-09T20:13:46.280562] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-09T20:13:46.280763] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-09T20:13:46.280821] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-09T20:13:46.401900] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-09T20:13:46.638063] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:13:47.140420] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T20:13:47.196677] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-09T20:13:47.366556] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T20:13:47.996748] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-09T20:13:48.575200] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T20:13:48.773191] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-09T20:13:48.796712] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-09T20:13:49.596743] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-09T20:13:49.910494] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T20:13:50.396775] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-09T20:13:51.043045] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T20:13:51.196732] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-09T20:13:51.996738] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-09T20:13:52.183749] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T20:13:52.340174] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T20:13:52.752039] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T20:13:52.796678] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-09T20:13:53.545592] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T20:13:53.596762] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-09T20:13:54.396808] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-09T20:13:55.065827] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T20:13:55.145841] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T20:13:55.196681] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-09T20:13:55.996749] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-09T20:13:56.161711] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T20:13:56.715792] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T20:13:56.796715] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-09T20:13:57.596740] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-09T20:13:58.171169] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T20:13:58.288513] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T20:13:58.396754] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-09T20:13:59.196756] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-09T20:13:59.217412] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T20:13:59.996735] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-09T20:14:00.281091] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T20:14:00.586848] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T20:14:00.796736] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-09T20:14:01.596825] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-09T20:14:01.876537] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T20:14:02.396796] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-09T20:14:03.196704] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-09T20:14:03.229381] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T20:14:03.461526] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T20:14:03.996726] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-09T20:14:04.144202] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T20:14:04.796717] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-09T20:14:05.596752] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-09T20:14:05.756709] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T20:14:05.792513] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T20:14:06.154395] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T20:14:06.396702] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-09T20:14:07.196776] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-09T20:14:07.814485] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T20:14:07.977331] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T20:14:07.996671] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-09T20:14:08.796713] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-09T20:14:09.596717] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-09T20:14:09.753180] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T20:14:09.857917] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T20:14:10.107623] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T20:14:10.109069] [INFO ] [REMOTE ] MMT: Full fetch complete (16088 records). [2025-10-09T20:14:10.109140] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-09T20:14:10.401804] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-09T20:14:10.479214] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-09T20:14:10.479290] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-09T20:14:10.479703] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-09T20:14:10.479767] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-09T20:14:10.480288] [DEBUG] [LOCAL ] MMT: Trimmed 16088 records to 10601 (keeping 200 days of data) [2025-10-09T20:14:10.542033] [DEBUG] [LOCAL ] MMT: Primary data saved (10601 records). [2025-10-09T20:14:10.542162] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-09T20:14:10.542244] [INFO ] [MAIN ] Update Progress: 1378/2373 symbols completed. MMT took 25.6s. Estimated remaining: 2h 20m 10s. Rate: 7.1 symbols/min [2025-10-09T20:14:10.709987] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:14:10.735255] [DEBUG] [LOCAL ] MNR: Loaded 24555 existing records from primary storage. [2025-10-09T20:14:10.735515] [INFO ] [MAIN ] MNR: Loaded 24555 existing records. [2025-10-09T20:14:10.909443] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:14:10.909797] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-09T20:14:10.909861] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-09T20:14:10.910243] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-09T20:14:10.910304] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-09T20:14:11.201830] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-09T20:14:11.269875] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:14:11.531203] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T20:14:11.996753] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-09T20:14:12.640352] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T20:14:12.699505] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T20:14:12.796756] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-09T20:14:13.596769] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-09T20:14:13.706279] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T20:14:14.396789] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-09T20:14:14.985090] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T20:14:15.196765] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-09T20:14:15.409608] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T20:14:15.996773] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-09T20:14:16.796725] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-09T20:14:17.047462] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T20:14:17.083259] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T20:14:17.596693] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-09T20:14:17.665328] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T20:14:17.667233] [INFO ] [REMOTE ] MMU: Full fetch complete (25277 records). [2025-10-09T20:14:17.667307] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-09T20:14:18.073169] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-09T20:14:18.073247] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-09T20:14:18.073800] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-09T20:14:18.073862] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-09T20:14:18.074511] [DEBUG] [LOCAL ] MMU: Trimmed 25277 records to 16913 (keeping 200 days of data) [2025-10-09T20:14:18.177616] [DEBUG] [LOCAL ] MMU: Primary data saved (16913 records). [2025-10-09T20:14:18.177809] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-09T20:14:18.177916] [INFO ] [MAIN ] Update Progress: 1379/2373 symbols completed. MMU took 32.4s. Estimated remaining: 2h 20m 1s. Rate: 7.1 symbols/min [2025-10-09T20:14:18.355120] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:14:18.400103] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-09T20:14:18.401744] [DEBUG] [LOCAL ] MNSO: Loaded 44259 existing records from primary storage. [2025-10-09T20:14:18.401990] [INFO ] [MAIN ] MNSO: Loaded 44259 existing records. [2025-10-09T20:14:18.601356] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:14:18.601602] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-09T20:14:18.601696] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-09T20:14:18.601980] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-09T20:14:18.602038] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-09T20:14:18.969377] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:14:18.989075] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T20:14:19.196717] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-09T20:14:19.923901] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T20:14:19.928195] [INFO ] [REMOTE ] MMS: Full fetch complete (51620 records). [2025-10-09T20:14:19.928433] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-09T20:14:19.999462] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-09T20:14:20.326724] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-09T20:14:20.326830] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-09T20:14:20.327835] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-09T20:14:20.327919] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-09T20:14:20.342105] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T20:14:20.347280] [DEBUG] [LOCAL ] MMS: Trimmed 51620 records to 34085 (keeping 200 days of data) [2025-10-09T20:14:20.563512] [DEBUG] [LOCAL ] MMS: Primary data saved (34085 records). [2025-10-09T20:14:20.563689] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-09T20:14:20.563793] [INFO ] [MAIN ] Update Progress: 1380/2373 symbols completed. MMS took 39.3s. Estimated remaining: 2h 19m 48s. Rate: 7.1 symbols/min [2025-10-09T20:14:20.728899] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:14:20.729076] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-09T20:14:20.729131] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-09T20:14:20.729240] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-09T20:14:20.729280] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-09T20:14:20.729323] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-09T20:14:20.729356] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-09T20:14:20.801892] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-09T20:14:21.083729] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:14:21.596777] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-09T20:14:21.760829] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T20:14:21.796303] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:14:21.796691] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-09T20:14:21.796962] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:14:21.797014] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-09T20:14:21.797049] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:14:21.797086] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-09T20:14:21.797145] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-09T20:14:21.797179] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-09T20:14:21.797233] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-09T20:14:21.797349] [INFO ] [MAIN ] Update Progress: 1381/2373 symbols completed. MNTN took 1.2s. Estimated remaining: 2h 19m 34s. Rate: 7.1 symbols/min [2025-10-09T20:14:21.972742] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:14:21.972976] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-09T20:14:21.973153] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-09T20:14:21.973279] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-09T20:14:21.973411] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-09T20:14:21.973508] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-09T20:14:21.973578] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-09T20:14:22.317326] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-09T20:14:22.381736] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:14:22.396676] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-09T20:14:23.196783] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-09T20:14:23.996689] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-09T20:14:24.157560] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T20:14:24.797836] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-09T20:14:24.803169] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-09T20:14:25.362618] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T20:14:25.596752] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-09T20:14:26.086129] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T20:14:26.396705] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-09T20:14:27.196776] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-09T20:14:27.247468] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T20:14:27.253198] [INFO ] [REMOTE ] MMM: Full fetch complete (77052 records). [2025-10-09T20:14:27.253412] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-09T20:14:27.714166] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-09T20:14:27.714251] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-09T20:14:27.715348] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-09T20:14:27.715413] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-09T20:14:27.717098] [DEBUG] [LOCAL ] MMM: Trimmed 77052 records to 53509 (keeping 200 days of data) [2025-10-09T20:14:28.012453] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-09T20:14:28.062387] [DEBUG] [LOCAL ] MMM: Primary data saved (53509 records). [2025-10-09T20:14:28.062521] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-09T20:14:28.062604] [INFO ] [MAIN ] Update Progress: 1382/2373 symbols completed. MMM took 53.8s. Estimated remaining: 2h 19m 24s. Rate: 7.1 symbols/min [2025-10-09T20:14:28.237261] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:14:28.280377] [DEBUG] [LOCAL ] MOD: Loaded 44995 existing records from primary storage. [2025-10-09T20:14:28.280713] [INFO ] [MAIN ] MOD: Loaded 44995 existing records. [2025-10-09T20:14:28.460836] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:14:28.461077] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-09T20:14:28.461262] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-09T20:14:28.461574] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-09T20:14:28.461632] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-09T20:14:28.870230] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:14:28.872890] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-09T20:14:28.872555] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T20:14:28.917490] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-09T20:14:29.103341] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T20:14:29.596723] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-09T20:14:30.396769] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-09T20:14:30.599606] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T20:14:30.935636] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T20:14:31.196044] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T20:14:31.201517] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-09T20:14:31.996720] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-09T20:14:32.796787] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-09T20:14:32.933997] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T20:14:33.029049] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T20:14:33.596763] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-09T20:14:34.396760] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-09T20:14:34.484291] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T20:14:34.505805] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T20:14:34.509607] [INFO ] [REMOTE ] MNR: Full fetch complete (36569 records). [2025-10-09T20:14:34.509856] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-09T20:14:34.902437] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-09T20:14:34.902538] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-09T20:14:34.903331] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-09T20:14:34.903396] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-09T20:14:34.904500] [DEBUG] [LOCAL ] MNR: Trimmed 36569 records to 24748 (keeping 200 days of data) [2025-10-09T20:14:35.061004] [DEBUG] [LOCAL ] MNR: Primary data saved (24748 records). [2025-10-09T20:14:35.061143] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-09T20:14:35.061230] [INFO ] [MAIN ] Update Progress: 1383/2373 symbols completed. MNR took 24.5s. Estimated remaining: 2h 19m 15s. Rate: 7.1 symbols/min [2025-10-09T20:14:35.201882] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-09T20:14:35.233187] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:14:35.284417] [DEBUG] [LOCAL ] MODG: Loaded 51570 existing records from primary storage. [2025-10-09T20:14:35.284755] [INFO ] [MAIN ] MODG: Loaded 51570 existing records. [2025-10-09T20:14:35.457491] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:14:35.457750] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-09T20:14:35.457811] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-09T20:14:35.458238] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-09T20:14:35.458295] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-09T20:14:35.804439] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:14:35.996718] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-09T20:14:36.560605] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T20:14:36.621148] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-09T20:14:36.796718] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-09T20:14:37.377817] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T20:14:37.596718] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-09T20:14:38.396785] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-09T20:14:38.996583] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T20:14:39.053162] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-09T20:14:39.196707] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-09T20:14:39.996690] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-09T20:14:40.054842] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T20:14:40.796742] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-09T20:14:41.150236] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T20:14:41.217791] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T20:14:41.596773] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-09T20:14:42.380884] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T20:14:42.396675] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-09T20:14:43.138818] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T20:14:43.196670] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-09T20:14:43.751012] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T20:14:43.996726] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-09T20:14:44.796697] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-09T20:14:44.862402] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T20:14:45.596683] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-09T20:14:45.795758] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T20:14:45.893133] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T20:14:46.396700] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-09T20:14:47.196755] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-09T20:14:47.232143] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T20:14:48.000168] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-09T20:14:48.004330] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T20:14:48.796755] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-09T20:14:49.385246] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-09T20:14:49.596674] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-09T20:14:49.731499] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T20:14:50.204488] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T20:14:50.396769] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-09T20:14:51.196688] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-09T20:14:51.725253] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T20:14:51.840814] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-09T20:14:51.996723] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-09T20:14:52.501712] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T20:14:52.796746] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-09T20:14:53.332670] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T20:14:53.336861] [INFO ] [REMOTE ] MNSO: Full fetch complete (64256 records). [2025-10-09T20:14:53.336968] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-09T20:14:53.604386] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-09T20:14:53.787982] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-09T20:14:53.788129] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-09T20:14:53.789447] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-09T20:14:53.789531] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-09T20:14:53.791397] [DEBUG] [LOCAL ] MNSO: Trimmed 64256 records to 44553 (keeping 200 days of data) [2025-10-09T20:14:54.105158] [DEBUG] [LOCAL ] MNSO: Primary data saved (44553 records). [2025-10-09T20:14:54.105352] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-09T20:14:54.105501] [INFO ] [MAIN ] Update Progress: 1384/2373 symbols completed. MNSO took 35.9s. Estimated remaining: 2h 19m 14s. Rate: 7.1 symbols/min [2025-10-09T20:14:54.396020] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:14:54.396832] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-09T20:14:54.456094] [DEBUG] [LOCAL ] MOH: Loaded 42118 existing records from primary storage. [2025-10-09T20:14:54.456576] [INFO ] [MAIN ] MOH: Loaded 42118 existing records. [2025-10-09T20:14:54.800339] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T20:14:54.797360] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:14:54.812958] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-09T20:14:54.813614] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-09T20:14:54.814284] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-09T20:14:54.814349] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-09T20:14:55.201989] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-09T20:14:55.283291] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:14:55.505880] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T20:14:55.719943] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T20:14:55.996728] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-09T20:14:56.673871] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T20:14:56.796712] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-09T20:14:57.302743] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T20:14:57.306409] [INFO ] [REMOTE ] MOD: Full fetch complete (66148 records). [2025-10-09T20:14:57.306541] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-09T20:14:57.598411] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-09T20:14:57.693979] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-09T20:14:57.694078] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-09T20:14:57.695133] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-09T20:14:57.695199] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-09T20:14:57.696820] [DEBUG] [LOCAL ] MOD: Trimmed 66148 records to 45257 (keeping 200 days of data) [2025-10-09T20:14:57.968304] [DEBUG] [LOCAL ] MOD: Primary data saved (45257 records). [2025-10-09T20:14:57.968441] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-09T20:14:57.968555] [INFO ] [MAIN ] Update Progress: 1385/2373 symbols completed. MOD took 29.9s. Estimated remaining: 2h 19m 2s. Rate: 7.1 symbols/min [2025-10-09T20:14:58.137507] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:14:58.188167] [DEBUG] [LOCAL ] MOS: Loaded 53504 existing records from primary storage. [2025-10-09T20:14:58.188537] [INFO ] [MAIN ] MOS: Loaded 53504 existing records. [2025-10-09T20:14:58.369238] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:14:58.369534] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-09T20:14:58.369588] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-09T20:14:58.369830] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-09T20:14:58.369887] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-09T20:14:58.401880] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-09T20:14:58.728442] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:14:58.758269] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-09T20:14:59.130030] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T20:14:59.196710] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-09T20:14:59.996736] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-09T20:15:00.166716] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:15:00.227753] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T20:15:00.796720] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-09T20:15:01.596712] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-09T20:15:01.726009] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T20:15:02.396783] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-09T20:15:02.769925] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-09T20:15:02.774807] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-09T20:15:02.774995] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-09T20:15:02.988757] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T20:15:02.989703] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:15:02.989784] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:15:02.989850] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-09T20:15:02.989934] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-09T20:15:02.989994] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-09T20:15:02.990067] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-09T20:15:02.990163] [INFO ] [MAIN ] Update Progress: 1386/2373 symbols completed. MO took 41.2s. Estimated remaining: 2h 18m 51s. Rate: 7.1 symbols/min [2025-10-09T20:15:03.185345] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:15:03.200330] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-09T20:15:03.212285] [DEBUG] [LOCAL ] MOV: Loaded 21793 existing records from primary storage. [2025-10-09T20:15:03.212662] [INFO ] [MAIN ] MOV: Loaded 21793 existing records. [2025-10-09T20:15:03.415452] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:15:03.415899] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-09T20:15:03.416095] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-09T20:15:03.416627] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-09T20:15:03.416957] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-09T20:15:03.551494] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-09T20:15:03.852906] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:15:03.930835] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T20:15:03.996696] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-09T20:15:04.745558] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T20:15:04.796743] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-09T20:15:05.499102] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T20:15:05.596731] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-09T20:15:06.399689] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-09T20:15:06.413169] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T20:15:06.956361] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T20:15:07.196784] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-09T20:15:07.996708] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-09T20:15:08.117761] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T20:15:08.160386] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T20:15:08.796722] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-09T20:15:09.600727] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-09T20:15:09.617379] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T20:15:09.910752] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T20:15:10.396735] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-09T20:15:11.108491] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T20:15:11.196730] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-09T20:15:11.926678] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T20:15:11.996717] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-09T20:15:12.294221] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T20:15:12.796735] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-09T20:15:13.596697] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-09T20:15:13.846317] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T20:15:13.949855] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T20:15:14.396715] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-09T20:15:15.196704] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-09T20:15:15.655285] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-09T20:15:15.988097] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T20:15:15.993591] [INFO ] [REMOTE ] MODG: Full fetch complete (74770 records). [2025-10-09T20:15:15.993803] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-09T20:15:16.002034] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-09T20:15:16.308820] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T20:15:16.441563] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-09T20:15:16.441636] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-09T20:15:16.442709] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-09T20:15:16.442772] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-09T20:15:16.444114] [DEBUG] [LOCAL ] MODG: Trimmed 74770 records to 51924 (keeping 200 days of data) [2025-10-09T20:15:16.735256] [DEBUG] [LOCAL ] MODG: Primary data saved (51924 records). [2025-10-09T20:15:16.735391] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-09T20:15:16.735473] [INFO ] [MAIN ] Update Progress: 1387/2373 symbols completed. MODG took 41.7s. Estimated remaining: 2h 18m 47s. Rate: 7.1 symbols/min [2025-10-09T20:15:16.804403] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-09T20:15:16.912234] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:15:16.960740] [DEBUG] [LOCAL ] MP: Loaded 53691 existing records from primary storage. [2025-10-09T20:15:16.961057] [INFO ] [MAIN ] MP: Loaded 53691 existing records. [2025-10-09T20:15:17.135336] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:15:17.135544] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-09T20:15:17.135601] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-09T20:15:17.135915] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-09T20:15:17.135974] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-09T20:15:17.481509] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:15:17.596664] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-09T20:15:17.982415] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T20:15:18.275693] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T20:15:18.396691] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-09T20:15:19.196754] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-09T20:15:19.280162] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T20:15:19.821918] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T20:15:19.996757] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-09T20:15:20.286606] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T20:15:20.796763] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-09T20:15:21.596785] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-09T20:15:21.738812] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T20:15:21.769161] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T20:15:22.396727] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-09T20:15:23.058086] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T20:15:23.196748] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-09T20:15:23.996707] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-09T20:15:24.277834] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T20:15:24.450341] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T20:15:24.456275] [INFO ] [REMOTE ] MOH: Full fetch complete (58691 records). [2025-10-09T20:15:24.456412] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-09T20:15:24.801852] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-09T20:15:24.846891] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-09T20:15:24.846967] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-09T20:15:24.847917] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-09T20:15:24.847980] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-09T20:15:24.849371] [DEBUG] [LOCAL ] MOH: Trimmed 58691 records to 42442 (keeping 200 days of data) [2025-10-09T20:15:25.070912] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T20:15:25.124150] [DEBUG] [LOCAL ] MOH: Primary data saved (42442 records). [2025-10-09T20:15:25.124290] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-09T20:15:25.124385] [INFO ] [MAIN ] Update Progress: 1388/2373 symbols completed. MOH took 31.0s. Estimated remaining: 2h 18m 38s. Rate: 7.1 symbols/min [2025-10-09T20:15:25.288692] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:15:25.296807] [DEBUG] [LOCAL ] MPA: Loaded 5322 existing records from primary storage. [2025-10-09T20:15:25.297013] [INFO ] [MAIN ] MPA: Loaded 5322 existing records. [2025-10-09T20:15:25.470170] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:15:25.470389] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-09T20:15:25.470445] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-09T20:15:25.470624] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-09T20:15:25.470712] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-09T20:15:25.606526] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-09T20:15:25.822514] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:15:26.396715] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-09T20:15:26.700562] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T20:15:26.758297] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T20:15:26.935848] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-09T20:15:27.196776] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-09T20:15:27.650132] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T20:15:27.996746] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-09T20:15:28.796725] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-09T20:15:29.596743] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-09T20:15:30.002029] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T20:15:30.396694] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-09T20:15:30.559009] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T20:15:30.814798] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T20:15:30.832137] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T20:15:31.196766] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-09T20:15:31.573523] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-09T20:15:31.996780] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-09T20:15:32.796768] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-09T20:15:33.596761] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-09T20:15:33.687412] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T20:15:34.184301] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-09T20:15:34.396757] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-09T20:15:35.196747] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-09T20:15:35.252871] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T20:15:35.681778] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T20:15:35.996722] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-09T20:15:36.519053] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-09T20:15:36.783509] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-09T20:15:36.796672] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-09T20:15:37.596784] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-09T20:15:38.221006] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T20:15:38.396799] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-09T20:15:38.972336] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T20:15:39.196693] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-09T20:15:39.312881] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-09T20:15:39.614975] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T20:15:39.996728] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-09T20:15:40.796739] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-09T20:15:41.596725] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-09T20:15:42.396711] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-09T20:15:42.539055] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T20:15:42.544587] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T20:15:42.558178] [INFO ] [REMOTE ] MOV: Full fetch complete (30566 records). [2025-10-09T20:15:42.558370] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-09T20:15:42.985453] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-09T20:15:42.983500] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-09T20:15:42.995955] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-09T20:15:42.997859] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-09T20:15:42.998248] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-09T20:15:42.999999] [DEBUG] [LOCAL ] MOV: Trimmed 30566 records to 21950 (keeping 200 days of data) [2025-10-09T20:15:43.078708] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T20:15:43.106092] [INFO ] [REMOTE ] MPA: Full fetch complete (7165 records). [2025-10-09T20:15:43.106186] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-09T20:15:43.197745] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-09T20:15:43.484018] [DEBUG] [LOCAL ] MOV: Primary data saved (21950 records). [2025-10-09T20:15:43.485965] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-09T20:15:43.486429] [INFO ] [MAIN ] Update Progress: 1389/2373 symbols completed. MOV took 40.5s. Estimated remaining: 2h 18m 37s. Rate: 7.1 symbols/min [2025-10-09T20:15:43.713806] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-09T20:15:43.726862] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-09T20:15:43.733398] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-09T20:15:43.740441] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-09T20:15:43.759480] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:15:43.760142] [DEBUG] [LOCAL ] MPA: Trimmed 7165 records to 5342 (keeping 200 days of data) [2025-10-09T20:15:43.797200] [DEBUG] [LOCAL ] MPA: Primary data saved (5342 records). [2025-10-09T20:15:43.797406] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-09T20:15:43.797502] [INFO ] [MAIN ] Update Progress: 1390/2373 symbols completed. MPA took 18.7s. Estimated remaining: 2h 18m 23s. Rate: 7.1 symbols/min [2025-10-09T20:15:43.998897] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-09T20:15:44.029606] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:15:44.030900] [DEBUG] [LOCAL ] MPC: Loaded 52062 existing records from primary storage. [2025-10-09T20:15:44.031952] [INFO ] [MAIN ] MPC: Loaded 52062 existing records. [2025-10-09T20:15:44.227299] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:15:44.227589] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-09T20:15:44.227682] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-09T20:15:44.227927] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-09T20:15:44.227976] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-09T20:15:44.411437] [DEBUG] [LOCAL ] MPLX: Loaded 50718 existing records from primary storage. [2025-10-09T20:15:44.445874] [INFO ] [MAIN ] MPLX: Loaded 50718 existing records. [2025-10-09T20:15:44.799480] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:15:44.800599] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-09T20:15:44.806085] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-09T20:15:44.855718] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-09T20:15:44.855897] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-09T20:15:44.928835] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:15:44.954913] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-09T20:15:45.282524] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:15:45.277079] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-09T20:15:45.596698] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-09T20:15:46.396698] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-09T20:15:46.542068] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-09T20:15:46.733231] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T20:15:46.950102] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T20:15:47.196730] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-09T20:15:47.996843] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-09T20:15:48.224534] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T20:15:48.636111] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T20:15:48.796757] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-09T20:15:49.596708] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-09T20:15:50.267805] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T20:15:50.396713] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-09T20:15:50.786446] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-09T20:15:50.791327] [INFO ] [REMOTE ] MP: Full fetch complete (77380 records). [2025-10-09T20:15:50.791461] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-09T20:15:51.187966] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-09T20:15:51.188085] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-09T20:15:51.189257] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-09T20:15:51.189328] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-09T20:15:51.190919] [DEBUG] [LOCAL ] MP: Trimmed 77380 records to 54081 (keeping 200 days of data) [2025-10-09T20:15:51.196704] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-09T20:15:51.462729] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T20:15:51.580125] [DEBUG] [LOCAL ] MP: Primary data saved (54081 records). [2025-10-09T20:15:51.580280] [INFO ] [MAIN ] MP: Full history saved. [2025-10-09T20:15:51.580369] [INFO ] [MAIN ] Update Progress: 1391/2373 symbols completed. MP took 34.8s. Estimated remaining: 2h 18m 14s. Rate: 7.1 symbols/min [2025-10-09T20:15:51.760262] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:15:51.768149] [DEBUG] [LOCAL ] MPV: Loaded 4885 existing records from primary storage. [2025-10-09T20:15:51.768383] [INFO ] [MAIN ] MPV: Loaded 4885 existing records. [2025-10-09T20:15:51.951193] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T20:15:51.968847] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:15:51.969224] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-09T20:15:51.969274] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-09T20:15:51.969443] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-09T20:15:51.969715] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-09T20:15:51.969566] [INFO ] [REMOTE ] MOS: Full fetch complete (77455 records). [2025-10-09T20:15:52.006073] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-09T20:15:52.012373] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-09T20:15:52.693950] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:15:52.778543] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-09T20:15:52.778638] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-09T20:15:52.779809] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-09T20:15:52.779879] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-09T20:15:52.781551] [DEBUG] [LOCAL ] MOS: Trimmed 77455 records to 53894 (keeping 200 days of data) [2025-10-09T20:15:52.837099] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-09T20:15:53.145036] [DEBUG] [LOCAL ] MOS: Primary data saved (53894 records). [2025-10-09T20:15:53.145370] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-09T20:15:53.145563] [INFO ] [MAIN ] Update Progress: 1392/2373 symbols completed. MOS took 55.2s. Estimated remaining: 2h 18m 0s. Rate: 7.1 symbols/min [2025-10-09T20:15:53.365860] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:15:53.369055] [DEBUG] [LOCAL ] MPW: No existing data file found in primary storage. [2025-10-09T20:15:53.368783] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-09T20:15:53.369161] [WARN ] [MAIN ] MPW: No existing data found, performing full refresh instead. [2025-10-09T20:15:53.380168] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-09T20:15:53.380722] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-09T20:15:53.380792] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-09T20:15:53.380830] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-09T20:15:53.598523] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-09T20:15:53.639483] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T20:15:53.850052] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:15:53.880450] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T20:15:54.396742] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-09T20:15:55.196743] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-09T20:15:55.277073] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T20:15:55.623388] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T20:15:55.892102] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:15:55.996724] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-09T20:15:56.796718] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-09T20:15:57.602238] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-09T20:15:57.607757] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T20:15:58.319151] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T20:15:58.396718] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-09T20:15:58.633154] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T20:15:59.196723] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-09T20:15:59.861842] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T20:15:59.996765] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-09T20:16:00.786221] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T20:16:00.796754] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-09T20:16:01.596707] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-09T20:16:01.951446] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T20:16:02.411568] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-09T20:16:02.434207] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T20:16:03.104761] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T20:16:03.196747] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-09T20:16:03.584756] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-09T20:16:03.670003] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-09T20:16:03.996744] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-09T20:16:04.796724] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-09T20:16:05.532947] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T20:16:05.596731] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-09T20:16:06.396696] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-09T20:16:06.521680] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:16:06.890946] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-09T20:16:07.196724] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-09T20:16:07.736419] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T20:16:07.996709] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-09T20:16:08.065223] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T20:16:08.619237] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T20:16:08.796775] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-09T20:16:09.421396] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T20:16:09.425638] [INFO ] [REMOTE ] MPC: Full fetch complete (75399 records). [2025-10-09T20:16:09.425802] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-09T20:16:09.426716] [FATAL] [VALIDATOR ] MPC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:16:09.426866] [FATAL] [MAIN ] MPC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:16:09.426941] [WARN ] [MAIN ] MPC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:16:09.427037] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-09T20:16:09.427119] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-09T20:16:09.427161] [INFO ] [LOCAL ] MPC: Starting deletion of derivative data. [2025-10-09T20:16:09.427475] [DEBUG] [LOCAL ] MPC: Deleted derivative data file. [2025-10-09T20:16:09.427584] [INFO ] [MAIN ] Update Progress: 1393/2373 symbols completed. MPC took 25.9s. Estimated remaining: 2h 17m 58s. Rate: 7.1 symbols/min [2025-10-09T20:16:09.601787] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-09T20:16:09.605555] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:16:09.605712] [DEBUG] [LOCAL ] MPX: No existing data file found in primary storage. [2025-10-09T20:16:09.605993] [WARN ] [MAIN ] MPX: No existing data found, performing full refresh instead. [2025-10-09T20:16:09.606938] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-09T20:16:09.606999] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-09T20:16:09.607050] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-09T20:16:09.607084] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-09T20:16:09.971632] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:16:10.396746] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-09T20:16:11.196739] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-09T20:16:11.616487] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T20:16:11.741629] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T20:16:11.996781] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-09T20:16:12.277593] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T20:16:12.796797] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-09T20:16:13.451451] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T20:16:13.596721] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-09T20:16:14.120609] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-09T20:16:14.392445] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T20:16:14.396704] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-09T20:16:15.196756] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-09T20:16:15.872794] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T20:16:15.996695] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-09T20:16:16.048446] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T20:16:16.484133] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T20:16:16.796782] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-09T20:16:17.174158] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T20:16:17.175057] [INFO ] [REMOTE ] MPV: Full fetch complete (7905 records). [2025-10-09T20:16:17.175125] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-09T20:16:17.175489] [FATAL] [VALIDATOR ] MPV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:16:17.175583] [FATAL] [MAIN ] MPV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:16:17.175686] [WARN ] [MAIN ] MPV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:16:17.175763] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-09T20:16:17.175827] [DEBUG] [LOCAL ] MPV: No primary data file found to delete. [2025-10-09T20:16:17.175863] [INFO ] [LOCAL ] MPV: Starting deletion of derivative data. [2025-10-09T20:16:17.176084] [DEBUG] [LOCAL ] MPV: Deleted derivative data file. [2025-10-09T20:16:17.176175] [INFO ] [MAIN ] Update Progress: 1394/2373 symbols completed. MPV took 25.6s. Estimated remaining: 2h 17m 49s. Rate: 7.1 symbols/min [2025-10-09T20:16:17.352057] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:16:17.363404] [DEBUG] [LOCAL ] MQT: Loaded 8683 existing records from primary storage. [2025-10-09T20:16:17.363615] [INFO ] [MAIN ] MQT: Loaded 8683 existing records. [2025-10-09T20:16:17.538104] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:16:17.538340] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-09T20:16:17.538394] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-09T20:16:17.538577] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-09T20:16:17.538634] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-09T20:16:17.601855] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-09T20:16:17.897883] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:16:18.396720] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-09T20:16:19.187018] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T20:16:19.196666] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-09T20:16:19.572191] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T20:16:19.753500] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T20:16:19.996752] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-09T20:16:20.730275] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T20:16:20.796764] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-09T20:16:21.596717] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-09T20:16:21.702088] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T20:16:22.396793] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-09T20:16:23.196719] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-09T20:16:23.244711] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T20:16:23.544830] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-09T20:16:23.932242] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T20:16:23.996724] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-09T20:16:24.704701] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T20:16:24.796770] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-09T20:16:25.596734] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-09T20:16:25.651560] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T20:16:25.655826] [INFO ] [REMOTE ] MPLX: Full fetch complete (73673 records). [2025-10-09T20:16:25.655934] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-09T20:16:25.656702] [FATAL] [VALIDATOR ] MPLX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:16:25.656805] [FATAL] [MAIN ] MPLX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:16:25.656848] [WARN ] [MAIN ] MPLX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:16:25.656886] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-09T20:16:25.656969] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-09T20:16:25.657035] [INFO ] [LOCAL ] MPLX: Starting deletion of derivative data. [2025-10-09T20:16:25.657443] [DEBUG] [LOCAL ] MPLX: Deleted derivative data file. [2025-10-09T20:16:25.657568] [INFO ] [MAIN ] Update Progress: 1395/2373 symbols completed. MPLX took 41.9s. Estimated remaining: 2h 17m 40s. Rate: 7.1 symbols/min [2025-10-09T20:16:25.842159] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:16:25.860833] [DEBUG] [LOCAL ] MQY: Loaded 16861 existing records from primary storage. [2025-10-09T20:16:25.861113] [INFO ] [MAIN ] MQY: Loaded 16861 existing records. [2025-10-09T20:16:26.063221] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:16:26.063433] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-09T20:16:26.063487] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-09T20:16:26.063740] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-09T20:16:26.063799] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-09T20:16:26.397717] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T20:16:26.403051] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-09T20:16:26.446720] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:16:27.126306] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T20:16:27.196747] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-09T20:16:27.996736] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-09T20:16:28.012595] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T20:16:28.796737] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-09T20:16:29.343819] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T20:16:29.596703] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-09T20:16:29.637932] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T20:16:30.396720] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-09T20:16:31.196699] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-09T20:16:31.326960] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T20:16:31.843705] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-09T20:16:31.996683] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-09T20:16:32.223757] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T20:16:32.796744] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-09T20:16:33.486395] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T20:16:33.596741] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-09T20:16:34.074827] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-09T20:16:34.296900] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:16:34.396734] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-09T20:16:35.196756] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-09T20:16:35.452112] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T20:16:35.749125] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T20:16:35.996766] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-09T20:16:36.796730] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-09T20:16:37.023251] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T20:16:37.372106] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T20:16:37.596725] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-09T20:16:38.396694] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-09T20:16:38.622195] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-09T20:16:38.623391] [INFO ] [REMOTE ] MPX: Full fetch complete (6622 records). [2025-10-09T20:16:38.623466] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-09T20:16:38.623885] [FATAL] [VALIDATOR ] MPX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:16:38.623987] [FATAL] [MAIN ] MPX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:16:38.624042] [WARN ] [MAIN ] MPX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:16:38.624095] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-09T20:16:38.624199] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-09T20:16:38.624262] [INFO ] [LOCAL ] MPX: Starting deletion of derivative data. [2025-10-09T20:16:38.624310] [DEBUG] [LOCAL ] MPX: No derivative data file found to delete. [2025-10-09T20:16:38.624370] [INFO ] [MAIN ] Update Progress: 1396/2373 symbols completed. MPX took 29.2s. Estimated remaining: 2h 17m 35s. Rate: 7.1 symbols/min [2025-10-09T20:16:38.858801] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T20:16:38.866994] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:16:38.871434] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-09T20:16:38.871489] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-09T20:16:38.871997] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-09T20:16:38.872100] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-09T20:16:38.872161] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-09T20:16:38.872200] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-09T20:16:39.207733] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-09T20:16:39.258619] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:16:39.882031] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T20:16:39.888367] [INFO ] [REMOTE ] MPW: Full fetch complete (77119 records). [2025-10-09T20:16:39.888485] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-09T20:16:39.890272] [FATAL] [VALIDATOR ] MPW: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:16:39.890367] [FATAL] [MAIN ] MPW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:16:39.890412] [WARN ] [MAIN ] MPW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:16:39.890454] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-09T20:16:39.890516] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-09T20:16:39.890553] [INFO ] [LOCAL ] MPW: Starting deletion of derivative data. [2025-10-09T20:16:39.890595] [DEBUG] [LOCAL ] MPW: No derivative data file found to delete. [2025-10-09T20:16:39.890677] [INFO ] [MAIN ] Update Progress: 1397/2373 symbols completed. MPW took 46.7s. Estimated remaining: 2h 17m 21s. Rate: 7.1 symbols/min [2025-10-09T20:16:39.996745] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-09T20:16:40.796758] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-09T20:16:41.153348] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T20:16:41.596722] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-09T20:16:42.089082] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T20:16:42.396722] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-09T20:16:42.620602] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T20:16:43.196710] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-09T20:16:43.376227] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T20:16:43.994967] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T20:16:43.998711] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-09T20:16:44.796719] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-09T20:16:45.195435] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T20:16:45.506865] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T20:16:45.596727] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-09T20:16:46.396698] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-09T20:16:46.814850] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T20:16:47.152767] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T20:16:47.196678] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-09T20:16:47.996744] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-09T20:16:48.386327] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T20:16:48.796735] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-09T20:16:49.604554] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-09T20:16:49.609586] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T20:16:49.671801] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T20:16:50.396719] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-09T20:16:50.825802] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T20:16:50.827022] [INFO ] [REMOTE ] MQT: Full fetch complete (13255 records). [2025-10-09T20:16:50.827092] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-09T20:16:50.827463] [FATAL] [VALIDATOR ] MQT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:16:50.827545] [FATAL] [MAIN ] MQT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:16:50.827589] [WARN ] [MAIN ] MQT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:16:50.827629] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-09T20:16:50.827757] [DEBUG] [LOCAL ] MQT: No primary data file found to delete. [2025-10-09T20:16:50.827814] [INFO ] [LOCAL ] MQT: Starting deletion of derivative data. [2025-10-09T20:16:50.828020] [DEBUG] [LOCAL ] MQT: Deleted derivative data file. [2025-10-09T20:16:50.828148] [INFO ] [MAIN ] Update Progress: 1398/2373 symbols completed. MQT took 33.7s. Estimated remaining: 2h 17m 15s. Rate: 7.1 symbols/min [2025-10-09T20:16:51.196753] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-09T20:16:51.239348] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T20:16:51.996691] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-09T20:16:52.321361] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-09T20:16:52.323221] [INFO ] [REMOTE ] MQY: Full fetch complete (26807 records). [2025-10-09T20:16:52.323290] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-09T20:16:52.323845] [FATAL] [VALIDATOR ] MQY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:16:52.323928] [FATAL] [MAIN ] MQY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:16:52.323971] [WARN ] [MAIN ] MQY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:16:52.324007] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-09T20:16:52.324061] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-09T20:16:52.324095] [INFO ] [LOCAL ] MQY: Starting deletion of derivative data. [2025-10-09T20:16:52.324238] [DEBUG] [LOCAL ] MQY: Deleted derivative data file. [2025-10-09T20:16:52.324324] [INFO ] [MAIN ] Update Progress: 1399/2373 symbols completed. MQY took 26.7s. Estimated remaining: 2h 17m 1s. Rate: 7.1 symbols/min [2025-10-09T20:16:52.427611] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T20:16:52.796776] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-09T20:16:53.967677] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T20:16:53.979729] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-09T20:16:55.316371] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T20:16:55.325133] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-09T20:16:57.061713] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T20:16:57.086676] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-09T20:16:58.648991] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T20:16:58.656900] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-09T20:16:59.106577] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T20:16:59.114766] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-09T20:16:59.534482] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T20:16:59.537431] [INFO ] [REMOTE ] MRC: Full fetch complete (54541 records). [2025-10-09T20:16:59.537587] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-09T20:16:59.538381] [FATAL] [VALIDATOR ] MRC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:16:59.538472] [FATAL] [MAIN ] MRC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:16:59.538516] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:16:59.538555] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-09T20:16:59.538612] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-09T20:16:59.538671] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-09T20:16:59.538737] [DEBUG] [LOCAL ] MRC: No derivative data file found to delete. [2025-10-09T20:16:59.538795] [INFO ] [MAIN ] Update Progress: 1400/2373 symbols completed. MRC took 20.9s. Estimated remaining: 2h 16m 52s. Rate: 7.1 symbols/min [2025-10-09T20:17:00.227930] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:00.247896] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:00.250856] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:00.247037] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:00.251053] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-09T20:17:00.251467] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-09T20:17:00.251353] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-09T20:17:00.251229] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-09T20:17:00.251872] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-09T20:17:00.251946] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-09T20:17:00.251757] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-09T20:17:00.251665] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-09T20:17:00.252310] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-09T20:17:00.252429] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-09T20:17:00.252237] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-09T20:17:00.252668] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-09T20:17:00.252989] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-09T20:17:00.252926] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-09T20:17:00.253157] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-09T20:17:00.253263] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-09T20:17:00.253364] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-09T20:17:00.253456] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-09T20:17:00.253626] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-09T20:17:00.253947] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-09T20:17:00.253792] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-09T20:17:00.253883] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-09T20:17:00.254140] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-09T20:17:00.254275] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-09T20:17:01.653365] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:01.731430] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-09T20:17:01.877946] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:01.884820] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:01.891839] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-09T20:17:01.891338] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:01.892207] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-09T20:17:01.893502] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-09T20:17:02.248918] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:17:02.249310] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-09T20:17:02.249430] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:17:02.249496] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-09T20:17:02.249552] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:17:02.249613] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-09T20:17:02.249738] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-09T20:17:02.249803] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-09T20:17:02.249886] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-09T20:17:02.249979] [INFO ] [MAIN ] Update Progress: 1401/2373 symbols completed. MRP took 2.7s. Estimated remaining: 2h 16m 40s. Rate: 7.1 symbols/min [2025-10-09T20:17:02.433066] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:02.433259] [DEBUG] [LOCAL ] MSB: No existing data file found in primary storage. [2025-10-09T20:17:02.433301] [WARN ] [MAIN ] MSB: No existing data found, performing full refresh instead. [2025-10-09T20:17:02.433378] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-09T20:17:02.433415] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-09T20:17:02.433456] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-09T20:17:02.433488] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-09T20:17:02.788163] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:02.788548] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-09T20:17:02.826978] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T20:17:02.830777] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-09T20:17:03.503258] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T20:17:03.505159] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-09T20:17:03.578605] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T20:17:03.589662] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-09T20:17:03.806939] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T20:17:03.855102] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T20:17:03.996726] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-09T20:17:04.324745] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T20:17:04.796725] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-09T20:17:05.438598] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T20:17:05.543611] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T20:17:05.596668] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-09T20:17:06.260230] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-09T20:17:06.396684] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-09T20:17:06.518086] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T20:17:07.196712] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-09T20:17:07.375921] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T20:17:07.996773] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-09T20:17:08.796744] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-09T20:17:09.083471] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T20:17:09.532245] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-09T20:17:09.596674] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-09T20:17:10.396683] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-09T20:17:10.717870] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-09T20:17:11.196740] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-09T20:17:11.531007] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T20:17:11.558969] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T20:17:11.996711] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-09T20:17:12.143802] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T20:17:12.796719] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-09T20:17:13.596703] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-09T20:17:13.640026] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T20:17:13.875450] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T20:17:14.396814] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-09T20:17:14.546937] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T20:17:15.196703] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-09T20:17:15.996750] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-09T20:17:16.497290] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T20:17:16.632958] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-09T20:17:16.796713] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-09T20:17:16.820712] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T20:17:17.596734] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-09T20:17:18.396732] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-09T20:17:18.464766] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-09T20:17:18.808325] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T20:17:19.196741] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-09T20:17:19.770362] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T20:17:19.996745] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-09T20:17:20.281330] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T20:17:20.770088] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T20:17:20.796676] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-09T20:17:21.330543] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T20:17:21.596738] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-09T20:17:22.396692] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-09T20:17:22.561317] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T20:17:23.196756] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-09T20:17:23.691114] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T20:17:23.996736] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-09T20:17:24.259546] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-09T20:17:24.260705] [INFO ] [REMOTE ] MSB: Full fetch complete (12916 records). [2025-10-09T20:17:24.260776] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-09T20:17:24.261152] [FATAL] [VALIDATOR ] MSB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:17:24.261251] [FATAL] [MAIN ] MSB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:17:24.261325] [WARN ] [MAIN ] MSB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:17:24.261417] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-09T20:17:24.261504] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-09T20:17:24.261562] [INFO ] [LOCAL ] MSB: Starting deletion of derivative data. [2025-10-09T20:17:24.261630] [DEBUG] [LOCAL ] MSB: No derivative data file found to delete. [2025-10-09T20:17:24.261728] [INFO ] [MAIN ] Update Progress: 1402/2373 symbols completed. MSB took 22.0s. Estimated remaining: 2h 16m 41s. Rate: 7.1 symbols/min [2025-10-09T20:17:24.435562] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:24.435783] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-09T20:17:24.435828] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-09T20:17:24.435942] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-09T20:17:24.435982] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-09T20:17:24.436023] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-09T20:17:24.436054] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-09T20:17:24.793145] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:24.804676] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-09T20:17:24.823677] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-09T20:17:25.205336] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-09T20:17:25.596800] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-09T20:17:26.053897] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:17:26.055955] [INFO ] [REMOTE ] MSA: Full fetch complete (25638 records). [2025-10-09T20:17:26.056044] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-09T20:17:26.056681] [FATAL] [VALIDATOR ] MSA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:17:26.056916] [FATAL] [MAIN ] MSA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:17:26.056995] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:17:26.057082] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-09T20:17:26.057234] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-09T20:17:26.057292] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-09T20:17:26.057340] [DEBUG] [LOCAL ] MSA: No derivative data file found to delete. [2025-10-09T20:17:26.057411] [INFO ] [MAIN ] Update Progress: 1403/2373 symbols completed. MSA took 26.5s. Estimated remaining: 2h 16m 28s. Rate: 7.1 symbols/min [2025-10-09T20:17:26.234545] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:26.234761] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-09T20:17:26.234808] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-09T20:17:26.234927] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-09T20:17:26.234967] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-09T20:17:26.235008] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-09T20:17:26.235039] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-09T20:17:26.406772] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-09T20:17:26.599053] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:27.119725] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T20:17:27.196840] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-09T20:17:27.996795] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-09T20:17:28.588139] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T20:17:28.796763] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-09T20:17:29.321511] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T20:17:29.434532] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-09T20:17:29.596822] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-09T20:17:30.396770] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-09T20:17:31.109637] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T20:17:31.196785] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-09T20:17:31.996743] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-09T20:17:32.305152] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-09T20:17:32.416400] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T20:17:32.796803] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-09T20:17:33.596771] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-09T20:17:34.062455] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T20:17:34.396741] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-09T20:17:34.553410] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-09T20:17:34.798156] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-09T20:17:35.196759] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-09T20:17:35.522372] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T20:17:35.622781] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T20:17:35.996767] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-09T20:17:36.435957] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-09T20:17:36.796758] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-09T20:17:37.596725] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-09T20:17:38.203827] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T20:17:38.396759] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-09T20:17:38.857335] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-09T20:17:39.196736] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-09T20:17:39.713047] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T20:17:39.996803] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-09T20:17:40.473863] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-09T20:17:40.667088] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T20:17:40.796754] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-09T20:17:41.596757] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-09T20:17:42.082425] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T20:17:42.396759] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-09T20:17:42.722249] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-09T20:17:42.723589] [INFO ] [REMOTE ] MSC: Full fetch complete (2522 records). [2025-10-09T20:17:42.723749] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-09T20:17:42.725105] [FATAL] [VALIDATOR ] MSC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:17:42.754226] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:17:42.757514] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:17:42.757628] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-09T20:17:42.758093] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-09T20:17:42.758672] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-09T20:17:42.760134] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-09T20:17:42.760383] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-09T20:17:42.771874] [INFO ] [MAIN ] Update Progress: 1404/2373 symbols completed. MSC took 18.5s. Estimated remaining: 2h 16m 25s. Rate: 7.1 symbols/min [2025-10-09T20:17:42.960132] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:42.980986] [DEBUG] [LOCAL ] MSD: Loaded 16093 existing records from primary storage. [2025-10-09T20:17:42.981311] [INFO ] [MAIN ] MSD: Loaded 16093 existing records. [2025-10-09T20:17:43.175203] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:17:43.175521] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-09T20:17:43.175575] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-09T20:17:43.175841] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-09T20:17:43.175901] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-09T20:17:43.201880] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-09T20:17:43.596610] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:43.996738] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-09T20:17:44.478313] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T20:17:44.613341] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T20:17:44.796717] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-09T20:17:45.596715] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-09T20:17:46.008817] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T20:17:46.223077] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T20:17:46.227313] [INFO ] [REMOTE ] MRK: Full fetch complete (77467 records). [2025-10-09T20:17:46.227444] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-09T20:17:46.228681] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:17:46.228800] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:17:46.228875] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:17:46.228971] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-09T20:17:46.229055] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-09T20:17:46.229093] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-09T20:17:46.229133] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-09T20:17:46.229193] [INFO ] [MAIN ] Update Progress: 1405/2373 symbols completed. MRK took 46.7s. Estimated remaining: 2h 16m 13s. Rate: 7.1 symbols/min [2025-10-09T20:17:46.403588] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-09T20:17:46.406875] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:46.407820] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-09T20:17:46.407865] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-09T20:17:46.408005] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-09T20:17:46.408063] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-09T20:17:46.408108] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-09T20:17:46.408140] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-09T20:17:46.769524] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:47.192584] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T20:17:47.196666] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-09T20:17:47.996723] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-09T20:17:48.796743] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-09T20:17:48.898472] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T20:17:48.981214] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T20:17:49.596747] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-09T20:17:50.005056] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T20:17:50.396740] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-09T20:17:50.564768] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:17:51.196726] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-09T20:17:51.961160] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T20:17:51.996684] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-09T20:17:52.064406] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T20:17:52.796707] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-09T20:17:53.480528] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T20:17:53.503428] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-09T20:17:53.596797] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-09T20:17:54.396725] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-09T20:17:54.575881] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T20:17:55.196742] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-09T20:17:55.927025] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T20:17:55.996758] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-09T20:17:56.122546] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T20:17:56.796695] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-09T20:17:56.902864] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T20:17:57.527998] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:17:57.532379] [INFO ] [REMOTE ] MS: Full fetch complete (77326 records). [2025-10-09T20:17:57.532528] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-09T20:17:57.533364] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:17:57.533470] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:17:57.533541] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:17:57.533611] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-09T20:17:57.533727] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-09T20:17:57.533784] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-09T20:17:57.533828] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-09T20:17:57.533917] [INFO ] [MAIN ] Update Progress: 1406/2373 symbols completed. MS took 58.0s. Estimated remaining: 2h 16m 7s. Rate: 7.1 symbols/min [2025-10-09T20:17:57.601969] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-09T20:17:57.724395] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:57.724591] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-09T20:17:57.724667] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-09T20:17:57.724788] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-09T20:17:57.724829] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-09T20:17:57.724869] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-09T20:17:57.724899] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-09T20:17:58.072803] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:17:58.396707] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-09T20:17:58.601093] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T20:17:59.196751] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-09T20:17:59.562226] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T20:17:59.648693] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T20:17:59.651007] [INFO ] [REMOTE ] MSCI: Full fetch complete (50060 records). [2025-10-09T20:17:59.651087] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-09T20:17:59.651681] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:17:59.651784] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:17:59.651902] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:17:59.651997] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-09T20:17:59.652075] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-09T20:17:59.652112] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-09T20:17:59.652151] [DEBUG] [LOCAL ] MSCI: No derivative data file found to delete. [2025-10-09T20:17:59.652205] [INFO ] [MAIN ] Update Progress: 1407/2373 symbols completed. MSCI took 33.6s. Estimated remaining: 2h 15m 54s. Rate: 7.1 symbols/min [2025-10-09T20:17:59.819246] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:17:59.819427] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-09T20:17:59.819464] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-09T20:17:59.819603] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-09T20:17:59.819686] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-09T20:17:59.819746] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-09T20:17:59.819779] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-09T20:18:00.003178] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-09T20:18:00.190969] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:18:00.796725] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-09T20:18:01.062334] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T20:18:01.596697] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-09T20:18:02.396806] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-09T20:18:02.483616] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-09T20:18:02.537857] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T20:18:03.196844] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-09T20:18:03.301710] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T20:18:03.996758] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-09T20:18:04.352222] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T20:18:04.796744] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-09T20:18:05.400981] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T20:18:05.453162] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:18:05.596723] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-09T20:18:06.396731] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-09T20:18:06.667242] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T20:18:07.196703] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-09T20:18:07.273520] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T20:18:07.529989] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-09T20:18:07.532180] [INFO ] [REMOTE ] MSD: Full fetch complete (22594 records). [2025-10-09T20:18:07.532251] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-09T20:18:07.532738] [FATAL] [VALIDATOR ] MSD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:18:07.532823] [FATAL] [MAIN ] MSD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:18:07.532912] [WARN ] [MAIN ] MSD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:18:07.532996] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-09T20:18:07.533072] [DEBUG] [LOCAL ] MSD: No primary data file found to delete. [2025-10-09T20:18:07.533126] [INFO ] [LOCAL ] MSD: Starting deletion of derivative data. [2025-10-09T20:18:07.533339] [DEBUG] [LOCAL ] MSD: Deleted derivative data file. [2025-10-09T20:18:07.533441] [INFO ] [MAIN ] Update Progress: 1408/2373 symbols completed. MSD took 24.8s. Estimated remaining: 2h 15m 45s. Rate: 7.1 symbols/min [2025-10-09T20:18:07.701099] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:18:07.701257] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-09T20:18:07.701311] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-09T20:18:07.701421] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-09T20:18:07.701462] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-09T20:18:07.701503] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-09T20:18:07.701533] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-09T20:18:08.011446] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-09T20:18:08.051727] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:18:08.796692] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-09T20:18:09.109728] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T20:18:09.596763] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-09T20:18:10.365824] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T20:18:10.396675] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-09T20:18:11.106528] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T20:18:11.196671] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-09T20:18:11.713163] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T20:18:11.996732] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-09T20:18:12.334374] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T20:18:12.796724] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-09T20:18:13.596723] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-09T20:18:13.729252] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T20:18:13.915194] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T20:18:14.396753] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-09T20:18:14.475454] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T20:18:15.196738] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-09T20:18:15.916691] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T20:18:15.996668] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-09T20:18:16.393814] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T20:18:16.796735] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-09T20:18:17.596704] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-09T20:18:17.722372] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T20:18:18.004396] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T20:18:18.396712] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-09T20:18:19.006228] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T20:18:19.196740] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-09T20:18:19.402632] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T20:18:19.996728] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-09T20:18:20.801847] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-09T20:18:20.816585] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T20:18:21.445487] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T20:18:21.535690] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T20:18:21.596747] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-09T20:18:22.396721] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-09T20:18:23.033106] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T20:18:23.037635] [INFO ] [REMOTE ] MSDL: Full fetch complete (55026 records). [2025-10-09T20:18:23.038038] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-09T20:18:23.039169] [FATAL] [VALIDATOR ] MSDL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:18:23.039279] [FATAL] [MAIN ] MSDL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:18:23.039327] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:18:23.039404] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-09T20:18:23.039509] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-09T20:18:23.039587] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-09T20:18:23.039703] [DEBUG] [LOCAL ] MSDL: No derivative data file found to delete. [2025-10-09T20:18:23.039832] [INFO ] [MAIN ] Update Progress: 1409/2373 symbols completed. MSDL took 36.8s. Estimated remaining: 2h 15m 41s. Rate: 7.1 symbols/min [2025-10-09T20:18:23.216001] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-09T20:18:23.250978] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:18:23.251413] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-09T20:18:23.251485] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-09T20:18:23.251613] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-09T20:18:23.251786] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-09T20:18:23.251901] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-09T20:18:23.252042] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-09T20:18:23.353835] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T20:18:23.632963] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:18:23.996789] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-09T20:18:24.562613] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T20:18:24.796733] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-09T20:18:25.029130] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:18:25.029514] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-09T20:18:25.029676] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:18:25.029795] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-09T20:18:25.029874] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:18:25.029961] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-09T20:18:25.030036] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-09T20:18:25.030081] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-09T20:18:25.030133] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-09T20:18:25.030191] [INFO ] [MAIN ] Update Progress: 1410/2373 symbols completed. MSIF took 2.0s. Estimated remaining: 2h 15m 28s. Rate: 7.1 symbols/min [2025-10-09T20:18:25.218314] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:18:25.218549] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-09T20:18:25.218593] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-09T20:18:25.218733] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-09T20:18:25.218778] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-09T20:18:25.218821] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-09T20:18:25.218854] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-09T20:18:25.589401] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:18:25.601763] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-09T20:18:25.615486] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T20:18:26.396709] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-09T20:18:27.071112] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T20:18:27.196718] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-09T20:18:27.391489] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T20:18:27.996738] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-09T20:18:28.528349] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T20:18:28.796711] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-09T20:18:28.935386] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T20:18:29.596720] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-09T20:18:30.144720] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T20:18:30.363338] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:18:30.396670] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-09T20:18:31.196725] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-09T20:18:31.789543] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T20:18:31.792995] [INFO ] [REMOTE ] MSI: Full fetch complete (57679 records). [2025-10-09T20:18:31.793117] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-09T20:18:31.796382] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:18:31.796610] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:18:31.796706] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:18:31.796783] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-09T20:18:31.796873] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-09T20:18:31.796936] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-09T20:18:31.797037] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-09T20:18:31.797130] [INFO ] [MAIN ] Update Progress: 1411/2373 symbols completed. MSI took 24.3s. Estimated remaining: 2h 15m 19s. Rate: 7.1 symbols/min [2025-10-09T20:18:31.977590] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:18:31.977937] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-09T20:18:31.978130] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-09T20:18:31.978340] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-09T20:18:31.978427] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-09T20:18:31.978601] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-09T20:18:31.978725] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-09T20:18:32.024129] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-09T20:18:32.090403] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T20:18:32.380182] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:18:32.796778] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-09T20:18:33.276186] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T20:18:33.596714] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-09T20:18:33.746174] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T20:18:34.396758] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-09T20:18:35.196737] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-09T20:18:35.359477] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T20:18:35.377048] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T20:18:35.996756] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-09T20:18:36.796704] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-09T20:18:36.825683] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T20:18:37.090339] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T20:18:37.596722] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-09T20:18:38.390597] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T20:18:38.396757] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-09T20:18:38.561669] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T20:18:39.196725] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-09T20:18:39.325061] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T20:18:39.996751] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-09T20:18:40.796705] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-09T20:18:40.887286] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T20:18:41.103877] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T20:18:41.597076] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-09T20:18:42.141331] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T20:18:42.159913] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:18:42.164246] [INFO ] [REMOTE ] MSGS: Full fetch complete (23293 records). [2025-10-09T20:18:42.164448] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-09T20:18:42.165768] [FATAL] [VALIDATOR ] MSGS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:18:42.165946] [FATAL] [MAIN ] MSGS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:18:42.166030] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:18:42.166125] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-09T20:18:42.166236] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-09T20:18:42.166308] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-09T20:18:42.166379] [DEBUG] [LOCAL ] MSGS: No derivative data file found to delete. [2025-10-09T20:18:42.166487] [INFO ] [MAIN ] Update Progress: 1412/2373 symbols completed. MSGS took 42.5s. Estimated remaining: 2h 15m 12s. Rate: 7.1 symbols/min [2025-10-09T20:18:42.366718] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:18:42.366936] [DEBUG] [LOCAL ] MTAL: No existing data file found in primary storage. [2025-10-09T20:18:42.366992] [WARN ] [MAIN ] MTAL: No existing data found, performing full refresh instead. [2025-10-09T20:18:42.367109] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-10-09T20:18:42.367150] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-09T20:18:42.367190] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-09T20:18:42.367222] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-10-09T20:18:42.401820] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-09T20:18:42.754847] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:18:43.196756] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-09T20:18:43.910193] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T20:18:43.996720] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-09T20:18:44.796742] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-09T20:18:45.235592] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:18:45.239893] [INFO ] [REMOTE ] MSGE: Full fetch complete (40046 records). [2025-10-09T20:18:45.240068] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-09T20:18:45.240742] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:18:45.240829] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:18:45.240873] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:18:45.240939] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-09T20:18:45.241030] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-09T20:18:45.241088] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-09T20:18:45.241134] [DEBUG] [LOCAL ] MSGE: No derivative data file found to delete. [2025-10-09T20:18:45.241194] [INFO ] [MAIN ] Update Progress: 1413/2373 symbols completed. MSGE took 47.7s. Estimated remaining: 2h 14m 60s. Rate: 7.1 symbols/min [2025-10-09T20:18:45.426042] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:18:45.426591] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-09T20:18:45.426724] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-09T20:18:45.427228] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-09T20:18:45.427534] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-09T20:18:45.427947] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-09T20:18:45.436709] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-09T20:18:45.521454] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T20:18:45.610931] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-09T20:18:45.611029] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-10-09T20:18:45.907245] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:18:46.396747] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-09T20:18:46.553413] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T20:18:47.196725] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-10-09T20:18:47.996707] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-09T20:18:48.090871] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T20:18:48.272464] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T20:18:48.796780] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-09T20:18:49.420348] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T20:18:49.596731] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-09T20:18:50.275448] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T20:18:50.402022] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-09T20:18:50.419217] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T20:18:51.196715] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-09T20:18:51.996741] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-09T20:18:52.303909] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-09T20:18:52.363686] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T20:18:52.367267] [INFO ] [REMOTE ] MSM: Full fetch complete (51737 records). [2025-10-09T20:18:52.367554] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-09T20:18:52.368803] [FATAL] [VALIDATOR ] MSM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:18:52.368919] [FATAL] [MAIN ] MSM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:18:52.368979] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:18:52.369057] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-09T20:18:52.369158] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-09T20:18:52.369198] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-09T20:18:52.369240] [DEBUG] [LOCAL ] MSM: No derivative data file found to delete. [2025-10-09T20:18:52.369317] [INFO ] [MAIN ] Update Progress: 1414/2373 symbols completed. MSM took 27.3s. Estimated remaining: 2h 14m 50s. Rate: 7.1 symbols/min [2025-10-09T20:18:52.580786] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:18:52.581132] [DEBUG] [LOCAL ] MTD: No existing data file found in primary storage. [2025-10-09T20:18:52.581192] [WARN ] [MAIN ] MTD: No existing data found, performing full refresh instead. [2025-10-09T20:18:52.581325] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-09T20:18:52.581368] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-09T20:18:52.581409] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-09T20:18:52.581443] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-09T20:18:52.804066] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-09T20:18:52.999905] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:18:53.005390] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T20:18:53.596750] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-10-09T20:18:54.396708] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-09T20:18:54.419702] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T20:18:54.621754] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T20:18:55.196763] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-09T20:18:55.877878] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T20:18:55.996680] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-09T20:18:56.713685] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T20:18:56.796689] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-09T20:18:57.596733] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-09T20:18:57.667684] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T20:18:58.319159] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T20:18:58.396724] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-09T20:18:58.720105] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T20:18:59.196738] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-09T20:18:59.324022] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T20:18:59.996743] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-09T20:19:00.796748] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-10-09T20:19:01.296398] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-09T20:19:01.596766] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-09T20:19:01.769025] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T20:19:01.989194] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T20:19:02.230737] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T20:19:02.396741] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-09T20:19:03.196805] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-10-09T20:19:03.996704] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-09T20:19:04.271618] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T20:19:04.589315] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T20:19:04.736367] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T20:19:04.796677] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-09T20:19:05.596710] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-09T20:19:05.700133] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T20:19:05.864603] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-09T20:19:05.868545] [INFO ] [REMOTE ] MT: Full fetch complete (73147 records). [2025-10-09T20:19:05.868706] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-09T20:19:05.871060] [FATAL] [VALIDATOR ] MT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:19:05.871158] [FATAL] [MAIN ] MT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:19:05.871225] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:19:05.871267] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-09T20:19:05.871323] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-09T20:19:05.871361] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-09T20:19:05.871399] [DEBUG] [LOCAL ] MT: No derivative data file found to delete. [2025-10-09T20:19:05.871456] [INFO ] [MAIN ] Update Progress: 1415/2373 symbols completed. MT took 34.1s. Estimated remaining: 2h 14m 45s. Rate: 7.1 symbols/min [2025-10-09T20:19:06.045151] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:19:06.045374] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-09T20:19:06.045429] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-09T20:19:06.045543] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-09T20:19:06.045584] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-09T20:19:06.045624] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-09T20:19:06.045689] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-09T20:19:06.405367] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-09T20:19:06.412828] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:19:07.196759] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-10-09T20:19:07.996730] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-09T20:19:08.259524] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T20:19:08.482849] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T20:19:08.796791] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-09T20:19:09.031917] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T20:19:09.596732] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-09T20:19:10.396701] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-09T20:19:10.455761] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T20:19:10.831878] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T20:19:11.196710] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-09T20:19:11.965764] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T20:19:11.996679] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-10-09T20:19:12.052163] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T20:19:12.796728] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-09T20:19:13.436623] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T20:19:13.596744] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-10-09T20:19:14.349230] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T20:19:14.396669] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-09T20:19:14.822778] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T20:19:15.197076] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-09T20:19:15.692433] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T20:19:15.696285] [INFO ] [REMOTE ] MTB: Full fetch complete (67569 records). [2025-10-09T20:19:15.696458] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-09T20:19:15.697561] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:19:15.697771] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:19:15.697829] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:19:15.697915] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-09T20:19:15.697997] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-09T20:19:15.698035] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-09T20:19:15.698073] [DEBUG] [LOCAL ] MTB: No derivative data file found to delete. [2025-10-09T20:19:15.698146] [INFO ] [MAIN ] Update Progress: 1416/2373 symbols completed. MTB took 30.5s. Estimated remaining: 2h 14m 38s. Rate: 7.1 symbols/min [2025-10-09T20:19:15.891108] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:19:15.891359] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-09T20:19:15.891459] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-09T20:19:15.891627] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-09T20:19:15.891724] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-09T20:19:15.891805] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-09T20:19:15.891978] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-09T20:19:15.996783] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-09T20:19:16.300398] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:19:16.305259] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T20:19:16.796718] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-09T20:19:17.176367] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T20:19:17.596787] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-10-09T20:19:18.367613] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T20:19:18.396743] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-09T20:19:19.196700] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-09T20:19:19.302963] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T20:19:19.880519] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T20:19:19.996713] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-10-09T20:19:20.037073] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T20:19:20.796701] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-09T20:19:20.986533] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T20:19:21.596703] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-10. [2025-10-09T20:19:21.814412] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T20:19:22.165239] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T20:19:22.169420] [INFO ] [REMOTE ] MTAL: Full fetch complete (48113 records). [2025-10-09T20:19:22.169505] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-10-09T20:19:22.170246] [FATAL] [VALIDATOR ] MTAL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:19:22.170992] [FATAL] [MAIN ] MTAL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:19:22.171078] [WARN ] [MAIN ] MTAL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:19:22.171227] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-09T20:19:22.171325] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-09T20:19:22.171376] [INFO ] [LOCAL ] MTAL: Starting deletion of derivative data. [2025-10-09T20:19:22.171422] [DEBUG] [LOCAL ] MTAL: No derivative data file found to delete. [2025-10-09T20:19:22.171488] [INFO ] [MAIN ] Update Progress: 1417/2373 symbols completed. MTAL took 40.0s. Estimated remaining: 2h 14m 28s. Rate: 7.1 symbols/min [2025-10-09T20:19:22.361818] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:19:22.362054] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-09T20:19:22.362104] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-09T20:19:22.362238] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-09T20:19:22.362307] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-09T20:19:22.362395] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-09T20:19:22.362474] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-09T20:19:22.401820] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-09T20:19:22.713555] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:19:23.196690] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-09T20:19:23.996691] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-09T20:19:24.358353] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T20:19:24.441066] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T20:19:24.644896] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T20:19:24.796752] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-09T20:19:25.596736] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-09T20:19:26.095842] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T20:19:26.097534] [INFO ] [REMOTE ] MTD: Full fetch complete (21137 records). [2025-10-09T20:19:26.097613] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-09T20:19:26.098164] [FATAL] [VALIDATOR ] MTD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:19:26.098260] [FATAL] [MAIN ] MTD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:19:26.098303] [WARN ] [MAIN ] MTD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:19:26.098375] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-09T20:19:26.098440] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-09T20:19:26.098476] [INFO ] [LOCAL ] MTD: Starting deletion of derivative data. [2025-10-09T20:19:26.098515] [DEBUG] [LOCAL ] MTD: No derivative data file found to delete. [2025-10-09T20:19:26.098571] [INFO ] [MAIN ] Update Progress: 1418/2373 symbols completed. MTD took 33.7s. Estimated remaining: 2h 14m 17s. Rate: 7.1 symbols/min [2025-10-09T20:19:26.269699] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:19:26.269881] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-09T20:19:26.270049] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-09T20:19:26.270201] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-09T20:19:26.270245] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-09T20:19:26.270287] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-09T20:19:26.270357] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-09T20:19:26.411513] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-09T20:19:26.633154] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:19:26.661361] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T20:19:27.196731] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-09T20:19:27.996750] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-09T20:19:28.179360] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T20:19:28.592372] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T20:19:28.796699] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-09T20:19:29.358082] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T20:19:29.596782] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-09T20:19:30.274700] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T20:19:30.396673] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-09T20:19:30.954212] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T20:19:31.196721] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-09T20:19:31.969344] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T20:19:31.996691] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-09T20:19:32.677691] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T20:19:32.796729] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-09T20:19:33.343194] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T20:19:33.596730] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-09T20:19:34.304430] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T20:19:34.396706] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-09T20:19:35.181976] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T20:19:35.196819] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-09T20:19:35.996686] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-09T20:19:36.080510] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T20:19:36.796709] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-09T20:19:36.951256] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T20:19:37.323063] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T20:19:37.596770] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-09T20:19:38.396775] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-09T20:19:38.464496] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T20:19:39.196768] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-09T20:19:39.432361] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T20:19:39.957907] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T20:19:39.996665] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-09T20:19:40.466012] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T20:19:40.796681] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-09T20:19:40.910483] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T20:19:41.596802] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-09T20:19:42.278592] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T20:19:42.304192] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T20:19:42.309479] [INFO ] [REMOTE ] MTDR: Full fetch complete (73400 records). [2025-10-09T20:19:42.309753] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-09T20:19:42.310933] [FATAL] [VALIDATOR ] MTDR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:19:42.312222] [FATAL] [MAIN ] MTDR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:19:42.312366] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:19:42.312454] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-09T20:19:42.312541] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-09T20:19:42.312589] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-09T20:19:42.312667] [DEBUG] [LOCAL ] MTDR: No derivative data file found to delete. [2025-10-09T20:19:42.312790] [INFO ] [MAIN ] Update Progress: 1419/2373 symbols completed. MTDR took 36.4s. Estimated remaining: 2h 14m 13s. Rate: 7.1 symbols/min [2025-10-09T20:19:42.401845] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-09T20:19:42.553203] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:19:42.553727] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-09T20:19:42.553809] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-09T20:19:42.553989] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-09T20:19:42.554069] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-09T20:19:42.554167] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-09T20:19:42.554243] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-09T20:19:42.954767] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:19:43.196726] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-09T20:19:43.984197] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T20:19:43.996677] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-09T20:19:44.435611] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T20:19:44.796740] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-09T20:19:45.520933] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T20:19:45.596683] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-09T20:19:46.396696] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-09T20:19:46.489667] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T20:19:46.907330] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T20:19:47.196816] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-09T20:19:47.523029] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T20:19:47.996886] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-09T20:19:48.563956] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T20:19:48.796750] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-09T20:19:49.596744] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-09T20:19:49.827297] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T20:19:50.032884] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-09T20:19:50.141693] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T20:19:50.396719] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-09T20:19:50.891741] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T20:19:51.196749] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-09T20:19:51.722991] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T20:19:51.996739] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-09T20:19:52.528222] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T20:19:52.796740] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-09T20:19:53.596757] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-09T20:19:54.138697] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-09T20:19:54.396733] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-09T20:19:54.502413] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T20:19:54.931567] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T20:19:55.196751] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-09T20:19:55.996743] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-09T20:19:56.763602] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T20:19:56.796701] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-09T20:19:56.823571] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T20:19:57.577580] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T20:19:57.596668] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-09T20:19:58.066840] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T20:19:58.396713] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-09T20:19:59.196746] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-09T20:19:59.313240] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:19:59.854266] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T20:19:59.857957] [INFO ] [REMOTE ] MTN: Full fetch complete (56262 records). [2025-10-09T20:19:59.858065] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-09T20:19:59.858810] [FATAL] [VALIDATOR ] MTN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:19:59.858899] [FATAL] [MAIN ] MTN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:19:59.858943] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:19:59.858985] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-09T20:19:59.859042] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-09T20:19:59.859078] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-09T20:19:59.859120] [DEBUG] [LOCAL ] MTN: No derivative data file found to delete. [2025-10-09T20:19:59.859176] [INFO ] [MAIN ] Update Progress: 1420/2373 symbols completed. MTN took 33.8s. Estimated remaining: 2h 14m 11s. Rate: 7.1 symbols/min [2025-10-09T20:20:00.005575] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-09T20:20:00.034467] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:20:00.034600] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-09T20:20:00.034678] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-09T20:20:00.034959] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-09T20:20:00.035068] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-09T20:20:00.035136] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-09T20:20:00.035175] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-09T20:20:00.393785] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:20:00.796801] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-09T20:20:01.596789] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-09T20:20:02.052394] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-09T20:20:02.396731] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-09T20:20:02.735463] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T20:20:02.808392] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-09T20:20:02.812498] [INFO ] [REMOTE ] MTG: Full fetch complete (73643 records). [2025-10-09T20:20:02.812703] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-09T20:20:02.813718] [FATAL] [VALIDATOR ] MTG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:20:02.813811] [FATAL] [MAIN ] MTG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:20:02.813855] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:20:02.813895] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-09T20:20:02.813952] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-09T20:20:02.813987] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-09T20:20:02.814025] [DEBUG] [LOCAL ] MTG: No derivative data file found to delete. [2025-10-09T20:20:02.814084] [INFO ] [MAIN ] Update Progress: 1421/2373 symbols completed. MTG took 47.1s. Estimated remaining: 2h 13m 59s. Rate: 7.1 symbols/min [2025-10-09T20:20:02.998073] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:20:02.998261] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-09T20:20:02.998299] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-09T20:20:02.998419] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-09T20:20:02.998463] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-09T20:20:02.998506] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-09T20:20:02.998542] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-09T20:20:03.198695] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-09T20:20:03.316537] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T20:20:03.398158] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:20:03.653555] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T20:20:03.654523] [INFO ] [REMOTE ] MTR: Full fetch complete (2464 records). [2025-10-09T20:20:03.654608] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-09T20:20:03.655067] [FATAL] [VALIDATOR ] MTR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:20:03.655161] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:20:03.655218] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:20:03.655314] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-09T20:20:03.655386] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-09T20:20:03.655430] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-09T20:20:03.655473] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-09T20:20:03.655535] [INFO ] [MAIN ] Update Progress: 1422/2373 symbols completed. MTR took 21.3s. Estimated remaining: 2h 13m 45s. Rate: 7.1 symbols/min [2025-10-09T20:20:03.851621] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:20:03.851844] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-09T20:20:03.851887] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-09T20:20:03.851998] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-09T20:20:03.852039] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-09T20:20:03.852081] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-09T20:20:03.852113] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-09T20:20:03.999453] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-09T20:20:04.211124] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:20:04.796774] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-09T20:20:05.571591] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T20:20:05.596677] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-09T20:20:05.739327] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T20:20:06.396706] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-09T20:20:07.079864] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T20:20:07.157261] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T20:20:07.196683] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-09T20:20:07.771803] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T20:20:07.775322] [INFO ] [REMOTE ] MTH: Full fetch complete (63091 records). [2025-10-09T20:20:07.775484] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-09T20:20:07.778231] [FATAL] [VALIDATOR ] MTH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:20:07.778362] [FATAL] [MAIN ] MTH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:20:07.778411] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:20:07.778486] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-09T20:20:07.778558] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-09T20:20:07.778599] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-09T20:20:07.778675] [DEBUG] [LOCAL ] MTH: No derivative data file found to delete. [2025-10-09T20:20:07.778767] [INFO ] [MAIN ] Update Progress: 1423/2373 symbols completed. MTH took 45.6s. Estimated remaining: 2h 13m 34s. Rate: 7.1 symbols/min [2025-10-09T20:20:07.966595] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:20:07.966783] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-09T20:20:07.966826] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-09T20:20:07.966939] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-09T20:20:07.966982] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-09T20:20:07.967047] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-09T20:20:07.967082] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-09T20:20:08.001917] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-09T20:20:08.336782] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:20:08.796715] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-09T20:20:09.148584] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T20:20:09.596721] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-09T20:20:09.758925] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T20:20:10.396709] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-09T20:20:10.782029] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T20:20:11.196770] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-09T20:20:11.483301] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T20:20:11.996732] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-09T20:20:12.471203] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T20:20:12.796730] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-09T20:20:13.280679] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T20:20:13.596740] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-09T20:20:13.686744] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T20:20:14.396699] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-09T20:20:14.677562] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T20:20:15.196727] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-09T20:20:15.848460] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T20:20:15.996682] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-09T20:20:16.688252] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T20:20:16.796702] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-09T20:20:17.399713] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T20:20:17.596735] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-09T20:20:18.192368] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T20:20:18.396707] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-09T20:20:18.443298] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T20:20:19.196727] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-09T20:20:19.384466] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T20:20:19.996749] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-09T20:20:20.009293] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T20:20:20.796735] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-09T20:20:21.270144] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T20:20:21.596733] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-09T20:20:21.961574] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T20:20:22.396750] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-09T20:20:22.926897] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T20:20:23.196772] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-09T20:20:23.824435] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T20:20:23.996719] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-09T20:20:24.415214] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T20:20:24.796743] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-09T20:20:25.527212] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T20:20:25.557745] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T20:20:25.596682] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-09T20:20:25.937114] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T20:20:25.939767] [INFO ] [REMOTE ] MTUS: Full fetch complete (41590 records). [2025-10-09T20:20:25.939869] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-09T20:20:25.940518] [FATAL] [VALIDATOR ] MTUS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:20:25.940611] [FATAL] [MAIN ] MTUS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:20:25.940740] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:20:25.940820] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-09T20:20:25.940894] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-09T20:20:25.940932] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-09T20:20:25.940973] [DEBUG] [LOCAL ] MTUS: No derivative data file found to delete. [2025-10-09T20:20:25.941036] [INFO ] [MAIN ] Update Progress: 1424/2373 symbols completed. MTUS took 23.1s. Estimated remaining: 2h 13m 32s. Rate: 7.1 symbols/min [2025-10-09T20:20:26.143850] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:20:26.144109] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-09T20:20:26.144150] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-09T20:20:26.144282] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-09T20:20:26.144324] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-09T20:20:26.144366] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-09T20:20:26.144401] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-09T20:20:26.401834] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-09T20:20:26.502924] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:20:27.196734] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-09T20:20:27.398152] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T20:20:27.996764] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-09T20:20:28.440237] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T20:20:28.796743] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-09T20:20:29.577526] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T20:20:29.596670] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-09T20:20:29.761567] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T20:20:29.950815] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T20:20:29.952377] [INFO ] [REMOTE ] MTRN: Full fetch complete (23554 records). [2025-10-09T20:20:29.952453] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-09T20:20:29.953017] [FATAL] [VALIDATOR ] MTRN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:20:29.953115] [FATAL] [MAIN ] MTRN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:20:29.953197] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:20:29.953287] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-09T20:20:29.953380] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-09T20:20:29.953434] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-09T20:20:29.953516] [DEBUG] [LOCAL ] MTRN: No derivative data file found to delete. [2025-10-09T20:20:29.953594] [INFO ] [MAIN ] Update Progress: 1425/2373 symbols completed. MTRN took 30.1s. Estimated remaining: 2h 13m 21s. Rate: 7.1 symbols/min [2025-10-09T20:20:30.118919] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:20:30.136714] [DEBUG] [LOCAL ] MUA: Loaded 11795 existing records from primary storage. [2025-10-09T20:20:30.136931] [INFO ] [MAIN ] MUA: Loaded 11795 existing records. [2025-10-09T20:20:30.310538] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:20:30.310803] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-09T20:20:30.310854] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-09T20:20:30.311206] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-09T20:20:30.311265] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-09T20:20:30.401884] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-09T20:20:30.668582] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:20:31.196760] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-09T20:20:31.976575] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T20:20:31.996679] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-09T20:20:32.189025] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T20:20:32.796729] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-09T20:20:33.188628] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T20:20:33.564359] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T20:20:33.596678] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-09T20:20:34.396698] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-09T20:20:35.196700] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-09T20:20:35.262615] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T20:20:35.534392] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T20:20:35.996724] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-09T20:20:36.458341] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T20:20:36.796726] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-09T20:20:37.469074] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T20:20:37.596702] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-09T20:20:37.766602] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T20:20:38.396705] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-09T20:20:39.196694] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-09T20:20:39.369092] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T20:20:39.636315] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T20:20:39.996700] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-09T20:20:40.300531] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T20:20:40.796705] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-09T20:20:40.899155] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T20:20:41.596747] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-09T20:20:41.663382] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T20:20:42.396708] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-09T20:20:42.841289] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T20:20:43.196735] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-09T20:20:43.462025] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T20:20:43.996765] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-09T20:20:44.616696] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T20:20:44.648369] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T20:20:44.796720] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-09T20:20:45.271840] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T20:20:45.596767] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-09T20:20:46.329113] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:20:46.331914] [INFO ] [REMOTE ] MTW: Full fetch complete (38106 records). [2025-10-09T20:20:46.332040] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-09T20:20:46.332781] [FATAL] [VALIDATOR ] MTW: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:20:46.332879] [FATAL] [MAIN ] MTW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:20:46.332926] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:20:46.332971] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-09T20:20:46.333038] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-09T20:20:46.333076] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-09T20:20:46.333117] [DEBUG] [LOCAL ] MTW: No derivative data file found to delete. [2025-10-09T20:20:46.333182] [INFO ] [MAIN ] Update Progress: 1426/2373 symbols completed. MTW took 42.7s. Estimated remaining: 2h 13m 18s. Rate: 7.1 symbols/min [2025-10-09T20:20:46.402199] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-09T20:20:46.555620] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:20:46.596571] [DEBUG] [LOCAL ] MUC: Loaded 20555 existing records from primary storage. [2025-10-09T20:20:46.597171] [INFO ] [MAIN ] MUC: Loaded 20555 existing records. [2025-10-09T20:20:46.913960] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:20:46.914384] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-09T20:20:46.914467] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-09T20:20:46.914883] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-09T20:20:46.914965] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-09T20:20:47.204831] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-09T20:20:47.429097] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:20:47.996697] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-09T20:20:48.133072] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T20:20:48.212514] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T20:20:48.796726] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-09T20:20:49.046814] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T20:20:49.412739] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T20:20:49.596729] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-09T20:20:49.956704] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T20:20:49.958460] [INFO ] [REMOTE ] MTX: Full fetch complete (31042 records). [2025-10-09T20:20:49.958547] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-09T20:20:49.959160] [FATAL] [VALIDATOR ] MTX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:20:49.959251] [FATAL] [MAIN ] MTX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:20:49.959296] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:20:49.959337] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-09T20:20:49.959396] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-09T20:20:49.959432] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-09T20:20:49.959474] [DEBUG] [LOCAL ] MTX: No derivative data file found to delete. [2025-10-09T20:20:49.959533] [INFO ] [MAIN ] Update Progress: 1427/2373 symbols completed. MTX took 42.2s. Estimated remaining: 2h 13m 6s. Rate: 7.1 symbols/min [2025-10-09T20:20:50.133594] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:20:50.146447] [DEBUG] [LOCAL ] MUE: Loaded 12015 existing records from primary storage. [2025-10-09T20:20:50.146624] [INFO ] [MAIN ] MUE: Loaded 12015 existing records. [2025-10-09T20:20:50.329522] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:20:50.329774] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-09T20:20:50.329824] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-09T20:20:50.330046] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-09T20:20:50.330103] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-09T20:20:50.402033] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-09T20:20:50.692296] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:20:51.196716] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-09T20:20:51.618944] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T20:20:51.996728] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-09T20:20:52.225166] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T20:20:52.796790] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-09T20:20:53.388102] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T20:20:53.396709] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T20:20:53.596746] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-09T20:20:54.396727] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-09T20:20:54.546916] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T20:20:55.196725] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-09T20:20:55.937588] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T20:20:55.996698] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-09T20:20:56.197545] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T20:20:56.796689] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-09T20:20:56.886799] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T20:20:57.443886] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T20:20:57.596736] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-09T20:20:58.396723] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-09T20:20:58.999824] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T20:20:59.196677] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-09T20:20:59.564395] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T20:20:59.756879] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T20:20:59.996742] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-09T20:21:00.796687] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-09T20:21:01.005384] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T20:21:01.215158] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T20:21:01.596756] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-09T20:21:02.396705] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-09T20:21:02.454949] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T20:21:03.196758] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-09T20:21:03.675615] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T20:21:03.677055] [INFO ] [REMOTE ] MUA: Full fetch complete (18615 records). [2025-10-09T20:21:03.677127] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-09T20:21:03.677695] [FATAL] [VALIDATOR ] MUA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:21:03.677816] [FATAL] [MAIN ] MUA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:21:03.677893] [WARN ] [MAIN ] MUA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:21:03.677967] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-09T20:21:03.678029] [DEBUG] [LOCAL ] MUA: No primary data file found to delete. [2025-10-09T20:21:03.678065] [INFO ] [LOCAL ] MUA: Starting deletion of derivative data. [2025-10-09T20:21:03.678290] [DEBUG] [LOCAL ] MUA: Deleted derivative data file. [2025-10-09T20:21:03.678429] [INFO ] [MAIN ] Update Progress: 1428/2373 symbols completed. MUA took 33.7s. Estimated remaining: 2h 13m 1s. Rate: 7.1 symbols/min [2025-10-09T20:21:03.795972] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T20:21:03.901470] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:03.901693] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-09T20:21:03.901747] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-09T20:21:03.901871] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-09T20:21:03.901913] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-09T20:21:03.901979] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-09T20:21:03.902013] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-09T20:21:04.001905] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-09T20:21:04.344895] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:04.796750] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-09T20:21:04.994929] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T20:21:05.596718] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-09T20:21:05.718808] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T20:21:06.396707] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-09T20:21:07.025300] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T20:21:07.028790] [INFO ] [REMOTE ] MTZ: Full fetch complete (63112 records). [2025-10-09T20:21:07.028893] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-09T20:21:07.029628] [FATAL] [VALIDATOR ] MTZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:21:07.029744] [FATAL] [MAIN ] MTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:21:07.029787] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:21:07.029850] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-09T20:21:07.029915] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-09T20:21:07.029949] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-09T20:21:07.029987] [DEBUG] [LOCAL ] MTZ: No derivative data file found to delete. [2025-10-09T20:21:07.030044] [INFO ] [MAIN ] Update Progress: 1429/2373 symbols completed. MTZ took 41.1s. Estimated remaining: 2h 12m 49s. Rate: 7.1 symbols/min [2025-10-09T20:21:07.200779] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:07.197574] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-09T20:21:07.217412] [DEBUG] [LOCAL ] MUJ: Loaded 13610 existing records from primary storage. [2025-10-09T20:21:07.217634] [INFO ] [MAIN ] MUJ: Loaded 13610 existing records. [2025-10-09T20:21:07.428493] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:21:07.423499] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T20:21:07.438924] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-09T20:21:07.438984] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-09T20:21:07.439218] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-09T20:21:07.439275] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-09T20:21:07.806497] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:07.996708] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-09T20:21:08.131899] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T20:21:08.796770] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-09T20:21:09.034289] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T20:21:09.596718] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-09T20:21:09.744483] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T20:21:10.396741] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-09T20:21:11.137023] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T20:21:11.196669] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-09T20:21:11.528264] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T20:21:11.996771] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-09T20:21:12.796686] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-09T20:21:12.809729] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T20:21:13.033506] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T20:21:13.523914] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T20:21:13.596734] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-09T20:21:14.396733] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-09T20:21:15.195308] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T20:21:15.205682] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-09T20:21:15.500027] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T20:21:15.678875] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T20:21:15.996786] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-09T20:21:16.491207] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T20:21:16.492504] [INFO ] [REMOTE ] MUE: Full fetch complete (15743 records). [2025-10-09T20:21:16.492581] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-09T20:21:16.493065] [FATAL] [VALIDATOR ] MUE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:21:16.493151] [FATAL] [MAIN ] MUE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:21:16.493195] [WARN ] [MAIN ] MUE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:21:16.493261] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-09T20:21:16.493342] [DEBUG] [LOCAL ] MUE: No primary data file found to delete. [2025-10-09T20:21:16.493408] [INFO ] [LOCAL ] MUE: Starting deletion of derivative data. [2025-10-09T20:21:16.493610] [DEBUG] [LOCAL ] MUE: Deleted derivative data file. [2025-10-09T20:21:16.493731] [INFO ] [MAIN ] Update Progress: 1430/2373 symbols completed. MUE took 26.5s. Estimated remaining: 2h 12m 41s. Rate: 7.1 symbols/min [2025-10-09T20:21:16.663132] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:16.663324] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-09T20:21:16.663363] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-09T20:21:16.663478] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-09T20:21:16.663521] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-09T20:21:16.663564] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-09T20:21:16.663599] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-09T20:21:16.804347] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-09T20:21:17.024876] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:17.596686] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-09T20:21:17.605952] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T20:21:18.396724] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-09T20:21:18.837795] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T20:21:19.196728] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-09T20:21:19.895800] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T20:21:19.996761] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-09T20:21:20.045471] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T20:21:20.796758] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-09T20:21:21.264303] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T20:21:21.266068] [INFO ] [REMOTE ] MUC: Full fetch complete (29659 records). [2025-10-09T20:21:21.266140] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-09T20:21:21.266597] [FATAL] [VALIDATOR ] MUC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:21:21.266701] [FATAL] [MAIN ] MUC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:21:21.266748] [WARN ] [MAIN ] MUC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:21:21.266814] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-09T20:21:21.266902] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-09T20:21:21.266960] [INFO ] [LOCAL ] MUC: Starting deletion of derivative data. [2025-10-09T20:21:21.267283] [DEBUG] [LOCAL ] MUC: Deleted derivative data file. [2025-10-09T20:21:21.267389] [INFO ] [MAIN ] Update Progress: 1431/2373 symbols completed. MUC took 34.9s. Estimated remaining: 2h 12m 31s. Rate: 7.1 symbols/min [2025-10-09T20:21:21.437498] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:21.437772] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-09T20:21:21.437833] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-09T20:21:21.437952] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-09T20:21:21.437994] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-09T20:21:21.438035] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-09T20:21:21.438067] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-09T20:21:21.597442] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-09T20:21:21.806929] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:21.849962] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T20:21:22.328175] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T20:21:22.396716] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-09T20:21:23.131136] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T20:21:23.196693] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-09T20:21:23.996766] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-09T20:21:24.121896] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T20:21:24.796700] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-09T20:21:25.031721] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T20:21:25.596762] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-09T20:21:26.396752] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-09T20:21:26.630944] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T20:21:26.856231] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-09T20:21:27.061296] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-09T20:21:27.196713] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-09T20:21:27.996771] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-09T20:21:28.354541] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T20:21:28.796769] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-09T20:21:29.524335] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T20:21:29.596669] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-09T20:21:29.701828] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T20:21:30.396715] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-09T20:21:31.149584] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T20:21:31.196727] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-09T20:21:31.709076] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T20:21:31.996739] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-09T20:21:32.800630] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-09T20:21:32.831492] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T20:21:33.107593] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T20:21:33.596761] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-09T20:21:33.992593] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T20:21:34.396772] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-09T20:21:35.196734] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-09T20:21:35.541879] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T20:21:35.625011] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T20:21:35.996696] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-09T20:21:36.405120] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T20:21:36.796700] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-09T20:21:36.835221] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T20:21:37.596759] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-09T20:21:38.396693] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-09T20:21:38.463053] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T20:21:38.928597] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T20:21:38.930358] [INFO ] [REMOTE ] MUJ: Full fetch complete (20052 records). [2025-10-09T20:21:38.930439] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-09T20:21:38.931082] [FATAL] [VALIDATOR ] MUJ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:21:38.931304] [FATAL] [MAIN ] MUJ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:21:38.931392] [WARN ] [MAIN ] MUJ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:21:38.931476] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-09T20:21:38.931592] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-09T20:21:38.931682] [INFO ] [LOCAL ] MUJ: Starting deletion of derivative data. [2025-10-09T20:21:38.931934] [DEBUG] [LOCAL ] MUJ: Deleted derivative data file. [2025-10-09T20:21:38.932047] [INFO ] [MAIN ] Update Progress: 1432/2373 symbols completed. MUJ took 31.9s. Estimated remaining: 2h 12m 28s. Rate: 7.1 symbols/min [2025-10-09T20:21:39.120806] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:39.121308] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-09T20:21:39.121390] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-09T20:21:39.121678] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-09T20:21:39.121877] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-09T20:21:39.122051] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-09T20:21:39.122096] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-09T20:21:39.198305] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-09T20:21:39.671488] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:39.699069] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-09T20:21:39.996798] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-09T20:21:40.683056] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T20:21:40.796693] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-09T20:21:41.596749] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-09T20:21:41.868134] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T20:21:42.162595] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T20:21:42.396753] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-09T20:21:42.923622] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T20:21:43.202782] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-09T20:21:43.210606] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T20:21:43.514554] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-09T20:21:43.996738] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-09T20:21:44.544936] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T20:21:44.546850] [INFO ] [REMOTE ] MUSA: Full fetch complete (34950 records). [2025-10-09T20:21:44.546931] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-09T20:21:44.547413] [FATAL] [VALIDATOR ] MUSA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:21:44.547518] [FATAL] [MAIN ] MUSA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:21:44.547592] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:21:44.547747] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-09T20:21:44.547837] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-09T20:21:44.547877] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-09T20:21:44.547920] [DEBUG] [LOCAL ] MUSA: No derivative data file found to delete. [2025-10-09T20:21:44.547977] [INFO ] [MAIN ] Update Progress: 1433/2373 symbols completed. MUSA took 23.3s. Estimated remaining: 2h 12m 18s. Rate: 7.1 symbols/min [2025-10-09T20:21:44.727272] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:44.727475] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-09T20:21:44.727524] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-09T20:21:44.727670] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-09T20:21:44.727760] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-09T20:21:44.727884] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-09T20:21:44.727947] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-09T20:21:44.801955] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-09T20:21:45.102303] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:45.596807] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-09T20:21:46.396786] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-09T20:21:46.842834] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-09T20:21:47.057354] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T20:21:47.196733] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-09T20:21:47.996699] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-09T20:21:48.192614] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T20:21:48.665288] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:21:48.665730] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-09T20:21:48.665847] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:21:48.665966] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-09T20:21:48.666058] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:21:48.666132] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-09T20:21:48.666282] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-09T20:21:48.685058] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-09T20:21:48.686615] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-09T20:21:48.686497] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T20:21:48.686822] [INFO ] [MAIN ] Update Progress: 1434/2373 symbols completed. MUSE took 9.8s. Estimated remaining: 2h 12m 7s. Rate: 7.1 symbols/min [2025-10-09T20:21:48.801839] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-09T20:21:48.871774] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:48.887852] [DEBUG] [LOCAL ] MVF: Loaded 13200 existing records from primary storage. [2025-10-09T20:21:48.888128] [INFO ] [MAIN ] MVF: Loaded 13200 existing records. [2025-10-09T20:21:49.063287] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:21:49.063520] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-09T20:21:49.063569] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-09T20:21:49.063813] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-09T20:21:49.063872] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-09T20:21:49.412174] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:49.596715] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-09T20:21:50.396691] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-09T20:21:50.423668] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T20:21:51.201863] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-09T20:21:51.220536] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T20:21:51.368371] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T20:21:51.996751] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-09T20:21:52.282442] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T20:21:52.637675] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T20:21:52.796726] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-09T20:21:53.263226] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T20:21:53.267179] [INFO ] [REMOTE ] MUR: Full fetch complete (76175 records). [2025-10-09T20:21:53.267286] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-09T20:21:53.268365] [FATAL] [VALIDATOR ] MUR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:21:53.268454] [FATAL] [MAIN ] MUR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:21:53.268497] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:21:53.268535] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-09T20:21:53.268606] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-09T20:21:53.268686] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-09T20:21:53.268747] [DEBUG] [LOCAL ] MUR: No derivative data file found to delete. [2025-10-09T20:21:53.268819] [INFO ] [MAIN ] Update Progress: 1435/2373 symbols completed. MUR took 36.8s. Estimated remaining: 2h 11m 56s. Rate: 7.1 symbols/min [2025-10-09T20:21:53.437782] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:53.437943] [DEBUG] [LOCAL ] MVO: No existing data file found in primary storage. [2025-10-09T20:21:53.437979] [WARN ] [MAIN ] MVO: No existing data found, performing full refresh instead. [2025-10-09T20:21:53.438088] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-09T20:21:53.438129] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-09T20:21:53.438169] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-09T20:21:53.438201] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-09T20:21:53.608251] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-09T20:21:53.794375] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:54.396699] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-09T20:21:55.082337] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T20:21:55.086776] [INFO ] [REMOTE ] MUFG: Full fetch complete (75243 records). [2025-10-09T20:21:55.086902] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-09T20:21:55.089088] [FATAL] [VALIDATOR ] MUFG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:21:55.089184] [FATAL] [MAIN ] MUFG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:21:55.089228] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:21:55.089296] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-09T20:21:55.089375] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-09T20:21:55.089431] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-09T20:21:55.089475] [DEBUG] [LOCAL ] MUFG: No derivative data file found to delete. [2025-10-09T20:21:55.089538] [INFO ] [MAIN ] Update Progress: 1436/2373 symbols completed. MUFG took 51.4s. Estimated remaining: 2h 11m 43s. Rate: 7.1 symbols/min [2025-10-09T20:21:55.199535] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-09T20:21:55.260777] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:21:55.290516] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T20:21:55.310521] [DEBUG] [LOCAL ] MVT: Loaded 10214 existing records from primary storage. [2025-10-09T20:21:55.310768] [INFO ] [MAIN ] MVT: Loaded 10214 existing records. [2025-10-09T20:21:55.485619] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:21:55.485865] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-09T20:21:55.485914] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-09T20:21:55.486154] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-09T20:21:55.486223] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-09T20:21:55.836700] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:21:55.996670] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-09T20:21:56.055057] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T20:21:56.796709] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-09T20:21:57.035913] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T20:21:57.552438] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T20:21:57.596724] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-09T20:21:58.396761] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-09T20:21:58.729732] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T20:21:59.073686] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T20:21:59.196741] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-09T20:21:59.996748] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-09T20:22:00.062591] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T20:22:00.796715] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-09T20:22:00.910758] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T20:22:01.565098] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T20:22:01.596752] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-09T20:22:02.356715] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T20:22:02.396808] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-09T20:22:03.196714] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-09T20:22:03.422893] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T20:22:03.993860] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T20:22:03.997926] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-09T20:22:04.796733] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-09T20:22:05.587757] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T20:22:05.596673] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-09T20:22:05.686331] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T20:22:06.396746] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-09T20:22:06.490619] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T20:22:07.196752] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-09T20:22:07.543375] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T20:22:07.876824] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T20:22:07.996724] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-09T20:22:08.796758] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-09T20:22:09.596801] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-09T20:22:09.661213] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T20:22:09.729348] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T20:22:10.348251] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T20:22:10.396812] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-09T20:22:11.203582] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-09T20:22:11.206495] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T20:22:11.996807] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-09T20:22:12.164063] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T20:22:12.751190] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T20:22:12.796747] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-09T20:22:13.596712] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-09T20:22:13.652110] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T20:22:14.396697] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-09T20:22:14.534867] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-09T20:22:14.924954] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T20:22:15.196730] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-09T20:22:15.996735] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-09T20:22:16.549844] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T20:22:16.796721] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-09T20:22:17.036935] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T20:22:17.380845] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T20:22:17.382616] [INFO ] [REMOTE ] MVF: Full fetch complete (18597 records). [2025-10-09T20:22:17.382736] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-09T20:22:17.383316] [FATAL] [VALIDATOR ] MVF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:22:17.383404] [FATAL] [MAIN ] MVF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:22:17.383449] [WARN ] [MAIN ] MVF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:22:17.383489] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-09T20:22:17.383547] [DEBUG] [LOCAL ] MVF: No primary data file found to delete. [2025-10-09T20:22:17.383583] [INFO ] [LOCAL ] MVF: Starting deletion of derivative data. [2025-10-09T20:22:17.383861] [DEBUG] [LOCAL ] MVF: Deleted derivative data file. [2025-10-09T20:22:17.383954] [INFO ] [MAIN ] Update Progress: 1437/2373 symbols completed. MVF took 28.7s. Estimated remaining: 2h 11m 43s. Rate: 7.1 symbols/min [2025-10-09T20:22:17.596747] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-09T20:22:18.109719] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T20:22:18.110846] [INFO ] [REMOTE ] MVO: Full fetch complete (14390 records). [2025-10-09T20:22:18.110938] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-09T20:22:18.111418] [FATAL] [VALIDATOR ] MVO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:22:18.111500] [FATAL] [MAIN ] MVO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:22:18.111543] [WARN ] [MAIN ] MVO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:22:18.111605] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-09T20:22:18.111711] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-09T20:22:18.111768] [INFO ] [LOCAL ] MVO: Starting deletion of derivative data. [2025-10-09T20:22:18.111902] [DEBUG] [LOCAL ] MVO: No derivative data file found to delete. [2025-10-09T20:22:18.111985] [INFO ] [MAIN ] Update Progress: 1438/2373 symbols completed. MVO took 24.8s. Estimated remaining: 2h 11m 30s. Rate: 7.1 symbols/min [2025-10-09T20:22:18.396725] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-09T20:22:19.196805] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-09T20:22:19.773089] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T20:22:19.996708] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-09T20:22:20.141424] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T20:22:20.796760] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-09T20:22:20.865947] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T20:22:21.587259] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T20:22:21.596673] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-09T20:22:22.396712] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-09T20:22:22.606987] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T20:22:22.757054] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T20:22:22.761595] [INFO ] [REMOTE ] MUX: Full fetch complete (59682 records). [2025-10-09T20:22:22.761818] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-09T20:22:22.765036] [FATAL] [VALIDATOR ] MUX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:22:22.765158] [FATAL] [MAIN ] MUX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:22:22.765202] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:22:22.765254] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-09T20:22:22.765347] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-09T20:22:22.765385] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-09T20:22:22.765425] [DEBUG] [LOCAL ] MUX: No derivative data file found to delete. [2025-10-09T20:22:22.765504] [INFO ] [MAIN ] Update Progress: 1439/2373 symbols completed. MUX took 38.2s. Estimated remaining: 2h 11m 19s. Rate: 7.1 symbols/min [2025-10-09T20:22:23.196730] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-09T20:22:24.159984] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T20:22:24.162951] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-09T20:22:25.095053] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T20:22:25.097898] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-09T20:22:25.680055] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T20:22:25.683543] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-09T20:22:26.058720] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T20:22:26.059884] [INFO ] [REMOTE ] MVT: Full fetch complete (14223 records). [2025-10-09T20:22:26.059956] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-09T20:22:26.060362] [FATAL] [VALIDATOR ] MVT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:22:26.060444] [FATAL] [MAIN ] MVT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:22:26.060487] [WARN ] [MAIN ] MVT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:22:26.060524] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-09T20:22:26.060579] [DEBUG] [LOCAL ] MVT: No primary data file found to delete. [2025-10-09T20:22:26.060612] [INFO ] [LOCAL ] MVT: Starting deletion of derivative data. [2025-10-09T20:22:26.060820] [DEBUG] [LOCAL ] MVT: Deleted derivative data file. [2025-10-09T20:22:26.060909] [INFO ] [MAIN ] Update Progress: 1440/2373 symbols completed. MVT took 31.0s. Estimated remaining: 2h 11m 7s. Rate: 7.1 symbols/min [2025-10-09T20:22:26.685846] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:22:26.827462] [DEBUG] [LOCAL ] MX: No existing data file found in primary storage. [2025-10-09T20:22:26.827354] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:22:26.825383] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:22:26.843896] [WARN ] [MAIN ] MX: No existing data found, performing full refresh instead. [2025-10-09T20:22:26.849030] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-09T20:22:26.850066] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-09T20:22:26.850212] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-09T20:22:26.850316] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-09T20:22:26.848792] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:22:26.849820] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-09T20:22:26.850579] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-09T20:22:26.856263] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-09T20:22:26.867588] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-09T20:22:26.867960] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-09T20:22:26.867868] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-09T20:22:26.868859] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-09T20:22:26.883773] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-09T20:22:26.874462] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-09T20:22:26.883993] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-09T20:22:26.924167] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-09T20:22:26.990084] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-09T20:22:27.011682] [DEBUG] [LOCAL ] MXF: Loaded 5687 existing records from primary storage. [2025-10-09T20:22:27.060903] [INFO ] [MAIN ] MXF: Loaded 5687 existing records. [2025-10-09T20:22:27.825206] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:22:27.955406] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-09T20:22:28.004217] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-09T20:22:28.077193] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-09T20:22:28.104195] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-09T20:22:28.238907] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:22:28.308419] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-09T20:22:28.297905] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:22:28.400997] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-09T20:22:28.482388] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:22:28.501029] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-09T20:22:28.726241] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:22:28.796771] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-09T20:22:29.052569] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T20:22:29.463445] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T20:22:29.604537] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-09T20:22:29.606330] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T20:22:30.130078] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T20:22:30.185382] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T20:22:30.396754] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-09T20:22:30.921361] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-09T20:22:31.196716] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-09T20:22:31.996805] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-09T20:22:32.625043] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T20:22:32.796729] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-09T20:22:32.812555] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T20:22:33.507906] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T20:22:33.596696] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-09T20:22:34.396687] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-09T20:22:34.801765] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T20:22:35.196755] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-09T20:22:35.997671] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-09T20:22:36.000283] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T20:22:36.457417] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T20:22:36.796736] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-09T20:22:36.858127] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T20:22:37.596724] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-09T20:22:38.153160] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T20:22:38.396732] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-09T20:22:39.196757] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-09T20:22:39.443437] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T20:22:39.649750] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T20:22:39.996765] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-09T20:22:40.009093] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T20:22:40.392731] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-09T20:22:40.796760] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-09T20:22:41.365733] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T20:22:41.596753] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-09T20:22:42.396736] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-09T20:22:42.746045] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T20:22:42.755202] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T20:22:43.196736] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-09T20:22:43.582864] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T20:22:43.996715] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-09T20:22:44.796754] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-09T20:22:45.354938] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T20:22:45.596684] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-09T20:22:45.637929] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T20:22:46.375507] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T20:22:46.396680] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-09T20:22:47.196697] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-09T20:22:47.279625] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T20:22:47.996780] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-09T20:22:48.576195] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T20:22:48.796677] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-09T20:22:48.882689] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T20:22:49.596739] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-09T20:22:49.730223] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T20:22:50.396758] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-09T20:22:50.740295] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T20:22:50.945486] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T20:22:51.196761] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-09T20:22:51.996721] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-09T20:22:52.796817] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-09T20:22:53.596851] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-09T20:23:05.464871] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (14.27 seconds). [2025-10-09T20:23:05.465944] [INFO ] [REMOTE ] MXE: Full fetch complete (2635 records). [2025-10-09T20:23:05.466040] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-09T20:23:05.466528] [FATAL] [VALIDATOR ] MXE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:23:05.466712] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:23:05.466760] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:23:05.466808] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-09T20:23:05.466877] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-09T20:23:05.466917] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-09T20:23:05.467017] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-09T20:23:05.467099] [INFO ] [MAIN ] Update Progress: 1441/2373 symbols completed. MXE took 39.4s. Estimated remaining: 2h 11m 19s. Rate: 7.1 symbols/min [2025-10-09T20:23:05.678214] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:23:05.696792] [DEBUG] [LOCAL ] MYD: Loaded 13378 existing records from primary storage. [2025-10-09T20:23:05.697060] [INFO ] [MAIN ] MYD: Loaded 13378 existing records. [2025-10-09T20:23:05.894413] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:23:05.894626] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-09T20:23:05.894707] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-09T20:23:05.895095] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-09T20:23:05.895152] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-09T20:23:06.251523] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:23:06.251887] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-09T20:23:07.574712] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T20:23:07.579308] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-09T20:23:07.757667] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (14.16 seconds). [2025-10-09T20:23:07.759597] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-09T20:23:08.429212] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T20:23:08.433351] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-09T20:23:08.945788] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (16.15 seconds). [2025-10-09T20:23:08.952678] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-09T20:23:09.321084] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T20:23:09.324823] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-09T20:23:09.438836] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (17.44 seconds). [2025-10-09T20:23:09.449515] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-09T20:23:09.620695] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T20:23:09.626478] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-09T20:23:09.842031] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-09T20:23:09.844121] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-09T20:23:10.009719] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T20:23:10.011490] [INFO ] [REMOTE ] MX: Full fetch complete (31582 records). [2025-10-09T20:23:10.011579] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-09T20:23:10.012143] [FATAL] [VALIDATOR ] MX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:23:10.012229] [FATAL] [MAIN ] MX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:23:10.012273] [WARN ] [MAIN ] MX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:23:10.012312] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-09T20:23:10.012368] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-09T20:23:10.012403] [INFO ] [LOCAL ] MX: Starting deletion of derivative data. [2025-10-09T20:23:10.012441] [DEBUG] [LOCAL ] MX: No derivative data file found to delete. [2025-10-09T20:23:10.012559] [INFO ] [MAIN ] Update Progress: 1442/2373 symbols completed. MX took 43.9s. Estimated remaining: 2h 11m 8s. Rate: 7.1 symbols/min [2025-10-09T20:23:10.180915] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:23:10.181081] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-09T20:23:10.181119] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-09T20:23:10.181235] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-09T20:23:10.181363] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-09T20:23:10.181414] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-09T20:23:10.181447] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-09T20:23:10.488181] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T20:23:10.495095] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-09T20:23:10.588843] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:23:10.589213] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-09T20:23:10.874464] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T20:23:10.879204] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-09T20:23:10.961448] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T20:23:10.971919] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-09T20:23:11.047037] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T20:23:11.049406] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-09T20:23:11.333954] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-09T20:23:11.334869] [INFO ] [REMOTE ] MXF: Full fetch complete (10043 records). [2025-10-09T20:23:11.334938] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-09T20:23:11.335305] [FATAL] [VALIDATOR ] MXF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:23:11.335402] [FATAL] [MAIN ] MXF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:23:11.335481] [WARN ] [MAIN ] MXF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:23:11.335579] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-09T20:23:11.335703] [DEBUG] [LOCAL ] MXF: No primary data file found to delete. [2025-10-09T20:23:11.335762] [INFO ] [LOCAL ] MXF: Starting deletion of derivative data. [2025-10-09T20:23:11.335950] [DEBUG] [LOCAL ] MXF: Deleted derivative data file. [2025-10-09T20:23:11.336039] [INFO ] [MAIN ] Update Progress: 1443/2373 symbols completed. MXF took 45.3s. Estimated remaining: 2h 10m 55s. Rate: 7.1 symbols/min [2025-10-09T20:23:11.505780] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:23:11.528242] [DEBUG] [LOCAL ] MYI: Loaded 19085 existing records from primary storage. [2025-10-09T20:23:11.528514] [INFO ] [MAIN ] MYI: Loaded 19085 existing records. [2025-10-09T20:23:11.725074] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:23:11.725377] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-09T20:23:11.725531] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-09T20:23:11.726062] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-09T20:23:11.726191] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-09T20:23:11.831485] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T20:23:11.861749] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-09T20:23:12.099371] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T20:23:12.134174] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T20:23:12.153836] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-09T20:23:12.172276] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-09T20:23:12.236791] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:23:12.237116] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-09T20:23:12.931089] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T20:23:12.936244] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-09T20:23:13.068952] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T20:23:13.072303] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-09T20:23:13.216177] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T20:23:13.221303] [INFO ] [REMOTE ] MWA: Full fetch complete (67306 records). [2025-10-09T20:23:13.221482] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-09T20:23:13.222371] [FATAL] [VALIDATOR ] MWA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:23:13.222479] [FATAL] [MAIN ] MWA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:23:13.222538] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:23:13.222615] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-09T20:23:13.222733] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-09T20:23:13.222788] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-09T20:23:13.222840] [DEBUG] [LOCAL ] MWA: No derivative data file found to delete. [2025-10-09T20:23:13.222915] [INFO ] [MAIN ] Update Progress: 1444/2373 symbols completed. MWA took 47.2s. Estimated remaining: 2h 10m 42s. Rate: 7.1 symbols/min [2025-10-09T20:23:13.403360] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:23:13.420630] [DEBUG] [LOCAL ] MYN: Loaded 9882 existing records from primary storage. [2025-10-09T20:23:13.420957] [INFO ] [MAIN ] MYN: Loaded 9882 existing records. [2025-10-09T20:23:13.646547] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:23:13.657675] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-09T20:23:13.658407] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-09T20:23:13.659236] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T20:23:13.665432] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-09T20:23:13.665515] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-09T20:23:13.666403] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-09T20:23:14.073056] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:23:14.073515] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-09T20:23:14.102554] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T20:23:14.106002] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-09T20:23:14.314909] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T20:23:14.319962] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-09T20:23:14.907001] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T20:23:14.917015] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-09T20:23:14.917346] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T20:23:14.923025] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-09T20:23:15.077188] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T20:23:15.196857] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-09T20:23:15.662750] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T20:23:15.733799] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T20:23:15.981116] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T20:23:15.996712] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-09T20:23:16.101147] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T20:23:16.796742] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-09T20:23:17.442773] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T20:23:17.459509] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T20:23:17.596715] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-09T20:23:18.396770] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-09T20:23:18.846350] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T20:23:19.208362] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T20:23:19.205246] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-09T20:23:19.870517] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T20:23:19.996714] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-09T20:23:20.540481] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T20:23:20.542471] [INFO ] [REMOTE ] MYD: Full fetch complete (20481 records). [2025-10-09T20:23:20.542562] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-09T20:23:20.543229] [FATAL] [VALIDATOR ] MYD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:23:20.543334] [FATAL] [MAIN ] MYD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:23:20.543389] [WARN ] [MAIN ] MYD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:23:20.543460] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-09T20:23:20.543527] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-09T20:23:20.543565] [INFO ] [LOCAL ] MYD: Starting deletion of derivative data. [2025-10-09T20:23:20.543810] [DEBUG] [LOCAL ] MYD: Deleted derivative data file. [2025-10-09T20:23:20.543909] [INFO ] [MAIN ] Update Progress: 1445/2373 symbols completed. MYD took 15.1s. Estimated remaining: 2h 10m 33s. Rate: 7.1 symbols/min [2025-10-09T20:23:20.724760] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:23:20.724966] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-09T20:23:20.725005] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-09T20:23:20.725119] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-09T20:23:20.725163] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-09T20:23:20.725206] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-09T20:23:20.725239] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-09T20:23:20.801804] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-09T20:23:21.104066] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:23:21.596722] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-09T20:23:22.206412] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T20:23:22.238662] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T20:23:22.396726] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-09T20:23:23.198456] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-09T20:23:23.200165] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T20:23:23.996742] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-09T20:23:24.423278] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T20:23:24.796789] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-09T20:23:25.014158] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T20:23:25.596746] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-09T20:23:26.277868] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T20:23:26.396722] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-09T20:23:26.452515] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T20:23:27.196718] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-09T20:23:27.678730] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T20:23:27.996709] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-09T20:23:28.141251] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T20:23:28.796729] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-09T20:23:28.953187] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T20:23:29.596794] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-09T20:23:30.342920] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T20:23:30.396716] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-09T20:23:30.882505] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T20:23:31.196709] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-09T20:23:31.996724] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-09T20:23:32.008737] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T20:23:32.114283] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T20:23:32.796716] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-09T20:23:32.837636] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T20:23:33.442809] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T20:23:33.596730] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-09T20:23:34.071622] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T20:23:34.074602] [INFO ] [REMOTE ] MYE: Full fetch complete (36080 records). [2025-10-09T20:23:34.074774] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-09T20:23:34.075882] [FATAL] [VALIDATOR ] MYE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:23:34.076007] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:23:34.076080] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:23:34.076207] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-09T20:23:34.076293] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-09T20:23:34.076516] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-09T20:23:34.076894] [DEBUG] [LOCAL ] MYE: No derivative data file found to delete. [2025-10-09T20:23:34.077020] [INFO ] [MAIN ] Update Progress: 1446/2373 symbols completed. MYE took 24.1s. Estimated remaining: 2h 10m 28s. Rate: 7.1 symbols/min [2025-10-09T20:23:34.252061] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:23:34.277138] [DEBUG] [LOCAL ] NAC: Loaded 24576 existing records from primary storage. [2025-10-09T20:23:34.277415] [INFO ] [MAIN ] NAC: Loaded 24576 existing records. [2025-10-09T20:23:34.401905] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-09T20:23:34.457526] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:23:34.457985] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-09T20:23:34.458034] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-09T20:23:34.458314] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-09T20:23:34.458372] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-09T20:23:34.815928] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:23:35.196723] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-09T20:23:35.996724] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-09T20:23:36.219124] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T20:23:36.387368] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T20:23:36.796740] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-09T20:23:37.182318] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T20:23:37.599800] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-09T20:23:37.603521] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T20:23:37.961424] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T20:23:38.396721] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-09T20:23:39.196719] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-09T20:23:39.732474] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T20:23:39.996748] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-09T20:23:40.393265] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T20:23:40.796736] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-09T20:23:41.065111] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T20:23:41.596692] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-09T20:23:41.713246] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T20:23:42.331515] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T20:23:42.396679] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-09T20:23:43.020847] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T20:23:43.022573] [INFO ] [REMOTE ] MYI: Full fetch complete (28912 records). [2025-10-09T20:23:43.022664] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-09T20:23:43.023118] [FATAL] [VALIDATOR ] MYI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:23:43.023281] [FATAL] [MAIN ] MYI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:23:43.023371] [WARN ] [MAIN ] MYI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:23:43.023544] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-09T20:23:43.023628] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-09T20:23:43.023711] [INFO ] [LOCAL ] MYI: Starting deletion of derivative data. [2025-10-09T20:23:43.023899] [DEBUG] [LOCAL ] MYI: Deleted derivative data file. [2025-10-09T20:23:43.024006] [INFO ] [MAIN ] Update Progress: 1447/2373 symbols completed. MYI took 31.7s. Estimated remaining: 2h 10m 20s. Rate: 7.1 symbols/min [2025-10-09T20:23:43.205700] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-09T20:23:43.209097] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:23:43.251758] [DEBUG] [LOCAL ] NAD: Loaded 33875 existing records from primary storage. [2025-10-09T20:23:43.252044] [INFO ] [MAIN ] NAD: Loaded 33875 existing records. [2025-10-09T20:23:43.436959] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:23:43.437158] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-09T20:23:43.437206] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-09T20:23:43.437470] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-09T20:23:43.437527] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-09T20:23:43.803172] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:23:43.996778] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-09T20:23:44.553543] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T20:23:44.695306] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T20:23:44.697948] [INFO ] [REMOTE ] MYN: Full fetch complete (15174 records). [2025-10-09T20:23:44.698202] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-09T20:23:44.699129] [FATAL] [VALIDATOR ] MYN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:23:44.699218] [FATAL] [MAIN ] MYN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:23:44.699261] [WARN ] [MAIN ] MYN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:23:44.699303] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-09T20:23:44.699363] [DEBUG] [LOCAL ] MYN: No primary data file found to delete. [2025-10-09T20:23:44.699398] [INFO ] [LOCAL ] MYN: Starting deletion of derivative data. [2025-10-09T20:23:44.699563] [DEBUG] [LOCAL ] MYN: Deleted derivative data file. [2025-10-09T20:23:44.699696] [INFO ] [MAIN ] Update Progress: 1448/2373 symbols completed. MYN took 31.5s. Estimated remaining: 2h 10m 7s. Rate: 7.1 symbols/min [2025-10-09T20:23:44.799740] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-09T20:23:44.869521] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:23:44.881552] [DEBUG] [LOCAL ] NAN: Loaded 8428 existing records from primary storage. [2025-10-09T20:23:44.881819] [INFO ] [MAIN ] NAN: Loaded 8428 existing records. [2025-10-09T20:23:45.062380] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:23:45.062575] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-09T20:23:45.062666] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-09T20:23:45.062856] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-09T20:23:45.062913] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-09T20:23:45.415196] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:23:45.596790] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-09T20:23:46.396758] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-09T20:23:46.455719] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T20:23:46.579067] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T20:23:47.196742] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-09T20:23:47.699973] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T20:23:47.996746] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-09T20:23:48.122451] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T20:23:48.796740] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-09T20:23:49.305556] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T20:23:49.596780] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-09T20:23:49.996069] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T20:23:50.396724] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-09T20:23:51.172760] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T20:23:51.196734] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-09T20:23:51.556481] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T20:23:51.996715] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-09T20:23:52.798810] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-09T20:23:52.802616] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T20:23:52.970573] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T20:23:53.416536] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T20:23:53.596738] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-09T20:23:54.396771] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-09T20:23:54.465881] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T20:23:54.979779] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T20:23:55.196730] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-09T20:23:55.996800] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-09T20:23:56.186457] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T20:23:56.796792] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-09T20:23:57.447560] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T20:23:57.596717] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-09T20:23:57.786183] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T20:23:58.396706] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-09T20:23:58.752008] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T20:23:58.930064] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T20:23:59.196727] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-09T20:23:59.911004] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T20:23:59.996689] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-09T20:24:00.675997] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T20:24:00.796700] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-09T20:24:01.596744] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-09T20:24:01.605519] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T20:24:02.031845] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:24:02.035227] [INFO ] [REMOTE ] NABL: Full fetch complete (56610 records). [2025-10-09T20:24:02.035314] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-09T20:24:02.036033] [FATAL] [VALIDATOR ] NABL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:24:02.036135] [FATAL] [MAIN ] NABL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:24:02.036206] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:24:02.036288] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-09T20:24:02.036363] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-09T20:24:02.036420] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-09T20:24:02.036465] [DEBUG] [LOCAL ] NABL: No derivative data file found to delete. [2025-10-09T20:24:02.036567] [INFO ] [MAIN ] Update Progress: 1449/2373 symbols completed. NABL took 41.5s. Estimated remaining: 2h 10m 4s. Rate: 7.1 symbols/min [2025-10-09T20:24:02.221156] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:24:02.221356] [DEBUG] [LOCAL ] NAT: No existing data file found in primary storage. [2025-10-09T20:24:02.221394] [WARN ] [MAIN ] NAT: No existing data found, performing full refresh instead. [2025-10-09T20:24:02.221545] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-09T20:24:02.221591] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-09T20:24:02.221632] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-09T20:24:02.221711] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-09T20:24:02.396928] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-09T20:24:02.578959] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:24:03.184220] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T20:24:03.196692] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-09T20:24:03.996793] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-09T20:24:04.482938] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T20:24:04.796736] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-09T20:24:05.596804] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-09T20:24:06.010622] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T20:24:06.111603] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T20:24:06.396763] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-09T20:24:06.703310] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-09T20:24:06.704790] [INFO ] [REMOTE ] NAN: Full fetch complete (13477 records). [2025-10-09T20:24:06.704934] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-09T20:24:06.705782] [FATAL] [VALIDATOR ] NAN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:24:06.705928] [FATAL] [MAIN ] NAN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:24:06.706370] [WARN ] [MAIN ] NAN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:24:06.706582] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-09T20:24:06.706810] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-09T20:24:06.706962] [INFO ] [LOCAL ] NAN: Starting deletion of derivative data. [2025-10-09T20:24:06.725170] [DEBUG] [LOCAL ] NAN: Deleted derivative data file. [2025-10-09T20:24:06.725705] [INFO ] [MAIN ] Update Progress: 1450/2373 symbols completed. NAN took 22.0s. Estimated remaining: 2h 9m 53s. Rate: 7.1 symbols/min [2025-10-09T20:24:06.726415] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T20:24:06.933746] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:24:06.933964] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-09T20:24:06.934019] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-09T20:24:06.934132] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-09T20:24:06.934172] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-09T20:24:06.934213] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-09T20:24:06.934245] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-09T20:24:07.201828] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-09T20:24:07.296773] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:24:07.996815] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-09T20:24:08.581838] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T20:24:08.796756] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-09T20:24:09.201218] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T20:24:09.226672] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T20:24:09.596731] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-09T20:24:10.396707] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-09T20:24:10.745028] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T20:24:11.196732] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-09T20:24:11.960136] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T20:24:11.996671] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-09T20:24:12.418402] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T20:24:12.796731] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-09T20:24:13.017466] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T20:24:13.417662] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T20:24:13.419983] [INFO ] [REMOTE ] NAC: Full fetch complete (35627 records). [2025-10-09T20:24:13.420077] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-09T20:24:13.421018] [FATAL] [VALIDATOR ] NAC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:24:13.421102] [FATAL] [MAIN ] NAC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:24:13.421165] [WARN ] [MAIN ] NAC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:24:13.421235] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-09T20:24:13.421347] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-09T20:24:13.421402] [INFO ] [LOCAL ] NAC: Starting deletion of derivative data. [2025-10-09T20:24:13.421755] [DEBUG] [LOCAL ] NAC: Deleted derivative data file. [2025-10-09T20:24:13.421878] [INFO ] [MAIN ] Update Progress: 1451/2373 symbols completed. NAC took 39.3s. Estimated remaining: 2h 9m 44s. Rate: 7.1 symbols/min [2025-10-09T20:24:13.592285] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:24:13.597334] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-09T20:24:13.597545] [DEBUG] [LOCAL ] NAZ: Loaded 2649 existing records from primary storage. [2025-10-09T20:24:13.598123] [INFO ] [MAIN ] NAZ: Loaded 2649 existing records. [2025-10-09T20:24:13.779533] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:24:13.779761] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-09T20:24:13.779816] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-09T20:24:13.779996] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-09T20:24:13.780052] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-09T20:24:14.146964] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:24:14.333473] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T20:24:14.396736] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-09T20:24:15.146959] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T20:24:15.150089] [INFO ] [REMOTE ] NAD: Full fetch complete (49069 records). [2025-10-09T20:24:15.150193] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-09T20:24:15.150919] [FATAL] [VALIDATOR ] NAD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:24:15.151015] [FATAL] [MAIN ] NAD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:24:15.151059] [WARN ] [MAIN ] NAD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:24:15.151099] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-09T20:24:15.151155] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-09T20:24:15.151190] [INFO ] [LOCAL ] NAD: Starting deletion of derivative data. [2025-10-09T20:24:15.151363] [DEBUG] [LOCAL ] NAD: Deleted derivative data file. [2025-10-09T20:24:15.151510] [INFO ] [MAIN ] Update Progress: 1452/2373 symbols completed. NAD took 32.1s. Estimated remaining: 2h 9m 31s. Rate: 7.1 symbols/min [2025-10-09T20:24:15.204058] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-09T20:24:15.322864] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:24:15.336336] [DEBUG] [LOCAL ] NBB: Loaded 9080 existing records from primary storage. [2025-10-09T20:24:15.336558] [INFO ] [MAIN ] NBB: Loaded 9080 existing records. [2025-10-09T20:24:15.511966] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:24:15.512227] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-09T20:24:15.512281] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-09T20:24:15.512581] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-09T20:24:15.512639] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-09T20:24:15.861128] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:24:15.996694] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-09T20:24:16.002424] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T20:24:16.796742] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-09T20:24:16.942081] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T20:24:17.596714] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-09T20:24:18.047711] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T20:24:18.396769] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-09T20:24:19.196704] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-09T20:24:19.362511] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:24:19.536949] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T20:24:19.854632] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T20:24:19.996776] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-09T20:24:20.796744] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-09T20:24:21.117472] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T20:24:21.596732] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-09T20:24:22.396695] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-09T20:24:22.756295] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-09T20:24:23.112854] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T20:24:23.116391] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T20:24:23.196707] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-09T20:24:23.996719] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-09T20:24:24.212451] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T20:24:24.618636] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T20:24:24.796728] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-09T20:24:25.596720] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-09T20:24:26.396705] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-09T20:24:26.706521] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T20:24:26.912008] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T20:24:27.027761] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T20:24:27.196687] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-09T20:24:27.996721] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-09T20:24:28.535668] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-09T20:24:28.735950] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T20:24:28.796705] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-09T20:24:29.596724] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-09T20:24:30.269842] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T20:24:30.396743] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-09T20:24:31.052032] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T20:24:31.126705] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T20:24:31.196748] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-09T20:24:31.996786] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-09T20:24:32.796701] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-09T20:24:32.951743] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T20:24:33.261503] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T20:24:33.596741] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-09T20:24:33.642550] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T20:24:34.398704] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-09T20:24:34.399259] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T20:24:35.193552] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T20:24:35.200835] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-09T20:24:35.996802] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-09T20:24:36.555238] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T20:24:36.796695] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-09T20:24:36.911506] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T20:24:37.596711] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-09T20:24:37.664394] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T20:24:38.015880] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T20:24:38.018478] [INFO ] [REMOTE ] NATL: Full fetch complete (45111 records). [2025-10-09T20:24:38.018567] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-09T20:24:38.019403] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:24:38.019497] [FATAL] [MAIN ] NATL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:24:38.019539] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:24:38.019576] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-09T20:24:38.019674] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-09T20:24:38.019732] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-09T20:24:38.019775] [DEBUG] [LOCAL ] NATL: No derivative data file found to delete. [2025-10-09T20:24:38.019842] [INFO ] [MAIN ] Update Progress: 1453/2373 symbols completed. NATL took 31.3s. Estimated remaining: 2h 9m 32s. Rate: 7.1 symbols/min [2025-10-09T20:24:38.219355] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:24:38.219531] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-09T20:24:38.219568] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-09T20:24:38.219709] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-09T20:24:38.219759] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-09T20:24:38.219801] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-09T20:24:38.219832] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-09T20:24:38.405259] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-09T20:24:38.579714] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:24:39.100757] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T20:24:39.196773] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-09T20:24:39.816637] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T20:24:39.996728] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-09T20:24:40.625077] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T20:24:40.796718] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-09T20:24:41.154916] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T20:24:41.596730] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-09T20:24:41.916743] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-09T20:24:41.918474] [INFO ] [REMOTE ] NBB: Full fetch complete (13665 records). [2025-10-09T20:24:41.918765] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-09T20:24:41.920093] [FATAL] [VALIDATOR ] NBB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:24:41.920195] [FATAL] [MAIN ] NBB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:24:41.920242] [WARN ] [MAIN ] NBB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:24:41.920471] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-09T20:24:41.920547] [DEBUG] [LOCAL ] NBB: No primary data file found to delete. [2025-10-09T20:24:41.920604] [INFO ] [LOCAL ] NBB: Starting deletion of derivative data. [2025-10-09T20:24:41.920841] [DEBUG] [LOCAL ] NBB: Deleted derivative data file. [2025-10-09T20:24:41.920953] [INFO ] [MAIN ] Update Progress: 1454/2373 symbols completed. NBB took 26.8s. Estimated remaining: 2h 9m 21s. Rate: 7.1 symbols/min [2025-10-09T20:24:42.091265] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:24:42.091447] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-09T20:24:42.091484] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-09T20:24:42.091598] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-09T20:24:42.091639] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-09T20:24:42.091729] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-09T20:24:42.091765] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-09T20:24:42.403508] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-09T20:24:42.446018] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:24:43.196732] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-09T20:24:43.946382] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T20:24:43.996740] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-09T20:24:44.262525] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T20:24:44.796723] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-09T20:24:44.860767] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T20:24:45.596687] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-09T20:24:45.884139] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T20:24:46.396732] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-09T20:24:46.835904] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T20:24:47.196772] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-09T20:24:47.554940] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T20:24:47.728251] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T20:24:47.996723] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-09T20:24:48.442291] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T20:24:48.450059] [INFO ] [REMOTE ] NAT: Full fetch complete (71713 records). [2025-10-09T20:24:48.450315] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-09T20:24:48.451599] [FATAL] [VALIDATOR ] NAT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:24:48.451718] [FATAL] [MAIN ] NAT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:24:48.451804] [WARN ] [MAIN ] NAT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:24:48.451896] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-09T20:24:48.452010] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-09T20:24:48.452094] [INFO ] [LOCAL ] NAT: Starting deletion of derivative data. [2025-10-09T20:24:48.452185] [DEBUG] [LOCAL ] NAT: No derivative data file found to delete. [2025-10-09T20:24:48.452300] [INFO ] [MAIN ] Update Progress: 1455/2373 symbols completed. NAT took 46.4s. Estimated remaining: 2h 9m 11s. Rate: 7.1 symbols/min [2025-10-09T20:24:48.622432] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:24:48.622627] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-09T20:24:48.622708] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-09T20:24:48.622827] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-09T20:24:48.622877] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-09T20:24:48.622961] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-09T20:24:48.623011] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-09T20:24:48.805724] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-09T20:24:48.992999] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:24:49.322307] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T20:24:49.596745] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-09T20:24:50.396724] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-09T20:24:50.735111] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T20:24:51.196732] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-09T20:24:51.585399] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T20:24:51.996823] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-09T20:24:52.236471] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T20:24:52.796808] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-09T20:24:53.282973] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T20:24:53.596753] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-09T20:24:54.236595] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T20:24:54.396686] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-09T20:24:54.495639] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T20:24:55.196728] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-09T20:24:55.531068] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T20:24:55.996767] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-09T20:24:56.178312] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T20:24:56.796821] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-09T20:24:57.157449] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T20:24:57.158396] [INFO ] [REMOTE ] NAZ: Full fetch complete (4258 records). [2025-10-09T20:24:57.158467] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-09T20:24:57.158930] [FATAL] [VALIDATOR ] NAZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:24:57.159020] [FATAL] [MAIN ] NAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:24:57.159062] [WARN ] [MAIN ] NAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:24:57.159101] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-09T20:24:57.159157] [DEBUG] [LOCAL ] NAZ: No primary data file found to delete. [2025-10-09T20:24:57.159192] [INFO ] [LOCAL ] NAZ: Starting deletion of derivative data. [2025-10-09T20:24:57.159347] [DEBUG] [LOCAL ] NAZ: Deleted derivative data file. [2025-10-09T20:24:57.159437] [INFO ] [MAIN ] Update Progress: 1456/2373 symbols completed. NAZ took 43.7s. Estimated remaining: 2h 9m 3s. Rate: 7.1 symbols/min [2025-10-09T20:24:57.331273] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:24:57.331582] [DEBUG] [LOCAL ] NC: No existing data file found in primary storage. [2025-10-09T20:24:57.331684] [WARN ] [MAIN ] NC: No existing data found, performing full refresh instead. [2025-10-09T20:24:57.331912] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-09T20:24:57.332026] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-09T20:24:57.332153] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-09T20:24:57.332211] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-09T20:24:57.600283] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-09T20:24:57.699135] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:24:57.720591] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T20:24:58.396785] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-09T20:24:58.840275] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T20:24:59.031997] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T20:24:59.196723] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-09T20:24:59.800206] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T20:24:59.996700] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-09T20:25:00.796726] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-09T20:25:01.282193] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T20:25:01.596733] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-09T20:25:02.093491] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T20:25:02.396765] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-09T20:25:02.423322] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T20:25:03.196743] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-09T20:25:03.341367] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T20:25:03.996775] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-09T20:25:04.725006] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T20:25:04.796693] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-09T20:25:05.076233] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T20:25:05.596714] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-09T20:25:05.703740] [DEBUG] [REMOTE ] NBXG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-09T20:25:05.704127] [WARN ] [REMOTE ] NBXG: No data returned for month 2025-06 [2025-10-09T20:25:05.704212] [FATAL] [REMOTE ] NBXG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:25:05.704291] [FATAL] [MAIN ] NBXG: Failed to fetch primary data. [2025-10-09T20:25:05.704327] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:25:05.704365] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-09T20:25:05.704419] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-09T20:25:05.704453] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-09T20:25:05.704507] [DEBUG] [LOCAL ] NBXG: No derivative data file found to delete. [2025-10-09T20:25:05.704578] [INFO ] [MAIN ] Update Progress: 1457/2373 symbols completed. NBXG took 17.3s. Estimated remaining: 2h 8m 54s. Rate: 7.1 symbols/min [2025-10-09T20:25:05.873980] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:25:05.886138] [DEBUG] [LOCAL ] NCA: Loaded 10027 existing records from primary storage. [2025-10-09T20:25:05.886367] [INFO ] [MAIN ] NCA: Loaded 10027 existing records. [2025-10-09T20:25:06.071011] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:25:06.071438] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-09T20:25:06.071530] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-09T20:25:06.072041] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-09T20:25:06.072203] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-09T20:25:06.183230] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T20:25:06.401859] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-09T20:25:06.460039] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:25:07.196788] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-09T20:25:07.599153] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T20:25:07.996685] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-09T20:25:08.359094] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T20:25:08.796735] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-09T20:25:09.245413] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T20:25:09.596717] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-09T20:25:10.184226] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T20:25:10.337239] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T20:25:10.396682] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-09T20:25:11.196722] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-09T20:25:11.686141] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T20:25:11.823301] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T20:25:11.996732] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-09T20:25:12.796693] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-09T20:25:12.982341] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T20:25:13.422330] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T20:25:13.596694] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-09T20:25:14.396760] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-09T20:25:14.420189] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T20:25:14.928390] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T20:25:14.931017] [INFO ] [REMOTE ] NBR: Full fetch complete (49098 records). [2025-10-09T20:25:14.931111] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-09T20:25:14.931786] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:25:14.931886] [FATAL] [MAIN ] NBR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:25:14.931931] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:25:14.931972] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-09T20:25:14.932028] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-09T20:25:14.932066] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-09T20:25:14.932104] [DEBUG] [LOCAL ] NBR: No derivative data file found to delete. [2025-10-09T20:25:14.932171] [INFO ] [MAIN ] Update Progress: 1458/2373 symbols completed. NBR took 33.0s. Estimated remaining: 2h 8m 46s. Rate: 7.1 symbols/min [2025-10-09T20:25:15.111737] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:25:15.111911] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-09T20:25:15.111948] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-09T20:25:15.112069] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-09T20:25:15.112112] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-09T20:25:15.112153] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-09T20:25:15.112187] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-09T20:25:15.201897] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-09T20:25:15.473334] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:25:15.996767] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-09T20:25:16.019814] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T20:25:16.796726] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-09T20:25:17.043122] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T20:25:17.242133] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T20:25:17.244719] [INFO ] [REMOTE ] NBHC: Full fetch complete (32399 records). [2025-10-09T20:25:17.244805] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-09T20:25:17.245391] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:25:17.245529] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:25:17.245583] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:25:17.245621] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-09T20:25:17.245721] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-09T20:25:17.245777] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-09T20:25:17.245819] [DEBUG] [LOCAL ] NBHC: No derivative data file found to delete. [2025-10-09T20:25:17.245986] [INFO ] [MAIN ] Update Progress: 1459/2373 symbols completed. NBHC took 39.2s. Estimated remaining: 2h 8m 34s. Rate: 7.1 symbols/min [2025-10-09T20:25:17.450020] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:25:17.450308] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-09T20:25:17.450379] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-09T20:25:17.450547] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-09T20:25:17.450622] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-09T20:25:17.450738] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-09T20:25:17.450804] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-09T20:25:17.601886] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-09T20:25:17.825706] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:25:18.396692] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-09T20:25:18.443507] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T20:25:19.196714] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-09T20:25:19.996691] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-09T20:25:20.070202] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T20:25:20.070762] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T20:25:20.796722] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-09T20:25:21.596710] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-09T20:25:22.140234] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T20:25:22.321474] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-09T20:25:22.394121] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T20:25:22.397383] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-09T20:25:23.196714] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-09T20:25:23.800408] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T20:25:23.996703] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-09T20:25:24.317108] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-09T20:25:24.597172] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T20:25:24.796723] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-09T20:25:25.596719] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-09T20:25:26.126698] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T20:25:26.396736] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-09T20:25:26.613204] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T20:25:26.928435] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T20:25:27.196774] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-09T20:25:27.996718] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-09T20:25:28.321634] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T20:25:28.796751] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-09T20:25:29.230607] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T20:25:29.596727] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-09T20:25:30.126768] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-09T20:25:30.230984] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T20:25:30.396718] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-09T20:25:30.898333] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T20:25:30.899714] [INFO ] [REMOTE ] NCA: Full fetch complete (15059 records). [2025-10-09T20:25:30.899793] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-09T20:25:30.900275] [FATAL] [VALIDATOR ] NCA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:25:30.900368] [FATAL] [MAIN ] NCA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:25:30.900414] [WARN ] [MAIN ] NCA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:25:30.900490] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-09T20:25:30.900562] [DEBUG] [LOCAL ] NCA: No primary data file found to delete. [2025-10-09T20:25:30.900601] [INFO ] [LOCAL ] NCA: Starting deletion of derivative data. [2025-10-09T20:25:30.901362] [DEBUG] [LOCAL ] NCA: Deleted derivative data file. [2025-10-09T20:25:30.901778] [INFO ] [MAIN ] Update Progress: 1460/2373 symbols completed. NCA took 25.2s. Estimated remaining: 2h 8m 29s. Rate: 7.1 symbols/min [2025-10-09T20:25:31.090442] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:25:31.106220] [DEBUG] [LOCAL ] NCV: Loaded 13909 existing records from primary storage. [2025-10-09T20:25:31.106526] [INFO ] [MAIN ] NCV: Loaded 13909 existing records. [2025-10-09T20:25:31.202852] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-09T20:25:31.285092] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:25:31.285314] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-09T20:25:31.285363] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-09T20:25:31.285586] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-09T20:25:31.285670] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-09T20:25:31.657215] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:25:31.996710] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-09T20:25:32.796737] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-09T20:25:33.411948] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T20:25:33.593817] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-09T20:25:33.604254] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-09T20:25:33.758776] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T20:25:34.099941] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T20:25:34.396752] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-09T20:25:35.196734] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-09T20:25:35.996735] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-09T20:25:36.386812] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T20:25:36.772970] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-09T20:25:36.796675] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-09T20:25:37.075756] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T20:25:37.596735] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-09T20:25:38.397293] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-09T20:25:38.552417] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T20:25:38.860522] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T20:25:38.955601] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-09T20:25:39.196768] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-09T20:25:39.996746] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-09T20:25:40.275624] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-09T20:25:40.276801] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T20:25:40.282863] [INFO ] [REMOTE ] NC: Full fetch complete (2721 records). [2025-10-09T20:25:40.283022] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-09T20:25:40.283489] [FATAL] [VALIDATOR ] NC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:25:40.283579] [FATAL] [MAIN ] NC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:25:40.283623] [WARN ] [MAIN ] NC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:25:40.283740] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-09T20:25:40.283840] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-09T20:25:40.283905] [INFO ] [LOCAL ] NC: Starting deletion of derivative data. [2025-10-09T20:25:40.283994] [DEBUG] [LOCAL ] NC: No derivative data file found to delete. [2025-10-09T20:25:40.284116] [INFO ] [MAIN ] Update Progress: 1461/2373 symbols completed. NC took 43.1s. Estimated remaining: 2h 8m 21s. Rate: 7.1 symbols/min [2025-10-09T20:25:40.455563] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:25:40.470253] [DEBUG] [LOCAL ] NCZ: Loaded 12196 existing records from primary storage. [2025-10-09T20:25:40.470524] [INFO ] [MAIN ] NCZ: Loaded 12196 existing records. [2025-10-09T20:25:40.644749] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:25:40.644974] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-09T20:25:40.645022] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-09T20:25:40.645225] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-09T20:25:40.645281] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-09T20:25:40.800735] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-09T20:25:41.055414] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:25:41.596765] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-09T20:25:41.949898] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T20:25:42.396708] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-09T20:25:42.721843] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T20:25:43.196680] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-09T20:25:43.491164] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T20:25:43.996694] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-09T20:25:44.796742] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-09T20:25:45.152891] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T20:25:45.206382] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T20:25:45.596731] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-09T20:25:45.696398] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T20:25:46.396773] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-09T20:25:47.196716] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-09T20:25:47.353245] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T20:25:47.355564] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T20:25:47.996787] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-09T20:25:48.287625] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T20:25:48.796726] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-09T20:25:49.031916] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T20:25:49.596718] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-09T20:25:50.164298] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T20:25:50.168429] [INFO ] [REMOTE ] NCLH: Full fetch complete (77420 records). [2025-10-09T20:25:50.168555] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-09T20:25:50.169456] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:25:50.169545] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:25:50.169588] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:25:50.169679] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-09T20:25:50.169760] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-09T20:25:50.169797] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-09T20:25:50.169836] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-09T20:25:50.169895] [INFO ] [MAIN ] Update Progress: 1462/2373 symbols completed. NCLH took 32.9s. Estimated remaining: 2h 8m 13s. Rate: 7.1 symbols/min [2025-10-09T20:25:50.301069] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T20:25:50.384034] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:25:50.384234] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-09T20:25:50.384273] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-09T20:25:50.384385] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-09T20:25:50.384427] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-09T20:25:50.384470] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-09T20:25:50.384504] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-09T20:25:50.405164] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-09T20:25:50.756109] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:25:51.206954] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-09T20:25:51.209266] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T20:25:51.996752] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-09T20:25:52.063761] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T20:25:52.796751] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-09T20:25:53.029152] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T20:25:53.259177] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:25:53.262028] [INFO ] [REMOTE ] NCDL: Full fetch complete (32644 records). [2025-10-09T20:25:53.262124] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-09T20:25:53.262723] [FATAL] [VALIDATOR ] NCDL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:25:53.262817] [FATAL] [MAIN ] NCDL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:25:53.262868] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:25:53.262944] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-09T20:25:53.263032] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-09T20:25:53.263113] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-09T20:25:53.263212] [DEBUG] [LOCAL ] NCDL: No derivative data file found to delete. [2025-10-09T20:25:53.263319] [INFO ] [MAIN ] Update Progress: 1463/2373 symbols completed. NCDL took 38.3s. Estimated remaining: 2h 8m 2s. Rate: 7.1 symbols/min [2025-10-09T20:25:53.459484] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:25:53.459683] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-09T20:25:53.459738] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-09T20:25:53.459850] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-09T20:25:53.459891] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-09T20:25:53.459932] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-09T20:25:53.459964] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-09T20:25:53.608146] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-09T20:25:53.836496] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:25:54.396804] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-09T20:25:54.636602] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T20:25:55.196801] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-09T20:25:55.443519] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T20:25:55.996727] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-09T20:25:56.516222] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T20:25:56.796774] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-09T20:25:57.252495] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T20:25:57.596715] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-09T20:25:57.863758] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T20:25:58.396734] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-09T20:25:59.154601] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T20:25:59.196678] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-09T20:25:59.239827] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T20:25:59.658134] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:25:59.660037] [INFO ] [REMOTE ] NCV: Full fetch complete (22325 records). [2025-10-09T20:25:59.660114] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-09T20:25:59.660583] [FATAL] [VALIDATOR ] NCV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:25:59.660697] [FATAL] [MAIN ] NCV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:25:59.660802] [WARN ] [MAIN ] NCV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:25:59.660889] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-09T20:25:59.660969] [DEBUG] [LOCAL ] NCV: No primary data file found to delete. [2025-10-09T20:25:59.661022] [INFO ] [LOCAL ] NCV: Starting deletion of derivative data. [2025-10-09T20:25:59.661196] [DEBUG] [LOCAL ] NCV: Deleted derivative data file. [2025-10-09T20:25:59.661304] [INFO ] [MAIN ] Update Progress: 1464/2373 symbols completed. NCV took 28.8s. Estimated remaining: 2h 7m 52s. Rate: 7.1 symbols/min [2025-10-09T20:25:59.846554] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:25:59.891863] [DEBUG] [LOCAL ] NEA: Loaded 35470 existing records from primary storage. [2025-10-09T20:25:59.892169] [INFO ] [MAIN ] NEA: Loaded 35470 existing records. [2025-10-09T20:26:00.001845] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-09T20:26:00.075088] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:26:00.075334] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-09T20:26:00.075395] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-09T20:26:00.075743] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-09T20:26:00.075814] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-09T20:26:00.470447] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:26:00.796691] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-09T20:26:00.813901] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T20:26:01.596731] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-09T20:26:02.401806] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-09T20:26:02.418129] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T20:26:02.579617] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T20:26:03.196711] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-09T20:26:03.388139] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T20:26:03.996730] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-09T20:26:04.507856] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T20:26:04.796727] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-09T20:26:05.548552] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T20:26:05.596726] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-09T20:26:05.855908] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T20:26:06.396728] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-09T20:26:07.100954] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T20:26:07.196713] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-09T20:26:07.445583] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T20:26:07.996723] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-09T20:26:08.674058] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T20:26:08.796712] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-09T20:26:08.836599] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T20:26:09.596745] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-09T20:26:09.886673] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T20:26:10.396713] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-09T20:26:11.196680] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-09T20:26:11.312689] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T20:26:11.528230] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T20:26:11.996700] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-09T20:26:12.323293] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T20:26:12.796737] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-09T20:26:13.607702] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-09T20:26:13.616977] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T20:26:13.641162] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T20:26:14.396745] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-09T20:26:14.967057] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T20:26:15.196736] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-09T20:26:15.315525] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T20:26:15.996733] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-09T20:26:16.796709] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-09T20:26:17.040918] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T20:26:17.190914] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T20:26:17.596727] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-09T20:26:17.872844] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T20:26:18.396730] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-09T20:26:18.915975] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T20:26:19.196735] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-09T20:26:19.705076] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T20:26:19.996775] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-09T20:26:20.796891] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-09T20:26:21.026300] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T20:26:21.121835] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T20:26:21.596712] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-09T20:26:21.692961] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T20:26:22.319165] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T20:26:22.396667] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-09T20:26:22.845613] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T20:26:22.847602] [INFO ] [REMOTE ] NDMO: Full fetch complete (24033 records). [2025-10-09T20:26:22.848040] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-09T20:26:22.849799] [FATAL] [VALIDATOR ] NDMO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:26:22.849922] [FATAL] [MAIN ] NDMO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:26:22.849969] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:26:22.850051] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-09T20:26:22.850176] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-09T20:26:22.850231] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-09T20:26:22.850291] [DEBUG] [LOCAL ] NDMO: No derivative data file found to delete. [2025-10-09T20:26:22.850388] [INFO ] [MAIN ] Update Progress: 1465/2373 symbols completed. NDMO took 32.7s. Estimated remaining: 2h 7m 53s. Rate: 7.1 symbols/min [2025-10-09T20:26:23.027813] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:26:23.028067] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-09T20:26:23.028125] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-09T20:26:23.028244] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-09T20:26:23.028288] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-09T20:26:23.028331] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-09T20:26:23.028364] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-09T20:26:23.196818] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-09T20:26:23.397354] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:26:23.896888] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T20:26:23.996764] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-09T20:26:24.796726] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-09T20:26:25.596737] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-09T20:26:25.654422] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T20:26:26.136262] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T20:26:26.138031] [INFO ] [REMOTE ] NCZ: Full fetch complete (21142 records). [2025-10-09T20:26:26.138106] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-09T20:26:26.138701] [FATAL] [VALIDATOR ] NCZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:26:26.138791] [FATAL] [MAIN ] NCZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:26:26.138835] [WARN ] [MAIN ] NCZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:26:26.138873] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-09T20:26:26.138927] [DEBUG] [LOCAL ] NCZ: No primary data file found to delete. [2025-10-09T20:26:26.138962] [INFO ] [LOCAL ] NCZ: Starting deletion of derivative data. [2025-10-09T20:26:26.139140] [DEBUG] [LOCAL ] NCZ: Deleted derivative data file. [2025-10-09T20:26:26.139234] [INFO ] [MAIN ] Update Progress: 1466/2373 symbols completed. NCZ took 45.9s. Estimated remaining: 2h 7m 41s. Rate: 7.1 symbols/min [2025-10-09T20:26:26.323789] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:26:26.323955] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-09T20:26:26.323994] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-09T20:26:26.324107] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-09T20:26:26.324149] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-09T20:26:26.324191] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-09T20:26:26.324224] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-09T20:26:26.401791] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-09T20:26:26.682943] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:26:26.998809] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-09T20:26:27.196762] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-09T20:26:27.643290] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T20:26:27.707414] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T20:26:27.996737] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-09T20:26:28.653333] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:26:28.796735] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-09T20:26:29.596719] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-09T20:26:30.396741] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-09T20:26:30.775064] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T20:26:30.777839] [INFO ] [REMOTE ] NEA: Full fetch complete (51326 records). [2025-10-09T20:26:30.777926] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-09T20:26:30.778451] [FATAL] [VALIDATOR ] NEA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:26:30.778536] [FATAL] [MAIN ] NEA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:26:30.778579] [WARN ] [MAIN ] NEA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:26:30.778617] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-09T20:26:30.778704] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-09T20:26:30.778755] [INFO ] [LOCAL ] NEA: Starting deletion of derivative data. [2025-10-09T20:26:30.778897] [DEBUG] [LOCAL ] NEA: Deleted derivative data file. [2025-10-09T20:26:30.778988] [INFO ] [MAIN ] Update Progress: 1467/2373 symbols completed. NEA took 31.1s. Estimated remaining: 2h 7m 30s. Rate: 7.1 symbols/min [2025-10-09T20:26:30.953170] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:26:30.953414] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-09T20:26:30.953488] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-09T20:26:30.953665] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-09T20:26:30.953736] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-09T20:26:30.953893] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-09T20:26:30.953974] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-09T20:26:31.151513] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-09T20:26:31.212987] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-09T20:26:31.370054] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:26:31.411460] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T20:26:31.694943] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T20:26:31.699113] [INFO ] [REMOTE ] NE: Full fetch complete (75138 records). [2025-10-09T20:26:31.699227] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-09T20:26:31.700385] [FATAL] [VALIDATOR ] NE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:26:31.700476] [FATAL] [MAIN ] NE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:26:31.700546] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:26:31.700622] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-09T20:26:31.700752] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-09T20:26:31.700800] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-09T20:26:31.700843] [DEBUG] [LOCAL ] NE: No derivative data file found to delete. [2025-10-09T20:26:31.700906] [INFO ] [MAIN ] Update Progress: 1468/2373 symbols completed. NE took 38.4s. Estimated remaining: 2h 7m 17s. Rate: 7.1 symbols/min [2025-10-09T20:26:31.884017] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:26:31.884193] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-09T20:26:31.884263] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-09T20:26:31.884406] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-09T20:26:31.884473] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-09T20:26:31.884533] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-09T20:26:31.884569] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-09T20:26:32.001996] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-09T20:26:32.259227] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:26:32.796774] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-09T20:26:33.472990] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T20:26:33.596713] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-09T20:26:34.259163] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-09T20:26:34.396733] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-09T20:26:35.196784] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-09T20:26:35.512724] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-09T20:26:35.928756] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T20:26:35.996684] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-09T20:26:36.562155] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-09T20:26:36.689995] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T20:26:36.796801] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-09T20:26:37.596766] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-09T20:26:38.396743] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-09T20:26:39.092583] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-09T20:26:39.196797] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-09T20:26:39.643786] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-09T20:26:39.996756] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-09T20:26:40.182843] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T20:26:40.656221] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T20:26:40.796772] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-09T20:26:41.526821] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-09T20:26:41.596761] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-09T20:26:42.396753] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-09T20:26:43.067984] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T20:26:43.075579] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-09T20:26:43.196748] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-09T20:26:43.564768] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T20:26:43.996745] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-09T20:26:44.796719] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-09T20:26:44.990604] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T20:26:45.596738] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-09T20:26:45.899916] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T20:26:46.330852] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T20:26:46.396747] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-09T20:26:46.879330] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T20:26:47.196833] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-09T20:26:47.996755] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-09T20:26:48.224885] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T20:26:48.352819] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T20:26:48.796759] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-09T20:26:49.596723] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-09T20:26:50.003847] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T20:26:50.396696] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-09T20:26:50.641506] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T20:26:51.196758] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-09T20:26:51.645143] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-09T20:26:51.837845] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-09T20:26:51.996811] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-09T20:26:52.467129] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-09T20:26:52.796751] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-09T20:26:53.596699] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-09T20:26:54.337563] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-09T20:26:54.396708] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-09T20:26:54.511573] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T20:26:54.936487] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-09T20:26:55.196703] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-09T20:26:55.441794] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T20:26:55.996779] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-09T20:26:56.451865] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:26:56.457333] [INFO ] [REMOTE ] NET: Full fetch complete (76397 records). [2025-10-09T20:26:56.457750] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-09T20:26:56.459670] [FATAL] [VALIDATOR ] NET: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:26:56.459898] [FATAL] [MAIN ] NET: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:26:56.460152] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:26:56.460295] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-09T20:26:56.460383] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-09T20:26:56.460469] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-09T20:26:56.460534] [DEBUG] [LOCAL ] NET: No derivative data file found to delete. [2025-10-09T20:26:56.460694] [INFO ] [MAIN ] Update Progress: 1469/2373 symbols completed. NET took 25.7s. Estimated remaining: 2h 7m 19s. Rate: 7.1 symbols/min [2025-10-09T20:26:56.628664] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:26:56.628893] [DEBUG] [LOCAL ] NEXA: No existing data file found in primary storage. [2025-10-09T20:26:56.628933] [WARN ] [MAIN ] NEXA: No existing data found, performing full refresh instead. [2025-10-09T20:26:56.629051] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-09T20:26:56.629092] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-09T20:26:56.629131] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-09T20:26:56.629164] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-09T20:26:56.801182] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-09T20:26:57.004844] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:26:57.039407] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T20:26:57.589706] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T20:26:57.596676] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-09T20:26:57.939446] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T20:26:57.940635] [INFO ] [REMOTE ] NEU: Full fetch complete (10643 records). [2025-10-09T20:26:57.940728] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-09T20:26:57.941101] [FATAL] [VALIDATOR ] NEU: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:26:57.941181] [FATAL] [MAIN ] NEU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:26:57.941224] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:26:57.941261] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-09T20:26:57.941319] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-09T20:26:57.941353] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-09T20:26:57.941392] [DEBUG] [LOCAL ] NEU: No derivative data file found to delete. [2025-10-09T20:26:57.941460] [INFO ] [MAIN ] Update Progress: 1470/2373 symbols completed. NEU took 26.2s. Estimated remaining: 2h 7m 6s. Rate: 7.1 symbols/min [2025-10-09T20:26:58.105884] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:26:58.106028] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-09T20:26:58.106082] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-09T20:26:58.106184] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-09T20:26:58.106224] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-09T20:26:58.106264] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-09T20:26:58.106295] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-09T20:26:58.410864] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-09T20:26:58.456926] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:26:59.196740] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-09T20:26:59.336678] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T20:26:59.996731] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-09T20:27:00.702279] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T20:27:00.796798] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-09T20:27:01.596784] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T20:27:01.596887] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-09T20:27:02.128330] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-09T20:27:02.396769] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-09T20:27:03.196761] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-09T20:27:03.278736] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T20:27:03.996801] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-09T20:27:04.110171] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T20:27:04.273404] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T20:27:04.399678] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T20:27:04.405103] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-10-09T20:27:04.405304] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-09T20:27:04.406405] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:27:04.406526] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:27:04.406584] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:27:04.406693] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-09T20:27:04.406812] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-09T20:27:04.406883] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-09T20:27:04.406968] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-09T20:27:04.407068] [INFO ] [MAIN ] Update Progress: 1471/2373 symbols completed. NEM took 38.3s. Estimated remaining: 2h 6m 56s. Rate: 7.1 symbols/min [2025-10-09T20:27:04.589999] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:27:04.612739] [DEBUG] [LOCAL ] NFJ: Loaded 20463 existing records from primary storage. [2025-10-09T20:27:04.613008] [INFO ] [MAIN ] NFJ: Loaded 20463 existing records. [2025-10-09T20:27:04.788443] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:27:04.788747] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-09T20:27:04.788809] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-09T20:27:04.789104] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-09T20:27:04.789163] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-09T20:27:04.801838] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-09T20:27:05.163359] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:27:05.596707] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-09T20:27:06.278525] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T20:27:06.403494] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-09T20:27:06.405992] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T20:27:07.138392] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T20:27:07.196690] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-09T20:27:07.749838] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T20:27:07.996754] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-09T20:27:08.796761] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-09T20:27:09.603869] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-09T20:27:09.620177] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T20:27:10.257535] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T20:27:10.396734] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-09T20:27:10.884260] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T20:27:10.926878] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-09T20:27:11.196728] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-09T20:27:11.868457] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T20:27:11.996739] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-09T20:27:12.796823] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-09T20:27:13.220595] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T20:27:13.596759] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-09T20:27:14.396699] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-09T20:27:14.456065] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T20:27:15.175233] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T20:27:15.196850] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-09T20:27:15.199887] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-09T20:27:15.784864] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T20:27:15.996734] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-09T20:27:16.796765] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-09T20:27:17.253721] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T20:27:17.310789] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T20:27:17.596758] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-09T20:27:18.396752] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-09T20:27:19.103265] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T20:27:19.123590] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:27:19.124789] [INFO ] [REMOTE ] NEXA: Full fetch complete (7631 records). [2025-10-09T20:27:19.124866] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-09T20:27:19.125235] [FATAL] [VALIDATOR ] NEXA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:27:19.125397] [FATAL] [MAIN ] NEXA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:27:19.125466] [WARN ] [MAIN ] NEXA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:27:19.125538] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-09T20:27:19.125601] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-09T20:27:19.125636] [INFO ] [LOCAL ] NEXA: Starting deletion of derivative data. [2025-10-09T20:27:19.125733] [DEBUG] [LOCAL ] NEXA: No derivative data file found to delete. [2025-10-09T20:27:19.125867] [INFO ] [MAIN ] Update Progress: 1472/2373 symbols completed. NEXA took 22.7s. Estimated remaining: 2h 6m 52s. Rate: 7.1 symbols/min [2025-10-09T20:27:19.201879] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-09T20:27:19.304570] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:27:19.304809] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-09T20:27:19.304869] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-09T20:27:19.304990] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-09T20:27:19.305035] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-09T20:27:19.305080] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-09T20:27:19.305116] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-09T20:27:19.659200] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:27:19.996691] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-09T20:27:20.103774] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T20:27:20.796714] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-09T20:27:21.398813] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T20:27:21.596743] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-09T20:27:21.883039] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T20:27:22.396713] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-09T20:27:23.128171] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T20:27:23.196685] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-09T20:27:23.624040] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T20:27:23.996731] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-09T20:27:24.804114] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-09T20:27:24.823744] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T20:27:25.151276] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T20:27:25.316323] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T20:27:25.320822] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-10-09T20:27:25.321006] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-09T20:27:25.322057] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:27:25.322161] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:27:25.322205] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:27:25.322246] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-09T20:27:25.322307] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-09T20:27:25.322344] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-09T20:27:25.322385] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-09T20:27:25.322459] [INFO ] [MAIN ] Update Progress: 1473/2373 symbols completed. NEE took 1m 2s. Estimated remaining: 2h 6m 42s. Rate: 7.1 symbols/min [2025-10-09T20:27:25.507398] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:27:25.507586] [DEBUG] [LOCAL ] NGL: No existing data file found in primary storage. [2025-10-09T20:27:25.507662] [WARN ] [MAIN ] NGL: No existing data found, performing full refresh instead. [2025-10-09T20:27:25.507817] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-09T20:27:25.507928] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-09T20:27:25.507998] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-09T20:27:25.508034] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-09T20:27:25.602020] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-09T20:27:25.925121] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:27:26.396716] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-09T20:27:27.196744] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-09T20:27:27.837314] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T20:27:27.996685] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-09T20:27:28.121047] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-09T20:27:28.233457] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T20:27:28.795080] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T20:27:28.798981] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-09T20:27:29.596727] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-09T20:27:30.345173] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T20:27:30.396750] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-09T20:27:30.603331] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T20:27:30.938325] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T20:27:31.196793] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-09T20:27:31.838378] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T20:27:31.842569] [INFO ] [REMOTE ] NFG: Full fetch complete (56686 records). [2025-10-09T20:27:31.843008] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-09T20:27:31.845052] [FATAL] [VALIDATOR ] NFG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:27:31.845158] [FATAL] [MAIN ] NFG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:27:31.845204] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:27:31.845438] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-09T20:27:31.845548] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-09T20:27:31.845609] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-09T20:27:31.845686] [DEBUG] [LOCAL ] NFG: No derivative data file found to delete. [2025-10-09T20:27:31.845779] [INFO ] [MAIN ] Update Progress: 1474/2373 symbols completed. NFG took 33.9s. Estimated remaining: 2h 6m 32s. Rate: 7.1 symbols/min [2025-10-09T20:27:32.001865] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-09T20:27:32.035614] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:27:32.035853] [DEBUG] [LOCAL ] NGS: No existing data file found in primary storage. [2025-10-09T20:27:32.035911] [WARN ] [MAIN ] NGS: No existing data found, performing full refresh instead. [2025-10-09T20:27:32.036030] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-09T20:27:32.036080] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-09T20:27:32.036133] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-09T20:27:32.036175] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-09T20:27:32.407428] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:27:32.796718] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-09T20:27:33.341872] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T20:27:33.596771] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-09T20:27:33.727511] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T20:27:34.396748] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-09T20:27:35.196693] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-09T20:27:35.534617] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T20:27:35.572957] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T20:27:35.996762] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-09T20:27:36.520722] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T20:27:36.796766] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-09T20:27:37.516338] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T20:27:37.596698] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-09T20:27:38.013106] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T20:27:38.396783] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-09T20:27:39.113848] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T20:27:39.196696] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-09T20:27:39.446279] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T20:27:39.772752] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T20:27:39.996740] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-09T20:27:40.518890] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T20:27:40.520893] [INFO ] [REMOTE ] NFJ: Full fetch complete (30131 records). [2025-10-09T20:27:40.520964] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-09T20:27:40.521571] [FATAL] [VALIDATOR ] NFJ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:27:40.521683] [FATAL] [MAIN ] NFJ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:27:40.521737] [WARN ] [MAIN ] NFJ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:27:40.521804] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-09T20:27:40.521931] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-09T20:27:40.521986] [INFO ] [LOCAL ] NFJ: Starting deletion of derivative data. [2025-10-09T20:27:40.522163] [DEBUG] [LOCAL ] NFJ: Deleted derivative data file. [2025-10-09T20:27:40.522254] [INFO ] [MAIN ] Update Progress: 1475/2373 symbols completed. NFJ took 36.1s. Estimated remaining: 2h 6m 24s. Rate: 7.1 symbols/min [2025-10-09T20:27:40.697257] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:27:40.697504] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-09T20:27:40.697556] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-09T20:27:40.697699] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-09T20:27:40.697787] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-09T20:27:40.697850] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-09T20:27:40.697884] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-09T20:27:40.800526] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-09T20:27:41.061121] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:27:41.596696] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-09T20:27:41.757539] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T20:27:42.396685] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-09T20:27:42.757432] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T20:27:43.196752] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-09T20:27:43.996712] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-09T20:27:44.155795] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T20:27:44.208509] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T20:27:44.796691] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-09T20:27:45.099175] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T20:27:45.596684] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-09T20:27:45.610757] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T20:27:46.396735] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-09T20:27:47.196691] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-09T20:27:47.302418] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T20:27:47.326298] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T20:27:47.996712] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-09T20:27:48.337153] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T20:27:48.748796] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T20:27:48.796736] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-09T20:27:49.596696] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-09T20:27:49.980461] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T20:27:50.301091] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T20:27:50.396752] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-09T20:27:51.196739] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-09T20:27:51.642229] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T20:27:51.646238] [INFO ] [REMOTE ] NGG: Full fetch complete (65975 records). [2025-10-09T20:27:51.646752] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-09T20:27:51.656092] [FATAL] [VALIDATOR ] NGG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:27:51.656301] [FATAL] [MAIN ] NGG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:27:51.656537] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:27:51.656634] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-09T20:27:51.656744] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-09T20:27:51.656785] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-09T20:27:51.656827] [DEBUG] [LOCAL ] NGG: No derivative data file found to delete. [2025-10-09T20:27:51.656894] [INFO ] [MAIN ] Update Progress: 1476/2373 symbols completed. NGG took 32.5s. Estimated remaining: 2h 6m 17s. Rate: 7.1 symbols/min [2025-10-09T20:27:51.833638] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:27:51.834165] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-09T20:27:51.834273] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-09T20:27:51.834399] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-09T20:27:51.834469] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-09T20:27:51.834700] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-09T20:27:51.834775] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-09T20:27:52.006549] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-09T20:27:52.082876] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T20:27:52.240083] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:27:52.796911] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-09T20:27:53.291569] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T20:27:53.596700] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-09T20:27:53.839572] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T20:27:54.396734] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-09T20:27:55.021697] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T20:27:55.196693] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-09T20:27:55.252040] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T20:27:55.996738] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-09T20:27:56.796685] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-09T20:27:56.933555] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T20:27:57.046600] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T20:27:57.399496] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T20:27:57.596728] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-09T20:27:58.396726] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-09T20:27:58.867615] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T20:27:59.196727] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-09T20:27:59.604569] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T20:27:59.973776] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T20:27:59.996732] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-09T20:28:00.796706] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-09T20:28:00.888762] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-09T20:28:01.596734] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-09T20:28:02.042726] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T20:28:02.396735] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-09T20:28:02.575816] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T20:28:02.755716] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T20:28:03.196775] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-09T20:28:03.996735] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-09T20:28:04.156353] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T20:28:04.607288] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T20:28:04.796722] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-09T20:28:05.596780] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-09T20:28:06.056592] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T20:28:06.057467] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:28:06.067146] [INFO ] [REMOTE ] NGL: Full fetch complete (41162 records). [2025-10-09T20:28:06.067246] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-09T20:28:06.067965] [FATAL] [VALIDATOR ] NGL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:28:06.068096] [FATAL] [MAIN ] NGL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:28:06.068139] [WARN ] [MAIN ] NGL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:28:06.068197] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-09T20:28:06.068278] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-09T20:28:06.068315] [INFO ] [LOCAL ] NGL: Starting deletion of derivative data. [2025-10-09T20:28:06.068355] [DEBUG] [LOCAL ] NGL: No derivative data file found to delete. [2025-10-09T20:28:06.068411] [INFO ] [MAIN ] Update Progress: 1477/2373 symbols completed. NGL took 40.7s. Estimated remaining: 2h 6m 12s. Rate: 7.1 symbols/min [2025-10-09T20:28:06.396851] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-09T20:28:07.072039] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T20:28:07.196726] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-09T20:28:07.996725] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-09T20:28:08.210764] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T20:28:08.796722] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-09T20:28:09.264034] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T20:28:09.284187] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T20:28:09.285756] [INFO ] [REMOTE ] NGS: Full fetch complete (17104 records). [2025-10-09T20:28:09.285856] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-09T20:28:09.286436] [FATAL] [VALIDATOR ] NGS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:28:09.286527] [FATAL] [MAIN ] NGS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:28:09.286572] [WARN ] [MAIN ] NGS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:28:09.286638] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-09T20:28:09.286742] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-09T20:28:09.286780] [INFO ] [LOCAL ] NGS: Starting deletion of derivative data. [2025-10-09T20:28:09.286822] [DEBUG] [LOCAL ] NGS: No derivative data file found to delete. [2025-10-09T20:28:09.286891] [INFO ] [MAIN ] Update Progress: 1478/2373 symbols completed. NGS took 37.4s. Estimated remaining: 2h 6m 1s. Rate: 7.1 symbols/min [2025-10-09T20:28:09.596798] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-09T20:28:10.396743] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-09T20:28:10.617712] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T20:28:11.196782] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-09T20:28:11.320613] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:28:11.996723] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-09T20:28:12.196110] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T20:28:12.290312] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-09T20:28:12.292368] [INFO ] [REMOTE ] NGVC: Full fetch complete (30524 records). [2025-10-09T20:28:12.292445] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-09T20:28:12.292955] [FATAL] [VALIDATOR ] NGVC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:28:12.293040] [FATAL] [MAIN ] NGVC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:28:12.293084] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:28:12.293150] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-09T20:28:12.293213] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-09T20:28:12.293249] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-09T20:28:12.293312] [DEBUG] [LOCAL ] NGVC: No derivative data file found to delete. [2025-10-09T20:28:12.293391] [INFO ] [MAIN ] Update Progress: 1479/2373 symbols completed. NGVC took 31.8s. Estimated remaining: 2h 5m 49s. Rate: 7.1 symbols/min [2025-10-09T20:28:12.796726] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-09T20:28:14.177564] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T20:28:14.183871] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-09T20:28:14.701041] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T20:28:14.706251] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-09T20:28:15.181788] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T20:28:15.183834] [INFO ] [REMOTE ] NGVT: Full fetch complete (34263 records). [2025-10-09T20:28:15.183910] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-09T20:28:15.184379] [FATAL] [VALIDATOR ] NGVT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:28:15.184460] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:28:15.184503] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:28:15.184567] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-09T20:28:15.184629] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-09T20:28:15.184728] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-09T20:28:15.184795] [DEBUG] [LOCAL ] NGVT: No derivative data file found to delete. [2025-10-09T20:28:15.184853] [INFO ] [MAIN ] Update Progress: 1480/2373 symbols completed. NGVT took 23.5s. Estimated remaining: 2h 5m 37s. Rate: 7.1 symbols/min [2025-10-09T20:28:15.807817] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:15.904144] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-09T20:28:15.915711] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:15.938474] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:15.939463] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:15.939618] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-09T20:28:15.940211] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-09T20:28:15.940297] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-09T20:28:15.939948] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-09T20:28:15.940438] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-09T20:28:15.940585] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-09T20:28:15.940738] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-09T20:28:15.940524] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-09T20:28:15.940931] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-09T20:28:15.941056] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-09T20:28:15.941239] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-09T20:28:15.941166] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-09T20:28:15.941346] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-09T20:28:15.941476] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-09T20:28:15.958372] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-09T20:28:16.097911] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-09T20:28:16.170726] [DEBUG] [LOCAL ] NIE: Loaded 11989 existing records from primary storage. [2025-10-09T20:28:16.161878] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-09T20:28:16.181576] [INFO ] [MAIN ] NIE: Loaded 11989 existing records. [2025-10-09T20:28:17.031670] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:28:17.205811] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:17.195086] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:17.225361] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-09T20:28:17.225537] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-09T20:28:17.226825] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-09T20:28:17.232399] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-09T20:28:17.249598] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-09T20:28:17.274756] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-09T20:28:17.382546] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:17.399292] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-09T20:28:17.671524] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:17.672073] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-09T20:28:18.096434] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T20:28:18.396765] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-09T20:28:18.423351] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T20:28:18.811191] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T20:28:19.196740] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-09T20:28:19.223876] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T20:28:19.482475] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-09T20:28:19.996724] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-09T20:28:20.519385] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T20:28:20.796786] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-09T20:28:20.822223] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T20:28:21.596815] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-09T20:28:21.738928] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T20:28:22.396736] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-09T20:28:22.987523] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T20:28:23.196702] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-09T20:28:23.384016] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T20:28:23.996718] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-09T20:28:24.161021] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T20:28:24.796727] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-09T20:28:25.374821] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T20:28:25.596734] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-09T20:28:25.642639] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T20:28:26.396735] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-09T20:28:26.724913] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T20:28:27.196718] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-09T20:28:27.996689] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-09T20:28:28.066724] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T20:28:28.234270] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T20:28:28.796754] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-09T20:28:29.042907] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T20:28:29.374989] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T20:28:29.596741] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-09T20:28:30.396683] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-09T20:28:30.519878] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T20:28:31.196724] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-09T20:28:31.941197] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T20:28:31.996691] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-09T20:28:32.401417] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T20:28:32.775949] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T20:28:32.796734] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-09T20:28:33.596731] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-09T20:28:33.647531] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T20:28:34.396736] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-09T20:28:35.196679] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-09T20:28:35.352996] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T20:28:35.481920] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T20:28:35.812259] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T20:28:35.996731] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-09T20:28:36.796727] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-09T20:28:37.596700] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-09T20:28:37.707698] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T20:28:37.829054] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T20:28:38.396740] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-09T20:28:38.462026] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T20:28:39.196695] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-09T20:28:39.370299] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T20:28:39.996782] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-09T20:28:40.796830] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-09T20:28:41.078615] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T20:28:41.254570] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-09T20:28:41.496626] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T20:28:41.596767] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-09T20:28:42.172946] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T20:28:42.396711] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-09T20:28:42.997636] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T20:28:43.196757] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-09T20:28:43.996798] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-09T20:28:44.407722] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T20:28:44.409537] [INFO ] [REMOTE ] NIE: Full fetch complete (16619 records). [2025-10-09T20:28:44.409623] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-09T20:28:44.410107] [FATAL] [VALIDATOR ] NIE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:28:44.410205] [FATAL] [MAIN ] NIE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:28:44.410258] [WARN ] [MAIN ] NIE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:28:44.410348] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-09T20:28:44.410425] [DEBUG] [LOCAL ] NIE: No primary data file found to delete. [2025-10-09T20:28:44.410464] [INFO ] [LOCAL ] NIE: Starting deletion of derivative data. [2025-10-09T20:28:44.410639] [DEBUG] [LOCAL ] NIE: Deleted derivative data file. [2025-10-09T20:28:44.410846] [INFO ] [MAIN ] Update Progress: 1481/2373 symbols completed. NIE took 29.2s. Estimated remaining: 2h 5m 41s. Rate: 7.1 symbols/min [2025-10-09T20:28:44.623962] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:44.636287] [DEBUG] [LOCAL ] NIM: Loaded 3906 existing records from primary storage. [2025-10-09T20:28:44.636547] [INFO ] [MAIN ] NIM: Loaded 3906 existing records. [2025-10-09T20:28:44.805701] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-09T20:28:44.859518] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:28:44.859915] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-09T20:28:44.860048] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-09T20:28:44.860245] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-09T20:28:44.860304] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-09T20:28:45.244186] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:45.277896] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-09T20:28:45.596765] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-09T20:28:46.104363] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T20:28:46.385933] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T20:28:46.396737] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-09T20:28:46.888035] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T20:28:47.196733] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-09T20:28:47.911777] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T20:28:47.996743] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-09T20:28:48.552540] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T20:28:48.796731] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-09T20:28:49.069007] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-09T20:28:49.072067] [INFO ] [REMOTE ] NHI: Full fetch complete (31238 records). [2025-10-09T20:28:49.072188] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-09T20:28:49.072970] [FATAL] [VALIDATOR ] NHI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:28:49.073085] [FATAL] [MAIN ] NHI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:28:49.073159] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:28:49.073249] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-09T20:28:49.073353] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-09T20:28:49.073419] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-09T20:28:49.073486] [DEBUG] [LOCAL ] NHI: No derivative data file found to delete. [2025-10-09T20:28:49.073573] [INFO ] [MAIN ] Update Progress: 1482/2373 symbols completed. NHI took 33.9s. Estimated remaining: 2h 5m 31s. Rate: 7.1 symbols/min [2025-10-09T20:28:49.271356] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:49.271609] [DEBUG] [LOCAL ] NINE: No existing data file found in primary storage. [2025-10-09T20:28:49.271693] [WARN ] [MAIN ] NINE: No existing data found, performing full refresh instead. [2025-10-09T20:28:49.271826] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-09T20:28:49.271871] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-09T20:28:49.271914] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-09T20:28:49.271956] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-09T20:28:49.601861] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-09T20:28:49.710528] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:50.353339] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T20:28:50.396704] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-09T20:28:50.812441] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T20:28:50.814082] [INFO ] [REMOTE ] NIC: Full fetch complete (12252 records). [2025-10-09T20:28:50.814173] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-09T20:28:50.814699] [FATAL] [VALIDATOR ] NIC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:28:50.814793] [FATAL] [MAIN ] NIC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:28:50.814839] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:28:50.814883] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-09T20:28:50.815512] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-09T20:28:50.815754] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-09T20:28:50.815820] [DEBUG] [LOCAL ] NIC: No derivative data file found to delete. [2025-10-09T20:28:50.815941] [INFO ] [MAIN ] Update Progress: 1483/2373 symbols completed. NIC took 35.6s. Estimated remaining: 2h 5m 18s. Rate: 7.1 symbols/min [2025-10-09T20:28:50.998691] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:50.998904] [DEBUG] [LOCAL ] NIO: No existing data file found in primary storage. [2025-10-09T20:28:50.998986] [WARN ] [MAIN ] NIO: No existing data found, performing full refresh instead. [2025-10-09T20:28:50.999154] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-09T20:28:50.999219] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-09T20:28:50.999293] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-09T20:28:50.999350] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-09T20:28:51.201898] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-09T20:28:51.370205] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:51.886413] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T20:28:51.996737] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-09T20:28:52.796759] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-09T20:28:53.307572] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T20:28:53.342455] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T20:28:53.596774] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-09T20:28:54.279084] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-09T20:28:54.396786] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-09T20:28:55.103308] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-09T20:28:55.196789] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-09T20:28:55.684799] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T20:28:55.689664] [INFO ] [REMOTE ] NI: Full fetch complete (76877 records). [2025-10-09T20:28:55.689809] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-09T20:28:55.691835] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:28:55.691930] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:28:55.691975] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:28:55.692016] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-09T20:28:55.692073] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-09T20:28:55.692123] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-09T20:28:55.692192] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-09T20:28:55.692254] [INFO ] [MAIN ] Update Progress: 1484/2373 symbols completed. NI took 40.5s. Estimated remaining: 2h 5m 7s. Rate: 7.1 symbols/min [2025-10-09T20:28:55.860706] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:55.860949] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-09T20:28:55.860998] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-09T20:28:55.861125] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-09T20:28:55.861233] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-09T20:28:55.861298] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-09T20:28:55.861333] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-09T20:28:56.007096] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-09T20:28:56.212745] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:56.610852] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T20:28:56.796731] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-09T20:28:57.074881] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:28:57.075385] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-09T20:28:57.075506] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:28:57.075562] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-09T20:28:57.075598] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:28:57.075681] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-09T20:28:57.075770] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-09T20:28:57.075810] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-09T20:28:57.075919] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-09T20:28:57.076000] [INFO ] [MAIN ] Update Progress: 1485/2373 symbols completed. NIQ took 1.4s. Estimated remaining: 2h 4m 55s. Rate: 7.1 symbols/min [2025-10-09T20:28:57.264409] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:28:57.264725] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-09T20:28:57.264778] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-09T20:28:57.264911] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-09T20:28:57.264956] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-09T20:28:57.264998] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-09T20:28:57.265035] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-09T20:28:57.601934] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-09T20:28:57.642827] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:28:58.280184] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T20:28:58.396726] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-09T20:28:59.196736] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-09T20:28:59.927435] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T20:28:59.996733] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-09T20:29:00.796725] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-09T20:29:01.485605] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T20:29:01.597216] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-09T20:29:01.597145] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-09T20:29:02.148736] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T20:29:02.345280] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T20:29:02.396666] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-09T20:29:03.196727] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-09T20:29:03.502090] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T20:29:03.996748] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-09T20:29:04.796781] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-09T20:29:05.073799] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-09T20:29:05.143067] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T20:29:05.347410] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-09T20:29:05.596734] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-09T20:29:06.396717] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-09T20:29:07.196691] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-09T20:29:07.249345] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T20:29:07.592239] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T20:29:07.996733] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-09T20:29:08.292076] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T20:29:08.292872] [INFO ] [REMOTE ] NIM: Full fetch complete (6515 records). [2025-10-09T20:29:08.292939] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-09T20:29:08.293293] [FATAL] [VALIDATOR ] NIM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:29:08.293374] [FATAL] [MAIN ] NIM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:29:08.293420] [WARN ] [MAIN ] NIM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:29:08.293458] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-09T20:29:08.293523] [DEBUG] [LOCAL ] NIM: No primary data file found to delete. [2025-10-09T20:29:08.293593] [INFO ] [LOCAL ] NIM: Starting deletion of derivative data. [2025-10-09T20:29:08.293870] [DEBUG] [LOCAL ] NIM: Deleted derivative data file. [2025-10-09T20:29:08.293978] [INFO ] [MAIN ] Update Progress: 1486/2373 symbols completed. NIM took 23.9s. Estimated remaining: 2h 4m 48s. Rate: 7.1 symbols/min [2025-10-09T20:29:08.465897] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:29:08.466062] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-09T20:29:08.466097] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-09T20:29:08.466209] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-09T20:29:08.466254] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-09T20:29:08.466336] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-09T20:29:08.466394] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-09T20:29:08.804689] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-09T20:29:08.832593] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:29:09.588978] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-09T20:29:09.598869] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-09T20:29:09.942151] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T20:29:10.396724] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-09T20:29:11.196786] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-09T20:29:11.996757] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-09T20:29:12.330262] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-09T20:29:12.579357] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T20:29:12.796755] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-09T20:29:13.085026] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-09T20:29:13.363163] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T20:29:13.596767] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-09T20:29:14.396739] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-09T20:29:15.163807] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T20:29:15.196696] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-09T20:29:15.389569] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-09T20:29:15.690498] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T20:29:15.996733] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-09T20:29:16.796733] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-09T20:29:16.896716] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T20:29:17.596766] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-09T20:29:18.160573] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-09T20:29:18.396707] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-09T20:29:18.893333] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T20:29:19.196785] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-09T20:29:19.330968] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-09T20:29:19.646778] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T20:29:19.996711] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-09T20:29:20.016073] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T20:29:20.796764] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-09T20:29:21.596736] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-09T20:29:22.054925] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T20:29:22.396814] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-09T20:29:22.960383] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-10-09T20:29:23.009850] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T20:29:23.196736] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-09T20:29:23.463032] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T20:29:23.754150] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:29:23.756714] [INFO ] [REMOTE ] NINE: Full fetch complete (43271 records). [2025-10-09T20:29:23.756992] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-09T20:29:23.757858] [FATAL] [VALIDATOR ] NINE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:29:23.758414] [FATAL] [MAIN ] NINE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:29:23.758612] [WARN ] [MAIN ] NINE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:29:23.758818] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-09T20:29:23.758911] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-09T20:29:23.758949] [INFO ] [LOCAL ] NINE: Starting deletion of derivative data. [2025-10-09T20:29:23.759034] [DEBUG] [LOCAL ] NINE: No derivative data file found to delete. [2025-10-09T20:29:23.759176] [INFO ] [MAIN ] Update Progress: 1487/2373 symbols completed. NINE took 34.7s. Estimated remaining: 2h 4m 44s. Rate: 7.1 symbols/min [2025-10-09T20:29:23.927355] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:29:23.944215] [DEBUG] [LOCAL ] NKX: Loaded 13662 existing records from primary storage. [2025-10-09T20:29:23.944461] [INFO ] [MAIN ] NKX: Loaded 13662 existing records. [2025-10-09T20:29:24.004827] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-09T20:29:24.122498] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:29:24.122716] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-09T20:29:24.122776] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-09T20:29:24.123039] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-09T20:29:24.123096] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-09T20:29:24.483444] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:29:24.600350] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T20:29:24.603522] [INFO ] [REMOTE ] NJR: Full fetch complete (54493 records). [2025-10-09T20:29:24.603605] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-09T20:29:24.604244] [FATAL] [VALIDATOR ] NJR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:29:24.604330] [FATAL] [MAIN ] NJR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:29:24.604384] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:29:24.604475] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-09T20:29:24.604568] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-09T20:29:24.604669] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-09T20:29:24.604770] [DEBUG] [LOCAL ] NJR: No derivative data file found to delete. [2025-10-09T20:29:24.604894] [INFO ] [MAIN ] Update Progress: 1488/2373 symbols completed. NJR took 27.5s. Estimated remaining: 2h 4m 31s. Rate: 7.1 symbols/min [2025-10-09T20:29:24.786634] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:29:24.786831] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-09T20:29:24.786872] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-09T20:29:24.786988] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-09T20:29:24.787030] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-09T20:29:24.787119] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-09T20:29:24.787169] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-09T20:29:24.801879] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-09T20:29:25.148909] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:29:25.596712] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-09T20:29:26.396745] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-09T20:29:26.702101] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T20:29:27.162824] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-09T20:29:27.196698] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-09T20:29:27.996727] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-09T20:29:28.442325] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-09T20:29:28.771301] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-09T20:29:28.796669] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-09T20:29:29.596754] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-09T20:29:29.985472] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-09T20:29:30.116450] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T20:29:30.396732] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-09T20:29:31.037972] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-09T20:29:31.076412] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T20:29:31.196733] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-09T20:29:31.996720] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-09T20:29:32.796708] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-09T20:29:32.966426] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:29:33.559408] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-09T20:29:33.596683] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-09T20:29:34.170012] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T20:29:34.396716] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-09T20:29:34.860788] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-09T20:29:35.179753] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T20:29:35.196763] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-09T20:29:35.765734] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T20:29:35.996736] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-09T20:29:36.796749] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-09T20:29:37.596681] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-09T20:29:37.692905] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T20:29:38.298006] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:29:38.396740] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-09T20:29:38.632608] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-09T20:29:39.196718] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-09T20:29:39.996693] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-09T20:29:40.139016] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T20:29:40.678109] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-09T20:29:40.796691] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-09T20:29:41.053596] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-09T20:29:41.596749] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-09T20:29:41.617762] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T20:29:42.250351] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T20:29:42.396750] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-09T20:29:43.169300] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-09T20:29:43.173515] [INFO ] [REMOTE ] NIO: Full fetch complete (77584 records). [2025-10-09T20:29:43.173758] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-09T20:29:43.174479] [FATAL] [VALIDATOR ] NIO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:29:43.174568] [FATAL] [MAIN ] NIO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:29:43.174613] [WARN ] [MAIN ] NIO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:29:43.174681] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-09T20:29:43.174760] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-09T20:29:43.174796] [INFO ] [LOCAL ] NIO: Starting deletion of derivative data. [2025-10-09T20:29:43.174836] [DEBUG] [LOCAL ] NIO: No derivative data file found to delete. [2025-10-09T20:29:43.174892] [INFO ] [MAIN ] Update Progress: 1489/2373 symbols completed. NIO took 52.4s. Estimated remaining: 2h 4m 28s. Rate: 7.1 symbols/min [2025-10-09T20:29:43.203522] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-09T20:29:43.347968] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:29:43.348168] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-09T20:29:43.348223] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-09T20:29:43.348337] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-09T20:29:43.348379] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-09T20:29:43.348420] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-09T20:29:43.348453] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-09T20:29:43.694256] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:29:43.996737] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-09T20:29:44.792440] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T20:29:44.796666] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-09T20:29:45.513604] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-09T20:29:45.596699] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-09T20:29:45.980872] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T20:29:46.241396] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T20:29:46.396741] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-09T20:29:47.056168] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T20:29:47.196738] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-09T20:29:47.908329] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T20:29:47.996728] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-09T20:29:48.656745] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T20:29:48.796766] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-09T20:29:49.596757] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-09T20:29:49.993454] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T20:29:50.008855] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T20:29:50.396731] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-09T20:29:51.196723] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-09T20:29:51.219186] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T20:29:51.895868] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T20:29:51.996699] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-09T20:29:52.796741] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-09T20:29:52.980133] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T20:29:53.412324] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T20:29:53.596773] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-09T20:29:54.061580] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T20:29:54.396749] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-09T20:29:55.067381] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T20:29:55.196735] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-09T20:29:55.438550] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-09T20:29:55.439400] [INFO ] [REMOTE ] NL: Full fetch complete (6761 records). [2025-10-09T20:29:55.439469] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-09T20:29:55.439996] [FATAL] [VALIDATOR ] NL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:29:55.440077] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:29:55.440120] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:29:55.440159] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-09T20:29:55.440228] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-09T20:29:55.440283] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-09T20:29:55.440327] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-09T20:29:55.440391] [INFO ] [MAIN ] Update Progress: 1490/2373 symbols completed. NL took 30.8s. Estimated remaining: 2h 4m 22s. Rate: 7.1 symbols/min [2025-10-09T20:29:55.606265] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:29:55.606391] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-09T20:29:55.606428] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-09T20:29:55.606528] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-09T20:29:55.606568] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-09T20:29:55.606608] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-09T20:29:55.606640] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-09T20:29:55.978607] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:29:55.996667] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-09T20:29:56.796714] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-09T20:29:57.186064] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T20:29:57.187510] [INFO ] [REMOTE ] NKX: Full fetch complete (19264 records). [2025-10-09T20:29:57.187582] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-09T20:29:57.188042] [FATAL] [VALIDATOR ] NKX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:29:57.188124] [FATAL] [MAIN ] NKX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:29:57.188166] [WARN ] [MAIN ] NKX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:29:57.188232] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-09T20:29:57.188292] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-10-09T20:29:57.188369] [INFO ] [LOCAL ] NKX: Starting deletion of derivative data. [2025-10-09T20:29:57.188568] [DEBUG] [LOCAL ] NKX: Deleted derivative data file. [2025-10-09T20:29:57.188677] [INFO ] [MAIN ] Update Progress: 1491/2373 symbols completed. NKX took 33.4s. Estimated remaining: 2h 4m 10s. Rate: 7.1 symbols/min [2025-10-09T20:29:57.356627] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:29:57.356852] [DEBUG] [LOCAL ] NMAI: No existing data file found in primary storage. [2025-10-09T20:29:57.357103] [WARN ] [MAIN ] NMAI: No existing data found, performing full refresh instead. [2025-10-09T20:29:57.357283] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-09T20:29:57.357453] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-09T20:29:57.357512] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-09T20:29:57.357719] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-09T20:29:57.601856] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-09T20:29:57.708454] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T20:29:57.760552] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:29:58.396691] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-09T20:29:58.496761] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T20:29:58.500952] [INFO ] [REMOTE ] NKE: Full fetch complete (76807 records). [2025-10-09T20:29:58.501077] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-09T20:29:58.501780] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:29:58.501868] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:29:58.501910] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:29:58.501951] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-09T20:29:58.502008] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-09T20:29:58.502043] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-09T20:29:58.502082] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-09T20:29:58.502137] [INFO ] [MAIN ] Update Progress: 1492/2373 symbols completed. NKE took 50.2s. Estimated remaining: 2h 3m 57s. Rate: 7.1 symbols/min [2025-10-09T20:29:58.676436] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:29:58.676903] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-09T20:29:58.676959] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-09T20:29:58.677096] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-09T20:29:58.677152] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-09T20:29:58.677199] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-09T20:29:58.677232] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-09T20:29:59.024300] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:29:59.196717] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-09T20:29:59.900464] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T20:29:59.996691] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-09T20:30:00.393996] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-09T20:30:00.796743] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-09T20:30:00.834963] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T20:30:01.596783] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-09T20:30:01.844258] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T20:30:02.396745] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-09T20:30:02.749004] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:30:02.749477] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-09T20:30:02.749582] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:30:02.749632] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-09T20:30:02.749718] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:30:02.749797] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-09T20:30:02.749873] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-09T20:30:02.749910] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-09T20:30:02.750177] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-09T20:30:02.750466] [INFO ] [MAIN ] Update Progress: 1493/2373 symbols completed. NMAX took 4.2s. Estimated remaining: 2h 3m 46s. Rate: 7.1 symbols/min [2025-10-09T20:30:02.920206] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:30:02.920446] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-09T20:30:02.920514] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-09T20:30:02.920634] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-09T20:30:02.920716] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-09T20:30:02.920818] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-09T20:30:02.920859] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-09T20:30:03.199810] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-09T20:30:03.295860] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:30:03.500521] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T20:30:03.812454] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T20:30:03.996751] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-09T20:30:04.796732] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-09T20:30:05.483568] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T20:30:05.596686] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-09T20:30:06.168608] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-09T20:30:06.396751] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-09T20:30:06.466307] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T20:30:07.196730] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-09T20:30:07.242021] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T20:30:07.996714] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-09T20:30:08.785502] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T20:30:08.796671] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-09T20:30:09.142999] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T20:30:09.493383] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-09T20:30:09.596683] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-09T20:30:10.396768] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-09T20:30:10.457292] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T20:30:11.196694] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-09T20:30:11.223567] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T20:30:11.499153] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T20:30:11.500396] [INFO ] [REMOTE ] NLOP: Full fetch complete (17667 records). [2025-10-09T20:30:11.500466] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-09T20:30:11.500893] [FATAL] [VALIDATOR ] NLOP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:30:11.500977] [FATAL] [MAIN ] NLOP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:30:11.501020] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:30:11.501057] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-09T20:30:11.501111] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-09T20:30:11.501145] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-09T20:30:11.501184] [DEBUG] [LOCAL ] NLOP: No derivative data file found to delete. [2025-10-09T20:30:11.501236] [INFO ] [MAIN ] Update Progress: 1494/2373 symbols completed. NLOP took 28.3s. Estimated remaining: 2h 3m 38s. Rate: 7.1 symbols/min [2025-10-09T20:30:11.679555] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:30:11.679745] [DEBUG] [LOCAL ] NMG: No existing data file found in primary storage. [2025-10-09T20:30:11.679792] [WARN ] [MAIN ] NMG: No existing data found, performing full refresh instead. [2025-10-09T20:30:11.679902] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-09T20:30:11.679943] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-09T20:30:11.679987] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-09T20:30:11.680019] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-09T20:30:12.001837] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-09T20:30:12.058529] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:30:12.796759] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-09T20:30:13.596751] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-09T20:30:13.609423] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T20:30:13.997110] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T20:30:14.396689] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-09T20:30:14.632058] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T20:30:15.196754] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-09T20:30:15.996767] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-09T20:30:16.060508] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T20:30:16.273437] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T20:30:16.796741] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-09T20:30:17.117192] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T20:30:17.596761] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-09T20:30:17.951953] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T20:30:18.396693] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-09T20:30:18.412575] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T20:30:19.196754] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-09T20:30:19.996721] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-09T20:30:20.329317] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T20:30:20.330216] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T20:30:20.796763] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-09T20:30:20.977543] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T20:30:21.596750] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-09T20:30:21.661422] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T20:30:22.396733] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-09T20:30:23.196695] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-09T20:30:23.321823] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T20:30:23.624453] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-09T20:30:23.931226] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T20:30:23.996748] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-09T20:30:24.796709] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-09T20:30:24.966262] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T20:30:25.596762] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-09T20:30:25.623583] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T20:30:26.001576] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T20:30:26.006976] [INFO ] [REMOTE ] NLY: Full fetch complete (77173 records). [2025-10-09T20:30:26.007090] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-09T20:30:26.007974] [FATAL] [VALIDATOR ] NLY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:30:26.008061] [FATAL] [MAIN ] NLY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:30:26.008104] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:30:26.008143] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-09T20:30:26.008199] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-09T20:30:26.008234] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-09T20:30:26.008280] [DEBUG] [LOCAL ] NLY: No derivative data file found to delete. [2025-10-09T20:30:26.008338] [INFO ] [MAIN ] Update Progress: 1495/2373 symbols completed. NLY took 30.6s. Estimated remaining: 2h 3m 33s. Rate: 7.1 symbols/min [2025-10-09T20:30:26.189247] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:30:26.196749] [DEBUG] [LOCAL ] NMI: Loaded 4065 existing records from primary storage. [2025-10-09T20:30:26.196948] [INFO ] [MAIN ] NMI: Loaded 4065 existing records. [2025-10-09T20:30:26.370950] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:30:26.371146] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-09T20:30:26.371205] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-09T20:30:26.371489] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-09T20:30:26.371546] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-09T20:30:26.401922] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-09T20:30:26.729438] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:30:27.196696] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-09T20:30:27.355849] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T20:30:27.774627] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T20:30:27.996754] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-09T20:30:28.517975] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T20:30:28.796791] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-09T20:30:29.530953] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T20:30:29.596709] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-09T20:30:30.147276] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T20:30:30.148836] [INFO ] [REMOTE ] NMAI: Full fetch complete (19762 records). [2025-10-09T20:30:30.148905] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-09T20:30:30.149299] [FATAL] [VALIDATOR ] NMAI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:30:30.149381] [FATAL] [MAIN ] NMAI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:30:30.149424] [WARN ] [MAIN ] NMAI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:30:30.149489] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-09T20:30:30.149551] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-09T20:30:30.149585] [INFO ] [LOCAL ] NMAI: Starting deletion of derivative data. [2025-10-09T20:30:30.149752] [DEBUG] [LOCAL ] NMAI: No derivative data file found to delete. [2025-10-09T20:30:30.149822] [INFO ] [MAIN ] Update Progress: 1496/2373 symbols completed. NMAI took 33.0s. Estimated remaining: 2h 3m 22s. Rate: 7.1 symbols/min [2025-10-09T20:30:30.315475] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:30:30.315634] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-09T20:30:30.315708] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-09T20:30:30.315822] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-09T20:30:30.315862] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-09T20:30:30.315903] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-09T20:30:30.315934] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-09T20:30:30.401930] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-09T20:30:30.678239] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:30:30.996674] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T20:30:31.196728] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-09T20:30:31.996749] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-09T20:30:32.255234] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T20:30:32.796774] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-09T20:30:33.091122] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T20:30:33.596747] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-09T20:30:33.653786] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T20:30:34.155009] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T20:30:34.396743] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-09T20:30:35.029921] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T20:30:35.196738] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-09T20:30:35.996710] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-09T20:30:36.181726] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T20:30:36.796739] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-09T20:30:37.129448] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T20:30:37.596731] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-09T20:30:37.642492] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T20:30:37.987312] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T20:30:38.396775] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-09T20:30:39.196702] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-09T20:30:39.436688] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T20:30:39.747376] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T20:30:39.749379] [INFO ] [REMOTE ] NMCO: Full fetch complete (23696 records). [2025-10-09T20:30:39.749508] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-09T20:30:39.750416] [FATAL] [VALIDATOR ] NMCO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:30:39.750505] [FATAL] [MAIN ] NMCO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:30:39.750550] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:30:39.750589] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-09T20:30:39.750699] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-09T20:30:39.750757] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-09T20:30:39.750801] [DEBUG] [LOCAL ] NMCO: No derivative data file found to delete. [2025-10-09T20:30:39.750881] [INFO ] [MAIN ] Update Progress: 1497/2373 symbols completed. NMCO took 37.0s. Estimated remaining: 2h 3m 14s. Rate: 7.1 symbols/min [2025-10-09T20:30:39.946593] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:30:39.946824] [DEBUG] [LOCAL ] NMR: No existing data file found in primary storage. [2025-10-09T20:30:39.946918] [WARN ] [MAIN ] NMR: No existing data found, performing full refresh instead. [2025-10-09T20:30:39.947003] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-09T20:30:39.947040] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-09T20:30:39.947080] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-09T20:30:39.947112] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-09T20:30:40.001822] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-09T20:30:40.294792] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:30:40.638999] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T20:30:40.796825] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-09T20:30:41.596793] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-09T20:30:41.616479] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T20:30:42.396744] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-09T20:30:42.791184] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T20:30:43.037576] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T20:30:43.196704] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-09T20:30:43.789988] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T20:30:43.996723] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-09T20:30:44.651014] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:30:44.653266] [INFO ] [REMOTE ] NMG: Full fetch complete (13569 records). [2025-10-09T20:30:44.653342] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-09T20:30:44.653888] [FATAL] [VALIDATOR ] NMG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:30:44.653974] [FATAL] [MAIN ] NMG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:30:44.654016] [WARN ] [MAIN ] NMG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:30:44.654066] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-09T20:30:44.654145] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-09T20:30:44.654182] [INFO ] [LOCAL ] NMG: Starting deletion of derivative data. [2025-10-09T20:30:44.654222] [DEBUG] [LOCAL ] NMG: No derivative data file found to delete. [2025-10-09T20:30:44.654275] [INFO ] [MAIN ] Update Progress: 1498/2373 symbols completed. NMG took 33.2s. Estimated remaining: 2h 3m 4s. Rate: 7.1 symbols/min [2025-10-09T20:30:44.801843] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-09T20:30:44.827532] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:30:44.833267] [DEBUG] [LOCAL ] NMS: Loaded 2822 existing records from primary storage. [2025-10-09T20:30:44.833446] [INFO ] [MAIN ] NMS: Loaded 2822 existing records. [2025-10-09T20:30:45.016544] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:30:45.016836] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-09T20:30:45.016895] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-09T20:30:45.017087] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-09T20:30:45.017144] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-09T20:30:45.361309] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:30:45.596708] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-09T20:30:46.185213] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T20:30:46.205582] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T20:30:46.396746] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-09T20:30:46.833402] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-09T20:30:47.196749] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-09T20:30:47.996727] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-09T20:30:48.384349] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T20:30:48.796715] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-09T20:30:49.043017] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T20:30:49.596730] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-09T20:30:50.177930] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T20:30:50.390481] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T20:30:50.396683] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-09T20:30:51.100255] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:30:51.196700] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-09T20:30:51.996707] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-09T20:30:52.217491] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T20:30:52.589739] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T20:30:52.796686] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-09T20:30:53.590869] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T20:30:53.596676] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-09T20:30:54.396696] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-09T20:30:54.722446] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T20:30:55.196713] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-09T20:30:55.704553] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T20:30:55.898810] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:30:55.996714] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-09T20:30:56.796717] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-09T20:30:56.824732] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T20:30:57.380784] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T20:30:57.596713] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-09T20:30:58.054472] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:30:58.056333] [INFO ] [REMOTE ] NMM: Full fetch complete (21645 records). [2025-10-09T20:30:58.056408] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-09T20:30:58.056936] [FATAL] [VALIDATOR ] NMM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:30:58.057048] [FATAL] [MAIN ] NMM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:30:58.057091] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:30:58.057129] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-09T20:30:58.057184] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-09T20:30:58.057217] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-09T20:30:58.057256] [DEBUG] [LOCAL ] NMM: No derivative data file found to delete. [2025-10-09T20:30:58.057380] [INFO ] [MAIN ] Update Progress: 1499/2373 symbols completed. NMM took 27.9s. Estimated remaining: 2h 2m 58s. Rate: 7.1 symbols/min [2025-10-09T20:30:58.237092] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:30:58.243327] [DEBUG] [LOCAL ] NMT: Loaded 2866 existing records from primary storage. [2025-10-09T20:30:58.243532] [INFO ] [MAIN ] NMT: Loaded 2866 existing records. [2025-10-09T20:30:58.407076] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-09T20:30:58.468192] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:30:58.468484] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-09T20:30:58.468584] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-09T20:30:58.468877] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-09T20:30:58.468953] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-09T20:30:59.056118] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:30:59.094549] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T20:30:59.196767] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-09T20:30:59.996764] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-09T20:31:00.546596] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T20:31:00.796770] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-09T20:31:01.021336] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T20:31:01.506077] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T20:31:01.596737] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-09T20:31:02.396733] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-09T20:31:02.809469] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T20:31:03.003433] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T20:31:03.196733] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-09T20:31:03.810106] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T20:31:03.996723] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-09T20:31:04.487249] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-09T20:31:04.796742] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-09T20:31:05.481453] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T20:31:05.596736] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-09T20:31:06.012056] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-09T20:31:06.396717] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-09T20:31:06.975208] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T20:31:07.196726] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-09T20:31:07.996714] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-09T20:31:08.417473] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T20:31:08.478758] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T20:31:08.796776] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-09T20:31:09.596714] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-09T20:31:10.062296] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-09T20:31:10.402428] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-09T20:31:10.414035] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T20:31:11.021265] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T20:31:11.196822] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-09T20:31:11.615345] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T20:31:11.996729] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-09T20:31:12.552061] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T20:31:12.796751] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-09T20:31:13.327133] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T20:31:13.327972] [INFO ] [REMOTE ] NMS: Full fetch complete (4015 records). [2025-10-09T20:31:13.328043] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-09T20:31:13.328400] [FATAL] [VALIDATOR ] NMS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:31:13.328497] [FATAL] [MAIN ] NMS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:31:13.328540] [WARN ] [MAIN ] NMS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:31:13.328603] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-09T20:31:13.328688] [DEBUG] [LOCAL ] NMS: No primary data file found to delete. [2025-10-09T20:31:13.328743] [INFO ] [LOCAL ] NMS: Starting deletion of derivative data. [2025-10-09T20:31:13.328975] [DEBUG] [LOCAL ] NMS: Deleted derivative data file. [2025-10-09T20:31:13.329060] [INFO ] [MAIN ] Update Progress: 1500/2373 symbols completed. NMS took 28.7s. Estimated remaining: 2h 2m 54s. Rate: 7.1 symbols/min [2025-10-09T20:31:13.510074] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:31:13.533167] [DEBUG] [LOCAL ] NMZ: Loaded 21658 existing records from primary storage. [2025-10-09T20:31:13.533423] [INFO ] [MAIN ] NMZ: Loaded 21658 existing records. [2025-10-09T20:31:13.601780] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-09T20:31:13.716611] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:31:13.716847] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-09T20:31:13.716902] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-09T20:31:13.717104] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-09T20:31:13.717160] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-09T20:31:14.082615] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:31:14.344735] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T20:31:14.396703] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-09T20:31:15.196710] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-09T20:31:15.218530] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T20:31:15.996773] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-09T20:31:16.295440] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T20:31:16.296382] [INFO ] [REMOTE ] NMI: Full fetch complete (5899 records). [2025-10-09T20:31:16.296457] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-09T20:31:16.296899] [FATAL] [VALIDATOR ] NMI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:31:16.297016] [FATAL] [MAIN ] NMI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:31:16.297092] [WARN ] [MAIN ] NMI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:31:16.297185] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-09T20:31:16.297265] [DEBUG] [LOCAL ] NMI: No primary data file found to delete. [2025-10-09T20:31:16.297304] [INFO ] [LOCAL ] NMI: Starting deletion of derivative data. [2025-10-09T20:31:16.297662] [DEBUG] [LOCAL ] NMI: Deleted derivative data file. [2025-10-09T20:31:16.297790] [INFO ] [MAIN ] Update Progress: 1501/2373 symbols completed. NMI took 50.3s. Estimated remaining: 2h 2m 42s. Rate: 7.1 symbols/min [2025-10-09T20:31:16.505289] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:31:16.505781] [DEBUG] [LOCAL ] NNI: No existing data file found in primary storage. [2025-10-09T20:31:16.505852] [WARN ] [MAIN ] NNI: No existing data found, performing full refresh instead. [2025-10-09T20:31:16.506028] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-09T20:31:16.506094] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-09T20:31:16.506174] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-09T20:31:16.506245] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-09T20:31:16.597377] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T20:31:16.801879] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-09T20:31:16.936044] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:31:17.596714] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-09T20:31:17.772500] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:31:18.082378] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T20:31:18.396710] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-09T20:31:19.138155] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T20:31:19.196723] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-09T20:31:19.850466] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T20:31:19.996736] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-09T20:31:20.576053] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T20:31:20.796738] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-09T20:31:21.596786] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-09T20:31:22.058592] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T20:31:22.248131] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T20:31:22.396690] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-09T20:31:23.196702] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-09T20:31:23.223904] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T20:31:23.996732] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-09T20:31:24.302093] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T20:31:24.416398] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T20:31:24.796727] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-09T20:31:25.596705] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-09T20:31:26.143138] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T20:31:26.211352] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T20:31:26.214845] [INFO ] [REMOTE ] NMR: Full fetch complete (50578 records). [2025-10-09T20:31:26.214947] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-09T20:31:26.215624] [FATAL] [VALIDATOR ] NMR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:31:26.215752] [FATAL] [MAIN ] NMR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:31:26.215795] [WARN ] [MAIN ] NMR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:31:26.215868] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-09T20:31:26.215932] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-09T20:31:26.215989] [INFO ] [LOCAL ] NMR: Starting deletion of derivative data. [2025-10-09T20:31:26.216032] [DEBUG] [LOCAL ] NMR: No derivative data file found to delete. [2025-10-09T20:31:26.216090] [INFO ] [MAIN ] Update Progress: 1502/2373 symbols completed. NMR took 46.5s. Estimated remaining: 2h 2m 35s. Rate: 7.1 symbols/min [2025-10-09T20:31:26.386470] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:31:26.386695] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-09T20:31:26.386749] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-09T20:31:26.386869] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-09T20:31:26.386913] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-09T20:31:26.386955] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-09T20:31:26.386988] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-09T20:31:26.407032] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-09T20:31:26.750478] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:31:27.196756] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-09T20:31:27.604033] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T20:31:27.825258] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T20:31:27.996730] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-09T20:31:28.255330] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-09T20:31:28.256188] [INFO ] [REMOTE ] NMT: Full fetch complete (4053 records). [2025-10-09T20:31:28.256257] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-09T20:31:28.256704] [FATAL] [VALIDATOR ] NMT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:31:28.256790] [FATAL] [MAIN ] NMT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:31:28.256832] [WARN ] [MAIN ] NMT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:31:28.256872] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-09T20:31:28.256930] [DEBUG] [LOCAL ] NMT: No primary data file found to delete. [2025-10-09T20:31:28.256964] [INFO ] [LOCAL ] NMT: Starting deletion of derivative data. [2025-10-09T20:31:28.257170] [DEBUG] [LOCAL ] NMT: Deleted derivative data file. [2025-10-09T20:31:28.257256] [INFO ] [MAIN ] Update Progress: 1503/2373 symbols completed. NMT took 30.2s. Estimated remaining: 2h 2m 22s. Rate: 7.1 symbols/min [2025-10-09T20:31:28.436378] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:31:28.446018] [DEBUG] [LOCAL ] NNY: Loaded 5633 existing records from primary storage. [2025-10-09T20:31:28.446247] [INFO ] [MAIN ] NNY: Loaded 5633 existing records. [2025-10-09T20:31:28.638165] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:31:28.638429] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-09T20:31:28.638498] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-09T20:31:28.638761] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-09T20:31:28.638822] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-09T20:31:28.807450] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-09T20:31:29.068531] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:31:29.596710] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-09T20:31:30.343831] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T20:31:30.396674] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-09T20:31:30.782992] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T20:31:31.196726] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-09T20:31:31.215212] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T20:31:31.996724] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-09T20:31:32.685015] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T20:31:32.796717] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-09T20:31:33.039201] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T20:31:33.569732] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T20:31:33.596706] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-09T20:31:34.396704] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-09T20:31:34.478404] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T20:31:35.196753] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-09T20:31:35.204861] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T20:31:35.996694] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-09T20:31:36.352758] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T20:31:36.796774] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-09T20:31:37.150084] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T20:31:37.596706] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-09T20:31:38.367785] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T20:31:38.396680] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-09T20:31:38.512250] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T20:31:38.850810] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T20:31:39.196738] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-09T20:31:39.996750] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-09T20:31:40.521428] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T20:31:40.522621] [INFO ] [REMOTE ] NNI: Full fetch complete (12815 records). [2025-10-09T20:31:40.522731] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-09T20:31:40.523140] [FATAL] [VALIDATOR ] NNI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:31:40.523224] [FATAL] [MAIN ] NNI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:31:40.523268] [WARN ] [MAIN ] NNI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:31:40.523335] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-09T20:31:40.523399] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-09T20:31:40.523435] [INFO ] [LOCAL ] NNI: Starting deletion of derivative data. [2025-10-09T20:31:40.523476] [DEBUG] [LOCAL ] NNI: No derivative data file found to delete. [2025-10-09T20:31:40.523532] [INFO ] [MAIN ] Update Progress: 1504/2373 symbols completed. NNI took 24.2s. Estimated remaining: 2h 2m 16s. Rate: 7.1 symbols/min [2025-10-09T20:31:40.726165] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:31:40.726486] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-09T20:31:40.726739] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-09T20:31:40.726921] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-09T20:31:40.727123] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-09T20:31:40.727418] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-09T20:31:40.727551] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-09T20:31:40.807099] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-09T20:31:41.068857] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T20:31:41.162486] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:31:41.596685] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-09T20:31:41.626121] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T20:31:42.396702] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-09T20:31:42.514149] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T20:31:43.141997] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T20:31:43.196780] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-09T20:31:43.996738] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-09T20:31:44.471800] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T20:31:44.796714] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-09T20:31:44.928900] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T20:31:45.461364] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-09T20:31:45.596746] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-09T20:31:46.396739] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-09T20:31:46.671471] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T20:31:47.196738] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-09T20:31:47.750261] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T20:31:47.996731] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-09T20:31:48.199061] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T20:31:48.796809] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-09T20:31:48.830090] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T20:31:49.596760] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-09T20:31:50.264669] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T20:31:50.396742] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-09T20:31:50.430290] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T20:31:51.196740] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-09T20:31:51.369099] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T20:31:51.830772] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T20:31:51.996696] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-09T20:31:52.796676] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-09T20:31:52.868621] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T20:31:53.478303] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T20:31:53.596770] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-09T20:31:54.396718] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-09T20:31:54.838845] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:31:54.840786] [INFO ] [REMOTE ] NMZ: Full fetch complete (31442 records). [2025-10-09T20:31:54.840866] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-09T20:31:54.841488] [FATAL] [VALIDATOR ] NMZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:31:54.841580] [FATAL] [MAIN ] NMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:31:54.841623] [WARN ] [MAIN ] NMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:31:54.841699] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-09T20:31:54.841770] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-09T20:31:54.841848] [INFO ] [LOCAL ] NMZ: Starting deletion of derivative data. [2025-10-09T20:31:54.842028] [DEBUG] [LOCAL ] NMZ: Deleted derivative data file. [2025-10-09T20:31:54.842118] [INFO ] [MAIN ] Update Progress: 1505/2373 symbols completed. NMZ took 41.5s. Estimated remaining: 2h 2m 11s. Rate: 7.1 symbols/min [2025-10-09T20:31:55.026171] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:31:55.026326] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-09T20:31:55.026362] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-09T20:31:55.026505] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-09T20:31:55.026571] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-09T20:31:55.026622] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-09T20:31:55.026693] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-09T20:31:55.202922] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-09T20:31:55.409076] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:31:55.434037] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T20:31:55.996775] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-09T20:31:56.279633] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T20:31:56.476404] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T20:31:56.796696] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-09T20:31:57.596782] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-09T20:31:58.027730] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T20:31:58.028810] [INFO ] [REMOTE ] NNY: Full fetch complete (8572 records). [2025-10-09T20:31:58.028881] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-09T20:31:58.029247] [FATAL] [VALIDATOR ] NNY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:31:58.029330] [FATAL] [MAIN ] NNY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:31:58.029373] [WARN ] [MAIN ] NNY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:31:58.029412] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-09T20:31:58.029466] [DEBUG] [LOCAL ] NNY: No primary data file found to delete. [2025-10-09T20:31:58.029514] [INFO ] [LOCAL ] NNY: Starting deletion of derivative data. [2025-10-09T20:31:58.029721] [DEBUG] [LOCAL ] NNY: Deleted derivative data file. [2025-10-09T20:31:58.029811] [INFO ] [MAIN ] Update Progress: 1506/2373 symbols completed. NNY took 29.8s. Estimated remaining: 2h 1m 60s. Rate: 7.1 symbols/min [2025-10-09T20:31:58.160626] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T20:31:58.219242] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:31:58.219471] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-09T20:31:58.219508] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-09T20:31:58.219623] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-09T20:31:58.219697] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-09T20:31:58.219752] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-09T20:31:58.219784] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-09T20:31:58.404108] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-09T20:31:58.570833] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:31:59.196725] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-09T20:31:59.996725] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-09T20:32:00.035666] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T20:32:00.200571] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T20:32:00.796774] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-09T20:32:00.930156] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T20:32:01.596751] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-09T20:32:02.322613] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T20:32:02.396704] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-09T20:32:02.719351] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T20:32:03.151489] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T20:32:03.196688] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-09T20:32:03.996718] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-09T20:32:04.278174] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T20:32:04.796713] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-09T20:32:05.124238] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T20:32:05.596742] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-09T20:32:05.905208] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T20:32:06.396739] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-09T20:32:07.196738] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-09T20:32:07.295761] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T20:32:07.604970] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-09T20:32:07.996753] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-09T20:32:08.228846] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-09T20:32:08.796738] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-09T20:32:08.842872] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T20:32:09.596738] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-09T20:32:10.208983] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T20:32:10.396735] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-09T20:32:11.165714] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:32:11.196693] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-09T20:32:11.416007] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T20:32:11.996798] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-09T20:32:12.749585] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T20:32:12.754736] [INFO ] [REMOTE ] NNN: Full fetch complete (69935 records). [2025-10-09T20:32:12.754863] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-09T20:32:12.755820] [FATAL] [VALIDATOR ] NNN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:32:12.755915] [FATAL] [MAIN ] NNN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:32:12.755987] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:32:12.756066] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-09T20:32:12.756158] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-09T20:32:12.756207] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-09T20:32:12.756251] [DEBUG] [LOCAL ] NNN: No derivative data file found to delete. [2025-10-09T20:32:12.756362] [INFO ] [MAIN ] Update Progress: 1507/2373 symbols completed. NNN took 46.5s. Estimated remaining: 2h 1m 55s. Rate: 7.1 symbols/min [2025-10-09T20:32:12.811497] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-09T20:32:12.934451] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:32:12.934771] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-09T20:32:12.934825] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-09T20:32:12.935078] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-09T20:32:12.935130] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-09T20:32:12.935172] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-09T20:32:12.935204] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-09T20:32:13.138208] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T20:32:13.342913] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:32:13.596782] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-09T20:32:13.996749] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T20:32:14.396731] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-09T20:32:15.196749] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-09T20:32:15.663117] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-09T20:32:15.680502] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T20:32:15.683494] [INFO ] [REMOTE ] NOA: Full fetch complete (22175 records). [2025-10-09T20:32:15.683595] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-09T20:32:15.684631] [FATAL] [VALIDATOR ] NOA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:32:15.684757] [FATAL] [MAIN ] NOA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:32:15.684817] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:32:15.684878] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-09T20:32:15.684959] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-09T20:32:15.685010] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-09T20:32:15.685137] [DEBUG] [LOCAL ] NOA: No derivative data file found to delete. [2025-10-09T20:32:15.685264] [INFO ] [MAIN ] Update Progress: 1508/2373 symbols completed. NOA took 35.2s. Estimated remaining: 2h 1m 43s. Rate: 7.1 symbols/min [2025-10-09T20:32:15.868517] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:32:15.868715] [DEBUG] [LOCAL ] NOK: No existing data file found in primary storage. [2025-10-09T20:32:15.868764] [WARN ] [MAIN ] NOK: No existing data found, performing full refresh instead. [2025-10-09T20:32:15.868878] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-09T20:32:15.868919] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-09T20:32:15.868961] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-09T20:32:15.868993] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-09T20:32:16.001862] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-09T20:32:16.260694] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:32:16.535232] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-09T20:32:16.769189] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T20:32:16.796677] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-09T20:32:17.596740] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-09T20:32:17.908599] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T20:32:18.396772] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-09T20:32:19.203311] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-09T20:32:19.209113] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T20:32:19.602028] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T20:32:19.996733] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-09T20:32:20.796691] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-09T20:32:20.892482] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T20:32:21.110605] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-09T20:32:21.112460] [INFO ] [REMOTE ] NOAH: Full fetch complete (27934 records). [2025-10-09T20:32:21.112531] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-09T20:32:21.113017] [FATAL] [VALIDATOR ] NOAH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:32:21.113101] [FATAL] [MAIN ] NOAH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:32:21.113143] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:32:21.113181] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-09T20:32:21.113236] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-09T20:32:21.113271] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-09T20:32:21.113308] [DEBUG] [LOCAL ] NOAH: No derivative data file found to delete. [2025-10-09T20:32:21.113361] [INFO ] [MAIN ] Update Progress: 1509/2373 symbols completed. NOAH took 26.3s. Estimated remaining: 2h 1m 33s. Rate: 7.1 symbols/min [2025-10-09T20:32:21.279631] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:32:21.279848] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-09T20:32:21.279887] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-09T20:32:21.280024] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-09T20:32:21.280068] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-09T20:32:21.280108] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-09T20:32:21.280140] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-09T20:32:21.629418] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:32:21.623856] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-09T20:32:21.996728] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-09T20:32:22.396736] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-09T20:32:23.196698] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-09T20:32:23.432989] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T20:32:23.996775] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-09T20:32:24.046243] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T20:32:24.796759] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-09T20:32:24.979395] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T20:32:25.402692] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T20:32:25.596739] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-09T20:32:26.234534] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T20:32:26.396741] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-09T20:32:27.196773] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-09T20:32:27.544193] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T20:32:27.724170] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-09T20:32:27.885164] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T20:32:27.996695] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-09T20:32:28.796726] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-09T20:32:29.596749] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-09T20:32:29.985327] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T20:32:30.042604] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T20:32:30.396795] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-09T20:32:30.800582] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T20:32:30.838246] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T20:32:31.196816] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-09T20:32:31.996767] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-09T20:32:32.796770] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-09T20:32:32.985448] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T20:32:33.596788] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-09T20:32:34.199619] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-09T20:32:34.307526] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T20:32:34.396738] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-09T20:32:35.196717] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-09T20:32:35.486740] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T20:32:35.578616] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-09T20:32:35.996698] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-09T20:32:36.086021] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T20:32:36.476541] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T20:32:36.796710] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-09T20:32:37.596751] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-09T20:32:38.396748] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-09T20:32:38.502521] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T20:32:38.866845] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T20:32:39.196752] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-09T20:32:39.546932] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T20:32:39.629223] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T20:32:39.996729] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-09T20:32:40.501509] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-09T20:32:40.796727] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-09T20:32:41.596725] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-09T20:32:41.832164] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T20:32:42.396736] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-09T20:32:43.078565] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T20:32:43.196715] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-09T20:32:43.422979] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T20:32:43.842930] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:32:43.846953] [INFO ] [REMOTE ] NOG: Full fetch complete (73546 records). [2025-10-09T20:32:43.847075] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-09T20:32:43.848056] [FATAL] [VALIDATOR ] NOG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:32:43.848169] [FATAL] [MAIN ] NOG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:32:43.848243] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:32:43.848322] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-09T20:32:43.848390] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-09T20:32:43.848436] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-09T20:32:43.848486] [DEBUG] [LOCAL ] NOG: No derivative data file found to delete. [2025-10-09T20:32:43.848588] [INFO ] [MAIN ] Update Progress: 1510/2373 symbols completed. NOG took 31.1s. Estimated remaining: 2h 1m 33s. Rate: 7.1 symbols/min [2025-10-09T20:32:43.997788] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-09T20:32:44.018436] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:32:44.018723] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-09T20:32:44.018945] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-09T20:32:44.019686] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-09T20:32:44.019742] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-09T20:32:44.019788] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-09T20:32:44.019822] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-09T20:32:44.397530] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:32:44.525997] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T20:32:44.796731] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-09T20:32:45.596749] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-09T20:32:46.332018] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T20:32:46.364629] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T20:32:46.396673] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-09T20:32:47.196776] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-09T20:32:47.781229] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T20:32:47.782404] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T20:32:47.996784] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-09T20:32:48.251015] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-09T20:32:48.251756] [INFO ] [REMOTE ] NOM: Full fetch complete (1553 records). [2025-10-09T20:32:48.251825] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-09T20:32:48.252156] [FATAL] [VALIDATOR ] NOM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:32:48.252252] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:32:48.252335] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:32:48.252426] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-09T20:32:48.252504] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-09T20:32:48.252542] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-09T20:32:48.252581] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-09T20:32:48.252636] [INFO ] [MAIN ] Update Progress: 1511/2373 symbols completed. NOM took 27.1s. Estimated remaining: 2h 1m 22s. Rate: 7.1 symbols/min [2025-10-09T20:32:48.429334] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:32:48.429525] [DEBUG] [LOCAL ] NOTE: No existing data file found in primary storage. [2025-10-09T20:32:48.429594] [WARN ] [MAIN ] NOTE: No existing data found, performing full refresh instead. [2025-10-09T20:32:48.429744] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-09T20:32:48.429788] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-09T20:32:48.429831] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-09T20:32:48.429864] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-09T20:32:48.798444] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:32:48.797682] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-09T20:32:49.596722] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-09T20:32:50.345825] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T20:32:50.396746] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-09T20:32:50.479034] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T20:32:50.925797] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T20:32:50.929038] [INFO ] [REMOTE ] NOC: Full fetch complete (61353 records). [2025-10-09T20:32:50.929183] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-09T20:32:50.929924] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:32:50.930088] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:32:50.930170] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:32:50.930265] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-09T20:32:50.930363] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-09T20:32:50.930419] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-09T20:32:50.930463] [DEBUG] [LOCAL ] NOC: No derivative data file found to delete. [2025-10-09T20:32:50.930523] [INFO ] [MAIN ] Update Progress: 1512/2373 symbols completed. NOC took 52.9s. Estimated remaining: 2h 1m 10s. Rate: 7.1 symbols/min [2025-10-09T20:32:51.107530] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:32:51.107774] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-09T20:32:51.107839] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-09T20:32:51.107963] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-09T20:32:51.108007] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-09T20:32:51.108090] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-09T20:32:51.108165] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-09T20:32:51.201952] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-09T20:32:51.465509] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:32:51.991419] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T20:32:51.996735] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-09T20:32:51.998067] [INFO ] [REMOTE ] NOK: Full fetch complete (77248 records). [2025-10-09T20:32:51.998244] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-09T20:32:51.999230] [FATAL] [VALIDATOR ] NOK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:32:51.999427] [FATAL] [MAIN ] NOK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:32:51.999498] [WARN ] [MAIN ] NOK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:32:51.999573] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-09T20:32:51.999665] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-09T20:32:51.999727] [INFO ] [LOCAL ] NOK: Starting deletion of derivative data. [2025-10-09T20:32:51.999775] [DEBUG] [LOCAL ] NOK: No derivative data file found to delete. [2025-10-09T20:32:51.999840] [INFO ] [MAIN ] Update Progress: 1513/2373 symbols completed. NOK took 36.3s. Estimated remaining: 2h 0m 58s. Rate: 7.1 symbols/min [2025-10-09T20:32:52.194952] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:32:52.195168] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-09T20:32:52.195225] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-09T20:32:52.195338] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-09T20:32:52.195382] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-09T20:32:52.195425] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-09T20:32:52.195459] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-09T20:32:52.559670] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:32:52.796719] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-09T20:32:53.596721] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-09T20:32:53.840082] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T20:32:54.396737] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-09T20:32:54.878331] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T20:32:55.196688] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-09T20:32:55.522798] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T20:32:55.825107] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T20:32:55.996701] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-09T20:32:56.796741] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-09T20:32:57.095271] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-09T20:32:57.596698] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-09T20:32:57.931563] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-09T20:32:58.396754] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-09T20:32:58.875497] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T20:32:59.196747] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-09T20:32:59.475290] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T20:32:59.996733] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-09T20:33:00.057713] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T20:33:00.796766] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-09T20:33:00.864616] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T20:33:01.596697] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-09T20:33:01.928034] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-09T20:33:02.330600] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T20:33:02.396718] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-09T20:33:03.196756] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-09T20:33:03.657138] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-09T20:33:03.996751] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-09T20:33:04.765238] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-09T20:33:04.799284] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-09T20:33:04.804734] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T20:33:05.520533] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T20:33:05.596786] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-09T20:33:06.396797] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-09T20:33:06.677674] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T20:33:07.056966] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T20:33:07.196744] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-09T20:33:07.738842] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T20:33:07.996754] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-09T20:33:08.189025] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T20:33:08.796733] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-09T20:33:09.476937] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T20:33:09.481235] [INFO ] [REMOTE ] NOMD: Full fetch complete (59273 records). [2025-10-09T20:33:09.481369] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-09T20:33:09.501518] [FATAL] [VALIDATOR ] NOMD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:33:09.511494] [FATAL] [MAIN ] NOMD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:33:09.511771] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:33:09.513228] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T20:33:09.512205] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-09T20:33:09.523943] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-09T20:33:09.524117] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-09T20:33:09.524186] [DEBUG] [LOCAL ] NOMD: No derivative data file found to delete. [2025-10-09T20:33:09.524272] [INFO ] [MAIN ] Update Progress: 1514/2373 symbols completed. NOMD took 25.7s. Estimated remaining: 2h 0m 54s. Rate: 7.1 symbols/min [2025-10-09T20:33:09.601796] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-09T20:33:09.696992] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:33:09.697199] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-09T20:33:09.697255] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-09T20:33:09.697371] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-09T20:33:09.697413] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-09T20:33:09.697455] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-09T20:33:09.697488] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-09T20:33:10.062433] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:33:10.396746] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-09T20:33:10.742565] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:33:10.742955] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-09T20:33:10.743056] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:33:10.743123] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-09T20:33:10.743160] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:33:10.743230] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-09T20:33:10.743294] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-09T20:33:10.743331] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-09T20:33:10.743371] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-09T20:33:10.743418] [INFO ] [MAIN ] Update Progress: 1515/2373 symbols completed. NP took 1.2s. Estimated remaining: 2h 0m 42s. Rate: 7.1 symbols/min [2025-10-09T20:33:10.919594] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:33:10.919819] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-09T20:33:10.919862] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-09T20:33:10.919974] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-09T20:33:10.920060] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-09T20:33:10.920139] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-09T20:33:10.920182] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-09T20:33:11.204777] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-09T20:33:11.313541] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:33:11.639708] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-09T20:33:11.996714] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-09T20:33:12.319151] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:33:12.319698] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-09T20:33:12.319830] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:33:12.319909] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-09T20:33:12.319994] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:33:12.320095] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-09T20:33:12.320193] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-09T20:33:12.320252] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-09T20:33:12.320317] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-09T20:33:12.320396] [INFO ] [MAIN ] Update Progress: 1516/2373 symbols completed. NPB took 1.6s. Estimated remaining: 2h 0m 30s. Rate: 7.1 symbols/min [2025-10-09T20:33:12.519307] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:33:12.519485] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-09T20:33:12.519523] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-09T20:33:12.519669] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-09T20:33:12.519738] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-09T20:33:12.519797] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-09T20:33:12.519860] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-09T20:33:12.801117] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-09T20:33:12.881564] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:33:13.110675] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T20:33:13.596738] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-09T20:33:14.396769] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-09T20:33:14.742570] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T20:33:15.196711] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-09T20:33:15.301847] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T20:33:15.668932] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T20:33:15.996784] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-09T20:33:16.598434] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T20:33:16.796728] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-09T20:33:16.883587] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T20:33:17.596787] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-09T20:33:18.396692] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-09T20:33:18.526436] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T20:33:18.629187] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T20:33:19.196827] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-09T20:33:19.996757] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-09T20:33:20.509581] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T20:33:20.796726] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-09T20:33:21.216943] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-10-09T20:33:21.596785] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-09T20:33:21.638270] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T20:33:21.727300] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T20:33:22.396793] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-09T20:33:23.052589] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T20:33:23.196742] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-09T20:33:23.996700] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-09T20:33:24.066299] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T20:33:24.414067] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T20:33:24.796701] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-09T20:33:25.162761] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T20:33:25.481155] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T20:33:25.485377] [INFO ] [REMOTE ] NOV: Full fetch complete (76600 records). [2025-10-09T20:33:25.485516] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-09T20:33:25.486589] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:33:25.486744] [FATAL] [MAIN ] NOV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:33:25.486819] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:33:25.486892] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-09T20:33:25.486981] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-09T20:33:25.487039] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-09T20:33:25.487084] [DEBUG] [LOCAL ] NOV: No derivative data file found to delete. [2025-10-09T20:33:25.487174] [INFO ] [MAIN ] Update Progress: 1517/2373 symbols completed. NOV took 34.6s. Estimated remaining: 2h 0m 24s. Rate: 7.1 symbols/min [2025-10-09T20:33:25.596695] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-09T20:33:26.295686] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T20:33:26.396761] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-09T20:33:27.196723] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-09T20:33:27.836718] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T20:33:27.839196] [INFO ] [REMOTE ] NOTE: Full fetch complete (62495 records). [2025-10-09T20:33:27.839294] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-09T20:33:27.841301] [FATAL] [VALIDATOR ] NOTE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:33:27.841392] [FATAL] [MAIN ] NOTE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:33:27.841477] [WARN ] [MAIN ] NOTE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:33:27.841550] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-09T20:33:27.841615] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-09T20:33:27.841681] [INFO ] [LOCAL ] NOTE: Starting deletion of derivative data. [2025-10-09T20:33:27.841744] [DEBUG] [LOCAL ] NOTE: No derivative data file found to delete. [2025-10-09T20:33:27.841806] [INFO ] [MAIN ] Update Progress: 1518/2373 symbols completed. NOTE took 39.6s. Estimated remaining: 2h 0m 12s. Rate: 7.1 symbols/min [2025-10-09T20:33:27.996709] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-09T20:33:28.339186] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T20:33:28.737446] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T20:33:28.796700] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-09T20:33:29.596789] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-09T20:33:29.877167] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T20:33:30.396734] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-09T20:33:31.324189] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T20:33:31.327933] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-09T20:33:31.573011] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T20:33:31.996759] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-09T20:33:32.051195] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T20:33:32.796718] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-09T20:33:33.554583] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T20:33:33.556251] [INFO ] [REMOTE ] NPCT: Full fetch complete (24892 records). [2025-10-09T20:33:33.556331] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-09T20:33:33.556840] [FATAL] [VALIDATOR ] NPCT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:33:33.556924] [FATAL] [MAIN ] NPCT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:33:33.556967] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:33:33.557004] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-09T20:33:33.557059] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-09T20:33:33.557093] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-09T20:33:33.557260] [DEBUG] [LOCAL ] NPCT: No derivative data file found to delete. [2025-10-09T20:33:33.557330] [INFO ] [MAIN ] Update Progress: 1519/2373 symbols completed. NPCT took 21.2s. Estimated remaining: 2h 0m 2s. Rate: 7.1 symbols/min [2025-10-09T20:33:33.820135] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T20:33:33.832123] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-09T20:33:34.774250] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T20:33:34.784870] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-09T20:33:35.269385] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T20:33:35.273060] [INFO ] [REMOTE ] NOW: Full fetch complete (70315 records). [2025-10-09T20:33:35.273164] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-09T20:33:35.274095] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:33:35.274210] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:33:35.274254] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:33:35.274321] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-09T20:33:35.274419] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-09T20:33:35.274473] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-09T20:33:35.274516] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-09T20:33:35.274580] [INFO ] [MAIN ] Update Progress: 1520/2373 symbols completed. NOW took 43.3s. Estimated remaining: 1h 59m 50s. Rate: 7.1 symbols/min [2025-10-09T20:33:35.833341] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:33:35.865631] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:33:35.908690] [DEBUG] [LOCAL ] NPK: No existing data file found in primary storage. [2025-10-09T20:33:35.904100] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-09T20:33:35.930346] [WARN ] [MAIN ] NPK: No existing data found, performing full refresh instead. [2025-10-09T20:33:35.944780] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:33:35.964756] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-09T20:33:35.965180] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-09T20:33:35.965393] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-09T20:33:35.990535] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:33:35.965561] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-09T20:33:35.990739] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-09T20:33:35.990908] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-09T20:33:35.991113] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-09T20:33:35.991197] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-09T20:33:35.991323] [DEBUG] [LOCAL ] NPFD: No existing data file found in primary storage. [2025-10-09T20:33:35.990983] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-09T20:33:36.002703] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-09T20:33:35.996714] [WARN ] [MAIN ] NPFD: No existing data found, performing full refresh instead. [2025-10-09T20:33:36.012357] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-09T20:33:36.026504] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-09T20:33:36.031811] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-09T20:33:36.048694] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-09T20:33:36.057412] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-09T20:33:36.066362] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-09T20:33:36.076971] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-09T20:33:36.139625] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-09T20:33:36.157225] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-09T20:33:37.143166] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:33:37.265036] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-09T20:33:37.546270] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:33:37.573372] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-09T20:33:37.479894] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:33:37.573125] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:33:37.575427] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-09T20:33:37.596671] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-09T20:33:38.291861] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T20:33:38.376739] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T20:33:38.396672] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-09T20:33:38.447062] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T20:33:38.588395] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T20:33:39.072265] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T20:33:39.196785] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-09T20:33:39.980779] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T20:33:39.996717] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-09T20:33:40.796693] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-09T20:33:40.843889] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T20:33:41.596732] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-09T20:33:42.130237] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T20:33:42.396696] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-09T20:33:42.451269] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T20:33:43.196752] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-09T20:33:43.375706] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T20:33:43.996864] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-09T20:33:44.120008] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T20:33:44.796740] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-09T20:33:45.364595] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T20:33:45.596753] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-09T20:33:45.957543] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T20:33:46.396776] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-09T20:33:46.612128] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T20:33:47.021838] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T20:33:47.196707] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-09T20:33:47.996727] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-09T20:33:48.674764] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T20:33:48.796674] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-09T20:33:49.264859] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T20:33:49.596761] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-09T20:33:50.289034] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T20:33:50.396686] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-09T20:33:50.743259] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T20:33:51.196789] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-09T20:33:51.750997] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T20:33:51.794122] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T20:33:51.996792] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-09T20:33:52.580907] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T20:33:52.796736] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-09T20:33:53.596720] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-09T20:33:54.384546] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T20:33:54.396677] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-09T20:33:54.405548] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T20:33:55.196725] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-09T20:33:55.996745] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-09T20:33:56.142306] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T20:33:56.317861] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T20:33:56.512985] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-09T20:33:56.796725] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-09T20:33:57.596689] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-09T20:33:57.681340] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T20:33:58.396720] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-09T20:33:58.439414] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T20:33:59.196731] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-09T20:33:59.304387] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T20:33:59.849097] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:33:59.854577] [INFO ] [REMOTE ] NPKI: Full fetch complete (55383 records). [2025-10-09T20:33:59.854868] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-09T20:33:59.856093] [FATAL] [VALIDATOR ] NPKI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:33:59.856195] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:33:59.856242] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:33:59.856310] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-09T20:33:59.856393] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-09T20:33:59.856432] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-09T20:33:59.856473] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-09T20:33:59.856539] [INFO ] [MAIN ] Update Progress: 1521/2373 symbols completed. NPKI took 24.6s. Estimated remaining: 1h 59m 50s. Rate: 7.1 symbols/min [2025-10-09T20:34:00.001847] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-09T20:34:00.026958] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:34:00.036815] [DEBUG] [LOCAL ] NPV: Loaded 5226 existing records from primary storage. [2025-10-09T20:34:00.037116] [INFO ] [MAIN ] NPV: Loaded 5226 existing records. [2025-10-09T20:34:00.213242] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:34:00.213540] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-09T20:34:00.213598] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-09T20:34:00.213934] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-09T20:34:00.213992] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-09T20:34:00.601105] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:34:00.796679] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-09T20:34:01.139476] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T20:34:01.596688] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-09T20:34:01.644175] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T20:34:02.326628] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T20:34:02.396777] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-09T20:34:03.128577] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T20:34:03.196701] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-09T20:34:03.659608] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:34:03.661217] [INFO ] [REMOTE ] NPFD: Full fetch complete (14596 records). [2025-10-09T20:34:03.661292] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-09T20:34:03.661804] [FATAL] [VALIDATOR ] NPFD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:34:03.661902] [FATAL] [MAIN ] NPFD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:34:03.661961] [WARN ] [MAIN ] NPFD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:34:03.662031] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-09T20:34:03.662117] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-09T20:34:03.662179] [INFO ] [LOCAL ] NPFD: Starting deletion of derivative data. [2025-10-09T20:34:03.662257] [DEBUG] [LOCAL ] NPFD: No derivative data file found to delete. [2025-10-09T20:34:03.662325] [INFO ] [MAIN ] Update Progress: 1522/2373 symbols completed. NPFD took 28.4s. Estimated remaining: 1h 59m 39s. Rate: 7.1 symbols/min [2025-10-09T20:34:03.869021] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:34:03.869219] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-09T20:34:03.869257] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-09T20:34:03.869374] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-09T20:34:03.869415] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-09T20:34:03.869456] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-09T20:34:03.869490] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-09T20:34:04.001890] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-09T20:34:04.301726] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:34:04.664265] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:34:04.796753] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-09T20:34:05.164093] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T20:34:05.166395] [INFO ] [REMOTE ] NPO: Full fetch complete (18189 records). [2025-10-09T20:34:05.166573] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-09T20:34:05.167386] [FATAL] [VALIDATOR ] NPO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:34:05.167550] [FATAL] [MAIN ] NPO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:34:05.167608] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:34:05.167709] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-09T20:34:05.167835] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-09T20:34:05.167890] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-09T20:34:05.167939] [DEBUG] [LOCAL ] NPO: No derivative data file found to delete. [2025-10-09T20:34:05.168015] [INFO ] [MAIN ] Update Progress: 1523/2373 symbols completed. NPO took 29.9s. Estimated remaining: 1h 59m 27s. Rate: 7.1 symbols/min [2025-10-09T20:34:05.358988] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:34:05.374983] [DEBUG] [LOCAL ] NQP: Loaded 9263 existing records from primary storage. [2025-10-09T20:34:05.375318] [INFO ] [MAIN ] NQP: Loaded 9263 existing records. [2025-10-09T20:34:05.575296] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:34:05.575725] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-09T20:34:05.575790] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-09T20:34:05.576445] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-09T20:34:05.576508] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-09T20:34:05.601887] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-09T20:34:05.966985] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:34:06.396756] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-09T20:34:07.196692] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-09T20:34:07.343358] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T20:34:07.378211] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T20:34:07.630488] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T20:34:07.996727] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-09T20:34:08.796705] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-09T20:34:09.064462] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T20:34:09.372032] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T20:34:09.596697] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-09T20:34:10.318444] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T20:34:10.396736] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-09T20:34:11.196804] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-09T20:34:11.491900] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T20:34:11.738501] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T20:34:11.996713] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-09T20:34:12.685832] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T20:34:12.796729] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-09T20:34:13.596719] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-09T20:34:14.044763] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T20:34:14.396697] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-09T20:34:14.477147] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T20:34:15.196761] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-09T20:34:15.282053] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T20:34:15.615258] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T20:34:15.996737] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-09T20:34:16.672001] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-09T20:34:16.796761] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-09T20:34:17.480016] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T20:34:17.596697] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-09T20:34:18.130521] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T20:34:18.396743] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-09T20:34:19.196728] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-09T20:34:19.244766] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T20:34:19.996752] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-09T20:34:20.667773] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T20:34:20.669434] [INFO ] [REMOTE ] NPK: Full fetch complete (10822 records). [2025-10-09T20:34:20.669514] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-09T20:34:20.669951] [FATAL] [VALIDATOR ] NPK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:34:20.670045] [FATAL] [MAIN ] NPK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:34:20.670090] [WARN ] [MAIN ] NPK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:34:20.670156] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-09T20:34:20.670219] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-09T20:34:20.670256] [INFO ] [LOCAL ] NPK: Starting deletion of derivative data. [2025-10-09T20:34:20.670297] [DEBUG] [LOCAL ] NPK: No derivative data file found to delete. [2025-10-09T20:34:20.670353] [INFO ] [MAIN ] Update Progress: 1524/2373 symbols completed. NPK took 45.4s. Estimated remaining: 1h 59m 23s. Rate: 7.1 symbols/min [2025-10-09T20:34:20.800988] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-09T20:34:20.866329] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:34:20.866534] [DEBUG] [LOCAL ] NRDY: No existing data file found in primary storage. [2025-10-09T20:34:20.866713] [WARN ] [MAIN ] NRDY: No existing data found, performing full refresh instead. [2025-10-09T20:34:20.866952] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-09T20:34:20.867107] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-09T20:34:20.867271] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-09T20:34:20.867342] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-09T20:34:21.055606] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T20:34:21.277280] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:34:21.519805] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T20:34:21.596708] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-09T20:34:22.396745] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-09T20:34:23.196734] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-09T20:34:23.489310] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T20:34:23.715904] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T20:34:23.740987] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-09T20:34:23.996741] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-09T20:34:24.620624] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T20:34:24.796734] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-09T20:34:25.596753] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-09T20:34:26.396706] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-09T20:34:26.448672] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T20:34:26.631847] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T20:34:27.196724] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-09T20:34:27.865314] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T20:34:28.004032] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-09T20:34:28.006371] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T20:34:28.412176] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-09T20:34:28.796751] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-09T20:34:29.140307] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T20:34:29.141461] [INFO ] [REMOTE ] NQP: Full fetch complete (13141 records). [2025-10-09T20:34:29.141529] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-09T20:34:29.141988] [FATAL] [VALIDATOR ] NQP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:34:29.142050] [FATAL] [MAIN ] NQP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:34:29.142086] [WARN ] [MAIN ] NQP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:34:29.142124] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-09T20:34:29.142177] [DEBUG] [LOCAL ] NQP: No primary data file found to delete. [2025-10-09T20:34:29.142213] [INFO ] [LOCAL ] NQP: Starting deletion of derivative data. [2025-10-09T20:34:29.142429] [DEBUG] [LOCAL ] NQP: Deleted derivative data file. [2025-10-09T20:34:29.142515] [INFO ] [MAIN ] Update Progress: 1525/2373 symbols completed. NQP took 24.0s. Estimated remaining: 1h 59m 14s. Rate: 7.1 symbols/min [2025-10-09T20:34:29.309099] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:34:29.309248] [DEBUG] [LOCAL ] NREF: No existing data file found in primary storage. [2025-10-09T20:34:29.309284] [WARN ] [MAIN ] NREF: No existing data found, performing full refresh instead. [2025-10-09T20:34:29.309397] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-09T20:34:29.309438] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-09T20:34:29.309481] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-09T20:34:29.309513] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-09T20:34:29.601908] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-09T20:34:29.664155] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:34:30.396767] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-09T20:34:31.099382] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:34:31.196700] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-09T20:34:31.316857] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T20:34:31.693705] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-09T20:34:31.996741] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-09T20:34:32.796694] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-09T20:34:33.566635] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:34:33.596677] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-09T20:34:33.845355] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T20:34:34.042988] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T20:34:34.396779] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-09T20:34:35.196729] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-09T20:34:35.636902] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T20:34:35.897850] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:34:35.996733] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-09T20:34:36.796773] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-09T20:34:37.519596] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T20:34:37.596733] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-09T20:34:38.208631] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T20:34:38.401885] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-09T20:34:38.414675] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T20:34:39.196783] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-09T20:34:39.710564] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T20:34:39.884302] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T20:34:39.996775] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-09T20:34:40.750457] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T20:34:40.796691] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-09T20:34:41.108180] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T20:34:41.596748] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-09T20:34:42.396715] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-09T20:34:42.678311] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T20:34:42.860394] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:34:42.863818] [INFO ] [REMOTE ] NPWR: Full fetch complete (59472 records). [2025-10-09T20:34:42.863910] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-09T20:34:42.864478] [FATAL] [VALIDATOR ] NPWR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:34:42.864583] [FATAL] [MAIN ] NPWR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:34:42.864685] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:34:42.864781] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-09T20:34:42.864859] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-09T20:34:42.864897] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-09T20:34:42.864937] [DEBUG] [LOCAL ] NPWR: No derivative data file found to delete. [2025-10-09T20:34:42.865038] [INFO ] [MAIN ] Update Progress: 1526/2373 symbols completed. NPWR took 39.2s. Estimated remaining: 1h 59m 9s. Rate: 7.1 symbols/min [2025-10-09T20:34:43.037576] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:34:43.037804] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-09T20:34:43.037855] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-09T20:34:43.037968] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-09T20:34:43.038013] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-09T20:34:43.038093] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-09T20:34:43.038154] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-09T20:34:43.208921] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-09T20:34:43.397451] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:34:43.780803] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T20:34:43.781988] [INFO ] [REMOTE ] NPV: Full fetch complete (6979 records). [2025-10-09T20:34:43.782071] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-09T20:34:43.782477] [FATAL] [VALIDATOR ] NPV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:34:43.782582] [FATAL] [MAIN ] NPV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:34:43.782678] [WARN ] [MAIN ] NPV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:34:43.782778] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-09T20:34:43.782861] [DEBUG] [LOCAL ] NPV: No primary data file found to delete. [2025-10-09T20:34:43.782900] [INFO ] [LOCAL ] NPV: Starting deletion of derivative data. [2025-10-09T20:34:43.783065] [DEBUG] [LOCAL ] NPV: Deleted derivative data file. [2025-10-09T20:34:43.783159] [INFO ] [MAIN ] Update Progress: 1527/2373 symbols completed. NPV took 43.9s. Estimated remaining: 1h 58m 56s. Rate: 7.1 symbols/min [2025-10-09T20:34:44.013541] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:34:44.005453] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-09T20:34:44.013908] [DEBUG] [LOCAL ] NRGV: No existing data file found in primary storage. [2025-10-09T20:34:44.014215] [WARN ] [MAIN ] NRGV: No existing data found, performing full refresh instead. [2025-10-09T20:34:44.015262] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-09T20:34:44.015330] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-09T20:34:44.015447] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-09T20:34:44.015504] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-09T20:34:44.582010] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:34:44.796754] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-09T20:34:44.867468] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T20:34:45.596708] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-09T20:34:46.258558] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T20:34:46.396725] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-09T20:34:47.196747] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-09T20:34:47.258858] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T20:34:47.307483] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T20:34:47.731922] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T20:34:47.996703] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-09T20:34:48.799057] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-09T20:34:48.799951] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T20:34:49.596730] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-09T20:34:50.396686] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-09T20:34:50.753551] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-09T20:34:51.085888] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T20:34:51.196691] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-09T20:34:51.400467] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T20:34:51.996728] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-09T20:34:52.796741] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-09T20:34:52.925863] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T20:34:53.468995] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T20:34:53.596772] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-09T20:34:53.645560] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T20:34:54.396786] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-09T20:34:54.855369] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:34:54.858340] [INFO ] [REMOTE ] NRDY: Full fetch complete (50810 records). [2025-10-09T20:34:54.858441] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-09T20:34:54.859081] [FATAL] [VALIDATOR ] NRDY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:34:54.859173] [FATAL] [MAIN ] NRDY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:34:54.859215] [WARN ] [MAIN ] NRDY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:34:54.859254] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-09T20:34:54.859309] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-09T20:34:54.859343] [INFO ] [LOCAL ] NRDY: Starting deletion of derivative data. [2025-10-09T20:34:54.859381] [DEBUG] [LOCAL ] NRDY: No derivative data file found to delete. [2025-10-09T20:34:54.859435] [INFO ] [MAIN ] Update Progress: 1528/2373 symbols completed. NRDY took 34.2s. Estimated remaining: 1h 58m 49s. Rate: 7.1 symbols/min [2025-10-09T20:34:55.033851] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:34:55.053855] [DEBUG] [LOCAL ] NRK: Loaded 20037 existing records from primary storage. [2025-10-09T20:34:55.054215] [INFO ] [MAIN ] NRK: Loaded 20037 existing records. [2025-10-09T20:34:55.202695] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-09T20:34:55.232320] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:34:55.233137] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-09T20:34:55.233322] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-09T20:34:55.233675] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-09T20:34:55.233734] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-09T20:34:55.364144] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T20:34:55.624545] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:34:55.931456] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T20:34:55.996730] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-09T20:34:56.796711] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-09T20:34:56.863468] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-09T20:34:57.596724] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-09T20:34:58.181341] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T20:34:58.193750] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T20:34:58.396740] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-09T20:34:59.196728] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-09T20:34:59.853828] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:34:59.996709] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-09T20:35:00.208264] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T20:35:00.796747] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-09T20:35:01.361393] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T20:35:01.596735] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-09T20:35:01.992330] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T20:35:01.993502] [INFO ] [REMOTE ] NREF: Full fetch complete (10881 records). [2025-10-09T20:35:01.993571] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-09T20:35:01.993970] [FATAL] [VALIDATOR ] NREF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:35:01.994052] [FATAL] [MAIN ] NREF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:35:01.994095] [WARN ] [MAIN ] NREF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:35:01.994170] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-09T20:35:01.994243] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-09T20:35:01.994308] [INFO ] [LOCAL ] NREF: Starting deletion of derivative data. [2025-10-09T20:35:01.994492] [DEBUG] [LOCAL ] NREF: No derivative data file found to delete. [2025-10-09T20:35:01.994568] [INFO ] [MAIN ] Update Progress: 1529/2373 symbols completed. NREF took 32.9s. Estimated remaining: 1h 58m 40s. Rate: 7.1 symbols/min [2025-10-09T20:35:02.160872] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:35:02.161063] [DEBUG] [LOCAL ] NRP: No existing data file found in primary storage. [2025-10-09T20:35:02.161100] [WARN ] [MAIN ] NRP: No existing data found, performing full refresh instead. [2025-10-09T20:35:02.161213] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-09T20:35:02.161254] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-09T20:35:02.161294] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-09T20:35:02.161368] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-09T20:35:02.403995] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-09T20:35:02.530720] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:35:02.598883] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T20:35:03.196776] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-09T20:35:03.592476] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T20:35:03.991762] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T20:35:03.996673] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-09T20:35:04.584078] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T20:35:04.796733] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-09T20:35:05.596778] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-09T20:35:06.396694] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-09T20:35:06.429415] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T20:35:06.503975] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T20:35:07.196781] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-09T20:35:07.981110] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T20:35:07.996675] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-09T20:35:08.327423] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T20:35:08.796740] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-09T20:35:08.965534] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T20:35:09.596709] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-09T20:35:10.405136] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-09T20:35:10.407203] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T20:35:10.565709] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T20:35:10.909999] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T20:35:11.196737] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-09T20:35:11.944420] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T20:35:11.996755] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-09T20:35:12.796705] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-09T20:35:13.089260] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T20:35:13.309122] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T20:35:13.596778] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-09T20:35:14.396747] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-09T20:35:14.991764] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T20:35:15.196733] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-09T20:35:15.214286] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T20:35:15.996748] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-09T20:35:16.796712] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-09T20:35:16.961044] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T20:35:17.519635] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T20:35:17.596696] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-09T20:35:17.921602] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T20:35:18.397876] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-09T20:35:18.399802] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T20:35:19.196737] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-09T20:35:19.862879] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T20:35:19.996695] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-09T20:35:20.796733] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-09T20:35:20.965921] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T20:35:21.381635] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T20:35:21.596717] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-09T20:35:22.069198] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T20:35:22.164493] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T20:35:22.396736] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-09T20:35:22.839631] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T20:35:23.196828] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-09T20:35:23.922151] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:35:23.927420] [INFO ] [REMOTE ] NRG: Full fetch complete (76216 records). [2025-10-09T20:35:23.927589] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-09T20:35:23.928578] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:35:23.928797] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:35:23.928865] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:35:23.928950] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-09T20:35:23.929032] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-09T20:35:23.929069] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-09T20:35:23.929110] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-09T20:35:23.929171] [INFO ] [MAIN ] Update Progress: 1530/2373 symbols completed. NRG took 41.1s. Estimated remaining: 1h 58m 39s. Rate: 7.1 symbols/min [2025-10-09T20:35:24.006607] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-09T20:35:24.178799] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:35:24.178999] [DEBUG] [LOCAL ] NRT: No existing data file found in primary storage. [2025-10-09T20:35:24.179036] [WARN ] [MAIN ] NRT: No existing data found, performing full refresh instead. [2025-10-09T20:35:24.179147] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-09T20:35:24.179187] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-09T20:35:24.179228] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-09T20:35:24.179259] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-09T20:35:24.531865] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:35:24.584889] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-09T20:35:24.796744] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-09T20:35:25.218056] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-09T20:35:25.596797] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-09T20:35:26.035924] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T20:35:26.396734] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-09T20:35:26.864957] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T20:35:26.868797] [INFO ] [REMOTE ] NRGV: Full fetch complete (61873 records). [2025-10-09T20:35:26.868909] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-09T20:35:26.870084] [FATAL] [VALIDATOR ] NRGV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:35:26.870176] [FATAL] [MAIN ] NRGV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:35:26.870219] [WARN ] [MAIN ] NRGV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:35:26.870259] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-09T20:35:26.870315] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-09T20:35:26.870349] [INFO ] [LOCAL ] NRGV: Starting deletion of derivative data. [2025-10-09T20:35:26.870396] [DEBUG] [LOCAL ] NRGV: No derivative data file found to delete. [2025-10-09T20:35:26.870453] [INFO ] [MAIN ] Update Progress: 1531/2373 symbols completed. NRGV took 43.1s. Estimated remaining: 1h 58m 27s. Rate: 7.1 symbols/min [2025-10-09T20:35:27.038922] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:35:27.039112] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-09T20:35:27.039149] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-09T20:35:27.039264] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-09T20:35:27.039305] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-09T20:35:27.039352] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-09T20:35:27.039387] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-09T20:35:27.212028] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-09T20:35:27.397598] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:35:27.884205] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T20:35:27.996722] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-09T20:35:28.644278] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:35:28.646296] [INFO ] [REMOTE ] NRK: Full fetch complete (27494 records). [2025-10-09T20:35:28.646396] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-09T20:35:28.646931] [FATAL] [VALIDATOR ] NRK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:35:28.647017] [FATAL] [MAIN ] NRK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:35:28.647059] [WARN ] [MAIN ] NRK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:35:28.647124] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-09T20:35:28.647211] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-09T20:35:28.647261] [INFO ] [LOCAL ] NRK: Starting deletion of derivative data. [2025-10-09T20:35:28.647489] [DEBUG] [LOCAL ] NRK: Deleted derivative data file. [2025-10-09T20:35:28.647596] [INFO ] [MAIN ] Update Progress: 1532/2373 symbols completed. NRK took 33.8s. Estimated remaining: 1h 58m 15s. Rate: 7.1 symbols/min [2025-10-09T20:35:28.808467] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-09T20:35:28.843017] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:35:28.843192] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-09T20:35:28.843236] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-09T20:35:28.843377] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-09T20:35:28.843438] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-09T20:35:28.843486] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-09T20:35:28.843541] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-09T20:35:29.206777] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:35:29.596770] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-09T20:35:30.026719] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T20:35:30.282745] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T20:35:30.396738] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-09T20:35:31.196775] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-09T20:35:31.313569] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T20:35:31.996788] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-09T20:35:32.511559] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T20:35:32.699016] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:35:32.796726] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-09T20:35:33.596697] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-09T20:35:34.299186] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T20:35:34.397924] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-09T20:35:34.399459] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T20:35:35.025273] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T20:35:35.196728] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-09T20:35:35.996770] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-09T20:35:36.272686] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T20:35:36.433939] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-09T20:35:36.796750] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-09T20:35:37.596708] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-09T20:35:37.606623] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T20:35:38.315875] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T20:35:38.396716] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-09T20:35:38.698845] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T20:35:38.699768] [INFO ] [REMOTE ] NRP: Full fetch complete (6403 records). [2025-10-09T20:35:38.699838] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-09T20:35:38.700203] [FATAL] [VALIDATOR ] NRP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:35:38.700308] [FATAL] [MAIN ] NRP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:35:38.700378] [WARN ] [MAIN ] NRP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:35:38.700449] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-09T20:35:38.700511] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-09T20:35:38.700554] [INFO ] [LOCAL ] NRP: Starting deletion of derivative data. [2025-10-09T20:35:38.700593] [DEBUG] [LOCAL ] NRP: No derivative data file found to delete. [2025-10-09T20:35:38.700686] [INFO ] [MAIN ] Update Progress: 1533/2373 symbols completed. NRP took 36.7s. Estimated remaining: 1h 58m 8s. Rate: 7.1 symbols/min [2025-10-09T20:35:38.866161] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:35:38.866377] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-09T20:35:38.866468] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-09T20:35:38.866586] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-09T20:35:38.866628] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-09T20:35:38.866729] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-09T20:35:38.866770] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-09T20:35:39.227602] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:35:39.196720] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-09T20:35:39.898413] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:35:39.996691] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-09T20:35:40.556976] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T20:35:40.796706] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-09T20:35:41.596760] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-09T20:35:42.176721] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T20:35:42.396748] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-09T20:35:42.968636] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-09T20:35:43.080028] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T20:35:43.196717] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-09T20:35:43.996726] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-09T20:35:44.796737] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-09T20:35:44.901920] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T20:35:45.504885] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T20:35:45.596690] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-09T20:35:45.783479] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T20:35:46.101242] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-09T20:35:46.396723] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-09T20:35:47.196734] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-09T20:35:47.996727] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-09T20:35:48.066414] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T20:35:48.502324] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T20:35:48.637036] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T20:35:48.796714] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-09T20:35:49.596762] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-09T20:35:50.228890] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T20:35:50.396690] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-09T20:35:50.631563] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-09T20:35:50.632794] [INFO ] [REMOTE ] NRUC: Full fetch complete (5404 records). [2025-10-09T20:35:50.632870] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-09T20:35:50.633320] [FATAL] [VALIDATOR ] NRUC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:35:50.633421] [FATAL] [MAIN ] NRUC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:35:50.633516] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:35:50.633600] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-09T20:35:50.633732] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-09T20:35:50.633812] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-09T20:35:50.633874] [DEBUG] [LOCAL ] NRUC: No derivative data file found to delete. [2025-10-09T20:35:50.633936] [INFO ] [MAIN ] Update Progress: 1534/2373 symbols completed. NRUC took 23.8s. Estimated remaining: 1h 58m 1s. Rate: 7.1 symbols/min [2025-10-09T20:35:50.842133] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:35:50.842372] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-09T20:35:50.842502] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-09T20:35:50.842702] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-09T20:35:50.842766] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-09T20:35:50.842855] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-09T20:35:50.842912] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-09T20:35:51.058079] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-09T20:35:51.201768] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-09T20:35:51.255978] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:35:51.996712] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-09T20:35:52.796865] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-09T20:35:52.886830] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T20:35:53.103251] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T20:35:53.596731] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-09T20:35:54.396762] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-09T20:35:54.555188] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T20:35:54.988550] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T20:35:55.066230] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T20:35:55.196717] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-09T20:35:55.996724] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-09T20:35:56.064546] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T20:35:56.796757] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-09T20:35:57.150819] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T20:35:57.287486] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T20:35:57.596741] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-09T20:35:58.396782] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-09T20:35:59.196683] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-09T20:35:59.288977] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T20:35:59.573798] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T20:35:59.574768] [INFO ] [REMOTE ] NRT: Full fetch complete (7914 records). [2025-10-09T20:35:59.574840] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-09T20:35:59.575237] [FATAL] [VALIDATOR ] NRT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:35:59.575355] [FATAL] [MAIN ] NRT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:35:59.575437] [WARN ] [MAIN ] NRT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:35:59.575511] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-09T20:35:59.575580] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-09T20:35:59.575620] [INFO ] [LOCAL ] NRT: Starting deletion of derivative data. [2025-10-09T20:35:59.575700] [DEBUG] [LOCAL ] NRT: No derivative data file found to delete. [2025-10-09T20:35:59.575771] [INFO ] [MAIN ] Update Progress: 1535/2373 symbols completed. NRT took 35.6s. Estimated remaining: 1h 57m 53s. Rate: 7.1 symbols/min [2025-10-09T20:35:59.755705] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:35:59.755871] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-09T20:35:59.755908] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-09T20:35:59.756016] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-09T20:35:59.756057] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-09T20:35:59.756104] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-09T20:35:59.756136] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-09T20:36:00.003577] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-09T20:36:00.124848] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:36:00.163183] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T20:36:00.796727] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-09T20:36:01.546284] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T20:36:01.596694] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-09T20:36:02.098094] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T20:36:02.396805] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-09T20:36:02.969128] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T20:36:03.196772] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-09T20:36:03.458355] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T20:36:03.853481] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:36:03.996682] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-09T20:36:04.692066] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T20:36:04.695566] [INFO ] [REMOTE ] NSA: Full fetch complete (61848 records). [2025-10-09T20:36:04.695684] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-09T20:36:04.696500] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:36:04.696586] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:36:04.696629] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:36:04.696722] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-09T20:36:04.696849] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-09T20:36:04.696904] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-09T20:36:04.696959] [DEBUG] [LOCAL ] NSA: No derivative data file found to delete. [2025-10-09T20:36:04.697059] [INFO ] [MAIN ] Update Progress: 1536/2373 symbols completed. NSA took 36.0s. Estimated remaining: 1h 57m 43s. Rate: 7.1 symbols/min [2025-10-09T20:36:04.797804] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-09T20:36:04.869177] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:36:04.869342] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-09T20:36:04.869378] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-09T20:36:04.869487] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-09T20:36:04.869527] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-09T20:36:04.869567] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-09T20:36:04.869598] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-09T20:36:05.230876] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:36:05.596713] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-09T20:36:06.396683] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-09T20:36:06.521179] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T20:36:06.859804] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T20:36:07.043563] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T20:36:07.196723] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-09T20:36:07.996726] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-09T20:36:08.455251] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T20:36:08.786247] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T20:36:08.796687] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-09T20:36:09.331863] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T20:36:09.596734] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-09T20:36:10.396730] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-09T20:36:11.166205] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T20:36:11.196673] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-09T20:36:11.673364] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T20:36:11.996725] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-09T20:36:12.628466] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T20:36:12.796701] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-09T20:36:12.961689] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T20:36:13.416293] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T20:36:13.596720] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-09T20:36:14.396734] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-09T20:36:15.196687] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-09T20:36:15.381465] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T20:36:15.773503] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T20:36:15.817767] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T20:36:15.996732] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-09T20:36:16.796725] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-09T20:36:17.596687] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-09T20:36:17.957286] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T20:36:18.073865] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-09T20:36:18.396678] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-09T20:36:18.585131] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T20:36:19.196742] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-09T20:36:19.996742] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-09T20:36:20.209994] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T20:36:20.486266] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T20:36:20.745619] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T20:36:20.796718] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-09T20:36:21.596733] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-09T20:36:22.049373] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T20:36:22.220876] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T20:36:22.396741] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-09T20:36:23.035443] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T20:36:23.039348] [INFO ] [REMOTE ] NSC: Full fetch complete (70443 records). [2025-10-09T20:36:23.039464] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-09T20:36:23.041428] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:36:23.041519] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:36:23.041564] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:36:23.041605] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-09T20:36:23.041708] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-09T20:36:23.041768] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-09T20:36:23.041815] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-09T20:36:23.041876] [INFO ] [MAIN ] Update Progress: 1537/2373 symbols completed. NSC took 44.3s. Estimated remaining: 1h 57m 40s. Rate: 7.1 symbols/min [2025-10-09T20:36:23.215269] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:36:23.209002] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-09T20:36:23.215667] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-09T20:36:23.215762] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-09T20:36:23.216586] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-09T20:36:23.216682] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-09T20:36:23.216765] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-09T20:36:23.216805] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-09T20:36:23.581725] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:36:23.996757] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-09T20:36:24.198499] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T20:36:24.796782] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-09T20:36:25.596722] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-09T20:36:25.631681] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T20:36:26.289585] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T20:36:26.396685] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-09T20:36:26.660910] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T20:36:26.858374] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:36:26.860602] [INFO ] [REMOTE ] NTB: Full fetch complete (30452 records). [2025-10-09T20:36:26.860857] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-09T20:36:26.861461] [FATAL] [VALIDATOR ] NTB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:36:26.861555] [FATAL] [MAIN ] NTB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:36:26.861600] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:36:26.861667] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-09T20:36:26.861757] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-09T20:36:26.861797] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-09T20:36:26.861841] [DEBUG] [LOCAL ] NTB: No derivative data file found to delete. [2025-10-09T20:36:26.861904] [INFO ] [MAIN ] Update Progress: 1538/2373 symbols completed. NTB took 27.3s. Estimated remaining: 1h 57m 29s. Rate: 7.1 symbols/min [2025-10-09T20:36:27.027518] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:36:27.027769] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-09T20:36:27.027827] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-09T20:36:27.027945] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-09T20:36:27.027989] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-09T20:36:27.028029] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-09T20:36:27.028061] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-09T20:36:27.198276] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-09T20:36:27.391737] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:36:27.844265] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T20:36:27.996722] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-09T20:36:28.796739] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-09T20:36:29.596765] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-09T20:36:29.602723] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T20:36:29.778562] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T20:36:30.396767] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-09T20:36:30.956633] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:36:30.959701] [INFO ] [REMOTE ] NSP: Full fetch complete (49520 records). [2025-10-09T20:36:30.959779] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-09T20:36:30.960352] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:36:30.960437] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:36:30.960480] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:36:30.960634] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-09T20:36:30.960753] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-09T20:36:30.960809] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-09T20:36:30.960893] [DEBUG] [LOCAL ] NSP: No derivative data file found to delete. [2025-10-09T20:36:30.960981] [INFO ] [MAIN ] Update Progress: 1539/2373 symbols completed. NSP took 40.3s. Estimated remaining: 1h 57m 18s. Rate: 7.1 symbols/min [2025-10-09T20:36:31.129190] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:36:31.129462] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-09T20:36:31.129598] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-09T20:36:31.129748] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-09T20:36:31.129792] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-09T20:36:31.129842] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-09T20:36:31.129873] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-09T20:36:31.197722] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-09T20:36:31.496829] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:36:31.533250] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T20:36:31.996787] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-09T20:36:32.796738] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-09T20:36:32.852959] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T20:36:33.596733] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-09T20:36:34.156066] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T20:36:34.396709] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-09T20:36:34.516851] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-09T20:36:34.688871] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-09T20:36:35.196788] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-09T20:36:35.504141] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T20:36:35.868618] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T20:36:35.996780] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-09T20:36:36.796763] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-09T20:36:37.065962] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-09T20:36:37.066685] [INFO ] [REMOTE ] NTEST: Full fetch complete (1993 records). [2025-10-09T20:36:37.066767] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-09T20:36:37.067187] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:36:37.067269] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:36:37.067311] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:36:37.067350] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-09T20:36:37.067427] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-09T20:36:37.067484] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-09T20:36:37.067528] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-09T20:36:37.067582] [INFO ] [MAIN ] Update Progress: 1540/2373 symbols completed. NTEST took 32.4s. Estimated remaining: 1h 57m 8s. Rate: 7.1 symbols/min [2025-10-09T20:36:37.252707] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:36:37.253020] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-09T20:36:37.253110] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-09T20:36:37.253246] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-09T20:36:37.253288] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-09T20:36:37.253330] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-09T20:36:37.253364] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-09T20:36:37.600269] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-09T20:36:37.630658] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:36:38.074339] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T20:36:38.396726] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-09T20:36:39.196706] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-09T20:36:39.314972] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T20:36:39.996728] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-09T20:36:40.508434] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-09T20:36:40.796702] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-09T20:36:41.284450] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T20:36:41.322797] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T20:36:41.596730] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-09T20:36:42.396758] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-09T20:36:42.931596] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-09T20:36:43.049916] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T20:36:43.196736] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-09T20:36:43.986333] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T20:36:43.996667] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-09T20:36:44.796759] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-09T20:36:45.081004] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T20:36:45.596780] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-09T20:36:45.655074] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T20:36:46.396738] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-09T20:36:47.196900] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-09T20:36:47.197039] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-09T20:36:47.555752] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-09T20:36:47.704219] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T20:36:47.996727] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-09T20:36:48.796711] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-09T20:36:48.894018] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T20:36:49.561864] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T20:36:49.596688] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-09T20:36:50.401932] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-09T20:36:50.427521] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T20:36:51.196694] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-09T20:36:51.696113] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-09T20:36:51.996800] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-09T20:36:52.404594] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T20:36:52.796701] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-09T20:36:53.080621] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T20:36:53.228185] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T20:36:53.596704] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-09T20:36:53.766830] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T20:36:54.396752] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-09T20:36:55.196725] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-09T20:36:55.298251] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T20:36:55.996725] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-09T20:36:56.265826] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T20:36:56.532785] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T20:36:56.796744] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-09T20:36:57.447448] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:36:57.449208] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T20:36:57.464099] [INFO ] [REMOTE ] NTR: Full fetch complete (75910 records). [2025-10-09T20:36:57.464752] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-09T20:36:57.466432] [FATAL] [VALIDATOR ] NTR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:36:57.466576] [FATAL] [MAIN ] NTR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:36:57.466665] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:36:57.466765] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-09T20:36:57.466865] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-09T20:36:57.466924] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-09T20:36:57.466970] [DEBUG] [LOCAL ] NTR: No derivative data file found to delete. [2025-10-09T20:36:57.467046] [INFO ] [MAIN ] Update Progress: 1541/2373 symbols completed. NTR took 34.4s. Estimated remaining: 1h 57m 6s. Rate: 7.1 symbols/min [2025-10-09T20:36:57.604771] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-09T20:36:57.643085] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:36:57.643297] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-09T20:36:57.643375] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-09T20:36:57.643531] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-09T20:36:57.643606] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-09T20:36:57.643722] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-09T20:36:57.643800] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-09T20:36:58.009703] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:36:58.396694] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-09T20:36:59.196732] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-09T20:36:59.571129] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-09T20:36:59.605969] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T20:36:59.862736] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T20:36:59.867414] [INFO ] [REMOTE ] NTST: Full fetch complete (61067 records). [2025-10-09T20:36:59.867714] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-09T20:36:59.868830] [FATAL] [VALIDATOR ] NTST: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:36:59.869217] [FATAL] [MAIN ] NTST: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:36:59.869317] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:36:59.869399] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-09T20:36:59.869476] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-09T20:36:59.869514] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-09T20:36:59.869553] [DEBUG] [LOCAL ] NTST: No derivative data file found to delete. [2025-10-09T20:36:59.869668] [INFO ] [MAIN ] Update Progress: 1542/2373 symbols completed. NTST took 33.0s. Estimated remaining: 1h 56m 55s. Rate: 7.1 symbols/min [2025-10-09T20:37:00.001865] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-09T20:37:00.054715] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:37:00.081713] [DEBUG] [LOCAL ] NUV: Loaded 23707 existing records from primary storage. [2025-10-09T20:37:00.082010] [INFO ] [MAIN ] NUV: Loaded 23707 existing records. [2025-10-09T20:37:00.294493] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:37:00.294756] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-09T20:37:00.294811] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-09T20:37:00.295183] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-09T20:37:00.295242] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-09T20:37:00.664342] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:37:00.796702] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-09T20:37:01.596727] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-09T20:37:01.888832] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T20:37:01.919051] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T20:37:02.396719] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-09T20:37:02.979718] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T20:37:03.196739] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-09T20:37:03.996773] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-09T20:37:04.279240] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T20:37:04.796714] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-09T20:37:04.847724] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T20:37:05.596761] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-09T20:37:05.808663] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T20:37:06.396775] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-09T20:37:06.528245] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-09T20:37:06.893197] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T20:37:07.201820] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-09T20:37:07.209588] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T20:37:07.996730] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-09T20:37:08.796698] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-09T20:37:08.986607] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T20:37:09.166080] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T20:37:09.596705] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-09T20:37:10.396755] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-09T20:37:10.479014] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T20:37:11.068616] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T20:37:11.196723] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-09T20:37:11.996799] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-09T20:37:12.501270] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-09T20:37:12.728188] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T20:37:12.796764] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-09T20:37:12.856030] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T20:37:13.441077] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T20:37:13.596710] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-09T20:37:14.186383] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T20:37:14.190306] [INFO ] [REMOTE ] NUE: Full fetch complete (74413 records). [2025-10-09T20:37:14.190460] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-09T20:37:14.191486] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:37:14.191594] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:37:14.191639] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:37:14.191731] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-09T20:37:14.191793] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-09T20:37:14.191831] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-09T20:37:14.191922] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-09T20:37:14.192005] [INFO ] [MAIN ] Update Progress: 1543/2373 symbols completed. NUE took 37.1s. Estimated remaining: 1h 56m 49s. Rate: 7.1 symbols/min [2025-10-09T20:37:14.380221] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:37:14.380462] [DEBUG] [LOCAL ] NUVB: No existing data file found in primary storage. [2025-10-09T20:37:14.380514] [WARN ] [MAIN ] NUVB: No existing data found, performing full refresh instead. [2025-10-09T20:37:14.380631] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-09T20:37:14.380714] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-09T20:37:14.380766] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-09T20:37:14.380798] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-09T20:37:14.401884] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-09T20:37:14.768912] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:37:15.196780] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-09T20:37:15.766496] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T20:37:15.996754] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-09T20:37:16.235170] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T20:37:16.796766] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-09T20:37:17.596683] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-09T20:37:17.783878] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T20:37:17.923689] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T20:37:18.396779] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-09T20:37:19.147581] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T20:37:19.196690] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-09T20:37:19.996727] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-09T20:37:20.046627] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T20:37:20.369808] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T20:37:20.375174] [INFO ] [REMOTE ] NU: Full fetch complete (77490 records). [2025-10-09T20:37:20.375337] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-09T20:37:20.376560] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:37:20.376708] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:37:20.376778] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:37:20.376871] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-09T20:37:20.376983] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-09T20:37:20.377053] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-09T20:37:20.377132] [DEBUG] [LOCAL ] NU: No derivative data file found to delete. [2025-10-09T20:37:20.377211] [INFO ] [MAIN ] Update Progress: 1544/2373 symbols completed. NU took 49.4s. Estimated remaining: 1h 56m 40s. Rate: 7.1 symbols/min [2025-10-09T20:37:20.596492] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:37:20.613731] [DEBUG] [LOCAL ] NUW: Loaded 7156 existing records from primary storage. [2025-10-09T20:37:20.614047] [INFO ] [MAIN ] NUW: Loaded 7156 existing records. [2025-10-09T20:37:20.802224] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-09T20:37:20.809077] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:37:20.810833] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-09T20:37:20.810900] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-09T20:37:20.811417] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-09T20:37:20.811479] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-09T20:37:21.153797] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-09T20:37:21.256333] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:37:21.596738] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-09T20:37:22.230538] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T20:37:22.396786] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-09T20:37:22.442248] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T20:37:22.980394] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T20:37:23.196740] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-09T20:37:23.996718] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-09T20:37:24.796779] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-09T20:37:24.937742] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T20:37:24.974497] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T20:37:25.596731] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-09T20:37:26.038414] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T20:37:26.303142] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T20:37:26.396734] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-09T20:37:27.196741] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-09T20:37:27.252215] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T20:37:27.996730] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-09T20:37:28.649034] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:37:28.652115] [INFO ] [REMOTE ] NUS: Full fetch complete (53529 records). [2025-10-09T20:37:28.652204] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-09T20:37:28.652888] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:37:28.652984] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:37:28.653028] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:37:28.653068] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-09T20:37:28.653125] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-09T20:37:28.653161] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-09T20:37:28.653205] [DEBUG] [LOCAL ] NUS: No derivative data file found to delete. [2025-10-09T20:37:28.653263] [INFO ] [MAIN ] Update Progress: 1545/2373 symbols completed. NUS took 31.2s. Estimated remaining: 1h 56m 31s. Rate: 7.1 symbols/min [2025-10-09T20:37:28.806119] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-09T20:37:28.841444] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:37:28.883084] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T20:37:28.920621] [DEBUG] [LOCAL ] NVG: Loaded 27460 existing records from primary storage. [2025-10-09T20:37:28.920978] [INFO ] [MAIN ] NVG: Loaded 27460 existing records. [2025-10-09T20:37:29.096834] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:37:29.097080] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-09T20:37:29.097131] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-09T20:37:29.097409] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-09T20:37:29.097502] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-09T20:37:29.453778] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:37:29.596777] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-09T20:37:29.645475] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T20:37:30.396732] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-09T20:37:31.079945] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T20:37:31.083180] [INFO ] [REMOTE ] NUV: Full fetch complete (34109 records). [2025-10-09T20:37:31.083274] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-09T20:37:31.083882] [FATAL] [VALIDATOR ] NUV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:37:31.083972] [FATAL] [MAIN ] NUV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:37:31.084019] [WARN ] [MAIN ] NUV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:37:31.084091] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-09T20:37:31.084164] [DEBUG] [LOCAL ] NUV: No primary data file found to delete. [2025-10-09T20:37:31.084203] [INFO ] [LOCAL ] NUV: Starting deletion of derivative data. [2025-10-09T20:37:31.084727] [DEBUG] [LOCAL ] NUV: Deleted derivative data file. [2025-10-09T20:37:31.085043] [INFO ] [MAIN ] Update Progress: 1546/2373 symbols completed. NUV took 31.2s. Estimated remaining: 1h 56m 20s. Rate: 7.1 symbols/min [2025-10-09T20:37:31.197969] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-09T20:37:31.266064] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:37:31.267079] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-09T20:37:31.267248] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-09T20:37:31.267461] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-09T20:37:31.267633] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-09T20:37:31.267880] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-09T20:37:31.267968] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-09T20:37:31.489913] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T20:37:31.712299] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:37:31.793688] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T20:37:31.996728] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-09T20:37:32.796698] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-09T20:37:33.017582] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T20:37:33.596768] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-09T20:37:34.396700] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-09T20:37:34.509832] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T20:37:34.711877] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T20:37:35.196753] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-09T20:37:35.816535] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T20:37:35.999160] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-09T20:37:36.003470] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T20:37:36.796773] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-09T20:37:37.370773] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T20:37:37.596728] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-09T20:37:38.065017] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T20:37:38.396725] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-09T20:37:38.418531] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T20:37:39.196738] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-09T20:37:39.721296] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T20:37:39.870088] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T20:37:39.996724] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-09T20:37:40.687722] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T20:37:40.796676] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-09T20:37:41.596734] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-09T20:37:42.084048] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T20:37:42.396785] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-09T20:37:43.118095] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T20:37:43.196773] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-09T20:37:43.996772] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-09T20:37:44.263513] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T20:37:44.687851] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T20:37:44.753083] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T20:37:44.796736] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-09T20:37:45.596779] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-09T20:37:45.912196] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-09T20:37:46.131746] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T20:37:46.396730] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-09T20:37:47.196728] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-09T20:37:47.396819] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.20 seconds). [2025-10-09T20:37:47.397970] [INFO ] [REMOTE ] NUW: Full fetch complete (11246 records). [2025-10-09T20:37:47.398044] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-09T20:37:47.398521] [FATAL] [VALIDATOR ] NUW: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:37:47.398683] [FATAL] [MAIN ] NUW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:37:47.398740] [WARN ] [MAIN ] NUW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:37:47.398913] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-09T20:37:47.398991] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-10-09T20:37:47.399033] [INFO ] [LOCAL ] NUW: Starting deletion of derivative data. [2025-10-09T20:37:47.399577] [DEBUG] [LOCAL ] NUW: Deleted derivative data file. [2025-10-09T20:37:47.399964] [INFO ] [MAIN ] Update Progress: 1547/2373 symbols completed. NUW took 27.0s. Estimated remaining: 1h 56m 15s. Rate: 7.1 symbols/min [2025-10-09T20:37:47.572880] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:37:47.573065] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-09T20:37:47.573103] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-09T20:37:47.573218] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-09T20:37:47.573259] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-09T20:37:47.573303] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-09T20:37:47.573381] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-09T20:37:47.871335] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T20:37:47.957276] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:37:47.996680] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-09T20:37:48.796731] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-09T20:37:49.596798] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-09T20:37:50.149334] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T20:37:50.396687] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-09T20:37:50.641725] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-09T20:37:50.745127] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T20:37:51.196723] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-09T20:37:51.829249] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T20:37:51.996736] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-09T20:37:52.796689] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-09T20:37:52.981882] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T20:37:53.596759] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-09T20:37:53.619765] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T20:37:54.252021] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-09T20:37:54.396702] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-09T20:37:54.550616] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T20:37:54.693832] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T20:37:54.696690] [INFO ] [REMOTE ] NVGS: Full fetch complete (41435 records). [2025-10-09T20:37:54.696794] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-09T20:37:54.697446] [FATAL] [VALIDATOR ] NVGS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:37:54.697548] [FATAL] [MAIN ] NVGS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:37:54.697600] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:37:54.697667] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-09T20:37:54.697791] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-09T20:37:54.697850] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-09T20:37:54.698112] [DEBUG] [LOCAL ] NVGS: No derivative data file found to delete. [2025-10-09T20:37:54.698513] [INFO ] [MAIN ] Update Progress: 1548/2373 symbols completed. NVGS took 23.6s. Estimated remaining: 1h 56m 6s. Rate: 7.1 symbols/min [2025-10-09T20:37:54.866022] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:37:54.866244] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-09T20:37:54.866280] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-09T20:37:54.866398] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-09T20:37:54.866439] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-09T20:37:54.866480] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-09T20:37:54.866512] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-09T20:37:55.212241] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-09T20:37:55.219695] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:37:55.670444] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:37:55.674421] [INFO ] [REMOTE ] NUVB: Full fetch complete (72547 records). [2025-10-09T20:37:55.674540] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-09T20:37:55.675365] [FATAL] [VALIDATOR ] NUVB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:37:55.675457] [FATAL] [MAIN ] NUVB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:37:55.675504] [WARN ] [MAIN ] NUVB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:37:55.675587] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-09T20:37:55.675699] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-09T20:37:55.675780] [INFO ] [LOCAL ] NUVB: Starting deletion of derivative data. [2025-10-09T20:37:55.675875] [DEBUG] [LOCAL ] NUVB: No derivative data file found to delete. [2025-10-09T20:37:55.676019] [INFO ] [MAIN ] Update Progress: 1549/2373 symbols completed. NUVB took 41.5s. Estimated remaining: 1h 55m 54s. Rate: 7.1 symbols/min [2025-10-09T20:37:55.861098] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:37:55.861270] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-09T20:37:55.861308] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-09T20:37:55.861422] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-09T20:37:55.861482] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-09T20:37:55.861554] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-09T20:37:55.861600] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-09T20:37:56.001856] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-09T20:37:56.256935] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:37:56.796818] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-09T20:37:57.596762] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-09T20:37:58.051039] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T20:37:58.396701] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-09T20:37:58.615621] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-09T20:37:58.661557] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T20:37:59.196840] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-09T20:37:59.873890] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T20:37:59.996678] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-09T20:38:00.796772] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-09T20:38:01.352475] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T20:38:01.596760] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-09T20:38:01.785436] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T20:38:02.049088] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-09T20:38:02.396743] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-09T20:38:02.678618] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T20:38:03.196751] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-09T20:38:03.414704] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T20:38:03.996733] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-09T20:38:04.485443] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T20:38:04.796722] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-09T20:38:05.596796] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-09T20:38:05.958413] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T20:38:06.396719] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-09T20:38:06.769883] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-09T20:38:06.983740] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T20:38:07.196721] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-09T20:38:07.477876] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T20:38:07.996740] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-09T20:38:08.611452] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T20:38:08.796693] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-09T20:38:08.984716] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T20:38:09.596719] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-09T20:38:09.766791] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T20:38:10.396722] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-09T20:38:11.196740] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-09T20:38:11.243995] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T20:38:11.953821] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T20:38:11.956408] [INFO ] [REMOTE ] NVG: Full fetch complete (40113 records). [2025-10-09T20:38:11.956510] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-09T20:38:11.957068] [FATAL] [VALIDATOR ] NVG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:38:11.957153] [FATAL] [MAIN ] NVG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:38:11.957196] [WARN ] [MAIN ] NVG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:38:11.957234] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-09T20:38:11.957291] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-09T20:38:11.957339] [INFO ] [LOCAL ] NVG: Starting deletion of derivative data. [2025-10-09T20:38:11.957559] [DEBUG] [LOCAL ] NVG: Deleted derivative data file. [2025-10-09T20:38:11.957681] [INFO ] [MAIN ] Update Progress: 1550/2373 symbols completed. NVG took 43.3s. Estimated remaining: 1h 55m 50s. Rate: 7.1 symbols/min [2025-10-09T20:38:12.001974] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-09T20:38:12.144067] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:38:12.144278] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-09T20:38:12.144316] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-09T20:38:12.144431] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-09T20:38:12.144473] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-09T20:38:12.144514] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-09T20:38:12.144546] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-09T20:38:12.583122] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:38:12.796703] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-09T20:38:12.934740] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-09T20:38:12.962613] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T20:38:13.596820] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-09T20:38:13.924061] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T20:38:14.396804] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-09T20:38:15.196695] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-09T20:38:15.576741] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T20:38:15.996735] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-09T20:38:16.254536] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-09T20:38:16.291634] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T20:38:16.796681] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-09T20:38:16.991379] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T20:38:17.596832] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-09T20:38:17.987389] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T20:38:18.396712] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-09T20:38:19.196763] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-09T20:38:19.308342] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T20:38:19.996701] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-09T20:38:20.796735] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-09T20:38:20.904557] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T20:38:21.250536] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-09T20:38:21.596686] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-09T20:38:21.630943] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T20:38:21.668689] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T20:38:22.224465] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T20:38:22.396729] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-09T20:38:23.196723] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-09T20:38:23.759061] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T20:38:23.996747] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-09T20:38:24.324048] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-09T20:38:24.327464] [INFO ] [REMOTE ] NVRI: Full fetch complete (55498 records). [2025-10-09T20:38:24.327557] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-09T20:38:24.328321] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:38:24.328410] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:38:24.328456] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:38:24.328523] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-09T20:38:24.328590] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-09T20:38:24.328628] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-09T20:38:24.328714] [DEBUG] [LOCAL ] NVRI: No derivative data file found to delete. [2025-10-09T20:38:24.328826] [INFO ] [MAIN ] Update Progress: 1551/2373 symbols completed. NVRI took 28.7s. Estimated remaining: 1h 55m 43s. Rate: 7.1 symbols/min [2025-10-09T20:38:24.505526] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:38:24.505755] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-09T20:38:24.505801] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-09T20:38:24.505917] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-09T20:38:24.505958] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-09T20:38:24.506045] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-09T20:38:24.506085] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-09T20:38:24.800042] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-09T20:38:24.854084] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:38:25.358279] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:38:25.361818] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-10-09T20:38:25.374370] [INFO ] [REMOTE ] NVR: Full fetch complete (28892 records). [2025-10-09T20:38:25.374804] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-09T20:38:25.376005] [FATAL] [VALIDATOR ] NVR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:38:25.376101] [FATAL] [MAIN ] NVR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:38:25.376162] [WARN ] [MAIN ] NVR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:38:25.376263] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-09T20:38:25.376357] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-09T20:38:25.376400] [INFO ] [LOCAL ] NVR: Starting deletion of derivative data. [2025-10-09T20:38:25.376443] [DEBUG] [LOCAL ] NVR: No derivative data file found to delete. [2025-10-09T20:38:25.376515] [INFO ] [MAIN ] Update Progress: 1552/2373 symbols completed. NVR took 30.7s. Estimated remaining: 1h 55m 31s. Rate: 7.1 symbols/min [2025-10-09T20:38:25.545704] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:38:25.545896] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-09T20:38:25.545934] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-09T20:38:25.546075] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-09T20:38:25.546145] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-09T20:38:25.546201] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-09T20:38:25.546234] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-09T20:38:25.606691] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-09T20:38:25.901991] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:38:26.253472] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T20:38:26.396724] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-09T20:38:27.196737] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-09T20:38:27.996738] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-09T20:38:28.301273] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T20:38:28.728847] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T20:38:28.796750] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-09T20:38:29.195859] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T20:38:29.200294] [INFO ] [REMOTE ] NVO: Full fetch complete (77566 records). [2025-10-09T20:38:29.200447] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-09T20:38:29.201607] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:38:29.201750] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:38:29.201822] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:38:29.201905] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-09T20:38:29.201992] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-09T20:38:29.202039] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-09T20:38:29.202109] [DEBUG] [LOCAL ] NVO: No derivative data file found to delete. [2025-10-09T20:38:29.202243] [INFO ] [MAIN ] Update Progress: 1553/2373 symbols completed. NVO took 41.8s. Estimated remaining: 1h 55m 20s. Rate: 7.1 symbols/min [2025-10-09T20:38:29.378003] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:38:29.378271] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-09T20:38:29.378395] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-09T20:38:29.378534] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-09T20:38:29.378819] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-09T20:38:29.378961] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-09T20:38:29.379113] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-09T20:38:29.615001] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-09T20:38:29.761548] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T20:38:29.887078] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:38:30.396813] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-09T20:38:31.196769] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-09T20:38:31.427831] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T20:38:31.737707] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T20:38:31.996758] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-09T20:38:32.588853] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T20:38:32.796742] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-09T20:38:33.435604] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T20:38:33.596741] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-09T20:38:34.062517] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T20:38:34.396772] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-09T20:38:35.196708] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-09T20:38:35.493990] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-09T20:38:35.996746] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-09T20:38:36.265937] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T20:38:36.796768] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-09T20:38:36.984718] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T20:38:37.317778] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T20:38:37.596760] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-09T20:38:38.396743] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-09T20:38:38.705082] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T20:38:39.170864] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T20:38:39.196698] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-09T20:38:39.996748] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-09T20:38:40.254800] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T20:38:40.796737] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-09T20:38:40.955892] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T20:38:41.579042] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T20:38:41.596677] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-09T20:38:42.396713] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-09T20:38:42.734320] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T20:38:43.115214] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T20:38:43.196740] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-09T20:38:43.960782] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T20:38:43.996709] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-09T20:38:44.796776] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-09T20:38:45.173631] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T20:38:45.354784] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T20:38:45.596765] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-09T20:38:46.396765] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-09T20:38:46.890547] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T20:38:47.196740] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-09T20:38:47.293998] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T20:38:47.996710] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-09T20:38:48.477691] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T20:38:48.796717] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-09T20:38:48.921842] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T20:38:49.362701] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T20:38:49.596769] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-09T20:38:50.186462] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T20:38:50.396714] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-09T20:38:50.674868] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T20:38:51.123618] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:38:51.128180] [INFO ] [REMOTE ] NVST: Full fetch complete (73732 records). [2025-10-09T20:38:51.128328] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-09T20:38:51.129477] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:38:51.129580] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:38:51.129709] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:38:51.129777] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-09T20:38:51.129882] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-09T20:38:51.129941] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-09T20:38:51.130018] [DEBUG] [LOCAL ] NVST: No derivative data file found to delete. [2025-10-09T20:38:51.130110] [INFO ] [MAIN ] Update Progress: 1554/2373 symbols completed. NVST took 26.8s. Estimated remaining: 1h 55m 19s. Rate: 7.1 symbols/min [2025-10-09T20:38:51.201874] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-09T20:38:51.319041] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:38:51.319314] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-09T20:38:51.319358] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-09T20:38:51.319488] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-09T20:38:51.319531] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-09T20:38:51.319608] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-09T20:38:51.319686] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-09T20:38:51.718842] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:38:51.862291] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:38:51.996784] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-09T20:38:52.750243] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T20:38:52.796695] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-09T20:38:53.596758] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-09T20:38:54.012903] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T20:38:54.396779] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-09T20:38:55.196776] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-09T20:38:55.640293] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-09T20:38:55.669930] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T20:38:55.675614] [INFO ] [REMOTE ] NVS: Full fetch complete (74444 records). [2025-10-09T20:38:55.675823] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-09T20:38:55.678403] [FATAL] [VALIDATOR ] NVS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:38:55.678503] [FATAL] [MAIN ] NVS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:38:55.678550] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:38:55.678593] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-09T20:38:55.678708] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-09T20:38:55.678767] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-09T20:38:55.678816] [DEBUG] [LOCAL ] NVS: No derivative data file found to delete. [2025-10-09T20:38:55.678884] [INFO ] [MAIN ] Update Progress: 1555/2373 symbols completed. NVS took 43.7s. Estimated remaining: 1h 55m 8s. Rate: 7.1 symbols/min [2025-10-09T20:38:55.821102] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T20:38:55.897840] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:38:55.898091] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-09T20:38:55.898241] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-09T20:38:55.898373] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-09T20:38:55.898415] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-09T20:38:55.898468] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-09T20:38:55.898509] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-09T20:38:56.001042] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-09T20:38:56.290566] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:38:56.796761] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-09T20:38:57.196201] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T20:38:57.596744] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-09T20:38:58.292467] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T20:38:58.396745] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-09T20:38:59.184660] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T20:38:59.196718] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-09T20:38:59.437014] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T20:38:59.996725] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-09T20:39:00.796754] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-09T20:39:01.150945] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T20:39:01.596766] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-09T20:39:01.772275] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T20:39:01.987790] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T20:39:02.396732] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-09T20:39:02.474534] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T20:39:03.196797] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-09T20:39:03.996770] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-09T20:39:04.353599] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-09T20:39:04.796701] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-09T20:39:04.868990] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T20:39:05.241664] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T20:39:05.316775] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T20:39:05.596749] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-09T20:39:06.396748] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-09T20:39:07.196755] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-09T20:39:07.243550] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T20:39:07.488437] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T20:39:07.996747] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-09T20:39:08.119375] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:39:08.796750] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-09T20:39:09.091556] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T20:39:09.312558] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T20:39:09.316440] [INFO ] [REMOTE ] NWG: Full fetch complete (73227 records). [2025-10-09T20:39:09.316547] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-09T20:39:09.317350] [FATAL] [VALIDATOR ] NWG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:39:09.317444] [FATAL] [MAIN ] NWG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:39:09.317488] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:39:09.317526] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-09T20:39:09.317583] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-09T20:39:09.317617] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-09T20:39:09.317689] [DEBUG] [LOCAL ] NWG: No derivative data file found to delete. [2025-10-09T20:39:09.317799] [INFO ] [MAIN ] Update Progress: 1556/2373 symbols completed. NWG took 40.1s. Estimated remaining: 1h 55m 2s. Rate: 7.1 symbols/min [2025-10-09T20:39:09.486559] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:39:09.494076] [DEBUG] [LOCAL ] NXC: Loaded 4129 existing records from primary storage. [2025-10-09T20:39:09.494279] [INFO ] [MAIN ] NXC: Loaded 4129 existing records. [2025-10-09T20:39:09.598303] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-09T20:39:09.677882] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:39:09.678073] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-09T20:39:09.678119] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-09T20:39:09.678411] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-09T20:39:09.678469] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-09T20:39:10.030522] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:39:10.396781] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-09T20:39:10.867387] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T20:39:11.196725] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-09T20:39:11.528567] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T20:39:11.996741] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-09T20:39:12.579885] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T20:39:12.796723] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-09T20:39:13.144206] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T20:39:13.263818] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T20:39:13.596741] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-09T20:39:14.396736] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-09T20:39:14.511996] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:39:15.129976] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T20:39:15.196680] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-09T20:39:15.963490] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T20:39:15.996680] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-09T20:39:16.770063] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T20:39:16.796685] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-09T20:39:17.453432] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T20:39:17.596771] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-09T20:39:17.972964] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T20:39:17.977266] [INFO ] [REMOTE ] NVT: Full fetch complete (74177 records). [2025-10-09T20:39:17.977401] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-09T20:39:17.978503] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:39:17.978598] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:39:17.978667] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:39:17.978737] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-09T20:39:17.978808] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-09T20:39:17.978844] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-09T20:39:17.978903] [DEBUG] [LOCAL ] NVT: No derivative data file found to delete. [2025-10-09T20:39:17.978994] [INFO ] [MAIN ] Update Progress: 1557/2373 symbols completed. NVT took 52.6s. Estimated remaining: 1h 54m 54s. Rate: 7.1 symbols/min [2025-10-09T20:39:18.396770] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-09T20:39:19.196772] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-09T20:39:19.959841] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T20:39:19.972392] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T20:39:19.975671] [INFO ] [REMOTE ] NWN: Full fetch complete (37147 records). [2025-10-09T20:39:19.975762] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-09T20:39:19.976319] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:39:19.976405] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:39:19.976449] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:39:19.976487] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-09T20:39:19.976563] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-09T20:39:19.976598] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-09T20:39:19.976637] [DEBUG] [LOCAL ] NWN: No derivative data file found to delete. [2025-10-09T20:39:19.976741] [INFO ] [MAIN ] Update Progress: 1558/2373 symbols completed. NWN took 28.8s. Estimated remaining: 1h 54m 42s. Rate: 7.1 symbols/min [2025-10-09T20:39:19.996681] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-09T20:39:20.796864] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-09T20:39:21.356053] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T20:39:21.402761] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-09T20:39:21.596751] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-09T20:39:22.222365] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T20:39:22.396725] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-09T20:39:23.017702] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T20:39:23.196757] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-09T20:39:23.996748] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-09T20:39:24.448260] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T20:39:24.560787] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T20:39:24.796716] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-09T20:39:25.211599] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T20:39:25.212461] [INFO ] [REMOTE ] NXC: Full fetch complete (5742 records). [2025-10-09T20:39:25.212534] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-09T20:39:25.213109] [FATAL] [VALIDATOR ] NXC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:39:25.213392] [FATAL] [MAIN ] NXC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:39:25.213466] [WARN ] [MAIN ] NXC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:39:25.213512] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-09T20:39:25.213580] [DEBUG] [LOCAL ] NXC: No primary data file found to delete. [2025-10-09T20:39:25.213634] [INFO ] [LOCAL ] NXC: Starting deletion of derivative data. [2025-10-09T20:39:25.213929] [DEBUG] [LOCAL ] NXC: Deleted derivative data file. [2025-10-09T20:39:25.214033] [INFO ] [MAIN ] Update Progress: 1559/2373 symbols completed. NXC took 15.9s. Estimated remaining: 1h 54m 32s. Rate: 7.1 symbols/min [2025-10-09T20:39:25.596780] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-09T20:39:26.206440] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T20:39:26.396729] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-09T20:39:26.919066] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T20:39:26.922005] [INFO ] [REMOTE ] NX: Full fetch complete (47829 records). [2025-10-09T20:39:26.922099] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-09T20:39:26.922834] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:39:26.922922] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:39:26.922966] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:39:26.923002] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-09T20:39:26.923073] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-09T20:39:26.923127] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-09T20:39:26.923169] [DEBUG] [LOCAL ] NX: No derivative data file found to delete. [2025-10-09T20:39:26.923234] [INFO ] [MAIN ] Update Progress: 1560/2373 symbols completed. NX took 31.2s. Estimated remaining: 1h 54m 20s. Rate: 7.1 symbols/min [2025-10-09T20:39:27.585024] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:39:27.668875] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:39:27.699431] [DEBUG] [LOCAL ] NXE: No existing data file found in primary storage. [2025-10-09T20:39:27.699702] [DEBUG] [LOCAL ] NXDT: No existing data file found in primary storage. [2025-10-09T20:39:27.695090] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:39:27.699306] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:39:27.699908] [WARN ] [MAIN ] NXE: No existing data found, performing full refresh instead. [2025-10-09T20:39:27.700335] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-09T20:39:27.700524] [DEBUG] [LOCAL ] NXG: No existing data file found in primary storage. [2025-10-09T20:39:27.700713] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-09T20:39:27.700431] [WARN ] [MAIN ] NXDT: No existing data found, performing full refresh instead. [2025-10-09T20:39:27.700612] [WARN ] [MAIN ] NXG: No existing data found, performing full refresh instead. [2025-10-09T20:39:27.701362] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-09T20:39:27.701514] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-09T20:39:27.701135] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-09T20:39:27.701741] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-09T20:39:27.701636] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-09T20:39:27.702009] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-09T20:39:27.702136] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-09T20:39:27.702212] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-09T20:39:27.707619] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-09T20:39:27.707807] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-09T20:39:27.702387] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-09T20:39:27.736683] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-09T20:39:27.736839] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-09T20:39:27.742173] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-09T20:39:27.747445] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-09T20:39:27.779583] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-09T20:39:28.868004] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:39:28.937387] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-09T20:39:29.131931] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:39:29.161272] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-09T20:39:29.211274] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:39:29.239427] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-09T20:39:29.278470] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:39:29.400044] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:39:29.400570] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-09T20:39:29.400700] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:39:29.400765] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-09T20:39:29.400828] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:39:29.400904] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-09T20:39:29.400977] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-09T20:39:29.401019] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-09T20:39:29.401058] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-09T20:39:29.401174] [INFO ] [MAIN ] Update Progress: 1561/2373 symbols completed. NXDR took 2.5s. Estimated remaining: 1h 54m 9s. Rate: 7.1 symbols/min [2025-10-09T20:39:29.591469] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:39:29.596766] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-09T20:39:29.616017] [DEBUG] [LOCAL ] NXJ: Loaded 15003 existing records from primary storage. [2025-10-09T20:39:29.616407] [INFO ] [MAIN ] NXJ: Loaded 15003 existing records. [2025-10-09T20:39:29.793756] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:39:29.794044] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-09T20:39:29.794104] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-09T20:39:29.794346] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-09T20:39:29.794404] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-09T20:39:30.144463] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:39:30.208446] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T20:39:30.396710] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-09T20:39:30.621241] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T20:39:30.737456] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T20:39:31.196687] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-09T20:39:31.512842] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T20:39:31.798724] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T20:39:31.996743] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-09T20:39:32.796695] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-09T20:39:33.150423] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T20:39:33.557493] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T20:39:33.596679] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-09T20:39:34.281956] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T20:39:34.396732] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-09T20:39:35.196715] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-09T20:39:36.011450] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-09T20:39:36.026866] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T20:39:36.047494] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T20:39:36.796726] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-09T20:39:36.988564] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T20:39:37.596737] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-09T20:39:38.403660] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-09T20:39:38.422353] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T20:39:38.464777] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T20:39:39.196718] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-09T20:39:39.715588] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T20:39:39.812162] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T20:39:39.996734] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-09T20:39:40.796685] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-09T20:39:40.926008] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T20:39:41.596687] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-09T20:39:41.727298] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T20:39:42.396673] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-09T20:39:42.494147] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T20:39:43.196725] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-09T20:39:43.996707] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-09T20:39:44.400270] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T20:39:44.441246] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T20:39:44.796705] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-09T20:39:44.984676] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T20:39:45.538850] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T20:39:45.596799] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-09T20:39:46.396784] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-09T20:39:46.530540] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T20:39:47.196758] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-09T20:39:47.217393] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T20:39:47.816759] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T20:39:47.996728] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-09T20:39:48.796752] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-09T20:39:49.036029] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T20:39:49.509091] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T20:39:49.596740] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-09T20:39:50.394680] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T20:39:50.398910] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-09T20:39:51.196776] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-09T20:39:51.997151] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-09T20:39:52.386562] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T20:39:52.427999] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T20:39:52.547414] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T20:39:52.549862] [INFO ] [REMOTE ] NXG: Full fetch complete (14355 records). [2025-10-09T20:39:52.550057] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-09T20:39:52.550582] [FATAL] [VALIDATOR ] NXG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:39:52.550721] [FATAL] [MAIN ] NXG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:39:52.550766] [WARN ] [MAIN ] NXG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:39:52.550805] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-09T20:39:52.550862] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-09T20:39:52.550898] [INFO ] [LOCAL ] NXG: Starting deletion of derivative data. [2025-10-09T20:39:52.550939] [DEBUG] [LOCAL ] NXG: No derivative data file found to delete. [2025-10-09T20:39:52.551047] [INFO ] [MAIN ] Update Progress: 1562/2373 symbols completed. NXG took 25.6s. Estimated remaining: 1h 54m 8s. Rate: 7.1 symbols/min [2025-10-09T20:39:52.716796] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:39:52.721755] [DEBUG] [LOCAL ] NXN: Loaded 2310 existing records from primary storage. [2025-10-09T20:39:52.721931] [INFO ] [MAIN ] NXN: Loaded 2310 existing records. [2025-10-09T20:39:52.801934] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-09T20:39:52.906115] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:39:52.906425] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-09T20:39:52.906484] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-09T20:39:52.907001] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-09T20:39:52.907060] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-09T20:39:53.255042] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:39:53.446591] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T20:39:53.596754] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-09T20:39:54.160741] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:39:54.162575] [INFO ] [REMOTE ] NXDT: Full fetch complete (24601 records). [2025-10-09T20:39:54.162680] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-09T20:39:54.163276] [FATAL] [VALIDATOR ] NXDT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:39:54.163365] [FATAL] [MAIN ] NXDT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:39:54.163411] [WARN ] [MAIN ] NXDT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:39:54.163487] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-09T20:39:54.163569] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-09T20:39:54.163614] [INFO ] [LOCAL ] NXDT: Starting deletion of derivative data. [2025-10-09T20:39:54.163687] [DEBUG] [LOCAL ] NXDT: No derivative data file found to delete. [2025-10-09T20:39:54.163768] [INFO ] [MAIN ] Update Progress: 1563/2373 symbols completed. NXDT took 27.2s. Estimated remaining: 1h 53m 56s. Rate: 7.1 symbols/min [2025-10-09T20:39:54.335730] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:39:54.349007] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-10-09T20:39:54.349189] [INFO ] [MAIN ] NXP: Loaded 12465 existing records. [2025-10-09T20:39:54.401975] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-09T20:39:54.524807] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:39:54.525027] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-09T20:39:54.525077] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-09T20:39:54.525335] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-09T20:39:54.525392] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-09T20:39:54.866687] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:39:55.196792] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-09T20:39:55.996718] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-09T20:39:56.096394] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T20:39:56.229335] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T20:39:56.796760] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-09T20:39:56.967569] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T20:39:57.596710] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-09T20:39:57.615096] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T20:39:58.396749] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-09T20:39:58.608089] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T20:39:58.990176] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T20:39:59.196753] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-09T20:39:59.800444] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T20:39:59.996749] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-09T20:40:00.796740] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-09T20:40:01.596755] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-09T20:40:01.838083] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T20:40:01.863512] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T20:40:02.160630] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T20:40:02.396756] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-09T20:40:02.881667] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T20:40:03.196752] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-09T20:40:03.996747] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-09T20:40:04.796701] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-09T20:40:04.898630] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T20:40:05.065152] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T20:40:05.190161] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T20:40:05.596718] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-09T20:40:06.396723] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-09T20:40:07.121342] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T20:40:07.196715] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-09T20:40:07.632597] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T20:40:07.840789] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T20:40:07.996734] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-09T20:40:08.796689] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-09T20:40:09.054197] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T20:40:09.235222] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T20:40:09.596758] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-09T20:40:09.963896] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T20:40:09.965616] [INFO ] [REMOTE ] NXJ: Full fetch complete (20643 records). [2025-10-09T20:40:09.965758] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-09T20:40:09.966374] [FATAL] [VALIDATOR ] NXJ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:40:09.966473] [FATAL] [MAIN ] NXJ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:40:09.966516] [WARN ] [MAIN ] NXJ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:40:09.966557] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-09T20:40:09.966623] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-09T20:40:09.966698] [INFO ] [LOCAL ] NXJ: Starting deletion of derivative data. [2025-10-09T20:40:09.966946] [DEBUG] [LOCAL ] NXJ: Deleted derivative data file. [2025-10-09T20:40:09.967094] [INFO ] [MAIN ] Update Progress: 1564/2373 symbols completed. NXJ took 40.6s. Estimated remaining: 1h 53m 51s. Rate: 7.1 symbols/min [2025-10-09T20:40:10.154694] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:40:10.154959] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-09T20:40:10.154999] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-09T20:40:10.155126] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-09T20:40:10.155170] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-09T20:40:10.155211] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-09T20:40:10.155246] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-09T20:40:10.404813] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-09T20:40:10.546866] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:40:10.994984] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T20:40:10.999188] [INFO ] [REMOTE ] NXE: Full fetch complete (76355 records). [2025-10-09T20:40:10.999390] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-09T20:40:11.000728] [FATAL] [VALIDATOR ] NXE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:40:11.000830] [FATAL] [MAIN ] NXE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:40:11.000875] [WARN ] [MAIN ] NXE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:40:11.000916] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-09T20:40:11.000977] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-09T20:40:11.001016] [INFO ] [LOCAL ] NXE: Starting deletion of derivative data. [2025-10-09T20:40:11.001056] [DEBUG] [LOCAL ] NXE: No derivative data file found to delete. [2025-10-09T20:40:11.001117] [INFO ] [MAIN ] Update Progress: 1565/2373 symbols completed. NXE took 44.1s. Estimated remaining: 1h 53m 39s. Rate: 7.1 symbols/min [2025-10-09T20:40:11.175025] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:40:11.175240] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-09T20:40:11.175276] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-09T20:40:11.175395] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-09T20:40:11.175435] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-09T20:40:11.175476] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-09T20:40:11.175507] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-09T20:40:11.204325] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-09T20:40:11.548001] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:40:11.996703] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-09T20:40:12.018347] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T20:40:12.536172] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T20:40:12.796800] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-09T20:40:13.596736] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-09T20:40:13.833488] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T20:40:14.396757] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-09T20:40:14.652191] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T20:40:15.196713] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-09T20:40:15.322048] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T20:40:15.976086] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T20:40:15.996680] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-09T20:40:16.796753] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-09T20:40:16.863832] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T20:40:17.240018] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-09T20:40:17.596796] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-09T20:40:18.208419] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T20:40:18.396805] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-09T20:40:18.990086] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T20:40:19.196771] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-09T20:40:19.996749] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-09T20:40:20.632074] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T20:40:20.650077] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T20:40:20.796708] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-09T20:40:21.596723] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-09T20:40:22.005113] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T20:40:22.070612] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T20:40:22.396783] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-09T20:40:23.030582] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T20:40:23.196730] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-09T20:40:23.996735] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-09T20:40:24.099439] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T20:40:24.578236] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T20:40:24.796727] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-09T20:40:25.596718] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-09T20:40:25.772494] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T20:40:26.363266] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T20:40:26.396733] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-09T20:40:27.196740] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-09T20:40:27.420445] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T20:40:27.850053] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T20:40:27.996754] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-09T20:40:28.388249] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T20:40:28.796788] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-09T20:40:29.446469] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T20:40:29.596735] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-09T20:40:29.819365] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-09T20:40:29.820142] [INFO ] [REMOTE ] NXN: Full fetch complete (3555 records). [2025-10-09T20:40:29.820240] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-09T20:40:29.820588] [FATAL] [VALIDATOR ] NXN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:40:29.820699] [FATAL] [MAIN ] NXN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:40:29.820747] [WARN ] [MAIN ] NXN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:40:29.820786] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-09T20:40:29.820853] [DEBUG] [LOCAL ] NXN: No primary data file found to delete. [2025-10-09T20:40:29.820890] [INFO ] [LOCAL ] NXN: Starting deletion of derivative data. [2025-10-09T20:40:29.821059] [DEBUG] [LOCAL ] NXN: Deleted derivative data file. [2025-10-09T20:40:29.821146] [INFO ] [MAIN ] Update Progress: 1566/2373 symbols completed. NXN took 37.3s. Estimated remaining: 1h 53m 36s. Rate: 7.1 symbols/min [2025-10-09T20:40:30.010924] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:40:30.011120] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-09T20:40:30.011164] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-09T20:40:30.011292] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-09T20:40:30.011344] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-09T20:40:30.011388] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-09T20:40:30.011421] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-09T20:40:30.385867] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:40:30.396665] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-09T20:40:31.196729] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-09T20:40:31.996779] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-09T20:40:32.154246] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T20:40:32.409155] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T20:40:32.474110] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-09T20:40:32.796765] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-09T20:40:33.188017] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T20:40:33.190069] [INFO ] [REMOTE ] NXP: Full fetch complete (16815 records). [2025-10-09T20:40:33.190155] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-09T20:40:33.190711] [FATAL] [VALIDATOR ] NXP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:40:33.190803] [FATAL] [MAIN ] NXP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:40:33.190879] [WARN ] [MAIN ] NXP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:40:33.190959] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-09T20:40:33.191031] [DEBUG] [LOCAL ] NXP: No primary data file found to delete. [2025-10-09T20:40:33.191083] [INFO ] [LOCAL ] NXP: Starting deletion of derivative data. [2025-10-09T20:40:33.191282] [DEBUG] [LOCAL ] NXP: Deleted derivative data file. [2025-10-09T20:40:33.191380] [INFO ] [MAIN ] Update Progress: 1567/2373 symbols completed. NXP took 39.0s. Estimated remaining: 1h 53m 25s. Rate: 7.1 symbols/min [2025-10-09T20:40:33.375433] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:40:33.413322] [DEBUG] [LOCAL ] NZF: Loaded 29053 existing records from primary storage. [2025-10-09T20:40:33.413674] [INFO ] [MAIN ] NZF: Loaded 29053 existing records. [2025-10-09T20:40:33.587252] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:40:33.587466] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-09T20:40:33.587513] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-09T20:40:33.588145] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-09T20:40:33.588204] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-09T20:40:33.601892] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-09T20:40:33.936959] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:40:34.396723] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-09T20:40:35.113035] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T20:40:35.196756] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-09T20:40:35.455318] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T20:40:35.957181] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T20:40:35.996731] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-09T20:40:36.435543] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:40:36.437549] [INFO ] [REMOTE ] NXRT: Full fetch complete (25537 records). [2025-10-09T20:40:36.437710] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-09T20:40:36.438371] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:40:36.438482] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:40:36.438554] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:40:36.438674] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-09T20:40:36.438771] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-09T20:40:36.438818] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-09T20:40:36.438862] [DEBUG] [LOCAL ] NXRT: No derivative data file found to delete. [2025-10-09T20:40:36.438921] [INFO ] [MAIN ] Update Progress: 1568/2373 symbols completed. NXRT took 26.5s. Estimated remaining: 1h 53m 14s. Rate: 7.1 symbols/min [2025-10-09T20:40:36.626303] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:40:36.626547] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-09T20:40:36.626588] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-09T20:40:36.626757] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-09T20:40:36.626804] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-09T20:40:36.626847] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-09T20:40:36.626890] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-09T20:40:36.814364] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-09T20:40:37.018815] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:40:37.596746] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-09T20:40:38.396759] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-09T20:40:38.610566] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T20:40:39.196726] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-09T20:40:39.412983] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T20:40:39.996790] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-09T20:40:40.433896] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-09T20:40:40.669494] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T20:40:40.796767] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-09T20:40:40.947204] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T20:40:41.596730] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-09T20:40:42.350539] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T20:40:42.396673] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-09T20:40:43.196780] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-09T20:40:43.551342] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T20:40:43.996899] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-09T20:40:44.162840] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T20:40:44.274010] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-09T20:40:44.796738] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-09T20:40:45.418842] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T20:40:45.596713] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-09T20:40:46.127285] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T20:40:46.396766] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-09T20:40:46.762115] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-09T20:40:47.196753] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-09T20:40:47.342431] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-09T20:40:47.766962] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T20:40:47.996725] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-09T20:40:48.796719] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-09T20:40:49.125674] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-09T20:40:49.126383] [INFO ] [REMOTE ] NYC: Full fetch complete (1886 records). [2025-10-09T20:40:49.126453] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-09T20:40:49.126909] [FATAL] [VALIDATOR ] NYC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:40:49.127010] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:40:49.127085] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:40:49.127175] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-09T20:40:49.127251] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-09T20:40:49.127290] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-09T20:40:49.127331] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-09T20:40:49.127387] [INFO ] [MAIN ] Update Progress: 1569/2373 symbols completed. NYC took 38.1s. Estimated remaining: 1h 53m 7s. Rate: 7.1 symbols/min [2025-10-09T20:40:49.300842] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:40:49.301031] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-09T20:40:49.301067] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-09T20:40:49.301191] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-09T20:40:49.301281] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-09T20:40:49.301346] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-09T20:40:49.301382] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-09T20:40:49.601943] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-09T20:40:49.674448] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:40:50.396772] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-09T20:40:50.732073] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-09T20:40:51.196685] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-09T20:40:51.391481] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T20:40:51.996781] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-09T20:40:52.405378] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T20:40:52.417088] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T20:40:52.796768] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-09T20:40:53.596758] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-09T20:40:54.396735] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-09T20:40:54.687614] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T20:40:54.762543] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T20:40:54.778436] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-09T20:40:55.196820] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-09T20:40:55.996694] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-09T20:40:56.253093] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T20:40:56.571320] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T20:40:56.796703] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-09T20:40:57.353231] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T20:40:57.596715] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-09T20:40:57.692132] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T20:40:58.396752] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-09T20:40:59.072336] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T20:40:59.196750] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-09T20:40:59.474150] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T20:40:59.996732] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-09T20:41:00.796741] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-09T20:41:01.596689] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-09T20:41:01.641896] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T20:41:01.955920] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-09T20:41:01.978937] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T20:41:01.983118] [INFO ] [REMOTE ] NYT: Full fetch complete (71704 records). [2025-10-09T20:41:01.983271] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-09T20:41:01.985351] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:41:01.985598] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:41:01.985740] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:41:01.985821] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-09T20:41:01.985894] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-09T20:41:01.985933] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-09T20:41:01.985975] [DEBUG] [LOCAL ] NYT: No derivative data file found to delete. [2025-10-09T20:41:01.986083] [INFO ] [MAIN ] Update Progress: 1570/2373 symbols completed. NYT took 32.2s. Estimated remaining: 1h 53m 1s. Rate: 7.1 symbols/min [2025-10-09T20:41:02.163490] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:41:02.163782] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-09T20:41:02.163834] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-09T20:41:02.163971] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-09T20:41:02.164019] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-09T20:41:02.164062] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-09T20:41:02.164095] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-09T20:41:02.371222] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T20:41:02.405351] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-09T20:41:02.579710] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:41:03.196780] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-09T20:41:03.996694] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-09T20:41:04.073483] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T20:41:04.796681] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-09T20:41:04.877750] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-09T20:41:05.120404] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T20:41:05.228563] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T20:41:05.231116] [INFO ] [REMOTE ] NZF: Full fetch complete (42706 records). [2025-10-09T20:41:05.231192] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-09T20:41:05.231753] [FATAL] [VALIDATOR ] NZF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:41:05.231835] [FATAL] [MAIN ] NZF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:41:05.231877] [WARN ] [MAIN ] NZF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:41:05.231941] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-09T20:41:05.232004] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-09T20:41:05.232039] [INFO ] [LOCAL ] NZF: Starting deletion of derivative data. [2025-10-09T20:41:05.232208] [DEBUG] [LOCAL ] NZF: Deleted derivative data file. [2025-10-09T20:41:05.232862] [INFO ] [MAIN ] Update Progress: 1571/2373 symbols completed. NZF took 32.0s. Estimated remaining: 1h 52m 50s. Rate: 7.1 symbols/min [2025-10-09T20:41:05.402797] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:41:05.402980] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-09T20:41:05.403036] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-09T20:41:05.403147] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-09T20:41:05.403229] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-09T20:41:05.403294] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-09T20:41:05.403338] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-09T20:41:05.601875] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-09T20:41:05.757885] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:41:06.396769] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-09T20:41:06.618049] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T20:41:07.196785] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-09T20:41:07.996693] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-09T20:41:08.028929] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T20:41:08.796827] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-09T20:41:08.896891] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T20:41:09.596693] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-09T20:41:09.944181] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-09T20:41:10.329038] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T20:41:10.396679] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-09T20:41:10.578824] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T20:41:11.196771] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-09T20:41:11.996794] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-09T20:41:12.593375] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T20:41:12.796692] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-09T20:41:13.099730] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-09T20:41:13.219745] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T20:41:13.596792] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-09T20:41:14.396746] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-09T20:41:14.420538] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T20:41:15.182817] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T20:41:15.196669] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-09T20:41:15.257521] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T20:41:15.936366] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T20:41:15.940435] [INFO ] [REMOTE ] O: Full fetch complete (77169 records). [2025-10-09T20:41:15.940553] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-09T20:41:15.941353] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:41:15.941443] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:41:15.941486] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:41:15.941550] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-09T20:41:15.941666] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-09T20:41:15.941726] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-09T20:41:15.941772] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-09T20:41:15.941843] [INFO ] [MAIN ] Update Progress: 1572/2373 symbols completed. O took 39.5s. Estimated remaining: 1h 52m 43s. Rate: 7.1 symbols/min [2025-10-09T20:41:16.003468] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-09T20:41:16.116814] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:41:16.116987] [DEBUG] [LOCAL ] OCFT: No existing data file found in primary storage. [2025-10-09T20:41:16.117024] [WARN ] [MAIN ] OCFT: No existing data found, performing full refresh instead. [2025-10-09T20:41:16.117138] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-09T20:41:16.117180] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-09T20:41:16.117221] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-09T20:41:16.117254] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-09T20:41:16.486905] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:41:16.796747] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-09T20:41:17.596691] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-09T20:41:17.722705] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T20:41:17.904598] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T20:41:18.074903] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T20:41:18.396805] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-09T20:41:18.951960] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T20:41:19.196736] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-09T20:41:19.996703] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-09T20:41:20.315624] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T20:41:20.796756] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-09T20:41:21.596761] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-09T20:41:21.681041] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T20:41:22.006569] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T20:41:22.396755] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-09T20:41:22.415418] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T20:41:23.196731] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-09T20:41:23.996990] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-09T20:41:24.258862] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T20:41:24.372346] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T20:41:24.796737] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-09T20:41:25.113987] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T20:41:25.596715] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-09T20:41:26.400135] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-09T20:41:26.403756] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T20:41:26.649749] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T20:41:27.165221] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T20:41:27.196694] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-09T20:41:27.924796] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T20:41:27.996691] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-09T20:41:28.662053] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T20:41:28.663689] [INFO ] [REMOTE ] OBK: Full fetch complete (23610 records). [2025-10-09T20:41:28.663760] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-09T20:41:28.664265] [FATAL] [VALIDATOR ] OBK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:41:28.664351] [FATAL] [MAIN ] OBK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:41:28.664393] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:41:28.664431] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-09T20:41:28.664500] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-09T20:41:28.664555] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-09T20:41:28.664596] [DEBUG] [LOCAL ] OBK: No derivative data file found to delete. [2025-10-09T20:41:28.664681] [INFO ] [MAIN ] Update Progress: 1573/2373 symbols completed. OBK took 26.7s. Estimated remaining: 1h 52m 37s. Rate: 7.1 symbols/min [2025-10-09T20:41:28.802995] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-09T20:41:28.835497] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:41:28.835617] [DEBUG] [LOCAL ] ODC: No existing data file found in primary storage. [2025-10-09T20:41:28.835680] [WARN ] [MAIN ] ODC: No existing data found, performing full refresh instead. [2025-10-09T20:41:28.835791] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-09T20:41:28.835832] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-09T20:41:28.835872] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-09T20:41:28.835907] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-09T20:41:29.186628] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:41:29.596755] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-09T20:41:30.396689] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-09T20:41:30.433690] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T20:41:30.562506] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T20:41:31.079666] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T20:41:31.196706] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-09T20:41:31.898183] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:41:31.996729] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-09T20:41:32.723939] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T20:41:32.796741] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-09T20:41:33.465801] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T20:41:33.596739] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-09T20:41:34.280255] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T20:41:34.396740] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-09T20:41:35.196756] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-09T20:41:35.517599] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T20:41:35.996683] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-09T20:41:36.246482] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T20:41:36.796731] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-09T20:41:37.509667] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T20:41:37.514183] [INFO ] [REMOTE ] OBDC: Full fetch complete (74694 records). [2025-10-09T20:41:37.514312] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-09T20:41:37.515150] [FATAL] [VALIDATOR ] OBDC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:41:37.515240] [FATAL] [MAIN ] OBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:41:37.515283] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:41:37.515351] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-09T20:41:37.515416] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-09T20:41:37.515452] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-09T20:41:37.515490] [DEBUG] [LOCAL ] OBDC: No derivative data file found to delete. [2025-10-09T20:41:37.515550] [INFO ] [MAIN ] Update Progress: 1574/2373 symbols completed. OBDC took 48.4s. Estimated remaining: 1h 52m 28s. Rate: 7.1 symbols/min [2025-10-09T20:41:37.602135] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-09T20:41:37.689849] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:41:37.690129] [DEBUG] [LOCAL ] ODV: No existing data file found in primary storage. [2025-10-09T20:41:37.690252] [WARN ] [MAIN ] ODV: No existing data found, performing full refresh instead. [2025-10-09T20:41:37.690389] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-09T20:41:37.690456] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-09T20:41:37.690595] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-09T20:41:37.690732] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-09T20:41:37.987686] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-09T20:41:38.100768] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:41:38.377291] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T20:41:38.396734] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-09T20:41:39.196689] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-09T20:41:39.420452] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T20:41:39.996747] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-09T20:41:40.557852] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T20:41:40.796741] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-09T20:41:41.000245] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T20:41:41.527015] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T20:41:41.596736] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-09T20:41:42.338409] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T20:41:42.396693] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-09T20:41:43.053629] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T20:41:43.196720] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-09T20:41:43.909445] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T20:41:43.996790] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-09T20:41:44.796780] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-09T20:41:44.971571] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T20:41:45.596832] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-09T20:41:46.137789] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T20:41:46.396688] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-09T20:41:46.486150] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T20:41:46.768123] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T20:41:46.768955] [INFO ] [REMOTE ] OCFT: Full fetch complete (11619 records). [2025-10-09T20:41:46.769025] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-09T20:41:46.769533] [FATAL] [VALIDATOR ] OCFT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:41:46.769615] [FATAL] [MAIN ] OCFT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:41:46.769694] [WARN ] [MAIN ] OCFT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:41:46.769766] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-09T20:41:46.769837] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-09T20:41:46.769872] [INFO ] [LOCAL ] OCFT: Starting deletion of derivative data. [2025-10-09T20:41:46.769912] [DEBUG] [LOCAL ] OCFT: No derivative data file found to delete. [2025-10-09T20:41:46.769964] [INFO ] [MAIN ] Update Progress: 1575/2373 symbols completed. OCFT took 30.8s. Estimated remaining: 1h 52m 20s. Rate: 7.1 symbols/min [2025-10-09T20:41:46.934540] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:41:46.934771] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-09T20:41:46.934815] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-09T20:41:46.934925] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-09T20:41:46.934966] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-09T20:41:46.935006] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-09T20:41:46.935038] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-09T20:41:47.205789] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-09T20:41:47.294827] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:41:47.823376] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T20:41:47.996756] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-09T20:41:48.796694] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-09T20:41:49.026542] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T20:41:49.140795] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T20:41:49.596720] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-09T20:41:50.363567] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T20:41:50.396693] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-09T20:41:50.753758] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T20:41:50.757409] [INFO ] [REMOTE ] OC: Full fetch complete (63836 records). [2025-10-09T20:41:50.757517] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-09T20:41:50.758273] [FATAL] [VALIDATOR ] OC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:41:50.758365] [FATAL] [MAIN ] OC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:41:50.758407] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:41:50.758505] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-09T20:41:50.758582] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-09T20:41:50.758619] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-09T20:41:50.758693] [DEBUG] [LOCAL ] OC: No derivative data file found to delete. [2025-10-09T20:41:50.758768] [INFO ] [MAIN ] Update Progress: 1576/2373 symbols completed. OC took 45.5s. Estimated remaining: 1h 52m 10s. Rate: 7.1 symbols/min [2025-10-09T20:41:50.926933] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:41:50.927139] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-09T20:41:50.927175] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-09T20:41:50.927289] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-09T20:41:50.927330] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-09T20:41:50.927370] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-09T20:41:50.927404] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-09T20:41:51.201926] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-09T20:41:51.285597] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:41:51.996713] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-09T20:41:52.214499] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T20:41:52.796687] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-09T20:41:52.823457] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T20:41:53.200075] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T20:41:53.201415] [INFO ] [REMOTE ] ODC: Full fetch complete (10857 records). [2025-10-09T20:41:53.201529] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-09T20:41:53.202179] [FATAL] [VALIDATOR ] ODC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:41:53.202263] [FATAL] [MAIN ] ODC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:41:53.202306] [WARN ] [MAIN ] ODC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:41:53.202372] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-09T20:41:53.202457] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-09T20:41:53.202514] [INFO ] [LOCAL ] ODC: Starting deletion of derivative data. [2025-10-09T20:41:53.202559] [DEBUG] [LOCAL ] ODC: No derivative data file found to delete. [2025-10-09T20:41:53.202625] [INFO ] [MAIN ] Update Progress: 1577/2373 symbols completed. ODC took 24.5s. Estimated remaining: 1h 51m 58s. Rate: 7.1 symbols/min [2025-10-09T20:41:53.372838] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:41:53.373047] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-09T20:41:53.373083] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-09T20:41:53.373196] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-09T20:41:53.373236] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-09T20:41:53.373277] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-09T20:41:53.373353] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-09T20:41:53.606763] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-09T20:41:53.725314] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:41:54.396737] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-09T20:41:54.579118] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:41:55.074038] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T20:41:55.196686] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-09T20:41:55.996750] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-09T20:41:56.164473] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T20:41:56.796733] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-09T20:41:57.394474] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T20:41:57.596701] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-09T20:41:57.914256] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T20:41:58.396778] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-09T20:41:58.884069] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T20:41:59.196715] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-09T20:41:59.748075] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T20:41:59.996763] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-09T20:42:00.570095] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T20:42:00.796784] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-09T20:42:01.469544] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T20:42:01.596683] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-09T20:42:01.686624] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T20:42:02.396727] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-09T20:42:03.166986] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T20:42:03.196750] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-09T20:42:03.441313] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T20:42:03.996694] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-09T20:42:04.726278] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T20:42:04.796668] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-09T20:42:05.602166] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-09T20:42:05.616782] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T20:42:06.249676] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:42:06.253068] [INFO ] [REMOTE ] ODV: Full fetch complete (33714 records). [2025-10-09T20:42:06.253170] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-09T20:42:06.253769] [FATAL] [VALIDATOR ] ODV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:42:06.253870] [FATAL] [MAIN ] ODV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:42:06.253920] [WARN ] [MAIN ] ODV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:42:06.254003] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-09T20:42:06.254099] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-09T20:42:06.254165] [INFO ] [LOCAL ] ODV: Starting deletion of derivative data. [2025-10-09T20:42:06.254229] [DEBUG] [LOCAL ] ODV: No derivative data file found to delete. [2025-10-09T20:42:06.254304] [INFO ] [MAIN ] Update Progress: 1578/2373 symbols completed. ODV took 28.7s. Estimated remaining: 1h 51m 52s. Rate: 7.1 symbols/min [2025-10-09T20:42:06.399155] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-09T20:42:06.436361] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:42:06.436679] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-09T20:42:06.436747] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-09T20:42:06.437065] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-09T20:42:06.437136] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-09T20:42:06.437316] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-09T20:42:06.437383] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-09T20:42:06.709739] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T20:42:06.839234] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:42:07.196694] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-09T20:42:07.563510] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T20:42:07.996702] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-09T20:42:08.796729] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-09T20:42:09.181993] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T20:42:09.367437] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T20:42:09.596731] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-09T20:42:10.003110] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T20:42:10.396738] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-09T20:42:11.196754] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-09T20:42:11.298289] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T20:42:11.444500] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T20:42:11.996728] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-09T20:42:12.796719] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-09T20:42:13.146880] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-09T20:42:13.596750] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-09T20:42:13.791045] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T20:42:14.252860] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T20:42:14.396769] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-09T20:42:15.081548] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T20:42:15.196692] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-09T20:42:15.509273] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T20:42:15.996775] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-09T20:42:16.249380] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T20:42:16.796782] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-09T20:42:17.533252] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T20:42:17.596741] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-09T20:42:18.286494] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T20:42:18.384844] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T20:42:18.396683] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-09T20:42:19.196734] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-09T20:42:19.368809] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T20:42:19.996732] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-09T20:42:20.497556] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T20:42:20.796721] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-09T20:42:20.837832] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T20:42:21.596721] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-09T20:42:22.248321] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T20:42:22.396724] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-09T20:42:22.827791] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T20:42:23.196736] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-09T20:42:23.301475] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T20:42:23.572440] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-09T20:42:23.996779] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-09T20:42:24.796752] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-09T20:42:24.914432] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:42:25.352894] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:42:25.355665] [INFO ] [REMOTE ] OEC: Full fetch complete (52495 records). [2025-10-09T20:42:25.355759] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-09T20:42:25.356503] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:42:25.356604] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:42:25.356684] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:42:25.356780] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-09T20:42:25.356872] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-09T20:42:25.356929] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-09T20:42:25.356974] [DEBUG] [LOCAL ] OEC: No derivative data file found to delete. [2025-10-09T20:42:25.357040] [INFO ] [MAIN ] Update Progress: 1579/2373 symbols completed. OEC took 38.6s. Estimated remaining: 1h 51m 49s. Rate: 7.1 symbols/min [2025-10-09T20:42:25.526286] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:42:25.526507] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-09T20:42:25.526563] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-09T20:42:25.526698] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-09T20:42:25.526750] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-09T20:42:25.526794] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-09T20:42:25.526826] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-09T20:42:25.601806] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-09T20:42:25.877230] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:42:26.396715] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-09T20:42:27.196686] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-09T20:42:27.517419] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-09T20:42:27.519572] [INFO ] [REMOTE ] OFG: Full fetch complete (33874 records). [2025-10-09T20:42:27.519683] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-09T20:42:27.520291] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:42:27.520401] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:42:27.520476] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:42:27.520550] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-09T20:42:27.520616] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-09T20:42:27.520696] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-09T20:42:27.520761] [DEBUG] [LOCAL ] OFG: No derivative data file found to delete. [2025-10-09T20:42:27.520822] [INFO ] [MAIN ] Update Progress: 1580/2373 symbols completed. OFG took 36.8s. Estimated remaining: 1h 51m 37s. Rate: 7.1 symbols/min [2025-10-09T20:42:27.711616] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:42:27.712202] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-09T20:42:27.712490] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-09T20:42:27.712825] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-09T20:42:27.713021] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-09T20:42:27.713145] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-09T20:42:27.713257] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-09T20:42:27.865756] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T20:42:27.880351] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T20:42:28.001877] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-09T20:42:28.147662] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:42:28.796732] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-09T20:42:29.370843] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T20:42:29.596742] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-09T20:42:30.039368] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:42:30.043041] [INFO ] [REMOTE ] OGE: Full fetch complete (66424 records). [2025-10-09T20:42:30.043134] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-09T20:42:30.044813] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:42:30.044901] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:42:30.044944] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:42:30.045008] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-09T20:42:30.045072] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-09T20:42:30.045109] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-09T20:42:30.045148] [DEBUG] [LOCAL ] OGE: No derivative data file found to delete. [2025-10-09T20:42:30.045204] [INFO ] [MAIN ] Update Progress: 1581/2373 symbols completed. OGE took 36.8s. Estimated remaining: 1h 51m 26s. Rate: 7.1 symbols/min [2025-10-09T20:42:30.214100] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:42:30.214255] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-09T20:42:30.214342] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-09T20:42:30.214459] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-09T20:42:30.214500] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-09T20:42:30.214540] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-09T20:42:30.214572] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-09T20:42:30.402886] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-09T20:42:30.581302] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:42:30.628463] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T20:42:31.196693] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-09T20:42:31.546724] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T20:42:31.996784] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-09T20:42:32.620049] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T20:42:32.796733] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-09T20:42:33.586291] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T20:42:33.596873] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-09T20:42:34.121120] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T20:42:34.396708] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-09T20:42:34.989985] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T20:42:35.196789] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-09T20:42:35.996721] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-09T20:42:36.053510] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T20:42:36.796784] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-09T20:42:36.852688] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T20:42:37.596733] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-09T20:42:37.766797] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T20:42:38.402166] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-09T20:42:38.416015] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T20:42:38.727487] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T20:42:39.196789] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-09T20:42:39.974760] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T20:42:39.996671] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-09T20:42:40.280375] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T20:42:40.790012] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T20:42:40.794013] [INFO ] [REMOTE ] OGN: Full fetch complete (76404 records). [2025-10-09T20:42:40.794149] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-09T20:42:40.795050] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:42:40.795164] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:42:40.795208] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:42:40.795247] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-09T20:42:40.795351] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-09T20:42:40.795410] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-09T20:42:40.795452] [DEBUG] [LOCAL ] OGN: No derivative data file found to delete. [2025-10-09T20:42:40.795515] [INFO ] [MAIN ] Update Progress: 1582/2373 symbols completed. OGN took 34.5s. Estimated remaining: 1h 51m 19s. Rate: 7.1 symbols/min [2025-10-09T20:42:40.801831] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-09T20:42:40.971408] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:42:40.988383] [DEBUG] [LOCAL ] OIA: Loaded 13570 existing records from primary storage. [2025-10-09T20:42:40.988619] [INFO ] [MAIN ] OIA: Loaded 13570 existing records. [2025-10-09T20:42:41.169527] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:42:41.169761] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-09T20:42:41.169818] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-09T20:42:41.170885] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-09T20:42:41.170946] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-09T20:42:41.576789] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:42:41.596695] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-09T20:42:42.396714] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-09T20:42:42.428770] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T20:42:42.851880] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T20:42:43.196782] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-09T20:42:43.592546] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T20:42:43.996791] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-09T20:42:44.116346] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T20:42:44.796806] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-09T20:42:45.505707] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T20:42:45.596681] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-09T20:42:45.808435] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T20:42:46.396701] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-09T20:42:47.025333] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T20:42:47.196719] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-09T20:42:47.237822] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T20:42:47.996734] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-09T20:42:48.420739] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T20:42:48.796717] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-09T20:42:49.325818] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T20:42:49.596711] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-09T20:42:50.359001] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T20:42:50.396669] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-09T20:42:50.931923] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T20:42:51.196743] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-09T20:42:51.982487] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T20:42:51.996685] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-09T20:42:52.796715] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-09T20:42:52.992204] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T20:42:53.342588] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T20:42:53.422883] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T20:42:53.596730] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-09T20:42:54.396780] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-09T20:42:54.839095] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:42:54.841600] [INFO ] [REMOTE ] OGS: Full fetch complete (47643 records). [2025-10-09T20:42:54.841726] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-09T20:42:54.842283] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:42:54.842370] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:42:54.842412] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:42:54.842483] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-09T20:42:54.842546] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-09T20:42:54.842581] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-09T20:42:54.842621] [DEBUG] [LOCAL ] OGS: No derivative data file found to delete. [2025-10-09T20:42:54.842731] [INFO ] [MAIN ] Update Progress: 1583/2373 symbols completed. OGS took 29.5s. Estimated remaining: 1h 51m 13s. Rate: 7.1 symbols/min [2025-10-09T20:42:55.017793] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:42:55.018812] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-09T20:42:55.018866] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-09T20:42:55.019065] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-09T20:42:55.019118] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-09T20:42:55.019160] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-09T20:42:55.019193] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-09T20:42:55.207227] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-09T20:42:55.378146] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:42:55.682469] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T20:42:55.996691] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-09T20:42:56.370159] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T20:42:56.796714] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-09T20:42:57.432065] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T20:42:57.596730] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-09T20:42:57.922765] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T20:42:58.396717] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-09T20:42:58.567568] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T20:42:59.196738] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-09T20:42:59.873074] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T20:42:59.996724] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-09T20:43:00.724849] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T20:43:00.796679] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-09T20:43:01.554222] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T20:43:01.596680] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-09T20:43:02.336991] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T20:43:02.396674] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-09T20:43:02.508890] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T20:43:03.196721] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-09T20:43:03.886083] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T20:43:03.996755] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-09T20:43:04.154901] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T20:43:04.796684] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-09T20:43:05.041043] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T20:43:05.596757] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-09T20:43:06.249521] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T20:43:06.340056] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T20:43:06.396763] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-09T20:43:07.164031] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T20:43:07.196737] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-09T20:43:07.621231] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T20:43:07.625121] [INFO ] [REMOTE ] OHI: Full fetch complete (74751 records). [2025-10-09T20:43:07.625245] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-09T20:43:07.626082] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:43:07.626192] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:43:07.626263] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:43:07.626360] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-09T20:43:07.626438] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-09T20:43:07.626481] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-09T20:43:07.626522] [DEBUG] [LOCAL ] OHI: No derivative data file found to delete. [2025-10-09T20:43:07.626581] [INFO ] [MAIN ] Update Progress: 1584/2373 symbols completed. OHI took 40.1s. Estimated remaining: 1h 51m 7s. Rate: 7.1 symbols/min [2025-10-09T20:43:07.797581] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:43:07.797842] [DEBUG] [LOCAL ] OIS: No existing data file found in primary storage. [2025-10-09T20:43:07.797892] [WARN ] [MAIN ] OIS: No existing data found, performing full refresh instead. [2025-10-09T20:43:07.798004] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-09T20:43:07.798046] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-09T20:43:07.798088] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-09T20:43:07.798121] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-09T20:43:08.001902] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-09T20:43:08.155776] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:43:08.593059] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T20:43:08.796767] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-09T20:43:09.176960] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T20:43:09.178263] [INFO ] [REMOTE ] OIA: Full fetch complete (20721 records). [2025-10-09T20:43:09.178334] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-09T20:43:09.178811] [FATAL] [VALIDATOR ] OIA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:43:09.178896] [FATAL] [MAIN ] OIA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:43:09.178940] [WARN ] [MAIN ] OIA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:43:09.179010] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-09T20:43:09.179074] [DEBUG] [LOCAL ] OIA: No primary data file found to delete. [2025-10-09T20:43:09.179112] [INFO ] [LOCAL ] OIA: Starting deletion of derivative data. [2025-10-09T20:43:09.179487] [DEBUG] [LOCAL ] OIA: Deleted derivative data file. [2025-10-09T20:43:09.179583] [INFO ] [MAIN ] Update Progress: 1585/2373 symbols completed. OIA took 28.4s. Estimated remaining: 1h 50m 55s. Rate: 7.1 symbols/min [2025-10-09T20:43:09.352160] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:43:09.352376] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-09T20:43:09.352412] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-09T20:43:09.352532] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-09T20:43:09.352573] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-09T20:43:09.352614] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-09T20:43:09.352670] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-09T20:43:09.601852] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-09T20:43:09.718516] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:43:10.396739] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-09T20:43:11.152351] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T20:43:11.196671] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-09T20:43:11.781174] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T20:43:11.996707] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-09T20:43:12.467812] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T20:43:12.796793] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-09T20:43:13.545338] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T20:43:13.549328] [INFO ] [REMOTE ] OI: Full fetch complete (67777 records). [2025-10-09T20:43:13.549440] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-09T20:43:13.550313] [FATAL] [VALIDATOR ] OI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:43:13.550408] [FATAL] [MAIN ] OI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:43:13.550452] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:43:13.550522] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-09T20:43:13.550587] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-09T20:43:13.550622] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-09T20:43:13.550738] [DEBUG] [LOCAL ] OI: No derivative data file found to delete. [2025-10-09T20:43:13.550815] [INFO ] [MAIN ] Update Progress: 1586/2373 symbols completed. OI took 43.5s. Estimated remaining: 1h 50m 44s. Rate: 7.1 symbols/min [2025-10-09T20:43:13.607111] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-09T20:43:13.729897] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:43:13.730208] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-09T20:43:13.730270] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-09T20:43:13.730474] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-09T20:43:13.730613] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-09T20:43:13.730754] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-09T20:43:13.730871] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-09T20:43:14.045534] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-09T20:43:14.126892] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:43:14.396720] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-09T20:43:15.175315] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T20:43:15.196662] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-09T20:43:15.996761] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-09T20:43:16.039191] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T20:43:16.322164] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T20:43:16.796726] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-09T20:43:17.495613] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T20:43:17.596683] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-09T20:43:18.396769] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-09T20:43:18.629248] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T20:43:19.196756] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-09T20:43:19.996707] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-09T20:43:20.049321] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T20:43:20.105160] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-09T20:43:20.333873] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T20:43:20.796723] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-09T20:43:21.559815] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T20:43:21.596739] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-09T20:43:22.187465] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T20:43:22.396748] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-09T20:43:23.196704] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-09T20:43:23.666017] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T20:43:23.714500] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T20:43:23.996737] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-09T20:43:24.796748] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-09T20:43:25.596733] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-09T20:43:25.650153] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-09T20:43:25.864824] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T20:43:26.062621] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-09T20:43:26.396794] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-09T20:43:27.196764] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-09T20:43:27.264467] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T20:43:27.945491] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T20:43:27.996687] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-09T20:43:28.796718] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-09T20:43:29.543874] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T20:43:29.605243] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-09T20:43:29.630715] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T20:43:29.670900] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-09T20:43:30.396766] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-09T20:43:31.197747] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-09T20:43:31.204449] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T20:43:31.825036] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T20:43:31.829516] [INFO ] [REMOTE ] OII: Full fetch complete (61499 records). [2025-10-09T20:43:31.829733] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-09T20:43:31.830607] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:43:31.830747] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:43:31.830792] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:43:31.830877] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-09T20:43:31.830983] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-09T20:43:31.831061] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-09T20:43:31.831126] [DEBUG] [LOCAL ] OII: No derivative data file found to delete. [2025-10-09T20:43:31.831192] [INFO ] [MAIN ] Update Progress: 1587/2373 symbols completed. OII took 37.0s. Estimated remaining: 1h 50m 41s. Rate: 7.1 symbols/min [2025-10-09T20:43:32.009801] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:43:32.006470] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-09T20:43:32.010041] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-09T20:43:32.010927] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-09T20:43:32.011114] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-09T20:43:32.011250] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-09T20:43:32.011312] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-09T20:43:32.031747] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-09T20:43:32.099983] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T20:43:32.399089] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:43:32.796773] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-09T20:43:33.571100] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T20:43:33.596678] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-09T20:43:34.345957] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T20:43:34.349962] [INFO ] [REMOTE ] OKE: Full fetch complete (77106 records). [2025-10-09T20:43:34.350075] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-09T20:43:34.350946] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:43:34.351034] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:43:34.351076] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:43:34.351117] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-09T20:43:34.351173] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-09T20:43:34.351208] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-09T20:43:34.351248] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-09T20:43:34.351305] [INFO ] [MAIN ] Update Progress: 1588/2373 symbols completed. OKE took 25.2s. Estimated remaining: 1h 50m 29s. Rate: 7.1 symbols/min [2025-10-09T20:43:34.403604] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-09T20:43:34.524593] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:43:34.524776] [DEBUG] [LOCAL ] OLP: No existing data file found in primary storage. [2025-10-09T20:43:34.524819] [WARN ] [MAIN ] OLP: No existing data found, performing full refresh instead. [2025-10-09T20:43:34.524925] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-09T20:43:34.524967] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-09T20:43:34.525007] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-09T20:43:34.525039] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-09T20:43:34.886982] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:43:34.916884] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-09T20:43:35.196750] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-09T20:43:36.006695] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-09T20:43:36.012451] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T20:43:36.796774] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-09T20:43:37.147294] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T20:43:37.596759] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-09T20:43:37.688826] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-09T20:43:38.218532] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T20:43:38.396692] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-09T20:43:39.163246] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T20:43:39.196670] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-09T20:43:39.996722] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-09T20:43:40.339346] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T20:43:40.443580] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T20:43:40.665459] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T20:43:40.796697] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-09T20:43:41.570608] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T20:43:41.596669] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-09T20:43:42.218617] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T20:43:42.396710] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-09T20:43:43.196698] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-09T20:43:43.268221] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T20:43:43.996767] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-09T20:43:44.796755] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-09T20:43:45.598794] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-09T20:43:45.604538] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-09T20:43:45.688692] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T20:43:45.705346] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T20:43:46.209281] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T20:43:46.212153] [INFO ] [REMOTE ] OIS: Full fetch complete (56753 records). [2025-10-09T20:43:46.212239] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-09T20:43:46.212936] [FATAL] [VALIDATOR ] OIS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:43:46.213019] [FATAL] [MAIN ] OIS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:43:46.213080] [WARN ] [MAIN ] OIS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:43:46.213167] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-09T20:43:46.213245] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-09T20:43:46.213323] [INFO ] [LOCAL ] OIS: Starting deletion of derivative data. [2025-10-09T20:43:46.213405] [DEBUG] [LOCAL ] OIS: No derivative data file found to delete. [2025-10-09T20:43:46.213481] [INFO ] [MAIN ] Update Progress: 1589/2373 symbols completed. OIS took 38.6s. Estimated remaining: 1h 50m 23s. Rate: 7.1 symbols/min [2025-10-09T20:43:46.380771] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:43:46.380984] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-09T20:43:46.381052] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-09T20:43:46.381180] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-09T20:43:46.381253] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-09T20:43:46.381344] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-09T20:43:46.381418] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-09T20:43:46.403845] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-09T20:43:46.748447] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:43:47.100637] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T20:43:47.196745] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-09T20:43:47.745558] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T20:43:47.996739] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-09T20:43:48.796699] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-09T20:43:48.889189] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-09T20:43:49.596726] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-09T20:43:50.396848] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-09T20:43:50.651789] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T20:43:51.080482] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T20:43:51.196700] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-09T20:43:51.430468] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T20:43:51.687908] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T20:43:51.996750] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-09T20:43:52.796694] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-09T20:43:53.513880] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T20:43:53.596682] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-09T20:43:54.396749] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-09T20:43:54.717908] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-09T20:43:54.908851] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T20:43:54.910326] [INFO ] [REMOTE ] OLP: Full fetch complete (14082 records). [2025-10-09T20:43:54.910394] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-09T20:43:54.910807] [FATAL] [VALIDATOR ] OLP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:43:54.910893] [FATAL] [MAIN ] OLP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:43:54.910935] [WARN ] [MAIN ] OLP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:43:54.910973] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-09T20:43:54.911028] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-09T20:43:54.911062] [INFO ] [LOCAL ] OLP: Starting deletion of derivative data. [2025-10-09T20:43:54.911101] [DEBUG] [LOCAL ] OLP: No derivative data file found to delete. [2025-10-09T20:43:54.911154] [INFO ] [MAIN ] Update Progress: 1590/2373 symbols completed. OLP took 20.6s. Estimated remaining: 1h 50m 14s. Rate: 7.1 symbols/min [2025-10-09T20:43:55.078341] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:43:55.078560] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-09T20:43:55.078607] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-09T20:43:55.078744] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-09T20:43:55.078787] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-09T20:43:55.078830] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-09T20:43:55.078861] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-09T20:43:55.201946] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-09T20:43:55.449736] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:43:55.498792] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T20:43:55.996763] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-09T20:43:56.796769] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-09T20:43:57.235360] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T20:43:57.596767] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-09T20:43:58.210128] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-10-09T20:43:58.396723] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-09T20:43:58.534880] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T20:43:58.939255] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T20:43:59.196792] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-09T20:43:59.655452] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T20:43:59.996731] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-09T20:44:00.751011] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T20:44:00.796685] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-09T20:44:01.596714] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-09T20:44:01.946426] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T20:44:02.396709] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-09T20:44:02.493636] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T20:44:03.196787] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-09T20:44:03.996697] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-09T20:44:04.161289] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T20:44:04.199487] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-09T20:44:04.796767] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-09T20:44:05.268114] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-09T20:44:05.596735] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-09T20:44:05.836270] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T20:44:06.334374] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T20:44:06.396684] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-09T20:44:07.196696] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-09T20:44:07.454423] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T20:44:07.987024] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T20:44:07.997967] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-09T20:44:08.071177] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T20:44:08.796761] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-09T20:44:09.596701] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-09T20:44:09.724071] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T20:44:09.993849] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T20:44:10.396755] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-09T20:44:10.675768] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T20:44:11.196801] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-09T20:44:11.905456] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T20:44:11.910434] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-10-09T20:44:11.910604] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-09T20:44:11.912178] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:44:11.912320] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:44:11.912428] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:44:11.912525] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-09T20:44:11.912679] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-09T20:44:11.912740] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-09T20:44:11.912788] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-09T20:44:11.912905] [INFO ] [MAIN ] Update Progress: 1591/2373 symbols completed. OKLO took 58.4s. Estimated remaining: 1h 50m 10s. Rate: 7.1 symbols/min [2025-10-09T20:44:12.002056] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-09T20:44:12.092189] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:44:12.092363] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-09T20:44:12.092418] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-09T20:44:12.092585] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-09T20:44:12.092689] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-09T20:44:12.092874] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-09T20:44:12.093016] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-09T20:44:12.423492] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-09T20:44:12.520547] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:44:12.531485] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T20:44:12.535488] [INFO ] [REMOTE ] OLN: Full fetch complete (74251 records). [2025-10-09T20:44:12.535592] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-09T20:44:12.536507] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:44:12.536600] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:44:12.536805] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:44:12.536885] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-09T20:44:12.536952] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-09T20:44:12.536987] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-09T20:44:12.537026] [DEBUG] [LOCAL ] OLN: No derivative data file found to delete. [2025-10-09T20:44:12.537086] [INFO ] [MAIN ] Update Progress: 1592/2373 symbols completed. OLN took 40.7s. Estimated remaining: 1h 49m 58s. Rate: 7.1 symbols/min [2025-10-09T20:44:12.705590] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:44:12.705835] [DEBUG] [LOCAL ] ONIT: No existing data file found in primary storage. [2025-10-09T20:44:12.705882] [WARN ] [MAIN ] ONIT: No existing data found, performing full refresh instead. [2025-10-09T20:44:12.706008] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-09T20:44:12.706049] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-09T20:44:12.706088] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-09T20:44:12.706163] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-09T20:44:12.801945] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-09T20:44:13.059244] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:44:13.596773] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-09T20:44:14.057588] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T20:44:14.396713] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-09T20:44:15.111576] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T20:44:15.196693] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-09T20:44:15.335960] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T20:44:15.996780] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-09T20:44:16.102560] [DEBUG] [REMOTE ] ONIT: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-09T20:44:16.102883] [WARN ] [REMOTE ] ONIT: No data returned for month 2024-12 [2025-10-09T20:44:16.103017] [FATAL] [REMOTE ] ONIT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:44:16.103118] [FATAL] [MAIN ] ONIT: Failed to fetch primary data. [2025-10-09T20:44:16.103204] [WARN ] [MAIN ] ONIT: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:44:16.103298] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-09T20:44:16.103380] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-09T20:44:16.103428] [INFO ] [LOCAL ] ONIT: Starting deletion of derivative data. [2025-10-09T20:44:16.103467] [DEBUG] [LOCAL ] ONIT: No derivative data file found to delete. [2025-10-09T20:44:16.103527] [INFO ] [MAIN ] Update Progress: 1593/2373 symbols completed. ONIT took 3.6s. Estimated remaining: 1h 49m 47s. Rate: 7.1 symbols/min [2025-10-09T20:44:16.274343] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:44:16.274669] [DEBUG] [LOCAL ] ONL: No existing data file found in primary storage. [2025-10-09T20:44:16.274727] [WARN ] [MAIN ] ONL: No existing data found, performing full refresh instead. [2025-10-09T20:44:16.274845] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-09T20:44:16.274887] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-09T20:44:16.274928] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-09T20:44:16.274960] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-09T20:44:16.649862] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T20:44:16.663041] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:44:16.796695] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-09T20:44:17.596772] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-09T20:44:18.069744] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T20:44:18.075132] [INFO ] [REMOTE ] OMC: Full fetch complete (76606 records). [2025-10-09T20:44:18.075596] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-09T20:44:18.077441] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:44:18.079126] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:44:18.079194] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:44:18.079282] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-09T20:44:18.079377] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-09T20:44:18.079432] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-09T20:44:18.079488] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-09T20:44:18.079595] [INFO ] [MAIN ] Update Progress: 1594/2373 symbols completed. OMC took 31.9s. Estimated remaining: 1h 49m 35s. Rate: 7.1 symbols/min [2025-10-09T20:44:18.365789] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:44:18.401207] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:44:18.401331] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-09T20:44:18.414066] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-09T20:44:18.414185] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-09T20:44:18.414356] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-09T20:44:18.414424] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-09T20:44:18.414501] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-09T20:44:18.414690] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-09T20:44:18.798283] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:44:19.196723] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-09T20:44:19.655246] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T20:44:19.996697] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-09T20:44:20.623428] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T20:44:20.796669] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-09T20:44:21.283142] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T20:44:21.596715] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-09T20:44:22.170284] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T20:44:22.396757] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-09T20:44:23.196804] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-09T20:44:23.494729] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T20:44:23.771213] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T20:44:23.996749] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-09T20:44:24.796687] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-09T20:44:24.911566] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T20:44:25.013628] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T20:44:25.596782] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-09T20:44:26.396802] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-09T20:44:26.804065] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-09T20:44:26.839743] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T20:44:27.196766] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-09T20:44:27.778268] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T20:44:27.996720] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-09T20:44:28.796691] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-09T20:44:29.077975] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T20:44:29.308406] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T20:44:29.596712] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-09T20:44:30.190176] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T20:44:30.396699] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-09T20:44:31.196788] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-09T20:44:31.447114] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T20:44:31.996771] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-09T20:44:32.298591] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T20:44:32.400049] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T20:44:32.796703] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-09T20:44:33.365696] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T20:44:33.596739] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-09T20:44:33.891991] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T20:44:34.416886] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-09T20:44:34.444763] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T20:44:35.196759] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-09T20:44:35.806940] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T20:44:35.810868] [INFO ] [REMOTE ] OMF: Full fetch complete (66848 records). [2025-10-09T20:44:35.810992] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-09T20:44:35.811960] [FATAL] [VALIDATOR ] OMF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:44:35.812048] [FATAL] [MAIN ] OMF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:44:35.812092] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:44:35.812131] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-09T20:44:35.812210] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-09T20:44:35.812274] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-09T20:44:35.812318] [DEBUG] [LOCAL ] OMF: No derivative data file found to delete. [2025-10-09T20:44:35.812399] [INFO ] [MAIN ] Update Progress: 1595/2373 symbols completed. OMF took 40.9s. Estimated remaining: 1h 49m 31s. Rate: 7.1 symbols/min [2025-10-09T20:44:35.986466] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:44:35.986673] [DEBUG] [LOCAL ] ONTF: No existing data file found in primary storage. [2025-10-09T20:44:35.986730] [WARN ] [MAIN ] ONTF: No existing data found, performing full refresh instead. [2025-10-09T20:44:35.986845] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-09T20:44:35.986888] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-09T20:44:35.986930] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-09T20:44:35.986963] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-09T20:44:36.001837] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-09T20:44:36.351078] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:44:36.518895] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T20:44:36.522582] [INFO ] [REMOTE ] OMI: Full fetch complete (64592 records). [2025-10-09T20:44:36.522724] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-09T20:44:36.523460] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:44:36.523549] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:44:36.523593] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:44:36.523632] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-09T20:44:36.523729] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-09T20:44:36.523771] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-09T20:44:36.523810] [DEBUG] [LOCAL ] OMI: No derivative data file found to delete. [2025-10-09T20:44:36.523924] [INFO ] [MAIN ] Update Progress: 1596/2373 symbols completed. OMI took 24.6s. Estimated remaining: 1h 49m 19s. Rate: 7.1 symbols/min [2025-10-09T20:44:36.694369] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:44:36.694623] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-09T20:44:36.694815] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-09T20:44:36.694961] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-09T20:44:36.695006] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-09T20:44:36.695047] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-09T20:44:36.695079] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-09T20:44:36.799561] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-09T20:44:37.013993] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-09T20:44:37.113843] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:44:37.596719] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-09T20:44:38.396704] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-09T20:44:38.511349] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T20:44:38.847025] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T20:44:39.196745] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-09T20:44:39.413194] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T20:44:39.996760] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-09T20:44:40.796757] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-09T20:44:41.092103] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T20:44:41.596689] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-09T20:44:42.356366] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T20:44:42.396690] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-09T20:44:43.204511] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-09T20:44:43.207613] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T20:44:43.249408] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (4.05 seconds). [2025-10-09T20:44:43.996762] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-09T20:44:44.712907] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (3.92 seconds). [2025-10-09T20:44:44.796695] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-09T20:44:45.092421] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T20:44:45.509389] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T20:44:45.596741] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-09T20:44:45.879998] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T20:44:46.396738] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-09T20:44:46.566862] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T20:44:47.196743] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-09T20:44:47.996692] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-09T20:44:48.129782] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T20:44:48.475262] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T20:44:48.796706] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-09T20:44:49.196107] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T20:44:49.596748] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-09T20:44:50.396733] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-09T20:44:50.707583] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T20:44:51.005699] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T20:44:51.196736] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-09T20:44:51.253300] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T20:44:51.996743] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-09T20:44:52.496750] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T20:44:52.608400] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T20:44:52.796708] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-09T20:44:53.601591] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-09T20:44:53.607231] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T20:44:53.611396] [INFO ] [REMOTE ] ONON: Full fetch complete (77205 records). [2025-10-09T20:44:53.611508] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-09T20:44:53.612224] [FATAL] [VALIDATOR ] ONON: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:44:53.612314] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:44:53.612365] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:44:53.612404] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-09T20:44:53.612459] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-09T20:44:53.612495] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-09T20:44:53.612537] [DEBUG] [LOCAL ] ONON: No derivative data file found to delete. [2025-10-09T20:44:53.612595] [INFO ] [MAIN ] Update Progress: 1597/2373 symbols completed. ONON took 35.5s. Estimated remaining: 1h 49m 15s. Rate: 7.1 symbols/min [2025-10-09T20:44:54.396784] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-09T20:44:54.570687] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T20:44:55.196737] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-09T20:44:55.651428] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T20:44:55.996738] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-09T20:44:56.214902] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T20:44:56.553615] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:44:56.555762] [INFO ] [REMOTE ] ONL: Full fetch complete (42779 records). [2025-10-09T20:44:56.555860] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-09T20:44:56.556439] [FATAL] [VALIDATOR ] ONL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:44:56.556526] [FATAL] [MAIN ] ONL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:44:56.556611] [WARN ] [MAIN ] ONL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:44:56.556721] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-09T20:44:56.556806] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-09T20:44:56.556904] [INFO ] [LOCAL ] ONL: Starting deletion of derivative data. [2025-10-09T20:44:56.556982] [DEBUG] [LOCAL ] ONL: No derivative data file found to delete. [2025-10-09T20:44:56.557063] [INFO ] [MAIN ] Update Progress: 1598/2373 symbols completed. ONL took 40.5s. Estimated remaining: 1h 49m 4s. Rate: 7.1 symbols/min [2025-10-09T20:44:56.796784] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-09T20:44:57.596761] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-09T20:44:58.291891] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T20:44:58.396672] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-09T20:44:58.539751] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T20:44:58.637488] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-09T20:44:58.639447] [INFO ] [REMOTE ] ONTF: Full fetch complete (31263 records). [2025-10-09T20:44:58.639517] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-09T20:44:58.640002] [FATAL] [VALIDATOR ] ONTF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:44:58.640084] [FATAL] [MAIN ] ONTF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:44:58.640126] [WARN ] [MAIN ] ONTF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:44:58.640163] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-09T20:44:58.640218] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-09T20:44:58.640250] [INFO ] [LOCAL ] ONTF: Starting deletion of derivative data. [2025-10-09T20:44:58.640289] [DEBUG] [LOCAL ] ONTF: No derivative data file found to delete. [2025-10-09T20:44:58.640341] [INFO ] [MAIN ] Update Progress: 1599/2373 symbols completed. ONTF took 22.8s. Estimated remaining: 1h 48m 52s. Rate: 7.1 symbols/min [2025-10-09T20:44:59.196735] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-09T20:45:00.678198] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T20:45:00.689762] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-09T20:45:02.304936] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T20:45:02.319034] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-09T20:45:04.659312] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-09T20:45:04.670035] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-09T20:45:05.580606] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T20:45:05.591901] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-09T20:45:06.246896] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:45:06.251107] [INFO ] [REMOTE ] ONTO: Full fetch complete (66063 records). [2025-10-09T20:45:06.251455] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-09T20:45:06.253372] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:45:06.253471] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:45:06.253516] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:45:06.253553] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-09T20:45:06.253632] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-09T20:45:06.253714] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-09T20:45:06.253763] [DEBUG] [LOCAL ] ONTO: No derivative data file found to delete. [2025-10-09T20:45:06.253853] [INFO ] [MAIN ] Update Progress: 1600/2373 symbols completed. ONTO took 29.7s. Estimated remaining: 1h 48m 43s. Rate: 7.1 symbols/min [2025-10-09T20:45:06.919071] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:45:06.931108] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:45:06.976451] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-09T20:45:06.970101] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:45:06.977136] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-09T20:45:06.976985] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-09T20:45:07.000866] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-09T20:45:07.001346] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-09T20:45:07.006096] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:45:07.001532] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-09T20:45:07.006326] [DEBUG] [LOCAL ] OPAD: No existing data file found in primary storage. [2025-10-09T20:45:07.006669] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-09T20:45:07.006855] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-09T20:45:07.007087] [WARN ] [MAIN ] OPAD: No existing data found, performing full refresh instead. [2025-10-09T20:45:07.007022] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-09T20:45:07.007199] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-09T20:45:07.007495] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-09T20:45:07.007849] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-09T20:45:07.013156] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-09T20:45:07.019559] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-09T20:45:07.097332] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-09T20:45:07.188915] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-09T20:45:07.181505] [DEBUG] [LOCAL ] OPP: Loaded 11993 existing records from primary storage. [2025-10-09T20:45:07.224826] [INFO ] [MAIN ] OPP: Loaded 11993 existing records. [2025-10-09T20:45:07.999149] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:45:08.005487] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-09T20:45:08.014288] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-09T20:45:08.063382] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-09T20:45:08.084913] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-09T20:45:08.356992] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:45:08.391898] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-09T20:45:08.396577] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:45:08.418058] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:45:08.434430] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-09T20:45:08.440217] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-09T20:45:08.717549] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:45:08.717967] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-09T20:45:09.244233] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T20:45:09.247108] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-09T20:45:09.305460] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T20:45:09.310423] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-09T20:45:09.711966] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T20:45:09.718451] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-09T20:45:09.812180] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T20:45:09.823336] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-09T20:45:09.982071] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T20:45:09.985078] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-09T20:45:10.146752] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T20:45:10.396832] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-09T20:45:10.585775] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T20:45:10.655862] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T20:45:11.196694] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-09T20:45:11.248762] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T20:45:11.445064] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T20:45:11.715627] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T20:45:11.996759] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-09T20:45:12.796801] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-09T20:45:12.915942] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T20:45:13.596787] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-09T20:45:14.396695] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-09T20:45:14.545156] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T20:45:14.992279] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-09T20:45:15.028103] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T20:45:15.196709] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-09T20:45:15.939687] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T20:45:15.996760] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-09T20:45:16.796698] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-09T20:45:16.872420] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T20:45:17.596717] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-09T20:45:18.396734] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-09T20:45:19.052626] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-09T20:45:19.084205] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T20:45:19.196736] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-09T20:45:19.207569] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T20:45:19.996716] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-09T20:45:20.796739] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-09T20:45:21.113244] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T20:45:21.167476] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T20:45:21.596737] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-09T20:45:22.348556] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T20:45:22.396745] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-09T20:45:22.686809] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T20:45:23.119716] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T20:45:23.196695] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-09T20:45:23.916971] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T20:45:23.920955] [INFO ] [REMOTE ] OPAD: Full fetch complete (26256 records). [2025-10-09T20:45:23.921093] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-09T20:45:23.921928] [FATAL] [VALIDATOR ] OPAD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:45:23.922052] [FATAL] [MAIN ] OPAD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:45:23.922125] [WARN ] [MAIN ] OPAD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:45:23.922229] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-09T20:45:23.922312] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-09T20:45:23.922359] [INFO ] [LOCAL ] OPAD: Starting deletion of derivative data. [2025-10-09T20:45:23.922408] [DEBUG] [LOCAL ] OPAD: No derivative data file found to delete. [2025-10-09T20:45:23.922491] [INFO ] [MAIN ] Update Progress: 1601/2373 symbols completed. OPAD took 17.7s. Estimated remaining: 1h 48m 40s. Rate: 7.1 symbols/min [2025-10-09T20:45:24.001821] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-09T20:45:24.097071] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:45:24.097267] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-09T20:45:24.097323] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-09T20:45:24.097431] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-09T20:45:24.097473] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-09T20:45:24.097513] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-09T20:45:24.097545] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-09T20:45:24.441014] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:45:24.796688] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-09T20:45:25.036779] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T20:45:25.596696] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-09T20:45:25.635993] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T20:45:26.347060] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T20:45:26.397110] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-09T20:45:27.196824] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-09T20:45:27.525902] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T20:45:27.912974] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T20:45:27.996698] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-09T20:45:28.796779] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-09T20:45:29.143502] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T20:45:29.596735] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-09T20:45:29.669697] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T20:45:30.362846] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T20:45:30.396716] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-09T20:45:31.146220] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T20:45:31.196714] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-09T20:45:31.924610] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T20:45:31.996724] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-09T20:45:32.716290] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T20:45:32.796775] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-09T20:45:33.596737] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-09T20:45:34.360555] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T20:45:34.399690] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-09T20:45:34.405028] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T20:45:34.971928] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T20:45:34.973694] [INFO ] [REMOTE ] OPP: Full fetch complete (17461 records). [2025-10-09T20:45:34.973772] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-09T20:45:34.974204] [FATAL] [VALIDATOR ] OPP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:45:34.974287] [FATAL] [MAIN ] OPP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:45:34.974351] [WARN ] [MAIN ] OPP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:45:34.974424] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-09T20:45:34.974489] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-10-09T20:45:34.974525] [INFO ] [LOCAL ] OPP: Starting deletion of derivative data. [2025-10-09T20:45:34.974846] [DEBUG] [LOCAL ] OPP: Deleted derivative data file. [2025-10-09T20:45:34.974938] [INFO ] [MAIN ] Update Progress: 1602/2373 symbols completed. OPP took 28.7s. Estimated remaining: 1h 48m 32s. Rate: 7.1 symbols/min [2025-10-09T20:45:35.141941] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:45:35.142145] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-09T20:45:35.142183] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-09T20:45:35.142293] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-09T20:45:35.142335] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-09T20:45:35.142380] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-09T20:45:35.142413] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-09T20:45:35.202308] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-09T20:45:35.510855] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:45:35.996776] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-09T20:45:36.524196] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T20:45:36.632174] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T20:45:36.796724] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-09T20:45:37.596790] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-09T20:45:38.332527] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T20:45:38.333889] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T20:45:38.396702] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-09T20:45:39.196739] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-09T20:45:39.656429] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:45:39.658163] [INFO ] [REMOTE ] OOMA: Full fetch complete (25591 records). [2025-10-09T20:45:39.658235] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-09T20:45:39.658720] [FATAL] [VALIDATOR ] OOMA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:45:39.658843] [FATAL] [MAIN ] OOMA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:45:39.658887] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:45:39.658950] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-09T20:45:39.659013] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-09T20:45:39.659049] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-09T20:45:39.659088] [DEBUG] [LOCAL ] OOMA: No derivative data file found to delete. [2025-10-09T20:45:39.659141] [INFO ] [MAIN ] Update Progress: 1603/2373 symbols completed. OOMA took 33.4s. Estimated remaining: 1h 48m 22s. Rate: 7.1 symbols/min [2025-10-09T20:45:39.836006] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:45:39.836285] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-09T20:45:39.836347] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-09T20:45:39.836470] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-09T20:45:39.836617] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-09T20:45:39.836736] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-09T20:45:39.836877] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-09T20:45:39.998213] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-09T20:45:40.229610] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:45:40.230979] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T20:45:40.796796] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-09T20:45:41.306945] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T20:45:41.596710] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-09T20:45:42.396756] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-09T20:45:42.532742] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T20:45:42.964010] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T20:45:43.196715] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-09T20:45:43.299739] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T20:45:43.996772] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-09T20:45:44.769857] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:45:44.796665] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-09T20:45:44.813475] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T20:45:45.596795] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-09T20:45:46.396724] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-09T20:45:46.480280] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T20:45:47.011612] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T20:45:47.196753] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-09T20:45:47.270033] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T20:45:47.545022] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T20:45:47.548626] [INFO ] [REMOTE ] OPFI: Full fetch complete (67866 records). [2025-10-09T20:45:47.548810] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-09T20:45:47.549486] [FATAL] [VALIDATOR ] OPFI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:45:47.549602] [FATAL] [MAIN ] OPFI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:45:47.549759] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:45:47.549842] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-09T20:45:47.549920] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-09T20:45:47.549977] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-09T20:45:47.550021] [DEBUG] [LOCAL ] OPFI: No derivative data file found to delete. [2025-10-09T20:45:47.550084] [INFO ] [MAIN ] Update Progress: 1604/2373 symbols completed. OPFI took 41.3s. Estimated remaining: 1h 48m 13s. Rate: 7.1 symbols/min [2025-10-09T20:45:47.718293] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:45:47.718492] [DEBUG] [LOCAL ] ORC: No existing data file found in primary storage. [2025-10-09T20:45:47.718528] [WARN ] [MAIN ] ORC: No existing data found, performing full refresh instead. [2025-10-09T20:45:47.718678] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-09T20:45:47.718733] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-09T20:45:47.718776] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-09T20:45:47.718808] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-09T20:45:48.001857] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-09T20:45:48.071937] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:45:48.796688] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-09T20:45:49.027084] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T20:45:49.596778] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-09T20:45:50.311615] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T20:45:50.396677] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-09T20:45:50.430503] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T20:45:51.196717] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-09T20:45:51.834324] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T20:45:51.996723] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-09T20:45:52.796717] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-09T20:45:52.849468] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T20:45:53.596719] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-09T20:45:53.654006] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T20:45:54.396746] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-09T20:45:54.461390] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T20:45:55.140144] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T20:45:55.196728] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-09T20:45:55.424008] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T20:45:55.996773] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-09T20:45:56.796740] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-09T20:45:57.156348] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-09T20:45:57.596743] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-09T20:45:57.689368] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T20:45:58.055022] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T20:45:58.396722] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-09T20:45:59.187397] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T20:45:59.196664] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-09T20:45:59.626913] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T20:45:59.651021] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T20:45:59.996757] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-09T20:46:00.796719] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-09T20:46:01.596698] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-09T20:46:01.711537] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T20:46:01.896876] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T20:46:01.898507] [INFO ] [REMOTE ] OPY: Full fetch complete (10055 records). [2025-10-09T20:46:01.898828] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-09T20:46:01.899389] [FATAL] [VALIDATOR ] OPY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:46:01.899495] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:46:01.899788] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:46:01.899859] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-09T20:46:01.899943] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-09T20:46:01.900000] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-09T20:46:01.900063] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-09T20:46:01.900147] [INFO ] [MAIN ] Update Progress: 1605/2373 symbols completed. OPY took 38.0s. Estimated remaining: 1h 48m 8s. Rate: 7.1 symbols/min [2025-10-09T20:46:02.139235] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:46:02.139638] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-09T20:46:02.139950] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-09T20:46:02.140296] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-09T20:46:02.140404] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-09T20:46:02.140585] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-09T20:46:02.140750] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-09T20:46:02.374899] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T20:46:02.397468] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-09T20:46:02.814810] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:46:03.196769] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-09T20:46:03.996702] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-09T20:46:04.218534] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T20:46:04.796687] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-09T20:46:04.878915] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T20:46:05.596759] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-09T20:46:05.843536] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T20:46:06.396796] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-09T20:46:06.483171] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T20:46:06.544375] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T20:46:07.196697] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-09T20:46:07.620948] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T20:46:07.624333] [INFO ] [REMOTE ] ORA: Full fetch complete (48723 records). [2025-10-09T20:46:07.624441] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-09T20:46:07.625868] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:46:07.626122] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:46:07.626195] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:46:07.626278] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-09T20:46:07.626353] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-09T20:46:07.626390] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-09T20:46:07.626433] [DEBUG] [LOCAL ] ORA: No derivative data file found to delete. [2025-10-09T20:46:07.626513] [INFO ] [MAIN ] Update Progress: 1606/2373 symbols completed. ORA took 28.0s. Estimated remaining: 1h 47m 58s. Rate: 7.1 symbols/min [2025-10-09T20:46:07.802098] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:46:07.802333] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-09T20:46:07.802390] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-09T20:46:07.802509] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-09T20:46:07.802570] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-09T20:46:07.802612] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-09T20:46:07.802670] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-09T20:46:08.005277] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-09T20:46:08.162403] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:46:08.497906] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-09T20:46:08.605465] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T20:46:08.796748] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-09T20:46:09.596722] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-09T20:46:10.396742] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-09T20:46:10.735040] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T20:46:11.028940] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T20:46:11.032944] [INFO ] [REMOTE ] OR: Full fetch complete (65483 records). [2025-10-09T20:46:11.033077] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-09T20:46:11.033906] [FATAL] [VALIDATOR ] OR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:46:11.033993] [FATAL] [MAIN ] OR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:46:11.034037] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:46:11.034075] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-09T20:46:11.034131] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-09T20:46:11.034166] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-09T20:46:11.034205] [DEBUG] [LOCAL ] OR: No derivative data file found to delete. [2025-10-09T20:46:11.034262] [INFO ] [MAIN ] Update Progress: 1607/2373 symbols completed. OR took 36.1s. Estimated remaining: 1h 47m 47s. Rate: 7.1 symbols/min [2025-10-09T20:46:11.206638] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-09T20:46:11.210191] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:46:11.211457] [DEBUG] [LOCAL ] ORN: No existing data file found in primary storage. [2025-10-09T20:46:11.211523] [WARN ] [MAIN ] ORN: No existing data found, performing full refresh instead. [2025-10-09T20:46:11.211666] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-09T20:46:11.211728] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-09T20:46:11.211777] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-09T20:46:11.211812] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-09T20:46:11.598237] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:46:11.996699] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-09T20:46:12.372861] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-09T20:46:12.761411] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T20:46:12.796684] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-09T20:46:13.463947] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T20:46:13.596705] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-09T20:46:14.280696] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T20:46:14.396714] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-09T20:46:15.196734] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-09T20:46:15.996695] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-09T20:46:16.110609] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-09T20:46:16.453261] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T20:46:16.531399] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-09T20:46:16.796735] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-09T20:46:17.565510] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T20:46:17.596689] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-09T20:46:18.396760] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-09T20:46:18.684808] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-09T20:46:19.196765] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-09T20:46:19.287633] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T20:46:19.678872] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-09T20:46:19.996740] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-09T20:46:20.669808] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T20:46:20.796716] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-09T20:46:20.851791] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T20:46:21.596754] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-09T20:46:22.396699] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-09T20:46:22.544116] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T20:46:23.029047] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T20:46:23.034088] [INFO ] [REMOTE ] ORC: Full fetch complete (75025 records). [2025-10-09T20:46:23.034224] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-09T20:46:23.035094] [FATAL] [VALIDATOR ] ORC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:46:23.035195] [FATAL] [MAIN ] ORC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:46:23.035261] [WARN ] [MAIN ] ORC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:46:23.035331] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-09T20:46:23.035395] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-09T20:46:23.035443] [INFO ] [LOCAL ] ORC: Starting deletion of derivative data. [2025-10-09T20:46:23.035511] [DEBUG] [LOCAL ] ORC: No derivative data file found to delete. [2025-10-09T20:46:23.035574] [INFO ] [MAIN ] Update Progress: 1608/2373 symbols completed. ORC took 35.5s. Estimated remaining: 1h 47m 40s. Rate: 7.1 symbols/min [2025-10-09T20:46:23.205879] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:46:23.203299] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-09T20:46:23.206056] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-09T20:46:23.206260] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-09T20:46:23.206980] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-09T20:46:23.207031] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-09T20:46:23.207075] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-09T20:46:23.207107] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-09T20:46:23.565006] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:46:23.996747] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-09T20:46:24.259942] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-09T20:46:24.427339] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T20:46:24.796783] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-09T20:46:25.596699] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-09T20:46:26.052334] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T20:46:26.307489] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T20:46:26.396703] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-09T20:46:27.103239] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T20:46:27.196687] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-09T20:46:27.433432] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T20:46:27.996724] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-09T20:46:28.796719] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-09T20:46:28.948477] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T20:46:29.596702] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-09T20:46:30.021443] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T20:46:30.283477] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-09T20:46:30.396716] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-09T20:46:31.073571] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T20:46:31.196758] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-09T20:46:31.996793] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-09T20:46:32.520125] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T20:46:32.796703] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-09T20:46:32.906167] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-09T20:46:33.551770] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T20:46:33.596698] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-09T20:46:34.336266] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T20:46:34.396732] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-09T20:46:35.196749] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-09T20:46:35.542033] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T20:46:35.820216] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-09T20:46:35.996740] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-09T20:46:36.796776] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-09T20:46:37.312927] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T20:46:37.575598] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-09T20:46:37.596698] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-09T20:46:37.678597] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T20:46:38.208869] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T20:46:38.211320] [INFO ] [REMOTE ] ORN: Full fetch complete (45076 records). [2025-10-09T20:46:38.211405] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-09T20:46:38.212103] [FATAL] [VALIDATOR ] ORN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:46:38.212192] [FATAL] [MAIN ] ORN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:46:38.212236] [WARN ] [MAIN ] ORN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:46:38.212276] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-09T20:46:38.212333] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-09T20:46:38.212368] [INFO ] [LOCAL ] ORN: Starting deletion of derivative data. [2025-10-09T20:46:38.212408] [DEBUG] [LOCAL ] ORN: No derivative data file found to delete. [2025-10-09T20:46:38.212462] [INFO ] [MAIN ] Update Progress: 1609/2373 symbols completed. ORN took 27.2s. Estimated remaining: 1h 47m 35s. Rate: 7.1 symbols/min [2025-10-09T20:46:38.379730] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:46:38.380000] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-09T20:46:38.380053] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-09T20:46:38.380185] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-09T20:46:38.380236] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-09T20:46:38.380281] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-09T20:46:38.380313] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-09T20:46:38.401925] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-09T20:46:38.740511] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:46:39.196771] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-09T20:46:39.996779] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-09T20:46:40.352985] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T20:46:40.599033] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T20:46:40.796693] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-09T20:46:40.914476] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:46:41.347660] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T20:46:41.596730] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-09T20:46:42.396736] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-09T20:46:43.186834] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T20:46:43.196664] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-09T20:46:43.996738] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-09T20:46:44.796723] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-09T20:46:44.829450] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T20:46:44.912053] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-09T20:46:45.303683] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T20:46:45.307522] [INFO ] [REMOTE ] ORI: Full fetch complete (69860 records). [2025-10-09T20:46:45.307727] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-09T20:46:45.308727] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:46:45.308821] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:46:45.308867] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:46:45.308908] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-09T20:46:45.308967] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-09T20:46:45.309004] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-09T20:46:45.309044] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-09T20:46:45.309105] [INFO ] [MAIN ] Update Progress: 1610/2373 symbols completed. ORI took 37.7s. Estimated remaining: 1h 47m 26s. Rate: 7.1 symbols/min [2025-10-09T20:46:45.485178] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:46:45.485440] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-09T20:46:45.485484] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-09T20:46:45.485559] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-09T20:46:45.485670] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-09T20:46:45.485739] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-09T20:46:45.485773] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-09T20:46:45.601830] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-09T20:46:45.865509] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:46:46.396778] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-09T20:46:46.691981] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:46:46.692402] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-09T20:46:46.692494] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:46:46.692546] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-09T20:46:46.692584] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:46:46.692677] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-09T20:46:46.692758] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-09T20:46:46.692795] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-09T20:46:46.692836] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-09T20:46:46.692884] [INFO ] [MAIN ] Update Progress: 1611/2373 symbols completed. OTF took 1.4s. Estimated remaining: 1h 47m 14s. Rate: 7.1 symbols/min [2025-10-09T20:46:46.874954] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:46:46.875145] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-09T20:46:46.875293] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-09T20:46:46.875448] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-09T20:46:46.875636] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-09T20:46:46.875742] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-09T20:46:46.875919] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-09T20:46:47.218617] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-09T20:46:47.299293] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-10-09T20:46:47.297396] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:46:47.336541] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T20:46:47.996699] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-09T20:46:48.796780] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-09T20:46:49.596753] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-09T20:46:49.739935] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T20:46:50.312000] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-10-09T20:46:50.363536] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T20:46:50.396693] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-09T20:46:51.196845] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-09T20:46:51.999270] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-09T20:46:52.002142] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-09T20:46:52.091823] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T20:46:52.796717] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-09T20:46:53.376430] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T20:46:53.596801] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-09T20:46:53.855269] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T20:46:53.933277] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-09T20:46:54.396795] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-09T20:46:55.138504] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T20:46:55.142947] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-10-09T20:46:55.143088] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-09T20:46:55.143928] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:46:55.144029] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:46:55.144099] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:46:55.144175] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-09T20:46:55.144240] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-09T20:46:55.144277] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-09T20:46:55.144316] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-09T20:46:55.144407] [INFO ] [MAIN ] Update Progress: 1612/2373 symbols completed. ORCL took 53.2s. Estimated remaining: 1h 47m 6s. Rate: 7.1 symbols/min [2025-10-09T20:46:55.206337] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-09T20:46:55.321613] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:46:55.321925] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-09T20:46:55.321986] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-09T20:46:55.343361] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-09T20:46:55.343478] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-09T20:46:55.343534] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-09T20:46:55.343764] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-09T20:46:55.376543] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T20:46:55.701484] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:46:55.996735] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-09T20:46:56.574029] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T20:46:56.796739] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-09T20:46:57.154130] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T20:46:57.596787] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-09T20:46:58.396746] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-09T20:46:58.447051] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T20:46:59.197717] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-09T20:46:59.200278] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T20:46:59.571453] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T20:46:59.996719] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-09T20:47:00.725440] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T20:47:00.796689] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-09T20:47:01.514139] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T20:47:01.596669] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-09T20:47:01.703833] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T20:47:02.233687] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T20:47:02.237856] [INFO ] [REMOTE ] OSK: Full fetch complete (60929 records). [2025-10-09T20:47:02.238128] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-09T20:47:02.239324] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:47:02.239419] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:47:02.239463] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:47:02.239531] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-09T20:47:02.239600] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-09T20:47:02.239638] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-09T20:47:02.239746] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-09T20:47:02.239839] [INFO ] [MAIN ] Update Progress: 1613/2373 symbols completed. OSK took 24.0s. Estimated remaining: 1h 46m 57s. Rate: 7.1 symbols/min [2025-10-09T20:47:02.399017] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-09T20:47:02.420721] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:47:02.420963] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-09T20:47:02.421021] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-09T20:47:02.421140] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-09T20:47:02.421184] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-09T20:47:02.421227] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-09T20:47:02.421260] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-09T20:47:02.778377] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:47:02.923529] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T20:47:02.928187] [INFO ] [REMOTE ] OSCR: Full fetch complete (77142 records). [2025-10-09T20:47:02.928345] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-09T20:47:02.929137] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:47:02.929238] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:47:02.929309] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:47:02.929386] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-09T20:47:02.929468] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-09T20:47:02.929528] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-09T20:47:02.929576] [DEBUG] [LOCAL ] OSCR: No derivative data file found to delete. [2025-10-09T20:47:02.929673] [INFO ] [MAIN ] Update Progress: 1614/2373 symbols completed. OSCR took 39.9s. Estimated remaining: 1h 46m 45s. Rate: 7.1 symbols/min [2025-10-09T20:47:03.113423] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:47:03.113546] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-09T20:47:03.113606] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-09T20:47:03.113754] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-09T20:47:03.113798] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-09T20:47:03.113839] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-09T20:47:03.113871] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-09T20:47:03.201850] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-09T20:47:03.478209] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:47:03.996746] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-09T20:47:04.796743] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-09T20:47:05.049629] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T20:47:05.596743] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-09T20:47:06.155495] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-09T20:47:06.396761] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-09T20:47:06.565772] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T20:47:07.196718] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-09T20:47:07.302299] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T20:47:07.606999] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T20:47:07.996716] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-09T20:47:08.797839] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-09T20:47:08.801456] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T20:47:09.596686] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-09T20:47:09.714876] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T20:47:10.340321] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T20:47:10.396758] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-09T20:47:10.916796] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T20:47:11.196744] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-09T20:47:11.879018] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T20:47:11.996687] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-09T20:47:12.796733] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-09T20:47:13.054064] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T20:47:13.414581] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T20:47:13.596682] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-09T20:47:14.329072] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T20:47:14.396662] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-09T20:47:15.196754] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-09T20:47:15.466265] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T20:47:15.996700] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-09T20:47:16.180434] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T20:47:16.796778] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-09T20:47:17.365611] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-09T20:47:17.596760] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-09T20:47:17.697392] [DEBUG] [REMOTE ] OTIS: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-09T20:47:17.697850] [WARN ] [REMOTE ] OTIS: No data returned for month 2025-08 [2025-10-09T20:47:17.697999] [FATAL] [REMOTE ] OTIS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:47:17.698132] [FATAL] [MAIN ] OTIS: Failed to fetch primary data. [2025-10-09T20:47:17.698212] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:47:17.698300] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-09T20:47:17.698401] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-09T20:47:17.698465] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-09T20:47:17.698517] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-09T20:47:17.698576] [INFO ] [MAIN ] Update Progress: 1615/2373 symbols completed. OTIS took 31.0s. Estimated remaining: 1h 46m 39s. Rate: 7.1 symbols/min [2025-10-09T20:47:17.910579] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:47:17.911142] [DEBUG] [LOCAL ] OWLT: No existing data file found in primary storage. [2025-10-09T20:47:17.911280] [WARN ] [MAIN ] OWLT: No existing data found, performing full refresh instead. [2025-10-09T20:47:17.911423] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-09T20:47:17.911479] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-09T20:47:17.911526] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-09T20:47:17.911559] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-09T20:47:18.162357] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-09T20:47:18.340631] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:47:18.373145] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T20:47:18.396678] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-09T20:47:19.196796] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-09T20:47:19.996741] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-09T20:47:20.170523] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T20:47:20.659885] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T20:47:20.796678] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-09T20:47:20.845047] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T20:47:21.596725] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-09T20:47:22.341279] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T20:47:22.396676] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-09T20:47:23.196690] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-09T20:47:23.519945] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T20:47:23.651187] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T20:47:24.001793] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-09T20:47:24.017532] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T20:47:24.796738] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-09T20:47:25.596739] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-09T20:47:25.801023] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T20:47:26.131292] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T20:47:26.396753] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-09T20:47:26.931740] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T20:47:27.029592] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T20:47:27.196775] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-09T20:47:27.996753] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-09T20:47:28.031625] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T20:47:28.796758] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-09T20:47:29.425322] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T20:47:29.596753] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-09T20:47:30.149174] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T20:47:30.303179] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T20:47:30.396716] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-09T20:47:30.942693] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T20:47:31.196709] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-09T20:47:31.934094] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T20:47:31.996722] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-09T20:47:32.796695] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-09T20:47:32.948749] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T20:47:33.530389] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:47:33.534762] [INFO ] [REMOTE ] OVV: Full fetch complete (76940 records). [2025-10-09T20:47:33.534918] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-09T20:47:33.537162] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:47:33.537275] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:47:33.537318] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:47:33.537386] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-09T20:47:33.537457] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-09T20:47:33.537493] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-09T20:47:33.537531] [DEBUG] [LOCAL ] OVV: No derivative data file found to delete. [2025-10-09T20:47:33.537605] [INFO ] [MAIN ] Update Progress: 1616/2373 symbols completed. OVV took 31.3s. Estimated remaining: 1h 46m 34s. Rate: 7.1 symbols/min [2025-10-09T20:47:33.601843] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-09T20:47:33.713712] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:47:33.713917] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-09T20:47:33.713974] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-09T20:47:33.714088] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-09T20:47:33.714133] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-09T20:47:33.714176] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-09T20:47:33.714211] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-09T20:47:34.075476] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:47:34.240538] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-09T20:47:34.396754] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-09T20:47:35.196758] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-09T20:47:35.342518] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T20:47:35.996784] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-09T20:47:36.767171] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T20:47:36.796668] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-09T20:47:37.596743] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-09T20:47:37.966472] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T20:47:38.185276] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T20:47:38.396712] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-09T20:47:38.420378] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T20:47:38.921289] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T20:47:39.196757] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-09T20:47:39.996744] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-09T20:47:40.587834] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T20:47:40.654759] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T20:47:40.656160] [INFO ] [REMOTE ] OWLT: Full fetch complete (11727 records). [2025-10-09T20:47:40.656232] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-09T20:47:40.656617] [FATAL] [VALIDATOR ] OWLT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:47:40.656721] [FATAL] [MAIN ] OWLT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:47:40.656764] [WARN ] [MAIN ] OWLT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:47:40.656828] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-09T20:47:40.656892] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-09T20:47:40.656928] [INFO ] [LOCAL ] OWLT: Starting deletion of derivative data. [2025-10-09T20:47:40.656967] [DEBUG] [LOCAL ] OWLT: No derivative data file found to delete. [2025-10-09T20:47:40.657022] [INFO ] [MAIN ] Update Progress: 1617/2373 symbols completed. OWLT took 23.0s. Estimated remaining: 1h 46m 25s. Rate: 7.1 symbols/min [2025-10-09T20:47:40.805710] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-09T20:47:40.824127] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:47:40.825040] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-09T20:47:40.825088] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-09T20:47:40.825204] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-09T20:47:40.825247] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-09T20:47:40.825288] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-09T20:47:40.825330] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-09T20:47:41.191828] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:47:41.548679] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T20:47:41.552337] [INFO ] [REMOTE ] OUT: Full fetch complete (68605 records). [2025-10-09T20:47:41.552465] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-09T20:47:41.553357] [FATAL] [VALIDATOR ] OUT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:47:41.553445] [FATAL] [MAIN ] OUT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:47:41.553488] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:47:41.553526] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-09T20:47:41.553582] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-09T20:47:41.553616] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-09T20:47:41.553689] [DEBUG] [LOCAL ] OUT: No derivative data file found to delete. [2025-10-09T20:47:41.553781] [INFO ] [MAIN ] Update Progress: 1618/2373 symbols completed. OUT took 46.4s. Estimated remaining: 1h 46m 13s. Rate: 7.1 symbols/min [2025-10-09T20:47:41.601793] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-09T20:47:41.735796] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:47:41.736018] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-09T20:47:41.736056] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-09T20:47:41.736167] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-09T20:47:41.736209] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-09T20:47:41.736249] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-09T20:47:41.736280] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-09T20:47:42.089455] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:47:42.396694] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-09T20:47:43.012275] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T20:47:43.196796] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-09T20:47:43.996746] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-09T20:47:44.435611] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T20:47:44.796780] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-09T20:47:44.994457] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T20:47:45.601860] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-09T20:47:45.623146] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-09T20:47:46.358824] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T20:47:46.396746] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-09T20:47:46.895287] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T20:47:46.901889] [INFO ] [REMOTE ] OWL: Full fetch complete (77142 records). [2025-10-09T20:47:46.902085] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-09T20:47:46.903064] [FATAL] [VALIDATOR ] OWL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:47:46.903171] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:47:46.903215] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:47:46.903254] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-09T20:47:46.903337] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-09T20:47:46.903399] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-09T20:47:46.903444] [DEBUG] [LOCAL ] OWL: No derivative data file found to delete. [2025-10-09T20:47:46.903818] [INFO ] [MAIN ] Update Progress: 1619/2373 symbols completed. OWL took 44.0s. Estimated remaining: 1h 46m 3s. Rate: 7.1 symbols/min [2025-10-09T20:47:47.083339] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:47:47.083634] [DEBUG] [LOCAL ] PAC: No existing data file found in primary storage. [2025-10-09T20:47:47.083727] [WARN ] [MAIN ] PAC: No existing data found, performing full refresh instead. [2025-10-09T20:47:47.083851] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-09T20:47:47.083895] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-09T20:47:47.083937] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-09T20:47:47.083971] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-09T20:47:47.201935] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-09T20:47:47.478783] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:47:47.574571] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-09T20:47:47.996712] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-09T20:47:48.358369] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T20:47:48.796685] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-09T20:47:48.954003] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T20:47:49.596758] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-09T20:47:50.134124] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T20:47:50.396732] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-09T20:47:51.196714] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-09T20:47:51.502147] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T20:47:51.974059] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T20:47:51.996702] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-09T20:47:52.170271] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:47:52.796716] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-09T20:47:53.348224] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T20:47:53.596741] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-09T20:47:54.396696] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-09T20:47:54.488156] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T20:47:54.947536] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-09T20:47:55.196782] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-09T20:47:55.996741] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-09T20:47:56.135513] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T20:47:56.352524] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T20:47:56.796745] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-09T20:47:56.945718] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T20:47:57.596748] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-09T20:47:58.396688] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-09T20:47:58.673708] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T20:47:58.815127] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T20:47:58.819986] [INFO ] [REMOTE ] OXM: Full fetch complete (45825 records). [2025-10-09T20:47:58.820229] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-09T20:47:58.821564] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:47:58.821875] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:47:58.821960] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:47:58.822202] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-09T20:47:58.822387] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-09T20:47:58.822596] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-09T20:47:58.822719] [DEBUG] [LOCAL ] OXM: No derivative data file found to delete. [2025-10-09T20:47:58.822828] [INFO ] [MAIN ] Update Progress: 1620/2373 symbols completed. OXM took 25.3s. Estimated remaining: 1h 45m 56s. Rate: 7.1 symbols/min [2025-10-09T20:47:58.974956] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-09T20:47:59.056080] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:47:59.056262] [DEBUG] [LOCAL ] PACK: No existing data file found in primary storage. [2025-10-09T20:47:59.056300] [WARN ] [MAIN ] PACK: No existing data found, performing full refresh instead. [2025-10-09T20:47:59.056417] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-09T20:47:59.056459] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-09T20:47:59.056501] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-09T20:47:59.056534] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-09T20:47:59.203070] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-09T20:47:59.422379] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:47:59.996772] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-09T20:48:00.796728] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-09T20:48:01.592582] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-09T20:48:01.603934] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-09T20:48:01.712423] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T20:48:01.854129] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T20:48:02.396734] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-09T20:48:02.652264] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T20:48:03.196819] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-09T20:48:03.996729] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-09T20:48:04.796717] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-09T20:48:04.833984] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-09T20:48:04.890037] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T20:48:05.274992] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T20:48:05.596736] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-09T20:48:05.894780] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T20:48:06.396733] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-09T20:48:06.835599] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T20:48:07.196779] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-09T20:48:07.996721] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-09T20:48:08.680228] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-09T20:48:08.796733] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-09T20:48:09.257293] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-09T20:48:09.355090] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T20:48:09.596691] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-09T20:48:10.396712] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-09T20:48:10.575547] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T20:48:10.892015] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-09T20:48:11.196716] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-09T20:48:11.996686] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-09T20:48:12.522660] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-09T20:48:12.796770] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-09T20:48:12.918863] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T20:48:13.596756] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-09T20:48:13.650087] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-09T20:48:14.077922] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T20:48:14.396693] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-09T20:48:14.792884] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T20:48:15.196809] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-09T20:48:15.646238] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T20:48:15.648208] [INFO ] [REMOTE ] PAC: Full fetch complete (16456 records). [2025-10-09T20:48:15.648337] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-09T20:48:15.649205] [FATAL] [VALIDATOR ] PAC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:48:15.649316] [FATAL] [MAIN ] PAC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:48:15.649401] [WARN ] [MAIN ] PAC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:48:15.649507] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-09T20:48:15.649606] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-09T20:48:15.649697] [INFO ] [LOCAL ] PAC: Starting deletion of derivative data. [2025-10-09T20:48:15.649778] [DEBUG] [LOCAL ] PAC: No derivative data file found to delete. [2025-10-09T20:48:15.649865] [INFO ] [MAIN ] Update Progress: 1621/2373 symbols completed. PAC took 28.7s. Estimated remaining: 1h 45m 52s. Rate: 7.1 symbols/min [2025-10-09T20:48:15.843081] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:48:15.843311] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-09T20:48:15.843374] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-09T20:48:15.843495] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-09T20:48:15.843539] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-09T20:48:15.843582] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-09T20:48:15.843615] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-09T20:48:15.998007] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-09T20:48:16.214849] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:48:16.691938] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-09T20:48:16.796743] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-09T20:48:17.112700] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T20:48:17.596914] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-09T20:48:18.396783] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-09T20:48:18.398622] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T20:48:18.834369] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T20:48:19.196678] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-09T20:48:19.662170] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T20:48:19.777146] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T20:48:19.781486] [INFO ] [REMOTE ] PAAS: Full fetch complete (77026 records). [2025-10-09T20:48:19.781600] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-09T20:48:19.782610] [FATAL] [VALIDATOR ] PAAS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:48:19.782950] [FATAL] [MAIN ] PAAS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:48:19.782994] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:48:19.783031] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-09T20:48:19.783086] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-09T20:48:19.783122] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-09T20:48:19.783160] [DEBUG] [LOCAL ] PAAS: No derivative data file found to delete. [2025-10-09T20:48:19.783229] [INFO ] [MAIN ] Update Progress: 1622/2373 symbols completed. PAAS took 38.2s. Estimated remaining: 1h 45m 41s. Rate: 7.1 symbols/min [2025-10-09T20:48:19.954907] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:48:19.955094] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-09T20:48:19.955152] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-09T20:48:19.955263] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-09T20:48:19.955306] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-09T20:48:19.955350] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-09T20:48:19.955388] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-09T20:48:20.001939] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-09T20:48:20.318637] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:48:20.692729] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T20:48:20.696774] [INFO ] [REMOTE ] OXY: Full fetch complete (77180 records). [2025-10-09T20:48:20.696901] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-09T20:48:20.697567] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:48:20.697687] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:48:20.697741] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:48:20.697835] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-09T20:48:20.697948] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-09T20:48:20.698000] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-09T20:48:20.698044] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-09T20:48:20.698102] [INFO ] [MAIN ] Update Progress: 1623/2373 symbols completed. OXY took 40.0s. Estimated remaining: 1h 45m 30s. Rate: 7.1 symbols/min [2025-10-09T20:48:20.797188] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-09T20:48:20.867676] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:48:20.867875] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-09T20:48:20.867932] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-09T20:48:20.868042] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-09T20:48:20.868084] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-09T20:48:20.868125] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-09T20:48:20.868163] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-09T20:48:21.219803] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:48:21.596714] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-09T20:48:22.194387] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T20:48:22.396741] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-09T20:48:23.165698] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T20:48:23.196675] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-09T20:48:23.252936] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T20:48:23.996758] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-09T20:48:24.557409] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T20:48:24.786387] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T20:48:24.796670] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-09T20:48:25.596740] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-09T20:48:25.937305] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T20:48:26.396798] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-09T20:48:27.087361] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T20:48:27.196728] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-09T20:48:27.873789] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T20:48:27.996702] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-09T20:48:28.486942] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T20:48:28.796760] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-09T20:48:29.433184] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T20:48:29.596699] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-09T20:48:29.856585] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T20:48:30.396723] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-09T20:48:31.196697] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-09T20:48:31.461136] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T20:48:31.835415] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T20:48:31.914232] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T20:48:31.996678] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-09T20:48:32.796788] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-09T20:48:33.303880] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T20:48:33.420337] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T20:48:33.423465] [INFO ] [REMOTE ] PACK: Full fetch complete (44328 records). [2025-10-09T20:48:33.423558] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-09T20:48:33.424205] [FATAL] [VALIDATOR ] PACK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:48:33.424303] [FATAL] [MAIN ] PACK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:48:33.424355] [WARN ] [MAIN ] PACK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:48:33.424442] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-09T20:48:33.424531] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-09T20:48:33.424592] [INFO ] [LOCAL ] PACK: Starting deletion of derivative data. [2025-10-09T20:48:33.424679] [DEBUG] [LOCAL ] PACK: No derivative data file found to delete. [2025-10-09T20:48:33.424775] [INFO ] [MAIN ] Update Progress: 1624/2373 symbols completed. PACK took 34.6s. Estimated remaining: 1h 45m 23s. Rate: 7.1 symbols/min [2025-10-09T20:48:33.590831] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:48:33.597314] [DEBUG] [LOCAL ] PAI: Loaded 2658 existing records from primary storage. [2025-10-09T20:48:33.597447] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-09T20:48:33.597782] [INFO ] [MAIN ] PAI: Loaded 2658 existing records. [2025-10-09T20:48:33.779262] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:48:33.779425] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-09T20:48:33.779473] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-09T20:48:33.780368] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-09T20:48:33.780429] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-09T20:48:34.178883] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:48:34.396718] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-09T20:48:35.196745] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-09T20:48:35.546936] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-09T20:48:35.667918] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T20:48:35.996752] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-09T20:48:36.306490] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T20:48:36.796698] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-09T20:48:37.433328] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T20:48:37.596708] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-09T20:48:37.812534] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T20:48:38.396794] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-09T20:48:39.046590] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T20:48:39.066743] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T20:48:39.196697] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-09T20:48:39.823463] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T20:48:39.996719] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-09T20:48:40.622464] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T20:48:40.796754] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-09T20:48:41.349027] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T20:48:41.596742] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-09T20:48:42.228850] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T20:48:42.396732] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-09T20:48:42.966480] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T20:48:43.196784] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-09T20:48:43.812995] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T20:48:43.816694] [INFO ] [REMOTE ] PACS: Full fetch complete (50444 records). [2025-10-09T20:48:43.816842] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-09T20:48:43.817564] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:48:43.817692] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:48:43.817764] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:48:43.817829] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-09T20:48:43.817891] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-09T20:48:43.817928] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-09T20:48:43.817976] [DEBUG] [LOCAL ] PACS: No derivative data file found to delete. [2025-10-09T20:48:43.818069] [INFO ] [MAIN ] Update Progress: 1625/2373 symbols completed. PACS took 28.2s. Estimated remaining: 1h 45m 16s. Rate: 7.1 symbols/min [2025-10-09T20:48:43.998535] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-09T20:48:44.027507] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:48:44.031687] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-09T20:48:44.031770] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-09T20:48:44.031893] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-09T20:48:44.031937] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-09T20:48:44.031978] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-09T20:48:44.032011] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-09T20:48:44.399618] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:48:44.625273] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T20:48:44.796714] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-09T20:48:45.284625] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-09T20:48:45.596776] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-09T20:48:46.149586] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T20:48:46.396787] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-09T20:48:46.919143] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T20:48:47.196728] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-09T20:48:47.459101] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:48:47.459496] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-09T20:48:47.459596] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:48:47.459665] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-09T20:48:47.459730] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:48:47.459799] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-09T20:48:47.459862] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-09T20:48:47.459898] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-09T20:48:47.459938] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-09T20:48:47.459986] [INFO ] [MAIN ] Update Progress: 1626/2373 symbols completed. PAII took 3.6s. Estimated remaining: 1h 45m 5s. Rate: 7.1 symbols/min [2025-10-09T20:48:47.632771] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:48:47.663060] [DEBUG] [LOCAL ] PAM: Loaded 28118 existing records from primary storage. [2025-10-09T20:48:47.663377] [INFO ] [MAIN ] PAM: Loaded 28118 existing records. [2025-10-09T20:48:47.846799] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:48:47.847110] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-09T20:48:47.847167] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-09T20:48:47.847868] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-09T20:48:47.847928] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-09T20:48:48.023949] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-09T20:48:48.205407] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:48:48.796693] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-09T20:48:48.874084] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T20:48:49.596723] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-09T20:48:50.153938] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T20:48:50.396762] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-09T20:48:50.742124] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T20:48:51.196755] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-09T20:48:51.884601] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T20:48:51.996769] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-09T20:48:52.500102] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T20:48:52.500861] [INFO ] [REMOTE ] PAI: Full fetch complete (4020 records). [2025-10-09T20:48:52.500929] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-09T20:48:52.501275] [FATAL] [VALIDATOR ] PAI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:48:52.501362] [FATAL] [MAIN ] PAI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:48:52.501405] [WARN ] [MAIN ] PAI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:48:52.501444] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-09T20:48:52.501496] [DEBUG] [LOCAL ] PAI: No primary data file found to delete. [2025-10-09T20:48:52.501530] [INFO ] [LOCAL ] PAI: Starting deletion of derivative data. [2025-10-09T20:48:52.501817] [DEBUG] [LOCAL ] PAI: Deleted derivative data file. [2025-10-09T20:48:52.501905] [INFO ] [MAIN ] Update Progress: 1627/2373 symbols completed. PAI took 19.1s. Estimated remaining: 1h 44m 55s. Rate: 7.1 symbols/min [2025-10-09T20:48:52.673525] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:48:52.673844] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-09T20:48:52.673900] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-09T20:48:52.674083] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-09T20:48:52.674159] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-09T20:48:52.674367] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-09T20:48:52.674468] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-09T20:48:52.799129] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-09T20:48:53.066232] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:48:53.069000] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T20:48:53.596762] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-09T20:48:54.396702] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-09T20:48:54.458311] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T20:48:55.002198] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T20:48:55.196793] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-09T20:48:55.690974] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T20:48:55.996841] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-09T20:48:56.179057] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T20:48:56.796761] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-09T20:48:57.331512] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T20:48:57.596718] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-09T20:48:57.908889] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T20:48:58.401849] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-09T20:48:58.420584] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T20:48:59.196724] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-09T20:48:59.748768] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T20:48:59.996720] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-09T20:49:00.668576] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T20:49:00.796683] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-09T20:49:01.596692] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-09T20:49:01.770702] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T20:49:01.852103] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T20:49:02.396707] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-09T20:49:02.791869] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T20:49:03.196720] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-09T20:49:03.892231] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T20:49:03.996697] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-09T20:49:04.611616] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T20:49:04.796737] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-09T20:49:04.823114] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T20:49:05.596723] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-09T20:49:05.889332] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T20:49:06.396719] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-09T20:49:06.625950] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T20:49:07.196742] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-09T20:49:07.996701] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-09T20:49:08.200532] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T20:49:08.255716] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T20:49:08.651598] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T20:49:08.796705] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-09T20:49:09.294966] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T20:49:09.296921] [INFO ] [REMOTE ] PAG: Full fetch complete (30243 records). [2025-10-09T20:49:09.297000] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-09T20:49:09.297680] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:49:09.297816] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:49:09.297892] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:49:09.297979] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-09T20:49:09.298054] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-09T20:49:09.298090] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-09T20:49:09.298129] [DEBUG] [LOCAL ] PAG: No derivative data file found to delete. [2025-10-09T20:49:09.298186] [INFO ] [MAIN ] Update Progress: 1628/2373 symbols completed. PAG took 49.5s. Estimated remaining: 1h 44m 50s. Rate: 7.1 symbols/min [2025-10-09T20:49:09.469393] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:49:09.469580] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-09T20:49:09.469637] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-09T20:49:09.469781] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-09T20:49:09.469823] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-09T20:49:09.469866] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-09T20:49:09.469900] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-09T20:49:09.601835] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-09T20:49:09.838924] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:49:10.396769] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-09T20:49:11.196764] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-09T20:49:11.340524] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T20:49:11.369919] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T20:49:11.996700] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-09T20:49:12.252262] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T20:49:12.796804] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-09T20:49:13.279355] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T20:49:13.281918] [INFO ] [REMOTE ] PAM: Full fetch complete (41616 records). [2025-10-09T20:49:13.281996] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-09T20:49:13.282505] [FATAL] [VALIDATOR ] PAM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:49:13.282591] [FATAL] [MAIN ] PAM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:49:13.282634] [WARN ] [MAIN ] PAM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:49:13.282716] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-09T20:49:13.282777] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-09T20:49:13.282834] [INFO ] [LOCAL ] PAM: Starting deletion of derivative data. [2025-10-09T20:49:13.283154] [DEBUG] [LOCAL ] PAM: Deleted derivative data file. [2025-10-09T20:49:13.283257] [INFO ] [MAIN ] Update Progress: 1629/2373 symbols completed. PAM took 25.8s. Estimated remaining: 1h 44m 40s. Rate: 7.1 symbols/min [2025-10-09T20:49:13.453638] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:49:13.459996] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-09T20:49:13.469632] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-09T20:49:13.469839] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-09T20:49:13.470410] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-09T20:49:13.471109] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T20:49:13.471210] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-09T20:49:13.477585] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-09T20:49:13.601773] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-09T20:49:13.829769] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:49:14.396722] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-09T20:49:15.196754] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-09T20:49:15.400924] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T20:49:15.996707] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-09T20:49:16.708379] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-09T20:49:16.796707] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-09T20:49:17.182126] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T20:49:17.438434] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T20:49:17.562744] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T20:49:17.596673] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-09T20:49:18.396776] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-09T20:49:18.500824] [DEBUG] [REMOTE ] PAR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-09T20:49:18.501153] [WARN ] [REMOTE ] PAR: No data returned for month 2025-10 [2025-10-09T20:49:18.501248] [FATAL] [REMOTE ] PAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:49:18.501332] [FATAL] [MAIN ] PAR: Failed to fetch primary data. [2025-10-09T20:49:18.501397] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:49:18.501494] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-09T20:49:18.501560] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-09T20:49:18.501598] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-09T20:49:18.501638] [DEBUG] [LOCAL ] PAR: No derivative data file found to delete. [2025-10-09T20:49:18.501752] [INFO ] [MAIN ] Update Progress: 1630/2373 symbols completed. PAR took 26.0s. Estimated remaining: 1h 44m 30s. Rate: 7.1 symbols/min [2025-10-09T20:49:18.675746] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:49:18.675916] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-09T20:49:18.675952] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-09T20:49:18.676069] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-09T20:49:18.676109] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-09T20:49:18.676194] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-09T20:49:18.676234] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-09T20:49:19.044039] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:49:19.067929] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T20:49:19.196695] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-09T20:49:19.996773] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-09T20:49:20.796721] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-09T20:49:20.909304] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T20:49:21.151693] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T20:49:21.596722] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-09T20:49:22.270352] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T20:49:22.396783] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-09T20:49:22.759562] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T20:49:23.196740] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-09T20:49:23.247555] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T20:49:23.996757] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-09T20:49:24.796784] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-09T20:49:24.874969] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T20:49:25.107452] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T20:49:25.596718] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-09T20:49:26.283448] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T20:49:26.287521] [INFO ] [REMOTE ] PAGS: Full fetch complete (75922 records). [2025-10-09T20:49:26.287698] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-09T20:49:26.288466] [FATAL] [VALIDATOR ] PAGS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:49:26.288559] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:49:26.288604] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:49:26.288667] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-09T20:49:26.288749] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-09T20:49:26.288786] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-09T20:49:26.288898] [DEBUG] [LOCAL ] PAGS: No derivative data file found to delete. [2025-10-09T20:49:26.288976] [INFO ] [MAIN ] Update Progress: 1631/2373 symbols completed. PAGS took 1m 6s. Estimated remaining: 1h 44m 21s. Rate: 7.1 symbols/min [2025-10-09T20:49:26.400966] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-09T20:49:26.465039] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:49:26.465785] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-09T20:49:26.465924] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-09T20:49:26.466238] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-09T20:49:26.466422] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-09T20:49:26.466491] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-09T20:49:26.466527] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-09T20:49:26.792298] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T20:49:26.876771] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:49:27.196722] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-09T20:49:27.996766] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-09T20:49:28.561955] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-09T20:49:28.738067] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T20:49:28.796689] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-09T20:49:29.138812] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T20:49:29.596786] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-09T20:49:30.377352] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T20:49:30.396678] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-09T20:49:30.796172] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T20:49:31.196751] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-09T20:49:31.996699] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-09T20:49:32.241258] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T20:49:32.796733] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-09T20:49:32.925542] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T20:49:33.409150] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-09T20:49:33.596726] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-09T20:49:34.011028] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T20:49:34.396710] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-09T20:49:35.196776] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-09T20:49:35.634723] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T20:49:35.975751] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-09T20:49:35.996692] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-09T20:49:36.756483] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T20:49:36.796674] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-09T20:49:37.596722] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-09T20:49:38.265165] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-09T20:49:38.396727] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-09T20:49:38.562737] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T20:49:38.868637] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T20:49:39.196731] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-09T20:49:39.996753] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-09T20:49:40.669942] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T20:49:40.781863] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-09T20:49:40.796674] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-09T20:49:40.963579] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T20:49:41.596733] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-09T20:49:42.207804] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T20:49:42.396768] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-09T20:49:42.923140] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T20:49:42.929181] [INFO ] [REMOTE ] PARR: Full fetch complete (68650 records). [2025-10-09T20:49:42.929581] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-09T20:49:42.930860] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:49:42.931040] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:49:42.931127] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:49:42.931222] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-09T20:49:42.931349] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-09T20:49:42.931421] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-09T20:49:42.931506] [DEBUG] [LOCAL ] PARR: No derivative data file found to delete. [2025-10-09T20:49:42.931626] [INFO ] [MAIN ] Update Progress: 1632/2373 symbols completed. PARR took 33.6s. Estimated remaining: 1h 44m 16s. Rate: 7.1 symbols/min [2025-10-09T20:49:43.118300] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:49:43.118507] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-09T20:49:43.118562] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-09T20:49:43.118842] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-09T20:49:43.118900] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-09T20:49:43.118946] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-09T20:49:43.118980] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-09T20:49:43.213718] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-09T20:49:43.236902] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-09T20:49:43.516976] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:49:43.996700] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-09T20:49:44.392076] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T20:49:44.796743] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-09T20:49:44.942885] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T20:49:45.596730] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-09T20:49:46.396748] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-09T20:49:46.450625] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T20:49:46.746588] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T20:49:47.196679] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-09T20:49:47.216467] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T20:49:47.931927] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T20:49:47.938276] [INFO ] [REMOTE ] PATH: Full fetch complete (77374 records). [2025-10-09T20:49:47.938491] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-09T20:49:47.939770] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:49:47.939913] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:49:47.940010] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:49:47.940112] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-09T20:49:47.940208] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-09T20:49:47.940271] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-09T20:49:47.940342] [DEBUG] [LOCAL ] PATH: No derivative data file found to delete. [2025-10-09T20:49:47.940470] [INFO ] [MAIN ] Update Progress: 1633/2373 symbols completed. PATH took 34.7s. Estimated remaining: 1h 44m 6s. Rate: 7.1 symbols/min [2025-10-09T20:49:48.001877] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-09T20:49:48.225093] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:49:48.225334] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-09T20:49:48.225398] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-09T20:49:48.225557] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-09T20:49:48.225619] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-09T20:49:48.225729] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-09T20:49:48.225791] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-09T20:49:48.760021] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:49:48.796762] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-09T20:49:49.596701] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-09T20:49:49.704254] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T20:49:50.288491] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T20:49:50.396763] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-09T20:49:50.843284] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T20:49:51.196717] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-09T20:49:51.934079] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T20:49:51.958541] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T20:49:51.996690] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-09T20:49:52.510992] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T20:49:52.512753] [INFO ] [REMOTE ] PAXS: Full fetch complete (30334 records). [2025-10-09T20:49:52.512832] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-09T20:49:52.513293] [FATAL] [VALIDATOR ] PAXS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:49:52.513409] [FATAL] [MAIN ] PAXS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:49:52.513454] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:49:52.513494] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-09T20:49:52.513564] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-09T20:49:52.513622] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-09T20:49:52.513729] [DEBUG] [LOCAL ] PAXS: No derivative data file found to delete. [2025-10-09T20:49:52.513809] [INFO ] [MAIN ] Update Progress: 1634/2373 symbols completed. PAXS took 34.0s. Estimated remaining: 1h 43m 56s. Rate: 7.1 symbols/min [2025-10-09T20:49:52.701758] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:49:52.701981] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-09T20:49:52.702020] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-09T20:49:52.702143] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-09T20:49:52.702184] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-09T20:49:52.702225] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-09T20:49:52.702257] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-09T20:49:52.805102] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-09T20:49:53.072431] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:49:53.596755] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-09T20:49:54.068790] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T20:49:54.396746] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-09T20:49:55.188368] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T20:49:55.196809] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-09T20:49:55.733260] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T20:49:55.996731] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-09T20:49:56.796690] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-09T20:49:56.840552] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T20:49:57.237442] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T20:49:57.596738] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-09T20:49:58.396698] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-09T20:49:58.465925] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T20:49:58.684130] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T20:49:59.196728] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-09T20:49:59.739926] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T20:49:59.760752] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T20:49:59.764201] [INFO ] [REMOTE ] PAY: Full fetch complete (53310 records). [2025-10-09T20:49:59.764312] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-09T20:49:59.765014] [FATAL] [VALIDATOR ] PAY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:49:59.765108] [FATAL] [MAIN ] PAY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:49:59.765153] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:49:59.765275] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-09T20:49:59.765351] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-09T20:49:59.765390] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-09T20:49:59.765432] [DEBUG] [LOCAL ] PAY: No derivative data file found to delete. [2025-10-09T20:49:59.765492] [INFO ] [MAIN ] Update Progress: 1635/2373 symbols completed. PAY took 33.5s. Estimated remaining: 1h 43m 47s. Rate: 7.1 symbols/min [2025-10-09T20:49:59.941632] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:49:59.941815] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-09T20:49:59.941855] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-09T20:49:59.941968] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-09T20:49:59.942011] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-09T20:49:59.942054] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-09T20:49:59.942087] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-09T20:50:00.007277] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-09T20:50:00.306031] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:50:00.796717] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-09T20:50:01.596763] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-09T20:50:01.854683] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T20:50:02.396725] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-09T20:50:02.811176] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T20:50:02.986064] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T20:50:03.196724] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-09T20:50:03.788531] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T20:50:03.996764] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-09T20:50:04.796676] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-09T20:50:04.977808] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T20:50:05.348907] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T20:50:05.596708] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-09T20:50:06.396738] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-09T20:50:06.672680] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T20:50:07.196692] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-09T20:50:07.353631] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T20:50:07.996691] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-09T20:50:08.234023] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T20:50:08.465501] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T20:50:08.796754] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-09T20:50:09.539788] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T20:50:09.596726] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-09T20:50:10.392044] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T20:50:10.403290] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-09T20:50:11.196704] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-09T20:50:11.514224] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T20:50:11.981013] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T20:50:11.996669] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-09T20:50:12.796741] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-09T20:50:13.096766] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T20:50:13.253293] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T20:50:13.596773] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-09T20:50:14.396696] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-09T20:50:14.427961] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T20:50:15.196746] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-09T20:50:15.332624] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T20:50:15.929181] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T20:50:15.996791] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-09T20:50:16.796696] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-09T20:50:16.971132] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T20:50:17.010344] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T20:50:17.596720] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-09T20:50:18.043243] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T20:50:18.047303] [INFO ] [REMOTE ] PAYC: Full fetch complete (52622 records). [2025-10-09T20:50:18.047474] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-09T20:50:18.048444] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:50:18.048535] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:50:18.048604] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:50:18.048706] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-09T20:50:18.048799] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-09T20:50:18.048856] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-09T20:50:18.048915] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-09T20:50:18.049041] [INFO ] [MAIN ] Update Progress: 1636/2373 symbols completed. PAYC took 35.1s. Estimated remaining: 1h 43m 43s. Rate: 7.1 symbols/min [2025-10-09T20:50:18.268517] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:50:18.268882] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-09T20:50:18.268993] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-09T20:50:18.269147] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-09T20:50:18.269364] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-09T20:50:18.269498] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-09T20:50:18.269567] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-09T20:50:18.397249] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-09T20:50:18.648480] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T20:50:18.722101] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:50:19.196774] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-09T20:50:19.996713] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-09T20:50:20.235560] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T20:50:20.609795] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T20:50:20.796788] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-09T20:50:21.446335] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T20:50:21.596711] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-09T20:50:21.666692] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T20:50:22.396707] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-09T20:50:23.196741] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-09T20:50:23.290562] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T20:50:23.386266] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T20:50:23.996806] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-09T20:50:24.170946] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T20:50:24.432946] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:50:24.436509] [INFO ] [REMOTE ] PB: Full fetch complete (58680 records). [2025-10-09T20:50:24.436632] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-09T20:50:24.437462] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:50:24.437561] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:50:24.437608] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:50:24.437705] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-09T20:50:24.437811] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-09T20:50:24.437865] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-09T20:50:24.437910] [DEBUG] [LOCAL ] PB: No derivative data file found to delete. [2025-10-09T20:50:24.437971] [INFO ] [MAIN ] Update Progress: 1637/2373 symbols completed. PB took 36.5s. Estimated remaining: 1h 43m 34s. Rate: 7.1 symbols/min [2025-10-09T20:50:24.796716] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-09T20:50:25.596717] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-09T20:50:26.402468] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-09T20:50:26.415020] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T20:50:27.196691] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-09T20:50:27.464670] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T20:50:27.493006] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T20:50:27.858492] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:50:27.996758] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-09T20:50:28.796780] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-09T20:50:29.274013] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T20:50:29.596769] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-09T20:50:30.396710] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-09T20:50:30.482423] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T20:50:30.821933] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T20:50:31.190520] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T20:50:31.194490] [INFO ] [REMOTE ] PBA: Full fetch complete (71035 records). [2025-10-09T20:50:31.194631] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-09T20:50:31.196758] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-09T20:50:31.196702] [FATAL] [VALIDATOR ] PBA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:50:31.197041] [FATAL] [MAIN ] PBA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:50:31.197385] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:50:31.197507] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-09T20:50:31.198302] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-09T20:50:31.198355] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-09T20:50:31.198398] [DEBUG] [LOCAL ] PBA: No derivative data file found to delete. [2025-10-09T20:50:31.198473] [INFO ] [MAIN ] Update Progress: 1638/2373 symbols completed. PBA took 38.7s. Estimated remaining: 1h 43m 25s. Rate: 7.1 symbols/min [2025-10-09T20:50:31.953787] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T20:50:31.996673] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-09T20:50:32.642124] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T20:50:32.646232] [INFO ] [REMOTE ] PBF: Full fetch complete (76230 records). [2025-10-09T20:50:32.646382] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-09T20:50:32.647276] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:50:32.647369] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:50:32.647412] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:50:32.647451] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-09T20:50:32.647510] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-09T20:50:32.647546] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-09T20:50:32.647587] [DEBUG] [LOCAL ] PBF: No derivative data file found to delete. [2025-10-09T20:50:32.647671] [INFO ] [MAIN ] Update Progress: 1639/2373 symbols completed. PBF took 32.9s. Estimated remaining: 1h 43m 13s. Rate: 7.1 symbols/min [2025-10-09T20:50:32.796750] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-09T20:50:34.257884] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T20:50:34.265284] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-09T20:50:35.524907] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T20:50:35.534158] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-09T20:50:36.958879] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T20:50:36.966178] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-09T20:50:38.446070] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T20:50:38.454319] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-09T20:50:39.416088] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T20:50:39.425073] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-09T20:50:40.046279] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T20:50:40.049086] [INFO ] [REMOTE ] PBH: Full fetch complete (43642 records). [2025-10-09T20:50:40.049174] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-09T20:50:40.051214] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:50:40.051388] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:50:40.051434] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:50:40.051473] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-09T20:50:40.051535] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-09T20:50:40.051571] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-09T20:50:40.051610] [DEBUG] [LOCAL ] PBH: No derivative data file found to delete. [2025-10-09T20:50:40.051710] [INFO ] [MAIN ] Update Progress: 1640/2373 symbols completed. PBH took 22.0s. Estimated remaining: 1h 43m 4s. Rate: 7.1 symbols/min [2025-10-09T20:50:40.666621] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:50:40.772335] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:50:40.774945] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-09T20:50:40.770011] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:50:40.775046] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-09T20:50:40.775373] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-09T20:50:40.775165] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-09T20:50:40.775594] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-09T20:50:40.793247] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:50:40.793512] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-09T20:50:40.793673] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-09T20:50:40.793807] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-09T20:50:40.793965] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-09T20:50:40.794047] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-09T20:50:40.794273] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-09T20:50:40.794342] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-09T20:50:40.794171] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-09T20:50:40.794731] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-09T20:50:40.794785] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-09T20:50:40.794952] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-09T20:50:40.820209] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-09T20:50:40.864770] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-09T20:50:40.965065] [DEBUG] [LOCAL ] PCF: Loaded 9021 existing records from primary storage. [2025-10-09T20:50:41.012246] [INFO ] [MAIN ] PCF: Loaded 9021 existing records. [2025-10-09T20:50:41.606169] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:50:41.624498] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-09T20:50:41.715325] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-09T20:50:41.771591] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-09T20:50:41.801764] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-09T20:50:42.050702] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:50:42.074165] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-09T20:50:42.327918] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:50:42.345394] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-09T20:50:42.344965] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:50:42.410875] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-09T20:50:42.581634] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:50:42.582264] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-09T20:50:43.409683] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T20:50:43.413895] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-09T20:50:43.573118] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T20:50:43.577892] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-09T20:50:44.012484] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T20:50:44.015170] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-09T20:50:44.299459] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T20:50:44.309841] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-09T20:50:44.321029] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T20:50:44.325287] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-09T20:50:44.451755] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-09T20:50:44.796777] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-09T20:50:44.973238] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T20:50:45.302976] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T20:50:45.596747] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-09T20:50:45.799820] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T20:50:46.163791] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T20:50:46.396730] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-09T20:50:46.466438] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T20:50:47.196704] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-09T20:50:47.333596] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T20:50:47.996683] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-09T20:50:48.262508] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T20:50:48.796756] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-09T20:50:48.829052] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T20:50:49.596737] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-09T20:50:50.396723] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-09T20:50:50.510776] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T20:50:50.913197] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-09T20:50:50.944603] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T20:50:51.196727] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-09T20:50:51.996699] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-09T20:50:52.073668] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T20:50:52.796741] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-09T20:50:52.921891] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T20:50:53.596725] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-09T20:50:54.396753] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-09T20:50:54.509908] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T20:50:54.588253] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T20:50:54.896034] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T20:50:55.196739] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-09T20:50:55.996757] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-09T20:50:56.796829] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-09T20:50:57.123609] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T20:50:57.601799] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-09T20:50:57.609818] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T20:50:57.816479] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T20:50:58.396776] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-09T20:50:58.711111] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T20:50:59.196809] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-09T20:50:59.514546] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T20:50:59.689198] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T20:50:59.691829] [INFO ] [REMOTE ] PCF: Full fetch complete (13824 records). [2025-10-09T20:50:59.691990] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-09T20:50:59.692766] [FATAL] [VALIDATOR ] PCF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:50:59.692853] [FATAL] [MAIN ] PCF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:50:59.692896] [WARN ] [MAIN ] PCF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:50:59.692938] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-09T20:50:59.693010] [DEBUG] [LOCAL ] PCF: No primary data file found to delete. [2025-10-09T20:50:59.693066] [INFO ] [LOCAL ] PCF: Starting deletion of derivative data. [2025-10-09T20:50:59.693315] [DEBUG] [LOCAL ] PCF: Deleted derivative data file. [2025-10-09T20:50:59.693421] [INFO ] [MAIN ] Update Progress: 1641/2373 symbols completed. PCF took 19.6s. Estimated remaining: 1h 43m 1s. Rate: 7.1 symbols/min [2025-10-09T20:50:59.864786] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:50:59.864990] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-09T20:50:59.865046] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-09T20:50:59.865165] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-09T20:50:59.865208] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-09T20:50:59.865253] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-09T20:50:59.865289] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-09T20:51:00.003075] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-09T20:51:00.221911] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:51:00.796731] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-09T20:51:01.596735] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-09T20:51:01.908784] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T20:51:02.396723] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-09T20:51:02.873040] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T20:51:03.196739] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-09T20:51:03.785110] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-09T20:51:03.825763] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T20:51:03.996747] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-09T20:51:04.796741] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-09T20:51:04.984431] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T20:51:05.284314] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T20:51:05.596761] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-09T20:51:06.311513] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T20:51:06.396677] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-09T20:51:06.491135] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T20:51:07.196780] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-09T20:51:07.996842] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-09T20:51:08.257631] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T20:51:08.594539] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T20:51:08.596305] [INFO ] [REMOTE ] PBT: Full fetch complete (24922 records). [2025-10-09T20:51:08.596379] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-09T20:51:08.597048] [FATAL] [VALIDATOR ] PBT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:51:08.597149] [FATAL] [MAIN ] PBT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:51:08.597192] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:51:08.597255] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-09T20:51:08.597335] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-09T20:51:08.597384] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-09T20:51:08.597450] [DEBUG] [LOCAL ] PBT: No derivative data file found to delete. [2025-10-09T20:51:08.597533] [INFO ] [MAIN ] Update Progress: 1642/2373 symbols completed. PBT took 28.5s. Estimated remaining: 1h 42m 53s. Rate: 7.1 symbols/min [2025-10-09T20:51:08.770123] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:51:08.779594] [DEBUG] [LOCAL ] PCM: Loaded 6743 existing records from primary storage. [2025-10-09T20:51:08.779834] [INFO ] [MAIN ] PCM: Loaded 6743 existing records. [2025-10-09T20:51:08.801902] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-09T20:51:08.972349] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:51:08.972687] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-09T20:51:08.972840] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-09T20:51:08.973254] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-09T20:51:08.973424] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-09T20:51:09.297293] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-09T20:51:09.378817] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:51:09.596715] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-09T20:51:10.297197] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T20:51:10.396704] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-09T20:51:10.754439] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-09T20:51:11.196812] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-09T20:51:11.996703] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-09T20:51:12.257152] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T20:51:12.402107] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-09T20:51:12.681162] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T20:51:12.796720] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-09T20:51:13.582683] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T20:51:13.596712] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-09T20:51:14.396726] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-09T20:51:14.581659] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T20:51:15.196731] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-09T20:51:15.996748] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-09T20:51:16.253746] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T20:51:16.453621] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T20:51:16.719291] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T20:51:16.723432] [INFO ] [REMOTE ] PBI: Full fetch complete (71793 records). [2025-10-09T20:51:16.723544] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-09T20:51:16.724262] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:51:16.724378] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:51:16.724423] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:51:16.724464] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-09T20:51:16.724522] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-09T20:51:16.724559] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-09T20:51:16.724599] [DEBUG] [LOCAL ] PBI: No derivative data file found to delete. [2025-10-09T20:51:16.724689] [INFO ] [MAIN ] Update Progress: 1643/2373 symbols completed. PBI took 36.7s. Estimated remaining: 1h 42m 44s. Rate: 7.1 symbols/min [2025-10-09T20:51:16.801815] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-09T20:51:16.898753] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:51:16.931254] [DEBUG] [LOCAL ] PCN: Loaded 24722 existing records from primary storage. [2025-10-09T20:51:16.931502] [INFO ] [MAIN ] PCN: Loaded 24722 existing records. [2025-10-09T20:51:17.107430] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:51:17.107696] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-09T20:51:17.107850] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-09T20:51:17.108581] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-09T20:51:17.108639] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-09T20:51:17.465915] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T20:51:17.470190] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:51:17.596714] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-09T20:51:18.396710] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-09T20:51:18.514819] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T20:51:19.196734] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-09T20:51:19.996704] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-09T20:51:20.248955] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T20:51:20.382856] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T20:51:20.796714] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-09T20:51:21.596708] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-09T20:51:22.005037] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T20:51:22.077626] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T20:51:22.377563] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T20:51:22.396672] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-09T20:51:23.146615] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T20:51:23.196744] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-09T20:51:23.996716] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-09T20:51:24.127684] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T20:51:24.476680] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T20:51:24.796722] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-09T20:51:25.596734] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-09T20:51:26.396692] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-09T20:51:26.473478] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T20:51:26.768002] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T20:51:26.936639] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T20:51:26.937831] [INFO ] [REMOTE ] PCM: Full fetch complete (10347 records). [2025-10-09T20:51:26.937906] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-09T20:51:26.938284] [FATAL] [VALIDATOR ] PCM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:51:26.938386] [FATAL] [MAIN ] PCM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:51:26.938430] [WARN ] [MAIN ] PCM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:51:26.938495] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-09T20:51:26.938557] [DEBUG] [LOCAL ] PCM: No primary data file found to delete. [2025-10-09T20:51:26.938593] [INFO ] [LOCAL ] PCM: Starting deletion of derivative data. [2025-10-09T20:51:26.938766] [DEBUG] [LOCAL ] PCM: Deleted derivative data file. [2025-10-09T20:51:26.938852] [INFO ] [MAIN ] Update Progress: 1644/2373 symbols completed. PCM took 18.3s. Estimated remaining: 1h 42m 36s. Rate: 7.1 symbols/min [2025-10-09T20:51:27.106262] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:51:27.106513] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-09T20:51:27.106568] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-09T20:51:27.106706] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-09T20:51:27.106770] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-09T20:51:27.106814] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-09T20:51:27.106846] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-09T20:51:27.201903] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-09T20:51:27.461944] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:51:27.996783] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-09T20:51:28.796693] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-09T20:51:29.176524] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T20:51:29.310179] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-09T20:51:29.596720] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-09T20:51:30.396759] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-09T20:51:31.016378] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T20:51:31.196689] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-09T20:51:31.348623] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T20:51:31.754470] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-09T20:51:31.996729] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-09T20:51:32.562081] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T20:51:32.796762] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-09T20:51:33.596770] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-09T20:51:34.136982] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-09T20:51:34.396744] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-09T20:51:34.452861] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T20:51:34.877894] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T20:51:35.040359] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T20:51:35.196721] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-09T20:51:35.996742] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-09T20:51:36.796687] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-09T20:51:36.955034] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T20:51:37.004220] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T20:51:37.265695] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T20:51:37.596721] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-09T20:51:38.396788] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-09T20:51:38.707375] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T20:51:38.745210] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T20:51:38.749268] [INFO ] [REMOTE ] PCG: Full fetch complete (77348 records). [2025-10-09T20:51:38.749390] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-09T20:51:38.750228] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:51:38.750388] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:51:38.750459] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:51:38.750534] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-09T20:51:38.750600] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-09T20:51:38.750668] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-09T20:51:38.750760] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-09T20:51:38.750843] [INFO ] [MAIN ] Update Progress: 1645/2373 symbols completed. PCG took 39.1s. Estimated remaining: 1h 42m 29s. Rate: 7.1 symbols/min [2025-10-09T20:51:38.928066] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:51:38.942620] [DEBUG] [LOCAL ] PCQ: Loaded 12096 existing records from primary storage. [2025-10-09T20:51:38.942889] [INFO ] [MAIN ] PCQ: Loaded 12096 existing records. [2025-10-09T20:51:39.116880] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:51:39.117091] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-09T20:51:39.117138] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-09T20:51:39.117510] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-09T20:51:39.117569] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-09T20:51:39.201858] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-09T20:51:39.492724] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:51:39.996741] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-09T20:51:40.083772] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T20:51:40.713606] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T20:51:40.796718] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-09T20:51:41.596773] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-09T20:51:42.036165] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:51:42.038435] [INFO ] [REMOTE ] PCN: Full fetch complete (33930 records). [2025-10-09T20:51:42.038509] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-09T20:51:42.039061] [FATAL] [VALIDATOR ] PCN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:51:42.039145] [FATAL] [MAIN ] PCN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:51:42.039188] [WARN ] [MAIN ] PCN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:51:42.039253] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-09T20:51:42.039315] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-09T20:51:42.039350] [INFO ] [LOCAL ] PCN: Starting deletion of derivative data. [2025-10-09T20:51:42.039531] [DEBUG] [LOCAL ] PCN: Deleted derivative data file. [2025-10-09T20:51:42.039633] [INFO ] [MAIN ] Update Progress: 1646/2373 symbols completed. PCN took 25.3s. Estimated remaining: 1h 42m 19s. Rate: 7.1 symbols/min [2025-10-09T20:51:42.204788] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:51:42.204984] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-09T20:51:42.205020] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-09T20:51:42.205128] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-09T20:51:42.205220] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-09T20:51:42.205283] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-09T20:51:42.205316] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-09T20:51:42.405352] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-09T20:51:42.566880] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:51:42.632619] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T20:51:43.108638] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:51:43.196732] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-09T20:51:43.996733] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-09T20:51:44.718142] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T20:51:44.734089] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T20:51:44.796709] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-09T20:51:45.378756] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T20:51:45.596720] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-09T20:51:46.396708] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-09T20:51:46.692311] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T20:51:47.196734] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-09T20:51:47.747195] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T20:51:47.996727] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-09T20:51:48.019385] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T20:51:48.796720] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-09T20:51:49.596809] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-09T20:51:49.650206] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T20:51:49.988467] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T20:51:49.997737] [INFO ] [REMOTE ] PBR: Full fetch complete (77385 records). [2025-10-09T20:51:49.998024] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-09T20:51:49.999618] [FATAL] [VALIDATOR ] PBR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:51:49.999980] [FATAL] [MAIN ] PBR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:51:50.000033] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:51:50.000083] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-09T20:51:50.000154] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-09T20:51:50.000200] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-09T20:51:50.000284] [DEBUG] [LOCAL ] PBR: No derivative data file found to delete. [2025-10-09T20:51:50.000398] [INFO ] [MAIN ] Update Progress: 1647/2373 symbols completed. PBR took 1m 10s. Estimated remaining: 1h 42m 10s. Rate: 7.1 symbols/min [2025-10-09T20:51:50.201201] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:51:50.201451] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-09T20:51:50.201618] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-09T20:51:50.201849] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-09T20:51:50.202041] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-09T20:51:50.202138] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-09T20:51:50.202205] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-09T20:51:50.404461] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-09T20:51:50.536334] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T20:51:50.625399] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:51:51.196732] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-09T20:51:51.241695] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T20:51:51.996758] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-09T20:51:52.657405] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T20:51:52.796743] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-09T20:51:52.933373] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T20:51:53.596722] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-09T20:51:54.396760] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-09T20:51:54.601427] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T20:51:54.627900] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T20:51:55.196723] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-09T20:51:55.996717] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-09T20:51:56.179800] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T20:51:56.301104] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-09T20:51:56.788450] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T20:51:56.797506] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-09T20:51:57.596759] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-09T20:51:57.989256] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-09T20:51:58.396700] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-09T20:51:58.454099] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T20:51:58.962314] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T20:51:59.196731] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-09T20:51:59.996717] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-09T20:52:00.684027] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T20:52:00.796710] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-09T20:52:01.457304] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:52:01.596697] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-09T20:52:01.854880] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T20:52:02.104551] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T20:52:02.105896] [INFO ] [REMOTE ] PCQ: Full fetch complete (17044 records). [2025-10-09T20:52:02.105970] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-09T20:52:02.106383] [FATAL] [VALIDATOR ] PCQ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:52:02.106471] [FATAL] [MAIN ] PCQ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:52:02.106517] [WARN ] [MAIN ] PCQ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:52:02.106606] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-09T20:52:02.106717] [DEBUG] [LOCAL ] PCQ: No primary data file found to delete. [2025-10-09T20:52:02.106765] [INFO ] [LOCAL ] PCQ: Starting deletion of derivative data. [2025-10-09T20:52:02.106966] [DEBUG] [LOCAL ] PCQ: Deleted derivative data file. [2025-10-09T20:52:02.107059] [INFO ] [MAIN ] Update Progress: 1648/2373 symbols completed. PCQ took 23.4s. Estimated remaining: 1h 42m 3s. Rate: 7.1 symbols/min [2025-10-09T20:52:02.288847] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:52:02.339733] [DEBUG] [LOCAL ] PDI: Loaded 50091 existing records from primary storage. [2025-10-09T20:52:02.340112] [INFO ] [MAIN ] PDI: Loaded 50091 existing records. [2025-10-09T20:52:02.403259] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-09T20:52:02.525437] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:52:02.525682] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-09T20:52:02.525741] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-09T20:52:02.525980] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-09T20:52:02.526069] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-09T20:52:02.937528] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:52:03.008694] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T20:52:03.196740] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-09T20:52:03.996773] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-09T20:52:04.796761] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-09T20:52:05.230036] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T20:52:05.231530] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T20:52:05.596724] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-09T20:52:05.775339] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T20:52:06.396772] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-09T20:52:06.721247] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-09T20:52:07.125928] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T20:52:07.196679] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-09T20:52:07.996702] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-09T20:52:08.465182] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T20:52:08.796718] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-09T20:52:09.111169] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T20:52:09.338797] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T20:52:09.596733] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-09T20:52:09.931130] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-09T20:52:10.396734] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-09T20:52:11.196751] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-09T20:52:11.996710] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-09T20:52:12.102767] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T20:52:12.511335] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-09T20:52:12.796785] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-09T20:52:13.522295] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:52:13.525860] [INFO ] [REMOTE ] PCOR: Full fetch complete (69077 records). [2025-10-09T20:52:13.525960] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-09T20:52:13.526754] [FATAL] [VALIDATOR ] PCOR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:52:13.526853] [FATAL] [MAIN ] PCOR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:52:13.526930] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:52:13.527023] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-09T20:52:13.527104] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-09T20:52:13.527159] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-09T20:52:13.527229] [DEBUG] [LOCAL ] PCOR: No derivative data file found to delete. [2025-10-09T20:52:13.527293] [INFO ] [MAIN ] Update Progress: 1649/2373 symbols completed. PCOR took 46.6s. Estimated remaining: 1h 41m 56s. Rate: 7.1 symbols/min [2025-10-09T20:52:13.600123] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-09T20:52:13.704942] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:52:13.705283] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-09T20:52:13.705354] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-09T20:52:13.705490] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-09T20:52:13.705711] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-09T20:52:13.705777] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-09T20:52:13.705812] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-09T20:52:13.833244] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T20:52:13.935976] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T20:52:14.100242] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:52:14.396738] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-09T20:52:15.196731] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-09T20:52:15.788317] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T20:52:15.789006] [INFO ] [REMOTE ] PDCC: Full fetch complete (1338 records). [2025-10-09T20:52:15.789075] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-09T20:52:15.789408] [FATAL] [VALIDATOR ] PDCC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:52:15.789490] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:52:15.789533] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:52:15.789571] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-09T20:52:15.789625] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-09T20:52:15.789717] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-09T20:52:15.789798] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-09T20:52:15.789858] [INFO ] [MAIN ] Update Progress: 1650/2373 symbols completed. PDCC took 25.8s. Estimated remaining: 1h 41m 45s. Rate: 7.1 symbols/min [2025-10-09T20:52:15.960498] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:52:15.995067] [DEBUG] [LOCAL ] PDO: Loaded 31294 existing records from primary storage. [2025-10-09T20:52:15.995349] [INFO ] [MAIN ] PDO: Loaded 31294 existing records. [2025-10-09T20:52:16.006387] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-09T20:52:16.178758] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:52:16.179099] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-09T20:52:16.179251] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-09T20:52:16.179579] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-09T20:52:16.179637] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-09T20:52:16.567162] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:52:16.571447] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-09T20:52:16.796683] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-09T20:52:17.596692] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-09T20:52:17.727879] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T20:52:18.254851] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T20:52:18.396688] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-09T20:52:19.196696] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-09T20:52:19.647308] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T20:52:19.850782] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T20:52:19.996760] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-09T20:52:20.102512] [DEBUG] [REMOTE ] PDI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-09T20:52:20.102822] [WARN ] [REMOTE ] PDI: No data returned for month 2025-05 [2025-10-09T20:52:20.102917] [FATAL] [REMOTE ] PDI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:52:20.102999] [FATAL] [MAIN ] PDI: Failed to fetch primary data. [2025-10-09T20:52:20.103059] [WARN ] [MAIN ] PDI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:52:20.103108] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-09T20:52:20.103166] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-09T20:52:20.103206] [INFO ] [LOCAL ] PDI: Starting deletion of derivative data. [2025-10-09T20:52:20.103381] [DEBUG] [LOCAL ] PDI: Deleted derivative data file. [2025-10-09T20:52:20.103467] [INFO ] [MAIN ] Update Progress: 1651/2373 symbols completed. PDI took 18.0s. Estimated remaining: 1h 41m 35s. Rate: 7.1 symbols/min [2025-10-09T20:52:20.278248] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:52:20.278537] [DEBUG] [LOCAL ] PDS: No existing data file found in primary storage. [2025-10-09T20:52:20.278600] [WARN ] [MAIN ] PDS: No existing data found, performing full refresh instead. [2025-10-09T20:52:20.278770] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-09T20:52:20.278828] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-09T20:52:20.278876] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-09T20:52:20.278912] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-09T20:52:20.594836] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T20:52:20.680226] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:52:20.796710] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-09T20:52:21.596791] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-09T20:52:22.173173] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T20:52:22.396772] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-09T20:52:22.935111] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T20:52:23.196758] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-09T20:52:23.273697] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T20:52:23.996740] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-09T20:52:24.748011] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T20:52:24.796711] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-09T20:52:25.450289] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T20:52:25.596695] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-09T20:52:26.396698] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-09T20:52:26.511261] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T20:52:27.177367] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T20:52:27.196710] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-09T20:52:27.354369] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T20:52:27.996746] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-09T20:52:28.539152] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T20:52:28.796762] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-09T20:52:29.323443] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T20:52:29.453821] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T20:52:29.457891] [INFO ] [REMOTE ] PD: Full fetch complete (67612 records). [2025-10-09T20:52:29.458009] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-09T20:52:29.459984] [FATAL] [VALIDATOR ] PD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:52:29.460086] [FATAL] [MAIN ] PD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:52:29.460161] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:52:29.460251] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-09T20:52:29.460328] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-09T20:52:29.460365] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-09T20:52:29.460406] [DEBUG] [LOCAL ] PD: No derivative data file found to delete. [2025-10-09T20:52:29.460464] [INFO ] [MAIN ] Update Progress: 1652/2373 symbols completed. PD took 47.4s. Estimated remaining: 1h 41m 27s. Rate: 7.1 symbols/min [2025-10-09T20:52:29.606452] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-09T20:52:29.633788] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:52:29.651945] [DEBUG] [LOCAL ] PDT: Loaded 17424 existing records from primary storage. [2025-10-09T20:52:29.652200] [INFO ] [MAIN ] PDT: Loaded 17424 existing records. [2025-10-09T20:52:29.825236] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:52:29.825473] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-09T20:52:29.825519] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-09T20:52:29.826251] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-09T20:52:29.826310] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-09T20:52:30.196309] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:52:30.396690] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-09T20:52:30.775131] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T20:52:31.196776] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-09T20:52:31.893581] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T20:52:31.996700] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-09T20:52:32.505395] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T20:52:32.796744] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-09T20:52:33.171635] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T20:52:33.596782] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-09T20:52:34.095160] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T20:52:34.396693] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-09T20:52:34.824827] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T20:52:35.196749] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-09T20:52:35.865683] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T20:52:35.996686] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-09T20:52:36.128587] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T20:52:36.796725] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-09T20:52:37.503507] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T20:52:37.596694] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-09T20:52:37.844216] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T20:52:38.364740] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T20:52:38.396673] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-09T20:52:38.932502] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T20:52:38.935545] [INFO ] [REMOTE ] PDM: Full fetch complete (56879 records). [2025-10-09T20:52:38.935691] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-09T20:52:38.936423] [FATAL] [VALIDATOR ] PDM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:52:38.936529] [FATAL] [MAIN ] PDM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:52:38.936599] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:52:38.936688] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-09T20:52:38.936762] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-09T20:52:38.936799] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-09T20:52:38.936839] [DEBUG] [LOCAL ] PDM: No derivative data file found to delete. [2025-10-09T20:52:38.936921] [INFO ] [MAIN ] Update Progress: 1653/2373 symbols completed. PDM took 25.4s. Estimated remaining: 1h 41m 19s. Rate: 7.1 symbols/min [2025-10-09T20:52:39.107310] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:52:39.107465] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-09T20:52:39.107520] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-09T20:52:39.107691] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-09T20:52:39.107768] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-09T20:52:39.107836] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-09T20:52:39.107872] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-09T20:52:39.201850] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-09T20:52:39.481947] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:52:39.996767] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-09T20:52:40.644234] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T20:52:40.796764] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-09T20:52:41.041044] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T20:52:41.596770] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-09T20:52:42.051383] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T20:52:42.396790] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-09T20:52:42.451776] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T20:52:43.190318] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T20:52:43.196665] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-09T20:52:43.996688] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-09T20:52:44.306363] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T20:52:44.796729] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-09T20:52:44.858028] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T20:52:45.596758] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-09T20:52:45.972001] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T20:52:46.396733] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-09T20:52:46.983686] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T20:52:47.196680] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-09T20:52:47.308578] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T20:52:47.933794] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T20:52:47.996672] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-09T20:52:48.796718] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-09T20:52:48.973482] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T20:52:49.596695] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-09T20:52:49.670283] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-09T20:52:50.396699] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-09T20:52:50.681971] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T20:52:51.196704] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-09T20:52:51.264060] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T20:52:51.996699] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-09T20:52:52.257350] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T20:52:52.429144] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T20:52:52.431955] [INFO ] [REMOTE ] PDO: Full fetch complete (47020 records). [2025-10-09T20:52:52.432057] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-09T20:52:52.432884] [FATAL] [VALIDATOR ] PDO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:52:52.433011] [FATAL] [MAIN ] PDO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:52:52.433074] [WARN ] [MAIN ] PDO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:52:52.433144] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-09T20:52:52.433214] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-09T20:52:52.433249] [INFO ] [LOCAL ] PDO: Starting deletion of derivative data. [2025-10-09T20:52:52.433396] [DEBUG] [LOCAL ] PDO: Deleted derivative data file. [2025-10-09T20:52:52.433503] [INFO ] [MAIN ] Update Progress: 1654/2373 symbols completed. PDO took 36.6s. Estimated remaining: 1h 41m 12s. Rate: 7.1 symbols/min [2025-10-09T20:52:52.652057] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:52:52.652328] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-09T20:52:52.652390] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-09T20:52:52.652533] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-09T20:52:52.652584] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-09T20:52:52.652628] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-09T20:52:52.652707] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-09T20:52:52.801849] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-09T20:52:53.088294] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:52:53.596754] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-09T20:52:54.018802] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T20:52:54.396718] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-09T20:52:55.196740] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-09T20:52:55.413191] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T20:52:55.498275] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T20:52:55.996702] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-09T20:52:56.195325] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T20:52:56.796713] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-09T20:52:57.364822] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T20:52:57.567060] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T20:52:57.596672] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-09T20:52:58.055767] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:52:58.057818] [INFO ] [REMOTE ] PDS: Full fetch complete (25395 records). [2025-10-09T20:52:58.057897] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-09T20:52:58.058456] [FATAL] [VALIDATOR ] PDS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:52:58.058544] [FATAL] [MAIN ] PDS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:52:58.058610] [WARN ] [MAIN ] PDS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:52:58.058698] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-09T20:52:58.058772] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-09T20:52:58.058809] [INFO ] [LOCAL ] PDS: Starting deletion of derivative data. [2025-10-09T20:52:58.058925] [DEBUG] [LOCAL ] PDS: No derivative data file found to delete. [2025-10-09T20:52:58.059009] [INFO ] [MAIN ] Update Progress: 1655/2373 symbols completed. PDS took 38.0s. Estimated remaining: 1h 41m 3s. Rate: 7.1 symbols/min [2025-10-09T20:52:58.278583] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:52:58.278857] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-09T20:52:58.278915] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-09T20:52:58.279036] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-09T20:52:58.279088] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-09T20:52:58.279150] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-09T20:52:58.279221] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-09T20:52:58.401912] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-09T20:52:58.712811] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:52:59.196738] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-09T20:52:59.576444] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T20:52:59.996759] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-09T20:53:00.797023] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-09T20:53:01.008775] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T20:53:01.596687] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-09T20:53:01.650138] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T20:53:01.721595] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T20:53:02.396784] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-09T20:53:02.858802] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:53:02.860983] [INFO ] [REMOTE ] PDT: Full fetch complete (25141 records). [2025-10-09T20:53:02.861087] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-09T20:53:02.861572] [FATAL] [VALIDATOR ] PDT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:53:02.861686] [FATAL] [MAIN ] PDT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:53:02.861738] [WARN ] [MAIN ] PDT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:53:02.861778] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-09T20:53:02.861832] [DEBUG] [LOCAL ] PDT: No primary data file found to delete. [2025-10-09T20:53:02.861866] [INFO ] [LOCAL ] PDT: Starting deletion of derivative data. [2025-10-09T20:53:02.862046] [DEBUG] [LOCAL ] PDT: Deleted derivative data file. [2025-10-09T20:53:02.862136] [INFO ] [MAIN ] Update Progress: 1656/2373 symbols completed. PDT took 33.4s. Estimated remaining: 1h 40m 53s. Rate: 7.1 symbols/min [2025-10-09T20:53:03.033161] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:53:03.033797] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-09T20:53:03.033855] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-09T20:53:03.033968] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-09T20:53:03.034013] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-09T20:53:03.034054] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-09T20:53:03.034088] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-09T20:53:03.199759] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-09T20:53:03.409524] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:53:03.548863] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-09T20:53:03.996683] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-09T20:53:04.291829] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T20:53:04.796736] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-09T20:53:05.596695] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-09T20:53:05.667865] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T20:53:06.233302] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T20:53:06.396739] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-09T20:53:07.196763] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-09T20:53:07.406518] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T20:53:07.996708] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-09T20:53:08.099692] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T20:53:08.308336] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T20:53:08.796723] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-09T20:53:09.596738] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-09T20:53:10.040061] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-09T20:53:10.178896] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T20:53:10.277367] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T20:53:10.396738] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-09T20:53:11.196730] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-09T20:53:11.852681] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T20:53:11.996757] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-09T20:53:12.576272] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T20:53:12.796687] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-09T20:53:13.272740] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T20:53:13.596907] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-09T20:53:14.010216] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T20:53:14.396726] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-09T20:53:15.206495] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-09T20:53:15.228373] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T20:53:15.724847] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T20:53:15.996718] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-09T20:53:16.796703] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-09T20:53:17.093086] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T20:53:17.256351] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T20:53:17.314240] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T20:53:17.315542] [INFO ] [REMOTE ] PDX: Full fetch complete (23789 records). [2025-10-09T20:53:17.315613] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-09T20:53:17.316211] [FATAL] [VALIDATOR ] PDX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:53:17.316321] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:53:17.316366] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:53:17.316416] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-09T20:53:17.316509] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-09T20:53:17.316580] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-09T20:53:17.316671] [DEBUG] [LOCAL ] PDX: No derivative data file found to delete. [2025-10-09T20:53:17.316771] [INFO ] [MAIN ] Update Progress: 1657/2373 symbols completed. PDX took 38.4s. Estimated remaining: 1h 40m 47s. Rate: 7.1 symbols/min [2025-10-09T20:53:17.492413] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:53:17.506487] [DEBUG] [LOCAL ] PEO: Loaded 11184 existing records from primary storage. [2025-10-09T20:53:17.506740] [INFO ] [MAIN ] PEO: Loaded 11184 existing records. [2025-10-09T20:53:17.601787] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-09T20:53:17.717342] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:53:17.717562] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-09T20:53:17.717606] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-09T20:53:17.717892] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-09T20:53:17.717951] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-09T20:53:18.068794] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:53:18.396720] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-09T20:53:19.189707] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T20:53:19.196668] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-09T20:53:19.265085] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T20:53:19.871355] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T20:53:19.996783] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-09T20:53:20.710979] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T20:53:20.796709] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-09T20:53:21.596737] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-09T20:53:22.138839] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T20:53:22.396809] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-09T20:53:23.155544] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T20:53:23.196687] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-09T20:53:23.525133] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T20:53:23.996755] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-09T20:53:24.243288] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T20:53:24.796780] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-09T20:53:25.596691] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-09T20:53:25.835835] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T20:53:25.867294] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T20:53:26.239735] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T20:53:26.244975] [INFO ] [REMOTE ] PEB: Full fetch complete (72572 records). [2025-10-09T20:53:26.245110] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-09T20:53:26.246033] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:53:26.246129] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:53:26.246174] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:53:26.246215] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-09T20:53:26.246287] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-09T20:53:26.246347] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-09T20:53:26.246392] [DEBUG] [LOCAL ] PEB: No derivative data file found to delete. [2025-10-09T20:53:26.246455] [INFO ] [MAIN ] Update Progress: 1658/2373 symbols completed. PEB took 33.8s. Estimated remaining: 1h 40m 39s. Rate: 7.1 symbols/min [2025-10-09T20:53:26.415313] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:53:26.409095] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-09T20:53:26.416323] [DEBUG] [LOCAL ] PERF: No existing data file found in primary storage. [2025-10-09T20:53:26.416384] [WARN ] [MAIN ] PERF: No existing data found, performing full refresh instead. [2025-10-09T20:53:26.416520] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-09T20:53:26.416585] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-09T20:53:26.416701] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-09T20:53:26.416765] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-09T20:53:26.778435] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:53:27.196760] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-09T20:53:27.996710] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-09T20:53:28.178205] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T20:53:28.688805] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T20:53:28.796677] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-09T20:53:29.089403] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T20:53:29.350066] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T20:53:29.596744] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-09T20:53:30.371820] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T20:53:30.396732] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-09T20:53:31.196742] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-09T20:53:31.356113] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T20:53:31.996691] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-09T20:53:32.132866] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T20:53:32.740733] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T20:53:32.744836] [INFO ] [REMOTE ] PEG: Full fetch complete (76331 records). [2025-10-09T20:53:32.744975] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-09T20:53:32.745929] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:53:32.746011] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:53:32.746095] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:53:32.746169] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-09T20:53:32.746256] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-09T20:53:32.746311] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-09T20:53:32.746354] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-09T20:53:32.746415] [INFO ] [MAIN ] Update Progress: 1659/2373 symbols completed. PEG took 34.7s. Estimated remaining: 1h 40m 29s. Rate: 7.1 symbols/min [2025-10-09T20:53:32.803774] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-09T20:53:32.922874] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:53:32.923064] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-09T20:53:32.923100] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-09T20:53:32.923211] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-09T20:53:32.923252] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-09T20:53:32.923292] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-09T20:53:32.923324] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-09T20:53:33.271139] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:53:33.596793] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-09T20:53:34.366419] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T20:53:34.396767] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-09T20:53:34.462003] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T20:53:34.988227] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T20:53:35.196771] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-09T20:53:35.482350] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T20:53:35.482715] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-09T20:53:35.482812] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:53:35.482867] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-09T20:53:35.482935] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:53:35.483010] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-09T20:53:35.483075] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-09T20:53:35.483112] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-09T20:53:35.483153] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-09T20:53:35.483201] [INFO ] [MAIN ] Update Progress: 1660/2373 symbols completed. PEW took 2.7s. Estimated remaining: 1h 40m 18s. Rate: 7.1 symbols/min [2025-10-09T20:53:35.657829] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:53:35.658037] [DEBUG] [LOCAL ] PFD: No existing data file found in primary storage. [2025-10-09T20:53:35.658074] [WARN ] [MAIN ] PFD: No existing data found, performing full refresh instead. [2025-10-09T20:53:35.658183] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-09T20:53:35.658224] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-09T20:53:35.658264] [DEBUG] [LOCAL ] PFD: No primary data file found to delete. [2025-10-09T20:53:35.658321] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-09T20:53:36.000252] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-09T20:53:36.023959] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:53:36.796699] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-09T20:53:37.188277] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T20:53:37.495698] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T20:53:37.498954] [INFO ] [REMOTE ] PEN: Full fetch complete (43983 records). [2025-10-09T20:53:37.499086] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-09T20:53:37.499952] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:53:37.500049] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:53:37.500095] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:53:37.500140] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-09T20:53:37.500209] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-09T20:53:37.500277] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-09T20:53:37.500361] [DEBUG] [LOCAL ] PEN: No derivative data file found to delete. [2025-10-09T20:53:37.500461] [INFO ] [MAIN ] Update Progress: 1661/2373 symbols completed. PEN took 34.6s. Estimated remaining: 1h 40m 7s. Rate: 7.1 symbols/min [2025-10-09T20:53:37.601964] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-09T20:53:37.690711] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:53:37.690995] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-09T20:53:37.691053] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-09T20:53:37.691185] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-09T20:53:37.691230] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-09T20:53:37.691273] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-09T20:53:37.691308] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-09T20:53:38.078691] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:53:38.396696] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-09T20:53:38.578457] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T20:53:39.119566] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T20:53:39.196688] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-09T20:53:39.988082] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T20:53:39.996670] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-09T20:53:40.730714] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T20:53:40.796677] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-09T20:53:41.596702] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-09T20:53:41.790555] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T20:53:42.351474] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T20:53:42.396692] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-09T20:53:43.196715] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-09T20:53:43.382883] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T20:53:43.996772] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-09T20:53:44.796858] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-09T20:53:44.855773] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T20:53:45.179688] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-09T20:53:45.596710] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-09T20:53:45.963620] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T20:53:45.965433] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-09T20:53:45.978231] [INFO ] [REMOTE ] PEO: Full fetch complete (16199 records). [2025-10-09T20:53:45.978325] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-09T20:53:45.978889] [FATAL] [VALIDATOR ] PEO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:53:45.978974] [FATAL] [MAIN ] PEO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:53:45.979041] [WARN ] [MAIN ] PEO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:53:45.979115] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-09T20:53:45.979182] [DEBUG] [LOCAL ] PEO: No primary data file found to delete. [2025-10-09T20:53:45.979223] [INFO ] [LOCAL ] PEO: Starting deletion of derivative data. [2025-10-09T20:53:45.979395] [DEBUG] [LOCAL ] PEO: Deleted derivative data file. [2025-10-09T20:53:45.979486] [INFO ] [MAIN ] Update Progress: 1662/2373 symbols completed. PEO took 28.7s. Estimated remaining: 1h 39m 59s. Rate: 7.1 symbols/min [2025-10-09T20:53:46.153089] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:53:46.153293] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-09T20:53:46.153349] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-09T20:53:46.153470] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-09T20:53:46.153520] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-09T20:53:46.153563] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-09T20:53:46.153596] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-09T20:53:46.401918] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-09T20:53:46.512222] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:53:47.196790] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-09T20:53:47.859114] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T20:53:47.996786] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-09T20:53:48.723549] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T20:53:48.801850] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-09T20:53:48.819297] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-09T20:53:49.596725] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-09T20:53:50.245001] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T20:53:50.288033] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T20:53:50.396672] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-09T20:53:51.196771] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-09T20:53:51.977724] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T20:53:51.996712] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-09T20:53:52.030507] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T20:53:52.796737] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-09T20:53:53.596692] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-09T20:53:53.679209] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T20:53:54.394606] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T20:53:54.396911] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-09T20:53:54.580605] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-09T20:53:55.196683] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-09T20:53:55.534383] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T20:53:55.996742] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-09T20:53:56.712219] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T20:53:56.796712] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-09T20:53:57.304235] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T20:53:57.596734] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-09T20:53:57.885186] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-09T20:53:57.897228] [INFO ] [REMOTE ] PFD: Full fetch complete (7567 records). [2025-10-09T20:53:57.915285] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-09T20:53:57.917090] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-09T20:53:57.917725] [FATAL] [VALIDATOR ] PFD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:53:57.928422] [FATAL] [MAIN ] PFD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:53:57.928585] [WARN ] [MAIN ] PFD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:53:57.928872] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-09T20:53:57.929053] [DEBUG] [LOCAL ] PFD: No primary data file found to delete. [2025-10-09T20:53:57.929103] [INFO ] [LOCAL ] PFD: Starting deletion of derivative data. [2025-10-09T20:53:57.929428] [DEBUG] [LOCAL ] PFD: No derivative data file found to delete. [2025-10-09T20:53:57.929507] [INFO ] [MAIN ] Update Progress: 1663/2373 symbols completed. PFD took 22.4s. Estimated remaining: 1h 39m 52s. Rate: 7.1 symbols/min [2025-10-09T20:53:58.100259] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:53:58.100513] [DEBUG] [LOCAL ] PFH: No existing data file found in primary storage. [2025-10-09T20:53:58.100571] [WARN ] [MAIN ] PFH: No existing data found, performing full refresh instead. [2025-10-09T20:53:58.100719] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-09T20:53:58.100796] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-09T20:53:58.100865] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-09T20:53:58.100905] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-09T20:53:58.401869] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-09T20:53:58.471636] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:53:59.196757] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-09T20:53:59.758521] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T20:53:59.996772] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-09T20:54:00.100500] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T20:54:00.796736] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-09T20:54:01.271857] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T20:54:01.596763] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-09T20:54:02.396712] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-09T20:54:02.428749] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T20:54:03.061737] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T20:54:03.196783] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-09T20:54:03.782375] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T20:54:03.996749] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-09T20:54:04.583225] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-10-09T20:54:04.796725] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-09T20:54:05.596778] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-09T20:54:05.729819] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T20:54:05.984830] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T20:54:05.986467] [INFO ] [REMOTE ] PERF: Full fetch complete (21922 records). [2025-10-09T20:54:05.986540] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-09T20:54:05.987060] [FATAL] [VALIDATOR ] PERF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:54:05.987143] [FATAL] [MAIN ] PERF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:54:05.987186] [WARN ] [MAIN ] PERF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:54:05.987249] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-09T20:54:05.987310] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-09T20:54:05.987345] [INFO ] [LOCAL ] PERF: Starting deletion of derivative data. [2025-10-09T20:54:05.987385] [DEBUG] [LOCAL ] PERF: No derivative data file found to delete. [2025-10-09T20:54:05.987440] [INFO ] [MAIN ] Update Progress: 1664/2373 symbols completed. PERF took 39.7s. Estimated remaining: 1h 39m 43s. Rate: 7.1 symbols/min [2025-10-09T20:54:06.155238] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:54:06.172991] [DEBUG] [LOCAL ] PFL: Loaded 13952 existing records from primary storage. [2025-10-09T20:54:06.173248] [INFO ] [MAIN ] PFL: Loaded 13952 existing records. [2025-10-09T20:54:06.390137] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:54:06.390386] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-09T20:54:06.390462] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-09T20:54:06.390798] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-09T20:54:06.390859] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-09T20:54:06.402691] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-09T20:54:06.840071] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:54:07.196702] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-09T20:54:07.326296] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-09T20:54:07.782206] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T20:54:07.996717] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-09T20:54:08.254585] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T20:54:08.675085] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T20:54:08.796702] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-09T20:54:09.596696] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-09T20:54:10.184970] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T20:54:10.396700] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-09T20:54:10.660264] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T20:54:11.196708] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-09T20:54:11.963343] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T20:54:11.996697] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-09T20:54:12.739427] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-09T20:54:12.796707] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-09T20:54:12.995668] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T20:54:13.596760] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-09T20:54:13.621412] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T20:54:14.396780] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-09T20:54:14.726938] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T20:54:15.196725] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-09T20:54:15.996768] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-09T20:54:16.636947] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T20:54:16.796688] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-09T20:54:16.888058] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T20:54:16.999517] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-09T20:54:17.596707] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-09T20:54:17.617486] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T20:54:18.396752] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-09T20:54:19.179692] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T20:54:19.196673] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-09T20:54:19.375994] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T20:54:19.996718] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-09T20:54:20.356545] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T20:54:20.796716] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-09T20:54:21.114590] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-09T20:54:21.115676] [INFO ] [REMOTE ] PFH: Full fetch complete (10050 records). [2025-10-09T20:54:21.115750] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-09T20:54:21.116248] [FATAL] [VALIDATOR ] PFH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:54:21.116385] [FATAL] [MAIN ] PFH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:54:21.116450] [WARN ] [MAIN ] PFH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:54:21.116542] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-09T20:54:21.116714] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-09T20:54:21.116798] [INFO ] [LOCAL ] PFH: Starting deletion of derivative data. [2025-10-09T20:54:21.116894] [DEBUG] [LOCAL ] PFH: No derivative data file found to delete. [2025-10-09T20:54:21.117001] [INFO ] [MAIN ] Update Progress: 1665/2373 symbols completed. PFH took 23.2s. Estimated remaining: 1h 39m 38s. Rate: 7.1 symbols/min [2025-10-09T20:54:21.295002] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:54:21.295208] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-09T20:54:21.295247] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-09T20:54:21.295357] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-09T20:54:21.295399] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-09T20:54:21.295441] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-09T20:54:21.295473] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-09T20:54:21.601905] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-09T20:54:21.685746] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:54:21.791579] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-09T20:54:22.315955] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-09T20:54:22.396782] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-09T20:54:23.196747] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-09T20:54:23.996711] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-09T20:54:24.156225] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T20:54:24.796703] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-09T20:54:24.837388] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T20:54:24.914577] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T20:54:25.596724] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-09T20:54:26.396693] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-09T20:54:26.509019] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T20:54:26.544523] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T20:54:27.196692] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-09T20:54:27.312186] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T20:54:27.996684] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-09T20:54:28.042048] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T20:54:28.046920] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-10-09T20:54:28.047049] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-09T20:54:28.048004] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:54:28.048103] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:54:28.048186] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:54:28.048277] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-09T20:54:28.048354] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-09T20:54:28.048394] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-09T20:54:28.048437] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-09T20:54:28.048550] [INFO ] [MAIN ] Update Progress: 1666/2373 symbols completed. PFE took 50.5s. Estimated remaining: 1h 39m 29s. Rate: 7.1 symbols/min [2025-10-09T20:54:28.215779] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:54:28.239188] [DEBUG] [LOCAL ] PFN: Loaded 22096 existing records from primary storage. [2025-10-09T20:54:28.239435] [INFO ] [MAIN ] PFN: Loaded 22096 existing records. [2025-10-09T20:54:28.417435] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:54:28.417638] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-09T20:54:28.417717] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-09T20:54:28.418062] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-09T20:54:28.418128] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-09T20:54:28.718337] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T20:54:28.777073] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:54:28.796661] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-09T20:54:29.596697] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-09T20:54:29.889823] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T20:54:30.396735] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-09T20:54:31.196692] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-09T20:54:31.273602] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T20:54:31.402175] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T20:54:31.996682] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-09T20:54:32.125277] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T20:54:32.796721] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-09T20:54:33.596731] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-09T20:54:33.704412] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T20:54:33.944032] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T20:54:33.953410] [INFO ] [REMOTE ] PFGC: Full fetch complete (67123 records). [2025-10-09T20:54:33.963378] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-09T20:54:33.964823] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T20:54:33.971126] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:54:33.971997] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:54:33.972066] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:54:33.972139] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-09T20:54:33.972204] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-09T20:54:33.972240] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-09T20:54:33.972279] [DEBUG] [LOCAL ] PFGC: No derivative data file found to delete. [2025-10-09T20:54:33.972340] [INFO ] [MAIN ] Update Progress: 1667/2373 symbols completed. PFGC took 48.0s. Estimated remaining: 1h 39m 19s. Rate: 7.1 symbols/min [2025-10-09T20:54:34.145695] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:54:34.154094] [DEBUG] [LOCAL ] PFO: Loaded 6048 existing records from primary storage. [2025-10-09T20:54:34.154335] [INFO ] [MAIN ] PFO: Loaded 6048 existing records. [2025-10-09T20:54:34.336501] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:54:34.336716] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-09T20:54:34.336770] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-09T20:54:34.336957] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-09T20:54:34.337013] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-09T20:54:34.401930] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-09T20:54:34.688044] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:54:35.196769] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-09T20:54:35.544028] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T20:54:35.996753] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-09T20:54:36.743909] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T20:54:36.776771] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T20:54:36.796675] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-09T20:54:37.424367] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T20:54:37.596739] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-09T20:54:37.939492] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T20:54:37.941556] [INFO ] [REMOTE ] PFL: Full fetch complete (20158 records). [2025-10-09T20:54:37.941639] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-09T20:54:37.942139] [FATAL] [VALIDATOR ] PFL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:54:37.942223] [FATAL] [MAIN ] PFL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:54:37.942289] [WARN ] [MAIN ] PFL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:54:37.942363] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-09T20:54:37.942427] [DEBUG] [LOCAL ] PFL: No primary data file found to delete. [2025-10-09T20:54:37.942466] [INFO ] [LOCAL ] PFL: Starting deletion of derivative data. [2025-10-09T20:54:37.942687] [DEBUG] [LOCAL ] PFL: Deleted derivative data file. [2025-10-09T20:54:37.942808] [INFO ] [MAIN ] Update Progress: 1668/2373 symbols completed. PFL took 32.0s. Estimated remaining: 1h 39m 9s. Rate: 7.1 symbols/min [2025-10-09T20:54:38.119288] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:54:38.119413] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-09T20:54:38.119452] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-09T20:54:38.119564] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-09T20:54:38.119606] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-09T20:54:38.119676] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-09T20:54:38.119732] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-09T20:54:38.403689] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-09T20:54:38.486419] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:54:39.196716] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-09T20:54:39.996688] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-09T20:54:40.293223] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T20:54:40.323790] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T20:54:40.668713] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T20:54:40.796690] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-09T20:54:41.596726] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-09T20:54:42.005456] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T20:54:42.396735] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-09T20:54:42.815347] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T20:54:43.196869] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-09T20:54:43.846837] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T20:54:43.996742] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-09T20:54:44.190364] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T20:54:44.796773] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-09T20:54:45.289525] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T20:54:45.596763] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-09T20:54:45.990318] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T20:54:46.396729] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-09T20:54:46.891299] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T20:54:47.123633] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T20:54:47.196734] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-09T20:54:47.915785] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T20:54:47.996696] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-09T20:54:48.796797] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-09T20:54:49.596697] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-09T20:54:49.630697] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T20:54:49.930410] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T20:54:50.396719] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-09T20:54:51.196690] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-09T20:54:51.375489] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T20:54:51.435996] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T20:54:51.996705] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-09T20:54:52.796757] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-09T20:54:52.990974] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T20:54:53.162095] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T20:54:53.519586] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T20:54:53.596689] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-09T20:54:54.313004] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T20:54:54.396753] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-09T20:54:55.196722] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-09T20:54:55.672285] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T20:54:55.673404] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T20:54:55.996719] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-09T20:54:56.528528] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T20:54:56.796746] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-09T20:54:57.596728] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-09T20:54:57.628307] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T20:54:58.396722] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-09T20:54:58.454224] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T20:54:58.932970] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T20:54:59.196770] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-09T20:54:59.914358] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T20:54:59.919160] [INFO ] [REMOTE ] PFLT: Full fetch complete (63553 records). [2025-10-09T20:54:59.919320] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-09T20:54:59.920127] [FATAL] [VALIDATOR ] PFLT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:54:59.920230] [FATAL] [MAIN ] PFLT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:54:59.920305] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:54:59.920380] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-09T20:54:59.920446] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-09T20:54:59.920496] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-09T20:54:59.920565] [DEBUG] [LOCAL ] PFLT: No derivative data file found to delete. [2025-10-09T20:54:59.920627] [INFO ] [MAIN ] Update Progress: 1669/2373 symbols completed. PFLT took 38.8s. Estimated remaining: 1h 39m 6s. Rate: 7.1 symbols/min [2025-10-09T20:55:00.001896] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-09T20:55:00.171863] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:55:00.172080] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-09T20:55:00.172124] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-09T20:55:00.172247] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-09T20:55:00.172288] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-09T20:55:00.172347] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-09T20:55:00.172379] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-09T20:55:00.570807] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:55:00.703513] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T20:55:00.707480] [INFO ] [REMOTE ] PFN: Full fetch complete (30888 records). [2025-10-09T20:55:00.707586] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-09T20:55:00.708448] [FATAL] [VALIDATOR ] PFN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:55:00.708557] [FATAL] [MAIN ] PFN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:55:00.708609] [WARN ] [MAIN ] PFN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:55:00.708718] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-09T20:55:00.708807] [DEBUG] [LOCAL ] PFN: No primary data file found to delete. [2025-10-09T20:55:00.708855] [INFO ] [LOCAL ] PFN: Starting deletion of derivative data. [2025-10-09T20:55:00.709167] [DEBUG] [LOCAL ] PFN: Deleted derivative data file. [2025-10-09T20:55:00.709292] [INFO ] [MAIN ] Update Progress: 1670/2373 symbols completed. PFN took 32.7s. Estimated remaining: 1h 38m 54s. Rate: 7.1 symbols/min [2025-10-09T20:55:00.801892] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-09T20:55:00.899426] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:55:00.899738] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-09T20:55:00.899791] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-09T20:55:00.899942] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-09T20:55:00.899998] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-09T20:55:00.900043] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-09T20:55:00.900080] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-09T20:55:01.304809] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:55:01.401794] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T20:55:01.596737] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-09T20:55:01.820667] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-09T20:55:01.821576] [INFO ] [REMOTE ] PFO: Full fetch complete (7831 records). [2025-10-09T20:55:01.821680] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-09T20:55:01.822116] [FATAL] [VALIDATOR ] PFO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:55:01.822209] [FATAL] [MAIN ] PFO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:55:01.822257] [WARN ] [MAIN ] PFO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:55:01.822303] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-09T20:55:01.822366] [DEBUG] [LOCAL ] PFO: No primary data file found to delete. [2025-10-09T20:55:01.822408] [INFO ] [LOCAL ] PFO: Starting deletion of derivative data. [2025-10-09T20:55:01.822786] [DEBUG] [LOCAL ] PFO: Deleted derivative data file. [2025-10-09T20:55:01.822888] [INFO ] [MAIN ] Update Progress: 1671/2373 symbols completed. PFO took 27.9s. Estimated remaining: 1h 38m 43s. Rate: 7.1 symbols/min [2025-10-09T20:55:02.007465] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:55:02.015432] [DEBUG] [LOCAL ] PGP: Loaded 5659 existing records from primary storage. [2025-10-09T20:55:02.015705] [INFO ] [MAIN ] PGP: Loaded 5659 existing records. [2025-10-09T20:55:02.199149] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:55:02.199396] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-09T20:55:02.199443] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-09T20:55:02.199693] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-09T20:55:02.199751] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-09T20:55:02.403294] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-09T20:55:02.556865] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:55:03.196706] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-09T20:55:03.967708] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T20:55:03.996683] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-09T20:55:04.686891] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T20:55:04.725416] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-09T20:55:04.796696] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-09T20:55:05.596716] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-09T20:55:06.006879] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T20:55:06.019912] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-09T20:55:06.396763] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-09T20:55:07.196714] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-09T20:55:07.446027] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T20:55:07.996731] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-09T20:55:08.796732] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-09T20:55:09.409100] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-09T20:55:09.560454] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T20:55:09.596723] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-09T20:55:09.601974] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T20:55:10.396736] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-09T20:55:11.196811] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-09T20:55:11.508912] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T20:55:11.637969] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T20:55:11.996712] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-09T20:55:12.043703] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T20:55:12.796802] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-09T20:55:13.478379] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T20:55:13.596700] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-09T20:55:13.841279] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T20:55:14.396730] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-09T20:55:15.115016] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T20:55:15.196676] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-09T20:55:15.996767] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-09T20:55:16.395350] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T20:55:16.575375] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-09T20:55:16.796758] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-09T20:55:17.461582] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T20:55:17.584709] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T20:55:17.596669] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-09T20:55:18.394786] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T20:55:18.397208] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-09T20:55:19.193128] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T20:55:19.196670] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-09T20:55:19.781898] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T20:55:19.996725] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-09T20:55:20.796713] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-09T20:55:20.930217] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T20:55:21.596738] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-09T20:55:22.200317] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T20:55:22.201433] [INFO ] [REMOTE ] PGP: Full fetch complete (7849 records). [2025-10-09T20:55:22.201501] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-09T20:55:22.201968] [FATAL] [VALIDATOR ] PGP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:55:22.202067] [FATAL] [MAIN ] PGP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:55:22.202149] [WARN ] [MAIN ] PGP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:55:22.202325] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-09T20:55:22.202403] [DEBUG] [LOCAL ] PGP: No primary data file found to delete. [2025-10-09T20:55:22.202442] [INFO ] [LOCAL ] PGP: Starting deletion of derivative data. [2025-10-09T20:55:22.202605] [DEBUG] [LOCAL ] PGP: Deleted derivative data file. [2025-10-09T20:55:22.202718] [INFO ] [MAIN ] Update Progress: 1672/2373 symbols completed. PGP took 20.4s. Estimated remaining: 1h 38m 39s. Rate: 7.1 symbols/min [2025-10-09T20:55:22.383340] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:55:22.383532] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-09T20:55:22.383587] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-09T20:55:22.383755] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-09T20:55:22.383821] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-09T20:55:22.383874] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-09T20:55:22.383907] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-09T20:55:22.404758] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-09T20:55:22.753468] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:55:22.811319] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T20:55:23.137526] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:55:23.143753] [INFO ] [REMOTE ] PFS: Full fetch complete (51477 records). [2025-10-09T20:55:23.143863] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-09T20:55:23.144816] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:55:23.144903] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:55:23.144970] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:55:23.145045] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-09T20:55:23.145120] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-09T20:55:23.145175] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-09T20:55:23.145251] [DEBUG] [LOCAL ] PFS: No derivative data file found to delete. [2025-10-09T20:55:23.145330] [INFO ] [MAIN ] Update Progress: 1673/2373 symbols completed. PFS took 45.2s. Estimated remaining: 1h 38m 28s. Rate: 7.1 symbols/min [2025-10-09T20:55:23.202275] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-09T20:55:23.323931] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:55:23.324159] [DEBUG] [LOCAL ] PGRE: No existing data file found in primary storage. [2025-10-09T20:55:23.324217] [WARN ] [MAIN ] PGRE: No existing data found, performing full refresh instead. [2025-10-09T20:55:23.324331] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-09T20:55:23.324375] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-09T20:55:23.324417] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-09T20:55:23.324451] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-09T20:55:23.679214] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:55:23.996719] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-09T20:55:24.481030] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T20:55:24.796781] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-09T20:55:25.596729] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-09T20:55:25.917668] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T20:55:26.396704] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-09T20:55:26.875527] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T20:55:27.118743] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T20:55:27.196680] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-09T20:55:27.714182] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T20:55:27.996690] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-09T20:55:28.379829] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T20:55:28.796808] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-09T20:55:29.596788] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-09T20:55:30.047709] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-09T20:55:30.304056] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T20:55:30.396694] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-09T20:55:31.196713] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-09T20:55:31.467363] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T20:55:31.959428] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-09T20:55:31.996684] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-09T20:55:32.443039] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T20:55:32.796790] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-09T20:55:33.596724] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-09T20:55:34.327621] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-09T20:55:34.396677] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-09T20:55:34.424450] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T20:55:35.196752] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-09T20:55:35.259881] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T20:55:35.491476] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T20:55:35.996768] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-09T20:55:36.796745] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-09T20:55:36.915128] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T20:55:37.210124] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T20:55:37.596786] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-09T20:55:38.396769] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-09T20:55:38.981058] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-09T20:55:39.070498] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T20:55:39.196694] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-09T20:55:39.350292] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T20:55:39.996731] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-09T20:55:40.453322] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T20:55:40.787048] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T20:55:40.792246] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-10-09T20:55:40.792377] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-09T20:55:40.793363] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:55:40.793495] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:55:40.793576] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:55:40.793675] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-09T20:55:40.793772] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-09T20:55:40.793816] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-09T20:55:40.793864] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-09T20:55:40.793972] [INFO ] [MAIN ] Update Progress: 1674/2373 symbols completed. PG took 40.1s. Estimated remaining: 1h 38m 23s. Rate: 7.1 symbols/min [2025-10-09T20:55:40.806879] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-09T20:55:40.973543] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:55:40.981292] [DEBUG] [LOCAL ] PGZ: Loaded 5471 existing records from primary storage. [2025-10-09T20:55:40.981470] [INFO ] [MAIN ] PGZ: Loaded 5471 existing records. [2025-10-09T20:55:41.158983] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:55:41.159201] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-09T20:55:41.159258] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-09T20:55:41.159521] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-09T20:55:41.159580] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-09T20:55:41.515456] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:55:41.596722] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-09T20:55:41.687011] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T20:55:42.396730] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-09T20:55:43.196757] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-09T20:55:43.449304] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T20:55:43.860765] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T20:55:43.863362] [INFO ] [REMOTE ] PFSI: Full fetch complete (41084 records). [2025-10-09T20:55:43.863442] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-09T20:55:43.864000] [FATAL] [VALIDATOR ] PFSI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:55:43.864117] [FATAL] [MAIN ] PFSI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:55:43.864174] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:55:43.864215] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-09T20:55:43.864298] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-09T20:55:43.864353] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-09T20:55:43.864408] [DEBUG] [LOCAL ] PFSI: No derivative data file found to delete. [2025-10-09T20:55:43.864486] [INFO ] [MAIN ] Update Progress: 1675/2373 symbols completed. PFSI took 43.9s. Estimated remaining: 1h 38m 13s. Rate: 7.1 symbols/min [2025-10-09T20:55:44.005001] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-09T20:55:44.039254] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:55:44.039454] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-09T20:55:44.039505] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-09T20:55:44.039615] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-09T20:55:44.039689] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-09T20:55:44.039751] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-09T20:55:44.039788] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-09T20:55:44.407056] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:55:44.448208] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T20:55:44.764981] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T20:55:44.796665] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-09T20:55:45.596710] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-09T20:55:45.636836] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T20:55:46.396697] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-09T20:55:47.196728] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-09T20:55:47.396867] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T20:55:47.996706] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-09T20:55:48.067226] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T20:55:48.796699] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-09T20:55:48.903313] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T20:55:49.014675] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T20:55:49.423929] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T20:55:49.596788] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-09T20:55:50.231453] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T20:55:50.235318] [INFO ] [REMOTE ] PGRE: Full fetch complete (63805 records). [2025-10-09T20:55:50.235424] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-09T20:55:50.236395] [FATAL] [VALIDATOR ] PGRE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:55:50.236501] [FATAL] [MAIN ] PGRE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:55:50.236579] [WARN ] [MAIN ] PGRE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:55:50.236696] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-09T20:55:50.236822] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-09T20:55:50.236877] [INFO ] [LOCAL ] PGRE: Starting deletion of derivative data. [2025-10-09T20:55:50.236921] [DEBUG] [LOCAL ] PGRE: No derivative data file found to delete. [2025-10-09T20:55:50.236989] [INFO ] [MAIN ] Update Progress: 1676/2373 symbols completed. PGRE took 27.1s. Estimated remaining: 1h 38m 3s. Rate: 7.1 symbols/min [2025-10-09T20:55:50.412473] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-09T20:55:50.417598] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:55:50.433050] [DEBUG] [LOCAL ] PHD: Loaded 10753 existing records from primary storage. [2025-10-09T20:55:50.433368] [INFO ] [MAIN ] PHD: Loaded 10753 existing records. [2025-10-09T20:55:50.617833] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:55:50.618055] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-10-09T20:55:50.618107] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-09T20:55:50.618306] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-10-09T20:55:50.618362] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-10-09T20:55:50.985879] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:55:51.196707] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-09T20:55:51.855528] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T20:55:51.996737] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-10-09T20:55:52.131217] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T20:55:52.552169] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T20:55:52.796722] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-10-09T20:55:53.596877] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-09T20:55:53.711677] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T20:55:54.396738] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-10-09T20:55:55.196717] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-09T20:55:55.237659] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T20:55:55.678756] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-09T20:55:55.938639] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T20:55:55.996685] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-10-09T20:55:56.656484] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T20:55:56.796796] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-10-09T20:55:57.596724] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-09T20:55:57.719922] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T20:55:58.396700] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-10-09T20:55:59.003254] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T20:55:59.028717] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T20:55:59.196742] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-09T20:55:59.996770] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-09T20:56:00.502623] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T20:56:00.796690] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-09T20:56:01.219505] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T20:56:01.596791] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-10-09T20:56:02.396789] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-09T20:56:02.406897] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T20:56:03.021222] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-09T20:56:03.196687] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-09T20:56:03.996697] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-09T20:56:04.354350] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T20:56:04.664892] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T20:56:04.796679] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-09T20:56:05.319927] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T20:56:05.596734] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-09T20:56:06.176152] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T20:56:06.301904] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T20:56:06.396711] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-09T20:56:07.196746] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-10-09T20:56:07.257709] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T20:56:07.996754] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-09T20:56:08.132635] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T20:56:08.617245] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T20:56:08.796738] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-09T20:56:09.169874] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-09T20:56:09.596738] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-09T20:56:10.363954] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-09T20:56:10.368771] [INFO ] [REMOTE ] PGR: Full fetch complete (76111 records). [2025-10-09T20:56:10.369018] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-09T20:56:10.370305] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:56:10.370611] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:56:10.370719] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:56:10.370799] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-09T20:56:10.370889] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-09T20:56:10.370948] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-09T20:56:10.370993] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-09T20:56:10.371096] [INFO ] [MAIN ] Update Progress: 1677/2373 symbols completed. PGR took 48.2s. Estimated remaining: 1h 37m 60s. Rate: 7.1 symbols/min [2025-10-09T20:56:10.396722] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-09T20:56:10.888508] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T20:56:10.889535] [INFO ] [REMOTE ] PGZ: Full fetch complete (8790 records). [2025-10-09T20:56:10.889627] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-09T20:56:10.890078] [FATAL] [VALIDATOR ] PGZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:56:10.890215] [FATAL] [MAIN ] PGZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:56:10.890285] [WARN ] [MAIN ] PGZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:56:10.890357] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-09T20:56:10.890421] [DEBUG] [LOCAL ] PGZ: No primary data file found to delete. [2025-10-09T20:56:10.890458] [INFO ] [LOCAL ] PGZ: Starting deletion of derivative data. [2025-10-09T20:56:10.890684] [DEBUG] [LOCAL ] PGZ: Deleted derivative data file. [2025-10-09T20:56:10.890789] [INFO ] [MAIN ] Update Progress: 1678/2373 symbols completed. PGZ took 30.1s. Estimated remaining: 1h 37m 48s. Rate: 7.1 symbols/min [2025-10-09T20:56:11.196754] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-10-09T20:56:11.996695] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-09T20:56:12.147623] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T20:56:12.796761] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-10-09T20:56:13.462842] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T20:56:13.531150] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T20:56:13.596696] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-09T20:56:14.396748] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-10. [2025-10-09T20:56:15.133379] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T20:56:15.135194] [INFO ] [REMOTE ] PHD: Full fetch complete (14848 records). [2025-10-09T20:56:15.135265] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-10-09T20:56:15.135731] [FATAL] [VALIDATOR ] PHD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:56:15.135836] [FATAL] [MAIN ] PHD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:56:15.135982] [WARN ] [MAIN ] PHD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:56:15.136020] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-09T20:56:15.136075] [DEBUG] [LOCAL ] PHD: No primary data file found to delete. [2025-10-09T20:56:15.136110] [INFO ] [LOCAL ] PHD: Starting deletion of derivative data. [2025-10-09T20:56:15.136271] [DEBUG] [LOCAL ] PHD: Deleted derivative data file. [2025-10-09T20:56:15.136371] [INFO ] [MAIN ] Update Progress: 1679/2373 symbols completed. PHD took 24.9s. Estimated remaining: 1h 37m 38s. Rate: 7.1 symbols/min [2025-10-09T20:56:15.328801] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T20:56:15.336891] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-09T20:56:17.000860] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T20:56:17.009474] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-09T20:56:17.742025] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T20:56:17.749851] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-09T20:56:18.340752] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T20:56:18.343110] [INFO ] [REMOTE ] PH: Full fetch complete (55599 records). [2025-10-09T20:56:18.343192] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-09T20:56:18.343884] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:56:18.343968] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:56:18.344011] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:56:18.344090] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-09T20:56:18.344165] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-09T20:56:18.344202] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-09T20:56:18.344242] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-09T20:56:18.344311] [INFO ] [MAIN ] Update Progress: 1680/2373 symbols completed. PH took 34.5s. Estimated remaining: 1h 37m 27s. Rate: 7.1 symbols/min [2025-10-09T20:56:19.000304] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:56:19.056358] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:56:19.048827] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:56:19.058533] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-09T20:56:19.072979] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-09T20:56:19.076163] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:56:19.076383] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-09T20:56:19.076802] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-09T20:56:19.076531] [DEBUG] [LOCAL ] PHI: No existing data file found in primary storage. [2025-10-09T20:56:19.076921] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-09T20:56:19.077036] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-09T20:56:19.077189] [WARN ] [MAIN ] PHI: No existing data found, performing full refresh instead. [2025-10-09T20:56:19.077473] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-09T20:56:19.077572] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-09T20:56:19.077304] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-09T20:56:19.083196] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-09T20:56:19.083284] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-09T20:56:19.083394] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-09T20:56:19.098734] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-09T20:56:19.113374] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-09T20:56:19.176409] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-09T20:56:19.176472] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-09T20:56:19.431855] [DEBUG] [LOCAL ] PHK: Loaded 26593 existing records from primary storage. [2025-10-09T20:56:19.474545] [INFO ] [MAIN ] PHK: Loaded 26593 existing records. [2025-10-09T20:56:20.246968] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:56:20.284268] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:56:20.287822] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-09T20:56:20.307971] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-09T20:56:20.321341] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-09T20:56:20.327819] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:56:20.329119] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-09T20:56:20.329484] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-09T20:56:20.340003] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-09T20:56:20.480977] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:56:20.492853] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-09T20:56:20.759914] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:56:20.760187] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-09T20:56:21.702899] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T20:56:21.706822] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-09T20:56:21.760990] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T20:56:21.768908] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-09T20:56:22.105270] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T20:56:22.211211] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T20:56:22.396688] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-09T20:56:22.513510] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T20:56:23.185276] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T20:56:23.196667] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-09T20:56:23.996730] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-09T20:56:24.040129] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T20:56:24.386262] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T20:56:24.796746] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-09T20:56:25.021500] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T20:56:25.421422] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T20:56:25.596760] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-09T20:56:26.396734] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-09T20:56:27.151795] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T20:56:27.188555] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T20:56:27.196673] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-09T20:56:27.996800] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-09T20:56:28.299842] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T20:56:28.796726] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-09T20:56:29.418837] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T20:56:29.596700] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-09T20:56:29.895533] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T20:56:30.396771] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-09T20:56:31.021798] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T20:56:31.196693] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-09T20:56:31.437270] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T20:56:31.996717] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-09T20:56:32.796772] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-09T20:56:33.036274] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T20:56:33.110452] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T20:56:33.596718] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-09T20:56:34.045153] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T20:56:34.396722] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-09T20:56:35.078921] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T20:56:35.196719] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-09T20:56:35.418755] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T20:56:35.996726] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-09T20:56:36.588373] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T20:56:36.796695] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-09T20:56:37.140110] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T20:56:37.596686] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-09T20:56:38.396697] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-09T20:56:38.465803] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T20:56:38.511685] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T20:56:39.196706] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-09T20:56:39.844121] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T20:56:39.996742] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-09T20:56:40.204843] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T20:56:40.796734] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-09T20:56:41.596733] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-09T20:56:42.083328] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T20:56:42.155744] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T20:56:42.396734] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-09T20:56:42.820316] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T20:56:43.196721] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-09T20:56:43.996756] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-09T20:56:44.151064] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T20:56:44.327863] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T20:56:44.502453] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T20:56:44.796775] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-09T20:56:45.596706] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-09T20:56:45.998103] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T20:56:46.396711] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-09T20:56:46.561716] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T20:56:47.068737] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T20:56:47.196688] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-09T20:56:47.957086] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T20:56:47.996667] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-09T20:56:48.461805] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T20:56:48.463711] [INFO ] [REMOTE ] PHI: Full fetch complete (20879 records). [2025-10-09T20:56:48.463807] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-09T20:56:48.464547] [FATAL] [VALIDATOR ] PHI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:56:48.464690] [FATAL] [MAIN ] PHI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:56:48.464745] [WARN ] [MAIN ] PHI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:56:48.464813] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-09T20:56:48.464892] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-09T20:56:48.464946] [INFO ] [LOCAL ] PHI: Starting deletion of derivative data. [2025-10-09T20:56:48.464990] [DEBUG] [LOCAL ] PHI: No derivative data file found to delete. [2025-10-09T20:56:48.465043] [INFO ] [MAIN ] Update Progress: 1681/2373 symbols completed. PHI took 30.1s. Estimated remaining: 1h 37m 28s. Rate: 7.1 symbols/min [2025-10-09T20:56:48.632993] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:56:48.633150] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-09T20:56:48.633186] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-09T20:56:48.633298] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-09T20:56:48.633338] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-09T20:56:48.633379] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-09T20:56:48.633411] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-09T20:56:48.801898] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-09T20:56:49.002791] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:56:49.535219] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T20:56:49.537793] [INFO ] [REMOTE ] PHIN: Full fetch complete (47528 records). [2025-10-09T20:56:49.537892] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-09T20:56:49.538595] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:56:49.538702] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:56:49.538763] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:56:49.538849] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-09T20:56:49.538928] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-09T20:56:49.538978] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-09T20:56:49.539037] [DEBUG] [LOCAL ] PHIN: No derivative data file found to delete. [2025-10-09T20:56:49.539110] [INFO ] [MAIN ] Update Progress: 1682/2373 symbols completed. PHIN took 31.2s. Estimated remaining: 1h 37m 16s. Rate: 7.1 symbols/min [2025-10-09T20:56:49.602243] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-09T20:56:49.723777] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:56:49.723964] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-09T20:56:49.724022] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-09T20:56:49.724133] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-09T20:56:49.724176] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-09T20:56:49.724219] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-09T20:56:49.724253] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-09T20:56:50.093330] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:56:50.396768] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-09T20:56:50.748785] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T20:56:50.751916] [INFO ] [REMOTE ] PHG: Full fetch complete (65186 records). [2025-10-09T20:56:50.752020] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-09T20:56:50.752713] [FATAL] [VALIDATOR ] PHG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:56:50.752840] [FATAL] [MAIN ] PHG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:56:50.752883] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:56:50.752922] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-09T20:56:50.752977] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-09T20:56:50.753011] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-09T20:56:50.753049] [DEBUG] [LOCAL ] PHG: No derivative data file found to delete. [2025-10-09T20:56:50.753104] [INFO ] [MAIN ] Update Progress: 1683/2373 symbols completed. PHG took 32.4s. Estimated remaining: 1h 37m 5s. Rate: 7.1 symbols/min [2025-10-09T20:56:50.917020] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:56:50.917189] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-09T20:56:50.917244] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-09T20:56:50.917353] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-09T20:56:50.917394] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-09T20:56:50.917433] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-09T20:56:50.917464] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-09T20:56:51.201791] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-09T20:56:51.274132] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:56:51.651162] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-09T20:56:51.996722] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-09T20:56:52.315285] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T20:56:52.796707] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-09T20:56:53.006161] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T20:56:53.596710] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-09T20:56:53.616839] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T20:56:54.396719] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-09T20:56:54.732800] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T20:56:54.735305] [INFO ] [REMOTE ] PHK: Full fetch complete (39221 records). [2025-10-09T20:56:54.735388] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-09T20:56:54.735916] [FATAL] [VALIDATOR ] PHK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:56:54.736029] [FATAL] [MAIN ] PHK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:56:54.736073] [WARN ] [MAIN ] PHK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:56:54.736114] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-09T20:56:54.736168] [DEBUG] [LOCAL ] PHK: No primary data file found to delete. [2025-10-09T20:56:54.736204] [INFO ] [LOCAL ] PHK: Starting deletion of derivative data. [2025-10-09T20:56:54.736466] [DEBUG] [LOCAL ] PHK: Deleted derivative data file. [2025-10-09T20:56:54.736602] [INFO ] [MAIN ] Update Progress: 1684/2373 symbols completed. PHK took 36.4s. Estimated remaining: 1h 36m 54s. Rate: 7.1 symbols/min [2025-10-09T20:56:54.903563] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:56:54.911748] [DEBUG] [LOCAL ] PIM: Loaded 4802 existing records from primary storage. [2025-10-09T20:56:54.911954] [INFO ] [MAIN ] PIM: Loaded 4802 existing records. [2025-10-09T20:56:55.093618] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:56:55.093915] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-09T20:56:55.093971] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-09T20:56:55.094199] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-09T20:56:55.094255] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-09T20:56:55.201865] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-09T20:56:55.467173] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:56:55.493122] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T20:56:55.996709] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-09T20:56:56.694506] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T20:56:56.796672] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-09T20:56:56.905540] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T20:56:57.596767] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-09T20:56:58.211158] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T20:56:58.212126] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T20:56:58.396742] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-09T20:56:59.196719] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-09T20:56:59.990729] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T20:56:59.998132] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-09T20:57:00.537984] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T20:57:00.796690] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-09T20:57:01.212750] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-09T20:57:01.596722] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-09T20:57:02.363275] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T20:57:02.396681] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-09T20:57:03.196705] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-09T20:57:03.597082] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-09T20:57:03.929807] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T20:57:03.996682] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-09T20:57:04.796686] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-09T20:57:04.917326] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T20:57:05.067861] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T20:57:05.596739] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-09T20:57:06.396744] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-09T20:57:06.689818] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T20:57:07.044085] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T20:57:07.196705] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-09T20:57:07.375151] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T20:57:07.996689] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-09T20:57:08.749852] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T20:57:08.772341] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T20:57:08.796696] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-09T20:57:09.596717] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-09T20:57:10.396700] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-09T20:57:10.428487] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T20:57:11.196697] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-09T20:57:11.205430] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T20:57:11.526529] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T20:57:11.996795] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-09T20:57:12.151533] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T20:57:12.796736] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-09T20:57:13.060246] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T20:57:13.368878] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T20:57:13.372774] [INFO ] [REMOTE ] PHR: Full fetch complete (52571 records). [2025-10-09T20:57:13.372877] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-09T20:57:13.373461] [FATAL] [VALIDATOR ] PHR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:57:13.373559] [FATAL] [MAIN ] PHR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:57:13.373604] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:57:13.373676] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-09T20:57:13.373758] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-09T20:57:13.373815] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-09T20:57:13.373901] [DEBUG] [LOCAL ] PHR: No derivative data file found to delete. [2025-10-09T20:57:13.374003] [INFO ] [MAIN ] Update Progress: 1685/2373 symbols completed. PHR took 23.8s. Estimated remaining: 1h 36m 50s. Rate: 7.1 symbols/min [2025-10-09T20:57:13.540401] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:57:13.540561] [DEBUG] [LOCAL ] PINE: No existing data file found in primary storage. [2025-10-09T20:57:13.540599] [WARN ] [MAIN ] PINE: No existing data found, performing full refresh instead. [2025-10-09T20:57:13.540736] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-09T20:57:13.540781] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-09T20:57:13.540823] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-09T20:57:13.540857] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-09T20:57:13.601972] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-09T20:57:13.895923] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:57:14.288209] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T20:57:14.396673] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-09T20:57:15.143628] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T20:57:15.196705] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-09T20:57:15.996677] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-09T20:57:16.024996] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T20:57:16.796780] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-09T20:57:17.596733] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-09T20:57:17.777192] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T20:57:17.822928] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-09T20:57:18.396748] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-09T20:57:18.657715] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T20:57:19.196757] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-09T20:57:19.959693] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T20:57:19.996785] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-09T20:57:20.668964] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T20:57:20.796795] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-09T20:57:21.582582] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T20:57:21.596671] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-09T20:57:21.946513] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-09T20:57:22.255343] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T20:57:22.396709] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-09T20:57:23.196689] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-09T20:57:23.477819] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T20:57:23.534760] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T20:57:23.535718] [INFO ] [REMOTE ] PIM: Full fetch complete (6451 records). [2025-10-09T20:57:23.535791] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-09T20:57:23.536280] [FATAL] [VALIDATOR ] PIM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:57:23.536360] [FATAL] [MAIN ] PIM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:57:23.536410] [WARN ] [MAIN ] PIM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:57:23.536466] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-09T20:57:23.536560] [DEBUG] [LOCAL ] PIM: No primary data file found to delete. [2025-10-09T20:57:23.536619] [INFO ] [LOCAL ] PIM: Starting deletion of derivative data. [2025-10-09T20:57:23.537083] [DEBUG] [LOCAL ] PIM: Deleted derivative data file. [2025-10-09T20:57:23.537203] [INFO ] [MAIN ] Update Progress: 1686/2373 symbols completed. PIM took 28.8s. Estimated remaining: 1h 36m 42s. Rate: 7.1 symbols/min [2025-10-09T20:57:23.708318] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:57:23.708527] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-09T20:57:23.708567] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-09T20:57:23.708712] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-09T20:57:23.708765] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-09T20:57:23.708809] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-09T20:57:23.708896] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-09T20:57:24.001862] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-09T20:57:24.072714] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:57:24.796784] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-09T20:57:25.234383] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T20:57:25.596796] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-09T20:57:26.396775] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-09T20:57:26.825125] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T20:57:27.196686] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-09T20:57:27.462772] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T20:57:27.996694] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-09T20:57:28.511315] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-09T20:57:28.796751] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-09T20:57:29.090336] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T20:57:29.601903] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-09T20:57:29.617306] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T20:57:30.396695] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-09T20:57:30.564085] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T20:57:30.873332] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T20:57:31.196735] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-09T20:57:31.996697] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-09T20:57:32.142992] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T20:57:32.748785] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T20:57:32.796700] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-09T20:57:33.229089] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-09T20:57:33.596683] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-09T20:57:33.685274] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T20:57:34.396728] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-09T20:57:35.196701] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-09T20:57:35.482197] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T20:57:35.677778] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-09T20:57:35.868392] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T20:57:35.874182] [INFO ] [REMOTE ] PHM: Full fetch complete (74537 records). [2025-10-09T20:57:35.874456] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-09T20:57:35.875693] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:57:35.875789] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:57:35.875834] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:57:35.875883] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-09T20:57:35.875942] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-09T20:57:35.876031] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-09T20:57:35.876096] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-09T20:57:35.876165] [INFO ] [MAIN ] Update Progress: 1687/2373 symbols completed. PHM took 47.4s. Estimated remaining: 1h 36m 36s. Rate: 7.1 symbols/min [2025-10-09T20:57:36.001930] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-09T20:57:36.061255] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:57:36.061448] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-09T20:57:36.061485] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-09T20:57:36.061601] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-09T20:57:36.061664] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-09T20:57:36.061736] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-09T20:57:36.061772] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-09T20:57:36.420216] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:57:36.796758] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-09T20:57:37.026399] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T20:57:37.506124] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T20:57:37.596724] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-09T20:57:38.396724] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-09T20:57:39.059863] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T20:57:39.196779] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-09T20:57:39.516224] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T20:57:39.703106] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T20:57:39.704980] [INFO ] [REMOTE ] PINE: Full fetch complete (21006 records). [2025-10-09T20:57:39.705077] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-09T20:57:39.705667] [FATAL] [VALIDATOR ] PINE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:57:39.705755] [FATAL] [MAIN ] PINE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:57:39.705801] [WARN ] [MAIN ] PINE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:57:39.705842] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-09T20:57:39.705897] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-09T20:57:39.705934] [INFO ] [LOCAL ] PINE: Starting deletion of derivative data. [2025-10-09T20:57:39.705974] [DEBUG] [LOCAL ] PINE: No derivative data file found to delete. [2025-10-09T20:57:39.706027] [INFO ] [MAIN ] Update Progress: 1688/2373 symbols completed. PINE took 26.3s. Estimated remaining: 1h 36m 25s. Rate: 7.1 symbols/min [2025-10-09T20:57:39.881206] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:57:39.881452] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-09T20:57:39.881498] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-09T20:57:39.881592] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-09T20:57:39.881670] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-09T20:57:39.881740] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-09T20:57:39.881775] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-09T20:57:40.001798] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-09T20:57:40.250086] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:57:40.784093] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-09T20:57:40.796673] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-09T20:57:41.559530] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T20:57:41.563215] [INFO ] [REMOTE ] PII: Full fetch complete (70860 records). [2025-10-09T20:57:41.563318] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-09T20:57:41.564115] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:57:41.564204] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:57:41.564247] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:57:41.564313] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-09T20:57:41.564377] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-09T20:57:41.564413] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-09T20:57:41.564451] [DEBUG] [LOCAL ] PII: No derivative data file found to delete. [2025-10-09T20:57:41.564507] [INFO ] [MAIN ] Update Progress: 1689/2373 symbols completed. PII took 50.8s. Estimated remaining: 1h 36m 14s. Rate: 7.1 symbols/min [2025-10-09T20:57:41.601809] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-09T20:57:41.740487] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:57:41.740679] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-09T20:57:41.740740] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-09T20:57:41.740853] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-09T20:57:41.740896] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-09T20:57:41.740937] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-09T20:57:41.740970] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-09T20:57:42.103242] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:57:42.396724] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-09T20:57:43.196704] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-09T20:57:43.260584] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T20:57:43.996725] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-09T20:57:44.412309] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T20:57:44.435946] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T20:57:44.796721] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-09T20:57:45.533874] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T20:57:45.551635] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T20:57:45.596684] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-09T20:57:46.396712] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-09T20:57:47.196706] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-09T20:57:47.436829] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T20:57:47.462389] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T20:57:47.996747] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-09T20:57:48.399535] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T20:57:48.796781] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-09T20:57:49.083982] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T20:57:49.596789] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-09T20:57:50.396729] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-09T20:57:50.545301] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T20:57:50.662879] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T20:57:51.196781] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-09T20:57:51.996796] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-09T20:57:52.544689] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-09T20:57:52.796685] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-09T20:57:53.005818] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T20:57:53.196933] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T20:57:53.596731] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-09T20:57:54.396684] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-09T20:57:54.623078] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T20:57:55.196704] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-09T20:57:55.434223] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T20:57:55.475112] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T20:57:55.996744] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-09T20:57:56.796692] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-09T20:57:56.911975] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T20:57:57.417038] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T20:57:57.596758] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-09T20:57:58.159146] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T20:57:58.396708] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-09T20:57:58.601584] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T20:57:59.072802] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T20:57:59.196714] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-09T20:57:59.821205] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T20:57:59.996712] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-09T20:58:00.570449] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T20:58:00.571980] [INFO ] [REMOTE ] PIPR: Full fetch complete (20471 records). [2025-10-09T20:58:00.572049] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-09T20:58:00.572487] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:58:00.572570] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:58:00.572614] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:58:00.572682] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-09T20:58:00.572775] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-09T20:58:00.572864] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-09T20:58:00.572934] [DEBUG] [LOCAL ] PIPR: No derivative data file found to delete. [2025-10-09T20:58:00.573002] [INFO ] [MAIN ] Update Progress: 1690/2373 symbols completed. PIPR took 24.7s. Estimated remaining: 1h 36m 10s. Rate: 7.1 symbols/min [2025-10-09T20:58:00.743843] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:58:00.744027] [DEBUG] [LOCAL ] PKE: No existing data file found in primary storage. [2025-10-09T20:58:00.744084] [WARN ] [MAIN ] PKE: No existing data found, performing full refresh instead. [2025-10-09T20:58:00.744197] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-09T20:58:00.744240] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-09T20:58:00.744283] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-09T20:58:00.744317] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-09T20:58:00.805514] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-09T20:58:01.102622] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:58:01.596742] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-09T20:58:02.141987] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T20:58:02.147717] [INFO ] [REMOTE ] PINS: Full fetch complete (77350 records). [2025-10-09T20:58:02.147892] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-09T20:58:02.148710] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:58:02.148805] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:58:02.148871] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:58:02.148945] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-09T20:58:02.149012] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-09T20:58:02.149050] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-09T20:58:02.149091] [DEBUG] [LOCAL ] PINS: No derivative data file found to delete. [2025-10-09T20:58:02.149152] [INFO ] [MAIN ] Update Progress: 1691/2373 symbols completed. PINS took 38.6s. Estimated remaining: 1h 35m 59s. Rate: 7.1 symbols/min [2025-10-09T20:58:02.319308] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:58:02.319524] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-09T20:58:02.319570] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-09T20:58:02.319726] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-09T20:58:02.319782] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-09T20:58:02.319826] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-09T20:58:02.319858] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-09T20:58:02.401813] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-09T20:58:02.692839] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:58:02.876088] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-09T20:58:03.196740] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-09T20:58:03.902754] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T20:58:03.996688] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-09T20:58:04.796752] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-09T20:58:04.998557] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T20:58:05.261172] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T20:58:05.433997] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T20:58:05.596718] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-09T20:58:06.396721] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-09T20:58:06.674428] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T20:58:07.196740] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-09T20:58:07.933122] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T20:58:07.996670] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-09T20:58:08.083599] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T20:58:08.796737] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-09T20:58:09.596792] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-09T20:58:09.760468] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T20:58:10.364131] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T20:58:10.396666] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-09T20:58:10.531441] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T20:58:11.196722] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-09T20:58:11.795434] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T20:58:11.996777] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-09T20:58:12.293511] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T20:58:12.796772] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-09T20:58:13.279337] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T20:58:13.596729] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-09T20:58:14.322469] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T20:58:14.396739] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-09T20:58:14.861801] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T20:58:15.196723] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-09T20:58:15.996702] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-09T20:58:16.055378] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T20:58:16.214994] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T20:58:16.796785] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-09T20:58:16.916117] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T20:58:17.461024] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T20:58:17.464064] [INFO ] [REMOTE ] PJT: Full fetch complete (31905 records). [2025-10-09T20:58:17.464215] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-09T20:58:17.465062] [FATAL] [VALIDATOR ] PJT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:58:17.465209] [FATAL] [MAIN ] PJT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:58:17.465272] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:58:17.465362] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-09T20:58:17.465448] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-09T20:58:17.465552] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-09T20:58:17.465633] [DEBUG] [LOCAL ] PJT: No derivative data file found to delete. [2025-10-09T20:58:17.465761] [INFO ] [MAIN ] Update Progress: 1692/2373 symbols completed. PJT took 37.8s. Estimated remaining: 1h 35m 53s. Rate: 7.1 symbols/min [2025-10-09T20:58:17.601853] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-09T20:58:17.658198] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:58:17.658372] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-09T20:58:17.658410] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-09T20:58:17.658523] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-09T20:58:17.658566] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-09T20:58:17.658608] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-09T20:58:17.658661] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-09T20:58:18.072047] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:58:18.396761] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-09T20:58:19.196774] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-09T20:58:19.255235] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T20:58:19.489458] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T20:58:19.996795] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-09T20:58:20.320977] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T20:58:20.636073] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T20:58:20.796710] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-09T20:58:21.596770] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-09T20:58:22.054459] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T20:58:22.396724] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-09T20:58:22.890394] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T20:58:23.196687] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-09T20:58:23.386819] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T20:58:23.996716] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-09T20:58:24.235971] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T20:58:24.796728] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-09T20:58:25.231935] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T20:58:25.596775] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-09T20:58:26.398296] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-09T20:58:26.400601] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T20:58:26.614525] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T20:58:26.785304] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T20:58:26.789234] [INFO ] [REMOTE ] PK: Full fetch complete (76008 records). [2025-10-09T20:58:26.789364] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-09T20:58:26.790109] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:58:26.790220] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:58:26.790317] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:58:26.790399] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-09T20:58:26.790463] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-09T20:58:26.790498] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-09T20:58:26.790536] [DEBUG] [LOCAL ] PK: No derivative data file found to delete. [2025-10-09T20:58:26.790632] [INFO ] [MAIN ] Update Progress: 1693/2373 symbols completed. PK took 45.2s. Estimated remaining: 1h 35m 45s. Rate: 7.1 symbols/min [2025-10-09T20:58:26.957242] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:58:26.957458] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-09T20:58:26.957515] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-09T20:58:26.957632] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-09T20:58:26.957709] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-09T20:58:26.957797] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-09T20:58:26.957846] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-09T20:58:27.201990] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-09T20:58:27.312869] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:58:27.777195] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T20:58:27.996748] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-09T20:58:28.796762] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-09T20:58:29.158420] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T20:58:29.596764] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-09T20:58:30.030197] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T20:58:30.338352] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T20:58:30.396796] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-09T20:58:31.196734] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-09T20:58:31.328594] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T20:58:31.996735] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-09T20:58:32.796685] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-09T20:58:32.825377] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T20:58:33.144189] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T20:58:33.209441] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T20:58:33.212420] [INFO ] [REMOTE ] PKG: Full fetch complete (57360 records). [2025-10-09T20:58:33.212560] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-09T20:58:33.213388] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:58:33.213488] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:58:33.213533] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:58:33.213575] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-09T20:58:33.213636] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-09T20:58:33.213728] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-09T20:58:33.213805] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-09T20:58:33.213898] [INFO ] [MAIN ] Update Progress: 1694/2373 symbols completed. PKG took 31.1s. Estimated remaining: 1h 35m 36s. Rate: 7.1 symbols/min [2025-10-09T20:58:33.388994] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:58:33.389178] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-09T20:58:33.389216] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-09T20:58:33.389327] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-09T20:58:33.389370] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-09T20:58:33.389412] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-09T20:58:33.389445] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-09T20:58:33.601884] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-09T20:58:33.765786] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:58:34.137199] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T20:58:34.139136] [INFO ] [REMOTE ] PKE: Full fetch complete (17584 records). [2025-10-09T20:58:34.139220] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-09T20:58:34.139706] [FATAL] [VALIDATOR ] PKE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:58:34.139794] [FATAL] [MAIN ] PKE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:58:34.139838] [WARN ] [MAIN ] PKE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:58:34.139877] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-09T20:58:34.139966] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-09T20:58:34.140024] [INFO ] [LOCAL ] PKE: Starting deletion of derivative data. [2025-10-09T20:58:34.140069] [DEBUG] [LOCAL ] PKE: No derivative data file found to delete. [2025-10-09T20:58:34.140126] [INFO ] [MAIN ] Update Progress: 1695/2373 symbols completed. PKE took 33.6s. Estimated remaining: 1h 35m 24s. Rate: 7.1 symbols/min [2025-10-09T20:58:34.309947] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:58:34.310107] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-09T20:58:34.310143] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-09T20:58:34.310257] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-09T20:58:34.310299] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-09T20:58:34.310340] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-09T20:58:34.310394] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-09T20:58:34.401849] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-09T20:58:34.684869] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:58:35.196715] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-09T20:58:35.996721] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-09T20:58:36.729153] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-09T20:58:36.796697] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-09T20:58:36.923900] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T20:58:36.944474] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T20:58:37.596754] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-09T20:58:38.396748] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-09T20:58:38.984051] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-09T20:58:39.196732] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-09T20:58:39.482035] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T20:58:39.746551] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T20:58:39.996777] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-09T20:58:40.796714] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-09T20:58:41.166696] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T20:58:41.385766] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T20:58:41.596683] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-09T20:58:41.870358] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T20:58:42.396726] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-09T20:58:43.196726] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-09T20:58:43.421125] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T20:58:43.729123] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-09T20:58:43.996764] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-09T20:58:44.796692] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-09T20:58:44.919494] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T20:58:44.954245] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T20:58:45.596723] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-09T20:58:46.276222] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T20:58:46.396798] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-09T20:58:47.196724] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-09T20:58:47.637152] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T20:58:47.853051] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T20:58:47.996728] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-09T20:58:48.796683] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-09T20:58:48.881678] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T20:58:49.413166] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T20:58:49.455100] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T20:58:49.596774] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-09T20:58:50.314900] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T20:58:50.317571] [INFO ] [REMOTE ] PKST: Full fetch complete (29144 records). [2025-10-09T20:58:50.317732] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-09T20:58:50.318579] [FATAL] [VALIDATOR ] PKST: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:58:50.318721] [FATAL] [MAIN ] PKST: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:58:50.318786] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:58:50.318873] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-09T20:58:50.318976] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-09T20:58:50.319045] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-09T20:58:50.319170] [DEBUG] [LOCAL ] PKST: No derivative data file found to delete. [2025-10-09T20:58:50.319294] [INFO ] [MAIN ] Update Progress: 1696/2373 symbols completed. PKST took 32.9s. Estimated remaining: 1h 35m 19s. Rate: 7.1 symbols/min [2025-10-09T20:58:50.401898] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-09T20:58:50.496726] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:58:50.496905] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-09T20:58:50.496960] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-09T20:58:50.497069] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-09T20:58:50.497110] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-09T20:58:50.497151] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-09T20:58:50.497182] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-09T20:58:50.846827] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:58:51.196728] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-09T20:58:51.774683] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T20:58:51.996695] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-09T20:58:52.796688] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-09T20:58:52.897811] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T20:58:53.596775] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-09T20:58:54.044436] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T20:58:54.396727] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-09T20:58:54.820075] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T20:58:54.844943] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T20:58:55.196719] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-09T20:58:55.996743] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-09T20:58:56.706834] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T20:58:56.796687] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-09T20:58:56.828244] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-09T20:58:57.378271] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T20:58:57.596752] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-09T20:58:58.401824] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-09T20:58:58.428087] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T20:58:58.948891] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T20:58:59.196766] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-09T20:58:59.798831] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T20:58:59.996827] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-09T20:59:00.796778] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-09T20:59:01.250170] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T20:59:01.596709] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-09T20:59:01.638553] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-09T20:59:02.396749] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-09T20:59:02.433417] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T20:59:03.196742] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-09T20:59:03.663774] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-09T20:59:03.953081] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T20:59:03.996678] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-09T20:59:04.461424] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T20:59:04.464477] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-09T20:59:04.475490] [INFO ] [REMOTE ] PKX: Full fetch complete (36270 records). [2025-10-09T20:59:04.475917] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-09T20:59:04.476961] [FATAL] [VALIDATOR ] PKX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:59:04.477076] [FATAL] [MAIN ] PKX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:59:04.477153] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:59:04.477247] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-09T20:59:04.477343] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-09T20:59:04.477402] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-09T20:59:04.477451] [DEBUG] [LOCAL ] PKX: No derivative data file found to delete. [2025-10-09T20:59:04.477508] [INFO ] [MAIN ] Update Progress: 1697/2373 symbols completed. PKX took 37.7s. Estimated remaining: 1h 35m 13s. Rate: 7.1 symbols/min [2025-10-09T20:59:04.646271] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:59:04.646438] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-09T20:59:04.646485] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-09T20:59:04.646624] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-09T20:59:04.646705] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-09T20:59:04.646759] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-09T20:59:04.646793] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-09T20:59:04.804818] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-09T20:59:05.011418] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:59:05.596709] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-09T20:59:06.400264] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-09T20:59:06.422878] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T20:59:06.482212] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T20:59:07.196693] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-09T20:59:07.524238] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T20:59:07.996736] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-09T20:59:08.322326] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T20:59:08.738349] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T20:59:08.745236] [INFO ] [REMOTE ] PLD: Full fetch complete (76977 records). [2025-10-09T20:59:08.745387] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-09T20:59:08.746277] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:59:08.746370] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:59:08.746457] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:59:08.746532] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-09T20:59:08.746596] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-09T20:59:08.746631] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-09T20:59:08.746714] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-09T20:59:08.746799] [INFO ] [MAIN ] Update Progress: 1698/2373 symbols completed. PLD took 34.6s. Estimated remaining: 1h 35m 3s. Rate: 7.1 symbols/min [2025-10-09T20:59:08.806737] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-09T20:59:08.922557] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:59:08.922775] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-09T20:59:08.922830] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-09T20:59:08.922940] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-09T20:59:08.922995] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-09T20:59:08.923063] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-09T20:59:08.923098] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-09T20:59:09.273317] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:59:09.596695] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-09T20:59:09.804849] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T20:59:10.300274] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T20:59:10.304256] [INFO ] [REMOTE ] PL: Full fetch complete (76583 records). [2025-10-09T20:59:10.304368] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-09T20:59:10.305132] [FATAL] [VALIDATOR ] PL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:59:10.305219] [FATAL] [MAIN ] PL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:59:10.305262] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:59:10.305300] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-09T20:59:10.305357] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-09T20:59:10.305392] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-09T20:59:10.305431] [DEBUG] [LOCAL ] PL: No derivative data file found to delete. [2025-10-09T20:59:10.305486] [INFO ] [MAIN ] Update Progress: 1699/2373 symbols completed. PL took 37.1s. Estimated remaining: 1h 34m 51s. Rate: 7.1 symbols/min [2025-10-09T20:59:10.401930] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-09T20:59:10.482066] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:59:10.482245] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-09T20:59:10.482299] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-09T20:59:10.482410] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-09T20:59:10.482452] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-09T20:59:10.482496] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-09T20:59:10.482528] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-09T20:59:10.838028] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:59:11.196739] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-09T20:59:11.996691] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-09T20:59:12.416597] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T20:59:12.669249] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T20:59:12.796703] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-09T20:59:13.135373] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T20:59:13.596733] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-09T20:59:14.181850] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T20:59:14.396732] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-09T20:59:15.196720] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-09T20:59:15.658097] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T20:59:15.979975] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T20:59:15.996676] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-09T20:59:16.310465] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T20:59:16.796774] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-09T20:59:17.185183] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T20:59:17.596754] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-09T20:59:18.120104] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T20:59:18.396730] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-09T20:59:18.704366] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T20:59:19.196685] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-09T20:59:19.582823] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T20:59:19.996770] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-09T20:59:20.796744] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-09T20:59:21.251314] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-09T20:59:21.596689] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-09T20:59:21.631108] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T20:59:21.826972] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T20:59:22.396755] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-09T20:59:23.196755] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-09T20:59:23.540197] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-09T20:59:23.996737] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-09T20:59:24.242727] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T20:59:24.416140] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T20:59:24.796727] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-09T20:59:24.901860] [DEBUG] [REMOTE ] PLOW: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-09T20:59:24.902090] [WARN ] [REMOTE ] PLOW: No data returned for month 2025-08 [2025-10-09T20:59:24.902197] [FATAL] [REMOTE ] PLOW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T20:59:24.902298] [FATAL] [MAIN ] PLOW: Failed to fetch primary data. [2025-10-09T20:59:24.902336] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T20:59:24.902424] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-09T20:59:24.902506] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-09T20:59:24.902543] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-09T20:59:24.902581] [DEBUG] [LOCAL ] PLOW: No derivative data file found to delete. [2025-10-09T20:59:24.902628] [INFO ] [MAIN ] Update Progress: 1700/2373 symbols completed. PLOW took 20.4s. Estimated remaining: 1h 34m 45s. Rate: 7.1 symbols/min [2025-10-09T20:59:25.104187] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:59:25.122143] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T20:59:25.144927] [DEBUG] [LOCAL ] PML: Loaded 21571 existing records from primary storage. [2025-10-09T20:59:25.145159] [INFO ] [MAIN ] PML: Loaded 21571 existing records. [2025-10-09T20:59:25.318053] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:59:25.318249] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-09T20:59:25.318296] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-09T20:59:25.318602] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-09T20:59:25.318694] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-09T20:59:25.601884] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-09T20:59:25.667952] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:59:26.396791] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-09T20:59:27.089416] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T20:59:27.196701] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-09T20:59:27.524033] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T20:59:27.996710] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-09T20:59:28.101219] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T20:59:28.796724] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-09T20:59:29.204490] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T20:59:29.596712] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-09T20:59:30.325144] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T20:59:30.341482] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T20:59:30.345106] [INFO ] [REMOTE ] PLNT: Full fetch complete (70033 records). [2025-10-09T20:59:30.345206] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-09T20:59:30.347186] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:59:30.347279] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:59:30.347326] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:59:30.347384] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-09T20:59:30.347477] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-09T20:59:30.347527] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-09T20:59:30.347583] [DEBUG] [LOCAL ] PLNT: No derivative data file found to delete. [2025-10-09T20:59:30.347682] [INFO ] [MAIN ] Update Progress: 1701/2373 symbols completed. PLNT took 40.0s. Estimated remaining: 1h 34m 36s. Rate: 7.1 symbols/min [2025-10-09T20:59:30.401888] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-09T20:59:30.520529] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:59:30.532378] [DEBUG] [LOCAL ] PMM: Loaded 10630 existing records from primary storage. [2025-10-09T20:59:30.532594] [INFO ] [MAIN ] PMM: Loaded 10630 existing records. [2025-10-09T20:59:30.705591] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:59:30.705835] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-09T20:59:30.705891] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-09T20:59:30.706083] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-09T20:59:30.706140] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-09T20:59:31.050368] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:59:31.196699] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-09T20:59:31.996745] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-09T20:59:32.265930] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T20:59:32.455267] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T20:59:32.796725] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-09T20:59:33.596714] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-09T20:59:33.691953] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T20:59:33.883888] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T20:59:34.396768] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-09T20:59:34.628922] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T20:59:35.196709] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-09T20:59:35.335457] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T20:59:35.996736] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-09T20:59:36.325013] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T20:59:36.796764] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-09T20:59:37.596744] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-09T20:59:37.784084] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T20:59:38.088835] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T20:59:38.372295] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-09T20:59:38.396685] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-09T20:59:39.196716] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-09T20:59:39.996698] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-09T20:59:40.064898] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T20:59:40.069544] [INFO ] [REMOTE ] PLYM: Full fetch complete (46965 records). [2025-10-09T20:59:40.069694] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-09T20:59:40.070606] [FATAL] [VALIDATOR ] PLYM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:59:40.070771] [FATAL] [MAIN ] PLYM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:59:40.070825] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:59:40.070895] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-09T20:59:40.070992] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-09T20:59:40.071119] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-09T20:59:40.071201] [DEBUG] [LOCAL ] PLYM: No derivative data file found to delete. [2025-10-09T20:59:40.071287] [INFO ] [MAIN ] Update Progress: 1702/2373 symbols completed. PLYM took 31.3s. Estimated remaining: 1h 34m 28s. Rate: 7.1 symbols/min [2025-10-09T20:59:40.251481] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:59:40.263863] [DEBUG] [LOCAL ] PMO: Loaded 10057 existing records from primary storage. [2025-10-09T20:59:40.264056] [INFO ] [MAIN ] PMO: Loaded 10057 existing records. [2025-10-09T20:59:40.444406] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T20:59:40.444749] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-09T20:59:40.444820] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-09T20:59:40.445250] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-09T20:59:40.445309] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-09T20:59:40.797971] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-09T20:59:40.840451] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-09T20:59:40.858134] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T20:59:40.881094] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:59:41.596690] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-09T20:59:41.862635] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T20:59:42.396721] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-09T20:59:43.196744] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-09T20:59:43.398745] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T20:59:43.594484] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-09T20:59:43.811421] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T20:59:43.996739] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-09T20:59:44.796738] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-09T20:59:45.027179] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T20:59:45.496256] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T20:59:45.596718] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-09T20:59:46.396729] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-09T20:59:47.196710] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-09T20:59:47.287823] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T20:59:47.944087] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-09T20:59:47.996673] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-09T20:59:48.271847] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T20:59:48.796722] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-09T20:59:49.596771] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-09T20:59:49.802574] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T20:59:50.116975] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T20:59:50.332590] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T20:59:50.396709] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-09T20:59:51.196771] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-09T20:59:51.246583] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T20:59:51.899086] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T20:59:51.996720] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-09T20:59:52.796740] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-09T20:59:53.108233] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T20:59:53.568763] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T20:59:53.596669] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-09T20:59:54.396691] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-09T20:59:54.738553] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T20:59:55.135374] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T20:59:55.196704] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-09T20:59:55.789527] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T20:59:55.996766] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-09T20:59:56.796797] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-09T20:59:56.853777] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T20:59:57.449856] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T20:59:57.596713] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-09T20:59:58.036658] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T20:59:58.038199] [INFO ] [REMOTE ] PMM: Full fetch complete (17899 records). [2025-10-09T20:59:58.038275] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-09T20:59:58.038745] [FATAL] [VALIDATOR ] PMM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T20:59:58.038839] [FATAL] [MAIN ] PMM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T20:59:58.038883] [WARN ] [MAIN ] PMM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T20:59:58.038950] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-09T20:59:58.039014] [DEBUG] [LOCAL ] PMM: No primary data file found to delete. [2025-10-09T20:59:58.039051] [INFO ] [LOCAL ] PMM: Starting deletion of derivative data. [2025-10-09T20:59:58.039418] [DEBUG] [LOCAL ] PMM: Deleted derivative data file. [2025-10-09T20:59:58.039510] [INFO ] [MAIN ] Update Progress: 1703/2373 symbols completed. PMM took 27.7s. Estimated remaining: 1h 34m 23s. Rate: 7.1 symbols/min [2025-10-09T20:59:58.209716] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T20:59:58.209888] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-09T20:59:58.209925] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-09T20:59:58.210040] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-09T20:59:58.210080] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-09T20:59:58.210120] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-09T20:59:58.210152] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-09T20:59:58.405714] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-09T20:59:58.579208] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T20:59:59.196734] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-09T20:59:59.247207] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T20:59:59.996713] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-09T21:00:00.796787] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-09T21:00:00.928494] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T21:00:00.956890] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T21:00:01.596777] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-09T21:00:01.830336] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T21:00:02.396750] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-09T21:00:02.478846] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T21:00:02.859058] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T21:00:02.863122] [INFO ] [REMOTE ] PM: Full fetch complete (77324 records). [2025-10-09T21:00:02.863239] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-09T21:00:02.864062] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:00:02.864157] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:00:02.864203] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:00:02.864272] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-09T21:00:02.864337] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-09T21:00:02.864374] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-09T21:00:02.864418] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-09T21:00:02.864478] [INFO ] [MAIN ] Update Progress: 1704/2373 symbols completed. PM took 52.6s. Estimated remaining: 1h 34m 13s. Rate: 7.1 symbols/min [2025-10-09T21:00:03.051804] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:03.052002] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-09T21:00:03.052041] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-09T21:00:03.052182] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-09T21:00:03.052249] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-09T21:00:03.052300] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-09T21:00:03.052336] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-09T21:00:03.201847] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-09T21:00:03.437306] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:03.996724] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-09T21:00:04.796763] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-09T21:00:04.831593] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T21:00:04.854283] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T21:00:05.389759] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T21:00:05.596717] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-09T21:00:06.160900] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T21:00:06.396725] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-09T21:00:06.912863] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-09T21:00:07.196774] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-09T21:00:07.505557] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-09T21:00:07.508010] [INFO ] [REMOTE ] PML: Full fetch complete (29602 records). [2025-10-09T21:00:07.508344] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-09T21:00:07.509349] [FATAL] [VALIDATOR ] PML: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:00:07.509441] [FATAL] [MAIN ] PML: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:00:07.509485] [WARN ] [MAIN ] PML: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:00:07.509526] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-09T21:00:07.509583] [DEBUG] [LOCAL ] PML: No primary data file found to delete. [2025-10-09T21:00:07.509620] [INFO ] [LOCAL ] PML: Starting deletion of derivative data. [2025-10-09T21:00:07.509846] [DEBUG] [LOCAL ] PML: Deleted derivative data file. [2025-10-09T21:00:07.509974] [INFO ] [MAIN ] Update Progress: 1705/2373 symbols completed. PML took 42.6s. Estimated remaining: 1h 34m 3s. Rate: 7.1 symbols/min [2025-10-09T21:00:07.692922] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:07.693105] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-09T21:00:07.693142] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-09T21:00:07.693257] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-09T21:00:07.693298] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-09T21:00:07.693338] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-09T21:00:07.693371] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-09T21:00:08.002857] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-09T21:00:08.043898] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:08.796768] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-09T21:00:09.318861] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T21:00:09.596754] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-09T21:00:09.736114] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T21:00:09.956687] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:00:09.957213] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-09T21:00:09.957321] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:00:09.957379] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-09T21:00:09.957443] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:00:09.957531] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-09T21:00:09.957606] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-09T21:00:09.957672] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-09T21:00:09.957768] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-09T21:00:09.957846] [INFO ] [MAIN ] Update Progress: 1706/2373 symbols completed. PMTV took 2.4s. Estimated remaining: 1h 33m 53s. Rate: 7.1 symbols/min [2025-10-09T21:00:10.131547] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:10.131726] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-09T21:00:10.131801] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-09T21:00:10.131918] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-09T21:00:10.131961] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-09T21:00:10.132055] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-09T21:00:10.132127] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-09T21:00:10.402276] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-09T21:00:10.486144] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:11.056988] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T21:00:11.196777] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-09T21:00:11.996764] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-09T21:00:12.361633] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:00:12.362007] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-09T21:00:12.362115] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:00:12.362174] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-09T21:00:12.362234] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:00:12.362311] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-09T21:00:12.362375] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-09T21:00:12.362410] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-09T21:00:12.362450] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-09T21:00:12.362497] [INFO ] [MAIN ] Update Progress: 1707/2373 symbols completed. PMTW took 2.4s. Estimated remaining: 1h 33m 42s. Rate: 7.1 symbols/min [2025-10-09T21:00:12.530788] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:12.531001] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-09T21:00:12.531058] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-09T21:00:12.531172] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-09T21:00:12.531235] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-09T21:00:12.531295] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-09T21:00:12.531329] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-09T21:00:12.801867] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-09T21:00:12.896733] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:13.025487] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T21:00:13.596726] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-09T21:00:13.771208] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T21:00:13.772473] [INFO ] [REMOTE ] PMO: Full fetch complete (16560 records). [2025-10-09T21:00:13.772547] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-09T21:00:13.773007] [FATAL] [VALIDATOR ] PMO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:00:13.773093] [FATAL] [MAIN ] PMO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:00:13.773141] [WARN ] [MAIN ] PMO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:00:13.773259] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-09T21:00:13.773343] [DEBUG] [LOCAL ] PMO: No primary data file found to delete. [2025-10-09T21:00:13.773393] [INFO ] [LOCAL ] PMO: Starting deletion of derivative data. [2025-10-09T21:00:13.773815] [DEBUG] [LOCAL ] PMO: Deleted derivative data file. [2025-10-09T21:00:13.773936] [INFO ] [MAIN ] Update Progress: 1708/2373 symbols completed. PMO took 33.7s. Estimated remaining: 1h 33m 31s. Rate: 7.1 symbols/min [2025-10-09T21:00:13.947019] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:13.956443] [DEBUG] [LOCAL ] PNI: Loaded 6770 existing records from primary storage. [2025-10-09T21:00:13.956747] [INFO ] [MAIN ] PNI: Loaded 6770 existing records. [2025-10-09T21:00:14.136470] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:00:14.136690] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-09T21:00:14.136747] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-09T21:00:14.137308] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-09T21:00:14.137365] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-09T21:00:14.401974] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-09T21:00:14.502504] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:15.196741] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-09T21:00:15.578362] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T21:00:15.662706] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T21:00:15.996753] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-09T21:00:16.341407] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T21:00:16.796786] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-09T21:00:17.596743] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-09T21:00:18.037262] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T21:00:18.167376] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T21:00:18.379320] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T21:00:18.396704] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-09T21:00:19.196772] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-09T21:00:19.933396] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T21:00:19.996681] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-09T21:00:20.016908] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T21:00:20.796718] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-09T21:00:21.132342] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T21:00:21.529621] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T21:00:21.596742] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-09T21:00:22.396781] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-09T21:00:22.851012] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T21:00:23.176429] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T21:00:23.196670] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-09T21:00:23.996729] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-09T21:00:24.772779] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T21:00:24.796682] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-09T21:00:24.852471] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T21:00:25.573150] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T21:00:25.596711] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-09T21:00:26.396730] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-09T21:00:27.196722] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-09T21:00:27.290086] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T21:00:27.412944] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T21:00:27.996735] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-09T21:00:28.463171] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-09T21:00:28.796709] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-09T21:00:28.837717] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T21:00:29.106686] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T21:00:29.596722] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-09T21:00:30.396749] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-09T21:00:30.458585] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T21:00:31.143062] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T21:00:31.196723] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-09T21:00:31.957275] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T21:00:31.961138] [INFO ] [REMOTE ] PMT: Full fetch complete (58264 records). [2025-10-09T21:00:31.961242] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-09T21:00:31.961923] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:00:31.962012] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:00:31.962055] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:00:31.962096] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-09T21:00:31.962154] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-09T21:00:31.962202] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-09T21:00:31.962270] [DEBUG] [LOCAL ] PMT: No derivative data file found to delete. [2025-10-09T21:00:31.962328] [INFO ] [MAIN ] Update Progress: 1709/2373 symbols completed. PMT took 33.9s. Estimated remaining: 1h 33m 26s. Rate: 7.1 symbols/min [2025-10-09T21:00:32.001951] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-09T21:00:32.132093] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:32.132246] [DEBUG] [LOCAL ] PNNT: No existing data file found in primary storage. [2025-10-09T21:00:32.132284] [WARN ] [MAIN ] PNNT: No existing data found, performing full refresh instead. [2025-10-09T21:00:32.132414] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-09T21:00:32.132460] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-09T21:00:32.132506] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-09T21:00:32.132542] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-09T21:00:32.485192] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:32.796712] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-09T21:00:33.356777] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T21:00:33.596706] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-09T21:00:34.051496] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T21:00:34.149483] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T21:00:34.396756] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-09T21:00:34.678982] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-09T21:00:34.679632] [INFO ] [REMOTE ] PMTU: Full fetch complete (1200 records). [2025-10-09T21:00:34.679727] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-09T21:00:34.680128] [FATAL] [VALIDATOR ] PMTU: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:00:34.680188] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:00:34.680225] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:00:34.680262] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-09T21:00:34.680317] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-09T21:00:34.680352] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-09T21:00:34.680417] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-09T21:00:34.680493] [INFO ] [MAIN ] Update Progress: 1710/2373 symbols completed. PMTU took 31.8s. Estimated remaining: 1h 33m 15s. Rate: 7.1 symbols/min [2025-10-09T21:00:34.855411] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:34.855624] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-09T21:00:34.855702] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-09T21:00:34.855816] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-09T21:00:34.855858] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-09T21:00:34.855899] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-09T21:00:34.855931] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-09T21:00:35.201635] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-09T21:00:35.204938] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:35.996731] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-09T21:00:36.046676] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T21:00:36.796723] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-09T21:00:37.596696] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-09T21:00:37.727218] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T21:00:38.248235] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T21:00:38.396704] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-09T21:00:39.198456] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-09T21:00:39.198327] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T21:00:39.632148] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T21:00:39.755777] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T21:00:39.996756] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-09T21:00:40.796774] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-09T21:00:41.232497] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T21:00:41.596773] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-09T21:00:41.885019] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-09T21:00:41.886056] [INFO ] [REMOTE ] PNI: Full fetch complete (9662 records). [2025-10-09T21:00:41.886129] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-09T21:00:41.886519] [FATAL] [VALIDATOR ] PNI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:00:41.886601] [FATAL] [MAIN ] PNI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:00:41.886674] [WARN ] [MAIN ] PNI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:00:41.886735] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-09T21:00:41.886793] [DEBUG] [LOCAL ] PNI: No primary data file found to delete. [2025-10-09T21:00:41.886843] [INFO ] [LOCAL ] PNI: Starting deletion of derivative data. [2025-10-09T21:00:41.887009] [DEBUG] [LOCAL ] PNI: Deleted derivative data file. [2025-10-09T21:00:41.887096] [INFO ] [MAIN ] Update Progress: 1711/2373 symbols completed. PNI took 28.1s. Estimated remaining: 1h 33m 6s. Rate: 7.1 symbols/min [2025-10-09T21:00:42.055271] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:42.055574] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-09T21:00:42.055632] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-09T21:00:42.055765] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-09T21:00:42.055808] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-09T21:00:42.055850] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-09T21:00:42.055883] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-09T21:00:42.403529] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-09T21:00:42.427198] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:42.456095] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T21:00:43.196804] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-09T21:00:43.988886] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T21:00:43.996661] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-09T21:00:44.565108] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T21:00:44.796765] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-09T21:00:45.578263] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T21:00:45.596670] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-09T21:00:46.396762] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-09T21:00:46.489963] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T21:00:47.196751] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-09T21:00:47.234397] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T21:00:47.996768] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-09T21:00:48.070791] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T21:00:48.796711] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-09T21:00:49.167577] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-09T21:00:49.388932] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T21:00:49.596779] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-09T21:00:50.345188] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T21:00:50.396673] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-09T21:00:51.196748] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-09T21:00:51.247100] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T21:00:51.370438] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T21:00:51.996743] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-09T21:00:52.667571] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T21:00:52.796748] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-09T21:00:53.596697] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-09T21:00:53.872239] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T21:00:54.088813] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T21:00:54.396773] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-09T21:00:54.997969] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T21:00:55.109553] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:00:55.113292] [INFO ] [REMOTE ] PNC: Full fetch complete (75011 records). [2025-10-09T21:00:55.113396] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-09T21:00:55.114270] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:00:55.114361] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:00:55.114404] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:00:55.114443] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-09T21:00:55.114499] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-09T21:00:55.114536] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-09T21:00:55.114574] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-09T21:00:55.114629] [INFO ] [MAIN ] Update Progress: 1712/2373 symbols completed. PNC took 42.8s. Estimated remaining: 1h 32m 60s. Rate: 7.1 symbols/min [2025-10-09T21:00:55.201907] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-09T21:00:55.300082] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:00:55.300264] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-09T21:00:55.300309] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-09T21:00:55.300454] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-09T21:00:55.300517] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-09T21:00:55.300576] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-09T21:00:55.300609] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-09T21:00:55.710023] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:00:55.996750] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-09T21:00:56.796762] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-09T21:00:57.063666] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T21:00:57.596733] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-09T21:00:57.687239] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T21:00:58.159884] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T21:00:58.263559] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T21:00:58.396754] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-09T21:00:59.196724] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-09T21:00:59.996768] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-09T21:01:00.161750] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T21:01:00.796707] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-09T21:01:01.148854] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T21:01:01.516073] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T21:01:01.596726] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-09T21:01:02.170934] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T21:01:02.396738] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-09T21:01:03.196721] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-09T21:01:03.421593] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T21:01:03.677235] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T21:01:03.680839] [INFO ] [REMOTE ] PNNT: Full fetch complete (47443 records). [2025-10-09T21:01:03.681026] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-09T21:01:03.682021] [FATAL] [VALIDATOR ] PNNT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:01:03.682135] [FATAL] [MAIN ] PNNT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:01:03.682203] [WARN ] [MAIN ] PNNT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:01:03.682308] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-09T21:01:03.682402] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-09T21:01:03.682443] [INFO ] [LOCAL ] PNNT: Starting deletion of derivative data. [2025-10-09T21:01:03.682485] [DEBUG] [LOCAL ] PNNT: No derivative data file found to delete. [2025-10-09T21:01:03.682555] [INFO ] [MAIN ] Update Progress: 1713/2373 symbols completed. PNNT took 31.7s. Estimated remaining: 1h 32m 51s. Rate: 7.1 symbols/min [2025-10-09T21:01:03.852728] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:01:03.852909] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-09T21:01:03.852947] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-09T21:01:03.853059] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-09T21:01:03.853100] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-09T21:01:03.853140] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-09T21:01:03.853172] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-09T21:01:03.997347] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-09T21:01:04.218248] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:01:04.338745] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T21:01:04.562053] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T21:01:04.796769] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-09T21:01:05.596749] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-09T21:01:06.291876] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T21:01:06.396815] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-09T21:01:06.884566] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T21:01:07.196730] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-09T21:01:08.001541] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-09T21:01:08.007228] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T21:01:08.738057] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T21:01:08.743884] [INFO ] [REMOTE ] PNR: Full fetch complete (68787 records). [2025-10-09T21:01:08.744121] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-09T21:01:08.745330] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:01:08.748249] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:01:08.749400] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:01:08.749557] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-09T21:01:08.749712] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-09T21:01:08.749788] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-09T21:01:08.749864] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-09T21:01:08.750023] [INFO ] [MAIN ] Update Progress: 1714/2373 symbols completed. PNR took 34.1s. Estimated remaining: 1h 32m 42s. Rate: 7.1 symbols/min [2025-10-09T21:01:08.798694] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-09T21:01:09.048674] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:01:09.049013] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-09T21:01:09.049083] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-09T21:01:09.049293] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-09T21:01:09.049509] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-09T21:01:09.049768] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-09T21:01:09.049930] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-09T21:01:09.191432] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T21:01:09.568752] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:01:09.596677] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-09T21:01:10.397464] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-09T21:01:10.397366] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T21:01:11.196709] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-09T21:01:11.422741] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T21:01:11.894716] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T21:01:11.996725] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-09T21:01:12.796767] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-09T21:01:13.112245] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T21:01:13.580411] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T21:01:13.596668] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-09T21:01:14.396770] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-09T21:01:14.746818] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-09T21:01:14.905454] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T21:01:15.196750] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-09T21:01:15.996718] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-09T21:01:16.218512] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T21:01:16.796696] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-09T21:01:17.126771] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T21:01:17.380600] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T21:01:17.596738] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-09T21:01:18.396746] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-09T21:01:18.629003] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T21:01:19.196713] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-09T21:01:19.251165] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T21:01:19.996745] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-09T21:01:20.177434] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T21:01:20.796755] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-09T21:01:21.243059] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T21:01:21.276735] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T21:01:21.596734] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-09T21:01:22.396690] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-09T21:01:22.494084] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T21:01:23.196805] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-09T21:01:23.629782] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T21:01:23.671626] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T21:01:23.996711] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-09T21:01:24.139160] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T21:01:24.796749] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-09T21:01:24.807206] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T21:01:24.811015] [INFO ] [REMOTE ] POR: Full fetch complete (68126 records). [2025-10-09T21:01:24.811108] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-09T21:01:24.812003] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:01:24.812090] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:01:24.812132] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:01:24.812171] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-09T21:01:24.812251] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-09T21:01:24.812305] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-09T21:01:24.812362] [DEBUG] [LOCAL ] POR: No derivative data file found to delete. [2025-10-09T21:01:24.812451] [INFO ] [MAIN ] Update Progress: 1715/2373 symbols completed. POR took 29.7s. Estimated remaining: 1h 32m 36s. Rate: 7.1 symbols/min [2025-10-09T21:01:24.993336] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:01:24.993574] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-09T21:01:24.993627] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-09T21:01:24.993764] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-09T21:01:24.993805] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-09T21:01:24.993847] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-09T21:01:24.993878] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-09T21:01:25.349726] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:01:25.596720] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-09T21:01:26.396718] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-09T21:01:26.460531] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T21:01:27.196807] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-09T21:01:27.525250] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T21:01:27.594131] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T21:01:27.949704] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T21:01:27.996712] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-09T21:01:28.711602] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:01:28.715381] [INFO ] [REMOTE ] PNW: Full fetch complete (65692 records). [2025-10-09T21:01:28.715476] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-09T21:01:28.716266] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:01:28.716354] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:01:28.716396] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:01:28.716435] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-09T21:01:28.716490] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-09T21:01:28.716525] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-09T21:01:28.716563] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-09T21:01:28.716635] [INFO ] [MAIN ] Update Progress: 1716/2373 symbols completed. PNW took 46.8s. Estimated remaining: 1h 32m 26s. Rate: 7.1 symbols/min [2025-10-09T21:01:28.801775] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-09T21:01:28.887599] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:01:28.907513] [DEBUG] [LOCAL ] PPT: Loaded 19997 existing records from primary storage. [2025-10-09T21:01:28.907795] [INFO ] [MAIN ] PPT: Loaded 19997 existing records. [2025-10-09T21:01:29.080878] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:01:29.081124] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-09T21:01:29.081179] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-09T21:01:29.081438] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-09T21:01:29.081495] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-09T21:01:29.429932] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:01:29.596737] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-09T21:01:30.396740] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-09T21:01:30.568605] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T21:01:31.196685] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-09T21:01:31.379807] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T21:01:31.996714] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-09T21:01:32.240975] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T21:01:32.796700] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-09T21:01:32.998445] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T21:01:33.082372] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T21:01:33.596754] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-09T21:01:34.313570] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T21:01:34.375411] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T21:01:34.396706] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-09T21:01:35.196717] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-09T21:01:35.555276] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T21:01:35.996731] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-09T21:01:36.796717] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-09T21:01:37.202727] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T21:01:37.459534] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-09T21:01:37.596691] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-09T21:01:37.866290] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T21:01:37.869285] [INFO ] [REMOTE ] POST: Full fetch complete (55129 records). [2025-10-09T21:01:37.869417] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-09T21:01:37.870109] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:01:37.870200] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:01:37.870244] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:01:37.870285] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-09T21:01:37.870343] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-09T21:01:37.870380] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-09T21:01:37.870421] [DEBUG] [LOCAL ] POST: No derivative data file found to delete. [2025-10-09T21:01:37.870482] [INFO ] [MAIN ] Update Progress: 1717/2373 symbols completed. POST took 34.2s. Estimated remaining: 1h 32m 18s. Rate: 7.1 symbols/min [2025-10-09T21:01:38.396734] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-09T21:01:39.196751] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-09T21:01:39.448999] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T21:01:39.759850] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-09T21:01:39.996759] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-09T21:01:40.732544] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T21:01:40.796678] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-09T21:01:41.235849] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T21:01:41.596703] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-09T21:01:41.676912] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T21:01:42.396747] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-09T21:01:43.196742] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-09T21:01:43.446709] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T21:01:43.553800] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T21:01:43.880762] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T21:01:43.884681] [INFO ] [REMOTE ] PPG: Full fetch complete (73393 records). [2025-10-09T21:01:43.884823] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-09T21:01:43.885730] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:01:43.885818] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:01:43.885860] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:01:43.885896] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-09T21:01:43.885952] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-09T21:01:43.885985] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-09T21:01:43.886039] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-09T21:01:43.886120] [INFO ] [MAIN ] Update Progress: 1718/2373 symbols completed. PPG took 35.1s. Estimated remaining: 1h 32m 8s. Rate: 7.1 symbols/min [2025-10-09T21:01:43.996701] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-09T21:01:44.796793] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-09T21:01:45.973427] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-09T21:01:45.985317] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-09T21:01:46.068903] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T21:01:46.396782] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-09T21:01:47.326443] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T21:01:47.336816] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-09T21:01:47.486425] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T21:01:47.996727] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-09T21:01:48.298832] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T21:01:48.796741] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-09T21:01:49.467005] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T21:01:49.596752] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-09T21:01:49.924905] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-09T21:01:50.074223] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T21:01:50.076243] [INFO ] [REMOTE ] PPT: Full fetch complete (28729 records). [2025-10-09T21:01:50.076325] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-09T21:01:50.077030] [FATAL] [VALIDATOR ] PPT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:01:50.077117] [FATAL] [MAIN ] PPT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:01:50.077160] [WARN ] [MAIN ] PPT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:01:50.077223] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-09T21:01:50.077300] [DEBUG] [LOCAL ] PPT: No primary data file found to delete. [2025-10-09T21:01:50.077379] [INFO ] [LOCAL ] PPT: Starting deletion of derivative data. [2025-10-09T21:01:50.077708] [DEBUG] [LOCAL ] PPT: Deleted derivative data file. [2025-10-09T21:01:50.077843] [INFO ] [MAIN ] Update Progress: 1719/2373 symbols completed. PPT took 21.4s. Estimated remaining: 1h 31m 59s. Rate: 7.1 symbols/min [2025-10-09T21:01:50.396784] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-09T21:01:51.566173] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T21:01:51.579139] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-09T21:01:52.137707] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T21:01:52.141806] [INFO ] [REMOTE ] PPL: Full fetch complete (77023 records). [2025-10-09T21:01:52.141946] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-09T21:01:52.142675] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:01:52.142767] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:01:52.142838] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:01:52.142910] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-09T21:01:52.142975] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-09T21:01:52.143012] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-09T21:01:52.143052] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-09T21:01:52.143138] [INFO ] [MAIN ] Update Progress: 1720/2373 symbols completed. PPL took 27.3s. Estimated remaining: 1h 31m 48s. Rate: 7.1 symbols/min [2025-10-09T21:01:52.745276] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:01:52.770469] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-09T21:01:52.764607] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:01:52.798758] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-09T21:01:52.816109] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-09T21:01:52.821416] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-09T21:01:52.846674] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-09T21:01:52.878128] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-09T21:01:52.877929] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-09T21:01:52.879466] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:01:52.883369] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-09T21:01:52.902482] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:01:52.902680] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-09T21:01:52.902967] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-09T21:01:52.903112] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-09T21:01:52.902865] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-09T21:01:52.908924] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-09T21:01:52.915709] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-09T21:01:52.916213] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-09T21:01:52.926529] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-09T21:01:52.941082] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-09T21:01:52.974506] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-09T21:01:52.974717] [DEBUG] [LOCAL ] PRCS: Loaded 2741 existing records from primary storage. [2025-10-09T21:01:53.073869] [INFO ] [MAIN ] PRCS: Loaded 2741 existing records. [2025-10-09T21:01:53.933133] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:01:53.976546] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-09T21:01:53.992982] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-09T21:01:54.068291] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-09T21:01:54.126795] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:01:54.136120] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-09T21:01:54.141916] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-09T21:01:54.284452] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:01:54.213622] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:01:54.290235] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-09T21:01:54.297351] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-09T21:01:54.581349] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:01:54.581685] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-09T21:01:55.087957] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T21:01:55.196704] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-09T21:01:55.343070] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T21:01:55.362878] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T21:01:55.676023] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T21:01:55.996745] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-09T21:01:56.240482] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T21:01:56.406297] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T21:01:56.796813] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-09T21:01:57.359702] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T21:01:57.596767] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-09T21:01:58.396772] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-09T21:01:58.882519] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T21:01:59.196734] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-09T21:01:59.412324] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T21:01:59.996745] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-09T21:02:00.718150] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T21:02:00.717105] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T21:02:00.796687] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-09T21:02:01.596757] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-09T21:02:02.128962] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T21:02:02.396800] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-09T21:02:02.565258] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T21:02:02.972480] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T21:02:03.196756] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-09T21:02:03.996724] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-09T21:02:04.477836] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T21:02:04.561768] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T21:02:04.796723] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-09T21:02:05.596736] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-09T21:02:06.209502] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T21:02:06.263689] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-09T21:02:06.396736] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-09T21:02:07.070072] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T21:02:07.196726] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-09T21:02:07.996706] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-09T21:02:08.306499] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T21:02:08.383505] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T21:02:08.796730] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-09T21:02:09.342478] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T21:02:09.343484] [INFO ] [REMOTE ] PRCS: Full fetch complete (3835 records). [2025-10-09T21:02:09.343579] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-09T21:02:09.344270] [FATAL] [VALIDATOR ] PRCS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:02:09.344375] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:02:09.344430] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:02:09.344546] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-09T21:02:09.344671] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-10-09T21:02:09.344740] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-10-09T21:02:09.344998] [DEBUG] [LOCAL ] PRCS: Deleted derivative data file. [2025-10-09T21:02:09.345096] [INFO ] [MAIN ] Update Progress: 1721/2373 symbols completed. PRCS took 17.2s. Estimated remaining: 1h 31m 43s. Rate: 7.1 symbols/min [2025-10-09T21:02:09.542440] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:02:09.542690] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-09T21:02:09.542748] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-09T21:02:09.542860] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-09T21:02:09.542903] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-09T21:02:09.542944] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-09T21:02:09.542977] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-09T21:02:09.602243] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-09T21:02:09.935087] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:02:10.396702] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-09T21:02:11.196699] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-09T21:02:11.617288] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-09T21:02:11.682217] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T21:02:11.996779] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-09T21:02:12.796744] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-09T21:02:13.015739] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T21:02:13.596760] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-09T21:02:13.964602] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T21:02:14.387335] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T21:02:14.396673] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-09T21:02:15.054147] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T21:02:15.196723] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-09T21:02:15.996724] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-09T21:02:16.098916] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T21:02:16.775541] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T21:02:16.796675] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-09T21:02:16.995935] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T21:02:17.596773] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-09T21:02:18.396762] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-09T21:02:18.673978] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T21:02:19.196712] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-09T21:02:19.379996] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T21:02:19.570285] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T21:02:19.996720] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-09T21:02:20.796699] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-09T21:02:21.109731] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T21:02:21.160957] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T21:02:21.596814] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-09T21:02:22.396693] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-09T21:02:22.514437] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T21:02:22.614958] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T21:02:23.196799] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-09T21:02:23.811847] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T21:02:23.814607] [INFO ] [REMOTE ] PRG: Full fetch complete (44109 records). [2025-10-09T21:02:23.814744] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-09T21:02:23.815445] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:02:23.815577] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:02:23.815622] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:02:23.815716] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-09T21:02:23.815810] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-09T21:02:23.815882] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-09T21:02:23.815997] [DEBUG] [LOCAL ] PRG: No derivative data file found to delete. [2025-10-09T21:02:23.816109] [INFO ] [MAIN ] Update Progress: 1722/2373 symbols completed. PRG took 31.7s. Estimated remaining: 1h 31m 37s. Rate: 7.1 symbols/min [2025-10-09T21:02:23.990297] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:02:23.990584] [DEBUG] [LOCAL ] PRH: No existing data file found in primary storage. [2025-10-09T21:02:23.990724] [WARN ] [MAIN ] PRH: No existing data found, performing full refresh instead. [2025-10-09T21:02:23.990927] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-09T21:02:23.991001] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-09T21:02:24.003157] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-09T21:02:24.014071] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-09T21:02:24.017600] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-09T21:02:24.024414] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T21:02:24.380592] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:02:24.796779] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-09T21:02:25.596743] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-09T21:02:26.074949] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-09T21:02:26.138875] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T21:02:26.193888] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T21:02:26.396681] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-09T21:02:27.147136] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T21:02:27.196675] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-09T21:02:27.308083] [DEBUG] [REMOTE ] PRH: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-09T21:02:27.308345] [WARN ] [REMOTE ] PRH: No data returned for month 2025-02 [2025-10-09T21:02:27.308458] [FATAL] [REMOTE ] PRH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:02:27.308570] [FATAL] [MAIN ] PRH: Failed to fetch primary data. [2025-10-09T21:02:27.308686] [WARN ] [MAIN ] PRH: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:02:27.308780] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-09T21:02:27.308882] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-09T21:02:27.308955] [INFO ] [LOCAL ] PRH: Starting deletion of derivative data. [2025-10-09T21:02:27.309042] [DEBUG] [LOCAL ] PRH: No derivative data file found to delete. [2025-10-09T21:02:27.309131] [INFO ] [MAIN ] Update Progress: 1723/2373 symbols completed. PRH took 3.5s. Estimated remaining: 1h 31m 27s. Rate: 7.1 symbols/min [2025-10-09T21:02:27.524957] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:02:27.525135] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-09T21:02:27.525172] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-09T21:02:27.525282] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-09T21:02:27.525323] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-09T21:02:27.525374] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-09T21:02:27.525445] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-09T21:02:27.881116] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:02:27.996716] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-09T21:02:28.796757] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-09T21:02:29.596897] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-09T21:02:30.018721] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-09T21:02:30.373690] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T21:02:30.396675] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-09T21:02:30.764837] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T21:02:31.010865] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T21:02:31.013537] [INFO ] [REMOTE ] PRA: Full fetch complete (43970 records). [2025-10-09T21:02:31.013624] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-09T21:02:31.014296] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:02:31.014401] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:02:31.014444] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:02:31.014484] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-09T21:02:31.014566] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-09T21:02:31.014626] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-09T21:02:31.014740] [DEBUG] [LOCAL ] PRA: No derivative data file found to delete. [2025-10-09T21:02:31.014847] [INFO ] [MAIN ] Update Progress: 1724/2373 symbols completed. PRA took 38.9s. Estimated remaining: 1h 31m 16s. Rate: 7.1 symbols/min [2025-10-09T21:02:31.186816] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:02:31.186979] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-09T21:02:31.187014] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-09T21:02:31.187124] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-09T21:02:31.187165] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-09T21:02:31.187224] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-09T21:02:31.187286] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-09T21:02:31.201906] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-09T21:02:31.560075] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:02:31.996764] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-09T21:02:32.796701] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-09T21:02:33.123722] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T21:02:33.596715] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-09T21:02:33.634976] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T21:02:33.981826] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T21:02:34.396776] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-09T21:02:35.196709] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-09T21:02:35.508855] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T21:02:35.562810] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T21:02:35.996753] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-09T21:02:36.796723] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-09T21:02:36.940190] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T21:02:37.452548] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T21:02:37.596682] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-09T21:02:37.829616] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T21:02:38.396697] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-09T21:02:38.439348] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T21:02:39.051386] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T21:02:39.056856] [INFO ] [REMOTE ] PR: Full fetch complete (77208 records). [2025-10-09T21:02:39.057061] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-09T21:02:39.058154] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:02:39.058261] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:02:39.058341] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:02:39.058429] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-09T21:02:39.058512] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-09T21:02:39.058568] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-09T21:02:39.058634] [DEBUG] [LOCAL ] PR: No derivative data file found to delete. [2025-10-09T21:02:39.058762] [INFO ] [MAIN ] Update Progress: 1725/2373 symbols completed. PR took 46.9s. Estimated remaining: 1h 31m 8s. Rate: 7.1 symbols/min [2025-10-09T21:02:39.201801] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-09T21:02:39.259888] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:02:39.260100] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-09T21:02:39.260145] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-09T21:02:39.260259] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-09T21:02:39.260303] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-09T21:02:39.260347] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-09T21:02:39.260380] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-09T21:02:39.703598] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:02:39.996718] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-09T21:02:40.718983] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T21:02:40.796688] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-09T21:02:41.473536] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T21:02:41.596743] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-09T21:02:42.166172] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T21:02:42.396696] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-09T21:02:42.479612] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T21:02:43.196738] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-09T21:02:43.996687] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-09T21:02:44.023868] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T21:02:44.796747] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-09T21:02:44.855955] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T21:02:45.244187] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T21:02:45.596725] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-09T21:02:46.397041] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-09T21:02:46.399526] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T21:02:46.570290] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T21:02:47.196714] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-09T21:02:47.267568] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T21:02:47.996729] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-09T21:02:48.742866] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T21:02:48.787041] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T21:02:48.792116] [INFO ] [REMOTE ] PRGO: Full fetch complete (68233 records). [2025-10-09T21:02:48.792240] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-09T21:02:48.793141] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:02:48.793226] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:02:48.793268] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:02:48.793334] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-09T21:02:48.793398] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-09T21:02:48.793433] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-09T21:02:48.793472] [DEBUG] [LOCAL ] PRGO: No derivative data file found to delete. [2025-10-09T21:02:48.793529] [INFO ] [MAIN ] Update Progress: 1726/2373 symbols completed. PRGO took 39.4s. Estimated remaining: 1h 30m 60s. Rate: 7.1 symbols/min [2025-10-09T21:02:48.804795] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-09T21:02:48.993018] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:02:48.993252] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-09T21:02:48.993296] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-09T21:02:48.993439] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-09T21:02:48.993517] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-09T21:02:48.993579] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-09T21:02:48.993613] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-09T21:02:49.340041] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:02:49.596688] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-09T21:02:50.111971] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T21:02:50.396766] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-09T21:02:50.650090] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T21:02:51.196715] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-09T21:02:52.003570] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-09T21:02:52.018559] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T21:02:52.428975] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T21:02:52.796764] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-09T21:02:53.443381] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T21:02:53.596736] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-09T21:02:53.924406] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T21:02:54.396720] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-09T21:02:54.943191] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T21:02:54.947516] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T21:02:55.196716] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-09T21:02:55.996710] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-09T21:02:56.513407] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T21:02:56.515126] [INFO ] [REMOTE ] PRI: Full fetch complete (25397 records). [2025-10-09T21:02:56.515200] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-09T21:02:56.516289] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:02:56.516374] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:02:56.516429] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:02:56.516518] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-09T21:02:56.516596] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-09T21:02:56.516725] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-09T21:02:56.516793] [DEBUG] [LOCAL ] PRI: No derivative data file found to delete. [2025-10-09T21:02:56.516880] [INFO ] [MAIN ] Update Progress: 1727/2373 symbols completed. PRI took 29.2s. Estimated remaining: 1h 30m 51s. Rate: 7.1 symbols/min [2025-10-09T21:02:56.687284] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:02:56.687431] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-09T21:02:56.687467] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-09T21:02:56.687576] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-09T21:02:56.687617] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-09T21:02:56.687716] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-09T21:02:56.687807] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-09T21:02:56.799117] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-09T21:02:57.063943] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:02:57.090770] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T21:02:57.596773] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-09T21:02:58.130600] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T21:02:58.396735] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-09T21:02:59.138725] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T21:02:59.196687] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-09T21:02:59.586898] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T21:02:59.996772] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-09T21:03:00.588007] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T21:03:00.796707] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-09T21:03:01.336123] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T21:03:01.596735] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-09T21:03:02.036752] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T21:03:02.396736] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-09T21:03:02.849815] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T21:03:03.196780] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-09T21:03:03.996731] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-09T21:03:04.168488] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T21:03:04.502891] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T21:03:04.796700] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-09T21:03:05.596809] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-09T21:03:06.045071] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T21:03:06.362265] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T21:03:06.396680] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-09T21:03:06.509402] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T21:03:07.196727] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-09T21:03:07.983594] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T21:03:07.996676] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-09T21:03:08.492601] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T21:03:08.796745] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-09T21:03:09.596711] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-09T21:03:09.718044] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T21:03:10.354141] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T21:03:10.396814] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-09T21:03:10.554023] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T21:03:11.196779] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-09T21:03:11.996711] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-09T21:03:12.099754] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T21:03:12.409028] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T21:03:12.796720] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-09T21:03:13.602418] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-09T21:03:13.618466] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T21:03:14.051381] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T21:03:14.396722] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-09T21:03:15.196720] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-09T21:03:15.260896] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T21:03:15.623176] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T21:03:15.695830] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T21:03:15.996781] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-09T21:03:16.796701] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-09T21:03:17.117799] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T21:03:17.596729] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-09T21:03:18.286348] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T21:03:18.396688] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-09T21:03:18.563913] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T21:03:18.903180] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T21:03:18.906896] [INFO ] [REMOTE ] PRKS: Full fetch complete (61178 records). [2025-10-09T21:03:18.907011] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-09T21:03:18.911032] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:03:18.911162] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:03:18.911210] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:03:18.911265] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-09T21:03:18.911349] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-09T21:03:18.911398] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-09T21:03:18.911466] [DEBUG] [LOCAL ] PRKS: No derivative data file found to delete. [2025-10-09T21:03:18.911545] [INFO ] [MAIN ] Update Progress: 1728/2373 symbols completed. PRKS took 39.9s. Estimated remaining: 1h 30m 48s. Rate: 7.1 symbols/min [2025-10-09T21:03:19.085400] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:03:19.085592] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-09T21:03:19.085630] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-09T21:03:19.085760] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-09T21:03:19.085801] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-09T21:03:19.085843] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-09T21:03:19.085875] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-09T21:03:19.201897] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-09T21:03:19.441013] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:03:19.959509] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T21:03:19.961204] [INFO ] [REMOTE ] PRLB: Full fetch complete (30262 records). [2025-10-09T21:03:19.961278] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-09T21:03:19.961763] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:03:19.961849] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:03:19.961892] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:03:19.961930] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-09T21:03:19.961985] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-09T21:03:19.962021] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-09T21:03:19.962060] [DEBUG] [LOCAL ] PRLB: No derivative data file found to delete. [2025-10-09T21:03:19.962112] [INFO ] [MAIN ] Update Progress: 1729/2373 symbols completed. PRLB took 31.2s. Estimated remaining: 1h 30m 37s. Rate: 7.1 symbols/min [2025-10-09T21:03:20.001891] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-09T21:03:20.136261] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:03:20.136436] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-09T21:03:20.136532] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-09T21:03:20.136672] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-09T21:03:20.136729] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-09T21:03:20.136774] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-09T21:03:20.136808] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-09T21:03:20.490226] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:03:20.796726] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-09T21:03:21.078174] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T21:03:21.596737] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-09T21:03:22.111998] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T21:03:22.171341] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:03:22.174726] [INFO ] [REMOTE ] PRIM: Full fetch complete (63172 records). [2025-10-09T21:03:22.174827] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-09T21:03:22.175484] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:03:22.175572] [FATAL] [MAIN ] PRIM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:03:22.175616] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:03:22.175694] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-09T21:03:22.175769] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-09T21:03:22.175806] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-09T21:03:22.175846] [DEBUG] [LOCAL ] PRIM: No derivative data file found to delete. [2025-10-09T21:03:22.175902] [INFO ] [MAIN ] Update Progress: 1730/2373 symbols completed. PRIM took 51.2s. Estimated remaining: 1h 30m 26s. Rate: 7.1 symbols/min [2025-10-09T21:03:22.341191] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:03:22.341393] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-09T21:03:22.341448] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-09T21:03:22.341560] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-09T21:03:22.341601] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-09T21:03:22.341663] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-09T21:03:22.341720] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-09T21:03:22.401814] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-09T21:03:22.691583] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:03:23.196733] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-09T21:03:23.476889] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:03:23.477288] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-09T21:03:23.477406] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:03:23.477505] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-09T21:03:23.477591] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:03:23.477796] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-09T21:03:23.477906] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-09T21:03:23.477980] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-09T21:03:23.478074] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-09T21:03:23.478146] [INFO ] [MAIN ] Update Progress: 1731/2373 symbols completed. PRSU took 1.3s. Estimated remaining: 1h 30m 15s. Rate: 7.1 symbols/min [2025-10-09T21:03:23.651664] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:03:23.651799] [DEBUG] [LOCAL ] PRT: No existing data file found in primary storage. [2025-10-09T21:03:23.651835] [WARN ] [MAIN ] PRT: No existing data found, performing full refresh instead. [2025-10-09T21:03:23.651943] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-09T21:03:23.651986] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-09T21:03:23.652027] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-09T21:03:23.652058] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-09T21:03:24.007295] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-09T21:03:24.012035] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:03:24.253259] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T21:03:24.796719] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-09T21:03:25.442117] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T21:03:25.544199] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T21:03:25.596708] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-09T21:03:26.396741] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-09T21:03:26.659442] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T21:03:27.018626] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T21:03:27.022538] [INFO ] [REMOTE ] PRM: Full fetch complete (64183 records). [2025-10-09T21:03:27.022745] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-09T21:03:27.023635] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:03:27.023752] [FATAL] [MAIN ] PRM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:03:27.023798] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:03:27.023842] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-09T21:03:27.023900] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-09T21:03:27.023937] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-09T21:03:27.024030] [DEBUG] [LOCAL ] PRM: No derivative data file found to delete. [2025-10-09T21:03:27.024099] [INFO ] [MAIN ] Update Progress: 1732/2373 symbols completed. PRM took 30.5s. Estimated remaining: 1h 30m 5s. Rate: 7.1 symbols/min [2025-10-09T21:03:27.196946] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-09T21:03:27.214871] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:03:27.216088] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-09T21:03:27.216132] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-09T21:03:27.216272] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-09T21:03:27.216329] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-09T21:03:27.216399] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-09T21:03:27.216433] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-09T21:03:27.565219] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:03:27.996719] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-09T21:03:28.430164] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T21:03:28.796728] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-09T21:03:29.596710] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-09T21:03:29.821532] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T21:03:30.325176] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T21:03:30.396711] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-09T21:03:31.023541] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T21:03:31.196714] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-09T21:03:31.996690] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-09T21:03:32.270597] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T21:03:32.638071] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T21:03:32.650799] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T21:03:32.796753] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-09T21:03:33.596719] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-09T21:03:34.396738] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-09T21:03:34.600681] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T21:03:35.196687] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-09T21:03:35.470062] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T21:03:35.944166] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T21:03:35.996681] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-09T21:03:36.796683] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-09T21:03:37.167202] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-09T21:03:37.387441] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T21:03:37.596728] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-09T21:03:38.212170] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T21:03:38.386491] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T21:03:38.396673] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-09T21:03:39.157339] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T21:03:39.196665] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-09T21:03:39.889436] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T21:03:39.996704] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-09T21:03:40.796772] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-09T21:03:41.596693] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-09T21:03:41.776057] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T21:03:42.396731] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-09T21:03:42.465770] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T21:03:43.196689] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-09T21:03:43.419903] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T21:03:43.614305] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T21:03:43.996682] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-09T21:03:44.326917] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T21:03:44.531114] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T21:03:44.796777] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-09T21:03:45.430303] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T21:03:45.434234] [INFO ] [REMOTE ] PRO: Full fetch complete (52384 records). [2025-10-09T21:03:45.434342] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-09T21:03:45.435015] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:03:45.435112] [FATAL] [MAIN ] PRO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:03:45.435175] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:03:45.435262] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-09T21:03:45.435355] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-09T21:03:45.435412] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-09T21:03:45.435482] [DEBUG] [LOCAL ] PRO: No derivative data file found to delete. [2025-10-09T21:03:45.435594] [INFO ] [MAIN ] Update Progress: 1733/2373 symbols completed. PRO took 25.5s. Estimated remaining: 1h 29m 60s. Rate: 7.1 symbols/min [2025-10-09T21:03:45.596905] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-09T21:03:45.620072] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:03:45.620261] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-09T21:03:45.620322] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-09T21:03:45.620440] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-09T21:03:45.620505] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-09T21:03:45.620566] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-09T21:03:45.620602] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-09T21:03:45.975263] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:03:46.396732] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-09T21:03:46.766494] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-09T21:03:47.196692] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-09T21:03:47.523466] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T21:03:47.758718] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T21:03:47.996720] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-09T21:03:48.796742] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-09T21:03:49.399750] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T21:03:49.596694] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-09T21:03:49.808472] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T21:03:50.010133] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T21:03:50.396723] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-09T21:03:51.196709] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-09T21:03:51.819706] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T21:03:51.996691] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-09T21:03:52.030310] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T21:03:52.521478] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T21:03:52.796753] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-09T21:03:53.164609] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-09T21:03:53.596728] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-09T21:03:54.338054] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T21:03:54.396791] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-09T21:03:55.196725] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-09T21:03:55.996685] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-09T21:03:56.065117] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T21:03:56.109575] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T21:03:56.575054] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T21:03:56.796734] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-09T21:03:57.244763] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T21:03:57.596799] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-09T21:03:58.026554] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-09T21:03:58.396767] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-09T21:03:58.838840] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T21:03:59.196776] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-09T21:03:59.996782] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-09T21:04:00.016201] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T21:04:00.021109] [INFO ] [REMOTE ] PRMB: Full fetch complete (75676 records). [2025-10-09T21:04:00.021369] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-09T21:04:00.024546] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:04:00.024841] [FATAL] [MAIN ] PRMB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:04:00.024931] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:04:00.025028] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-09T21:04:00.025121] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-09T21:04:00.025181] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-09T21:04:00.025226] [DEBUG] [LOCAL ] PRMB: No derivative data file found to delete. [2025-10-09T21:04:00.025318] [INFO ] [MAIN ] Update Progress: 1734/2373 symbols completed. PRMB took 41.1s. Estimated remaining: 1h 29m 54s. Rate: 7.1 symbols/min [2025-10-09T21:04:00.196814] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:04:00.197020] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-09T21:04:00.197078] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-09T21:04:00.197201] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-09T21:04:00.197246] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-09T21:04:00.197315] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-09T21:04:00.197350] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-09T21:04:00.553564] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:04:00.796714] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-09T21:04:01.250168] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T21:04:01.596688] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-09T21:04:01.879080] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T21:04:02.396768] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-09T21:04:02.708551] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T21:04:03.202301] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-09T21:04:03.216300] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T21:04:03.996707] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-09T21:04:04.408474] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T21:04:04.409501] [INFO ] [REMOTE ] PRT: Full fetch complete (8847 records). [2025-10-09T21:04:04.409617] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-09T21:04:04.410064] [FATAL] [VALIDATOR ] PRT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:04:04.410147] [FATAL] [MAIN ] PRT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:04:04.410188] [WARN ] [MAIN ] PRT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:04:04.410226] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-09T21:04:04.410294] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-09T21:04:04.410351] [INFO ] [LOCAL ] PRT: Starting deletion of derivative data. [2025-10-09T21:04:04.410394] [DEBUG] [LOCAL ] PRT: No derivative data file found to delete. [2025-10-09T21:04:04.410474] [INFO ] [MAIN ] Update Progress: 1735/2373 symbols completed. PRT took 40.9s. Estimated remaining: 1h 29m 44s. Rate: 7.1 symbols/min [2025-10-09T21:04:04.580169] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:04:04.580429] [DEBUG] [LOCAL ] PSBD: No existing data file found in primary storage. [2025-10-09T21:04:04.580486] [WARN ] [MAIN ] PSBD: No existing data found, performing full refresh instead. [2025-10-09T21:04:04.580608] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-09T21:04:04.580685] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-09T21:04:04.580749] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-09T21:04:04.580783] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-09T21:04:04.801960] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-09T21:04:04.942575] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:04:04.992545] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T21:04:05.596762] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-09T21:04:06.033072] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T21:04:06.033902] [INFO ] [REMOTE ] PRVS: Full fetch complete (1256 records). [2025-10-09T21:04:06.033987] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-09T21:04:06.034385] [FATAL] [VALIDATOR ] PRVS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:04:06.034484] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:04:06.034552] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:04:06.034625] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-09T21:04:06.034729] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-09T21:04:06.034777] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-09T21:04:06.034824] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-09T21:04:06.034880] [INFO ] [MAIN ] Update Progress: 1736/2373 symbols completed. PRVS took 20.6s. Estimated remaining: 1h 29m 33s. Rate: 7.1 symbols/min [2025-10-09T21:04:06.232088] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:04:06.265348] [DEBUG] [LOCAL ] PSF: Loaded 6974 existing records from primary storage. [2025-10-09T21:04:06.265583] [INFO ] [MAIN ] PSF: Loaded 6974 existing records. [2025-10-09T21:04:06.400973] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-09T21:04:06.460328] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:04:06.461106] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-09T21:04:06.461295] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-09T21:04:06.462534] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-09T21:04:06.462600] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-09T21:04:06.598597] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T21:04:06.889829] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:04:07.130428] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T21:04:07.196695] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-09T21:04:07.996738] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-09T21:04:08.797985] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-09T21:04:08.800225] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T21:04:09.126663] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-09T21:04:09.596708] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-09T21:04:09.627011] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T21:04:10.171873] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T21:04:10.396758] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-09T21:04:11.196718] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-09T21:04:11.442150] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T21:04:11.644971] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T21:04:11.996768] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-09T21:04:12.752395] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T21:04:12.796725] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-09T21:04:13.506235] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-09T21:04:13.596720] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-09T21:04:14.396730] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-09T21:04:14.411599] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T21:04:15.196801] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-09T21:04:15.257159] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T21:04:15.261275] [INFO ] [REMOTE ] PRU: Full fetch complete (73798 records). [2025-10-09T21:04:15.261436] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-09T21:04:15.262313] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:04:15.262410] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:04:15.262475] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:04:15.262514] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-09T21:04:15.262572] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-09T21:04:15.262606] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-09T21:04:15.262675] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-09T21:04:15.262758] [INFO ] [MAIN ] Update Progress: 1737/2373 symbols completed. PRU took 48.2s. Estimated remaining: 1h 29m 25s. Rate: 7.1 symbols/min [2025-10-09T21:04:15.440226] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:04:15.440490] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-09T21:04:15.440531] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-09T21:04:15.440687] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-09T21:04:15.440743] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-09T21:04:15.440787] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-09T21:04:15.440822] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-09T21:04:15.851075] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:04:15.996789] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-09T21:04:16.045857] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T21:04:16.765768] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T21:04:16.796764] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-09T21:04:17.377586] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T21:04:17.596696] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-09T21:04:18.396734] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-09T21:04:18.996139] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T21:04:19.098271] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T21:04:19.196726] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-09T21:04:19.996763] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-09T21:04:20.016691] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T21:04:20.796769] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-09T21:04:21.141637] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T21:04:21.596794] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-09T21:04:22.393765] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T21:04:22.400928] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-09T21:04:22.923310] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T21:04:23.075271] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T21:04:23.196730] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-09T21:04:23.790289] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T21:04:23.996741] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-09T21:04:24.796757] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-09T21:04:24.919605] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T21:04:25.596760] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-09T21:04:25.640780] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T21:04:26.330470] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T21:04:26.396729] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-09T21:04:27.196727] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-09T21:04:27.942720] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T21:04:27.996701] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-09T21:04:28.609970] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T21:04:28.796734] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-09T21:04:28.883283] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T21:04:29.596714] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-09T21:04:30.283029] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T21:04:30.303100] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T21:04:30.396701] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-09T21:04:31.196711] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-09T21:04:31.714379] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T21:04:31.715741] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T21:04:31.726055] [INFO ] [REMOTE ] PSBD: Full fetch complete (9836 records). [2025-10-09T21:04:31.726438] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-09T21:04:31.727097] [FATAL] [VALIDATOR ] PSBD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:04:31.727185] [FATAL] [MAIN ] PSBD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:04:31.727228] [WARN ] [MAIN ] PSBD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:04:31.727291] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-09T21:04:31.727375] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-09T21:04:31.727431] [INFO ] [LOCAL ] PSBD: Starting deletion of derivative data. [2025-10-09T21:04:31.727489] [DEBUG] [LOCAL ] PSBD: No derivative data file found to delete. [2025-10-09T21:04:31.727565] [INFO ] [MAIN ] Update Progress: 1738/2373 symbols completed. PSBD took 27.3s. Estimated remaining: 1h 29m 19s. Rate: 7.1 symbols/min [2025-10-09T21:04:31.895108] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:04:31.895301] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-09T21:04:31.895339] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-09T21:04:31.895453] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-09T21:04:31.895493] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-09T21:04:31.895534] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-09T21:04:31.895566] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-09T21:04:32.001812] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-09T21:04:32.250761] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:04:32.796734] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-09T21:04:33.513895] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T21:04:33.596695] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-09T21:04:34.080811] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T21:04:34.396752] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-09T21:04:35.055440] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T21:04:35.196732] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-09T21:04:35.575557] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T21:04:35.576597] [INFO ] [REMOTE ] PSF: Full fetch complete (9754 records). [2025-10-09T21:04:35.576801] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-09T21:04:35.577192] [FATAL] [VALIDATOR ] PSF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:04:35.577272] [FATAL] [MAIN ] PSF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:04:35.577315] [WARN ] [MAIN ] PSF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:04:35.577352] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-09T21:04:35.577407] [DEBUG] [LOCAL ] PSF: No primary data file found to delete. [2025-10-09T21:04:35.577442] [INFO ] [LOCAL ] PSF: Starting deletion of derivative data. [2025-10-09T21:04:35.577769] [DEBUG] [LOCAL ] PSF: Deleted derivative data file. [2025-10-09T21:04:35.577859] [INFO ] [MAIN ] Update Progress: 1739/2373 symbols completed. PSF took 29.5s. Estimated remaining: 1h 29m 9s. Rate: 7.1 symbols/min [2025-10-09T21:04:35.755375] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:04:35.755709] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-09T21:04:35.755764] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-09T21:04:35.755874] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-09T21:04:35.755915] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-09T21:04:35.755962] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-09T21:04:35.755994] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-09T21:04:36.004712] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-09T21:04:36.122452] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:04:36.148534] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T21:04:36.796774] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-09T21:04:37.596684] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-09T21:04:37.642111] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T21:04:37.836922] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T21:04:38.396710] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-09T21:04:39.196685] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-09T21:04:39.377138] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T21:04:39.489238] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T21:04:39.996723] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-09T21:04:40.796731] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-09T21:04:40.963421] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T21:04:41.482564] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T21:04:41.509322] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T21:04:41.596697] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-09T21:04:42.164986] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:04:42.168283] [INFO ] [REMOTE ] PSFE: Full fetch complete (42857 records). [2025-10-09T21:04:42.168755] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-09T21:04:42.170290] [FATAL] [VALIDATOR ] PSFE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:04:42.170409] [FATAL] [MAIN ] PSFE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:04:42.170455] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:04:42.170504] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-09T21:04:42.170564] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-09T21:04:42.170600] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-09T21:04:42.170638] [DEBUG] [LOCAL ] PSFE: No derivative data file found to delete. [2025-10-09T21:04:42.170774] [INFO ] [MAIN ] Update Progress: 1740/2373 symbols completed. PSFE took 26.9s. Estimated remaining: 1h 28m 60s. Rate: 7.1 symbols/min [2025-10-09T21:04:42.350311] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:04:42.350512] [DEBUG] [LOCAL ] PSQH: No existing data file found in primary storage. [2025-10-09T21:04:42.350558] [WARN ] [MAIN ] PSQH: No existing data found, performing full refresh instead. [2025-10-09T21:04:42.350700] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-09T21:04:42.350755] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-09T21:04:42.350799] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-09T21:04:42.350832] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-09T21:04:42.405868] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-09T21:04:42.738541] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:04:43.196814] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-09T21:04:44.006578] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-09T21:04:44.009457] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T21:04:44.796781] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-09T21:04:45.372635] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-09T21:04:45.547474] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T21:04:45.596701] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-09T21:04:45.645941] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T21:04:46.396774] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-09T21:04:46.911521] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T21:04:47.196696] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-09T21:04:47.299799] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T21:04:47.996766] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-09T21:04:48.796777] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-09T21:04:48.883927] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T21:04:49.141178] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T21:04:49.144254] [INFO ] [REMOTE ] PSA: Full fetch complete (58899 records). [2025-10-09T21:04:49.144360] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-09T21:04:49.145142] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:04:49.145231] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:04:49.145276] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:04:49.145326] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-09T21:04:49.145410] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-09T21:04:49.145448] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-09T21:04:49.145492] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-09T21:04:49.145550] [INFO ] [MAIN ] Update Progress: 1741/2373 symbols completed. PSA took 49.1s. Estimated remaining: 1h 28m 51s. Rate: 7.1 symbols/min [2025-10-09T21:04:49.325954] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:04:49.326140] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-09T21:04:49.326197] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-09T21:04:49.326327] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-09T21:04:49.326369] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-09T21:04:49.326413] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-09T21:04:49.326455] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-09T21:04:49.599794] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-09T21:04:49.694881] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T21:04:49.723668] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:04:50.396690] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-09T21:04:51.193611] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T21:04:51.203164] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-09T21:04:51.996755] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-09T21:04:52.345955] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T21:04:52.796694] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-09T21:04:52.873888] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T21:04:53.596687] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-09T21:04:53.769975] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T21:04:54.396756] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-09T21:04:54.575287] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T21:04:55.196724] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-09T21:04:55.354824] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T21:04:55.996706] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-09T21:04:56.032518] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T21:04:56.796773] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-09T21:04:57.226038] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-09T21:04:57.427332] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T21:04:57.596718] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-09T21:04:58.300866] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T21:04:58.396675] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-09T21:04:59.196748] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-09T21:04:59.521953] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T21:04:59.996743] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-09T21:05:00.100927] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T21:05:00.431880] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T21:05:00.796793] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-09T21:05:01.596699] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-09T21:05:01.764741] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T21:05:02.396685] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-09T21:05:02.678290] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T21:05:02.925707] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T21:05:03.196779] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-09T21:05:03.807102] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T21:05:03.996752] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-09T21:05:04.798370] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-09T21:05:04.801582] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T21:05:05.596685] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-09T21:05:05.730905] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T21:05:06.396693] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-09T21:05:06.842884] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-09T21:05:06.911321] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T21:05:06.982428] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T21:05:07.196735] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-09T21:05:07.996739] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-09T21:05:08.764254] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T21:05:08.796729] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-09T21:05:09.434943] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T21:05:09.439518] [INFO ] [REMOTE ] PSN: Full fetch complete (66708 records). [2025-10-09T21:05:09.439676] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-09T21:05:09.440454] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:05:09.440555] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:05:09.440679] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:05:09.440769] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-09T21:05:09.440850] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-09T21:05:09.440901] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-09T21:05:09.440999] [DEBUG] [LOCAL ] PSN: No derivative data file found to delete. [2025-10-09T21:05:09.441095] [INFO ] [MAIN ] Update Progress: 1742/2373 symbols completed. PSN took 37.7s. Estimated remaining: 1h 28m 47s. Rate: 7.1 symbols/min [2025-10-09T21:05:09.613876] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-09T21:05:09.616961] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:05:09.618394] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-09T21:05:09.618509] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-09T21:05:09.618662] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-09T21:05:09.618731] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-09T21:05:09.618899] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-09T21:05:09.619007] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-09T21:05:09.786118] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T21:05:10.007580] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:05:10.396745] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-09T21:05:11.196756] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-09T21:05:11.592145] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T21:05:11.996755] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-09T21:05:12.032965] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T21:05:12.204635] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T21:05:12.796816] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-09T21:05:13.355136] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T21:05:13.596726] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-09T21:05:13.668819] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T21:05:14.373636] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T21:05:14.376635] [INFO ] [REMOTE ] PSO: Full fetch complete (51830 records). [2025-10-09T21:05:14.376751] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-09T21:05:14.377383] [FATAL] [VALIDATOR ] PSO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:05:14.377516] [FATAL] [MAIN ] PSO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:05:14.377560] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:05:14.377600] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-09T21:05:14.377682] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-09T21:05:14.377758] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-09T21:05:14.377828] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-09T21:05:14.377935] [INFO ] [MAIN ] Update Progress: 1743/2373 symbols completed. PSO took 38.8s. Estimated remaining: 1h 28m 37s. Rate: 7.1 symbols/min [2025-10-09T21:05:14.401914] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-09T21:05:14.577236] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:05:14.577370] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-09T21:05:14.577432] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-09T21:05:14.577595] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-09T21:05:14.577761] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-09T21:05:14.577863] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-09T21:05:14.577919] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-09T21:05:14.931216] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:05:15.196714] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-09T21:05:15.912612] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T21:05:15.996704] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-09T21:05:16.152031] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T21:05:16.467375] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T21:05:16.470606] [INFO ] [REMOTE ] PSQH: Full fetch complete (53120 records). [2025-10-09T21:05:16.470717] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-09T21:05:16.471403] [FATAL] [VALIDATOR ] PSQH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:05:16.471497] [FATAL] [MAIN ] PSQH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:05:16.471541] [WARN ] [MAIN ] PSQH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:05:16.471581] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-09T21:05:16.471638] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-09T21:05:16.471723] [INFO ] [LOCAL ] PSQH: Starting deletion of derivative data. [2025-10-09T21:05:16.471771] [DEBUG] [LOCAL ] PSQH: No derivative data file found to delete. [2025-10-09T21:05:16.471885] [INFO ] [MAIN ] Update Progress: 1744/2373 symbols completed. PSQH took 34.3s. Estimated remaining: 1h 28m 26s. Rate: 7.1 symbols/min [2025-10-09T21:05:16.641303] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:05:16.641475] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-09T21:05:16.641512] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-09T21:05:16.641627] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-09T21:05:16.641703] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-09T21:05:16.641756] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-09T21:05:16.641791] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-09T21:05:16.798688] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-09T21:05:16.999974] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:05:17.596687] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-09T21:05:18.255880] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T21:05:18.396695] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-09T21:05:18.665024] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-09T21:05:18.669071] [INFO ] [REMOTE ] PSTG: Full fetch complete (76173 records). [2025-10-09T21:05:18.669188] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-09T21:05:18.670164] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:05:18.670253] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:05:18.670312] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:05:18.670396] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-09T21:05:18.671008] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-09T21:05:18.671057] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-09T21:05:18.671100] [DEBUG] [LOCAL ] PSTG: No derivative data file found to delete. [2025-10-09T21:05:18.671162] [INFO ] [MAIN ] Update Progress: 1745/2373 symbols completed. PSTG took 29.5s. Estimated remaining: 1h 28m 16s. Rate: 7.1 symbols/min [2025-10-09T21:05:18.851177] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:05:18.884368] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T21:05:18.928777] [DEBUG] [LOCAL ] PTY: Loaded 37470 existing records from primary storage. [2025-10-09T21:05:18.929066] [INFO ] [MAIN ] PTY: Loaded 37470 existing records. [2025-10-09T21:05:19.124403] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:05:19.124595] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-09T21:05:19.124661] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-09T21:05:19.125097] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-09T21:05:19.125155] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-09T21:05:19.201821] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-09T21:05:19.474610] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:05:19.996709] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-09T21:05:20.796698] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-09T21:05:20.972396] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T21:05:21.114531] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T21:05:21.596725] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-09T21:05:21.790693] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T21:05:22.396716] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-09T21:05:23.196694] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-09T21:05:23.375890] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T21:05:23.675358] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T21:05:23.996737] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-09T21:05:24.031018] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T21:05:24.796720] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-09T21:05:25.528776] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T21:05:25.596678] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-09T21:05:26.045772] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T21:05:26.396722] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-09T21:05:26.927260] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T21:05:27.196683] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-09T21:05:27.409920] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T21:05:27.996734] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-09T21:05:28.796701] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-09T21:05:28.841141] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T21:05:29.596697] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-09T21:05:29.685851] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T21:05:30.021899] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T21:05:30.221659] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T21:05:30.396720] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-09T21:05:31.196695] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-09T21:05:31.491489] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T21:05:31.996742] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-09T21:05:32.286919] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T21:05:32.796780] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-09T21:05:33.596746] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-09T21:05:33.883222] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T21:05:34.103777] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T21:05:34.396732] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-09T21:05:34.661792] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T21:05:35.196734] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-09T21:05:35.891011] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T21:05:35.996677] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-09T21:05:36.021982] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T21:05:36.796728] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-09T21:05:37.247406] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T21:05:37.537294] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T21:05:37.596675] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-09T21:05:38.396746] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-09T21:05:38.673622] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T21:05:39.196678] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-09T21:05:39.301609] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T21:05:39.996699] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-09T21:05:40.327847] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T21:05:40.796750] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-09T21:05:41.598942] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-09T21:05:41.603817] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T21:05:42.396734] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-09T21:05:42.598481] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T21:05:42.909991] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T21:05:43.196745] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-09T21:05:43.836014] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T21:05:43.872341] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T21:05:43.996762] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-09T21:05:44.688696] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T21:05:44.690617] [INFO ] [REMOTE ] PSTL: Full fetch complete (29489 records). [2025-10-09T21:05:44.690782] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-09T21:05:44.691327] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:05:44.691414] [FATAL] [MAIN ] PSTL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:05:44.691460] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:05:44.691499] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-09T21:05:44.691553] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-09T21:05:44.691589] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-09T21:05:44.691637] [DEBUG] [LOCAL ] PSTL: No derivative data file found to delete. [2025-10-09T21:05:44.691755] [INFO ] [MAIN ] Update Progress: 1746/2373 symbols completed. PSTL took 35.3s. Estimated remaining: 1h 28m 14s. Rate: 7.1 symbols/min [2025-10-09T21:05:44.801782] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-09T21:05:44.874947] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:05:44.875110] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-09T21:05:44.875147] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-09T21:05:44.875254] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-09T21:05:44.875295] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-09T21:05:44.875335] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-09T21:05:44.875367] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-09T21:05:45.224257] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:05:45.583689] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T21:05:45.596663] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-09T21:05:46.136841] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:05:46.396774] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-09T21:05:47.196694] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-09T21:05:47.370596] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T21:05:47.996746] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-09T21:05:48.796707] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-09T21:05:49.089229] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T21:05:49.168313] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:05:49.171378] [INFO ] [REMOTE ] PTY: Full fetch complete (53586 records). [2025-10-09T21:05:49.171465] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-09T21:05:49.172133] [FATAL] [VALIDATOR ] PTY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:05:49.172237] [FATAL] [MAIN ] PTY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:05:49.172315] [WARN ] [MAIN ] PTY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:05:49.172418] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-09T21:05:49.172496] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-09T21:05:49.172533] [INFO ] [LOCAL ] PTY: Starting deletion of derivative data. [2025-10-09T21:05:49.172753] [DEBUG] [LOCAL ] PTY: Deleted derivative data file. [2025-10-09T21:05:49.172848] [INFO ] [MAIN ] Update Progress: 1747/2373 symbols completed. PTY took 30.5s. Estimated remaining: 1h 28m 4s. Rate: 7.1 symbols/min [2025-10-09T21:05:49.350520] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:05:49.350762] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-09T21:05:49.350807] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-09T21:05:49.350938] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-09T21:05:49.351027] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-09T21:05:49.351111] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-09T21:05:49.351180] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-09T21:05:49.601484] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-09T21:05:49.731430] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:05:49.885830] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T21:05:49.989724] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T21:05:49.991543] [INFO ] [REMOTE ] PTA: Full fetch complete (22781 records). [2025-10-09T21:05:49.991619] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-09T21:05:49.992119] [FATAL] [VALIDATOR ] PTA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:05:49.992205] [FATAL] [MAIN ] PTA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:05:49.992254] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:05:49.992294] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-09T21:05:49.992354] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-09T21:05:49.992416] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-09T21:05:49.992490] [DEBUG] [LOCAL ] PTA: No derivative data file found to delete. [2025-10-09T21:05:49.992547] [INFO ] [MAIN ] Update Progress: 1748/2373 symbols completed. PTA took 33.5s. Estimated remaining: 1h 27m 53s. Rate: 7.1 symbols/min [2025-10-09T21:05:50.203824] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:05:50.204068] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-09T21:05:50.204120] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-09T21:05:50.204240] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-09T21:05:50.204285] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-09T21:05:50.204327] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-09T21:05:50.204361] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-09T21:05:50.403337] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-09T21:05:50.592188] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:05:51.196701] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-09T21:05:51.983083] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T21:05:51.996675] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-09T21:05:52.796759] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-09T21:05:53.035476] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T21:05:53.596704] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-09T21:05:53.735322] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T21:05:54.155815] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T21:05:54.396731] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-09T21:05:55.196750] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-09T21:05:55.515867] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-09T21:05:55.731239] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T21:05:55.996720] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-09T21:05:56.796699] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-09T21:05:57.129599] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T21:05:57.523879] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T21:05:57.596820] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-09T21:05:58.140372] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T21:05:58.396733] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-09T21:05:59.196696] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-09T21:05:59.618784] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T21:05:59.996695] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-09T21:06:00.120328] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T21:06:00.796740] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-09T21:06:00.969350] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T21:06:01.423849] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T21:06:01.596734] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-09T21:06:02.396760] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-09T21:06:02.698088] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T21:06:02.986355] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T21:06:03.068036] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T21:06:03.196690] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-09T21:06:03.996781] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-09T21:06:04.415830] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T21:06:04.422467] [INFO ] [REMOTE ] PSX: Full fetch complete (76639 records). [2025-10-09T21:06:04.422751] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-09T21:06:04.424280] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:06:04.424471] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:06:04.424550] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:06:04.424627] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-09T21:06:04.424771] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-09T21:06:04.424844] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-09T21:06:04.425005] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-09T21:06:04.425121] [INFO ] [MAIN ] Update Progress: 1749/2373 symbols completed. PSX took 50.0s. Estimated remaining: 1h 27m 46s. Rate: 7.1 symbols/min [2025-10-09T21:06:04.684996] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:06:04.685288] [DEBUG] [LOCAL ] PVL: No existing data file found in primary storage. [2025-10-09T21:06:04.685407] [WARN ] [MAIN ] PVL: No existing data found, performing full refresh instead. [2025-10-09T21:06:04.685801] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-09T21:06:04.685960] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-09T21:06:04.686030] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-09T21:06:04.686066] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-09T21:06:04.798508] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-09T21:06:05.194705] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T21:06:05.217889] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:06:05.596774] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-09T21:06:06.396716] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-09T21:06:06.508741] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T21:06:06.860752] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T21:06:07.196735] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-09T21:06:07.912160] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T21:06:07.959313] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T21:06:07.996676] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-09T21:06:08.796714] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-09T21:06:09.596752] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-09T21:06:09.770816] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T21:06:10.162116] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T21:06:10.304600] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T21:06:10.396685] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-09T21:06:11.196710] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-09T21:06:11.915395] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T21:06:11.996682] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-09T21:06:12.705112] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T21:06:12.796700] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-09T21:06:13.596767] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-09T21:06:13.921855] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T21:06:14.365542] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T21:06:14.396675] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-09T21:06:14.563436] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T21:06:15.073383] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-09T21:06:15.196741] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-09T21:06:15.996777] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-09T21:06:16.796727] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-09T21:06:16.862244] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T21:06:16.899959] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T21:06:17.419520] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T21:06:17.596710] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-09T21:06:18.396732] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-09T21:06:19.196692] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-09T21:06:19.358834] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T21:06:19.914696] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T21:06:19.940065] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T21:06:19.996669] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-09T21:06:20.664911] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-09T21:06:20.796708] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-09T21:06:21.596720] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-09T21:06:21.704701] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T21:06:22.396731] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-09T21:06:22.709996] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-09T21:06:22.713524] [INFO ] [REMOTE ] PVH: Full fetch complete (70519 records). [2025-10-09T21:06:22.713673] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-09T21:06:22.714529] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:06:22.714635] [FATAL] [MAIN ] PVH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:06:22.714729] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:06:22.714805] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-09T21:06:22.714871] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-09T21:06:22.714908] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-09T21:06:22.714947] [DEBUG] [LOCAL ] PVH: No derivative data file found to delete. [2025-10-09T21:06:22.715040] [INFO ] [MAIN ] Update Progress: 1750/2373 symbols completed. PVH took 32.7s. Estimated remaining: 1h 27m 41s. Rate: 7.1 symbols/min [2025-10-09T21:06:22.887220] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:06:22.887436] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-09T21:06:22.887503] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-09T21:06:22.887791] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-09T21:06:22.887861] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-09T21:06:22.888000] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-09T21:06:22.888091] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-09T21:06:23.032938] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T21:06:23.202721] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-09T21:06:23.286240] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:06:23.934677] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T21:06:23.996710] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-09T21:06:24.557058] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T21:06:24.796740] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-09T21:06:25.160443] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T21:06:25.161553] [INFO ] [REMOTE ] PVL: Full fetch complete (7266 records). [2025-10-09T21:06:25.161630] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-09T21:06:25.162122] [FATAL] [VALIDATOR ] PVL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:06:25.162537] [FATAL] [MAIN ] PVL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:06:25.162830] [WARN ] [MAIN ] PVL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:06:25.162926] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-09T21:06:25.163011] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-09T21:06:25.163055] [INFO ] [LOCAL ] PVL: Starting deletion of derivative data. [2025-10-09T21:06:25.163099] [DEBUG] [LOCAL ] PVL: No derivative data file found to delete. [2025-10-09T21:06:25.163198] [INFO ] [MAIN ] Update Progress: 1751/2373 symbols completed. PVL took 20.7s. Estimated remaining: 1h 27m 31s. Rate: 7.1 symbols/min [2025-10-09T21:06:25.350030] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:06:25.350235] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-09T21:06:25.350273] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-09T21:06:25.350386] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-09T21:06:25.350428] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-09T21:06:25.350472] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-09T21:06:25.350504] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-09T21:06:25.601918] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-09T21:06:25.731072] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:06:26.304865] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T21:06:26.308842] [INFO ] [REMOTE ] PUMP: Full fetch complete (71287 records). [2025-10-09T21:06:26.308991] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-09T21:06:26.310389] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:06:26.310484] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:06:26.310527] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:06:26.310568] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-09T21:06:26.310625] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-09T21:06:26.310698] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-09T21:06:26.310759] [DEBUG] [LOCAL ] PUMP: No derivative data file found to delete. [2025-10-09T21:06:26.310833] [INFO ] [MAIN ] Update Progress: 1752/2373 symbols completed. PUMP took 37.1s. Estimated remaining: 1h 27m 20s. Rate: 7.1 symbols/min [2025-10-09T21:06:26.401910] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-09T21:06:26.485791] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:06:26.486081] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-09T21:06:26.486137] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-09T21:06:26.486248] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-09T21:06:26.486289] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-09T21:06:26.486329] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-09T21:06:26.486361] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-09T21:06:26.879166] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:06:27.196687] [INFO ] [REMOTE ] PXED: Fetching primary data for 2024-12. [2025-10-09T21:06:27.400203] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T21:06:27.499808] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:06:27.500134] [WARN ] [REMOTE ] PXED: No data returned for month 2024-12 [2025-10-09T21:06:27.500262] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:06:27.500325] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-09T21:06:27.500386] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:06:27.500459] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-09T21:06:27.500522] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-09T21:06:27.500557] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-09T21:06:27.500618] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-09T21:06:27.500708] [INFO ] [MAIN ] Update Progress: 1753/2373 symbols completed. PXED took 1.2s. Estimated remaining: 1h 27m 9s. Rate: 7.1 symbols/min [2025-10-09T21:06:27.672420] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:06:27.672618] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-09T21:06:27.672688] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-09T21:06:27.672812] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-09T21:06:27.672855] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-09T21:06:27.672895] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-09T21:06:27.672927] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-09T21:06:28.007111] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-09T21:06:28.037616] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:06:28.796763] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-09T21:06:29.566927] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T21:06:29.575044] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T21:06:29.589230] [INFO ] [REMOTE ] PUK: Full fetch complete (64824 records). [2025-10-09T21:06:29.589510] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-09T21:06:29.590600] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:06:29.590743] [FATAL] [MAIN ] PUK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:06:29.590792] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:06:29.590870] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-09T21:06:29.590952] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-09T21:06:29.590996] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-09T21:06:29.591043] [DEBUG] [LOCAL ] PUK: No derivative data file found to delete. [2025-10-09T21:06:29.591115] [INFO ] [MAIN ] Update Progress: 1754/2373 symbols completed. PUK took 44.9s. Estimated remaining: 1h 26m 58s. Rate: 7.1 symbols/min [2025-10-09T21:06:29.603736] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-09T21:06:29.784559] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:06:29.784766] [DEBUG] [LOCAL ] QD: No existing data file found in primary storage. [2025-10-09T21:06:29.784880] [WARN ] [MAIN ] QD: No existing data found, performing full refresh instead. [2025-10-09T21:06:29.785002] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-09T21:06:29.785044] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-09T21:06:29.785085] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-09T21:06:29.785117] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-09T21:06:30.139956] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:06:30.396776] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-09T21:06:31.178149] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T21:06:31.196704] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-09T21:06:31.996704] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-09T21:06:32.443765] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-09T21:06:32.805130] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-09T21:06:32.808233] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T21:06:33.596749] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-09T21:06:33.977525] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T21:06:34.396770] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-09T21:06:34.766579] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T21:06:34.871316] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-09T21:06:35.196694] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-09T21:06:35.561449] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T21:06:35.996733] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-09T21:06:36.796801] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-09T21:06:37.117001] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T21:06:37.596699] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-09T21:06:37.898790] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-09T21:06:38.396693] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-09T21:06:38.776183] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-09T21:06:38.953249] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T21:06:39.196735] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-09T21:06:39.996787] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-09T21:06:40.662854] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:06:40.796760] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-09T21:06:41.545032] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (3.15 seconds). [2025-10-09T21:06:41.596679] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-09T21:06:41.655978] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T21:06:42.396704] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-09T21:06:42.597713] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T21:06:43.196755] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-09T21:06:43.996695] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-09T21:06:44.124535] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-09T21:06:44.189143] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T21:06:44.738140] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T21:06:44.796689] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-09T21:06:44.819589] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T21:06:45.596719] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-09T21:06:46.396709] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-09T21:06:46.585948] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T21:06:47.196689] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-09T21:06:47.560238] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-09T21:06:47.996702] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-09T21:06:48.024984] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T21:06:48.796737] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-09T21:06:49.485318] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T21:06:49.487903] [INFO ] [REMOTE ] PX: Full fetch complete (50174 records). [2025-10-09T21:06:49.488049] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-09T21:06:49.488845] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:06:49.488963] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:06:49.489027] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:06:49.489098] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-09T21:06:49.489180] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-09T21:06:49.489239] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-09T21:06:49.489300] [DEBUG] [LOCAL ] PX: No derivative data file found to delete. [2025-10-09T21:06:49.489398] [INFO ] [MAIN ] Update Progress: 1755/2373 symbols completed. PX took 24.3s. Estimated remaining: 1h 26m 54s. Rate: 7.1 symbols/min [2025-10-09T21:06:49.600476] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-09T21:06:49.697198] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:06:49.697362] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-09T21:06:49.697401] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-09T21:06:49.697515] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-09T21:06:49.697558] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-09T21:06:49.697602] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-09T21:06:49.697636] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-09T21:06:50.095201] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:06:50.110210] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-09T21:06:50.153696] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (3.76 seconds). [2025-10-09T21:06:50.396735] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-09T21:06:51.089468] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T21:06:51.196746] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-09T21:06:51.996751] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-09T21:06:52.145184] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T21:06:52.796741] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-09T21:06:53.133271] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T21:06:53.596732] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-09T21:06:54.237563] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T21:06:54.396731] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-09T21:06:54.432493] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-09T21:06:55.196701] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-09T21:06:55.391407] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T21:06:55.623256] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T21:06:55.996732] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-09T21:06:56.796813] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-09T21:06:57.500907] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T21:06:57.596691] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-09T21:06:57.877093] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-09T21:06:58.396781] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-09T21:06:58.505958] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T21:06:59.196697] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-09T21:06:59.457775] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T21:06:59.996710] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-09T21:07:00.521366] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T21:07:00.796706] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-09T21:07:01.076674] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-09T21:07:01.117428] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T21:07:01.596721] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-09T21:07:01.907859] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T21:07:02.377938] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T21:07:02.381545] [INFO ] [REMOTE ] PWR: Full fetch complete (68488 records). [2025-10-09T21:07:02.381740] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-09T21:07:02.382553] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:07:02.382673] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:07:02.382734] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:07:02.382778] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-09T21:07:02.382837] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-09T21:07:02.382874] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-09T21:07:02.382913] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-09T21:07:02.382984] [INFO ] [MAIN ] Update Progress: 1756/2373 symbols completed. PWR took 39.7s. Estimated remaining: 1h 26m 47s. Rate: 7.1 symbols/min [2025-10-09T21:07:02.404192] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-09T21:07:02.560697] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:07:02.560927] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-09T21:07:02.560986] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-09T21:07:02.561145] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-09T21:07:02.561189] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-09T21:07:02.561232] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-09T21:07:02.561265] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-09T21:07:02.925080] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:07:03.196716] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-09T21:07:03.272506] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T21:07:03.996788] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-09T21:07:04.796739] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-09T21:07:05.596791] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-09T21:07:06.086330] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-09T21:07:06.299177] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T21:07:06.300761] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-09T21:07:06.315112] [INFO ] [REMOTE ] QD: Full fetch complete (39898 records). [2025-10-09T21:07:06.315232] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-09T21:07:06.316012] [FATAL] [VALIDATOR ] QD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:07:06.316099] [FATAL] [MAIN ] QD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:07:06.316143] [WARN ] [MAIN ] QD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:07:06.316212] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-09T21:07:06.316288] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-09T21:07:06.316384] [INFO ] [LOCAL ] QD: Starting deletion of derivative data. [2025-10-09T21:07:06.316444] [DEBUG] [LOCAL ] QD: No derivative data file found to delete. [2025-10-09T21:07:06.316520] [INFO ] [MAIN ] Update Progress: 1757/2373 symbols completed. QD took 36.7s. Estimated remaining: 1h 26m 37s. Rate: 7.1 symbols/min [2025-10-09T21:07:06.396669] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-09T21:07:07.196685] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-09T21:07:07.824842] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-10-09T21:07:07.996675] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-09T21:07:08.761556] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-09T21:07:08.796687] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-09T21:07:09.510743] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-09T21:07:09.596783] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-09T21:07:09.906304] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T21:07:10.329059] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T21:07:10.333217] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-09T21:07:10.333317] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-09T21:07:10.335063] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:07:10.335164] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:07:10.335208] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:07:10.335299] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-09T21:07:10.335378] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-09T21:07:10.335413] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-09T21:07:10.335452] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-09T21:07:10.335511] [INFO ] [MAIN ] Update Progress: 1758/2373 symbols completed. QBTS took 42.8s. Estimated remaining: 1h 26m 27s. Rate: 7.1 symbols/min [2025-10-09T21:07:10.396739] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-09T21:07:10.736882] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-09T21:07:11.196731] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-09T21:07:12.224378] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T21:07:12.235549] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-09T21:07:13.621513] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-09T21:07:13.634550] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-09T21:07:15.210604] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-10-09T21:07:15.220851] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-09T21:07:15.846499] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-09T21:07:15.859431] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-09T21:07:16.871585] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T21:07:16.882909] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-09T21:07:17.940083] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-09T21:07:17.952017] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-09T21:07:18.671339] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T21:07:18.683961] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-09T21:07:19.263188] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T21:07:19.273460] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-09T21:07:19.856315] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T21:07:19.867897] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-09T21:07:20.204831] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T21:07:20.208628] [INFO ] [REMOTE ] QGEN: Full fetch complete (69843 records). [2025-10-09T21:07:20.208772] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-09T21:07:20.211738] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:07:20.211827] [FATAL] [MAIN ] QGEN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:07:20.211873] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:07:20.211911] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-09T21:07:20.211985] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-09T21:07:20.212040] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-09T21:07:20.212084] [DEBUG] [LOCAL ] QGEN: No derivative data file found to delete. [2025-10-09T21:07:20.212143] [INFO ] [MAIN ] Update Progress: 1759/2373 symbols completed. QGEN took 30.7s. Estimated remaining: 1h 26m 19s. Rate: 7.1 symbols/min [2025-10-09T21:07:24.721889] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (4.85 seconds). [2025-10-09T21:07:24.735441] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-09T21:07:27.195989] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-09T21:07:27.207676] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-09T21:07:28.269968] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T21:07:28.281572] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-09T21:07:28.539892] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-09T21:07:28.543921] [INFO ] [REMOTE ] QS: Full fetch complete (77496 records). [2025-10-09T21:07:28.544039] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-09T21:07:28.544746] [FATAL] [VALIDATOR ] QS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:07:28.544856] [FATAL] [MAIN ] QS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:07:28.544921] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:07:28.544995] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-09T21:07:28.545060] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-09T21:07:28.545096] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-09T21:07:28.545137] [DEBUG] [LOCAL ] QS: No derivative data file found to delete. [2025-10-09T21:07:28.545193] [INFO ] [MAIN ] Update Progress: 1760/2373 symbols completed. QS took 26.2s. Estimated remaining: 1h 26m 10s. Rate: 7.1 symbols/min [2025-10-09T21:07:29.209638] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:07:29.232692] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-09T21:07:29.232847] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-09T21:07:29.262710] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-09T21:07:29.238312] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:07:29.262618] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:07:29.278959] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-09T21:07:29.279145] [DEBUG] [LOCAL ] QUAD: No existing data file found in primary storage. [2025-10-09T21:07:29.279248] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-09T21:07:29.282884] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-09T21:07:29.282800] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-09T21:07:29.284123] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:07:29.284808] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-09T21:07:29.284899] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-09T21:07:29.285280] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-09T21:07:29.284382] [WARN ] [MAIN ] QUAD: No existing data found, performing full refresh instead. [2025-10-09T21:07:29.285193] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-09T21:07:29.285515] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-09T21:07:29.285591] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-09T21:07:29.320438] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-09T21:07:29.331239] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-09T21:07:29.348230] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-09T21:07:29.325841] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-09T21:07:29.358853] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-09T21:07:29.353619] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-09T21:07:29.389250] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-09T21:07:29.389415] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-09T21:07:29.413693] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-09T21:07:30.850081] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:07:30.843977] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:07:30.880114] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-09T21:07:30.880405] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-09T21:07:30.883473] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:07:30.907536] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-09T21:07:30.913538] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:07:30.914549] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-09T21:07:31.928973] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T21:07:31.931598] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-09T21:07:32.303514] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T21:07:32.309918] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-09T21:07:32.467889] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T21:07:32.476428] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-09T21:07:32.540971] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T21:07:32.543109] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-09T21:07:32.787450] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T21:07:32.798309] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-09T21:07:33.041268] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T21:07:33.043067] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-09T21:07:33.110922] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T21:07:33.116095] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-09T21:07:33.810012] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T21:07:33.818487] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-09T21:07:34.006376] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T21:07:34.010798] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-09T21:07:34.319715] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T21:07:34.325972] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-09T21:07:35.009439] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T21:07:35.014448] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-09T21:07:35.014117] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T21:07:35.024940] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-09T21:07:35.556147] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T21:07:35.562313] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-09T21:07:35.718757] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T21:07:35.721665] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-09T21:07:36.042872] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (3.24 seconds). [2025-10-09T21:07:36.053631] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-09T21:07:36.662551] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T21:07:36.796717] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-09T21:07:36.936533] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T21:07:37.516260] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T21:07:37.598218] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-09T21:07:37.599160] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T21:07:37.701912] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-09T21:07:38.396742] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-09T21:07:39.196688] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-09T21:07:39.525195] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T21:07:39.770452] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T21:07:39.996729] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-09T21:07:40.537607] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T21:07:40.796788] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-09T21:07:41.224391] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T21:07:41.596721] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-09T21:07:42.396716] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-09T21:07:42.572403] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T21:07:43.196750] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-09T21:07:43.672570] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-09T21:07:43.996739] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-09T21:07:44.113630] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T21:07:44.238752] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T21:07:44.796737] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-09T21:07:45.156858] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T21:07:45.594271] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T21:07:45.596846] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-09T21:07:46.236050] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T21:07:46.237421] [INFO ] [REMOTE ] QVCC: Full fetch complete (12048 records). [2025-10-09T21:07:46.237490] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-09T21:07:46.238117] [FATAL] [VALIDATOR ] QVCC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:07:46.238202] [FATAL] [MAIN ] QVCC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:07:46.238244] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:07:46.238316] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-09T21:07:46.238398] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-09T21:07:46.238435] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-09T21:07:46.238510] [DEBUG] [LOCAL ] QVCC: No derivative data file found to delete. [2025-10-09T21:07:46.238587] [INFO ] [MAIN ] Update Progress: 1761/2373 symbols completed. QVCC took 17.7s. Estimated remaining: 1h 26m 5s. Rate: 7.1 symbols/min [2025-10-09T21:07:46.411854] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:07:46.408551] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-09T21:07:46.412773] [DEBUG] [LOCAL ] QVCD: No existing data file found in primary storage. [2025-10-09T21:07:46.412829] [WARN ] [MAIN ] QVCD: No existing data found, performing full refresh instead. [2025-10-09T21:07:46.412939] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-09T21:07:46.412979] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-09T21:07:46.413019] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-09T21:07:46.413054] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-09T21:07:46.764163] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:07:47.196787] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-09T21:07:47.525325] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T21:07:47.996763] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-09T21:07:48.677623] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T21:07:48.796676] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-09T21:07:49.197727] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T21:07:49.550730] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T21:07:49.596815] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-09T21:07:50.396842] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-09T21:07:51.081448] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T21:07:51.196737] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-09T21:07:51.412162] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T21:07:51.996699] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-09T21:07:52.727590] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T21:07:52.796707] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-09T21:07:53.596751] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-09T21:07:54.152977] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T21:07:54.154993] [INFO ] [REMOTE ] QUAD: Full fetch complete (34172 records). [2025-10-09T21:07:54.155066] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-09T21:07:54.155529] [FATAL] [VALIDATOR ] QUAD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:07:54.155740] [FATAL] [MAIN ] QUAD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:07:54.155831] [WARN ] [MAIN ] QUAD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:07:54.155927] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-09T21:07:54.156022] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-09T21:07:54.156079] [INFO ] [LOCAL ] QUAD: Starting deletion of derivative data. [2025-10-09T21:07:54.156124] [DEBUG] [LOCAL ] QUAD: No derivative data file found to delete. [2025-10-09T21:07:54.156179] [INFO ] [MAIN ] Update Progress: 1762/2373 symbols completed. QUAD took 25.6s. Estimated remaining: 1h 25m 57s. Rate: 7.1 symbols/min [2025-10-09T21:07:54.328768] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:07:54.329161] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-09T21:07:54.329311] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-09T21:07:54.329519] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-09T21:07:54.329677] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-09T21:07:54.329760] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-09T21:07:54.329796] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-09T21:07:54.401590] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-09T21:07:54.769247] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:07:54.771581] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T21:07:55.093442] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T21:07:55.196691] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-09T21:07:55.996728] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-09T21:07:56.067696] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T21:07:56.316672] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (4.32 seconds). [2025-10-09T21:07:56.796722] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-09T21:07:57.596744] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-09T21:07:57.661378] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T21:07:57.664886] [INFO ] [REMOTE ] QTWO: Full fetch complete (57343 records). [2025-10-09T21:07:57.664975] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-09T21:07:57.665597] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:07:57.665750] [FATAL] [MAIN ] QTWO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:07:57.665798] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:07:57.665839] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-09T21:07:57.665895] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-09T21:07:57.665981] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-09T21:07:57.666035] [DEBUG] [LOCAL ] QTWO: No derivative data file found to delete. [2025-10-09T21:07:57.666094] [INFO ] [MAIN ] Update Progress: 1763/2373 symbols completed. QTWO took 29.1s. Estimated remaining: 1h 25m 46s. Rate: 7.1 symbols/min [2025-10-09T21:07:57.848353] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:07:57.848599] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-09T21:07:57.848763] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-09T21:07:57.848957] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-09T21:07:57.849071] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-09T21:07:57.849235] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-09T21:07:57.849294] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-09T21:07:58.149730] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-09T21:07:58.264081] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:07:58.396734] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-09T21:07:59.196704] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-09T21:07:59.511923] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T21:07:59.780498] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T21:07:59.996693] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-09T21:08:00.102293] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T21:08:00.796721] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-09T21:08:01.524259] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T21:08:01.596701] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-09T21:08:01.768161] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T21:08:02.396773] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-09T21:08:03.080299] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T21:08:03.196670] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-09T21:08:03.996715] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-09T21:08:04.358314] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T21:08:04.378556] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T21:08:04.382375] [INFO ] [REMOTE ] QSR: Full fetch complete (75470 records). [2025-10-09T21:08:04.382471] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-09T21:08:04.383139] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:08:04.383223] [FATAL] [MAIN ] QSR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:08:04.383297] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:08:04.383369] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-09T21:08:04.383432] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-09T21:08:04.383467] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-09T21:08:04.383507] [DEBUG] [LOCAL ] QSR: No derivative data file found to delete. [2025-10-09T21:08:04.383564] [INFO ] [MAIN ] Update Progress: 1764/2373 symbols completed. QSR took 35.8s. Estimated remaining: 1h 25m 37s. Rate: 7.1 symbols/min [2025-10-09T21:08:04.549323] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:08:04.573042] [DEBUG] [LOCAL ] RA: Loaded 21855 existing records from primary storage. [2025-10-09T21:08:04.573281] [INFO ] [MAIN ] RA: Loaded 21855 existing records. [2025-10-09T21:08:04.747977] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:08:04.748175] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-09T21:08:04.748222] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-09T21:08:04.748599] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-09T21:08:04.748693] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-09T21:08:04.802314] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-09T21:08:05.103137] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:08:05.596712] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-09T21:08:06.127570] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-09T21:08:06.342492] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T21:08:06.396684] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-09T21:08:06.840899] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T21:08:07.196741] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-09T21:08:07.917100] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T21:08:07.996749] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-09T21:08:08.067117] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T21:08:08.796727] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-09T21:08:09.274815] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T21:08:09.596721] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-09T21:08:10.396741] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-09T21:08:10.603306] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T21:08:11.144966] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T21:08:11.196735] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-09T21:08:11.996701] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-09T21:08:12.071778] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-09T21:08:12.417496] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T21:08:12.651530] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T21:08:12.796756] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-09T21:08:13.596711] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-09T21:08:13.905968] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T21:08:14.396744] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-09T21:08:14.915121] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T21:08:15.196757] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-09T21:08:15.996816] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-09T21:08:16.475598] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-09T21:08:16.578284] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T21:08:16.579128] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T21:08:16.796776] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-09T21:08:17.596709] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-09T21:08:17.880874] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-09T21:08:17.986888] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T21:08:18.396772] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-09T21:08:19.196698] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-09T21:08:19.224357] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T21:08:19.996726] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-09T21:08:20.500483] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T21:08:20.502267] [INFO ] [REMOTE ] QVCD: Full fetch complete (6307 records). [2025-10-09T21:08:20.502377] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-09T21:08:20.503027] [FATAL] [VALIDATOR ] QVCD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:08:20.503139] [FATAL] [MAIN ] QVCD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:08:20.503219] [WARN ] [MAIN ] QVCD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:08:20.503374] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-09T21:08:20.503484] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-09T21:08:20.503565] [INFO ] [LOCAL ] QVCD: Starting deletion of derivative data. [2025-10-09T21:08:20.503688] [DEBUG] [LOCAL ] QVCD: No derivative data file found to delete. [2025-10-09T21:08:20.503795] [INFO ] [MAIN ] Update Progress: 1765/2373 symbols completed. QVCD took 34.3s. Estimated remaining: 1h 25m 32s. Rate: 7.1 symbols/min [2025-10-09T21:08:20.685175] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:08:20.685366] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-09T21:08:20.685426] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-09T21:08:20.685544] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-09T21:08:20.685586] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-09T21:08:20.685626] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-09T21:08:20.685694] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-09T21:08:20.801888] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-09T21:08:21.065941] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:08:21.167077] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T21:08:21.596789] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-09T21:08:22.077488] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T21:08:22.396743] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-09T21:08:23.196744] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-09T21:08:23.311197] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T21:08:23.334912] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T21:08:23.996716] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-09T21:08:24.796793] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-09T21:08:25.596754] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-09T21:08:25.619763] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T21:08:25.879595] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T21:08:25.903667] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-09T21:08:25.906594] [INFO ] [REMOTE ] R: Full fetch complete (42129 records). [2025-10-09T21:08:25.906736] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-09T21:08:25.907356] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:08:25.907449] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:08:25.907495] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:08:25.907539] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-09T21:08:25.907603] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-09T21:08:25.907662] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-09T21:08:25.907754] [DEBUG] [LOCAL ] R: No derivative data file found to delete. [2025-10-09T21:08:25.907840] [INFO ] [MAIN ] Update Progress: 1766/2373 symbols completed. R took 28.2s. Estimated remaining: 1h 25m 22s. Rate: 7.1 symbols/min [2025-10-09T21:08:26.102243] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:08:26.102544] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-09T21:08:26.102584] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-09T21:08:26.102739] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-09T21:08:26.102788] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-09T21:08:26.102830] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-09T21:08:26.102864] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-09T21:08:26.401823] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-09T21:08:26.523795] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:08:26.967693] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (3.77 seconds). [2025-10-09T21:08:27.196699] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-09T21:08:27.996707] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-09T21:08:28.027937] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T21:08:28.796704] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-09T21:08:29.104307] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T21:08:29.596748] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-09T21:08:29.648976] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T21:08:29.744057] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T21:08:30.396771] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-09T21:08:30.427434] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T21:08:31.196724] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-09T21:08:31.996704] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-09T21:08:32.796737] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-09T21:08:32.949977] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T21:08:32.979780] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-09T21:08:33.526774] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-09T21:08:33.596680] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-09T21:08:34.160542] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T21:08:34.396708] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-09T21:08:35.196799] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-09T21:08:35.475732] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T21:08:35.996753] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-09T21:08:36.195695] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T21:08:36.262081] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T21:08:36.796704] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-09T21:08:36.970382] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T21:08:37.488497] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T21:08:37.596690] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-09T21:08:38.396735] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-09T21:08:39.029154] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T21:08:39.035446] [INFO ] [REMOTE ] QXO: Full fetch complete (75435 records). [2025-10-09T21:08:39.035741] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-09T21:08:39.036807] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:08:39.036926] [FATAL] [MAIN ] QXO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:08:39.036996] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:08:39.037088] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-09T21:08:39.037166] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-09T21:08:39.037214] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-09T21:08:39.037266] [DEBUG] [LOCAL ] QXO: No derivative data file found to delete. [2025-10-09T21:08:39.037340] [INFO ] [MAIN ] Update Progress: 1767/2373 symbols completed. QXO took 44.9s. Estimated remaining: 1h 25m 15s. Rate: 7.1 symbols/min [2025-10-09T21:08:39.223091] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:08:39.204671] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-09T21:08:39.224137] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-09T21:08:39.224251] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-09T21:08:39.224429] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-09T21:08:39.224517] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-09T21:08:39.224591] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-09T21:08:39.224774] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-09T21:08:39.378273] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T21:08:39.614474] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:08:39.996754] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-09T21:08:40.703870] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T21:08:40.796697] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-09T21:08:41.596719] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-09T21:08:41.707823] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T21:08:42.171411] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:08:42.174666] [INFO ] [REMOTE ] RA: Full fetch complete (31698 records). [2025-10-09T21:08:42.174820] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-09T21:08:42.175523] [FATAL] [VALIDATOR ] RA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:08:42.175626] [FATAL] [MAIN ] RA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:08:42.175715] [WARN ] [MAIN ] RA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:08:42.175796] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-09T21:08:42.175872] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-09T21:08:42.175916] [INFO ] [LOCAL ] RA: Starting deletion of derivative data. [2025-10-09T21:08:42.176250] [DEBUG] [LOCAL ] RA: Deleted derivative data file. [2025-10-09T21:08:42.176360] [INFO ] [MAIN ] Update Progress: 1768/2373 symbols completed. RA took 37.8s. Estimated remaining: 1h 25m 5s. Rate: 7.1 symbols/min [2025-10-09T21:08:42.373774] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T21:08:42.397347] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-09T21:08:42.486042] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:08:42.486324] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-09T21:08:42.486394] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-09T21:08:42.486546] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-09T21:08:42.486611] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-09T21:08:42.486721] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-09T21:08:42.486785] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-09T21:08:42.950415] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:08:43.196734] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-09T21:08:43.621381] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T21:08:43.996734] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-09T21:08:44.114466] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T21:08:44.796745] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-09T21:08:45.596695] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-09T21:08:45.695896] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T21:08:46.177202] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T21:08:46.396746] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-09T21:08:47.196691] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-09T21:08:47.602718] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T21:08:47.996694] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-09T21:08:48.138107] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T21:08:48.796704] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-09T21:08:48.891031] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T21:08:48.940199] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T21:08:49.332566] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:08:49.596718] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-09T21:08:50.396781] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-09T21:08:50.524989] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T21:08:50.969576] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:08:50.972484] [INFO ] [REMOTE ] RACE: Full fetch complete (47500 records). [2025-10-09T21:08:50.972578] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-09T21:08:50.973220] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:08:50.973307] [FATAL] [MAIN ] RACE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:08:50.973351] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:08:50.973419] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-09T21:08:50.973483] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-09T21:08:50.973538] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-09T21:08:50.973608] [DEBUG] [LOCAL ] RACE: No derivative data file found to delete. [2025-10-09T21:08:50.973702] [INFO ] [MAIN ] Update Progress: 1769/2373 symbols completed. RACE took 30.5s. Estimated remaining: 1h 24m 57s. Rate: 7.1 symbols/min [2025-10-09T21:08:51.140955] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:08:51.141150] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-09T21:08:51.141204] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-09T21:08:51.141314] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-09T21:08:51.141355] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-09T21:08:51.141395] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-09T21:08:51.141427] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-09T21:08:51.201824] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-09T21:08:51.497224] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:08:51.996679] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-09T21:08:52.365126] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T21:08:52.796686] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-09T21:08:53.113168] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T21:08:53.596785] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-09T21:08:54.158022] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T21:08:54.164551] [INFO ] [REMOTE ] RAMP: Full fetch complete (53526 records). [2025-10-09T21:08:54.164728] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-09T21:08:54.165534] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:08:54.165665] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:08:54.165731] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:08:54.165776] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-09T21:08:54.165834] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-09T21:08:54.165870] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-09T21:08:54.165910] [DEBUG] [LOCAL ] RAMP: No derivative data file found to delete. [2025-10-09T21:08:54.165971] [INFO ] [MAIN ] Update Progress: 1770/2373 symbols completed. RAMP took 28.3s. Estimated remaining: 1h 24m 47s. Rate: 7.1 symbols/min [2025-10-09T21:08:54.346311] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:08:54.346615] [DEBUG] [LOCAL ] RBOT: No existing data file found in primary storage. [2025-10-09T21:08:54.346769] [WARN ] [MAIN ] RBOT: No existing data found, performing full refresh instead. [2025-10-09T21:08:54.346946] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-09T21:08:54.347020] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-09T21:08:54.347131] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-09T21:08:54.347199] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-09T21:08:54.412038] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-09T21:08:54.570488] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T21:08:54.750635] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:08:55.196729] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-09T21:08:55.996716] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-09T21:08:56.798516] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-09T21:08:56.796720] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-09T21:08:56.843137] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T21:08:56.847113] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T21:08:57.596838] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-09T21:08:57.997486] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T21:08:58.396781] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-09T21:08:59.196701] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-09T21:08:59.263853] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T21:08:59.406722] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T21:08:59.797718] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T21:08:59.996712] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-09T21:09:00.796706] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-09T21:09:00.874562] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T21:09:01.596727] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-09T21:09:02.396698] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-09T21:09:02.491175] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T21:09:03.159318] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T21:09:03.196666] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-09T21:09:03.914366] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T21:09:03.996919] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-09T21:09:04.000419] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-09T21:09:04.796739] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-09T21:09:05.596719] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-09T21:09:05.853916] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T21:09:06.396752] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-09T21:09:06.740017] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T21:09:06.844598] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-09T21:09:07.196732] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-09T21:09:07.678231] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-09T21:09:07.996708] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-09T21:09:08.166054] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T21:09:08.571725] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T21:09:08.796735] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-09T21:09:09.596735] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-09T21:09:10.396704] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-09T21:09:10.451263] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T21:09:10.520851] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T21:09:11.196723] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-09T21:09:11.980808] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T21:09:11.996671] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-09T21:09:12.216981] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T21:09:12.796728] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-09T21:09:13.596748] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-09T21:09:13.722203] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T21:09:14.324019] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T21:09:14.396687] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-09T21:09:14.799806] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T21:09:14.817414] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T21:09:15.196722] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-09T21:09:15.717604] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T21:09:15.720098] [INFO ] [REMOTE ] RBOT: Full fetch complete (8893 records). [2025-10-09T21:09:15.720227] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-09T21:09:15.720747] [FATAL] [VALIDATOR ] RBOT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:09:15.720833] [FATAL] [MAIN ] RBOT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:09:15.720877] [WARN ] [MAIN ] RBOT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:09:15.720917] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-09T21:09:15.720974] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-09T21:09:15.721010] [INFO ] [LOCAL ] RBOT: Starting deletion of derivative data. [2025-10-09T21:09:15.721048] [DEBUG] [LOCAL ] RBOT: No derivative data file found to delete. [2025-10-09T21:09:15.721105] [INFO ] [MAIN ] Update Progress: 1771/2373 symbols completed. RBOT took 21.6s. Estimated remaining: 1h 24m 43s. Rate: 7.1 symbols/min [2025-10-09T21:09:15.887185] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:09:15.887379] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-09T21:09:15.887416] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-09T21:09:15.887531] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-09T21:09:15.887572] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-09T21:09:15.887613] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-09T21:09:15.887669] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-09T21:09:16.001847] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-09T21:09:16.237346] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:09:16.796711] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-09T21:09:17.221398] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T21:09:17.596724] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-09T21:09:18.235031] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T21:09:18.396725] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-09T21:09:18.863448] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-09T21:09:19.196750] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-09T21:09:19.244245] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T21:09:19.248356] [INFO ] [REMOTE ] RBA: Full fetch complete (65521 records). [2025-10-09T21:09:19.248496] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-09T21:09:19.249320] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:09:19.249463] [FATAL] [MAIN ] RBA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:09:19.249540] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:09:19.249627] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-09T21:09:19.249731] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-09T21:09:19.249776] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-09T21:09:19.249818] [DEBUG] [LOCAL ] RBA: No derivative data file found to delete. [2025-10-09T21:09:19.249882] [INFO ] [MAIN ] Update Progress: 1772/2373 symbols completed. RBA took 40.2s. Estimated remaining: 1h 24m 32s. Rate: 7.1 symbols/min [2025-10-09T21:09:19.455991] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:09:19.456169] [DEBUG] [LOCAL ] RC: No existing data file found in primary storage. [2025-10-09T21:09:19.456222] [WARN ] [MAIN ] RC: No existing data found, performing full refresh instead. [2025-10-09T21:09:19.456365] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-09T21:09:19.456412] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-09T21:09:19.456455] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-09T21:09:19.456488] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-09T21:09:19.911732] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:09:19.996707] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-09T21:09:20.706303] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T21:09:20.796707] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-09T21:09:20.960689] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T21:09:21.254361] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T21:09:21.256104] [INFO ] [REMOTE ] RBC: Full fetch complete (21539 records). [2025-10-09T21:09:21.256175] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-09T21:09:21.256713] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:09:21.256909] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:09:21.257002] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:09:21.257074] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-09T21:09:21.257138] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-09T21:09:21.257175] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-09T21:09:21.257213] [DEBUG] [LOCAL ] RBC: No derivative data file found to delete. [2025-10-09T21:09:21.257307] [INFO ] [MAIN ] Update Progress: 1773/2373 symbols completed. RBC took 39.1s. Estimated remaining: 1h 24m 22s. Rate: 7.1 symbols/min [2025-10-09T21:09:21.423262] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:09:21.423462] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-09T21:09:21.423499] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-09T21:09:21.423611] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-09T21:09:21.423684] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-09T21:09:21.423746] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-09T21:09:21.423780] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-09T21:09:21.607017] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-09T21:09:21.821978] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:09:22.396764] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-09T21:09:22.910310] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T21:09:23.196772] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-09T21:09:23.996690] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-09T21:09:24.147708] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-09T21:09:24.179713] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T21:09:24.796817] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-09T21:09:25.596700] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-09T21:09:25.785428] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T21:09:26.146633] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T21:09:26.396779] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-09T21:09:27.196737] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-09T21:09:27.320894] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-09T21:09:27.996712] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-09T21:09:28.302849] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T21:09:28.796700] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-09T21:09:28.975486] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T21:09:29.315816] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T21:09:29.596797] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-09T21:09:30.139541] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-09T21:09:30.396747] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-09T21:09:31.131467] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T21:09:31.196708] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-09T21:09:31.822966] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T21:09:31.996693] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-09T21:09:32.796723] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-09T21:09:32.939554] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T21:09:33.290009] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T21:09:33.596778] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-09T21:09:33.996791] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T21:09:34.396742] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-09T21:09:34.519867] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T21:09:35.196732] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-09T21:09:35.996685] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-09T21:09:36.049388] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T21:09:36.796687] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-09T21:09:36.809058] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T21:09:36.813818] [INFO ] [REMOTE ] RBLX: Full fetch complete (77394 records). [2025-10-09T21:09:36.814072] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-09T21:09:36.815021] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:09:36.815124] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:09:36.815210] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:09:36.815300] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-09T21:09:36.815402] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-09T21:09:36.815461] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-09T21:09:36.815525] [DEBUG] [LOCAL ] RBLX: No derivative data file found to delete. [2025-10-09T21:09:36.815630] [INFO ] [MAIN ] Update Progress: 1774/2373 symbols completed. RBLX took 45.8s. Estimated remaining: 1h 24m 16s. Rate: 7.1 symbols/min [2025-10-09T21:09:37.029823] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:09:37.029991] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-09T21:09:37.030033] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-09T21:09:37.030144] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-09T21:09:37.030186] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-09T21:09:37.030236] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-09T21:09:37.030290] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-09T21:09:37.419079] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:09:37.460612] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-09T21:09:37.477333] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T21:09:37.596700] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-09T21:09:38.174260] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T21:09:38.396737] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-09T21:09:38.874053] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T21:09:39.196724] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-09T21:09:39.996765] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-09T21:09:40.469289] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-09T21:09:40.796711] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-09T21:09:41.136697] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T21:09:41.596698] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-09T21:09:41.671761] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T21:09:41.901815] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T21:09:42.396765] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-09T21:09:43.196774] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-09T21:09:43.996714] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-09T21:09:44.323558] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-09T21:09:44.324337] [INFO ] [REMOTE ] RCB: Full fetch complete (3735 records). [2025-10-09T21:09:44.324405] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-09T21:09:44.324791] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:09:44.324940] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:09:44.325005] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:09:44.325077] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-09T21:09:44.325153] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-09T21:09:44.325208] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-09T21:09:44.325264] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-09T21:09:44.325355] [INFO ] [MAIN ] Update Progress: 1775/2373 symbols completed. RCB took 23.1s. Estimated remaining: 1h 24m 7s. Rate: 7.1 symbols/min [2025-10-09T21:09:44.511757] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:09:44.511996] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-09T21:09:44.512113] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-09T21:09:44.512410] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-09T21:09:44.512475] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-09T21:09:44.512611] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-09T21:09:44.512759] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-09T21:09:44.798825] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-09T21:09:44.842857] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-09T21:09:44.958114] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:09:44.987770] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T21:09:45.596795] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-09T21:09:45.707483] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T21:09:46.396767] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-09T21:09:47.196721] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-09T21:09:47.835336] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-09T21:09:47.996737] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-09T21:09:48.200067] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T21:09:48.640230] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T21:09:48.796723] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-09T21:09:49.596792] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-09T21:09:49.986997] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-09T21:09:50.060131] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T21:09:50.180071] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T21:09:50.396719] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-09T21:09:51.196779] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-09T21:09:51.996699] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-09T21:09:52.192824] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T21:09:52.244832] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T21:09:52.609441] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T21:09:52.796730] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-09T21:09:53.597133] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-09T21:09:54.297878] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T21:09:54.317087] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T21:09:54.396722] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-09T21:09:54.886183] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T21:09:55.196725] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-09T21:09:55.862882] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T21:09:55.996716] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-09T21:09:56.606283] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T21:09:56.610415] [INFO ] [REMOTE ] RBRK: Full fetch complete (76148 records). [2025-10-09T21:09:56.610543] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-09T21:09:56.612916] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:09:56.613010] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:09:56.613053] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:09:56.613118] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-09T21:09:56.613197] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-09T21:09:56.613252] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-09T21:09:56.613296] [DEBUG] [LOCAL ] RBRK: No derivative data file found to delete. [2025-10-09T21:09:56.613375] [INFO ] [MAIN ] Update Progress: 1776/2373 symbols completed. RBRK took 40.9s. Estimated remaining: 1h 23m 60s. Rate: 7.1 symbols/min [2025-10-09T21:09:56.779976] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:09:56.780186] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-09T21:09:56.780243] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-09T21:09:56.780353] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-09T21:09:56.780395] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-09T21:09:56.780436] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-09T21:09:56.780467] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-09T21:09:56.801894] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-09T21:09:57.139734] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:09:57.596741] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-09T21:09:58.396707] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-09T21:09:58.600062] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T21:09:59.041285] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-09T21:09:59.196728] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-09T21:09:59.314484] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T21:09:59.644334] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T21:09:59.996719] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-09T21:10:00.410500] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-09T21:10:00.796762] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-09T21:10:01.596725] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-09T21:10:01.966280] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:10:01.967268] [INFO ] [REMOTE ] RCD: Full fetch complete (6839 records). [2025-10-09T21:10:01.967337] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-09T21:10:01.967723] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:10:01.967838] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:10:01.967882] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:10:01.967947] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-09T21:10:01.968009] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-09T21:10:01.968047] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-09T21:10:01.968085] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-09T21:10:01.968137] [INFO ] [MAIN ] Update Progress: 1777/2373 symbols completed. RCD took 25.2s. Estimated remaining: 1h 23m 50s. Rate: 7.1 symbols/min [2025-10-09T21:10:02.133168] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:10:02.147047] [DEBUG] [LOCAL ] RCS: Loaded 12029 existing records from primary storage. [2025-10-09T21:10:02.147287] [INFO ] [MAIN ] RCS: Loaded 12029 existing records. [2025-10-09T21:10:02.320748] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:10:02.321000] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-09T21:10:02.321048] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-09T21:10:02.321318] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-09T21:10:02.321375] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-09T21:10:02.401854] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-09T21:10:02.690716] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:10:02.817252] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-09T21:10:03.196745] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-09T21:10:03.996739] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-09T21:10:04.462356] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T21:10:04.796754] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-09T21:10:05.019340] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T21:10:05.152228] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T21:10:05.596774] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-09T21:10:06.396743] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-09T21:10:06.474287] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T21:10:07.196695] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-09T21:10:07.260581] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T21:10:07.857796] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T21:10:07.996713] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-09T21:10:08.740693] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T21:10:08.744823] [INFO ] [REMOTE ] RC: Full fetch complete (70533 records). [2025-10-09T21:10:08.744954] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-09T21:10:08.745846] [FATAL] [VALIDATOR ] RC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:10:08.746014] [FATAL] [MAIN ] RC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:10:08.746099] [WARN ] [MAIN ] RC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:10:08.746190] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-09T21:10:08.746268] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-09T21:10:08.746308] [INFO ] [LOCAL ] RC: Starting deletion of derivative data. [2025-10-09T21:10:08.746354] [DEBUG] [LOCAL ] RC: No derivative data file found to delete. [2025-10-09T21:10:08.746430] [INFO ] [MAIN ] Update Progress: 1778/2373 symbols completed. RC took 49.5s. Estimated remaining: 1h 23m 41s. Rate: 7.1 symbols/min [2025-10-09T21:10:08.802689] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-09T21:10:08.921611] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:10:08.921878] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-09T21:10:08.922002] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-09T21:10:08.922258] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-09T21:10:08.922329] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-09T21:10:08.922477] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-09T21:10:08.922532] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-09T21:10:09.249342] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-09T21:10:09.337306] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:10:09.596745] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-09T21:10:09.980864] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T21:10:10.396720] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-09T21:10:11.196705] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-09T21:10:11.251454] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T21:10:11.741597] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T21:10:11.996732] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-09T21:10:12.740900] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T21:10:12.796782] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-09T21:10:13.098815] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T21:10:13.542740] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T21:10:13.596692] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-09T21:10:14.396725] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-09T21:10:14.671227] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T21:10:15.196726] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-09T21:10:15.860045] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T21:10:15.996692] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-09T21:10:16.796695] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-09T21:10:16.967443] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T21:10:17.596715] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-09T21:10:17.667017] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T21:10:17.923581] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T21:10:18.348984] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T21:10:18.396668] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-09T21:10:19.196753] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-09T21:10:19.264899] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T21:10:19.268596] [INFO ] [REMOTE ] RCI: Full fetch complete (70110 records). [2025-10-09T21:10:19.268740] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-09T21:10:19.269771] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:10:19.269860] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:10:19.269903] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:10:19.269973] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-09T21:10:19.270051] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-09T21:10:19.270107] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-09T21:10:19.270151] [DEBUG] [LOCAL ] RCI: No derivative data file found to delete. [2025-10-09T21:10:19.270223] [INFO ] [MAIN ] Update Progress: 1779/2373 symbols completed. RCI took 34.9s. Estimated remaining: 1h 23m 34s. Rate: 7.1 symbols/min [2025-10-09T21:10:19.437575] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:10:19.437802] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-09T21:10:19.437852] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-09T21:10:19.437960] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-09T21:10:19.437999] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-09T21:10:19.438039] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-09T21:10:19.438070] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-09T21:10:19.788856] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:10:19.996728] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-09T21:10:20.796677] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-09T21:10:21.343442] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-09T21:10:21.596760] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-09T21:10:21.816731] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T21:10:22.396703] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-09T21:10:22.650795] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-09T21:10:23.058424] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T21:10:23.196700] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-09T21:10:23.558435] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T21:10:23.996760] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-09T21:10:24.193749] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T21:10:24.796738] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-09T21:10:25.341708] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T21:10:25.596786] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-09T21:10:26.396732] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-09T21:10:26.442864] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T21:10:26.531748] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T21:10:27.196769] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-09T21:10:27.504434] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T21:10:27.996760] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-09T21:10:28.796742] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-09T21:10:29.371185] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-09T21:10:29.596707] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-09T21:10:30.200583] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T21:10:30.202497] [INFO ] [REMOTE ] RCS: Full fetch complete (19070 records). [2025-10-09T21:10:30.202566] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-09T21:10:30.202997] [FATAL] [VALIDATOR ] RCS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:10:30.203078] [FATAL] [MAIN ] RCS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:10:30.203123] [WARN ] [MAIN ] RCS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:10:30.203186] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-09T21:10:30.203273] [DEBUG] [LOCAL ] RCS: No primary data file found to delete. [2025-10-09T21:10:30.203328] [INFO ] [LOCAL ] RCS: Starting deletion of derivative data. [2025-10-09T21:10:30.203485] [DEBUG] [LOCAL ] RCS: Deleted derivative data file. [2025-10-09T21:10:30.203570] [INFO ] [MAIN ] Update Progress: 1780/2373 symbols completed. RCS took 28.2s. Estimated remaining: 1h 23m 26s. Rate: 7.1 symbols/min [2025-10-09T21:10:30.390239] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:10:30.390772] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-09T21:10:30.390956] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-09T21:10:30.391681] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-09T21:10:30.391798] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-09T21:10:30.391972] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-09T21:10:30.392096] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-09T21:10:30.397387] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-09T21:10:30.631170] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T21:10:30.812497] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.82 seconds). [2025-10-09T21:10:30.857980] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:10:31.196778] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-09T21:10:31.996781] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-09T21:10:32.219490] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T21:10:32.659673] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T21:10:32.796699] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-09T21:10:33.303975] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T21:10:33.596739] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-09T21:10:34.396722] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-09T21:10:34.852259] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T21:10:35.196704] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-09T21:10:35.588888] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-09T21:10:35.996695] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-09T21:10:36.022215] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T21:10:36.570045] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T21:10:36.796782] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-09T21:10:37.596729] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-09T21:10:38.197563] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T21:10:38.396712] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-09T21:10:38.473521] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-09T21:10:38.874840] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T21:10:39.196749] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-09T21:10:39.985897] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T21:10:39.996678] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-09T21:10:40.087028] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T21:10:40.796705] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-09T21:10:40.894571] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T21:10:41.596727] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-09T21:10:42.353714] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T21:10:42.396680] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-09T21:10:43.196754] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-09T21:10:43.720573] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T21:10:43.747710] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T21:10:43.751954] [INFO ] [REMOTE ] RCUS: Full fetch complete (59848 records). [2025-10-09T21:10:43.752094] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-09T21:10:43.755505] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:10:43.755623] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:10:43.755715] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:10:43.755814] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-09T21:10:43.755922] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-09T21:10:43.756002] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-09T21:10:43.756099] [DEBUG] [LOCAL ] RCUS: No derivative data file found to delete. [2025-10-09T21:10:43.756201] [INFO ] [MAIN ] Update Progress: 1781/2373 symbols completed. RCUS took 35.0s. Estimated remaining: 1h 23m 19s. Rate: 7.1 symbols/min [2025-10-09T21:10:43.958997] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:10:43.959448] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-09T21:10:43.959601] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-09T21:10:43.959851] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-09T21:10:43.960007] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-09T21:10:43.960310] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-09T21:10:43.960481] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-09T21:10:44.001896] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-09T21:10:44.381762] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:10:44.383878] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-09T21:10:44.796713] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-09T21:10:44.827212] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T21:10:44.831096] [INFO ] [REMOTE ] RCL: Full fetch complete (74994 records). [2025-10-09T21:10:44.831219] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-09T21:10:44.832088] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:10:44.832187] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:10:44.832240] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:10:44.832318] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-09T21:10:44.832381] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-09T21:10:44.832416] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-09T21:10:44.832455] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-09T21:10:44.832533] [INFO ] [MAIN ] Update Progress: 1782/2373 symbols completed. RCL took 48.2s. Estimated remaining: 1h 23m 8s. Rate: 7.1 symbols/min [2025-10-09T21:10:44.999681] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:10:44.999828] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-09T21:10:44.999865] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-09T21:10:44.999969] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-09T21:10:45.000010] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-09T21:10:45.000050] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-09T21:10:45.000082] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-09T21:10:45.348470] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:10:45.596741] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-09T21:10:46.396806] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-09T21:10:46.901088] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T21:10:47.196801] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-09T21:10:47.371756] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-09T21:10:47.996761] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-09T21:10:48.199248] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T21:10:48.796754] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-09T21:10:49.098229] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T21:10:49.596766] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-09T21:10:50.396690] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-09T21:10:50.549767] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T21:10:50.860190] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-09T21:10:51.196721] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-09T21:10:51.553970] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T21:10:51.766477] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T21:10:51.996770] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-09T21:10:52.796694] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-09T21:10:52.901853] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T21:10:53.000361] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T21:10:53.596762] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-09T21:10:54.396764] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-09T21:10:55.196708] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-09T21:10:55.438113] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-09T21:10:55.708314] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-09T21:10:55.737833] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T21:10:55.741842] [INFO ] [REMOTE ] RDN: Full fetch complete (65694 records). [2025-10-09T21:10:55.741968] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-09T21:10:55.742771] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:10:55.742867] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:10:55.742918] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:10:55.743000] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-09T21:10:55.743082] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-09T21:10:55.743150] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-09T21:10:55.743212] [DEBUG] [LOCAL ] RDN: No derivative data file found to delete. [2025-10-09T21:10:55.743305] [INFO ] [MAIN ] Update Progress: 1783/2373 symbols completed. RDN took 25.5s. Estimated remaining: 1h 23m 1s. Rate: 7.1 symbols/min [2025-10-09T21:10:55.923930] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:10:55.924193] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-09T21:10:55.924343] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-09T21:10:55.924582] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-09T21:10:55.924733] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-09T21:10:55.924831] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-09T21:10:55.925071] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-09T21:10:56.002290] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-09T21:10:56.071302] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T21:10:56.328260] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:10:56.796819] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-09T21:10:57.596710] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-09T21:10:57.776728] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T21:10:58.398004] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-09T21:10:58.401093] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-09T21:10:59.196705] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-09T21:10:59.432787] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T21:10:59.796329] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T21:10:59.953981] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T21:10:59.958051] [INFO ] [REMOTE ] RDDT: Full fetch complete (77498 records). [2025-10-09T21:10:59.958191] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-09T21:10:59.959034] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:10:59.959133] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:10:59.959175] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:10:59.959215] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-09T21:10:59.959270] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-09T21:10:59.959304] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-09T21:10:59.959342] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-09T21:10:59.959428] [INFO ] [MAIN ] Update Progress: 1784/2373 symbols completed. RDDT took 40.7s. Estimated remaining: 1h 22m 51s. Rate: 7.1 symbols/min [2025-10-09T21:11:00.001981] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-09T21:11:00.131401] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:11:00.131600] [DEBUG] [LOCAL ] RERE: No existing data file found in primary storage. [2025-10-09T21:11:00.131637] [WARN ] [MAIN ] RERE: No existing data found, performing full refresh instead. [2025-10-09T21:11:00.131787] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-09T21:11:00.131828] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-09T21:11:00.131867] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-09T21:11:00.131898] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-09T21:11:00.520308] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:11:00.796832] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-09T21:11:01.596767] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-09T21:11:01.826666] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T21:11:02.396723] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-09T21:11:02.607408] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T21:11:03.196724] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-09T21:11:03.634360] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-09T21:11:03.707989] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T21:11:03.996741] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-09T21:11:04.796703] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-09T21:11:04.883577] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T21:11:05.313298] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T21:11:05.596716] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-09T21:11:06.313091] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T21:11:06.396716] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-09T21:11:07.196728] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-09T21:11:07.474286] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T21:11:07.944853] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T21:11:07.996713] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-09T21:11:08.796718] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-09T21:11:09.009902] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T21:11:09.596715] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-09T21:11:10.203149] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-09T21:11:10.280005] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T21:11:10.396715] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-09T21:11:11.167440] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T21:11:11.196675] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-09T21:11:11.996713] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-09T21:11:12.099676] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T21:11:12.796754] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-09T21:11:12.956926] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T21:11:13.563002] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T21:11:13.596673] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-09T21:11:14.396759] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-09T21:11:14.428429] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T21:11:14.761196] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T21:11:15.196760] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-09T21:11:15.996751] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-09T21:11:16.561744] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T21:11:16.722337] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-09T21:11:16.796688] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-09T21:11:17.596696] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-09T21:11:17.912886] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T21:11:18.396838] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-09T21:11:19.035336] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-09T21:11:19.094579] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T21:11:19.197565] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-09T21:11:19.200542] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T21:11:19.996781] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-09T21:11:20.796762] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-09T21:11:21.138405] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T21:11:21.465154] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T21:11:21.596727] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-09T21:11:22.396740] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-09T21:11:22.510754] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T21:11:22.919138] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T21:11:22.922834] [INFO ] [REMOTE ] RDY: Full fetch complete (68466 records). [2025-10-09T21:11:22.922939] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-09T21:11:22.923759] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:11:22.923875] [FATAL] [MAIN ] RDY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:11:22.923919] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:11:22.923958] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-09T21:11:22.924013] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-09T21:11:22.924055] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-09T21:11:22.924094] [DEBUG] [LOCAL ] RDY: No derivative data file found to delete. [2025-10-09T21:11:22.924151] [INFO ] [MAIN ] Update Progress: 1785/2373 symbols completed. RDY took 38.1s. Estimated remaining: 1h 22m 47s. Rate: 7.1 symbols/min [2025-10-09T21:11:23.105800] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:11:23.106037] [DEBUG] [LOCAL ] RES: No existing data file found in primary storage. [2025-10-09T21:11:23.106208] [WARN ] [MAIN ] RES: No existing data found, performing full refresh instead. [2025-10-09T21:11:23.106351] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-09T21:11:23.106422] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-09T21:11:23.106546] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-09T21:11:23.106669] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-09T21:11:23.197032] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-09T21:11:23.428564] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-09T21:11:23.517503] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:11:23.996795] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-09T21:11:24.796699] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-09T21:11:25.114903] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T21:11:25.338410] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:11:25.596685] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-09T21:11:25.699253] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T21:11:26.235519] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T21:11:26.240198] [INFO ] [REMOTE ] RDW: Full fetch complete (74796 records). [2025-10-09T21:11:26.240318] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-09T21:11:26.241224] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:11:26.241327] [FATAL] [MAIN ] RDW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:11:26.241370] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:11:26.241410] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-09T21:11:26.241466] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-09T21:11:26.241501] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-09T21:11:26.241541] [DEBUG] [LOCAL ] RDW: No derivative data file found to delete. [2025-10-09T21:11:26.241607] [INFO ] [MAIN ] Update Progress: 1786/2373 symbols completed. RDW took 42.5s. Estimated remaining: 1h 22m 37s. Rate: 7.1 symbols/min [2025-10-09T21:11:26.409680] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-09T21:11:26.413291] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:11:26.414419] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-09T21:11:26.414548] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-09T21:11:26.414695] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-09T21:11:26.414749] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-09T21:11:26.414793] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-09T21:11:26.414826] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-09T21:11:26.773878] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:11:26.921611] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T21:11:26.925024] [INFO ] [REMOTE ] RERE: Full fetch complete (57078 records). [2025-10-09T21:11:26.925107] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-09T21:11:26.925690] [FATAL] [VALIDATOR ] RERE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:11:26.925776] [FATAL] [MAIN ] RERE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:11:26.925819] [WARN ] [MAIN ] RERE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:11:26.925857] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-09T21:11:26.925910] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-09T21:11:26.925944] [INFO ] [LOCAL ] RERE: Starting deletion of derivative data. [2025-10-09T21:11:26.925981] [DEBUG] [LOCAL ] RERE: No derivative data file found to delete. [2025-10-09T21:11:26.926032] [INFO ] [MAIN ] Update Progress: 1787/2373 symbols completed. RERE took 27.0s. Estimated remaining: 1h 22m 26s. Rate: 7.1 symbols/min [2025-10-09T21:11:27.142572] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:11:27.142801] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-09T21:11:27.142845] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-09T21:11:27.142959] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-09T21:11:27.143004] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-09T21:11:27.143047] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-09T21:11:27.143081] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-09T21:11:27.201859] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-09T21:11:27.509045] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:11:27.996775] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-09T21:11:28.796703] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-09T21:11:28.877785] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T21:11:28.904720] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T21:11:29.359398] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T21:11:29.596804] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-09T21:11:30.396747] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-09T21:11:30.419937] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T21:11:30.423830] [INFO ] [REMOTE ] RELX: Full fetch complete (67397 records). [2025-10-09T21:11:30.423929] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-09T21:11:30.424553] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:11:30.424684] [FATAL] [MAIN ] RELX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:11:30.424778] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:11:30.424873] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-09T21:11:30.424959] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-09T21:11:30.425011] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-09T21:11:30.425068] [DEBUG] [LOCAL ] RELX: No derivative data file found to delete. [2025-10-09T21:11:30.425149] [INFO ] [MAIN ] Update Progress: 1788/2373 symbols completed. RELX took 34.7s. Estimated remaining: 1h 22m 16s. Rate: 7.1 symbols/min [2025-10-09T21:11:30.596827] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:11:30.597001] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-09T21:11:30.597038] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-09T21:11:30.597151] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-09T21:11:30.597192] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-09T21:11:30.597234] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-09T21:11:30.597266] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-09T21:11:30.970984] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:11:31.196683] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-09T21:11:31.996702] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-09T21:11:32.034508] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T21:11:32.113597] [DEBUG] [REMOTE ] REVG: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-09T21:11:32.114020] [WARN ] [REMOTE ] REVG: No data returned for month 2025-01 [2025-10-09T21:11:32.114126] [FATAL] [REMOTE ] REVG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:11:32.114221] [FATAL] [MAIN ] REVG: Failed to fetch primary data. [2025-10-09T21:11:32.114296] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:11:32.114378] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-09T21:11:32.114453] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-09T21:11:32.114510] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-09T21:11:32.114587] [DEBUG] [LOCAL ] REVG: No derivative data file found to delete. [2025-10-09T21:11:32.114671] [INFO ] [MAIN ] Update Progress: 1789/2373 symbols completed. REVG took 5.9s. Estimated remaining: 1h 22m 6s. Rate: 7.1 symbols/min [2025-10-09T21:11:32.291604] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:11:32.291812] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-09T21:11:32.291862] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-09T21:11:32.291974] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-09T21:11:32.292016] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-09T21:11:32.292057] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-09T21:11:32.292088] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-09T21:11:32.647694] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:11:32.796692] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-09T21:11:32.833141] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T21:11:33.596691] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-09T21:11:33.930076] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T21:11:34.396749] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-09T21:11:35.201967] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-09T21:11:35.215724] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T21:11:35.996802] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-09T21:11:36.378483] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T21:11:36.736509] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T21:11:36.758286] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T21:11:36.796728] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-09T21:11:37.596737] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-09T21:11:38.396773] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-09T21:11:38.562879] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T21:11:38.668765] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T21:11:39.196767] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-09T21:11:39.967269] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T21:11:39.996703] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-09T21:11:40.036587] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T21:11:40.796723] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-09T21:11:41.589996] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T21:11:41.596659] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-09T21:11:41.699852] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T21:11:42.396777] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-09T21:11:42.574189] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T21:11:43.196719] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-09T21:11:43.897166] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T21:11:43.996761] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-09T21:11:44.796685] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-09T21:11:44.990319] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T21:11:45.406863] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T21:11:45.596750] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-09T21:11:45.758893] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T21:11:46.396719] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-09T21:11:47.061399] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-09T21:11:47.061037] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T21:11:47.196688] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-09T21:11:47.996733] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-09T21:11:48.110811] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T21:11:48.367175] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-09T21:11:48.796716] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-09T21:11:49.596727] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-09T21:11:50.396706] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-09T21:11:50.578345] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T21:11:51.196703] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-09T21:11:51.328258] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T21:11:51.620882] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T21:11:51.623123] [INFO ] [REMOTE ] REX: Full fetch complete (20908 records). [2025-10-09T21:11:51.623204] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-09T21:11:51.623629] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:11:51.623756] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:11:51.623811] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:11:51.623890] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-09T21:11:51.623996] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-09T21:11:51.624039] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-09T21:11:51.624080] [DEBUG] [LOCAL ] REX: No derivative data file found to delete. [2025-10-09T21:11:51.624134] [INFO ] [MAIN ] Update Progress: 1790/2373 symbols completed. REX took 24.7s. Estimated remaining: 1h 22m 1s. Rate: 7.1 symbols/min [2025-10-09T21:11:51.798108] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:11:51.798351] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-09T21:11:51.798405] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-09T21:11:51.798517] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-09T21:11:51.798564] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-09T21:11:51.798606] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-09T21:11:51.798640] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-09T21:11:52.001840] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-09T21:11:52.181626] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:11:52.208786] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T21:11:52.796774] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-09T21:11:53.596695] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-09T21:11:54.016598] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T21:11:54.117900] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T21:11:54.396740] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-09T21:11:55.196701] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-09T21:11:55.557431] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T21:11:55.923792] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T21:11:55.996693] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-09T21:11:56.597469] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T21:11:56.796688] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-09T21:11:57.006017] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T21:11:57.596736] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-09T21:11:58.396800] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-09T21:11:58.439573] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T21:11:58.698976] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T21:11:58.702315] [INFO ] [REMOTE ] RES: Full fetch complete (68334 records). [2025-10-09T21:11:58.702438] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-09T21:11:58.703462] [FATAL] [VALIDATOR ] RES: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:11:58.703551] [FATAL] [MAIN ] RES: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:11:58.703594] [WARN ] [MAIN ] RES: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:11:58.703633] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-09T21:11:58.703742] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-09T21:11:58.703784] [INFO ] [LOCAL ] RES: Starting deletion of derivative data. [2025-10-09T21:11:58.703824] [DEBUG] [LOCAL ] RES: No derivative data file found to delete. [2025-10-09T21:11:58.703882] [INFO ] [MAIN ] Update Progress: 1791/2373 symbols completed. RES took 35.8s. Estimated remaining: 1h 21m 52s. Rate: 7.1 symbols/min [2025-10-09T21:11:58.876837] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:11:58.891401] [DEBUG] [LOCAL ] RFI: Loaded 10472 existing records from primary storage. [2025-10-09T21:11:58.891674] [INFO ] [MAIN ] RFI: Loaded 10472 existing records. [2025-10-09T21:11:59.080868] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:11:59.081122] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-09T21:11:59.081176] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-09T21:11:59.081509] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-09T21:11:59.081567] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-09T21:11:59.201773] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-09T21:11:59.481308] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:11:59.539545] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T21:11:59.996780] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-09T21:12:00.796700] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-09T21:12:00.944707] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T21:12:00.964195] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T21:12:01.596757] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-09T21:12:02.396734] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-09T21:12:02.492918] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T21:12:02.638193] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T21:12:03.196721] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-09T21:12:03.922099] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T21:12:03.996680] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-09T21:12:04.116808] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T21:12:04.796701] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-09T21:12:04.951860] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T21:12:05.596713] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-09T21:12:06.396716] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-09T21:12:06.727689] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T21:12:07.196718] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-09T21:12:07.414946] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T21:12:07.996696] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-09T21:12:08.109579] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T21:12:08.368262] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T21:12:08.796714] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-09T21:12:09.596727] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-09T21:12:09.731889] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T21:12:09.871098] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T21:12:10.396766] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-09T21:12:11.196744] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-09T21:12:11.425223] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T21:12:11.701135] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-09T21:12:11.789239] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T21:12:11.996697] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-09T21:12:12.796742] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-09T21:12:12.933082] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T21:12:13.596740] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-09T21:12:14.344027] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T21:12:14.396668] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-09T21:12:14.662556] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T21:12:15.121075] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T21:12:15.124735] [INFO ] [REMOTE ] REZI: Full fetch complete (65661 records). [2025-10-09T21:12:15.124831] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-09T21:12:15.125442] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:12:15.125550] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:12:15.125621] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:12:15.125715] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-09T21:12:15.125778] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-09T21:12:15.125814] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-09T21:12:15.125853] [DEBUG] [LOCAL ] REZI: No derivative data file found to delete. [2025-10-09T21:12:15.125953] [INFO ] [MAIN ] Update Progress: 1792/2373 symbols completed. REZI took 43.0s. Estimated remaining: 1h 21m 46s. Rate: 7.1 symbols/min [2025-10-09T21:12:15.201859] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-09T21:12:15.306497] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:12:15.306684] [DEBUG] [LOCAL ] RFL: No existing data file found in primary storage. [2025-10-09T21:12:15.306739] [WARN ] [MAIN ] RFL: No existing data found, performing full refresh instead. [2025-10-09T21:12:15.306851] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-09T21:12:15.306921] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-09T21:12:15.306965] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-09T21:12:15.306998] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-09T21:12:15.676744] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:12:15.678025] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T21:12:15.682001] [INFO ] [REMOTE ] REXR: Full fetch complete (74780 records). [2025-10-09T21:12:15.682093] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-09T21:12:15.682904] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:12:15.682989] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:12:15.683032] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:12:15.683070] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-09T21:12:15.683128] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-09T21:12:15.683162] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-09T21:12:15.683201] [DEBUG] [LOCAL ] REXR: No derivative data file found to delete. [2025-10-09T21:12:15.683281] [INFO ] [MAIN ] Update Progress: 1793/2373 symbols completed. REXR took 45.3s. Estimated remaining: 1h 21m 35s. Rate: 7.1 symbols/min [2025-10-09T21:12:15.851717] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:12:15.851888] [DEBUG] [LOCAL ] RFM: No existing data file found in primary storage. [2025-10-09T21:12:15.851925] [WARN ] [MAIN ] RFM: No existing data found, performing full refresh instead. [2025-10-09T21:12:15.852031] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-09T21:12:15.852071] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-09T21:12:15.852112] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-09T21:12:15.852143] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-09T21:12:16.007296] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-09T21:12:16.209834] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:12:16.796696] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-09T21:12:17.094411] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T21:12:17.337106] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T21:12:17.596771] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-09T21:12:17.883516] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-09T21:12:18.396740] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-09T21:12:18.763471] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:12:18.765021] [INFO ] [REMOTE ] RFI: Full fetch complete (15488 records). [2025-10-09T21:12:18.765093] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-09T21:12:18.765519] [FATAL] [VALIDATOR ] RFI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:12:18.765603] [FATAL] [MAIN ] RFI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:12:18.765671] [WARN ] [MAIN ] RFI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:12:18.765733] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-09T21:12:18.765826] [DEBUG] [LOCAL ] RFI: No primary data file found to delete. [2025-10-09T21:12:18.765914] [INFO ] [LOCAL ] RFI: Starting deletion of derivative data. [2025-10-09T21:12:18.766127] [DEBUG] [LOCAL ] RFI: Deleted derivative data file. [2025-10-09T21:12:18.766226] [INFO ] [MAIN ] Update Progress: 1794/2373 symbols completed. RFI took 20.1s. Estimated remaining: 1h 21m 25s. Rate: 7.1 symbols/min [2025-10-09T21:12:18.931584] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:12:18.931771] [DEBUG] [LOCAL ] RFMZ: No existing data file found in primary storage. [2025-10-09T21:12:18.931814] [WARN ] [MAIN ] RFMZ: No existing data found, performing full refresh instead. [2025-10-09T21:12:18.931922] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-09T21:12:18.931963] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-09T21:12:18.932006] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-09T21:12:18.932037] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-09T21:12:19.205921] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-09T21:12:19.289121] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:12:19.996748] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-09T21:12:20.796706] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-09T21:12:20.971349] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T21:12:21.037007] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T21:12:21.520309] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T21:12:21.596752] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-09T21:12:22.152154] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T21:12:22.396735] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-09T21:12:22.946478] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T21:12:23.196712] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-09T21:12:23.986228] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T21:12:23.996675] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-09T21:12:24.726963] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T21:12:24.796696] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-09T21:12:25.443480] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T21:12:25.596741] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-09T21:12:26.396711] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-09T21:12:26.472221] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T21:12:26.878606] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T21:12:27.196714] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-09T21:12:27.864057] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T21:12:27.996718] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-09T21:12:28.613294] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T21:12:28.796985] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-09T21:12:29.596776] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-09T21:12:30.396713] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-09T21:12:30.414533] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T21:12:30.584838] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T21:12:30.903083] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T21:12:31.196789] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-09T21:12:31.846666] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T21:12:31.996759] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-09T21:12:32.796764] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-09T21:12:32.867518] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T21:12:33.596735] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-09T21:12:33.646707] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T21:12:34.396744] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-09T21:12:34.825974] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T21:12:34.984439] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T21:12:35.196771] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-09T21:12:35.996700] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-09T21:12:36.219532] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T21:12:36.796709] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-09T21:12:36.814776] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T21:12:37.596748] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-09T21:12:37.700551] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T21:12:38.216575] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T21:12:38.396757] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-09T21:12:39.196702] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-09T21:12:39.301673] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T21:12:39.996733] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-09T21:12:40.518448] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-09T21:12:40.796698] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-09T21:12:41.079847] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T21:12:41.315515] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T21:12:41.596747] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-09T21:12:42.074164] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T21:12:42.396710] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-09T21:12:43.014844] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T21:12:43.196777] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-09T21:12:43.648048] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T21:12:43.649306] [INFO ] [REMOTE ] RFL: Full fetch complete (13062 records). [2025-10-09T21:12:43.649379] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-09T21:12:43.649979] [FATAL] [VALIDATOR ] RFL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:12:43.650066] [FATAL] [MAIN ] RFL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:12:43.650110] [WARN ] [MAIN ] RFL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:12:43.650179] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-09T21:12:43.650297] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-09T21:12:43.650353] [INFO ] [LOCAL ] RFL: Starting deletion of derivative data. [2025-10-09T21:12:43.650397] [DEBUG] [LOCAL ] RFL: No derivative data file found to delete. [2025-10-09T21:12:43.650482] [INFO ] [MAIN ] Update Progress: 1795/2373 symbols completed. RFL took 28.5s. Estimated remaining: 1h 21m 22s. Rate: 7.1 symbols/min [2025-10-09T21:12:43.826024] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:12:43.826345] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-09T21:12:43.826400] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-09T21:12:43.826513] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-09T21:12:43.826554] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-09T21:12:43.826624] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-09T21:12:43.826701] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-09T21:12:44.002455] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-09T21:12:44.188758] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:12:44.796738] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-09T21:12:45.144584] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T21:12:45.596782] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-09T21:12:46.359616] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T21:12:46.361100] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T21:12:46.396673] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-09T21:12:46.818309] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T21:12:47.196723] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-09T21:12:47.996849] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-09T21:12:48.363103] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:12:48.370720] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12364 records). [2025-10-09T21:12:48.382355] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T21:12:48.381786] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-09T21:12:48.391340] [FATAL] [VALIDATOR ] RFMZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:12:48.391461] [FATAL] [MAIN ] RFMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:12:48.391546] [WARN ] [MAIN ] RFMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:12:48.391611] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-09T21:12:48.391734] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-09T21:12:48.391801] [INFO ] [LOCAL ] RFMZ: Starting deletion of derivative data. [2025-10-09T21:12:48.391891] [DEBUG] [LOCAL ] RFMZ: No derivative data file found to delete. [2025-10-09T21:12:48.391987] [INFO ] [MAIN ] Update Progress: 1796/2373 symbols completed. RFMZ took 29.6s. Estimated remaining: 1h 21m 12s. Rate: 7.1 symbols/min [2025-10-09T21:12:48.569283] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:12:48.569504] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-09T21:12:48.569547] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-09T21:12:48.569683] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-09T21:12:48.569784] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-09T21:12:48.569850] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-09T21:12:48.569885] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-09T21:12:48.807035] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-09T21:12:48.926983] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:12:49.239925] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T21:12:49.240867] [INFO ] [REMOTE ] RFM: Full fetch complete (5831 records). [2025-10-09T21:12:49.240944] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-09T21:12:49.241321] [FATAL] [VALIDATOR ] RFM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:12:49.241405] [FATAL] [MAIN ] RFM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:12:49.241451] [WARN ] [MAIN ] RFM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:12:49.241531] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-09T21:12:49.241609] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-09T21:12:49.241713] [INFO ] [LOCAL ] RFM: Starting deletion of derivative data. [2025-10-09T21:12:49.241795] [DEBUG] [LOCAL ] RFM: No derivative data file found to delete. [2025-10-09T21:12:49.241916] [INFO ] [MAIN ] Update Progress: 1797/2373 symbols completed. RFM took 33.6s. Estimated remaining: 1h 21m 1s. Rate: 7.1 symbols/min [2025-10-09T21:12:49.596716] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-09T21:12:50.396744] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-09T21:12:50.745072] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T21:12:50.921423] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T21:12:50.925389] [INFO ] [REMOTE ] RF: Full fetch complete (77237 records). [2025-10-09T21:12:50.925491] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-09T21:12:50.926249] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:12:50.926336] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:12:50.926379] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:12:50.926444] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-09T21:12:50.926507] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-09T21:12:50.926541] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-09T21:12:50.926579] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-09T21:12:50.926633] [INFO ] [MAIN ] Update Progress: 1798/2373 symbols completed. RF took 59.3s. Estimated remaining: 1h 20m 51s. Rate: 7.1 symbols/min [2025-10-09T21:12:51.196732] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-09T21:12:51.996725] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-09T21:12:52.897171] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T21:12:52.901203] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-09T21:12:52.979429] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T21:12:53.596715] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-09T21:12:54.069629] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T21:12:54.396770] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-09T21:12:55.226868] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T21:12:55.235878] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-09T21:12:55.249437] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T21:12:55.996731] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-09T21:12:56.778423] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T21:12:56.796665] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-09T21:12:57.176745] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T21:12:57.596716] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-09T21:12:58.082883] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T21:12:58.396773] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-09T21:12:58.499178] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T21:12:59.196693] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-09T21:12:59.602637] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T21:12:59.996685] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-09T21:13:00.064915] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T21:13:00.796785] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-09T21:13:01.269841] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T21:13:01.596777] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-09T21:13:02.052224] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T21:13:02.396778] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-09T21:13:02.805790] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T21:13:03.196774] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-09T21:13:03.715969] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T21:13:03.823915] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T21:13:03.996771] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-09T21:13:04.312333] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-09T21:13:04.314905] [INFO ] [REMOTE ] RGA: Full fetch complete (45142 records). [2025-10-09T21:13:04.314994] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-09T21:13:04.315718] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:13:04.315819] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:13:04.315893] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:13:04.315978] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-09T21:13:04.316078] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-09T21:13:04.316185] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-09T21:13:04.316279] [DEBUG] [LOCAL ] RGA: No derivative data file found to delete. [2025-10-09T21:13:04.316363] [INFO ] [MAIN ] Update Progress: 1799/2373 symbols completed. RGA took 20.7s. Estimated remaining: 1h 20m 44s. Rate: 7.1 symbols/min [2025-10-09T21:13:04.796718] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-09T21:13:05.619857] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T21:13:05.625436] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-09T21:13:06.116053] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T21:13:06.118095] [INFO ] [REMOTE ] RGR: Full fetch complete (28732 records). [2025-10-09T21:13:06.118170] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-09T21:13:06.118623] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:13:06.118730] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:13:06.118794] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:13:06.118878] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-09T21:13:06.118959] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-09T21:13:06.119028] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-09T21:13:06.119091] [DEBUG] [LOCAL ] RGR: No derivative data file found to delete. [2025-10-09T21:13:06.119163] [INFO ] [MAIN ] Update Progress: 1800/2373 symbols completed. RGR took 17.7s. Estimated remaining: 1h 20m 33s. Rate: 7.1 symbols/min [2025-10-09T21:13:06.659891] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:06.722926] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-09T21:13:06.792690] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-09T21:13:06.777617] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:06.815132] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:06.793003] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-09T21:13:06.815206] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-09T21:13:06.849389] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-09T21:13:06.849723] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-09T21:13:06.849822] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-09T21:13:06.848426] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-09T21:13:06.849959] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-09T21:13:06.850969] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-09T21:13:06.856335] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-09T21:13:06.849308] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:06.862173] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-09T21:13:06.885703] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-09T21:13:06.891114] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-09T21:13:06.935830] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-09T21:13:06.893439] [DEBUG] [LOCAL ] RGT: Loaded 2713 existing records from primary storage. [2025-10-09T21:13:06.984029] [INFO ] [MAIN ] RGT: Loaded 2713 existing records. [2025-10-09T21:13:06.978619] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-09T21:13:07.030759] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-09T21:13:07.136457] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-09T21:13:07.764905] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:13:07.867444] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-09T21:13:07.967045] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-09T21:13:08.154426] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-09T21:13:08.170920] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-09T21:13:08.165595] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:08.213677] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:08.250901] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-09T21:13:08.250558] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-09T21:13:08.451716] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:08.482234] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-09T21:13:08.640386] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:13:08.670221] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-09T21:13:08.694330] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:08.694387] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:13:08.694777] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-09T21:13:08.694843] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:13:08.694912] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-09T21:13:08.694976] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-09T21:13:08.695012] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-09T21:13:08.695049] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-09T21:13:08.695094] [INFO ] [MAIN ] Update Progress: 1801/2373 symbols completed. RHLD took 2.6s. Estimated remaining: 1h 20m 23s. Rate: 7.1 symbols/min [2025-10-09T21:13:08.801815] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-09T21:13:08.872172] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:08.872418] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-09T21:13:08.872474] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-09T21:13:08.872594] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-09T21:13:08.872639] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-09T21:13:08.872730] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-09T21:13:08.872768] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-09T21:13:09.223701] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:09.594446] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T21:13:09.596669] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-09T21:13:09.680887] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T21:13:10.062425] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T21:13:10.173700] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T21:13:10.396752] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-09T21:13:10.966296] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T21:13:11.196767] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-09T21:13:11.996786] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-09T21:13:12.796716] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-09T21:13:12.899698] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T21:13:13.450145] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T21:13:13.596704] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-09T21:13:13.728803] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T21:13:14.380864] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T21:13:14.396663] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-09T21:13:15.025613] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T21:13:15.196763] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-09T21:13:15.996772] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-09T21:13:16.653170] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T21:13:16.796744] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-09T21:13:17.596814] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-09T21:13:17.792717] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T21:13:18.160965] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T21:13:18.406463] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-09T21:13:18.411255] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T21:13:19.196780] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-09T21:13:19.996708] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-09T21:13:20.068804] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-09T21:13:20.100576] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T21:13:20.796779] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-09T21:13:21.309842] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T21:13:21.417681] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T21:13:21.596686] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-09T21:13:22.396703] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-09T21:13:23.094017] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T21:13:23.196691] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-09T21:13:23.842083] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T21:13:23.996772] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-09T21:13:24.431619] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T21:13:24.432402] [INFO ] [REMOTE ] RGT: Full fetch complete (4064 records). [2025-10-09T21:13:24.432493] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-09T21:13:24.432931] [FATAL] [VALIDATOR ] RGT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:13:24.433014] [FATAL] [MAIN ] RGT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:13:24.433057] [WARN ] [MAIN ] RGT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:13:24.433096] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-09T21:13:24.433151] [DEBUG] [LOCAL ] RGT: No primary data file found to delete. [2025-10-09T21:13:24.433185] [INFO ] [LOCAL ] RGT: Starting deletion of derivative data. [2025-10-09T21:13:24.433367] [DEBUG] [LOCAL ] RGT: Deleted derivative data file. [2025-10-09T21:13:24.433466] [INFO ] [MAIN ] Update Progress: 1802/2373 symbols completed. RGT took 18.3s. Estimated remaining: 1h 20m 17s. Rate: 7.1 symbols/min [2025-10-09T21:13:24.606423] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:24.606567] [DEBUG] [LOCAL ] RIG: No existing data file found in primary storage. [2025-10-09T21:13:24.606624] [WARN ] [MAIN ] RIG: No existing data found, performing full refresh instead. [2025-10-09T21:13:24.606768] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-09T21:13:24.606824] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-09T21:13:24.606867] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-09T21:13:24.606899] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-09T21:13:24.802412] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-09T21:13:25.003083] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T21:13:25.006799] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:25.596777] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-09T21:13:26.328518] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T21:13:26.396667] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-09T21:13:27.196717] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-09T21:13:27.449820] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T21:13:27.996687] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-09T21:13:28.089879] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T21:13:28.796739] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-09T21:13:28.887488] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T21:13:29.428693] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T21:13:29.596694] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-09T21:13:30.396731] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-09T21:13:30.674528] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T21:13:31.089750] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T21:13:31.196725] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-09T21:13:31.996742] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-09T21:13:32.226398] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T21:13:32.631555] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T21:13:32.796728] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-09T21:13:33.596717] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-09T21:13:34.103956] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T21:13:34.292490] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-09T21:13:34.396679] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-09T21:13:35.196753] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-09T21:13:35.363360] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T21:13:35.996768] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-09T21:13:36.202388] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T21:13:36.616330] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T21:13:36.796729] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-09T21:13:36.898845] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T21:13:37.596779] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-09T21:13:38.350020] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T21:13:38.353960] [INFO ] [REMOTE ] RHI: Full fetch complete (69758 records). [2025-10-09T21:13:38.354106] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-09T21:13:38.357559] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:13:38.357689] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:13:38.357786] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:13:38.357883] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-09T21:13:38.357964] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-09T21:13:38.358003] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-09T21:13:38.358060] [DEBUG] [LOCAL ] RHI: No derivative data file found to delete. [2025-10-09T21:13:38.358142] [INFO ] [MAIN ] Update Progress: 1803/2373 symbols completed. RHI took 32.2s. Estimated remaining: 1h 20m 10s. Rate: 7.1 symbols/min [2025-10-09T21:13:38.405685] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-09T21:13:38.541912] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:38.542088] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-09T21:13:38.542144] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-09T21:13:38.542257] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-09T21:13:38.542325] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-09T21:13:38.542388] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-09T21:13:38.542433] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-09T21:13:38.904626] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:38.930442] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-09T21:13:39.196722] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-09T21:13:39.996755] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-09T21:13:40.490903] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-09T21:13:40.796749] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-09T21:13:41.100706] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T21:13:41.596775] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-09T21:13:41.987535] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T21:13:42.396730] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-09T21:13:42.448900] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T21:13:42.508848] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T21:13:43.196751] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-09T21:13:43.630965] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T21:13:43.634206] [INFO ] [REMOTE ] RHP: Full fetch complete (57693 records). [2025-10-09T21:13:43.634299] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-09T21:13:43.634980] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:13:43.635144] [FATAL] [MAIN ] RHP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:13:43.635199] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:13:43.635239] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-09T21:13:43.635293] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-09T21:13:43.635329] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-09T21:13:43.635375] [DEBUG] [LOCAL ] RHP: No derivative data file found to delete. [2025-10-09T21:13:43.635429] [INFO ] [MAIN ] Update Progress: 1804/2373 symbols completed. RHP took 34.9s. Estimated remaining: 1h 20m 1s. Rate: 7.1 symbols/min [2025-10-09T21:13:43.805431] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:43.805607] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-09T21:13:43.805672] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-09T21:13:43.805790] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-09T21:13:43.805834] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-09T21:13:43.805877] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-09T21:13:43.805915] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-09T21:13:44.005477] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-09T21:13:44.173346] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:44.214834] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T21:13:44.796800] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-09T21:13:45.596691] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-09T21:13:45.936229] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-09T21:13:46.396753] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-09T21:13:46.870226] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-09T21:13:47.196693] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-09T21:13:47.556534] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-09T21:13:47.996744] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-09T21:13:48.473117] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T21:13:48.796722] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-09T21:13:49.328395] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T21:13:49.596792] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-09T21:13:50.088985] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-09T21:13:50.396732] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-09T21:13:50.432184] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T21:13:50.519027] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T21:13:51.196725] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-09T21:13:51.996739] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-09T21:13:52.624811] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T21:13:52.628520] [INFO ] [REMOTE ] RH: Full fetch complete (65231 records). [2025-10-09T21:13:52.628725] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-09T21:13:52.629577] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:13:52.629824] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:13:52.629989] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:13:52.630096] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-09T21:13:52.630244] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-09T21:13:52.630304] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-09T21:13:52.630371] [DEBUG] [LOCAL ] RH: No derivative data file found to delete. [2025-10-09T21:13:52.630478] [INFO ] [MAIN ] Update Progress: 1805/2373 symbols completed. RH took 46.5s. Estimated remaining: 1h 19m 52s. Rate: 7.1 symbols/min [2025-10-09T21:13:52.804739] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-09T21:13:52.839227] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-09T21:13:52.856024] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:13:52.873283] [DEBUG] [LOCAL ] RIV: Loaded 12476 existing records from primary storage. [2025-10-09T21:13:52.873514] [INFO ] [MAIN ] RIV: Loaded 12476 existing records. [2025-10-09T21:13:53.092680] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T21:13:53.089633] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:13:53.107855] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-09T21:13:53.108733] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-09T21:13:53.110306] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-09T21:13:53.110369] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-09T21:13:53.469149] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:13:53.596710] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-09T21:13:54.396729] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-09T21:13:54.695382] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-09T21:13:55.196774] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-09T21:13:55.579437] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T21:13:55.996687] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-09T21:13:56.091785] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T21:13:56.298446] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T21:13:56.796751] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-09T21:13:57.596732] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-09T21:13:57.692765] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T21:13:57.902240] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T21:13:58.396719] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-09T21:13:59.028100] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T21:13:59.196769] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-09T21:13:59.817974] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-09T21:13:59.996713] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-09T21:14:00.796736] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-09T21:14:01.127153] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T21:14:01.443321] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T21:14:01.596758] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-09T21:14:02.356376] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-09T21:14:02.396705] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-09T21:14:03.196729] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-09T21:14:03.690528] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T21:14:03.996700] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-09T21:14:04.250634] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T21:14:04.796685] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-09T21:14:05.223454] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-09T21:14:05.596691] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-09T21:14:05.723461] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T21:14:05.735911] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T21:14:06.141080] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:14:06.396727] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-09T21:14:07.196703] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-09T21:14:07.392609] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T21:14:07.996712] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-09T21:14:08.796698] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-09T21:14:08.892627] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T21:14:08.896970] [INFO ] [REMOTE ] RIG: Full fetch complete (77316 records). [2025-10-09T21:14:08.897087] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-09T21:14:08.897941] [FATAL] [VALIDATOR ] RIG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:14:08.898031] [FATAL] [MAIN ] RIG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:14:08.898074] [WARN ] [MAIN ] RIG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:14:08.898141] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-09T21:14:08.898206] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-09T21:14:08.898241] [INFO ] [LOCAL ] RIG: Starting deletion of derivative data. [2025-10-09T21:14:08.898280] [DEBUG] [LOCAL ] RIG: No derivative data file found to delete. [2025-10-09T21:14:08.898341] [INFO ] [MAIN ] Update Progress: 1806/2373 symbols completed. RIG took 44.5s. Estimated remaining: 1h 19m 46s. Rate: 7.1 symbols/min [2025-10-09T21:14:09.068614] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:14:09.068919] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-09T21:14:09.068987] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-09T21:14:09.069242] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-09T21:14:09.069339] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-09T21:14:09.069518] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-09T21:14:09.069573] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-09T21:14:09.201737] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-09T21:14:09.462581] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:14:09.596684] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-09T21:14:09.642096] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T21:14:10.396791] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-09T21:14:11.080205] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T21:14:11.084232] [INFO ] [REMOTE ] RIO: Full fetch complete (76971 records). [2025-10-09T21:14:11.084342] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-09T21:14:11.085279] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:14:11.085384] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:14:11.085462] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:14:11.085559] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-09T21:14:11.085660] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-09T21:14:11.085732] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-09T21:14:11.085786] [DEBUG] [LOCAL ] RIO: No derivative data file found to delete. [2025-10-09T21:14:11.085849] [INFO ] [MAIN ] Update Progress: 1807/2373 symbols completed. RIO took 32.7s. Estimated remaining: 1h 19m 36s. Rate: 7.1 symbols/min [2025-10-09T21:14:11.197777] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-09T21:14:11.262265] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:14:11.262876] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-09T21:14:11.262981] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-09T21:14:11.263139] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-09T21:14:11.263340] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-09T21:14:11.263491] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-09T21:14:11.263558] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-09T21:14:11.578434] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T21:14:11.658540] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:14:11.907033] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T21:14:11.996686] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-09T21:14:12.796777] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-09T21:14:13.596687] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-09T21:14:13.908622] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T21:14:14.097758] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-09T21:14:14.396770] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-09T21:14:15.196747] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-09T21:14:15.379061] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T21:14:15.429825] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T21:14:15.996695] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-09T21:14:16.738403] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T21:14:16.796698] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-09T21:14:16.982682] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T21:14:17.596749] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-09T21:14:18.244951] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T21:14:18.396801] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-09T21:14:19.196697] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-09T21:14:19.238580] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T21:14:19.996751] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-09T21:14:20.111357] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T21:14:20.796727] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-09T21:14:21.214439] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T21:14:21.326448] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T21:14:21.596778] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-09T21:14:22.367795] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T21:14:22.396675] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-09T21:14:22.519022] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T21:14:23.196716] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-09T21:14:23.996700] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-09T21:14:24.392160] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T21:14:24.574272] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T21:14:24.576170] [INFO ] [REMOTE ] RIV: Full fetch complete (17643 records). [2025-10-09T21:14:24.576243] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-09T21:14:24.576749] [FATAL] [VALIDATOR ] RIV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:14:24.576844] [FATAL] [MAIN ] RIV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:14:24.576910] [WARN ] [MAIN ] RIV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:14:24.576984] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-09T21:14:24.577048] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-09T21:14:24.577084] [INFO ] [LOCAL ] RIV: Starting deletion of derivative data. [2025-10-09T21:14:24.577273] [DEBUG] [LOCAL ] RIV: Deleted derivative data file. [2025-10-09T21:14:24.577361] [INFO ] [MAIN ] Update Progress: 1808/2373 symbols completed. RIV took 31.9s. Estimated remaining: 1h 19m 29s. Rate: 7.1 symbols/min [2025-10-09T21:14:24.790367] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:14:24.790731] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-09T21:14:24.790829] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-09T21:14:24.790980] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-09T21:14:24.791099] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-09T21:14:24.791180] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-09T21:14:24.791255] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-09T21:14:24.809301] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-09T21:14:25.254267] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:14:25.248835] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T21:14:25.507818] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T21:14:25.511862] [INFO ] [REMOTE ] RITM: Full fetch complete (76219 records). [2025-10-09T21:14:25.511988] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-09T21:14:25.514045] [FATAL] [VALIDATOR ] RITM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:14:25.514136] [FATAL] [MAIN ] RITM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:14:25.514180] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:14:25.514219] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-09T21:14:25.514275] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-09T21:14:25.514310] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-09T21:14:25.514348] [DEBUG] [LOCAL ] RITM: No derivative data file found to delete. [2025-10-09T21:14:25.514485] [INFO ] [MAIN ] Update Progress: 1809/2373 symbols completed. RITM took 41.9s. Estimated remaining: 1h 19m 18s. Rate: 7.1 symbols/min [2025-10-09T21:14:25.601867] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-09T21:14:25.689213] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:14:25.689371] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-09T21:14:25.689408] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-09T21:14:25.689520] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-09T21:14:25.689561] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-09T21:14:25.689603] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-09T21:14:25.689635] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-09T21:14:26.036624] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:14:26.396753] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-09T21:14:27.196741] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-09T21:14:27.613225] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T21:14:27.932699] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-09T21:14:27.996691] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-09T21:14:28.534107] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T21:14:28.796731] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-09T21:14:29.242139] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T21:14:29.596791] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-09T21:14:30.193159] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T21:14:30.396778] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-09T21:14:31.196773] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-09T21:14:31.560366] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T21:14:31.996781] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-09T21:14:32.129675] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T21:14:32.634136] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T21:14:32.796729] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-09T21:14:33.596782] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-09T21:14:34.396865] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-09T21:14:34.485154] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-09T21:14:34.566043] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T21:14:35.158193] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T21:14:35.196702] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-09T21:14:35.740190] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T21:14:35.996755] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-09T21:14:36.347364] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T21:14:36.796794] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-09T21:14:37.596793] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-09T21:14:38.282964] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-09T21:14:38.396688] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-09T21:14:38.580528] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T21:14:38.879487] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T21:14:39.196700] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-09T21:14:39.252360] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T21:14:39.883131] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T21:14:39.888767] [INFO ] [REMOTE ] RKT: Full fetch complete (77048 records). [2025-10-09T21:14:39.889036] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-09T21:14:39.890538] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:14:39.890779] [FATAL] [MAIN ] RKT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:14:39.890854] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:14:39.890938] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-09T21:14:39.891018] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-09T21:14:39.891081] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-09T21:14:39.891153] [DEBUG] [LOCAL ] RKT: No derivative data file found to delete. [2025-10-09T21:14:39.891252] [INFO ] [MAIN ] Update Progress: 1810/2373 symbols completed. RKT took 28.8s. Estimated remaining: 1h 19m 12s. Rate: 7.1 symbols/min [2025-10-09T21:14:40.001916] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-09T21:14:40.102830] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:14:40.103092] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-09T21:14:40.103145] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-09T21:14:40.103273] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-09T21:14:40.103318] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-09T21:14:40.103364] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-09T21:14:40.103399] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-09T21:14:40.485375] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:14:40.796762] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-09T21:14:41.416876] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T21:14:41.596723] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-09T21:14:42.047708] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T21:14:42.396775] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-09T21:14:42.564783] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T21:14:43.196696] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-09T21:14:43.767709] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T21:14:43.996783] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-09T21:14:44.523862] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T21:14:44.796767] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-09T21:14:45.279817] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T21:14:45.596743] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-09T21:14:46.394830] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-09T21:14:46.398353] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-09T21:14:46.400734] [INFO ] [REMOTE ] RJF: Full fetch complete (67956 records). [2025-10-09T21:14:46.400956] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-09T21:14:46.402087] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:14:46.402190] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:14:46.402236] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:14:46.402307] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-09T21:14:46.402380] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-09T21:14:46.402419] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-09T21:14:46.402458] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-09T21:14:46.402522] [INFO ] [MAIN ] Update Progress: 1811/2373 symbols completed. RJF took 37.5s. Estimated remaining: 1h 19m 3s. Rate: 7.1 symbols/min [2025-10-09T21:14:46.635505] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:14:46.632391] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T21:14:46.645311] [DEBUG] [LOCAL ] RLTY: No existing data file found in primary storage. [2025-10-09T21:14:46.645383] [WARN ] [MAIN ] RLTY: No existing data found, performing full refresh instead. [2025-10-09T21:14:46.645601] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-09T21:14:46.645714] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-09T21:14:46.646052] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-09T21:14:46.646103] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-09T21:14:46.990803] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:14:47.196681] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-09T21:14:47.889991] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T21:14:47.996690] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-09T21:14:48.464998] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T21:14:48.796730] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-09T21:14:49.590250] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T21:14:49.601939] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-09T21:14:49.614026] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T21:14:50.396733] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-09T21:14:51.196720] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-09T21:14:51.489999] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T21:14:51.781910] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T21:14:51.996724] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-09T21:14:52.796720] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-09T21:14:53.002931] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T21:14:53.412480] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T21:14:53.596730] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-09T21:14:53.833233] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T21:14:54.396730] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-09T21:14:55.126206] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T21:14:55.196747] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-09T21:14:55.736916] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:14:55.829822] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T21:14:55.996729] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-09T21:14:56.796698] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-09T21:14:56.897168] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T21:14:57.596727] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-09T21:14:58.255066] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T21:14:58.396684] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-09T21:14:58.533151] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T21:14:59.196727] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-09T21:14:59.814925] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T21:14:59.996726] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-09T21:15:00.075234] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T21:15:00.392037] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T21:15:00.395662] [INFO ] [REMOTE ] RLI: Full fetch complete (47611 records). [2025-10-09T21:15:00.395754] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-09T21:15:00.396463] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:15:00.396568] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:15:00.396640] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:15:00.396745] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-09T21:15:00.396819] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-09T21:15:00.396868] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-09T21:15:00.396924] [DEBUG] [LOCAL ] RLI: No derivative data file found to delete. [2025-10-09T21:15:00.397060] [INFO ] [MAIN ] Update Progress: 1812/2373 symbols completed. RLI took 34.9s. Estimated remaining: 1h 18m 56s. Rate: 7.1 symbols/min [2025-10-09T21:15:00.568168] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:15:00.568383] [DEBUG] [LOCAL ] RLX: No existing data file found in primary storage. [2025-10-09T21:15:00.568431] [WARN ] [MAIN ] RLX: No existing data found, performing full refresh instead. [2025-10-09T21:15:00.568542] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-09T21:15:00.568610] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-09T21:15:00.568771] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-09T21:15:00.568842] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-09T21:15:00.801903] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-09T21:15:00.950186] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:15:01.596715] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-09T21:15:02.396716] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-09T21:15:02.634894] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T21:15:03.196718] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-09T21:15:03.466619] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T21:15:03.565905] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T21:15:03.865985] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T21:15:03.996768] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-09T21:15:04.796733] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-09T21:15:05.596769] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-09T21:15:05.806721] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T21:15:05.945016] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T21:15:05.948831] [INFO ] [REMOTE ] RLJ: Full fetch complete (68898 records). [2025-10-09T21:15:05.948957] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-09T21:15:05.949835] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:15:05.949929] [FATAL] [MAIN ] RLJ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:15:05.949972] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:15:05.950059] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-09T21:15:05.950140] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-09T21:15:05.950190] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-09T21:15:05.950246] [DEBUG] [LOCAL ] RLJ: No derivative data file found to delete. [2025-10-09T21:15:05.950331] [INFO ] [MAIN ] Update Progress: 1813/2373 symbols completed. RLJ took 26.1s. Estimated remaining: 1h 18m 47s. Rate: 7.1 symbols/min [2025-10-09T21:15:06.124053] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:15:06.124424] [DEBUG] [LOCAL ] RM: No existing data file found in primary storage. [2025-10-09T21:15:06.124485] [WARN ] [MAIN ] RM: No existing data found, performing full refresh instead. [2025-10-09T21:15:06.124569] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-09T21:15:06.124633] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-09T21:15:06.124754] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-09T21:15:06.124844] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-09T21:15:06.401800] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-09T21:15:06.541599] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:15:06.574398] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T21:15:07.177345] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T21:15:07.196679] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-09T21:15:07.996703] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-09T21:15:08.066823] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T21:15:08.796708] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-09T21:15:08.887892] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T21:15:09.370622] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T21:15:09.596732] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-09T21:15:10.270009] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T21:15:10.396685] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-09T21:15:11.196696] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-09T21:15:11.257567] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T21:15:11.996775] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-09T21:15:12.796713] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-09T21:15:12.837380] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T21:15:13.079978] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T21:15:13.596697] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-09T21:15:13.735939] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T21:15:14.396736] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-09T21:15:14.819788] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T21:15:14.821139] [INFO ] [REMOTE ] RLTY: Full fetch complete (17418 records). [2025-10-09T21:15:14.821213] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-09T21:15:14.821638] [FATAL] [VALIDATOR ] RLTY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:15:14.821747] [FATAL] [MAIN ] RLTY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:15:14.821791] [WARN ] [MAIN ] RLTY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:15:14.821858] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-09T21:15:14.821921] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-09T21:15:14.821958] [INFO ] [LOCAL ] RLTY: Starting deletion of derivative data. [2025-10-09T21:15:14.822024] [DEBUG] [LOCAL ] RLTY: No derivative data file found to delete. [2025-10-09T21:15:14.822101] [INFO ] [MAIN ] Update Progress: 1814/2373 symbols completed. RLTY took 28.4s. Estimated remaining: 1h 18m 38s. Rate: 7.1 symbols/min [2025-10-09T21:15:14.992161] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:15:14.992327] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-09T21:15:14.992367] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-09T21:15:14.992485] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-09T21:15:14.992531] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-09T21:15:14.992574] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-09T21:15:14.992608] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-09T21:15:15.206530] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-09T21:15:15.369516] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:15:15.466460] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T21:15:15.932469] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T21:15:15.935483] [INFO ] [REMOTE ] RL: Full fetch complete (59655 records). [2025-10-09T21:15:15.935593] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-09T21:15:15.936215] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:15:15.936300] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:15:15.936344] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:15:15.936411] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-09T21:15:15.936489] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-09T21:15:15.936547] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-09T21:15:15.936604] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-09T21:15:15.936708] [INFO ] [MAIN ] Update Progress: 1815/2373 symbols completed. RL took 51.4s. Estimated remaining: 1h 18m 28s. Rate: 7.1 symbols/min [2025-10-09T21:15:16.001832] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-09T21:15:16.121971] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:15:16.122164] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-09T21:15:16.122222] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-09T21:15:16.122353] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-09T21:15:16.122404] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-09T21:15:16.122449] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-09T21:15:16.122481] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-09T21:15:16.482567] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:15:16.796773] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-09T21:15:17.219277] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T21:15:17.596781] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-09T21:15:18.396768] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-09T21:15:18.445214] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T21:15:18.509069] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T21:15:19.196733] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-09T21:15:19.669720] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T21:15:19.819842] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T21:15:19.996723] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-09T21:15:20.747614] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T21:15:20.796696] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-09T21:15:21.572921] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T21:15:21.596682] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-09T21:15:22.396748] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-09T21:15:23.196792] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-09T21:15:23.250311] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T21:15:23.290663] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T21:15:23.996720] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-09T21:15:24.457537] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T21:15:24.677072] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T21:15:24.796726] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-09T21:15:25.596753] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-09T21:15:25.653091] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T21:15:26.396772] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-09T21:15:27.196710] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-09T21:15:27.242242] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T21:15:27.324765] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T21:15:27.996745] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-09T21:15:28.690381] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T21:15:28.796692] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-09T21:15:29.051472] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T21:15:29.596785] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-09T21:15:30.138549] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:15:30.396711] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-09T21:15:30.655163] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T21:15:31.196759] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-09T21:15:31.996756] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-09T21:15:32.209272] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T21:15:32.594222] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T21:15:32.612130] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T21:15:32.613131] [INFO ] [REMOTE ] RM: Full fetch complete (11488 records). [2025-10-09T21:15:32.613198] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-09T21:15:32.613723] [FATAL] [VALIDATOR ] RM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:15:32.613805] [FATAL] [MAIN ] RM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:15:32.613848] [WARN ] [MAIN ] RM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:15:32.613916] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-09T21:15:32.613993] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-09T21:15:32.614047] [INFO ] [LOCAL ] RM: Starting deletion of derivative data. [2025-10-09T21:15:32.614090] [DEBUG] [LOCAL ] RM: No derivative data file found to delete. [2025-10-09T21:15:32.614154] [INFO ] [MAIN ] Update Progress: 1816/2373 symbols completed. RM took 26.7s. Estimated remaining: 1h 18m 22s. Rate: 7.1 symbols/min [2025-10-09T21:15:32.787152] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:15:32.787345] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-09T21:15:32.787383] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-09T21:15:32.787495] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-09T21:15:32.787538] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-09T21:15:32.787619] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-09T21:15:32.787710] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-09T21:15:32.801805] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-09T21:15:33.154612] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:15:33.308626] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T21:15:33.596829] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-09T21:15:34.396757] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-09T21:15:34.696605] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T21:15:34.765509] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:15:34.770353] [INFO ] [REMOTE ] RLX: Full fetch complete (69748 records). [2025-10-09T21:15:34.770477] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-09T21:15:34.771319] [FATAL] [VALIDATOR ] RLX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:15:34.771426] [FATAL] [MAIN ] RLX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:15:34.771501] [WARN ] [MAIN ] RLX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:15:34.771597] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-09T21:15:34.771713] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-09T21:15:34.771771] [INFO ] [LOCAL ] RLX: Starting deletion of derivative data. [2025-10-09T21:15:34.771816] [DEBUG] [LOCAL ] RLX: No derivative data file found to delete. [2025-10-09T21:15:34.771889] [INFO ] [MAIN ] Update Progress: 1817/2373 symbols completed. RLX took 34.4s. Estimated remaining: 1h 18m 11s. Rate: 7.1 symbols/min [2025-10-09T21:15:34.946182] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:15:34.946356] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-09T21:15:34.946393] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-09T21:15:34.946537] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-09T21:15:34.946612] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-09T21:15:34.946719] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-09T21:15:34.946768] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-09T21:15:35.201850] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-09T21:15:35.309633] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:15:35.934973] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T21:15:35.996678] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-09T21:15:36.536401] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-09T21:15:36.796737] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-09T21:15:37.398159] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T21:15:37.596703] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-09T21:15:38.396693] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-09T21:15:38.470242] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T21:15:39.196730] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-09T21:15:39.889099] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T21:15:39.996686] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-09T21:15:40.201554] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T21:15:40.636533] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T21:15:40.796716] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-09T21:15:41.596727] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-09T21:15:42.396697] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-09T21:15:42.499636] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T21:15:42.544243] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T21:15:43.137100] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T21:15:43.196758] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-09T21:15:43.996693] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-09T21:15:44.294474] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T21:15:44.796734] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-09T21:15:45.361857] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T21:15:45.372462] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T21:15:45.596736] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-09T21:15:46.396701] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-09T21:15:46.544388] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T21:15:47.196727] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-09T21:15:47.458526] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T21:15:47.996688] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-09T21:15:48.065157] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T21:15:48.746037] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T21:15:48.796683] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-09T21:15:49.596691] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-09T21:15:49.631110] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T21:15:50.396738] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-09T21:15:51.196743] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-09T21:15:51.265764] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T21:15:51.419092] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T21:15:51.996776] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-09T21:15:52.584961] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T21:15:52.796692] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-09T21:15:52.882038] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T21:15:53.596720] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-09T21:15:53.687859] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T21:15:54.082338] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T21:15:54.396719] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-09T21:15:55.196696] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-09T21:15:55.371859] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T21:15:55.652724] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T21:15:55.996757] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-09T21:15:56.383141] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T21:15:56.384070] [INFO ] [REMOTE ] RMI: Full fetch complete (6134 records). [2025-10-09T21:15:56.384141] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-09T21:15:56.384671] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:15:56.384753] [FATAL] [MAIN ] RMI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:15:56.384799] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:15:56.384892] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-09T21:15:56.384970] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-09T21:15:56.385019] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-09T21:15:56.385091] [DEBUG] [LOCAL ] RMI: No derivative data file found to delete. [2025-10-09T21:15:56.385186] [INFO ] [MAIN ] Update Progress: 1818/2373 symbols completed. RMI took 23.8s. Estimated remaining: 1h 18m 7s. Rate: 7.1 symbols/min [2025-10-09T21:15:56.557356] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:15:56.557551] [DEBUG] [LOCAL ] RMMZ: No existing data file found in primary storage. [2025-10-09T21:15:56.557589] [WARN ] [MAIN ] RMMZ: No existing data found, performing full refresh instead. [2025-10-09T21:15:56.557763] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-09T21:15:56.557819] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-09T21:15:56.557864] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-09T21:15:56.557897] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-09T21:15:56.801854] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-09T21:15:56.911153] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:15:57.510283] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:15:57.514296] [INFO ] [REMOTE ] RMD: Full fetch complete (60895 records). [2025-10-09T21:15:57.514427] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-09T21:15:57.515075] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:15:57.515162] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:15:57.515206] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:15:57.515273] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-09T21:15:57.515361] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-09T21:15:57.515418] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-09T21:15:57.515463] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-09T21:15:57.515522] [INFO ] [MAIN ] Update Progress: 1819/2373 symbols completed. RMD took 41.6s. Estimated remaining: 1h 17m 56s. Rate: 7.1 symbols/min [2025-10-09T21:15:57.601807] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-09T21:15:57.696614] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:15:57.716057] [DEBUG] [LOCAL ] RMT: Loaded 17357 existing records from primary storage. [2025-10-09T21:15:57.716307] [INFO ] [MAIN ] RMT: Loaded 17357 existing records. [2025-10-09T21:15:57.894891] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:15:57.895114] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-09T21:15:57.895175] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-09T21:15:57.895519] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-09T21:15:57.895579] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-09T21:15:58.253878] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:15:58.396687] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-09T21:15:58.507979] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T21:15:59.196739] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-09T21:15:59.322471] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T21:15:59.996692] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-09T21:16:00.115758] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T21:16:00.796717] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-09T21:16:00.979524] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T21:16:01.393479] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T21:16:01.596710] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-09T21:16:02.396706] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-09T21:16:02.622834] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T21:16:03.054632] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T21:16:03.196782] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-09T21:16:03.888964] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T21:16:03.996732] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-09T21:16:04.457833] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T21:16:04.796733] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-09T21:16:05.596681] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-09T21:16:05.920997] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T21:16:06.068115] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T21:16:06.396722] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-09T21:16:07.061857] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T21:16:07.196724] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-09T21:16:07.996768] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-09T21:16:08.299115] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T21:16:08.553393] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T21:16:08.555379] [INFO ] [REMOTE ] RMAX: Full fetch complete (29764 records). [2025-10-09T21:16:08.555482] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-09T21:16:08.556455] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:16:08.556543] [FATAL] [MAIN ] RMAX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:16:08.556586] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:16:08.556634] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-09T21:16:08.556749] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-09T21:16:08.556805] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-09T21:16:08.556847] [DEBUG] [LOCAL ] RMAX: No derivative data file found to delete. [2025-10-09T21:16:08.556906] [INFO ] [MAIN ] Update Progress: 1820/2373 symbols completed. RMAX took 53.7s. Estimated remaining: 1h 17m 49s. Rate: 7.1 symbols/min [2025-10-09T21:16:08.793580] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:16:08.793824] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-09T21:16:08.793882] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-09T21:16:08.793998] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-09T21:16:08.794041] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-09T21:16:08.794084] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-09T21:16:08.794118] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-09T21:16:08.805251] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-09T21:16:09.159662] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:16:09.478462] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T21:16:09.596749] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-09T21:16:10.396728] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-09T21:16:10.867874] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T21:16:11.196744] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-09T21:16:11.996686] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-09T21:16:12.089741] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T21:16:12.283447] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T21:16:12.720064] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T21:16:12.796734] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-09T21:16:13.596721] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-09T21:16:13.771117] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T21:16:14.142432] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T21:16:14.396730] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-09T21:16:15.196781] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-09T21:16:15.664462] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T21:16:15.667532] [INFO ] [REMOTE ] RMM: Full fetch complete (14850 records). [2025-10-09T21:16:15.667839] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-09T21:16:15.668623] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:16:15.668792] [FATAL] [MAIN ] RMM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:16:15.668858] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:16:15.668943] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-09T21:16:15.669053] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-09T21:16:15.669117] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-09T21:16:15.669189] [DEBUG] [LOCAL ] RMM: No derivative data file found to delete. [2025-10-09T21:16:15.669282] [INFO ] [MAIN ] Update Progress: 1821/2373 symbols completed. RMM took 40.9s. Estimated remaining: 1h 17m 40s. Rate: 7.1 symbols/min [2025-10-09T21:16:15.764552] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T21:16:15.953910] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:16:15.954164] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-09T21:16:15.954225] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-09T21:16:15.954386] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-09T21:16:15.954436] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-09T21:16:15.954481] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-09T21:16:15.954514] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-09T21:16:16.002145] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-09T21:16:16.372194] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:16:16.796704] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-09T21:16:17.508929] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T21:16:17.596727] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-09T21:16:17.773942] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T21:16:18.326279] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T21:16:18.396772] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-09T21:16:19.196747] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-09T21:16:19.996771] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-09T21:16:20.195983] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T21:16:20.352587] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T21:16:20.796729] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-09T21:16:21.022900] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T21:16:21.596722] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-09T21:16:22.127635] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T21:16:22.404749] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-09T21:16:22.410302] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T21:16:23.196692] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-09T21:16:23.224931] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T21:16:23.996788] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-09T21:16:24.108214] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T21:16:24.796724] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-09T21:16:25.139830] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T21:16:25.140787] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6961 records). [2025-10-09T21:16:25.140858] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-09T21:16:25.141230] [FATAL] [VALIDATOR ] RMMZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:16:25.141339] [FATAL] [MAIN ] RMMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:16:25.141387] [WARN ] [MAIN ] RMMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:16:25.141466] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-09T21:16:25.141578] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-09T21:16:25.141678] [INFO ] [LOCAL ] RMMZ: Starting deletion of derivative data. [2025-10-09T21:16:25.141775] [DEBUG] [LOCAL ] RMMZ: No derivative data file found to delete. [2025-10-09T21:16:25.141891] [INFO ] [MAIN ] Update Progress: 1822/2373 symbols completed. RMMZ took 28.8s. Estimated remaining: 1h 17m 32s. Rate: 7.1 symbols/min [2025-10-09T21:16:25.325317] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:16:25.344256] [DEBUG] [LOCAL ] RNP: Loaded 16068 existing records from primary storage. [2025-10-09T21:16:25.344548] [INFO ] [MAIN ] RNP: Loaded 16068 existing records. [2025-10-09T21:16:25.528315] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:16:25.528727] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-09T21:16:25.528876] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-09T21:16:25.529246] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-09T21:16:25.529304] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-09T21:16:25.610008] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-09T21:16:25.669004] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T21:16:25.946272] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:16:26.396855] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-09T21:16:26.400459] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T21:16:27.196707] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-09T21:16:27.281937] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T21:16:27.996713] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-09T21:16:28.149802] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T21:16:28.796736] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-09T21:16:29.596766] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-09T21:16:29.933277] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T21:16:29.945619] [INFO ] [REMOTE ] RMT: Full fetch complete (25312 records). [2025-10-09T21:16:29.946398] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T21:16:29.946476] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-09T21:16:29.951281] [FATAL] [VALIDATOR ] RMT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:16:29.951365] [FATAL] [MAIN ] RMT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:16:29.951441] [WARN ] [MAIN ] RMT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:16:29.951526] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-09T21:16:29.951604] [DEBUG] [LOCAL ] RMT: No primary data file found to delete. [2025-10-09T21:16:29.951688] [INFO ] [LOCAL ] RMT: Starting deletion of derivative data. [2025-10-09T21:16:29.952035] [DEBUG] [LOCAL ] RMT: Deleted derivative data file. [2025-10-09T21:16:29.952154] [INFO ] [MAIN ] Update Progress: 1823/2373 symbols completed. RMT took 32.4s. Estimated remaining: 1h 17m 22s. Rate: 7.1 symbols/min [2025-10-09T21:16:30.131841] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:16:30.132084] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-09T21:16:30.132234] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-09T21:16:30.132455] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-09T21:16:30.132638] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-09T21:16:30.132839] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-09T21:16:30.132905] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-09T21:16:30.311997] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-09T21:16:30.405996] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-09T21:16:30.533855] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:16:31.196734] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-09T21:16:31.996742] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-09T21:16:32.174916] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T21:16:32.196494] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T21:16:32.789160] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T21:16:32.796666] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-09T21:16:33.596737] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-09T21:16:33.854633] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T21:16:34.396750] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-09T21:16:35.196737] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-09T21:16:35.355705] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T21:16:35.501389] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T21:16:35.996707] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-09T21:16:36.254101] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T21:16:36.796689] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-09T21:16:36.946322] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T21:16:37.596744] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-09T21:16:38.396687] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-09T21:16:38.661622] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T21:16:38.697588] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T21:16:39.196777] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-09T21:16:40.004041] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-09T21:16:40.009341] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T21:16:40.136739] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T21:16:40.796722] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-09T21:16:40.873328] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T21:16:41.596728] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-09T21:16:42.382594] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T21:16:42.396686] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-09T21:16:42.511848] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T21:16:43.196731] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-09T21:16:43.418408] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T21:16:43.996699] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-09T21:16:44.289334] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T21:16:44.796729] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-09T21:16:45.416594] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T21:16:45.602751] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-09T21:16:45.607273] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T21:16:46.396694] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-09T21:16:46.703738] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T21:16:47.196741] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-09T21:16:47.692725] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T21:16:47.996734] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-09T21:16:48.169783] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T21:16:48.173866] [INFO ] [REMOTE ] RNG: Full fetch complete (69059 records). [2025-10-09T21:16:48.174029] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-09T21:16:48.174775] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:16:48.174892] [FATAL] [MAIN ] RNG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:16:48.174937] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:16:48.174978] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-09T21:16:48.175036] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-09T21:16:48.175074] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-09T21:16:48.175114] [DEBUG] [LOCAL ] RNG: No derivative data file found to delete. [2025-10-09T21:16:48.175172] [INFO ] [MAIN ] Update Progress: 1824/2373 symbols completed. RNG took 39.6s. Estimated remaining: 1h 17m 17s. Rate: 7.1 symbols/min [2025-10-09T21:16:48.362412] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:16:48.362585] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-09T21:16:48.362623] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-09T21:16:48.362761] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-09T21:16:48.362803] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-09T21:16:48.362844] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-09T21:16:48.362877] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-09T21:16:48.720708] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:16:48.796671] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-09T21:16:49.596751] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-09T21:16:49.622938] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T21:16:50.245727] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T21:16:50.310766] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T21:16:50.396703] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-09T21:16:51.196745] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-09T21:16:51.858346] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T21:16:51.901344] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T21:16:51.903542] [INFO ] [REMOTE ] RNP: Full fetch complete (23631 records). [2025-10-09T21:16:51.903638] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-09T21:16:51.904194] [FATAL] [VALIDATOR ] RNP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:16:51.904285] [FATAL] [MAIN ] RNP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:16:51.904329] [WARN ] [MAIN ] RNP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:16:51.904392] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-09T21:16:51.904449] [DEBUG] [LOCAL ] RNP: No primary data file found to delete. [2025-10-09T21:16:51.904484] [INFO ] [LOCAL ] RNP: Starting deletion of derivative data. [2025-10-09T21:16:51.904903] [DEBUG] [LOCAL ] RNP: Deleted derivative data file. [2025-10-09T21:16:51.905006] [INFO ] [MAIN ] Update Progress: 1825/2373 symbols completed. RNP took 26.8s. Estimated remaining: 1h 17m 7s. Rate: 7.1 symbols/min [2025-10-09T21:16:52.001914] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-09T21:16:52.072937] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:16:52.073093] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-09T21:16:52.073129] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-09T21:16:52.073241] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-09T21:16:52.073282] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-09T21:16:52.073323] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-09T21:16:52.073355] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-09T21:16:52.424550] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:16:52.632775] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T21:16:52.634800] [INFO ] [REMOTE ] RNGR: Full fetch complete (28027 records). [2025-10-09T21:16:52.634921] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-09T21:16:52.635395] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:16:52.635474] [FATAL] [MAIN ] RNGR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:16:52.635544] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:16:52.635613] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-09T21:16:52.635711] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-09T21:16:52.635761] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-09T21:16:52.635805] [DEBUG] [LOCAL ] RNGR: No derivative data file found to delete. [2025-10-09T21:16:52.635860] [INFO ] [MAIN ] Update Progress: 1826/2373 symbols completed. RNGR took 37.0s. Estimated remaining: 1h 16m 56s. Rate: 7.1 symbols/min [2025-10-09T21:16:52.797692] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-09T21:16:52.826485] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:16:52.826786] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-09T21:16:52.826853] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-09T21:16:52.826995] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-09T21:16:52.827058] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-09T21:16:52.827130] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-09T21:16:52.827186] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-09T21:16:53.200023] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:16:53.596712] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-09T21:16:54.312352] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T21:16:54.396687] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-09T21:16:54.881694] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T21:16:55.196692] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-09T21:16:55.464792] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T21:16:55.996711] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-09T21:16:56.592933] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T21:16:56.796726] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-09T21:16:57.596719] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-09T21:16:57.726920] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T21:16:58.396720] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-09T21:16:58.606557] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T21:16:59.196704] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-09T21:16:59.923234] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-09T21:16:59.996772] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-09T21:17:00.056850] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T21:17:00.283568] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T21:17:00.796789] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-09T21:17:01.224956] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T21:17:01.596753] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-09T21:17:02.317385] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T21:17:02.396728] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-09T21:17:03.196702] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-09T21:17:03.661011] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T21:17:03.996703] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-09T21:17:04.134634] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T21:17:04.796775] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-09T21:17:05.361601] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (3.76 seconds). [2025-10-09T21:17:05.560197] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T21:17:05.596679] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-09T21:17:06.082034] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T21:17:06.396784] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-09T21:17:07.196697] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-09T21:17:07.441053] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T21:17:07.845733] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T21:17:07.996745] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-09T21:17:08.796698] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-09T21:17:08.820823] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T21:17:09.596686] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-09T21:17:09.761546] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T21:17:10.396690] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-09T21:17:11.091028] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-09T21:17:11.196699] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-09T21:17:11.376560] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T21:17:11.381143] [INFO ] [REMOTE ] RNST: Full fetch complete (52783 records). [2025-10-09T21:17:11.381349] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-09T21:17:11.382365] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:17:11.382463] [FATAL] [MAIN ] RNST: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:17:11.382509] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:17:11.382564] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-09T21:17:11.382632] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-09T21:17:11.382712] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-09T21:17:11.382768] [DEBUG] [LOCAL ] RNST: No derivative data file found to delete. [2025-10-09T21:17:11.382836] [INFO ] [MAIN ] Update Progress: 1827/2373 symbols completed. RNST took 23.2s. Estimated remaining: 1h 16m 51s. Rate: 7.1 symbols/min [2025-10-09T21:17:11.566361] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:17:11.566665] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-09T21:17:11.566726] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-09T21:17:11.566858] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-09T21:17:11.566902] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-09T21:17:11.566945] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-09T21:17:11.566980] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-09T21:17:11.949722] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:17:11.996698] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-09T21:17:12.197212] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T21:17:12.457542] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T21:17:12.796719] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-09T21:17:13.091035] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T21:17:13.340064] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:17:13.596760] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-09T21:17:14.396736] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-09T21:17:14.701425] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T21:17:14.704199] [INFO ] [REMOTE ] RNR: Full fetch complete (50713 records). [2025-10-09T21:17:14.704285] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-09T21:17:14.704843] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:17:14.704948] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:17:14.705012] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:17:14.705084] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-09T21:17:14.705145] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-09T21:17:14.705181] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-09T21:17:14.705220] [DEBUG] [LOCAL ] RNR: No derivative data file found to delete. [2025-10-09T21:17:14.705272] [INFO ] [MAIN ] Update Progress: 1828/2373 symbols completed. RNR took 44.8s. Estimated remaining: 1h 16m 41s. Rate: 7.1 symbols/min [2025-10-09T21:17:14.883726] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:17:14.883881] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-09T21:17:14.883943] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-09T21:17:14.884065] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-09T21:17:14.884107] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-09T21:17:14.884150] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-09T21:17:14.884182] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-09T21:17:15.206931] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-09T21:17:15.250411] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:17:15.364425] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T21:17:15.996721] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-09T21:17:16.749385] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T21:17:16.796674] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-09T21:17:17.568290] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T21:17:17.596813] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-09T21:17:18.396692] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-09T21:17:18.547596] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T21:17:19.196791] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-09T21:17:19.293361] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T21:17:19.958474] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-09T21:17:19.996749] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-09T21:17:20.247131] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T21:17:20.796755] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-09T21:17:21.596746] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-09T21:17:21.903492] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T21:17:22.091380] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T21:17:22.277796] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T21:17:22.396702] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-09T21:17:23.196705] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-09T21:17:23.770410] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:17:23.774249] [INFO ] [REMOTE ] ROK: Full fetch complete (62368 records). [2025-10-09T21:17:23.774355] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-09T21:17:23.775095] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:17:23.775199] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:17:23.775276] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:17:23.775373] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-09T21:17:23.775459] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-09T21:17:23.775826] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-09T21:17:23.775899] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-09T21:17:23.776028] [INFO ] [MAIN ] Update Progress: 1829/2373 symbols completed. ROK took 31.1s. Estimated remaining: 1h 16m 32s. Rate: 7.1 symbols/min [2025-10-09T21:17:23.956159] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:17:23.956359] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-10-09T21:17:23.956562] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-10-09T21:17:23.956770] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-09T21:17:23.956818] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-09T21:17:23.956862] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-09T21:17:23.956896] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-09T21:17:24.001829] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-09T21:17:24.239754] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T21:17:24.358170] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:17:24.796758] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-09T21:17:25.596764] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-09T21:17:25.846777] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T21:17:25.918224] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T21:17:26.396715] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-09T21:17:27.113508] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T21:17:27.196679] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-09T21:17:27.996698] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-09T21:17:28.315234] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T21:17:28.796707] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-09T21:17:28.874758] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T21:17:29.324542] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T21:17:29.596746] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-09T21:17:29.720969] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T21:17:30.253522] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T21:17:30.396730] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-09T21:17:30.684319] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-09T21:17:30.686300] [INFO ] [REMOTE ] ROG: Full fetch complete (30806 records). [2025-10-09T21:17:30.686406] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-09T21:17:30.686993] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:17:30.687103] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:17:30.687192] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:17:30.687276] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-09T21:17:30.687356] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-09T21:17:30.687412] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-09T21:17:30.687456] [DEBUG] [LOCAL ] ROG: No derivative data file found to delete. [2025-10-09T21:17:30.687515] [INFO ] [MAIN ] Update Progress: 1830/2373 symbols completed. ROG took 38.8s. Estimated remaining: 1h 16m 23s. Rate: 7.1 symbols/min [2025-10-09T21:17:30.887762] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:17:30.887913] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-09T21:17:30.887967] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-09T21:17:30.888080] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-09T21:17:30.888122] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-09T21:17:30.888163] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-09T21:17:30.888194] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-09T21:17:31.205715] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-09T21:17:31.235989] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:17:31.996784] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-09T21:17:32.369624] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T21:17:32.796746] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-09T21:17:33.596747] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-09T21:17:33.653552] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T21:17:34.396720] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-09T21:17:34.483093] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T21:17:34.511577] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T21:17:35.196730] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-09T21:17:35.996686] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-09T21:17:36.030165] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T21:17:36.576629] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T21:17:36.796725] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-09T21:17:37.381356] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T21:17:37.596740] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-09T21:17:38.396691] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-09T21:17:38.452137] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T21:17:39.030584] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T21:17:39.196699] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-09T21:17:39.539879] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T21:17:39.996721] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-09T21:17:40.413341] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T21:17:40.796776] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-09T21:17:41.217807] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T21:17:41.596770] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-09T21:17:42.173591] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T21:17:42.396731] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-09T21:17:43.196725] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-09T21:17:43.338420] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T21:17:43.911602] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T21:17:43.996677] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-09T21:17:44.214466] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T21:17:44.796765] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-09T21:17:45.259124] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T21:17:45.596722] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-09T21:17:46.396749] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-09T21:17:46.524280] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T21:17:46.693065] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T21:17:47.196714] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-09T21:17:47.308090] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T21:17:47.996779] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-09T21:17:48.612211] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T21:17:48.615663] [INFO ] [REMOTE ] RPM: Full fetch complete (59094 records). [2025-10-09T21:17:48.615767] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-09T21:17:48.616432] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:17:48.616522] [FATAL] [MAIN ] RPM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:17:48.616565] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:17:48.616610] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-09T21:17:48.616693] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-09T21:17:48.616750] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-09T21:17:48.616794] [DEBUG] [LOCAL ] RPM: No derivative data file found to delete. [2025-10-09T21:17:48.616852] [INFO ] [MAIN ] Update Progress: 1831/2373 symbols completed. RPM took 33.9s. Estimated remaining: 1h 16m 18s. Rate: 7.1 symbols/min [2025-10-09T21:17:48.787491] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:17:48.787929] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-09T21:17:48.787993] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-09T21:17:48.788146] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-09T21:17:48.788233] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-09T21:17:48.788302] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-09T21:17:48.788516] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-09T21:17:48.808431] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-09T21:17:49.046939] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T21:17:49.191108] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:17:49.596756] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-09T21:17:50.184425] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T21:17:50.396703] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-09T21:17:51.128883] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T21:17:51.196680] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-09T21:17:51.418562] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T21:17:51.996774] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-09T21:17:52.719798] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T21:17:52.796670] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-09T21:17:53.131421] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T21:17:53.596722] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-09T21:17:53.996541] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T21:17:54.215494] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T21:17:54.396716] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-09T21:17:55.100595] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T21:17:55.196683] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-09T21:17:55.925147] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T21:17:55.929087] [INFO ] [REMOTE ] ROL: Full fetch complete (72515 records). [2025-10-09T21:17:55.929189] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-09T21:17:55.929977] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:17:55.930083] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:17:55.930155] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:17:55.930229] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-09T21:17:55.930294] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-09T21:17:55.930329] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-09T21:17:55.930369] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-09T21:17:55.930461] [INFO ] [MAIN ] Update Progress: 1832/2373 symbols completed. ROL took 44.5s. Estimated remaining: 1h 16m 9s. Rate: 7.1 symbols/min [2025-10-09T21:17:56.001818] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-09T21:17:56.103326] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:17:56.103519] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-09T21:17:56.103558] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-09T21:17:56.103699] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-09T21:17:56.103754] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-09T21:17:56.103797] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-09T21:17:56.103831] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-09T21:17:56.475517] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:17:56.796718] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-09T21:17:57.581852] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T21:17:57.596677] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-09T21:17:57.619845] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T21:17:57.957550] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T21:17:57.959335] [INFO ] [REMOTE ] RPT: Full fetch complete (28392 records). [2025-10-09T21:17:57.959408] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-09T21:17:57.959887] [FATAL] [VALIDATOR ] RPT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:17:57.959970] [FATAL] [MAIN ] RPT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:17:57.960013] [WARN ] [MAIN ] RPT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:17:57.960156] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-09T21:17:57.960231] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-09T21:17:57.960267] [INFO ] [LOCAL ] RPT: Starting deletion of derivative data. [2025-10-09T21:17:57.960306] [DEBUG] [LOCAL ] RPT: No derivative data file found to delete. [2025-10-09T21:17:57.960382] [INFO ] [MAIN ] Update Progress: 1833/2373 symbols completed. RPT took 34.2s. Estimated remaining: 1h 15m 59s. Rate: 7.1 symbols/min [2025-10-09T21:17:58.140486] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:17:58.140706] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-09T21:17:58.140760] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-09T21:17:58.140870] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-09T21:17:58.140911] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-09T21:17:58.140951] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-09T21:17:58.140984] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-09T21:17:58.401846] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-09T21:17:58.494976] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:17:59.093029] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T21:17:59.096245] [INFO ] [REMOTE ] RQI: Full fetch complete (42879 records). [2025-10-09T21:17:59.096584] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-09T21:17:59.097936] [FATAL] [VALIDATOR ] RQI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:17:59.098056] [FATAL] [MAIN ] RQI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:17:59.098117] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:17:59.098181] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-09T21:17:59.098267] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-09T21:17:59.098337] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-10-09T21:17:59.098439] [DEBUG] [LOCAL ] RQI: No derivative data file found to delete. [2025-10-09T21:17:59.098553] [INFO ] [MAIN ] Update Progress: 1834/2373 symbols completed. RQI took 28.4s. Estimated remaining: 1h 15m 48s. Rate: 7.1 symbols/min [2025-10-09T21:17:59.202061] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-09T21:17:59.287747] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:17:59.296328] [DEBUG] [LOCAL ] RSF: Loaded 4306 existing records from primary storage. [2025-10-09T21:17:59.296547] [INFO ] [MAIN ] RSF: Loaded 4306 existing records. [2025-10-09T21:17:59.478948] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:17:59.479180] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-09T21:17:59.479231] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-09T21:17:59.479560] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-09T21:17:59.479621] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-09T21:17:59.830527] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:17:59.996751] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-09T21:18:00.440603] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-09T21:18:00.731684] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T21:18:00.796687] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-09T21:18:01.596736] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-09T21:18:02.387663] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T21:18:02.396667] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-09T21:18:02.838567] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T21:18:03.196698] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-09T21:18:03.928591] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T21:18:03.929862] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T21:18:03.996676] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-09T21:18:04.796732] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-09T21:18:05.596721] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-09T21:18:05.689823] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T21:18:05.718901] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T21:18:06.396755] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-09T21:18:06.779248] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T21:18:07.196728] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-09T21:18:07.725029] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T21:18:07.996696] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-09T21:18:08.034638] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T21:18:08.796729] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-09T21:18:09.519728] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T21:18:09.596700] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-09T21:18:10.396693] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-09T21:18:10.577502] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T21:18:11.018928] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T21:18:11.077604] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T21:18:11.196723] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-09T21:18:11.900615] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T21:18:11.996734] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-09T21:18:12.777009] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T21:18:12.796675] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-09T21:18:13.596736] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-09T21:18:14.396704] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-09T21:18:14.428913] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T21:18:14.753557] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T21:18:15.196710] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-09T21:18:15.996698] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-09T21:18:16.117516] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T21:18:16.303588] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T21:18:16.697705] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T21:18:16.796696] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-09T21:18:17.596789] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-09T21:18:18.396790] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-09T21:18:18.551675] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T21:18:18.796870] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T21:18:19.196739] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-09T21:18:19.763884] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T21:18:19.996797] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-09T21:18:20.602004] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T21:18:20.796781] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-09T21:18:21.238829] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T21:18:21.596770] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-09T21:18:22.396768] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-09T21:18:22.486498] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T21:18:22.547211] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T21:18:23.071884] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T21:18:23.196728] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-09T21:18:23.996737] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-09T21:18:24.366705] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T21:18:24.796743] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-09T21:18:24.967049] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.17 seconds). [2025-10-09T21:18:24.968009] [INFO ] [REMOTE ] RSF: Full fetch complete (5647 records). [2025-10-09T21:18:24.968081] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-09T21:18:24.968602] [FATAL] [VALIDATOR ] RSF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:18:24.968709] [FATAL] [MAIN ] RSF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:18:24.968755] [WARN ] [MAIN ] RSF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:18:24.968824] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-09T21:18:24.968912] [DEBUG] [LOCAL ] RSF: No primary data file found to delete. [2025-10-09T21:18:24.968970] [INFO ] [LOCAL ] RSF: Starting deletion of derivative data. [2025-10-09T21:18:24.969217] [DEBUG] [LOCAL ] RSF: Deleted derivative data file. [2025-10-09T21:18:24.969326] [INFO ] [MAIN ] Update Progress: 1835/2373 symbols completed. RSF took 25.9s. Estimated remaining: 1h 15m 45s. Rate: 7.1 symbols/min [2025-10-09T21:18:25.142188] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:18:25.142419] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-09T21:18:25.142475] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-09T21:18:25.142596] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-09T21:18:25.142639] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-09T21:18:25.142731] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-09T21:18:25.142766] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-09T21:18:25.429225] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T21:18:25.521675] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:18:25.596676] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-09T21:18:26.396722] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-09T21:18:27.196730] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-09T21:18:27.365130] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T21:18:27.996746] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-09T21:18:28.090067] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T21:18:28.658960] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T21:18:28.796667] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-09T21:18:29.343226] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T21:18:29.596760] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-09T21:18:30.396763] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-09T21:18:30.518034] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T21:18:31.016888] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T21:18:31.055496] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T21:18:31.196699] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-09T21:18:31.996737] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-09T21:18:32.482209] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T21:18:32.486179] [INFO ] [REMOTE ] RRC: Full fetch complete (76068 records). [2025-10-09T21:18:32.486312] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-09T21:18:32.487110] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:18:32.487207] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:18:32.487250] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:18:32.487289] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-09T21:18:32.487346] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-09T21:18:32.487381] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-09T21:18:32.487426] [DEBUG] [LOCAL ] RRC: No derivative data file found to delete. [2025-10-09T21:18:32.487484] [INFO ] [MAIN ] Update Progress: 1836/2373 symbols completed. RRC took 43.9s. Estimated remaining: 1h 15m 36s. Rate: 7.1 symbols/min [2025-10-09T21:18:32.658208] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:18:32.658323] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-09T21:18:32.658361] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-09T21:18:32.658465] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-09T21:18:32.658506] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-09T21:18:32.658547] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-09T21:18:32.658579] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-09T21:18:32.797358] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-09T21:18:33.018347] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:18:33.046392] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T21:18:33.596746] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-09T21:18:33.638306] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T21:18:34.396738] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-09T21:18:34.675739] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-09T21:18:34.677817] [INFO ] [REMOTE ] RS: Full fetch complete (38755 records). [2025-10-09T21:18:34.677893] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-09T21:18:34.678368] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:18:34.678452] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:18:34.678495] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:18:34.678532] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-09T21:18:34.678587] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-09T21:18:34.678621] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-09T21:18:34.678710] [DEBUG] [LOCAL ] RS: No derivative data file found to delete. [2025-10-09T21:18:34.678777] [INFO ] [MAIN ] Update Progress: 1837/2373 symbols completed. RS took 36.7s. Estimated remaining: 1h 15m 26s. Rate: 7.1 symbols/min [2025-10-09T21:18:34.892190] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T21:18:35.196789] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-09T21:18:35.996738] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-09T21:18:36.796730] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-09T21:18:36.963008] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T21:18:37.604347] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-09T21:18:37.609968] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T21:18:37.798968] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T21:18:38.396718] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-09T21:18:39.072374] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T21:18:39.075585] [INFO ] [REMOTE ] RRX: Full fetch complete (58109 records). [2025-10-09T21:18:39.075709] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-09T21:18:39.076397] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:18:39.076481] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:18:39.076524] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:18:39.076589] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-09T21:18:39.076676] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-09T21:18:39.076732] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-09T21:18:39.076774] [DEBUG] [LOCAL ] RRX: No derivative data file found to delete. [2025-10-09T21:18:39.076831] [INFO ] [MAIN ] Update Progress: 1838/2373 symbols completed. RRX took 43.1s. Estimated remaining: 1h 15m 16s. Rate: 7.1 symbols/min [2025-10-09T21:18:39.196752] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-09T21:18:39.353253] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T21:18:39.996754] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-09T21:18:40.853012] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T21:18:40.862873] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-09T21:18:41.433334] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T21:18:41.596751] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-09T21:18:42.328865] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T21:18:42.396663] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-09T21:18:43.342745] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T21:18:43.353632] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-09T21:18:44.091921] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T21:18:44.102183] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-09T21:18:45.110996] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T21:18:45.122322] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-09T21:18:45.659679] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:18:45.670171] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-09T21:18:45.779866] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T21:18:46.342183] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T21:18:46.345814] [INFO ] [REMOTE ] RSG: Full fetch complete (67673 records). [2025-10-09T21:18:46.345930] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-09T21:18:46.348824] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:18:46.348920] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:18:46.348963] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:18:46.349029] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-09T21:18:46.349092] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-09T21:18:46.349128] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-09T21:18:46.349168] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-09T21:18:46.349240] [INFO ] [MAIN ] Update Progress: 1839/2373 symbols completed. RSG took 21.4s. Estimated remaining: 1h 15m 7s. Rate: 7.1 symbols/min [2025-10-09T21:18:46.396795] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-09T21:18:48.089074] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T21:18:48.100465] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-09T21:18:49.741411] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T21:18:49.751683] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-09T21:18:51.636589] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T21:18:51.647118] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-09T21:18:52.684411] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T21:18:52.694683] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-09T21:18:53.214177] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T21:18:53.217903] [INFO ] [REMOTE ] RSI: Full fetch complete (69117 records). [2025-10-09T21:18:53.218004] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-09T21:18:53.218955] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:18:53.219043] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:18:53.219086] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:18:53.219169] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-09T21:18:53.219256] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-09T21:18:53.219311] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-09T21:18:53.219353] [DEBUG] [LOCAL ] RSI: No derivative data file found to delete. [2025-10-09T21:18:53.219408] [INFO ] [MAIN ] Update Progress: 1840/2373 symbols completed. RSI took 20.7s. Estimated remaining: 1h 14m 59s. Rate: 7.1 symbols/min [2025-10-09T21:18:53.792949] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:18:53.871817] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-09T21:18:53.872735] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:18:53.873016] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-09T21:18:53.886039] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-09T21:18:53.886219] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-09T21:18:53.898918] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-09T21:18:53.898855] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-09T21:18:53.944090] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:18:53.944313] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-09T21:18:53.943052] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-09T21:18:53.945350] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:18:53.944467] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-09T21:18:53.945541] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-09T21:18:53.945801] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-09T21:18:53.945731] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-09T21:18:53.946023] [DEBUG] [LOCAL ] RSKD: No existing data file found in primary storage. [2025-10-09T21:18:53.946113] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-09T21:18:53.946422] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-09T21:18:53.951758] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-09T21:18:53.971705] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-09T21:18:53.946279] [WARN ] [MAIN ] RSKD: No existing data found, performing full refresh instead. [2025-10-09T21:18:54.010183] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-09T21:18:54.029526] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-09T21:18:54.020714] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-09T21:18:54.102557] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-09T21:18:54.204726] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-09T21:18:54.278666] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-09T21:18:55.233283] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:18:55.298014] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:18:55.322592] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-09T21:18:55.280204] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-09T21:18:55.351537] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:18:55.351985] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-09T21:18:55.489923] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:18:55.490260] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-09T21:18:56.672924] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T21:18:56.682388] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-09T21:18:56.912736] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T21:18:56.919957] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-09T21:18:57.033698] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T21:18:57.044235] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-09T21:18:57.326779] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-09T21:18:57.337843] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-09T21:18:57.945910] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T21:18:57.955001] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-09T21:18:58.180529] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T21:18:58.187312] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-09T21:18:58.653541] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T21:18:58.664474] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-09T21:18:58.772077] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T21:18:59.157846] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T21:18:59.187780] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T21:18:59.196670] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-09T21:18:59.996762] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-09T21:19:00.219248] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T21:19:00.615511] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T21:19:00.796712] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-09T21:19:01.596693] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-09T21:19:01.775864] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T21:19:02.396707] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-09T21:19:02.582198] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T21:19:02.883123] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T21:19:03.196774] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-09T21:19:03.996691] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-09T21:19:04.077074] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T21:19:04.190486] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T21:19:04.796763] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-09T21:19:05.047173] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T21:19:05.596770] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-09T21:19:06.390410] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T21:19:06.400432] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-09T21:19:06.977345] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T21:19:07.196776] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-09T21:19:07.895736] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T21:19:07.996679] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-09T21:19:08.796681] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-09T21:19:08.988497] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T21:19:09.491447] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T21:19:09.596794] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-09T21:19:10.317708] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T21:19:10.396820] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-09T21:19:10.661437] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T21:19:11.196725] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-09T21:19:11.996729] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-09T21:19:12.381564] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T21:19:12.722115] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T21:19:12.796676] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-09T21:19:13.337219] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T21:19:13.503823] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T21:19:13.596680] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-09T21:19:14.396756] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-09T21:19:14.762282] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:19:14.764910] [INFO ] [REMOTE ] RSKD: Full fetch complete (48103 records). [2025-10-09T21:19:14.764993] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-09T21:19:14.765909] [FATAL] [VALIDATOR ] RSKD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:19:14.766035] [FATAL] [MAIN ] RSKD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:19:14.766112] [WARN ] [MAIN ] RSKD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:19:14.766233] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-09T21:19:14.766314] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-09T21:19:14.766365] [INFO ] [LOCAL ] RSKD: Starting deletion of derivative data. [2025-10-09T21:19:14.766432] [DEBUG] [LOCAL ] RSKD: No derivative data file found to delete. [2025-10-09T21:19:14.766490] [INFO ] [MAIN ] Update Progress: 1841/2373 symbols completed. RSKD took 21.5s. Estimated remaining: 1h 14m 54s. Rate: 7.1 symbols/min [2025-10-09T21:19:14.955295] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:19:14.990435] [DEBUG] [LOCAL ] RVT: Loaded 26433 existing records from primary storage. [2025-10-09T21:19:14.990725] [INFO ] [MAIN ] RVT: Loaded 26433 existing records. [2025-10-09T21:19:15.174535] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:19:15.174843] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-09T21:19:15.174949] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-09T21:19:15.175351] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-09T21:19:15.175456] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-09T21:19:15.209198] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-09T21:19:15.364219] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T21:19:15.578756] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:19:15.996730] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-09T21:19:16.796782] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-09T21:19:17.470427] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-09T21:19:17.604724] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-09T21:19:17.622690] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T21:19:18.396702] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-09T21:19:18.446578] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T21:19:19.196781] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-09T21:19:19.861480] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T21:19:19.960133] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T21:19:19.974705] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-09T21:19:19.996665] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-09T21:19:20.796729] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-09T21:19:21.263951] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T21:19:21.267680] [INFO ] [REMOTE ] RVLV: Full fetch complete (68472 records). [2025-10-09T21:19:21.267843] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-09T21:19:21.268637] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:19:21.268758] [FATAL] [MAIN ] RVLV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:19:21.268802] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:19:21.268845] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-09T21:19:21.268902] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-09T21:19:21.268936] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-09T21:19:21.268977] [DEBUG] [LOCAL ] RVLV: No derivative data file found to delete. [2025-10-09T21:19:21.269033] [INFO ] [MAIN ] Update Progress: 1842/2373 symbols completed. RVLV took 28.0s. Estimated remaining: 1h 14m 45s. Rate: 7.1 symbols/min [2025-10-09T21:19:21.435781] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:19:21.435948] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-09T21:19:21.435985] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-09T21:19:21.436096] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-09T21:19:21.436136] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-09T21:19:21.436176] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-09T21:19:21.436208] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-09T21:19:21.606953] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-09T21:19:21.788225] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:19:22.376923] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-09T21:19:22.396673] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-09T21:19:22.474333] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T21:19:23.196737] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-09T21:19:23.996716] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-09T21:19:24.479224] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T21:19:24.482745] [INFO ] [REMOTE ] RTO: Full fetch complete (58322 records). [2025-10-09T21:19:24.482865] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-09T21:19:24.483551] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:19:24.483670] [FATAL] [MAIN ] RTO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:19:24.483732] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:19:24.483777] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-09T21:19:24.483836] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-09T21:19:24.483874] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-09T21:19:24.483924] [DEBUG] [LOCAL ] RTO: No derivative data file found to delete. [2025-10-09T21:19:24.484020] [INFO ] [MAIN ] Update Progress: 1843/2373 symbols completed. RTO took 31.3s. Estimated remaining: 1h 14m 35s. Rate: 7.1 symbols/min [2025-10-09T21:19:24.661174] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:19:24.661383] [DEBUG] [LOCAL ] RWT: No existing data file found in primary storage. [2025-10-09T21:19:24.661480] [WARN ] [MAIN ] RWT: No existing data found, performing full refresh instead. [2025-10-09T21:19:24.661628] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-09T21:19:24.661713] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-09T21:19:24.661843] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-09T21:19:24.661977] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-09T21:19:24.808492] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-09T21:19:25.003949] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-09T21:19:25.084405] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:19:25.107838] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T21:19:25.596744] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-09T21:19:26.062412] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T21:19:26.396712] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-09T21:19:27.196712] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-09T21:19:27.325523] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T21:19:27.681976] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T21:19:27.996738] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-09T21:19:28.796728] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-09T21:19:29.302090] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T21:19:29.467000] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-09T21:19:29.596719] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-09T21:19:30.001008] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T21:19:30.396690] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-09T21:19:30.577014] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T21:19:31.196709] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-09T21:19:31.652862] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T21:19:31.938108] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T21:19:31.942446] [INFO ] [REMOTE ] RTX: Full fetch complete (77342 records). [2025-10-09T21:19:31.942575] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-09T21:19:31.943474] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:19:31.943572] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:19:31.943616] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:19:31.943711] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-09T21:19:31.943794] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-09T21:19:31.943852] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-09T21:19:31.943901] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-09T21:19:31.943989] [INFO ] [MAIN ] Update Progress: 1844/2373 symbols completed. RTX took 38.7s. Estimated remaining: 1h 14m 26s. Rate: 7.1 symbols/min [2025-10-09T21:19:32.007162] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-09T21:19:32.149180] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:19:32.149388] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-09T21:19:32.149444] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-09T21:19:32.149597] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-09T21:19:32.149691] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-09T21:19:32.149761] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-09T21:19:32.149804] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-09T21:19:32.561510] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:19:32.796789] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-09T21:19:33.596740] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-09T21:19:33.644591] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T21:19:34.384294] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T21:19:34.404059] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-09T21:19:34.435091] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T21:19:34.923596] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T21:19:35.196744] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-09T21:19:35.996732] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-09T21:19:36.391516] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T21:19:36.540304] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T21:19:36.796732] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-09T21:19:37.328286] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T21:19:37.596724] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-09T21:19:38.396759] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-09T21:19:38.996321] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T21:19:39.196695] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-09T21:19:39.996704] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-09T21:19:40.180919] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T21:19:40.216499] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T21:19:40.525169] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T21:19:40.796725] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-09T21:19:41.596683] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-09T21:19:41.725158] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T21:19:42.396768] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-09T21:19:42.891121] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T21:19:43.196707] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-09T21:19:43.963018] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T21:19:43.986763] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T21:19:43.996675] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-09T21:19:44.796720] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-09T21:19:45.215612] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T21:19:45.336513] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T21:19:45.596721] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-09T21:19:46.396710] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-09T21:19:46.854147] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T21:19:47.196707] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-09T21:19:47.566187] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-09T21:19:47.749282] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T21:19:47.996719] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-09T21:19:48.796725] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-09T21:19:49.596734] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-09T21:19:50.033119] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T21:19:50.286996] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T21:19:50.333726] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T21:19:50.396714] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-09T21:19:50.661518] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-09T21:19:50.663614] [INFO ] [REMOTE ] RVT: Full fetch complete (39014 records). [2025-10-09T21:19:50.663725] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-09T21:19:50.664221] [FATAL] [VALIDATOR ] RVT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:19:50.664306] [FATAL] [MAIN ] RVT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:19:50.664349] [WARN ] [MAIN ] RVT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:19:50.664421] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-09T21:19:50.664482] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-09T21:19:50.664517] [INFO ] [LOCAL ] RVT: Starting deletion of derivative data. [2025-10-09T21:19:50.664906] [DEBUG] [LOCAL ] RVT: Deleted derivative data file. [2025-10-09T21:19:50.664998] [INFO ] [MAIN ] Update Progress: 1845/2373 symbols completed. RVT took 35.9s. Estimated remaining: 1h 14m 21s. Rate: 7.1 symbols/min [2025-10-09T21:19:50.838077] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:19:50.838261] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-09T21:19:50.838296] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-09T21:19:50.838406] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-09T21:19:50.838447] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-09T21:19:50.838487] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-09T21:19:50.838518] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-09T21:19:51.190105] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:19:51.196661] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-09T21:19:51.666261] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-09T21:19:51.996750] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-09T21:19:52.796735] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-09T21:19:53.484669] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T21:19:53.596798] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-09T21:19:53.790917] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T21:19:54.396722] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-09T21:19:55.007001] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T21:19:55.196793] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-09T21:19:55.274357] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T21:19:55.996701] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-09T21:19:56.091224] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T21:19:56.680441] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T21:19:56.796718] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-09T21:19:57.004215] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-09T21:19:57.005197] [INFO ] [REMOTE ] RWTN: Full fetch complete (3129 records). [2025-10-09T21:19:57.005282] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-09T21:19:57.005761] [FATAL] [VALIDATOR ] RWTN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:19:57.005865] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:19:57.005920] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:19:57.006006] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-09T21:19:57.006100] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-09T21:19:57.006150] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-09T21:19:57.006239] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-09T21:19:57.006391] [INFO ] [MAIN ] Update Progress: 1846/2373 symbols completed. RWTN took 25.1s. Estimated remaining: 1h 14m 12s. Rate: 7.1 symbols/min [2025-10-09T21:19:57.197410] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:19:57.197599] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-09T21:19:57.197639] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-09T21:19:57.197808] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-09T21:19:57.197898] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-09T21:19:57.197964] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-09T21:19:57.197998] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-09T21:19:57.561958] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:19:57.596708] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-09T21:19:57.952248] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:19:57.952563] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-09T21:19:57.952690] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:19:57.952745] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-09T21:19:57.952781] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:19:57.952832] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-09T21:19:57.952910] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-09T21:19:57.952947] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-09T21:19:57.952987] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-09T21:19:57.953034] [INFO ] [MAIN ] Update Progress: 1847/2373 symbols completed. RWTP took 0.9s. Estimated remaining: 1h 14m 1s. Rate: 7.1 symbols/min [2025-10-09T21:19:58.125982] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:19:58.126174] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-09T21:19:58.126213] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-09T21:19:58.126325] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-09T21:19:58.126367] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-09T21:19:58.126410] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-09T21:19:58.126443] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-09T21:19:58.401902] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-09T21:19:58.494870] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:19:59.196712] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-09T21:19:59.771355] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T21:19:59.996742] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-09T21:20:00.208231] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T21:20:00.300516] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T21:20:00.304853] [INFO ] [REMOTE ] RWT: Full fetch complete (58151 records). [2025-10-09T21:20:00.305035] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-09T21:20:00.306021] [FATAL] [VALIDATOR ] RWT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:20:00.306137] [FATAL] [MAIN ] RWT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:20:00.306192] [WARN ] [MAIN ] RWT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:20:00.306272] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-09T21:20:00.306376] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-09T21:20:00.306432] [INFO ] [LOCAL ] RWT: Starting deletion of derivative data. [2025-10-09T21:20:00.306551] [DEBUG] [LOCAL ] RWT: No derivative data file found to delete. [2025-10-09T21:20:00.306674] [INFO ] [MAIN ] Update Progress: 1848/2373 symbols completed. RWT took 35.8s. Estimated remaining: 1h 13m 51s. Rate: 7.1 symbols/min [2025-10-09T21:20:00.510029] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:20:00.510241] [DEBUG] [LOCAL ] RY: No existing data file found in primary storage. [2025-10-09T21:20:00.510281] [WARN ] [MAIN ] RY: No existing data found, performing full refresh instead. [2025-10-09T21:20:00.510396] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-09T21:20:00.510440] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-09T21:20:00.510483] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-09T21:20:00.510517] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-09T21:20:00.797961] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-09T21:20:00.878047] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:20:01.579587] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T21:20:01.596671] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-09T21:20:02.204746] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T21:20:02.396776] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-09T21:20:03.196783] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-09T21:20:03.622406] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T21:20:03.996734] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-09T21:20:04.796731] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-09T21:20:04.958031] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T21:20:05.351094] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T21:20:05.597479] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T21:20:05.597604] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-09T21:20:06.396744] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-09T21:20:07.196793] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-09T21:20:07.263395] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T21:20:07.996798] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-09T21:20:08.030501] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T21:20:08.496940] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T21:20:08.796733] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-09T21:20:08.962418] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T21:20:09.596741] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-09T21:20:09.988157] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T21:20:10.396751] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-09T21:20:10.957066] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T21:20:11.196682] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-09T21:20:11.369214] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T21:20:11.892332] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T21:20:11.896236] [INFO ] [REMOTE ] RVTY: Full fetch complete (66693 records). [2025-10-09T21:20:11.896334] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-09T21:20:11.897025] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:20:11.897113] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:20:11.897155] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:20:11.897194] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-09T21:20:11.897247] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-09T21:20:11.897295] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-09T21:20:11.897362] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-09T21:20:11.897418] [INFO ] [MAIN ] Update Progress: 1849/2373 symbols completed. RVTY took 50.6s. Estimated remaining: 1h 13m 43s. Rate: 7.1 symbols/min [2025-10-09T21:20:11.999053] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-09T21:20:12.071160] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:20:12.071324] [DEBUG] [LOCAL ] RYAM: No existing data file found in primary storage. [2025-10-09T21:20:12.071361] [WARN ] [MAIN ] RYAM: No existing data found, performing full refresh instead. [2025-10-09T21:20:12.071474] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-09T21:20:12.071515] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-09T21:20:12.071556] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-09T21:20:12.071588] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-09T21:20:12.436817] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:20:12.796786] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-09T21:20:13.596712] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-09T21:20:13.814983] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T21:20:14.396784] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-09T21:20:14.595041] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T21:20:14.631286] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T21:20:15.196731] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-09T21:20:15.964445] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T21:20:15.996684] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-09T21:20:16.590500] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T21:20:16.796766] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-09T21:20:17.478824] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T21:20:17.596697] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-09T21:20:17.933718] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T21:20:18.396697] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-09T21:20:18.983400] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T21:20:19.196688] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-09T21:20:19.606795] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T21:20:19.996781] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-09T21:20:20.796763] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-09T21:20:21.009629] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T21:20:21.322305] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T21:20:21.354225] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T21:20:21.596725] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-09T21:20:22.396759] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-09T21:20:23.196697] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-09T21:20:23.247364] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T21:20:23.381186] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T21:20:23.630666] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T21:20:23.996727] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-09T21:20:24.796719] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-09T21:20:25.603069] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-09T21:20:25.621031] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T21:20:25.808780] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-09T21:20:25.809624] [INFO ] [REMOTE ] RWTO: Full fetch complete (4826 records). [2025-10-09T21:20:25.809717] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-09T21:20:25.810072] [FATAL] [VALIDATOR ] RWTO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:20:25.810153] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:20:25.810197] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:20:25.810269] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-09T21:20:25.810362] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-09T21:20:25.810426] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-09T21:20:25.810486] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-09T21:20:25.810560] [INFO ] [MAIN ] Update Progress: 1850/2373 symbols completed. RWTO took 35.1s. Estimated remaining: 1h 13m 36s. Rate: 7.1 symbols/min [2025-10-09T21:20:25.977488] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:20:26.033403] [DEBUG] [LOCAL ] RYAN: Loaded 44657 existing records from primary storage. [2025-10-09T21:20:26.033926] [INFO ] [MAIN ] RYAN: Loaded 44657 existing records. [2025-10-09T21:20:26.228553] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:20:26.236738] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-09T21:20:26.248987] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-09T21:20:26.250517] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T21:20:26.258145] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-09T21:20:26.258541] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-09T21:20:26.406721] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-09T21:20:26.707637] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:20:27.196710] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-09T21:20:27.996700] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-09T21:20:28.214546] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T21:20:28.694618] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T21:20:28.796734] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-09T21:20:28.962273] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T21:20:29.596768] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-09T21:20:30.396742] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-09T21:20:30.610667] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T21:20:31.053060] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T21:20:31.196722] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-09T21:20:31.996750] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-09T21:20:32.099427] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T21:20:32.141049] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T21:20:32.796758] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-09T21:20:33.360123] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T21:20:33.596800] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-09T21:20:34.223843] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T21:20:34.396776] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-09T21:20:34.842196] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T21:20:34.945083] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T21:20:35.196707] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-09T21:20:35.663852] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T21:20:35.667684] [INFO ] [REMOTE ] RXO: Full fetch complete (68123 records). [2025-10-09T21:20:35.667809] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-09T21:20:35.668564] [FATAL] [VALIDATOR ] RXO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:20:35.668708] [FATAL] [MAIN ] RXO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:20:35.668783] [WARN ] [MAIN ] RXO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:20:35.668854] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-09T21:20:35.668939] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-09T21:20:35.669003] [INFO ] [LOCAL ] RXO: Starting deletion of derivative data. [2025-10-09T21:20:35.669050] [DEBUG] [LOCAL ] RXO: No derivative data file found to delete. [2025-10-09T21:20:35.669135] [INFO ] [MAIN ] Update Progress: 1851/2373 symbols completed. RXO took 37.7s. Estimated remaining: 1h 13m 28s. Rate: 7.1 symbols/min [2025-10-09T21:20:35.844459] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:20:35.866232] [DEBUG] [LOCAL ] RYI: Loaded 21603 existing records from primary storage. [2025-10-09T21:20:35.866490] [INFO ] [MAIN ] RYI: Loaded 21603 existing records. [2025-10-09T21:20:36.010013] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-09T21:20:36.054042] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:20:36.054349] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-09T21:20:36.054398] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-09T21:20:36.054626] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-09T21:20:36.054719] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-09T21:20:36.424303] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:20:36.796741] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-09T21:20:37.596803] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-09T21:20:37.745465] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T21:20:38.189542] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T21:20:38.195034] [INFO ] [REMOTE ] RY: Full fetch complete (68589 records). [2025-10-09T21:20:38.195346] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-09T21:20:38.196679] [FATAL] [VALIDATOR ] RY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T21:20:38.196805] [FATAL] [MAIN ] RY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:20:38.196864] [WARN ] [MAIN ] RY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:20:38.196957] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-09T21:20:38.197064] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-09T21:20:38.197129] [INFO ] [LOCAL ] RY: Starting deletion of derivative data. [2025-10-09T21:20:38.197220] [DEBUG] [LOCAL ] RY: No derivative data file found to delete. [2025-10-09T21:20:38.197358] [INFO ] [MAIN ] Update Progress: 1852/2373 symbols completed. RY took 37.9s. Estimated remaining: 1h 13m 18s. Rate: 7.1 symbols/min [2025-10-09T21:20:38.400002] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-09T21:20:38.399906] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:20:38.443225] [DEBUG] [LOCAL ] RYN: Loaded 45442 existing records from primary storage. [2025-10-09T21:20:38.443680] [INFO ] [MAIN ] RYN: Loaded 45442 existing records. [2025-10-09T21:20:38.645403] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T21:20:38.689930] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:20:38.690598] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-09T21:20:38.690723] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-09T21:20:38.691005] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-09T21:20:38.691064] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-09T21:20:39.045764] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:20:39.196692] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-09T21:20:39.495894] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T21:20:39.996740] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-09T21:20:40.685508] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T21:20:40.762613] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T21:20:40.796674] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-09T21:20:41.596729] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-09T21:20:42.009011] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T21:20:42.012242] [INFO ] [REMOTE ] RYAM: Full fetch complete (49068 records). [2025-10-09T21:20:42.012344] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-09T21:20:42.388007] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-09T21:20:42.388098] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-09T21:20:42.389063] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-09T21:20:42.389128] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-09T21:20:42.390228] [DEBUG] [LOCAL ] RYAM: Trimmed 49068 records to 35363 (keeping 200 days of data) [2025-10-09T21:20:42.436077] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-09T21:20:42.618229] [DEBUG] [LOCAL ] RYAM: Primary data saved (35363 records). [2025-10-09T21:20:42.618443] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-09T21:20:42.618526] [INFO ] [MAIN ] Update Progress: 1853/2373 symbols completed. RYAM took 30.7s. Estimated remaining: 1h 13m 9s. Rate: 7.1 symbols/min [2025-10-09T21:20:42.799441] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:20:42.810926] [DEBUG] [LOCAL ] RZB: Loaded 6038 existing records from primary storage. [2025-10-09T21:20:42.811171] [INFO ] [MAIN ] RZB: Loaded 6038 existing records. [2025-10-09T21:20:42.983683] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T21:20:43.034407] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:20:43.034684] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-09T21:20:43.034745] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-09T21:20:43.034938] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-09T21:20:43.034997] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-09T21:20:43.196772] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-09T21:20:43.399169] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:20:43.996746] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-09T21:20:44.123526] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T21:20:44.465247] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-09T21:20:44.517910] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T21:20:44.796713] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-09T21:20:45.392752] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T21:20:45.596747] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-09T21:20:46.396732] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-09T21:20:47.091926] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T21:20:47.196716] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-09T21:20:47.467843] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T21:20:47.753011] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T21:20:47.996770] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-09T21:20:48.796776] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-09T21:20:49.157806] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T21:20:49.596711] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-09T21:20:50.191171] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T21:20:50.396751] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-09T21:20:51.198161] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T21:20:51.196690] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-09T21:20:51.999859] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-09T21:20:52.005600] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T21:20:52.387825] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T21:20:52.397507] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-09T21:20:52.796748] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-09T21:20:53.596726] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-09T21:20:53.633138] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T21:20:53.937883] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-09T21:20:54.396727] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-09T21:20:55.196758] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-09T21:20:55.918018] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T21:20:55.996708] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-09T21:20:56.743230] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T21:20:56.796672] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-09T21:20:57.575093] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T21:20:57.596716] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-09T21:20:58.396698] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-09T21:20:58.619183] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T21:20:59.141532] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T21:20:59.192586] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T21:20:59.196872] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-09T21:20:59.948523] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T21:20:59.996673] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-09T21:21:00.796720] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-09T21:21:01.002500] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T21:21:01.596748] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-09T21:21:02.146686] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T21:21:02.150933] [INFO ] [REMOTE ] RYAN: Full fetch complete (64244 records). [2025-10-09T21:21:02.151045] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-09T21:21:02.397427] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-09T21:21:02.556896] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-09T21:21:02.556993] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-09T21:21:02.557981] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-09T21:21:02.558048] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-09T21:21:02.559394] [DEBUG] [LOCAL ] RYAN: Trimmed 64244 records to 45041 (keeping 200 days of data) [2025-10-09T21:21:02.692178] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T21:21:02.861298] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T21:21:02.878459] [DEBUG] [LOCAL ] RYAN: Primary data saved (45041 records). [2025-10-09T21:21:02.878604] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-09T21:21:02.878730] [INFO ] [MAIN ] Update Progress: 1854/2373 symbols completed. RYAN took 37.1s. Estimated remaining: 1h 13m 4s. Rate: 7.1 symbols/min [2025-10-09T21:21:03.055298] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:21:03.067215] [DEBUG] [LOCAL ] RZC: Loaded 6781 existing records from primary storage. [2025-10-09T21:21:03.067467] [INFO ] [MAIN ] RZC: Loaded 6781 existing records. [2025-10-09T21:21:03.203144] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-09T21:21:03.244708] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:21:03.244938] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-09T21:21:03.245024] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-09T21:21:03.245237] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-09T21:21:03.245296] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-09T21:21:03.599666] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:21:03.996737] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-09T21:21:04.796702] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-09T21:21:04.897938] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T21:21:05.022483] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T21:21:05.370757] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T21:21:05.596718] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-09T21:21:06.330669] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T21:21:06.332775] [INFO ] [REMOTE ] RYI: Full fetch complete (32090 records). [2025-10-09T21:21:06.332846] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-09T21:21:06.401891] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-09T21:21:06.701945] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-09T21:21:06.702022] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-09T21:21:06.702679] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-09T21:21:06.702740] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-09T21:21:06.703455] [DEBUG] [LOCAL ] RYI: Trimmed 32090 records to 21708 (keeping 200 days of data) [2025-10-09T21:21:06.847330] [DEBUG] [LOCAL ] RYI: Primary data saved (21708 records). [2025-10-09T21:21:06.847464] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-09T21:21:06.847559] [INFO ] [MAIN ] Update Progress: 1855/2373 symbols completed. RYI took 31.2s. Estimated remaining: 1h 12m 54s. Rate: 7.1 symbols/min [2025-10-09T21:21:07.020799] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:21:07.109894] [DEBUG] [LOCAL ] S: Loaded 53532 existing records from primary storage. [2025-10-09T21:21:07.110239] [INFO ] [MAIN ] S: Loaded 53532 existing records. [2025-10-09T21:21:07.201901] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-09T21:21:07.306717] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:21:07.307143] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-09T21:21:07.307229] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-09T21:21:07.307510] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-09T21:21:07.307569] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-09T21:21:07.494106] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T21:21:07.684560] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:21:07.996763] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-09T21:21:08.048877] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T21:21:08.796756] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-09T21:21:09.360973] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T21:21:09.596737] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-09T21:21:10.222823] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-09T21:21:10.313543] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T21:21:10.396794] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-09T21:21:10.966424] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T21:21:11.196810] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-09T21:21:11.996786] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-09T21:21:12.596206] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T21:21:12.745040] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T21:21:12.796783] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-09T21:21:13.596762] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-09T21:21:14.396721] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-09T21:21:14.635733] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T21:21:15.141862] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T21:21:15.156745] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T21:21:15.196707] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-09T21:21:15.983325] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T21:21:15.996698] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-09T21:21:16.796720] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-09T21:21:17.596740] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-09T21:21:18.396748] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-09T21:21:18.755186] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T21:21:18.755079] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-09T21:21:18.765879] [INFO ] [REMOTE ] RZB: Full fetch complete (8528 records). [2025-10-09T21:21:18.766121] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-09T21:21:19.058058] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T21:21:19.087924] [INFO ] [REMOTE ] RYN: Full fetch complete (65075 records). [2025-10-09T21:21:19.112598] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-09T21:21:19.213334] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-09T21:21:19.246854] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-09T21:21:19.246956] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-09T21:21:19.247175] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-09T21:21:19.247472] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-09T21:21:19.306963] [DEBUG] [LOCAL ] RZB: Trimmed 8528 records to 6067 (keeping 200 days of data) [2025-10-09T21:21:19.579237] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-09T21:21:19.579878] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-09T21:21:19.581759] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-09T21:21:19.582136] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-09T21:21:19.586056] [DEBUG] [LOCAL ] RZB: Primary data saved (6067 records). [2025-10-09T21:21:19.586322] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-09T21:21:19.586530] [INFO ] [MAIN ] Update Progress: 1856/2373 symbols completed. RZB took 37.0s. Estimated remaining: 1h 12m 47s. Rate: 7.1 symbols/min [2025-10-09T21:21:19.598164] [DEBUG] [LOCAL ] RYN: Trimmed 65075 records to 45758 (keeping 200 days of data) [2025-10-09T21:21:19.851714] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:21:19.907886] [DEBUG] [LOCAL ] SA: Loaded 43887 existing records from primary storage. [2025-10-09T21:21:19.969051] [INFO ] [MAIN ] SA: Loaded 43887 existing records. [2025-10-09T21:21:20.181390] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:21:20.182850] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-09T21:21:20.182919] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-09T21:21:20.183529] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-09T21:21:20.183603] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-09T21:21:20.457555] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (4.46 seconds). [2025-10-09T21:21:20.474309] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-09T21:21:20.578145] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:21:20.620401] [DEBUG] [LOCAL ] RYN: Primary data saved (45758 records). [2025-10-09T21:21:20.620524] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-09T21:21:20.621095] [INFO ] [MAIN ] Update Progress: 1857/2373 symbols completed. RYN took 42.4s. Estimated remaining: 1h 12m 36s. Rate: 7.1 symbols/min [2025-10-09T21:21:20.792141] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:21:20.796695] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-09T21:21:20.804533] [DEBUG] [LOCAL ] SABA: Loaded 9280 existing records from primary storage. [2025-10-09T21:21:20.804742] [INFO ] [MAIN ] SABA: Loaded 9280 existing records. [2025-10-09T21:21:20.984305] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:21:20.984520] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-09T21:21:20.984566] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-09T21:21:20.984738] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-09T21:21:20.984814] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-09T21:21:21.278497] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T21:21:21.402997] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:21:21.405054] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-09T21:21:21.596754] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-09T21:21:21.982448] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T21:21:22.396763] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-09T21:21:23.196707] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-09T21:21:23.374349] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T21:21:23.676392] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T21:21:23.892457] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T21:21:23.996720] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-09T21:21:24.796748] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-09T21:21:25.152108] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T21:21:25.596741] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-09T21:21:25.660700] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T21:21:26.396740] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-09T21:21:27.142302] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T21:21:27.196729] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-09T21:21:27.692392] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-09T21:21:27.996683] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-09T21:21:28.212782] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T21:21:28.796764] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-09T21:21:29.307685] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T21:21:29.596856] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-09T21:21:30.209000] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T21:21:30.396724] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-09T21:21:30.859142] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-09T21:21:31.196726] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-09T21:21:31.695814] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T21:21:31.996712] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-09T21:21:32.504225] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T21:21:32.505297] [INFO ] [REMOTE ] RZC: Full fetch complete (9707 records). [2025-10-09T21:21:32.505372] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-09T21:21:32.797175] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-09T21:21:32.878694] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-09T21:21:32.878786] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-09T21:21:32.879030] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-09T21:21:32.879071] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-09T21:21:32.879500] [DEBUG] [LOCAL ] RZC: Trimmed 9707 records to 6815 (keeping 200 days of data) [2025-10-09T21:21:32.921691] [DEBUG] [LOCAL ] RZC: Primary data saved (6815 records). [2025-10-09T21:21:32.921804] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-09T21:21:32.921887] [INFO ] [MAIN ] Update Progress: 1858/2373 symbols completed. RZC took 30.0s. Estimated remaining: 1h 12m 29s. Rate: 7.1 symbols/min [2025-10-09T21:21:33.091529] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:21:33.124631] [DEBUG] [LOCAL ] SAFE: Loaded 30306 existing records from primary storage. [2025-10-09T21:21:33.124936] [INFO ] [MAIN ] SAFE: Loaded 30306 existing records. [2025-10-09T21:21:33.309986] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:21:33.310264] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-09T21:21:33.310338] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-09T21:21:33.311037] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-09T21:21:33.311100] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-09T21:21:33.605710] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-09T21:21:33.636003] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-09T21:21:33.692627] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T21:21:33.740358] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:21:34.396731] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-09T21:21:35.196729] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-09T21:21:35.270936] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T21:21:35.982257] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T21:21:35.996667] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-09T21:21:36.387565] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T21:21:36.738872] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T21:21:36.796683] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-09T21:21:37.596729] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-09T21:21:38.078617] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T21:21:38.384199] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T21:21:38.396665] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-09T21:21:39.196732] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-09T21:21:39.713352] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T21:21:39.934578] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T21:21:39.996694] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-09T21:21:40.796739] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-09T21:21:41.177306] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T21:21:41.272171] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T21:21:41.596714] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-09T21:21:42.396688] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-09T21:21:42.469720] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T21:21:43.196708] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-09T21:21:43.996759] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-09T21:21:44.087370] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T21:21:44.297599] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T21:21:44.772220] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T21:21:44.796744] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-09T21:21:45.507532] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T21:21:45.596728] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-09T21:21:46.396683] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-09T21:21:46.460636] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T21:21:47.196724] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-09T21:21:47.996820] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-09T21:21:48.207638] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T21:21:48.562339] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:21:48.564779] [INFO ] [REMOTE ] SABA: Full fetch complete (15286 records). [2025-10-09T21:21:48.584133] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-09T21:21:48.585572] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T21:21:48.801978] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-09T21:21:48.992554] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-09T21:21:48.992689] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-09T21:21:48.993278] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-09T21:21:48.993363] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-09T21:21:48.994097] [DEBUG] [LOCAL ] SABA: Trimmed 15286 records to 9341 (keeping 200 days of data) [2025-10-09T21:21:49.057540] [DEBUG] [LOCAL ] SABA: Primary data saved (9341 records). [2025-10-09T21:21:49.057836] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-09T21:21:49.057958] [INFO ] [MAIN ] Update Progress: 1859/2373 symbols completed. SABA took 28.4s. Estimated remaining: 1h 12m 22s. Rate: 7.1 symbols/min [2025-10-09T21:21:49.231869] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:21:49.257311] [DEBUG] [LOCAL ] SAH: Loaded 21601 existing records from primary storage. [2025-10-09T21:21:49.257701] [INFO ] [MAIN ] SAH: Loaded 21601 existing records. [2025-10-09T21:21:49.447232] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:21:49.447470] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-09T21:21:49.447540] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-09T21:21:49.447824] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-09T21:21:49.447881] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-09T21:21:49.597748] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-09T21:21:49.805776] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:21:50.396786] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-09T21:21:51.083660] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-09T21:21:51.196725] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-09T21:21:51.283945] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T21:21:51.288198] [INFO ] [REMOTE ] SA: Full fetch complete (62794 records). [2025-10-09T21:21:51.288296] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-09T21:21:51.410482] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T21:21:51.685541] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-09T21:21:51.685624] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-09T21:21:51.686664] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-09T21:21:51.686730] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-09T21:21:51.688074] [DEBUG] [LOCAL ] SA: Trimmed 62794 records to 44266 (keeping 200 days of data) [2025-10-09T21:21:51.953346] [DEBUG] [LOCAL ] SA: Primary data saved (44266 records). [2025-10-09T21:21:51.953491] [INFO ] [MAIN ] SA: Full history saved. [2025-10-09T21:21:51.953590] [INFO ] [MAIN ] Update Progress: 1860/2373 symbols completed. SA took 32.4s. Estimated remaining: 1h 12m 12s. Rate: 7.1 symbols/min [2025-10-09T21:21:52.001922] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-09T21:21:52.140301] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:21:52.140462] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-09T21:21:52.140519] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-09T21:21:52.140749] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-09T21:21:52.140807] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-09T21:21:52.140851] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-09T21:21:52.140883] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-09T21:21:52.544829] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:21:52.796685] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-09T21:21:53.125349] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-09T21:21:53.160893] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T21:21:53.166107] [INFO ] [REMOTE ] S: Full fetch complete (77544 records). [2025-10-09T21:21:53.166307] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-09T21:21:53.475084] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:21:53.610696] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-09T21:21:53.615623] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-09T21:21:53.615754] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-09T21:21:53.616856] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-09T21:21:53.617016] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-09T21:21:53.618781] [DEBUG] [LOCAL ] S: Trimmed 77544 records to 53920 (keeping 200 days of data) [2025-10-09T21:21:53.948943] [DEBUG] [LOCAL ] S: Primary data saved (53920 records). [2025-10-09T21:21:53.949093] [INFO ] [MAIN ] S: Full history saved. [2025-10-09T21:21:53.949189] [INFO ] [MAIN ] Update Progress: 1861/2373 symbols completed. S took 47.1s. Estimated remaining: 1h 12m 2s. Rate: 7.1 symbols/min [2025-10-09T21:21:54.026216] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T21:21:54.121113] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:21:54.143022] [DEBUG] [LOCAL ] SAM: Loaded 21350 existing records from primary storage. [2025-10-09T21:21:54.143272] [INFO ] [MAIN ] SAM: Loaded 21350 existing records. [2025-10-09T21:21:54.319357] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:21:54.319572] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-09T21:21:54.319620] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-09T21:21:54.319891] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-09T21:21:54.319948] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-09T21:21:54.401926] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-09T21:21:54.674151] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:21:54.755546] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T21:21:55.196691] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-09T21:21:55.439465] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-09T21:21:55.996726] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-09T21:21:56.796725] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-09T21:21:57.095726] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T21:21:57.596702] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-09T21:21:57.875483] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T21:21:57.925494] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-09T21:21:58.396714] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-09T21:21:58.745685] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-09T21:21:59.196785] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-09T21:21:59.996779] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-09T21:22:00.333607] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T21:22:00.377168] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-09T21:22:00.796745] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-09T21:22:01.596728] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-09T21:22:01.937367] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T21:22:02.057557] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T21:22:02.396755] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-09T21:22:03.196743] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-09T21:22:03.346737] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T21:22:03.996778] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-09T21:22:04.254290] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T21:22:04.796748] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-09T21:22:05.006056] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T21:22:05.131526] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-09T21:22:05.596782] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-09T21:22:06.006890] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-09T21:22:06.396740] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-09T21:22:07.174927] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T21:22:07.196706] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-09T21:22:07.996760] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-09T21:22:08.207140] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T21:22:08.796749] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-09T21:22:09.318794] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T21:22:09.596722] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-09T21:22:09.824722] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T21:22:09.847446] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-09T21:22:09.848098] [INFO ] [REMOTE ] SAJ: Full fetch complete (922 records). [2025-10-09T21:22:09.848166] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-09T21:22:10.027835] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-09T21:22:10.028038] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:22:10.028083] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:22:10.028122] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-09T21:22:10.028178] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-09T21:22:10.028233] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-09T21:22:10.028290] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-09T21:22:10.028374] [INFO ] [MAIN ] Update Progress: 1862/2373 symbols completed. SAJ took 18.1s. Estimated remaining: 1h 11m 56s. Rate: 7.1 symbols/min [2025-10-09T21:22:10.197930] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:22:10.246342] [DEBUG] [LOCAL ] SAN: Loaded 52980 existing records from primary storage. [2025-10-09T21:22:10.246672] [INFO ] [MAIN ] SAN: Loaded 52980 existing records. [2025-10-09T21:22:10.403762] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-09T21:22:10.423164] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:22:10.424362] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-09T21:22:10.424417] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-09T21:22:10.424817] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-09T21:22:10.424876] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-09T21:22:10.781665] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:22:11.196744] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-09T21:22:11.788052] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T21:22:11.996721] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-09T21:22:12.588870] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T21:22:12.671847] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T21:22:12.796773] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-09T21:22:13.596682] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-09T21:22:13.950322] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T21:22:14.396725] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-09T21:22:15.143288] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T21:22:15.196669] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-09T21:22:15.431938] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T21:22:15.892787] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T21:22:15.895156] [INFO ] [REMOTE ] SAH: Full fetch complete (30644 records). [2025-10-09T21:22:15.895261] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-09T21:22:15.997169] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-09T21:22:16.262392] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-09T21:22:16.262467] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-09T21:22:16.263083] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-09T21:22:16.263144] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-09T21:22:16.263846] [DEBUG] [LOCAL ] SAH: Trimmed 30644 records to 21703 (keeping 200 days of data) [2025-10-09T21:22:16.401155] [DEBUG] [LOCAL ] SAH: Primary data saved (21703 records). [2025-10-09T21:22:16.401283] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-09T21:22:16.401399] [INFO ] [MAIN ] Update Progress: 1863/2373 symbols completed. SAH took 27.3s. Estimated remaining: 1h 11m 47s. Rate: 7.1 symbols/min [2025-10-09T21:22:16.566009] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:22:16.618254] [DEBUG] [LOCAL ] SAND: Loaded 51820 existing records from primary storage. [2025-10-09T21:22:16.618569] [INFO ] [MAIN ] SAND: Loaded 51820 existing records. [2025-10-09T21:22:16.794212] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:22:16.794388] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-09T21:22:16.794436] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-09T21:22:16.794619] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-09T21:22:16.794699] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-09T21:22:16.805691] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-09T21:22:17.151719] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:22:17.194335] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T21:22:17.596728] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-09T21:22:18.396755] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-09T21:22:18.604218] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T21:22:18.647980] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T21:22:19.196689] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-09T21:22:19.433592] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T21:22:19.996737] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-09T21:22:20.352405] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T21:22:20.796722] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-09T21:22:21.598419] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-09T21:22:21.604158] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T21:22:21.661506] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T21:22:21.664161] [INFO ] [REMOTE ] SAFE: Full fetch complete (44806 records). [2025-10-09T21:22:21.664254] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-09T21:22:22.032246] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-09T21:22:22.032329] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-09T21:22:22.033176] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-09T21:22:22.033241] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-09T21:22:22.034256] [DEBUG] [LOCAL ] SAFE: Trimmed 44806 records to 30510 (keeping 200 days of data) [2025-10-09T21:22:22.228740] [DEBUG] [LOCAL ] SAFE: Primary data saved (30510 records). [2025-10-09T21:22:22.228896] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-09T21:22:22.228989] [INFO ] [MAIN ] Update Progress: 1864/2373 symbols completed. SAFE took 49.3s. Estimated remaining: 1h 11m 38s. Rate: 7.1 symbols/min [2025-10-09T21:22:22.410772] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-09T21:22:22.414569] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:22:22.465594] [DEBUG] [LOCAL ] SAP: Loaded 49897 existing records from primary storage. [2025-10-09T21:22:22.465936] [INFO ] [MAIN ] SAP: Loaded 49897 existing records. [2025-10-09T21:22:22.640316] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:22:22.640509] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-09T21:22:22.640555] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-09T21:22:22.640805] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-09T21:22:22.640889] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-09T21:22:22.998937] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:22:23.196690] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-09T21:22:23.306270] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T21:22:23.996709] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-09T21:22:24.371130] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T21:22:24.733745] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T21:22:24.796717] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-09T21:22:25.596765] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-09T21:22:25.766965] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T21:22:26.396754] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-09T21:22:26.621417] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T21:22:26.652020] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T21:22:27.196728] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-09T21:22:27.718076] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T21:22:27.996738] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-09T21:22:28.706917] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T21:22:28.796738] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-09T21:22:29.596765] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-09T21:22:29.725123] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T21:22:30.396676] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-09T21:22:30.471489] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T21:22:30.481530] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T21:22:31.196741] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-09T21:22:31.996685] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-09T21:22:32.229276] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T21:22:32.276957] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T21:22:32.796733] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-09T21:22:33.596735] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-09T21:22:33.701377] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T21:22:34.396694] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-09T21:22:34.482935] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T21:22:34.485217] [INFO ] [REMOTE ] SAM: Full fetch complete (30990 records). [2025-10-09T21:22:34.485314] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-09T21:22:34.869556] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-09T21:22:34.869767] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-09T21:22:34.870510] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-09T21:22:34.870592] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-09T21:22:34.871773] [DEBUG] [LOCAL ] SAM: Trimmed 30990 records to 21510 (keeping 200 days of data) [2025-10-09T21:22:35.004597] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-09T21:22:35.077678] [DEBUG] [LOCAL ] SAM: Primary data saved (21510 records). [2025-10-09T21:22:35.077867] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-09T21:22:35.077985] [INFO ] [MAIN ] Update Progress: 1865/2373 symbols completed. SAM took 41.1s. Estimated remaining: 1h 11m 30s. Rate: 7.1 symbols/min [2025-10-09T21:22:35.202728] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-09T21:22:35.278092] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:22:35.296460] [DEBUG] [LOCAL ] SAR: Loaded 16872 existing records from primary storage. [2025-10-09T21:22:35.296725] [INFO ] [MAIN ] SAR: Loaded 16872 existing records. [2025-10-09T21:22:35.468413] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:22:35.468699] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-09T21:22:35.468827] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-09T21:22:35.469041] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-09T21:22:35.469098] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-09T21:22:35.825530] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:22:35.869716] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T21:22:35.996689] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-09T21:22:36.796753] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-09T21:22:37.071927] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T21:22:37.567127] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T21:22:37.591196] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T21:22:37.596664] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-09T21:22:38.396760] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-09T21:22:39.196813] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-09T21:22:39.333618] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T21:22:39.996712] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-09T21:22:40.064613] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-09T21:22:40.332008] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T21:22:40.796730] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-09T21:22:41.349333] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T21:22:41.382867] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T21:22:41.596718] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-09T21:22:42.396719] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-09T21:22:43.196763] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-09T21:22:43.301757] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T21:22:43.996735] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-09T21:22:44.415242] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T21:22:44.758602] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T21:22:44.796665] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-09T21:22:44.966565] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T21:22:45.596722] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-09T21:22:46.330123] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T21:22:46.396734] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-09T21:22:46.638142] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T21:22:47.196732] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-09T21:22:47.556582] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T21:22:47.996755] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-09T21:22:48.796752] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-09T21:22:48.919951] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T21:22:49.336969] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T21:22:49.341395] [INFO ] [REMOTE ] SAND: Full fetch complete (74468 records). [2025-10-09T21:22:49.341509] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-09T21:22:49.609526] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-09T21:22:49.751812] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-09T21:22:49.751902] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-09T21:22:49.753011] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-09T21:22:49.753076] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-09T21:22:49.754546] [DEBUG] [LOCAL ] SAND: Trimmed 74468 records to 52210 (keeping 200 days of data) [2025-10-09T21:22:50.108046] [DEBUG] [LOCAL ] SAND: Primary data saved (52210 records). [2025-10-09T21:22:50.108188] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-09T21:22:50.108838] [INFO ] [MAIN ] Update Progress: 1866/2373 symbols completed. SAND took 33.7s. Estimated remaining: 1h 11m 24s. Rate: 7.1 symbols/min [2025-10-09T21:22:50.281266] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:22:50.281491] [DEBUG] [LOCAL ] SARO: No existing data file found in primary storage. [2025-10-09T21:22:50.281551] [WARN ] [MAIN ] SARO: No existing data found, performing full refresh instead. [2025-10-09T21:22:50.281726] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-09T21:22:50.281878] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-09T21:22:50.281967] [DEBUG] [LOCAL ] SARO: No primary data file found to delete. [2025-10-09T21:22:50.282101] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-09T21:22:50.404717] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-09T21:22:50.521933] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T21:22:50.697296] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:22:51.196730] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-09T21:22:51.362684] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T21:22:51.542385] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T21:22:51.996724] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-09T21:22:52.796736] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-09T21:22:53.596788] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-09T21:23:06.017938] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (14.82 seconds). [2025-10-09T21:23:06.022680] [INFO ] [REMOTE ] SAN: Full fetch complete (76296 records). [2025-10-09T21:23:06.022793] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-09T21:23:06.449807] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (14.45 seconds). [2025-10-09T21:23:06.469907] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-09T21:23:06.478933] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-09T21:23:06.480668] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-09T21:23:06.481831] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-09T21:23:06.481760] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-09T21:23:06.484146] [DEBUG] [LOCAL ] SAN: Trimmed 76296 records to 53356 (keeping 200 days of data) [2025-10-09T21:23:06.743877] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (13.15 seconds). [2025-10-09T21:23:06.756812] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-09T21:23:06.848127] [DEBUG] [LOCAL ] SAN: Primary data saved (53356 records). [2025-10-09T21:23:06.859251] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-09T21:23:06.859927] [INFO ] [MAIN ] Update Progress: 1867/2373 symbols completed. SAN took 56.8s. Estimated remaining: 1h 11m 18s. Rate: 7.1 symbols/min [2025-10-09T21:23:06.860285] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (14.06 seconds). [2025-10-09T21:23:06.907898] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-09T21:23:07.033835] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:07.033957] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-09T21:23:07.033994] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-09T21:23:07.034101] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-09T21:23:07.034141] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-09T21:23:07.034181] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-09T21:23:07.034213] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-09T21:23:07.384378] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:07.384700] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-09T21:23:07.686784] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-09T21:23:07.687834] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-09T21:23:07.731441] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T21:23:07.735483] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-09T21:23:07.950521] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-09T21:23:07.951404] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-09T21:23:08.280164] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T21:23:08.289270] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-09T21:23:08.311712] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-09T21:23:08.312984] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-09T21:23:08.578786] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-09T21:23:08.579920] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-09T21:23:08.625358] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T21:23:08.637128] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-09T21:23:08.659480] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T21:23:08.663878] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-09T21:23:08.848372] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-09T21:23:08.849482] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-09T21:23:09.169277] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-09T21:23:09.170466] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-09T21:23:09.430602] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-09T21:23:09.431603] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-09T21:23:09.601338] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T21:23:09.615965] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T21:23:09.615674] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-09T21:23:09.619490] [INFO ] [REMOTE ] SAR: Full fetch complete (23462 records). [2025-10-09T21:23:09.619568] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-09T21:23:09.867874] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T21:23:09.885099] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-09T21:23:09.990617] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-09T21:23:09.990781] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-09T21:23:09.991304] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-09T21:23:09.991346] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-09T21:23:09.992056] [DEBUG] [LOCAL ] SAR: Trimmed 23462 records to 17116 (keeping 200 days of data) [2025-10-09T21:23:10.103772] [DEBUG] [LOCAL ] SAR: Primary data saved (17116 records). [2025-10-09T21:23:10.103912] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-09T21:23:10.103997] [INFO ] [MAIN ] Update Progress: 1868/2373 symbols completed. SAR took 35.0s. Estimated remaining: 1h 11m 8s. Rate: 7.1 symbols/min [2025-10-09T21:23:10.290469] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:10.288222] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T21:23:10.290801] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-09T21:23:10.294690] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-09T21:23:10.294949] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-09T21:23:10.295018] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-09T21:23:10.297584] [INFO ] [REMOTE ] SAP: Full fetch complete (71880 records). [2025-10-09T21:23:10.297817] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-09T21:23:10.299037] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-09T21:23:10.295108] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-09T21:23:10.299971] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-09T21:23:10.299149] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-09T21:23:10.774061] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T21:23:10.838416] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-09T21:23:11.028087] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:11.038717] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-09T21:23:11.121676] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-09T21:23:11.121787] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-09T21:23:11.122902] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-09T21:23:11.122969] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-09T21:23:11.125486] [DEBUG] [LOCAL ] SAP: Trimmed 71880 records to 50268 (keeping 200 days of data) [2025-10-09T21:23:11.194941] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T21:23:11.221675] [INFO ] [REMOTE ] SAT: Full fetch complete (1514 records). [2025-10-09T21:23:11.222989] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-09T21:23:11.479161] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-09T21:23:11.479391] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:23:11.479466] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:23:11.479668] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-09T21:23:11.479796] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-09T21:23:11.479856] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-09T21:23:11.479924] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-09T21:23:11.480023] [INFO ] [MAIN ] Update Progress: 1869/2373 symbols completed. SAT took 4.6s. Estimated remaining: 1h 10m 57s. Rate: 7.1 symbols/min [2025-10-09T21:23:11.540611] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-09T21:23:11.583785] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-09T21:23:11.646620] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T21:23:11.717349] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-09T21:23:11.750318] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:11.750827] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-09T21:23:11.750896] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-09T21:23:11.751147] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-09T21:23:11.751195] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-09T21:23:11.751237] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-09T21:23:11.751268] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-09T21:23:12.016968] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T21:23:12.023501] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-09T21:23:12.222108] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:12.317906] [DEBUG] [LOCAL ] SAP: Primary data saved (50268 records). [2025-10-09T21:23:12.318046] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-09T21:23:12.318148] [INFO ] [MAIN ] Update Progress: 1870/2373 symbols completed. SAP took 50.1s. Estimated remaining: 1h 10m 47s. Rate: 7.1 symbols/min [2025-10-09T21:23:12.426464] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-09T21:23:12.495730] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:12.529704] [DEBUG] [LOCAL ] SB: Loaded 33034 existing records from primary storage. [2025-10-09T21:23:12.529989] [INFO ] [MAIN ] SB: Loaded 33034 existing records. [2025-10-09T21:23:12.701374] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:23:12.701596] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-09T21:23:12.701664] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-09T21:23:12.701932] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-09T21:23:12.701989] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-09T21:23:12.798483] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-09T21:23:13.048105] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:13.501390] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T21:23:13.548129] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T21:23:13.596674] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-09T21:23:13.962310] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T21:23:14.396720] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-09T21:23:15.196717] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-09T21:23:15.619022] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T21:23:15.996789] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-09T21:23:16.084490] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T21:23:16.315626] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-09T21:23:16.796703] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-09T21:23:17.292969] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-09T21:23:17.596724] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-09T21:23:17.935425] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T21:23:18.396726] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-09T21:23:18.738808] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T21:23:19.196901] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-09T21:23:19.566794] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-09T21:23:19.996727] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-09T21:23:20.352501] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-09T21:23:20.796745] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-09T21:23:21.115453] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-09T21:23:21.596823] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-09T21:23:22.396737] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-09T21:23:22.660516] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-09T21:23:22.661223] [INFO ] [REMOTE ] SAY: Full fetch complete (1374 records). [2025-10-09T21:23:22.661290] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-09T21:23:22.848093] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-09T21:23:22.848258] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:23:22.848327] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:23:22.848399] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-09T21:23:22.848464] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-09T21:23:22.848501] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-09T21:23:22.848540] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-09T21:23:22.848611] [INFO ] [MAIN ] Update Progress: 1871/2373 symbols completed. SAY took 12.7s. Estimated remaining: 1h 10m 39s. Rate: 7.1 symbols/min [2025-10-09T21:23:23.020246] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:23.020416] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-09T21:23:23.020455] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-09T21:23:23.020590] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-09T21:23:23.020636] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-09T21:23:23.020724] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-09T21:23:23.020762] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-09T21:23:23.197866] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-09T21:23:23.418369] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:23.430167] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T21:23:23.547364] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-09T21:23:23.996762] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-09T21:23:24.796744] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-09T21:23:24.978122] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:23:24.978419] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-09T21:23:24.978578] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:23:24.978695] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-09T21:23:24.978783] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:23:24.978882] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-09T21:23:24.978964] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-09T21:23:24.979003] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-09T21:23:24.979043] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-09T21:23:24.979090] [INFO ] [MAIN ] Update Progress: 1872/2373 symbols completed. SBDS took 2.1s. Estimated remaining: 1h 10m 29s. Rate: 7.1 symbols/min [2025-10-09T21:23:25.167137] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:25.221524] [DEBUG] [LOCAL ] SBH: Loaded 49785 existing records from primary storage. [2025-10-09T21:23:25.222054] [INFO ] [MAIN ] SBH: Loaded 49785 existing records. [2025-10-09T21:23:25.476289] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:23:25.476949] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-09T21:23:25.479107] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T21:23:25.477343] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-09T21:23:25.490064] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-09T21:23:25.490232] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-09T21:23:25.605431] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-09T21:23:25.862342] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:26.396759] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-09T21:23:26.815287] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T21:23:27.162053] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T21:23:27.196679] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-09T21:23:27.996722] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-09T21:23:28.687594] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T21:23:28.796685] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-09T21:23:29.269980] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T21:23:29.596745] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-09T21:23:30.396688] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-09T21:23:30.498779] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T21:23:31.018380] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T21:23:31.196699] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-09T21:23:31.763212] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T21:23:31.996717] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-09T21:23:32.352021] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T21:23:32.593409] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T21:23:32.796770] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-09T21:23:33.122421] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T21:23:33.596740] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-09T21:23:34.396724] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-09T21:23:35.077753] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T21:23:35.196665] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-09T21:23:35.503770] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T21:23:35.507618] [INFO ] [REMOTE ] SARO: Full fetch complete (68712 records). [2025-10-09T21:23:35.507755] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-09T21:23:35.885866] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-09T21:23:35.885955] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-09T21:23:35.886965] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-09T21:23:35.887030] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-09T21:23:35.888396] [DEBUG] [LOCAL ] SARO: Trimmed 68712 records to 48788 (keeping 200 days of data) [2025-10-09T21:23:35.996701] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-09T21:23:36.181293] [DEBUG] [LOCAL ] SARO: Primary data saved (48788 records). [2025-10-09T21:23:36.181427] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-09T21:23:36.181511] [INFO ] [MAIN ] Update Progress: 1873/2373 symbols completed. SARO took 46.1s. Estimated remaining: 1h 10m 21s. Rate: 7.1 symbols/min [2025-10-09T21:23:36.349085] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:36.358056] [DEBUG] [LOCAL ] SBI: Loaded 7410 existing records from primary storage. [2025-10-09T21:23:36.358216] [INFO ] [MAIN ] SBI: Loaded 7410 existing records. [2025-10-09T21:23:36.532231] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:23:36.532408] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-09T21:23:36.532463] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-09T21:23:36.532703] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-09T21:23:36.532772] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-09T21:23:36.807582] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-09T21:23:36.909545] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T21:23:36.914593] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:37.188443] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T21:23:37.203531] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-09T21:23:37.596731] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-09T21:23:38.396694] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-09T21:23:38.721098] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-09T21:23:38.865309] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T21:23:39.196719] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-09T21:23:39.528596] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T21:23:39.996721] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-09T21:23:40.796691] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-09T21:23:41.269861] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T21:23:41.521035] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T21:23:41.596868] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-09T21:23:42.396714] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-09T21:23:43.010153] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T21:23:43.079555] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T21:23:43.196723] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-09T21:23:43.996747] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-09T21:23:44.558385] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T21:23:44.637949] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T21:23:44.796763] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-09T21:23:45.596814] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-09T21:23:46.141591] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T21:23:46.396780] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-09T21:23:47.173946] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T21:23:47.196719] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-09T21:23:47.918608] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T21:23:47.996776] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-09T21:23:48.642548] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T21:23:48.796796] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-09T21:23:49.309034] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T21:23:49.596730] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-09T21:23:50.104778] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T21:23:50.105394] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T21:23:50.396730] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-09T21:23:51.192432] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T21:23:51.196681] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-09T21:23:51.857688] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T21:23:51.996691] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-09T21:23:52.716377] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T21:23:52.796701] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-09T21:23:53.513914] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T21:23:53.596736] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-09T21:23:54.335528] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T21:23:54.396708] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-09T21:23:54.980866] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T21:23:55.196733] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-09T21:23:55.707532] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T21:23:55.708864] [INFO ] [REMOTE ] SBI: Full fetch complete (10426 records). [2025-10-09T21:23:55.708953] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-09T21:23:55.998664] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-09T21:23:56.080933] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-09T21:23:56.081000] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-09T21:23:56.081234] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-09T21:23:56.081270] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-09T21:23:56.081824] [DEBUG] [LOCAL ] SBI: Trimmed 10426 records to 7435 (keeping 200 days of data) [2025-10-09T21:23:56.126072] [DEBUG] [LOCAL ] SBI: Primary data saved (7435 records). [2025-10-09T21:23:56.126175] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-09T21:23:56.126252] [INFO ] [MAIN ] Update Progress: 1874/2373 symbols completed. SBI took 19.9s. Estimated remaining: 1h 10m 16s. Rate: 7.1 symbols/min [2025-10-09T21:23:56.292096] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:56.301375] [DEBUG] [LOCAL ] SBR: Loaded 7598 existing records from primary storage. [2025-10-09T21:23:56.301530] [INFO ] [MAIN ] SBR: Loaded 7598 existing records. [2025-10-09T21:23:56.380036] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T21:23:56.407631] [INFO ] [REMOTE ] SAZ: Full fetch complete (1823 records). [2025-10-09T21:23:56.407892] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-09T21:23:56.610669] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:23:56.621225] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-09T21:23:56.621362] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-09T21:23:56.655408] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-09T21:23:56.656469] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-09T21:23:56.710066] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T21:23:56.741946] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:23:56.753271] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:23:56.776866] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-09T21:23:56.778996] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-09T21:23:56.779286] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-09T21:23:56.789884] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-09T21:23:56.800569] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-09T21:23:56.795177] [INFO ] [MAIN ] Update Progress: 1875/2373 symbols completed. SAZ took 45.3s. Estimated remaining: 1h 10m 5s. Rate: 7.1 symbols/min [2025-10-09T21:23:57.208565] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:23:57.212196] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:57.260937] [DEBUG] [LOCAL ] SBS: Loaded 49399 existing records from primary storage. [2025-10-09T21:23:57.261277] [INFO ] [MAIN ] SBS: Loaded 49399 existing records. [2025-10-09T21:23:57.442793] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:23:57.443011] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-09T21:23:57.443060] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-09T21:23:57.443281] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-09T21:23:57.443339] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-09T21:23:57.618581] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-09T21:23:57.806146] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:23:58.396743] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-09T21:23:58.496239] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T21:23:58.494742] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T21:23:59.196680] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-09T21:23:59.257476] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T21:23:59.260952] [INFO ] [REMOTE ] SB: Full fetch complete (49834 records). [2025-10-09T21:23:59.261058] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-09T21:23:59.644989] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-09T21:23:59.645084] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-09T21:23:59.646003] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-09T21:23:59.646074] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-09T21:23:59.647378] [DEBUG] [LOCAL ] SB: Trimmed 49834 records to 33254 (keeping 200 days of data) [2025-10-09T21:23:59.845589] [DEBUG] [LOCAL ] SB: Primary data saved (33254 records). [2025-10-09T21:23:59.845761] [INFO ] [MAIN ] SB: Full history saved. [2025-10-09T21:23:59.845856] [INFO ] [MAIN ] Update Progress: 1876/2373 symbols completed. SB took 47.5s. Estimated remaining: 1h 9m 55s. Rate: 7.1 symbols/min [2025-10-09T21:24:00.002838] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-09T21:24:00.025003] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:24:00.042083] [DEBUG] [LOCAL ] SBSI: Loaded 14797 existing records from primary storage. [2025-10-09T21:24:00.042379] [INFO ] [MAIN ] SBSI: Loaded 14797 existing records. [2025-10-09T21:24:00.221773] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:24:00.222046] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-09T21:24:00.222105] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-09T21:24:00.222299] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-09T21:24:00.222356] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-09T21:24:00.577438] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:24:00.796792] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-09T21:24:01.353017] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-09T21:24:01.430108] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T21:24:01.596692] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-09T21:24:02.393852] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T21:24:02.397007] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-09T21:24:02.423140] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T21:24:02.923116] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T21:24:03.196766] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-09T21:24:03.996750] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-09T21:24:04.633064] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T21:24:04.648386] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T21:24:04.652715] [INFO ] [REMOTE ] SBH: Full fetch complete (72886 records). [2025-10-09T21:24:04.652816] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-09T21:24:04.801937] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-09T21:24:05.056479] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-09T21:24:05.056553] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-09T21:24:05.057701] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-09T21:24:05.057837] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-09T21:24:05.059816] [DEBUG] [LOCAL ] SBH: Trimmed 72886 records to 50164 (keeping 200 days of data) [2025-10-09T21:24:05.373924] [DEBUG] [LOCAL ] SBH: Primary data saved (50164 records). [2025-10-09T21:24:05.374113] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-09T21:24:05.374228] [INFO ] [MAIN ] Update Progress: 1877/2373 symbols completed. SBH took 40.4s. Estimated remaining: 1h 9m 46s. Rate: 7.1 symbols/min [2025-10-09T21:24:05.596745] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-09T21:24:05.883192] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T21:24:06.290761] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T21:24:06.396717] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-09T21:24:07.196691] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-09T21:24:07.454597] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T21:24:07.996719] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-09T21:24:08.462064] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T21:24:08.796732] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-09T21:24:08.840365] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T21:24:09.596734] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-09T21:24:10.396724] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-09T21:24:10.777963] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-09T21:24:10.923173] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T21:24:11.154210] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T21:24:11.196708] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-09T21:24:11.996690] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-09T21:24:12.215424] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T21:24:12.558449] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T21:24:12.796730] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-09T21:24:13.596739] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-09T21:24:14.403734] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-09T21:24:14.429235] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T21:24:14.650959] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T21:24:15.141703] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T21:24:15.196701] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-09T21:24:15.996733] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-09T21:24:16.796713] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-09T21:24:17.008726] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T21:24:17.187210] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-09T21:24:17.438886] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T21:24:17.596724] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-09T21:24:18.396799] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-09T21:24:18.521840] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T21:24:19.105824] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:24:19.107336] [INFO ] [REMOTE ] SBR: Full fetch complete (11217 records). [2025-10-09T21:24:19.107462] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-09T21:24:19.204943] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-09T21:24:19.478608] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-09T21:24:19.478719] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-09T21:24:19.479006] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-09T21:24:19.479045] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-09T21:24:19.479486] [DEBUG] [LOCAL ] SBR: Trimmed 11217 records to 7676 (keeping 200 days of data) [2025-10-09T21:24:19.527280] [DEBUG] [LOCAL ] SBR: Primary data saved (7676 records). [2025-10-09T21:24:19.527432] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-09T21:24:19.527528] [INFO ] [MAIN ] Update Progress: 1878/2373 symbols completed. SBR took 23.4s. Estimated remaining: 1h 9m 39s. Rate: 7.1 symbols/min [2025-10-09T21:24:19.996793] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-09T21:24:20.135010] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T21:24:20.796732] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-09T21:24:21.201686] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T21:24:21.596720] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-09T21:24:21.818593] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T21:24:22.396771] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-09T21:24:23.019748] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T21:24:23.196685] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-09T21:24:23.251704] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T21:24:23.253476] [INFO ] [REMOTE ] SBSI: Full fetch complete (21116 records). [2025-10-09T21:24:23.253560] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-09T21:24:23.667678] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-09T21:24:23.668238] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-09T21:24:23.668811] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-09T21:24:23.668877] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-09T21:24:23.669627] [DEBUG] [LOCAL ] SBSI: Trimmed 21116 records to 14889 (keeping 200 days of data) [2025-10-09T21:24:23.766602] [DEBUG] [LOCAL ] SBSI: Primary data saved (14889 records). [2025-10-09T21:24:23.766787] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-09T21:24:23.766892] [INFO ] [MAIN ] Update Progress: 1879/2373 symbols completed. SBSI took 23.9s. Estimated remaining: 1h 9m 30s. Rate: 7.1 symbols/min [2025-10-09T21:24:24.831768] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T21:24:24.843199] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-09T21:24:26.568086] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T21:24:26.578939] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-09T21:24:28.008576] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T21:24:28.019205] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-09T21:24:29.495133] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T21:24:29.499241] [INFO ] [REMOTE ] SBS: Full fetch complete (70062 records). [2025-10-09T21:24:29.499362] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-09T21:24:29.895117] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-09T21:24:29.895190] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-09T21:24:29.896157] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-09T21:24:29.896261] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-09T21:24:29.897605] [DEBUG] [LOCAL ] SBS: Trimmed 70062 records to 49729 (keeping 200 days of data) [2025-10-09T21:24:30.201682] [DEBUG] [LOCAL ] SBS: Primary data saved (49729 records). [2025-10-09T21:24:30.201818] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-09T21:24:30.201903] [INFO ] [MAIN ] Update Progress: 1880/2373 symbols completed. SBS took 33.4s. Estimated remaining: 1h 9m 21s. Rate: 7.1 symbols/min [2025-10-09T21:24:30.805714] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:24:30.834376] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:24:30.884705] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:24:30.911333] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-09T21:24:30.912358] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:24:30.913011] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-09T21:24:30.913124] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-09T21:24:30.913165] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-09T21:24:30.913207] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-09T21:24:30.913242] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-09T21:24:31.029135] [DEBUG] [LOCAL ] SCD: Loaded 13042 existing records from primary storage. [2025-10-09T21:24:31.041522] [INFO ] [MAIN ] SCD: Loaded 13042 existing records. [2025-10-09T21:24:31.504035] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:24:31.522439] [DEBUG] [LOCAL ] SCCO: Loaded 49592 existing records from primary storage. [2025-10-09T21:24:31.522746] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-09T21:24:31.523982] [DEBUG] [LOCAL ] SBSW: Loaded 53079 existing records from primary storage. [2025-10-09T21:24:31.529473] [INFO ] [MAIN ] SCCO: Loaded 49592 existing records. [2025-10-09T21:24:31.534738] [INFO ] [MAIN ] SBSW: Loaded 53079 existing records. [2025-10-09T21:24:31.550449] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-09T21:24:31.583069] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-09T21:24:31.693964] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-09T21:24:31.793108] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:24:31.853302] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-09T21:24:32.058433] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:24:32.099514] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:24:32.100164] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-09T21:24:32.105591] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-09T21:24:32.105704] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-09T21:24:32.146190] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-09T21:24:32.116112] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-09T21:24:32.178163] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-09T21:24:32.187460] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-09T21:24:32.268121] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-09T21:24:32.285206] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-09T21:24:32.441055] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-09T21:24:32.689190] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:24:32.704206] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-09T21:24:32.928297] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T21:24:32.968708] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-09T21:24:33.112446] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:24:33.123045] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-09T21:24:33.174201] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:24:33.174432] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-09T21:24:33.245373] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-09T21:24:33.246328] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-09T21:24:33.471921] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-09T21:24:33.472947] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-09T21:24:33.518499] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T21:24:33.520799] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-09T21:24:33.665343] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.19 seconds). [2025-10-09T21:24:33.666220] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-09T21:24:33.999108] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-09T21:24:34.230031] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T21:24:34.396763] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-09T21:24:34.702292] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T21:24:34.746975] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T21:24:35.104457] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T21:24:35.196694] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-09T21:24:35.996749] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-09T21:24:36.796764] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-09T21:24:36.856787] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T21:24:37.534099] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T21:24:37.596666] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-09T21:24:37.771318] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T21:24:38.038437] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-09T21:24:38.396719] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-09T21:24:39.196772] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-09T21:24:39.996697] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-09T21:24:40.026113] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T21:24:40.059866] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T21:24:40.570549] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T21:24:40.796734] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-09T21:24:41.596694] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-09T21:24:42.384472] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T21:24:42.396665] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-09T21:24:42.500155] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T21:24:42.941739] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T21:24:43.196710] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-09T21:24:43.996773] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-09T21:24:44.796700] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-09T21:24:44.882299] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T21:24:45.255628] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T21:24:45.362788] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T21:24:45.596705] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-09T21:24:46.396708] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-09T21:24:47.068327] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T21:24:47.196692] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-09T21:24:47.570775] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T21:24:47.996795] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-09T21:24:48.796757] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-09T21:24:49.061425] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-09T21:24:49.062154] [INFO ] [REMOTE ] SBXD: Full fetch complete (3102 records). [2025-10-09T21:24:49.062222] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-09T21:24:49.240008] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-09T21:24:49.240218] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:24:49.240265] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:24:49.240348] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-09T21:24:49.240411] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-09T21:24:49.240447] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-09T21:24:49.240486] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-09T21:24:49.240543] [INFO ] [MAIN ] Update Progress: 1881/2373 symbols completed. SBXD took 19.0s. Estimated remaining: 1h 9m 15s. Rate: 7.1 symbols/min [2025-10-09T21:24:49.406194] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:24:49.461664] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-09T21:24:49.462005] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-09T21:24:49.606113] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-09T21:24:49.648772] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:24:49.648990] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-09T21:24:49.649051] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-09T21:24:49.649308] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-09T21:24:49.649368] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-09T21:24:50.020225] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:24:50.050934] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T21:24:50.396756] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-09T21:24:50.613337] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (3.42 seconds). [2025-10-09T21:24:51.196702] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-09T21:24:51.503991] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T21:24:51.996735] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-09T21:24:52.088471] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T21:24:52.796782] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-09T21:24:53.427246] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T21:24:53.451378] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T21:24:53.596681] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-09T21:24:54.239731] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (3.04 seconds). [2025-10-09T21:24:54.396678] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-09T21:24:54.416351] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T21:24:55.196718] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-09T21:24:55.996746] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-09T21:24:56.796802] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-09T21:24:57.066678] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T21:24:57.178731] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-10-09T21:24:57.483382] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T21:24:57.485147] [INFO ] [REMOTE ] SCD: Full fetch complete (16497 records). [2025-10-09T21:24:57.485228] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-09T21:24:57.602057] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-09T21:24:57.871734] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-09T21:24:57.871877] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-09T21:24:57.872328] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-09T21:24:57.872407] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-09T21:24:57.873167] [DEBUG] [LOCAL ] SCD: Trimmed 16497 records to 13118 (keeping 200 days of data) [2025-10-09T21:24:57.957465] [DEBUG] [LOCAL ] SCD: Primary data saved (13118 records). [2025-10-09T21:24:57.957612] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-09T21:24:57.957742] [INFO ] [MAIN ] Update Progress: 1882/2373 symbols completed. SCD took 27.7s. Estimated remaining: 1h 9m 7s. Rate: 7.1 symbols/min [2025-10-09T21:24:58.133119] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:24:58.170938] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-09T21:24:58.220812] [DEBUG] [LOCAL ] SCI: Loaded 46538 existing records from primary storage. [2025-10-09T21:24:58.221132] [INFO ] [MAIN ] SCI: Loaded 46538 existing records. [2025-10-09T21:24:58.394916] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:24:58.395141] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-09T21:24:58.395190] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-09T21:24:58.395437] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-09T21:24:58.395541] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-09T21:24:58.406584] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-09T21:24:58.756859] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:24:59.196810] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-09T21:24:59.424895] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T21:24:59.996705] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-09T21:25:00.796708] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-09T21:25:01.295959] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-09T21:25:01.596692] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-09T21:25:01.855763] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T21:25:02.236978] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T21:25:02.358567] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-10-09T21:25:02.396696] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-09T21:25:03.196695] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-09T21:25:03.421353] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T21:25:03.996802] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-09T21:25:04.543999] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-09T21:25:04.796697] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-09T21:25:05.282437] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-09T21:25:05.596723] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-09T21:25:05.883799] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T21:25:06.396701] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-09T21:25:06.526033] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T21:25:07.196739] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-09T21:25:07.234801] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T21:25:07.241456] [INFO ] [REMOTE ] SBSW: Full fetch complete (76543 records). [2025-10-09T21:25:07.241674] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-09T21:25:07.653467] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-09T21:25:07.653559] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-09T21:25:07.654775] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-09T21:25:07.654844] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-09T21:25:07.656347] [DEBUG] [LOCAL ] SBSW: Trimmed 76543 records to 53469 (keeping 200 days of data) [2025-10-09T21:25:07.899249] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T21:25:07.905808] [INFO ] [REMOTE ] SCCO: Full fetch complete (71269 records). [2025-10-09T21:25:07.906520] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-09T21:25:08.010190] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-09T21:25:08.385488] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-09T21:25:08.386190] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-09T21:25:08.388207] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-09T21:25:08.388294] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-09T21:25:08.393480] [DEBUG] [LOCAL ] SCCO: Trimmed 71269 records to 49979 (keeping 200 days of data) [2025-10-09T21:25:08.509818] [DEBUG] [LOCAL ] SBSW: Primary data saved (53469 records). [2025-10-09T21:25:08.510694] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-09T21:25:08.510852] [INFO ] [MAIN ] Update Progress: 1883/2373 symbols completed. SBSW took 38.3s. Estimated remaining: 1h 8m 59s. Rate: 7.1 symbols/min [2025-10-09T21:25:08.698872] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:25:08.719828] [DEBUG] [LOCAL ] SCL: Loaded 14833 existing records from primary storage. [2025-10-09T21:25:08.720578] [INFO ] [MAIN ] SCL: Loaded 14833 existing records. [2025-10-09T21:25:08.988906] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:25:09.015161] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-09T21:25:09.017453] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-09T21:25:09.018558] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-09T21:25:09.018708] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-09T21:25:09.252367] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-09T21:25:09.336189] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-09T21:25:09.461509] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:25:09.550590] [DEBUG] [LOCAL ] SCCO: Primary data saved (49979 records). [2025-10-09T21:25:09.550784] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-09T21:25:09.550886] [INFO ] [MAIN ] Update Progress: 1884/2373 symbols completed. SCCO took 39.3s. Estimated remaining: 1h 8m 48s. Rate: 7.1 symbols/min [2025-10-09T21:25:09.608005] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-09T21:25:09.726180] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:25:09.748836] [DEBUG] [LOCAL ] SCM: Loaded 19886 existing records from primary storage. [2025-10-09T21:25:09.749223] [INFO ] [MAIN ] SCM: Loaded 19886 existing records. [2025-10-09T21:25:09.932090] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T21:25:09.975072] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:25:09.975984] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-09T21:25:09.976064] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-09T21:25:09.976321] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-09T21:25:09.976383] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-09T21:25:10.329689] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:25:10.339280] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T21:25:10.396667] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-09T21:25:10.769487] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T21:25:11.064868] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T21:25:11.196670] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-09T21:25:11.996759] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-09T21:25:12.796697] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-09T21:25:12.959747] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T21:25:13.043552] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T21:25:13.596724] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-09T21:25:14.396744] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-09T21:25:14.448180] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T21:25:15.196693] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-09T21:25:15.303836] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T21:25:15.523088] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T21:25:15.816025] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T21:25:15.996686] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-09T21:25:16.796727] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-09T21:25:16.961119] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T21:25:17.596695] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-09T21:25:17.842843] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T21:25:18.396781] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-09T21:25:19.196744] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-09T21:25:19.602301] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T21:25:19.996776] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-09T21:25:20.386361] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T21:25:20.410273] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T21:25:20.796735] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-09T21:25:21.539485] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T21:25:21.596672] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-09T21:25:21.727254] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T21:25:22.396766] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-09T21:25:23.196692] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-09T21:25:23.250382] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T21:25:23.466218] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T21:25:23.996692] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-09T21:25:24.796692] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-09T21:25:24.931535] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T21:25:25.242367] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-09T21:25:25.596768] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-09T21:25:26.396724] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-09T21:25:26.433358] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T21:25:26.432975] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T21:25:27.196719] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-09T21:25:27.527180] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T21:25:27.996734] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-09T21:25:28.042971] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T21:25:28.710598] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T21:25:28.796740] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-09T21:25:29.596755] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-09T21:25:30.381409] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T21:25:30.396673] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-09T21:25:30.444108] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T21:25:31.196722] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-09T21:25:31.746722] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T21:25:31.750726] [INFO ] [REMOTE ] SCI: Full fetch complete (67430 records). [2025-10-09T21:25:31.750852] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-09T21:25:32.003286] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-09T21:25:32.151634] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-09T21:25:32.152068] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-09T21:25:32.153118] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-09T21:25:32.153182] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-09T21:25:32.155499] [DEBUG] [LOCAL ] SCI: Trimmed 67430 records to 46874 (keeping 200 days of data) [2025-10-09T21:25:32.457263] [DEBUG] [LOCAL ] SCI: Primary data saved (46874 records). [2025-10-09T21:25:32.457411] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-09T21:25:32.457551] [INFO ] [MAIN ] Update Progress: 1885/2373 symbols completed. SCI took 34.5s. Estimated remaining: 1h 8m 44s. Rate: 7.1 symbols/min [2025-10-09T21:25:32.633972] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:25:32.648616] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T21:25:32.655674] [INFO ] [REMOTE ] SCHW: Full fetch complete (77704 records). [2025-10-09T21:25:32.655829] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-09T21:25:32.805832] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-09T21:25:33.000513] [DEBUG] [LOCAL ] SCS: Loaded 43480 existing records from primary storage. [2025-10-09T21:25:33.004684] [INFO ] [MAIN ] SCS: Loaded 43480 existing records. [2025-10-09T21:25:33.220433] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T21:25:33.226099] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-09T21:25:33.265509] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-09T21:25:33.304874] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-09T21:25:33.308587] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:25:33.308888] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-09T21:25:33.309022] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-09T21:25:33.308979] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-09T21:25:33.309682] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-09T21:25:33.309753] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-09T21:25:33.410685] [DEBUG] [LOCAL ] SCHW: Trimmed 77704 records to 54075 (keeping 200 days of data) [2025-10-09T21:25:33.597401] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-09T21:25:33.797911] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:25:33.927945] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T21:25:34.053122] [DEBUG] [LOCAL ] SCHW: Primary data saved (54075 records). [2025-10-09T21:25:34.053269] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-09T21:25:34.054129] [INFO ] [MAIN ] Update Progress: 1886/2373 symbols completed. SCHW took 44.8s. Estimated remaining: 1h 8m 34s. Rate: 7.1 symbols/min [2025-10-09T21:25:34.218063] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:25:34.218293] [DEBUG] [LOCAL ] SD: No existing data file found in primary storage. [2025-10-09T21:25:34.218343] [WARN ] [MAIN ] SD: No existing data found, performing full refresh instead. [2025-10-09T21:25:34.218449] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-09T21:25:34.218489] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-09T21:25:34.218529] [DEBUG] [LOCAL ] SD: No primary data file found to delete. [2025-10-09T21:25:34.218560] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-09T21:25:34.379595] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T21:25:34.405139] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-09T21:25:34.425027] [INFO ] [REMOTE ] SCL: Full fetch complete (21358 records). [2025-10-09T21:25:34.425187] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-09T21:25:34.780042] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:25:34.960910] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-09T21:25:34.960992] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-09T21:25:34.961467] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-09T21:25:34.961506] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-09T21:25:34.962143] [DEBUG] [LOCAL ] SCL: Trimmed 21358 records to 14919 (keeping 200 days of data) [2025-10-09T21:25:35.054987] [DEBUG] [LOCAL ] SCL: Primary data saved (14919 records). [2025-10-09T21:25:35.055136] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-09T21:25:35.055226] [INFO ] [MAIN ] Update Progress: 1887/2373 symbols completed. SCL took 26.5s. Estimated remaining: 1h 8m 23s. Rate: 7.1 symbols/min [2025-10-09T21:25:35.201822] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-09T21:25:35.226828] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:25:35.239434] [DEBUG] [LOCAL ] SDHC: Loaded 10348 existing records from primary storage. [2025-10-09T21:25:35.240091] [INFO ] [MAIN ] SDHC: Loaded 10348 existing records. [2025-10-09T21:25:35.431580] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:25:35.431827] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-09T21:25:35.431877] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-09T21:25:35.432061] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-09T21:25:35.432118] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-09T21:25:35.789833] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:25:35.880409] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T21:25:35.996708] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-09T21:25:36.440632] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T21:25:36.796693] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-09T21:25:37.004720] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T21:25:37.596737] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-09T21:25:38.057199] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T21:25:38.396689] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-09T21:25:38.456442] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T21:25:39.196728] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-09T21:25:39.786332] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T21:25:39.996687] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-09T21:25:40.296098] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T21:25:40.796689] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-09T21:25:40.902960] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T21:25:41.596707] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-09T21:25:41.928160] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T21:25:42.396721] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-09T21:25:42.608835] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T21:25:43.196689] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-09T21:25:43.468332] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T21:25:43.996753] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-09T21:25:44.551800] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T21:25:44.796694] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-09T21:25:45.115372] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T21:25:45.118365] [INFO ] [REMOTE ] SCM: Full fetch complete (28766 records). [2025-10-09T21:25:45.118451] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-09T21:25:45.500281] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-09T21:25:45.500363] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-09T21:25:45.501019] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-09T21:25:45.501083] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-09T21:25:45.501786] [DEBUG] [LOCAL ] SCM: Trimmed 28766 records to 20128 (keeping 200 days of data) [2025-10-09T21:25:45.596694] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-09T21:25:45.633790] [DEBUG] [LOCAL ] SCM: Primary data saved (20128 records). [2025-10-09T21:25:45.633929] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-09T21:25:45.634015] [INFO ] [MAIN ] Update Progress: 1888/2373 symbols completed. SCM took 36.1s. Estimated remaining: 1h 8m 15s. Rate: 7.1 symbols/min [2025-10-09T21:25:45.807357] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:25:45.820698] [DEBUG] [LOCAL ] SDHY: Loaded 10901 existing records from primary storage. [2025-10-09T21:25:45.820933] [INFO ] [MAIN ] SDHY: Loaded 10901 existing records. [2025-10-09T21:25:45.942828] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T21:25:46.029591] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:25:46.029828] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-09T21:25:46.029880] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-09T21:25:46.030109] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-09T21:25:46.030169] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-09T21:25:46.391814] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:25:46.400603] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-09T21:25:46.402623] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T21:25:47.196709] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-09T21:25:47.996706] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-09T21:25:48.033067] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T21:25:48.069859] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T21:25:48.796696] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-09T21:25:48.968486] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T21:25:49.596779] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-09T21:25:50.330064] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T21:25:50.358967] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T21:25:50.396701] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-09T21:25:50.925888] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T21:25:51.196690] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-09T21:25:51.996739] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-09T21:25:52.167978] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T21:25:52.751278] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T21:25:52.796804] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-09T21:25:53.596734] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-09T21:25:54.166305] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T21:25:54.340539] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T21:25:54.396669] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-09T21:25:55.196714] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-09T21:25:55.977168] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T21:25:56.000720] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-09T21:25:56.005692] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T21:25:56.774985] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T21:25:56.796670] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-09T21:25:57.559495] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T21:25:57.596672] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-09T21:25:58.396689] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-09T21:25:58.470248] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T21:25:59.196760] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-09T21:25:59.858209] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T21:25:59.996697] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-09T21:26:00.796691] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-09T21:26:00.813178] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T21:26:01.088814] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T21:26:01.576511] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T21:26:01.596731] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-09T21:26:02.396742] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-09T21:26:02.494290] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T21:26:03.196695] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-09T21:26:03.361001] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T21:26:03.996763] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-09T21:26:04.015280] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T21:26:04.796722] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-09T21:26:05.606311] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-09T21:26:05.627999] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T21:26:05.958736] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T21:26:06.396703] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-09T21:26:06.434969] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T21:26:07.196708] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-09T21:26:07.866250] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T21:26:07.870069] [INFO ] [REMOTE ] SCS: Full fetch complete (60849 records). [2025-10-09T21:26:07.870218] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-09T21:26:08.011693] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-09T21:26:08.273759] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-09T21:26:08.273975] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-09T21:26:08.274936] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-09T21:26:08.275014] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-09T21:26:08.291184] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T21:26:08.297195] [DEBUG] [LOCAL ] SCS: Trimmed 60849 records to 43817 (keeping 200 days of data) [2025-10-09T21:26:08.533753] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T21:26:08.587795] [DEBUG] [LOCAL ] SCS: Primary data saved (43817 records). [2025-10-09T21:26:08.587927] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-09T21:26:08.588011] [INFO ] [MAIN ] Update Progress: 1889/2373 symbols completed. SCS took 36.1s. Estimated remaining: 1h 8m 11s. Rate: 7.1 symbols/min [2025-10-09T21:26:08.757668] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:26:08.801159] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-09T21:26:08.803196] [DEBUG] [LOCAL ] SDRL: Loaded 41463 existing records from primary storage. [2025-10-09T21:26:08.803588] [INFO ] [MAIN ] SDRL: Loaded 41463 existing records. [2025-10-09T21:26:08.988006] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:26:08.988258] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-09T21:26:08.988308] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-09T21:26:08.988507] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-09T21:26:08.988565] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-09T21:26:09.361737] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:26:09.513423] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T21:26:09.596731] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-09T21:26:10.396710] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-09T21:26:11.159616] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T21:26:11.161608] [INFO ] [REMOTE ] SDHY: Full fetch complete (15740 records). [2025-10-09T21:26:11.161794] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-09T21:26:11.201818] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-09T21:26:11.292386] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T21:26:11.576837] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-09T21:26:11.576986] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-09T21:26:11.577402] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-09T21:26:11.577458] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-09T21:26:11.578239] [DEBUG] [LOCAL ] SDHY: Trimmed 15740 records to 11007 (keeping 200 days of data) [2025-10-09T21:26:11.646607] [DEBUG] [LOCAL ] SDHY: Primary data saved (11007 records). [2025-10-09T21:26:11.646761] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-09T21:26:11.646866] [INFO ] [MAIN ] Update Progress: 1890/2373 symbols completed. SDHY took 26.0s. Estimated remaining: 1h 8m 1s. Rate: 7.1 symbols/min [2025-10-09T21:26:11.822420] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:26:11.872971] [DEBUG] [LOCAL ] SE: Loaded 53331 existing records from primary storage. [2025-10-09T21:26:11.873319] [INFO ] [MAIN ] SE: Loaded 53331 existing records. [2025-10-09T21:26:12.001909] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-09T21:26:12.057899] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:26:12.058230] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-09T21:26:12.058291] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-09T21:26:12.058517] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-09T21:26:12.058577] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-09T21:26:12.410109] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T21:26:12.451509] [INFO ] [REMOTE ] SD: Full fetch complete (41077 records). [2025-10-09T21:26:12.465546] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-09T21:26:12.560785] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:26:12.801787] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-09T21:26:12.868502] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T21:26:12.868346] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-09T21:26:12.868688] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-09T21:26:12.870951] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-09T21:26:12.871043] [INFO ] [REMOTE ] SDHC: Full fetch complete (17166 records). [2025-10-09T21:26:12.871166] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-09T21:26:12.871230] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-09T21:26:12.950427] [DEBUG] [LOCAL ] SD: Trimmed 41077 records to 28932 (keeping 200 days of data) [2025-10-09T21:26:13.352170] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-09T21:26:13.353066] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-09T21:26:13.354397] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-09T21:26:13.354481] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-09T21:26:13.356706] [DEBUG] [LOCAL ] SDHC: Trimmed 17166 records to 10432 (keeping 200 days of data) [2025-10-09T21:26:13.440467] [DEBUG] [LOCAL ] SDHC: Primary data saved (10432 records). [2025-10-09T21:26:13.440616] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-09T21:26:13.440753] [INFO ] [MAIN ] Update Progress: 1891/2373 symbols completed. SDHC took 38.4s. Estimated remaining: 1h 7m 51s. Rate: 7.1 symbols/min [2025-10-09T21:26:13.597768] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-09T21:26:13.686338] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:26:13.704118] [DEBUG] [LOCAL ] SD: Primary data saved (28932 records). [2025-10-09T21:26:13.704308] [INFO ] [MAIN ] SD: Full history saved. [2025-10-09T21:26:13.704423] [INFO ] [MAIN ] Update Progress: 1892/2373 symbols completed. SD took 39.7s. Estimated remaining: 1h 7m 40s. Rate: 7.1 symbols/min [2025-10-09T21:26:13.852976] [DEBUG] [LOCAL ] SEE: Loaded 48187 existing records from primary storage. [2025-10-09T21:26:13.870580] [INFO ] [MAIN ] SEE: Loaded 48187 existing records. [2025-10-09T21:26:13.974557] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:26:14.083801] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:26:14.089197] [DEBUG] [LOCAL ] SEG: Loaded 13214 existing records from primary storage. [2025-10-09T21:26:14.089341] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-09T21:26:14.089669] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-09T21:26:14.089611] [INFO ] [MAIN ] SEG: Loaded 13214 existing records. [2025-10-09T21:26:14.104669] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-09T21:26:14.132146] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-09T21:26:14.416361] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:26:14.450996] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-09T21:26:14.467472] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-09T21:26:14.499409] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-09T21:26:14.504682] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-09T21:26:14.803161] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:26:14.829059] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-09T21:26:15.016180] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-09T21:26:15.053376] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:26:15.164393] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T21:26:15.196669] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-09T21:26:15.845720] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T21:26:15.996669] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-09T21:26:16.718716] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T21:26:16.796698] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-09T21:26:17.596792] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-09T21:26:17.883938] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T21:26:17.933089] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T21:26:18.019544] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T21:26:18.396708] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-09T21:26:19.196712] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-09T21:26:20.001846] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-09T21:26:20.017829] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T21:26:20.190534] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T21:26:20.796733] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-09T21:26:21.596702] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-09T21:26:21.717980] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T21:26:21.784955] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T21:26:22.396763] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-09T21:26:22.957140] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T21:26:23.196710] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-09T21:26:23.490676] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T21:26:23.996698] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-09T21:26:24.154197] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T21:26:24.796727] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-09T21:26:25.374200] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T21:26:25.522749] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T21:26:25.596686] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-09T21:26:26.396768] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-09T21:26:27.196747] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-09T21:26:27.400949] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T21:26:27.962852] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T21:26:27.996672] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-09T21:26:28.326119] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T21:26:28.796727] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-09T21:26:28.845758] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T21:26:29.596779] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-09T21:26:30.323746] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T21:26:30.396714] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-09T21:26:30.942145] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T21:26:31.196704] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-09T21:26:31.885003] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T21:26:31.996725] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-09T21:26:32.796725] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-09T21:26:32.888599] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T21:26:33.059820] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T21:26:33.596764] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-09T21:26:34.076564] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T21:26:34.368282] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T21:26:34.396669] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-09T21:26:35.001993] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T21:26:35.003343] [INFO ] [REMOTE ] SEG: Full fetch complete (19684 records). [2025-10-09T21:26:35.003411] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-09T21:26:35.201907] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-09T21:26:35.365914] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-09T21:26:35.366010] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-09T21:26:35.366455] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-09T21:26:35.366515] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-09T21:26:35.367678] [DEBUG] [LOCAL ] SEG: Trimmed 19684 records to 13269 (keeping 200 days of data) [2025-10-09T21:26:35.447035] [DEBUG] [LOCAL ] SEG: Primary data saved (13269 records). [2025-10-09T21:26:35.447164] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-09T21:26:35.447273] [INFO ] [MAIN ] Update Progress: 1893/2373 symbols completed. SEG took 21.7s. Estimated remaining: 1h 7m 35s. Rate: 7.1 symbols/min [2025-10-09T21:26:35.612115] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:26:35.655451] [DEBUG] [LOCAL ] SEI: Loaded 49760 existing records from primary storage. [2025-10-09T21:26:35.655769] [INFO ] [MAIN ] SEI: Loaded 49760 existing records. [2025-10-09T21:26:35.826963] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:26:35.827147] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-09T21:26:35.827193] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-09T21:26:35.827451] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-09T21:26:35.827508] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-09T21:26:36.003138] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-09T21:26:36.178211] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:26:36.796856] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T21:26:36.797010] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-09T21:26:37.502996] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T21:26:37.596720] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-09T21:26:38.396760] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-09T21:26:38.432024] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T21:26:39.196680] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-09T21:26:39.225716] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T21:26:39.829701] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T21:26:39.996668] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-09T21:26:40.633741] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T21:26:40.796777] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-09T21:26:41.023946] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T21:26:41.027490] [INFO ] [REMOTE ] SDRL: Full fetch complete (61634 records). [2025-10-09T21:26:41.027580] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-09T21:26:41.425485] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-09T21:26:41.425566] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-09T21:26:41.426614] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-09T21:26:41.426702] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-09T21:26:41.428002] [DEBUG] [LOCAL ] SDRL: Trimmed 61634 records to 41781 (keeping 200 days of data) [2025-10-09T21:26:41.604923] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-09T21:26:41.689356] [DEBUG] [LOCAL ] SDRL: Primary data saved (41781 records). [2025-10-09T21:26:41.689492] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-09T21:26:41.689599] [INFO ] [MAIN ] Update Progress: 1894/2373 symbols completed. SDRL took 33.1s. Estimated remaining: 1h 7m 26s. Rate: 7.1 symbols/min [2025-10-09T21:26:41.884982] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:26:41.933264] [DEBUG] [LOCAL ] SEM: Loaded 42906 existing records from primary storage. [2025-10-09T21:26:41.933696] [INFO ] [MAIN ] SEM: Loaded 42906 existing records. [2025-10-09T21:26:42.154940] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:26:42.155292] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-09T21:26:42.155371] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-09T21:26:42.155601] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-09T21:26:42.155696] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-09T21:26:42.402573] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-09T21:26:42.558472] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T21:26:42.562468] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:26:43.173308] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T21:26:43.196660] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-09T21:26:43.996697] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-09T21:26:44.423039] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T21:26:44.801202] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-09T21:26:44.806849] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T21:26:45.265054] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T21:26:45.596796] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-09T21:26:46.396723] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-09T21:26:46.664436] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T21:26:47.172233] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T21:26:47.196667] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-09T21:26:47.849044] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T21:26:47.996694] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-09T21:26:48.805118] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-09T21:26:48.827528] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T21:26:49.596705] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-09T21:26:49.721240] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T21:26:50.343567] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T21:26:50.396723] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-09T21:26:51.004398] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T21:26:51.196737] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-09T21:26:51.982720] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T21:26:51.996679] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-09T21:26:52.456828] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T21:26:52.796746] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-09T21:26:53.596738] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-09T21:26:54.036667] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T21:26:54.396745] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-09T21:26:54.432005] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T21:26:54.707952] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T21:26:55.196722] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-09T21:26:55.996747] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-09T21:26:56.273396] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T21:26:56.279160] [INFO ] [REMOTE ] SE: Full fetch complete (77090 records). [2025-10-09T21:26:56.279303] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-09T21:26:56.709484] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T21:26:56.707975] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-09T21:26:56.718231] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-09T21:26:56.719818] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-09T21:26:56.719906] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-09T21:26:56.721467] [DEBUG] [LOCAL ] SE: Trimmed 77090 records to 53720 (keeping 200 days of data) [2025-10-09T21:26:56.811331] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-09T21:26:57.060269] [DEBUG] [LOCAL ] SE: Primary data saved (53720 records). [2025-10-09T21:26:57.060423] [INFO ] [MAIN ] SE: Full history saved. [2025-10-09T21:26:57.060509] [INFO ] [MAIN ] Update Progress: 1895/2373 symbols completed. SE took 45.4s. Estimated remaining: 1h 7m 19s. Rate: 7.1 symbols/min [2025-10-09T21:26:57.233479] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:26:57.271676] [DEBUG] [LOCAL ] SEMR: Loaded 41795 existing records from primary storage. [2025-10-09T21:26:57.271970] [INFO ] [MAIN ] SEMR: Loaded 41795 existing records. [2025-10-09T21:26:57.457532] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:26:57.457906] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-09T21:26:57.458027] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-09T21:26:57.458358] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-09T21:26:57.458427] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-09T21:26:57.611136] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-09T21:26:57.820847] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:26:57.849888] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T21:26:58.053337] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T21:26:58.396741] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-09T21:26:59.145074] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T21:26:59.150019] [INFO ] [REMOTE ] SEE: Full fetch complete (69811 records). [2025-10-09T21:26:59.150184] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-09T21:26:59.201838] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-09T21:26:59.545245] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-09T21:26:59.545325] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-09T21:26:59.546336] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-09T21:26:59.546401] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-09T21:26:59.547735] [DEBUG] [LOCAL ] SEE: Trimmed 69811 records to 48548 (keeping 200 days of data) [2025-10-09T21:26:59.882028] [DEBUG] [LOCAL ] SEE: Primary data saved (48548 records). [2025-10-09T21:26:59.882209] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-09T21:26:59.882325] [INFO ] [MAIN ] Update Progress: 1896/2373 symbols completed. SEE took 46.4s. Estimated remaining: 1h 7m 9s. Rate: 7.1 symbols/min [2025-10-09T21:27:00.000404] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-09T21:27:00.085293] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:00.088230] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T21:27:00.145524] [DEBUG] [LOCAL ] SES: Loaded 51569 existing records from primary storage. [2025-10-09T21:27:00.145885] [INFO ] [MAIN ] SES: Loaded 51569 existing records. [2025-10-09T21:27:00.363443] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:27:00.363725] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-09T21:27:00.363785] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-09T21:27:00.364004] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-09T21:27:00.364062] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-09T21:27:00.715173] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T21:27:00.788583] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:00.796674] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-09T21:27:01.550580] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T21:27:01.596709] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-09T21:27:02.396689] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-09T21:27:02.567124] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T21:27:03.196706] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-09T21:27:03.228956] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T21:27:03.816923] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T21:27:03.996707] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-09T21:27:04.796718] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-09T21:27:04.826598] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T21:27:05.596717] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-09T21:27:06.035225] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T21:27:06.396859] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-09T21:27:06.533195] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-09T21:27:07.192813] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T21:27:07.201756] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-09T21:27:07.393043] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T21:27:07.996759] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-09T21:27:08.532347] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T21:27:08.536974] [INFO ] [REMOTE ] SEI: Full fetch complete (70337 records). [2025-10-09T21:27:08.537078] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-09T21:27:08.801868] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-09T21:27:08.921616] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-09T21:27:08.921726] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-09T21:27:08.922734] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-09T21:27:08.922797] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-09T21:27:08.924246] [DEBUG] [LOCAL ] SEI: Trimmed 70337 records to 50147 (keeping 200 days of data) [2025-10-09T21:27:09.251045] [DEBUG] [LOCAL ] SEI: Primary data saved (50147 records). [2025-10-09T21:27:09.251218] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-09T21:27:09.251817] [INFO ] [MAIN ] Update Progress: 1897/2373 symbols completed. SEI took 33.8s. Estimated remaining: 1h 7m 1s. Rate: 7.1 symbols/min [2025-10-09T21:27:09.422907] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:09.458676] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T21:27:09.493639] [DEBUG] [LOCAL ] SF: Loaded 41634 existing records from primary storage. [2025-10-09T21:27:09.494005] [INFO ] [MAIN ] SF: Loaded 41634 existing records. [2025-10-09T21:27:09.601897] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-09T21:27:09.670744] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:27:09.670911] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-09T21:27:09.670958] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-09T21:27:09.671152] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-09T21:27:09.671209] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-09T21:27:10.022282] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:10.396744] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-09T21:27:10.723509] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-09T21:27:11.111585] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T21:27:11.196725] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-09T21:27:11.990059] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T21:27:11.996013] [INFO ] [REMOTE ] SEM: Full fetch complete (61627 records). [2025-10-09T21:27:11.996213] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-09T21:27:11.996690] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-09T21:27:12.446269] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-09T21:27:12.446456] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-09T21:27:12.447519] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-09T21:27:12.447587] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-09T21:27:12.449025] [DEBUG] [LOCAL ] SEM: Trimmed 61627 records to 43265 (keeping 200 days of data) [2025-10-09T21:27:12.701095] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T21:27:12.754124] [DEBUG] [LOCAL ] SEM: Primary data saved (43265 records). [2025-10-09T21:27:12.754263] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-09T21:27:12.754348] [INFO ] [MAIN ] Update Progress: 1898/2373 symbols completed. SEM took 31.1s. Estimated remaining: 1h 6m 52s. Rate: 7.1 symbols/min [2025-10-09T21:27:12.808842] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-09T21:27:12.927967] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:12.935102] [DEBUG] [LOCAL ] SFB: Loaded 4199 existing records from primary storage. [2025-10-09T21:27:12.935318] [INFO ] [MAIN ] SFB: Loaded 4199 existing records. [2025-10-09T21:27:13.122025] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:27:13.122304] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-09T21:27:13.122359] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-09T21:27:13.122536] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-09T21:27:13.122594] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-09T21:27:13.476297] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:13.596731] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-09T21:27:14.116298] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T21:27:14.396698] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-09T21:27:14.612712] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-09T21:27:14.977895] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T21:27:15.071101] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T21:27:15.196759] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-09T21:27:15.821783] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T21:27:15.996739] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-09T21:27:16.796779] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-09T21:27:17.437553] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T21:27:17.596741] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-09T21:27:18.285073] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T21:27:18.396757] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-09T21:27:18.870089] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T21:27:19.196721] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-09T21:27:19.996806] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-09T21:27:20.465596] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T21:27:20.591455] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T21:27:20.796739] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-09T21:27:20.872254] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-09T21:27:21.596717] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-09T21:27:22.065415] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T21:27:22.396780] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-09T21:27:23.196789] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-09T21:27:23.764519] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-09T21:27:23.996698] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-09T21:27:24.208827] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T21:27:24.773851] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T21:27:24.796680] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-09T21:27:25.596789] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-09T21:27:26.090793] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T21:27:26.095140] [INFO ] [REMOTE ] SEMR: Full fetch complete (59597 records). [2025-10-09T21:27:26.095255] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-09T21:27:26.398869] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-09T21:27:26.564212] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-09T21:27:26.565320] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-09T21:27:26.565518] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-09T21:27:26.576444] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-09T21:27:26.576562] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-09T21:27:26.579135] [DEBUG] [LOCAL ] SEMR: Trimmed 59597 records to 42098 (keeping 200 days of data) [2025-10-09T21:27:26.823719] [DEBUG] [LOCAL ] SEMR: Primary data saved (42098 records). [2025-10-09T21:27:26.823856] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-09T21:27:26.823940] [INFO ] [MAIN ] Update Progress: 1899/2373 symbols completed. SEMR took 29.8s. Estimated remaining: 1h 6m 44s. Rate: 7.1 symbols/min [2025-10-09T21:27:26.998731] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:27.020896] [DEBUG] [LOCAL ] SFBS: Loaded 21095 existing records from primary storage. [2025-10-09T21:27:27.021146] [INFO ] [MAIN ] SFBS: Loaded 21095 existing records. [2025-10-09T21:27:27.128299] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T21:27:27.197262] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-09T21:27:27.210338] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:27:27.211539] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-09T21:27:27.211699] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-09T21:27:27.212116] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-09T21:27:27.212333] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-09T21:27:27.311665] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T21:27:27.592006] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:27.996727] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-09T21:27:28.056230] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T21:27:28.796744] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-09T21:27:29.414629] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T21:27:29.564074] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T21:27:29.596677] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-09T21:27:30.396699] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-09T21:27:30.731298] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T21:27:30.740563] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T21:27:31.196730] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-09T21:27:31.996792] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-09T21:27:32.578673] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T21:27:32.796770] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-09T21:27:33.217256] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T21:27:33.596720] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-09T21:27:34.085612] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T21:27:34.406410] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-09T21:27:34.409147] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T21:27:34.879861] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-09T21:27:35.196765] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-09T21:27:35.996724] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-09T21:27:36.796705] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-09T21:27:37.022958] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T21:27:37.265487] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-09T21:27:37.596727] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-09T21:27:38.318709] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T21:27:38.396736] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-09T21:27:39.196748] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-09T21:27:39.550953] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T21:27:39.871434] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-09T21:27:39.996770] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-09T21:27:40.662403] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T21:27:40.796792] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-09T21:27:41.298405] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T21:27:41.315505] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T21:27:41.596756] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-09T21:27:42.396734] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-09T21:27:42.613356] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T21:27:42.793857] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T21:27:42.795736] [INFO ] [REMOTE ] SFB: Full fetch complete (5830 records). [2025-10-09T21:27:42.795989] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-09T21:27:43.162452] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-09T21:27:43.162706] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-09T21:27:43.162907] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-09T21:27:43.162950] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-09T21:27:43.163464] [DEBUG] [LOCAL ] SFB: Trimmed 5830 records to 4217 (keeping 200 days of data) [2025-10-09T21:27:43.190216] [DEBUG] [LOCAL ] SFB: Primary data saved (4217 records). [2025-10-09T21:27:43.190306] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-09T21:27:43.190422] [INFO ] [MAIN ] Update Progress: 1900/2373 symbols completed. SFB took 30.4s. Estimated remaining: 1h 6m 38s. Rate: 7.1 symbols/min [2025-10-09T21:27:43.202145] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-09T21:27:43.371013] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:43.413696] [DEBUG] [LOCAL ] SFL: Loaded 45174 existing records from primary storage. [2025-10-09T21:27:43.414068] [INFO ] [MAIN ] SFL: Loaded 45174 existing records. [2025-10-09T21:27:43.599739] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:27:43.600043] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-09T21:27:43.600096] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-09T21:27:43.600393] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-09T21:27:43.600456] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-09T21:27:43.951430] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:43.996705] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-09T21:27:44.796781] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-09T21:27:45.459725] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-09T21:27:45.464216] [INFO ] [REMOTE ] SES: Full fetch complete (75548 records). [2025-10-09T21:27:45.464378] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-09T21:27:45.603175] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-09T21:27:45.897259] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T21:27:45.906772] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-09T21:27:45.908139] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-09T21:27:45.909422] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-09T21:27:45.909513] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-09T21:27:45.919490] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T21:27:45.924047] [INFO ] [REMOTE ] SF: Full fetch complete (60052 records). [2025-10-09T21:27:45.924181] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-09T21:27:45.924335] [DEBUG] [LOCAL ] SES: Trimmed 75548 records to 51959 (keeping 200 days of data) [2025-10-09T21:27:46.402695] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-09T21:27:46.442571] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-09T21:27:46.446737] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-09T21:27:46.447861] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-09T21:27:46.448936] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-09T21:27:46.463296] [DEBUG] [LOCAL ] SF: Trimmed 60052 records to 41925 (keeping 200 days of data) [2025-10-09T21:27:46.675974] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T21:27:46.938271] [DEBUG] [LOCAL ] SES: Primary data saved (51959 records). [2025-10-09T21:27:46.939189] [INFO ] [MAIN ] SES: Full history saved. [2025-10-09T21:27:46.939521] [INFO ] [MAIN ] Update Progress: 1901/2373 symbols completed. SES took 47.1s. Estimated remaining: 1h 6m 28s. Rate: 7.1 symbols/min [2025-10-09T21:27:47.022191] [DEBUG] [LOCAL ] SF: Primary data saved (41925 records). [2025-10-09T21:27:47.039161] [INFO ] [MAIN ] SF: Full history saved. [2025-10-09T21:27:47.050069] [INFO ] [MAIN ] Update Progress: 1902/2373 symbols completed. SF took 37.8s. Estimated remaining: 1h 6m 18s. Rate: 7.1 symbols/min [2025-10-09T21:27:47.196887] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-09T21:27:47.227094] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:47.292761] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:47.347192] [DEBUG] [LOCAL ] SG: Loaded 53472 existing records from primary storage. [2025-10-09T21:27:47.347624] [INFO ] [MAIN ] SG: Loaded 53472 existing records. [2025-10-09T21:27:47.463033] [DEBUG] [LOCAL ] SGHC: Loaded 46532 existing records from primary storage. [2025-10-09T21:27:47.474044] [INFO ] [MAIN ] SGHC: Loaded 46532 existing records. [2025-10-09T21:27:47.587972] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:27:47.600598] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-09T21:27:47.609631] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-09T21:27:47.637213] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-09T21:27:47.644704] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-09T21:27:47.831533] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:27:47.847849] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-09T21:27:47.858226] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-09T21:27:47.956602] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-09T21:27:47.962559] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-09T21:27:48.278239] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:48.280686] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T21:27:48.319607] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-09T21:27:48.504583] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T21:27:48.518329] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:48.796727] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-09T21:27:49.596787] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-09T21:27:49.812958] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T21:27:50.250486] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T21:27:50.396743] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-09T21:27:51.099519] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T21:27:51.196755] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-09T21:27:51.220741] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T21:27:51.996711] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-09T21:27:52.799213] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-09T21:27:52.804492] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T21:27:53.444973] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T21:27:53.596678] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-09T21:27:53.710945] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T21:27:53.713126] [INFO ] [REMOTE ] SFBS: Full fetch complete (30175 records). [2025-10-09T21:27:53.713196] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-09T21:27:54.072358] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-09T21:27:54.072432] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-09T21:27:54.073015] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-09T21:27:54.073077] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-09T21:27:54.073806] [DEBUG] [LOCAL ] SFBS: Trimmed 30175 records to 21214 (keeping 200 days of data) [2025-10-09T21:27:54.207775] [DEBUG] [LOCAL ] SFBS: Primary data saved (21214 records). [2025-10-09T21:27:54.207901] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-09T21:27:54.207992] [INFO ] [MAIN ] Update Progress: 1903/2373 symbols completed. SFBS took 27.4s. Estimated remaining: 1h 6m 9s. Rate: 7.1 symbols/min [2025-10-09T21:27:54.374755] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:54.374973] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-09T21:27:54.375035] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-09T21:27:54.375140] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-09T21:27:54.375191] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-09T21:27:54.375248] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-09T21:27:54.375295] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-09T21:27:54.408372] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-09T21:27:54.727151] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:54.993755] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T21:27:55.196714] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-09T21:27:55.373737] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:27:55.373968] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-09T21:27:55.374050] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:27:55.374097] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-09T21:27:55.374156] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:27:55.374228] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-09T21:27:55.374289] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-09T21:27:55.374325] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-09T21:27:55.374380] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-09T21:27:55.374449] [INFO ] [MAIN ] Update Progress: 1904/2373 symbols completed. SGI took 1.2s. Estimated remaining: 1h 5m 59s. Rate: 7.1 symbols/min [2025-10-09T21:27:55.541675] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:27:55.556148] [DEBUG] [LOCAL ] SGU: Loaded 6597 existing records from primary storage. [2025-10-09T21:27:55.556459] [INFO ] [MAIN ] SGU: Loaded 6597 existing records. [2025-10-09T21:27:55.733732] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:27:55.733910] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-09T21:27:55.733965] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-09T21:27:55.734160] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-09T21:27:55.734217] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-09T21:27:56.015537] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-09T21:27:56.061202] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T21:27:56.128613] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:27:56.796801] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-09T21:27:57.596685] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-09T21:27:57.708905] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T21:27:58.248123] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T21:27:58.396802] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-09T21:27:58.840864] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-09T21:27:59.196723] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-09T21:27:59.403599] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T21:27:59.806423] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T21:27:59.996749] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-09T21:28:00.577997] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T21:28:00.796782] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-09T21:28:01.596771] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-09T21:28:02.016861] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T21:28:02.396765] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-09T21:28:02.974945] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T21:28:03.197371] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-09T21:28:03.200569] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T21:28:03.898554] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T21:28:03.996709] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-09T21:28:04.796787] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-09T21:28:05.303149] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T21:28:05.596723] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-09T21:28:06.288613] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T21:28:06.396695] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-09T21:28:06.854500] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T21:28:07.057848] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-09T21:28:07.196747] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-09T21:28:07.938100] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T21:28:07.996678] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-09T21:28:08.796739] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-09T21:28:09.596699] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-09T21:28:09.681464] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T21:28:10.396687] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-09T21:28:10.718310] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T21:28:10.825622] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T21:28:11.196756] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-09T21:28:11.996754] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-09T21:28:12.076784] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T21:28:12.483548] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T21:28:12.513172] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T21:28:12.796743] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-09T21:28:13.596768] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-09T21:28:14.222594] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T21:28:14.226812] [INFO ] [REMOTE ] SFL: Full fetch complete (65659 records). [2025-10-09T21:28:14.226937] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-09T21:28:14.399539] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-09T21:28:14.611185] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-09T21:28:14.611266] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-09T21:28:14.612308] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-09T21:28:14.612371] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-09T21:28:14.613752] [DEBUG] [LOCAL ] SFL: Trimmed 65659 records to 45526 (keeping 200 days of data) [2025-10-09T21:28:14.894983] [DEBUG] [LOCAL ] SFL: Primary data saved (45526 records). [2025-10-09T21:28:14.895133] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-09T21:28:14.895268] [INFO ] [MAIN ] Update Progress: 1905/2373 symbols completed. SFL took 31.7s. Estimated remaining: 1h 5m 53s. Rate: 7.1 symbols/min [2025-10-09T21:28:15.064207] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:28:15.108916] [DEBUG] [LOCAL ] SHAK: Loaded 48826 existing records from primary storage. [2025-10-09T21:28:15.109307] [INFO ] [MAIN ] SHAK: Loaded 48826 existing records. [2025-10-09T21:28:15.200451] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-09T21:28:15.289242] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:28:15.294595] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-09T21:28:15.294510] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T21:28:15.296359] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-09T21:28:15.297210] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-09T21:28:15.297268] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-09T21:28:15.651184] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:28:15.720290] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-09T21:28:15.996734] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-09T21:28:16.576063] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T21:28:16.796734] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-09T21:28:17.533079] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T21:28:17.596668] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-09T21:28:18.376140] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T21:28:18.396674] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-09T21:28:19.053510] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T21:28:19.196691] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-09T21:28:19.996747] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-09T21:28:20.075402] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T21:28:20.514510] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T21:28:20.515504] [INFO ] [REMOTE ] SGU: Full fetch complete (9025 records). [2025-10-09T21:28:20.515574] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-09T21:28:20.801441] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-09T21:28:20.877669] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-09T21:28:20.877790] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-09T21:28:20.878108] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-09T21:28:20.878211] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-09T21:28:20.887476] [DEBUG] [LOCAL ] SGU: Trimmed 9025 records to 6613 (keeping 200 days of data) [2025-10-09T21:28:20.934279] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T21:28:20.955488] [DEBUG] [LOCAL ] SGU: Primary data saved (6613 records). [2025-10-09T21:28:20.955579] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-09T21:28:20.955700] [INFO ] [MAIN ] Update Progress: 1906/2373 symbols completed. SGU took 25.6s. Estimated remaining: 1h 5m 44s. Rate: 7.1 symbols/min [2025-10-09T21:28:21.124404] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:28:21.149470] [DEBUG] [LOCAL ] SHCO: Loaded 25465 existing records from primary storage. [2025-10-09T21:28:21.149825] [INFO ] [MAIN ] SHCO: Loaded 25465 existing records. [2025-10-09T21:28:21.321515] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:28:21.321799] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-09T21:28:21.321907] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-09T21:28:21.322228] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-09T21:28:21.322285] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-09T21:28:21.601808] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-09T21:28:21.667776] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:28:22.180511] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T21:28:22.396694] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-09T21:28:23.172484] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T21:28:23.196689] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-09T21:28:23.393611] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T21:28:23.996722] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-09T21:28:24.796701] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-09T21:28:25.009259] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T21:28:25.059269] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T21:28:25.596698] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-09T21:28:26.396769] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-09T21:28:26.967608] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-09T21:28:26.990564] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T21:28:26.994936] [INFO ] [REMOTE ] SGHC: Full fetch complete (64287 records). [2025-10-09T21:28:26.995036] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-09T21:28:27.201867] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-09T21:28:27.469228] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T21:28:27.472381] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-09T21:28:27.477020] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-09T21:28:27.478528] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-09T21:28:27.478612] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-09T21:28:27.480189] [DEBUG] [LOCAL ] SGHC: Trimmed 64287 records to 46912 (keeping 200 days of data) [2025-10-09T21:28:27.784576] [DEBUG] [LOCAL ] SGHC: Primary data saved (46912 records). [2025-10-09T21:28:27.784734] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-09T21:28:27.784827] [INFO ] [MAIN ] Update Progress: 1907/2373 symbols completed. SGHC took 40.7s. Estimated remaining: 1h 5m 35s. Rate: 7.1 symbols/min [2025-10-09T21:28:27.963776] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:28:27.996722] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-09T21:28:28.015560] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-10-09T21:28:28.015935] [INFO ] [MAIN ] SHEL: Loaded 53672 existing records. [2025-10-09T21:28:28.203612] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:28:28.203857] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-09T21:28:28.203905] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-09T21:28:28.204155] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-09T21:28:28.204212] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-09T21:28:28.567935] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:28:28.796743] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-09T21:28:29.216443] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T21:28:29.398433] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T21:28:29.596741] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-09T21:28:30.396686] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-09T21:28:30.573076] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T21:28:31.196694] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-09T21:28:31.701013] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-09T21:28:31.996695] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-09T21:28:32.480494] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-09T21:28:32.522068] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T21:28:32.796731] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-09T21:28:33.596736] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-09T21:28:34.008089] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-09T21:28:34.396728] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-09T21:28:34.651783] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T21:28:35.196729] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-09T21:28:35.342001] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T21:28:35.347944] [INFO ] [REMOTE ] SG: Full fetch complete (77309 records). [2025-10-09T21:28:35.348215] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-09T21:28:35.768960] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-09T21:28:35.769493] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T21:28:35.769896] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-09T21:28:35.771366] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-09T21:28:35.777346] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-09T21:28:35.779883] [DEBUG] [LOCAL ] SG: Trimmed 77309 records to 53857 (keeping 200 days of data) [2025-10-09T21:28:35.997152] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-09T21:28:36.103888] [DEBUG] [LOCAL ] SG: Primary data saved (53857 records). [2025-10-09T21:28:36.104048] [INFO ] [MAIN ] SG: Full history saved. [2025-10-09T21:28:36.104151] [INFO ] [MAIN ] Update Progress: 1908/2373 symbols completed. SG took 49.2s. Estimated remaining: 1h 5m 27s. Rate: 7.1 symbols/min [2025-10-09T21:28:36.272737] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:28:36.300501] [DEBUG] [LOCAL ] SHG: Loaded 26285 existing records from primary storage. [2025-10-09T21:28:36.300802] [INFO ] [MAIN ] SHG: Loaded 26285 existing records. [2025-10-09T21:28:36.479604] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:28:36.479848] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-09T21:28:36.479924] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-09T21:28:36.480374] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-09T21:28:36.480435] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-09T21:28:36.800291] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-09T21:28:36.835719] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:28:37.210806] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-09T21:28:37.596696] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-09T21:28:37.699062] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T21:28:37.872309] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T21:28:38.396702] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-09T21:28:38.971827] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T21:28:38.993111] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T21:28:39.196724] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-09T21:28:39.996774] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-09T21:28:40.796693] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-09T21:28:41.094756] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T21:28:41.279466] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-09T21:28:41.596782] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-09T21:28:42.396781] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-09T21:28:42.490319] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T21:28:42.949380] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T21:28:43.196688] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-09T21:28:43.237880] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T21:28:43.996772] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-09T21:28:44.796695] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-09T21:28:44.972671] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T21:28:45.010394] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T21:28:45.596719] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-09T21:28:46.396809] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-09T21:28:47.034405] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-09T21:28:47.070813] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T21:28:47.196786] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-09T21:28:47.753766] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T21:28:47.996771] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-09T21:28:48.584597] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T21:28:48.796746] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-09T21:28:49.596690] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-09T21:28:50.095102] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-09T21:28:50.117435] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T21:28:50.121930] [INFO ] [REMOTE ] SHAK: Full fetch complete (70639 records). [2025-10-09T21:28:50.122037] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-09T21:28:50.396731] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-09T21:28:50.431847] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T21:28:50.525825] [INFO ] [REMOTE ] SHCO: Full fetch complete (37759 records). [2025-10-09T21:28:50.526021] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-09T21:28:50.526182] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-09T21:28:50.526133] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-09T21:28:50.527281] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-09T21:28:50.527507] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-09T21:28:50.627878] [DEBUG] [LOCAL ] SHAK: Trimmed 70639 records to 49174 (keeping 200 days of data) [2025-10-09T21:28:51.007999] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-09T21:28:51.008107] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-09T21:28:51.010470] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-09T21:28:51.011439] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-09T21:28:51.015144] [DEBUG] [LOCAL ] SHCO: Trimmed 37759 records to 25606 (keeping 200 days of data) [2025-10-09T21:28:51.198214] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-09T21:28:51.295310] [DEBUG] [LOCAL ] SHCO: Primary data saved (25606 records). [2025-10-09T21:28:51.296797] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-09T21:28:51.297886] [INFO ] [MAIN ] Update Progress: 1909/2373 symbols completed. SHCO took 30.3s. Estimated remaining: 1h 5m 20s. Rate: 7.1 symbols/min [2025-10-09T21:28:51.573691] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:28:51.600379] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T21:28:51.619870] [DEBUG] [LOCAL ] SHAK: Primary data saved (49174 records). [2025-10-09T21:28:51.620052] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-09T21:28:51.620175] [INFO ] [MAIN ] Update Progress: 1910/2373 symbols completed. SHAK took 36.7s. Estimated remaining: 1h 5m 10s. Rate: 7.1 symbols/min [2025-10-09T21:28:51.779876] [DEBUG] [LOCAL ] SHO: Loaded 49577 existing records from primary storage. [2025-10-09T21:28:51.796159] [INFO ] [MAIN ] SHO: Loaded 49577 existing records. [2025-10-09T21:28:51.958783] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:28:52.000860] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-09T21:28:52.048548] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:28:52.048688] [DEBUG] [LOCAL ] SHOC: Loaded 3342 existing records from primary storage. [2025-10-09T21:28:52.049025] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-09T21:28:52.049270] [INFO ] [MAIN ] SHOC: Loaded 3342 existing records. [2025-10-09T21:28:52.080123] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-09T21:28:52.122519] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-09T21:28:52.127734] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-09T21:28:52.374490] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:28:52.383957] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-09T21:28:52.390104] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-09T21:28:52.407050] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-09T21:28:52.409560] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-09T21:28:52.814426] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:28:52.854124] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-09T21:28:52.973148] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:28:53.125278] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T21:28:53.262882] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T21:28:53.596729] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-09T21:28:54.396748] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-09T21:28:54.502476] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T21:28:55.136988] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T21:28:55.196703] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-09T21:28:55.788341] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T21:28:55.957104] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T21:28:55.996672] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-09T21:28:56.796776] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-09T21:28:57.022701] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T21:28:57.596774] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-09T21:28:58.108907] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T21:28:58.396742] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-09T21:28:58.727187] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T21:28:59.196761] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-09T21:28:59.988472] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T21:28:59.997808] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-09T21:29:00.796686] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-09T21:29:01.093472] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T21:29:01.156965] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T21:29:01.596718] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-09T21:29:02.256423] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T21:29:02.396768] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-09T21:29:02.616612] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T21:29:02.619264] [INFO ] [REMOTE ] SHG: Full fetch complete (40954 records). [2025-10-09T21:29:02.619357] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-09T21:29:03.012823] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-09T21:29:03.012941] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-09T21:29:03.014183] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-09T21:29:03.014255] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-09T21:29:03.015753] [DEBUG] [LOCAL ] SHG: Trimmed 40954 records to 26539 (keeping 200 days of data) [2025-10-09T21:29:03.197997] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-09T21:29:03.203413] [DEBUG] [LOCAL ] SHG: Primary data saved (26539 records). [2025-10-09T21:29:03.203634] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-09T21:29:03.203811] [INFO ] [MAIN ] Update Progress: 1911/2373 symbols completed. SHG took 27.1s. Estimated remaining: 1h 5m 2s. Rate: 7.1 symbols/min [2025-10-09T21:29:03.390257] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:29:03.446247] [DEBUG] [LOCAL ] SHW: Loaded 50320 existing records from primary storage. [2025-10-09T21:29:03.446738] [INFO ] [MAIN ] SHW: Loaded 50320 existing records. [2025-10-09T21:29:03.639834] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:29:03.640243] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-09T21:29:03.640308] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-09T21:29:03.640545] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-09T21:29:03.640606] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-09T21:29:04.010802] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-09T21:29:04.017040] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:29:04.500109] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T21:29:04.770503] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T21:29:04.796669] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-09T21:29:04.934313] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T21:29:05.419639] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T21:29:05.596730] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-09T21:29:06.341329] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T21:29:06.396708] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-09T21:29:07.196762] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-09T21:29:07.794538] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T21:29:07.882811] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T21:29:07.996728] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-09T21:29:08.796728] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-09T21:29:09.397417] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T21:29:09.596686] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-09T21:29:09.849837] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T21:29:10.000198] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-09T21:29:10.396715] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-09T21:29:11.196722] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-09T21:29:11.996734] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-09T21:29:12.163222] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T21:29:12.796710] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-09T21:29:12.967685] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T21:29:13.596688] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-09T21:29:13.660134] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T21:29:13.665320] [INFO ] [REMOTE ] SHEL: Full fetch complete (77694 records). [2025-10-09T21:29:13.665444] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-09T21:29:14.135967] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-09T21:29:14.136073] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-09T21:29:14.137282] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-09T21:29:14.137348] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-09T21:29:14.139037] [DEBUG] [LOCAL ] SHEL: Trimmed 77694 records to 54062 (keeping 200 days of data) [2025-10-09T21:29:14.396760] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-09T21:29:14.504220] [DEBUG] [LOCAL ] SHEL: Primary data saved (54062 records). [2025-10-09T21:29:14.504385] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-09T21:29:14.505017] [INFO ] [MAIN ] Update Progress: 1912/2373 symbols completed. SHEL took 46.7s. Estimated remaining: 1h 4m 54s. Rate: 7.1 symbols/min [2025-10-09T21:29:14.670830] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:29:14.670998] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-09T21:29:14.671034] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-09T21:29:14.671143] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-09T21:29:14.671184] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-09T21:29:14.671223] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-09T21:29:14.671255] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-09T21:29:15.042250] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:29:15.196793] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-09T21:29:15.481400] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:29:15.481826] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-09T21:29:15.481923] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:29:15.481973] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-09T21:29:15.482032] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:29:15.482105] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-09T21:29:15.482173] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-09T21:29:15.482240] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-09T21:29:15.482324] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-09T21:29:15.482396] [INFO ] [MAIN ] Update Progress: 1913/2373 symbols completed. SI took 1.0s. Estimated remaining: 1h 4m 44s. Rate: 7.1 symbols/min [2025-10-09T21:29:15.655069] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:29:15.699167] [DEBUG] [LOCAL ] SID: Loaded 42554 existing records from primary storage. [2025-10-09T21:29:15.699573] [INFO ] [MAIN ] SID: Loaded 42554 existing records. [2025-10-09T21:29:15.884293] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:29:15.884971] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-09T21:29:15.901634] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-09T21:29:15.913823] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-09T21:29:15.914402] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-09T21:29:15.915559] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-09T21:29:16.032452] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-09T21:29:16.268175] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T21:29:16.349339] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:29:16.547592] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (3.75 seconds). [2025-10-09T21:29:16.796710] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-09T21:29:17.518337] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T21:29:17.596671] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-09T21:29:18.125840] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T21:29:18.396805] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-09T21:29:19.043634] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T21:29:19.047728] [INFO ] [REMOTE ] SHO: Full fetch complete (70974 records). [2025-10-09T21:29:19.047833] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-09T21:29:19.197493] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-09T21:29:19.468933] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-09T21:29:19.469034] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-09T21:29:19.470126] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-09T21:29:19.470191] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-09T21:29:19.471851] [DEBUG] [LOCAL ] SHO: Trimmed 70974 records to 49918 (keeping 200 days of data) [2025-10-09T21:29:19.745693] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T21:29:19.790942] [DEBUG] [LOCAL ] SHO: Primary data saved (49918 records). [2025-10-09T21:29:19.791055] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-09T21:29:19.791143] [INFO ] [MAIN ] Update Progress: 1914/2373 symbols completed. SHO took 28.5s. Estimated remaining: 1h 4m 34s. Rate: 7.1 symbols/min [2025-10-09T21:29:19.967010] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:29:19.996730] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-09T21:29:20.016586] [DEBUG] [LOCAL ] SIG: Loaded 45786 existing records from primary storage. [2025-10-09T21:29:20.017064] [INFO ] [MAIN ] SIG: Loaded 45786 existing records. [2025-10-09T21:29:20.239134] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:29:20.241422] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T21:29:20.241502] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-09T21:29:20.251122] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-09T21:29:20.251344] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-09T21:29:20.251406] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-09T21:29:20.606130] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:29:20.796694] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-09T21:29:21.596761] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-09T21:29:21.717691] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T21:29:22.331311] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T21:29:22.356075] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T21:29:22.396674] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-09T21:29:23.196730] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-09T21:29:23.759247] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T21:29:23.996774] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-09T21:29:24.796723] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-09T21:29:24.917076] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T21:29:25.277307] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T21:29:25.278288] [INFO ] [REMOTE ] SHOC: Full fetch complete (7087 records). [2025-10-09T21:29:25.278362] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-09T21:29:25.599436] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-09T21:29:25.667398] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-09T21:29:25.676319] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-09T21:29:25.688365] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-09T21:29:25.691040] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-09T21:29:25.693174] [DEBUG] [LOCAL ] SHOC: Trimmed 7087 records to 3377 (keeping 200 days of data) [2025-10-09T21:29:25.692894] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T21:29:25.724796] [DEBUG] [LOCAL ] SHOC: Primary data saved (3377 records). [2025-10-09T21:29:25.724873] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-09T21:29:25.725331] [INFO ] [MAIN ] Update Progress: 1915/2373 symbols completed. SHOC took 34.1s. Estimated remaining: 1h 4m 25s. Rate: 7.1 symbols/min [2025-10-09T21:29:25.903302] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:29:25.926681] [DEBUG] [LOCAL ] SII: Loaded 23684 existing records from primary storage. [2025-10-09T21:29:25.926973] [INFO ] [MAIN ] SII: Loaded 23684 existing records. [2025-10-09T21:29:26.114307] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:29:26.114539] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-09T21:29:26.114601] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-09T21:29:26.114848] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-09T21:29:26.114905] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-09T21:29:26.401955] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-09T21:29:26.472800] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:29:27.196732] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-09T21:29:27.419829] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T21:29:27.996816] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-09T21:29:28.589403] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-09T21:29:28.674212] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T21:29:28.796691] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-09T21:29:29.314201] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T21:29:29.596750] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-09T21:29:30.391418] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T21:29:30.400480] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-09T21:29:30.571382] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T21:29:31.196723] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-09T21:29:31.996730] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-09T21:29:32.699778] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-09T21:29:32.796676] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-09T21:29:32.942362] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T21:29:33.596690] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-09T21:29:33.741688] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T21:29:34.396742] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-09T21:29:34.493309] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T21:29:34.867090] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T21:29:35.196716] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-09T21:29:35.837846] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T21:29:35.996717] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-09T21:29:36.796745] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-09T21:29:36.891294] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T21:29:37.522007] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T21:29:37.596678] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-09T21:29:37.795193] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T21:29:38.396719] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-09T21:29:38.540239] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T21:29:39.196743] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-09T21:29:39.996695] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-09T21:29:40.257442] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T21:29:40.292346] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T21:29:40.796791] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-09T21:29:41.596712] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-09T21:29:41.646478] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T21:29:42.109789] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T21:29:42.396770] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-09T21:29:42.840907] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T21:29:43.196742] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-09T21:29:43.996701] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-09T21:29:44.036509] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T21:29:44.269128] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T21:29:44.796759] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-09T21:29:45.460826] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T21:29:45.596735] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-09T21:29:46.389366] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T21:29:46.398481] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-09T21:29:46.701317] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T21:29:47.196716] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-09T21:29:47.900732] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T21:29:47.996685] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-09T21:29:48.355798] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T21:29:48.796806] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-09T21:29:49.585531] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T21:29:49.589920] [INFO ] [REMOTE ] SHW: Full fetch complete (73037 records). [2025-10-09T21:29:49.590043] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-09T21:29:49.601963] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-09T21:29:49.987462] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T21:29:50.016856] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-09T21:29:50.017272] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-09T21:29:50.018511] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-09T21:29:50.019006] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-09T21:29:50.020360] [DEBUG] [LOCAL ] SHW: Trimmed 73037 records to 50691 (keeping 200 days of data) [2025-10-09T21:29:50.340962] [DEBUG] [LOCAL ] SHW: Primary data saved (50691 records). [2025-10-09T21:29:50.341104] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-09T21:29:50.341190] [INFO ] [MAIN ] Update Progress: 1916/2373 symbols completed. SHW took 47.1s. Estimated remaining: 1h 4m 21s. Rate: 7.1 symbols/min [2025-10-09T21:29:50.402409] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-09T21:29:50.519501] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:29:50.549580] [DEBUG] [LOCAL ] SILA: Loaded 30608 existing records from primary storage. [2025-10-09T21:29:50.549886] [INFO ] [MAIN ] SILA: Loaded 30608 existing records. [2025-10-09T21:29:50.729298] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:29:50.730337] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-09T21:29:50.730389] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-09T21:29:50.730599] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-09T21:29:50.730699] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-09T21:29:50.842997] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T21:29:50.863600] [INFO ] [REMOTE ] SID: Full fetch complete (60813 records). [2025-10-09T21:29:50.874073] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-09T21:29:51.200043] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-09T21:29:51.510494] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:29:51.675192] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-09T21:29:51.675886] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-09T21:29:51.676338] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T21:29:51.678018] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-09T21:29:51.683169] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-09T21:29:51.685184] [DEBUG] [LOCAL ] SID: Trimmed 60813 records to 42901 (keeping 200 days of data) [2025-10-09T21:29:51.931706] [DEBUG] [LOCAL ] SID: Primary data saved (42901 records). [2025-10-09T21:29:51.931843] [INFO ] [MAIN ] SID: Full history saved. [2025-10-09T21:29:51.932375] [INFO ] [MAIN ] Update Progress: 1917/2373 symbols completed. SID took 36.4s. Estimated remaining: 1h 4m 11s. Rate: 7.1 symbols/min [2025-10-09T21:29:51.996688] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-09T21:29:52.620553] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T21:29:52.796710] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-09T21:29:53.313903] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T21:29:53.596716] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-09T21:29:53.799214] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T21:29:53.803042] [INFO ] [REMOTE ] SIG: Full fetch complete (67836 records). [2025-10-09T21:29:53.803144] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-09T21:29:54.206772] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-09T21:29:54.206861] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-09T21:29:54.208042] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-09T21:29:54.208163] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-09T21:29:54.210365] [DEBUG] [LOCAL ] SIG: Trimmed 67836 records to 46129 (keeping 200 days of data) [2025-10-09T21:29:54.412038] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-09T21:29:54.539266] [DEBUG] [LOCAL ] SIG: Primary data saved (46129 records). [2025-10-09T21:29:54.539487] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-09T21:29:54.539697] [INFO ] [MAIN ] Update Progress: 1918/2373 symbols completed. SIG took 34.7s. Estimated remaining: 1h 4m 1s. Rate: 7.1 symbols/min [2025-10-09T21:29:54.564025] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T21:29:55.196746] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-09T21:29:55.401702] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T21:29:55.404271] [INFO ] [REMOTE ] SII: Full fetch complete (30576 records). [2025-10-09T21:29:55.404345] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-09T21:29:55.777462] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-09T21:29:55.777566] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-09T21:29:55.778218] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-09T21:29:55.778293] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-09T21:29:55.779034] [DEBUG] [LOCAL ] SII: Trimmed 30576 records to 23968 (keeping 200 days of data) [2025-10-09T21:29:55.922951] [DEBUG] [LOCAL ] SII: Primary data saved (23968 records). [2025-10-09T21:29:55.923080] [INFO ] [MAIN ] SII: Full history saved. [2025-10-09T21:29:55.923187] [INFO ] [MAIN ] Update Progress: 1919/2373 symbols completed. SII took 30.2s. Estimated remaining: 1h 3m 51s. Rate: 7.1 symbols/min [2025-10-09T21:29:56.461979] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T21:29:56.468711] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-09T21:29:57.819247] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T21:29:57.826323] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-09T21:29:59.169203] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T21:29:59.176224] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-09T21:30:00.535892] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T21:30:00.543175] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-09T21:30:02.030149] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T21:30:02.041281] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-09T21:30:03.445981] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T21:30:03.453204] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-09T21:30:04.535452] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T21:30:04.541914] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-09T21:30:05.692752] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T21:30:05.698761] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-09T21:30:06.507237] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T21:30:06.510157] [INFO ] [REMOTE ] SILA: Full fetch complete (44573 records). [2025-10-09T21:30:06.510264] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-09T21:30:06.888621] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-09T21:30:06.888731] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-09T21:30:06.889432] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-09T21:30:06.889514] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-09T21:30:06.890478] [DEBUG] [LOCAL ] SILA: Trimmed 44573 records to 30772 (keeping 200 days of data) [2025-10-09T21:30:07.075111] [DEBUG] [LOCAL ] SILA: Primary data saved (30772 records). [2025-10-09T21:30:07.075262] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-09T21:30:07.075360] [INFO ] [MAIN ] Update Progress: 1920/2373 symbols completed. SILA took 16.7s. Estimated remaining: 1h 3m 43s. Rate: 7.1 symbols/min [2025-10-09T21:30:07.748981] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:30:07.763851] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:30:07.796993] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:30:07.867240] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:30:07.889899] [DEBUG] [LOCAL ] SJT: Loaded 22517 existing records from primary storage. [2025-10-09T21:30:07.890487] [INFO ] [MAIN ] SJT: Loaded 22517 existing records. [2025-10-09T21:30:08.137282] [DEBUG] [LOCAL ] SITC: Loaded 41578 existing records from primary storage. [2025-10-09T21:30:08.146513] [INFO ] [MAIN ] SITC: Loaded 41578 existing records. [2025-10-09T21:30:08.138168] [DEBUG] [LOCAL ] SITE: Loaded 35253 existing records from primary storage. [2025-10-09T21:30:08.192862] [INFO ] [MAIN ] SITE: Loaded 35253 existing records. [2025-10-09T21:30:08.186112] [DEBUG] [LOCAL ] SJM: Loaded 50116 existing records from primary storage. [2025-10-09T21:30:08.219450] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:30:08.232063] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-09T21:30:08.246071] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-09T21:30:08.226636] [INFO ] [MAIN ] SJM: Loaded 50116 existing records. [2025-10-09T21:30:08.301993] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-09T21:30:08.314011] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-09T21:30:08.869716] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:30:08.919772] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:30:08.930530] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-09T21:30:08.944750] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-09T21:30:08.930708] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-09T21:30:08.966131] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-09T21:30:09.029434] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-09T21:30:09.050345] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-09T21:30:09.067027] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-09T21:30:09.085101] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-09T21:30:09.141160] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:30:09.266556] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-09T21:30:09.271865] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-09T21:30:09.339474] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-09T21:30:09.396426] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-09T21:30:09.516629] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:30:09.608198] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-09T21:30:10.242257] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:30:10.251758] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-09T21:30:10.305951] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:30:10.316824] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-09T21:30:10.373827] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:30:10.374161] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-09T21:30:10.905860] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T21:30:10.912204] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-09T21:30:11.649396] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T21:30:11.677725] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-09T21:30:11.681072] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T21:30:11.690977] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-09T21:30:11.753496] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T21:30:11.763308] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-09T21:30:11.933419] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T21:30:11.937740] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-09T21:30:13.072283] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T21:30:13.073618] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T21:30:13.088907] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-09T21:30:13.089868] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-09T21:30:13.103974] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T21:30:13.109294] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-09T21:30:13.587373] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T21:30:13.597548] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-09T21:30:14.190175] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T21:30:14.194978] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-09T21:30:14.290984] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T21:30:14.298239] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-09T21:30:14.586403] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T21:30:14.594503] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-09T21:30:15.064054] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T21:30:15.196719] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-09T21:30:15.319527] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T21:30:15.699259] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T21:30:15.866202] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T21:30:15.996741] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-09T21:30:16.170098] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T21:30:16.796739] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-09T21:30:17.596755] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-09T21:30:17.678378] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T21:30:17.942807] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T21:30:18.396747] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-09T21:30:19.196748] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-09T21:30:19.531150] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T21:30:19.593822] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T21:30:19.766925] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T21:30:19.996722] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-09T21:30:20.796765] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-09T21:30:21.469438] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:30:21.596692] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-09T21:30:21.629821] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T21:30:22.396760] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-09T21:30:23.074022] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T21:30:23.196723] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-09T21:30:23.719147] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T21:30:23.996743] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-09T21:30:24.606395] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T21:30:24.796716] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-09T21:30:25.596749] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-09T21:30:25.688130] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T21:30:26.393671] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T21:30:26.397212] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-09T21:30:26.878558] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T21:30:27.196713] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-09T21:30:27.768388] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T21:30:27.996713] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-09T21:30:28.723976] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T21:30:28.796674] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-09T21:30:29.273894] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T21:30:29.596725] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-09T21:30:30.396742] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-09T21:30:30.444470] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T21:30:31.071359] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T21:30:31.125772] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T21:30:31.196831] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-09T21:30:31.996720] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-09T21:30:32.796694] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-09T21:30:33.028613] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T21:30:33.421684] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T21:30:33.424131] [INFO ] [REMOTE ] SJT: Full fetch complete (31913 records). [2025-10-09T21:30:33.424292] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-09T21:30:33.550779] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T21:30:33.601780] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-09T21:30:33.838597] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-09T21:30:33.838700] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-09T21:30:33.839446] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-09T21:30:33.839488] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-09T21:30:33.840264] [DEBUG] [LOCAL ] SJT: Trimmed 31913 records to 22638 (keeping 200 days of data) [2025-10-09T21:30:33.964437] [DEBUG] [LOCAL ] SJT: Primary data saved (22638 records). [2025-10-09T21:30:33.964563] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-09T21:30:33.964664] [INFO ] [MAIN ] Update Progress: 1921/2373 symbols completed. SJT took 26.9s. Estimated remaining: 1h 3m 39s. Rate: 7.1 symbols/min [2025-10-09T21:30:34.139699] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:30:34.176166] [DEBUG] [LOCAL ] SKE: Loaded 36311 existing records from primary storage. [2025-10-09T21:30:34.176448] [INFO ] [MAIN ] SKE: Loaded 36311 existing records. [2025-10-09T21:30:34.350959] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:30:34.351212] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-09T21:30:34.351259] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-09T21:30:34.351528] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-09T21:30:34.351593] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-09T21:30:34.406616] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-09T21:30:34.708879] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:30:34.937691] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T21:30:34.941820] [INFO ] [REMOTE ] SITC: Full fetch complete (60550 records). [2025-10-09T21:30:34.941929] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-09T21:30:35.205682] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-09T21:30:35.325004] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-09T21:30:35.325079] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-09T21:30:35.326102] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-09T21:30:35.326171] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-09T21:30:35.327564] [DEBUG] [LOCAL ] SITC: Trimmed 60550 records to 41812 (keeping 200 days of data) [2025-10-09T21:30:35.572696] [DEBUG] [LOCAL ] SITC: Primary data saved (41812 records). [2025-10-09T21:30:35.572829] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-09T21:30:35.573499] [INFO ] [MAIN ] Update Progress: 1922/2373 symbols completed. SITC took 28.5s. Estimated remaining: 1h 3m 29s. Rate: 7.1 symbols/min [2025-10-09T21:30:35.744174] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:30:35.754616] [DEBUG] [LOCAL ] SKIL: Loaded 6539 existing records from primary storage. [2025-10-09T21:30:35.754975] [INFO ] [MAIN ] SKIL: Loaded 6539 existing records. [2025-10-09T21:30:35.934584] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:30:35.934822] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-09T21:30:35.934910] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-09T21:30:35.935094] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-09T21:30:35.935151] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-09T21:30:35.999094] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-09T21:30:36.312540] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:30:36.356027] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T21:30:36.382211] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T21:30:36.796756] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-09T21:30:37.332537] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T21:30:37.337838] [INFO ] [REMOTE ] SITE: Full fetch complete (49962 records). [2025-10-09T21:30:37.338022] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-09T21:30:37.601842] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-09T21:30:37.732431] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-09T21:30:37.732532] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-09T21:30:37.733504] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-09T21:30:37.733722] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-09T21:30:37.751090] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T21:30:37.758221] [DEBUG] [LOCAL ] SITE: Trimmed 49962 records to 35558 (keeping 200 days of data) [2025-10-09T21:30:37.975544] [DEBUG] [LOCAL ] SITE: Primary data saved (35558 records). [2025-10-09T21:30:37.975760] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-09T21:30:37.975864] [INFO ] [MAIN ] Update Progress: 1923/2373 symbols completed. SITE took 30.9s. Estimated remaining: 1h 3m 19s. Rate: 7.1 symbols/min [2025-10-09T21:30:38.145178] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:30:38.157859] [DEBUG] [LOCAL ] SKLZ: Loaded 11603 existing records from primary storage. [2025-10-09T21:30:38.158082] [INFO ] [MAIN ] SKLZ: Loaded 11603 existing records. [2025-10-09T21:30:38.336118] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:30:38.336325] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-09T21:30:38.336387] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-09T21:30:38.336735] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-09T21:30:38.336795] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-09T21:30:38.399426] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-09T21:30:38.619037] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T21:30:38.739264] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:30:39.196726] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-09T21:30:39.785770] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T21:30:39.996756] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-09T21:30:40.420158] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T21:30:40.425251] [INFO ] [REMOTE ] SJM: Full fetch complete (72027 records). [2025-10-09T21:30:40.425389] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-09T21:30:40.810920] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-09T21:30:40.838024] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-09T21:30:40.838137] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-09T21:30:40.839638] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-09T21:30:40.839892] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-09T21:30:40.842257] [DEBUG] [LOCAL ] SJM: Trimmed 72027 records to 50431 (keeping 200 days of data) [2025-10-09T21:30:41.148230] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T21:30:41.184668] [DEBUG] [LOCAL ] SJM: Primary data saved (50431 records). [2025-10-09T21:30:41.184822] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-09T21:30:41.185990] [INFO ] [MAIN ] Update Progress: 1924/2373 symbols completed. SJM took 34.1s. Estimated remaining: 1h 3m 9s. Rate: 7.1 symbols/min [2025-10-09T21:30:41.360795] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:30:41.360975] [DEBUG] [LOCAL ] SKM: No existing data file found in primary storage. [2025-10-09T21:30:41.361014] [WARN ] [MAIN ] SKM: No existing data found, performing full refresh instead. [2025-10-09T21:30:41.361168] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-09T21:30:41.361211] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-09T21:30:41.361253] [DEBUG] [LOCAL ] SKM: No primary data file found to delete. [2025-10-09T21:30:41.361288] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-09T21:30:41.603732] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-09T21:30:41.717991] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:30:42.321425] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T21:30:42.335281] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T21:30:42.396682] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-09T21:30:43.171058] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T21:30:43.196674] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-09T21:30:43.697259] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T21:30:43.996788] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-09T21:30:44.796755] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-09T21:30:45.191185] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T21:30:45.596732] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-09T21:30:45.943752] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T21:30:46.355415] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T21:30:46.396665] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-09T21:30:47.065981] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T21:30:47.196725] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-09T21:30:47.805692] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T21:30:47.996769] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-09T21:30:48.796743] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-09T21:30:49.402886] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T21:30:49.596766] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-09T21:30:49.765516] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T21:30:50.396721] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-09T21:30:50.742898] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T21:30:50.990310] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T21:30:51.196750] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-09T21:30:51.996708] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-09T21:30:52.247491] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T21:30:52.796720] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-09T21:30:53.347183] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T21:30:53.442301] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T21:30:53.596751] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-09T21:30:54.396738] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-09T21:30:55.003895] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T21:30:55.196701] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-09T21:30:55.663741] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T21:30:55.996723] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-09T21:30:56.122683] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T21:30:56.796759] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-09T21:30:57.146786] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T21:30:57.596727] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-09T21:30:58.128777] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T21:30:58.396769] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-09T21:30:59.127832] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T21:30:59.178380] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T21:30:59.196669] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-09T21:30:59.700678] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T21:30:59.996753] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-09T21:31:00.796795] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-09T21:31:01.598766] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-09T21:31:01.612069] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T21:31:01.611557] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T21:31:02.396736] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-09T21:31:03.137892] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T21:31:03.193195] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T21:31:03.196672] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-09T21:31:03.937698] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T21:31:03.996719] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-09T21:31:04.796736] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-09T21:31:05.461375] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T21:31:05.596722] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-09T21:31:06.298474] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T21:31:06.302803] [INFO ] [REMOTE ] SKE: Full fetch complete (51128 records). [2025-10-09T21:31:06.302913] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-09T21:31:06.401896] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-09T21:31:06.684095] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-09T21:31:06.684197] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-09T21:31:06.685192] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-09T21:31:06.685303] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-09T21:31:06.705834] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T21:31:06.705948] [DEBUG] [LOCAL ] SKE: Trimmed 51128 records to 36667 (keeping 200 days of data) [2025-10-09T21:31:06.958577] [DEBUG] [LOCAL ] SKE: Primary data saved (36667 records). [2025-10-09T21:31:06.958770] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-09T21:31:06.958900] [INFO ] [MAIN ] Update Progress: 1925/2373 symbols completed. SKE took 33.0s. Estimated remaining: 1h 3m 5s. Rate: 7.1 symbols/min [2025-10-09T21:31:07.125074] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:31:07.164380] [DEBUG] [LOCAL ] SKT: Loaded 42467 existing records from primary storage. [2025-10-09T21:31:07.164693] [INFO ] [MAIN ] SKT: Loaded 42467 existing records. [2025-10-09T21:31:07.202897] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-09T21:31:07.240974] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T21:31:07.356022] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:31:07.356217] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-09T21:31:07.356274] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-09T21:31:07.356540] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-09T21:31:07.356599] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-09T21:31:07.704161] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:31:07.996773] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-09T21:31:08.542951] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T21:31:08.746366] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T21:31:08.747811] [INFO ] [REMOTE ] SKIL: Full fetch complete (10098 records). [2025-10-09T21:31:08.747881] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-09T21:31:08.801978] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-09T21:31:09.098987] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-09T21:31:09.099062] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-09T21:31:09.099264] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-09T21:31:09.099302] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-09T21:31:09.099738] [DEBUG] [LOCAL ] SKIL: Trimmed 10098 records to 6584 (keeping 200 days of data) [2025-10-09T21:31:09.139682] [DEBUG] [LOCAL ] SKIL: Primary data saved (6584 records). [2025-10-09T21:31:09.139771] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-09T21:31:09.139848] [INFO ] [MAIN ] Update Progress: 1926/2373 symbols completed. SKIL took 33.6s. Estimated remaining: 1h 2m 55s. Rate: 7.1 symbols/min [2025-10-09T21:31:09.304816] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:31:09.343482] [DEBUG] [LOCAL ] SKY: Loaded 38006 existing records from primary storage. [2025-10-09T21:31:09.343786] [INFO ] [MAIN ] SKY: Loaded 38006 existing records. [2025-10-09T21:31:09.519482] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:31:09.519757] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-09T21:31:09.519873] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-09T21:31:09.520140] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-09T21:31:09.520222] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-09T21:31:09.601962] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-09T21:31:09.874090] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:31:10.160844] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T21:31:10.396755] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-09T21:31:10.576370] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T21:31:11.196767] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-09T21:31:11.801663] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T21:31:11.983932] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T21:31:11.996671] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-09T21:31:12.796724] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-09T21:31:13.016544] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T21:31:13.596783] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-09T21:31:14.106031] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T21:31:14.396722] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-09T21:31:14.765484] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T21:31:14.768441] [INFO ] [REMOTE ] SKM: Full fetch complete (48352 records). [2025-10-09T21:31:14.768518] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-09T21:31:15.142430] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-09T21:31:15.142504] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-09T21:31:15.143370] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-09T21:31:15.143433] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-09T21:31:15.144390] [DEBUG] [LOCAL ] SKM: Trimmed 48352 records to 35216 (keeping 200 days of data) [2025-10-09T21:31:15.198227] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-09T21:31:15.362367] [DEBUG] [LOCAL ] SKM: Primary data saved (35216 records). [2025-10-09T21:31:15.362501] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-09T21:31:15.362574] [INFO ] [MAIN ] Update Progress: 1927/2373 symbols completed. SKM took 34.2s. Estimated remaining: 1h 2m 46s. Rate: 7.1 symbols/min [2025-10-09T21:31:15.549239] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:31:15.569942] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T21:31:15.591671] [DEBUG] [LOCAL ] SKYH: Loaded 16565 existing records from primary storage. [2025-10-09T21:31:15.591953] [INFO ] [MAIN ] SKYH: Loaded 16565 existing records. [2025-10-09T21:31:15.776164] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:31:15.776399] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-09T21:31:15.776447] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-09T21:31:15.776627] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-09T21:31:15.776719] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-09T21:31:16.006440] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-09T21:31:16.131601] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:31:16.715139] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T21:31:16.796662] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-09T21:31:17.274604] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T21:31:17.596764] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-09T21:31:18.238017] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T21:31:18.396771] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-09T21:31:19.020719] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T21:31:19.196751] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-09T21:31:19.954427] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T21:31:19.996679] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-09T21:31:20.174921] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T21:31:20.796701] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-09T21:31:21.596683] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-09T21:31:21.608714] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T21:31:21.610504] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18488 records). [2025-10-09T21:31:21.610578] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-09T21:31:21.831173] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T21:31:22.024164] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-09T21:31:22.024237] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-09T21:31:22.024681] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-09T21:31:22.024743] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-09T21:31:22.025254] [DEBUG] [LOCAL ] SKLZ: Trimmed 18488 records to 11644 (keeping 200 days of data) [2025-10-09T21:31:22.098321] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11644 records). [2025-10-09T21:31:22.098501] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-09T21:31:22.098591] [INFO ] [MAIN ] Update Progress: 1928/2373 symbols completed. SKLZ took 44.1s. Estimated remaining: 1h 2m 37s. Rate: 7.1 symbols/min [2025-10-09T21:31:22.268720] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:31:22.319504] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-09T21:31:22.319892] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-10-09T21:31:22.401822] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-09T21:31:22.519843] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T21:31:22.523630] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:31:22.527072] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-09T21:31:22.527128] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-09T21:31:22.527389] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-09T21:31:22.527448] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-09T21:31:22.916891] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:31:23.196689] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-09T21:31:23.920219] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T21:31:23.996803] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-09T21:31:24.048528] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T21:31:24.796799] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-09T21:31:25.596695] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-09T21:31:25.646234] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T21:31:26.202469] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-09T21:31:26.396710] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-09T21:31:27.144723] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T21:31:27.196683] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-09T21:31:27.478725] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T21:31:27.996772] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-09T21:31:28.656838] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T21:31:28.796676] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-09T21:31:29.599749] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-09T21:31:29.605314] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T21:31:30.388689] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T21:31:30.397449] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-09T21:31:31.196747] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-09T21:31:31.840749] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-09T21:31:31.908312] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-09T21:31:31.926765] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T21:31:31.996754] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-09T21:31:32.796715] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-09T21:31:33.607480] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-09T21:31:33.610177] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T21:31:33.740192] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T21:31:34.396749] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-09T21:31:35.102278] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T21:31:35.165177] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T21:31:35.196683] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-09T21:31:35.996705] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-09T21:31:36.217105] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T21:31:36.796723] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-09T21:31:37.164730] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T21:31:37.596712] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-09T21:31:37.793856] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T21:31:37.797268] [INFO ] [REMOTE ] SKY: Full fetch complete (54266 records). [2025-10-09T21:31:37.797354] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-09T21:31:38.172685] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-09T21:31:38.172776] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-09T21:31:38.173635] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-09T21:31:38.173716] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-09T21:31:38.174798] [DEBUG] [LOCAL ] SKY: Trimmed 54266 records to 38321 (keeping 200 days of data) [2025-10-09T21:31:38.402129] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-09T21:31:38.410493] [DEBUG] [LOCAL ] SKY: Primary data saved (38321 records). [2025-10-09T21:31:38.410591] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-09T21:31:38.411165] [INFO ] [MAIN ] Update Progress: 1929/2373 symbols completed. SKY took 29.3s. Estimated remaining: 1h 2m 31s. Rate: 7.1 symbols/min [2025-10-09T21:31:38.579908] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:31:38.617898] [DEBUG] [LOCAL ] SLF: Loaded 38750 existing records from primary storage. [2025-10-09T21:31:38.618195] [INFO ] [MAIN ] SLF: Loaded 38750 existing records. [2025-10-09T21:31:38.790679] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:31:38.790948] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-09T21:31:38.791008] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-09T21:31:38.791226] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-09T21:31:38.791282] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-09T21:31:39.171314] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:31:39.196685] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-09T21:31:39.457053] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T21:31:39.458502] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T21:31:39.996709] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-09T21:31:40.796752] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-09T21:31:40.830332] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T21:31:41.090590] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T21:31:41.334109] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T21:31:41.336881] [INFO ] [REMOTE ] SKYH: Full fetch complete (22351 records). [2025-10-09T21:31:41.336992] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-09T21:31:41.601864] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-09T21:31:41.725894] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-09T21:31:41.725980] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-09T21:31:41.726556] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-09T21:31:41.726620] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-09T21:31:41.727409] [DEBUG] [LOCAL ] SKYH: Trimmed 22351 records to 16701 (keeping 200 days of data) [2025-10-09T21:31:41.823159] [DEBUG] [LOCAL ] SKYH: Primary data saved (16701 records). [2025-10-09T21:31:41.823280] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-09T21:31:41.823394] [INFO ] [MAIN ] Update Progress: 1930/2373 symbols completed. SKYH took 26.5s. Estimated remaining: 1h 2m 21s. Rate: 7.1 symbols/min [2025-10-09T21:31:41.991478] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:31:42.032027] [DEBUG] [LOCAL ] SLG: Loaded 45182 existing records from primary storage. [2025-10-09T21:31:42.032316] [INFO ] [MAIN ] SLG: Loaded 45182 existing records. [2025-10-09T21:31:42.220030] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:31:42.220260] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-09T21:31:42.220308] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-09T21:31:42.220539] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-09T21:31:42.220598] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-09T21:31:42.411458] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-09T21:31:42.599557] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:31:43.196762] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-09T21:31:43.354964] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T21:31:43.910269] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T21:31:43.996681] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-09T21:31:44.397628] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T21:31:44.401753] [INFO ] [REMOTE ] SKT: Full fetch complete (60352 records). [2025-10-09T21:31:44.401929] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-09T21:31:44.795948] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-09T21:31:44.796033] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-09T21:31:44.797142] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-09T21:31:44.797083] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-09T21:31:44.797303] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-09T21:31:44.799553] [DEBUG] [LOCAL ] SKT: Trimmed 60352 records to 42715 (keeping 200 days of data) [2025-10-09T21:31:45.069463] [DEBUG] [LOCAL ] SKT: Primary data saved (42715 records). [2025-10-09T21:31:45.069589] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-09T21:31:45.069710] [INFO ] [MAIN ] Update Progress: 1931/2373 symbols completed. SKT took 38.1s. Estimated remaining: 1h 2m 11s. Rate: 7.1 symbols/min [2025-10-09T21:31:45.237965] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:31:45.274589] [DEBUG] [LOCAL ] SLGN: Loaded 40575 existing records from primary storage. [2025-10-09T21:31:45.274928] [INFO ] [MAIN ] SLGN: Loaded 40575 existing records. [2025-10-09T21:31:45.456210] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:31:45.456508] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-09T21:31:45.456693] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-09T21:31:45.456987] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-09T21:31:45.457045] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-09T21:31:45.599913] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-09T21:31:45.601461] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T21:31:45.850113] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:31:46.396756] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-09T21:31:46.449601] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T21:31:47.196725] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-09T21:31:47.450109] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T21:31:47.839083] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T21:31:47.996707] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-09T21:31:48.798595] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-09T21:31:48.803506] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T21:31:49.561079] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T21:31:49.596672] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-09T21:31:49.887441] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T21:31:50.396735] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-09T21:31:50.660705] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T21:31:51.196766] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-09T21:31:51.996704] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-09T21:31:52.456139] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-09T21:31:52.785213] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T21:31:52.796679] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-09T21:31:53.067261] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T21:31:53.596777] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-09T21:31:53.836621] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T21:31:54.396740] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-09T21:31:55.196693] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-09T21:31:55.232216] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T21:31:55.996706] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-09T21:31:56.416869] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T21:31:56.614851] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T21:31:56.796732] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-09T21:31:57.596697] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-09T21:31:57.624570] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T21:31:58.312125] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T21:31:58.396803] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-09T21:31:59.196744] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-09T21:31:59.370481] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T21:31:59.996708] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-09T21:32:00.264982] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T21:32:00.605300] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T21:32:00.796737] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-09T21:32:01.557579] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T21:32:01.596723] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-09T21:32:02.168215] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T21:32:02.396755] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-09T21:32:03.190474] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T21:32:03.199789] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-09T21:32:03.996753] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-09T21:32:04.425664] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-09T21:32:04.699948] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T21:32:04.796687] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-09T21:32:04.890258] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T21:32:04.893807] [INFO ] [REMOTE ] SLF: Full fetch complete (56335 records). [2025-10-09T21:32:04.893980] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-09T21:32:05.296796] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-09T21:32:05.296996] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-09T21:32:05.298258] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-09T21:32:05.298328] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-09T21:32:05.299718] [DEBUG] [LOCAL ] SLF: Trimmed 56335 records to 39021 (keeping 200 days of data) [2025-10-09T21:32:05.563116] [DEBUG] [LOCAL ] SLF: Primary data saved (39021 records). [2025-10-09T21:32:05.563277] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-09T21:32:05.563818] [INFO ] [MAIN ] Update Progress: 1932/2373 symbols completed. SLF took 27.2s. Estimated remaining: 1h 2m 6s. Rate: 7.1 symbols/min [2025-10-09T21:32:05.601967] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-09T21:32:05.737516] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:32:05.737746] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-09T21:32:05.737802] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-09T21:32:05.737927] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-09T21:32:05.737969] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-09T21:32:05.738010] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-09T21:32:05.738042] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-09T21:32:06.096719] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:32:06.221679] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T21:32:06.396722] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-09T21:32:07.196738] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-09T21:32:07.392309] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T21:32:07.457154] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-09T21:32:07.996749] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-09T21:32:08.318757] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-09T21:32:08.473418] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-09T21:32:08.796724] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-09T21:32:09.134477] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-09T21:32:09.596717] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-09T21:32:10.396746] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-09T21:32:10.948389] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T21:32:11.196721] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-09T21:32:11.459952] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T21:32:11.996729] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-09T21:32:12.533692] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T21:32:12.796765] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-09T21:32:13.597001] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-09T21:32:13.602890] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T21:32:14.159389] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T21:32:14.163119] [INFO ] [REMOTE ] SLG: Full fetch complete (64900 records). [2025-10-09T21:32:14.163272] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-09T21:32:14.401850] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-09T21:32:14.629446] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-09T21:32:14.629533] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-09T21:32:14.630503] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-09T21:32:14.630569] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-09T21:32:14.631894] [DEBUG] [LOCAL ] SLG: Trimmed 64900 records to 45493 (keeping 200 days of data) [2025-10-09T21:32:14.913762] [DEBUG] [LOCAL ] SLG: Primary data saved (45493 records). [2025-10-09T21:32:14.913932] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-09T21:32:14.914043] [INFO ] [MAIN ] Update Progress: 1933/2373 symbols completed. SLG took 33.1s. Estimated remaining: 1h 1m 57s. Rate: 7.1 symbols/min [2025-10-09T21:32:15.086104] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:32:15.129457] [DEBUG] [LOCAL ] SLQT: Loaded 43514 existing records from primary storage. [2025-10-09T21:32:15.129814] [INFO ] [MAIN ] SLQT: Loaded 43514 existing records. [2025-10-09T21:32:15.203542] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-09T21:32:15.318059] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:32:15.318430] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-09T21:32:15.318585] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-09T21:32:15.318923] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-09T21:32:15.318980] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-09T21:32:15.491803] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T21:32:15.538203] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-10-09T21:32:15.556863] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-09T21:32:15.556745] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-09T21:32:15.889897] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:32:15.997543] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-09T21:32:16.136322] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-09T21:32:16.136522] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-09T21:32:16.137768] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-09T21:32:16.137858] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-09T21:32:16.164691] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T21:32:16.174882] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 54087 (keeping 200 days of data) [2025-10-09T21:32:16.514477] [DEBUG] [LOCAL ] SLB: Primary data saved (54087 records). [2025-10-09T21:32:16.514622] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-09T21:32:16.514741] [INFO ] [MAIN ] Update Progress: 1934/2373 symbols completed. SLB took 54.4s. Estimated remaining: 1h 1m 47s. Rate: 7.1 symbols/min [2025-10-09T21:32:16.686843] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:32:16.715150] [DEBUG] [LOCAL ] SLVM: Loaded 27872 existing records from primary storage. [2025-10-09T21:32:16.715451] [INFO ] [MAIN ] SLVM: Loaded 27872 existing records. [2025-10-09T21:32:16.803586] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-09T21:32:16.892433] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:32:16.892716] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-09T21:32:16.892771] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-09T21:32:16.892972] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-09T21:32:16.893037] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-09T21:32:17.256343] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:32:17.370499] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T21:32:17.596735] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-09T21:32:18.148587] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T21:32:18.396748] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-09T21:32:18.790444] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T21:32:19.196771] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-09T21:32:19.548908] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-09T21:32:19.703413] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T21:32:19.707364] [INFO ] [REMOTE ] SLGN: Full fetch complete (58826 records). [2025-10-09T21:32:19.707488] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-09T21:32:19.996937] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-09T21:32:20.090232] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-09T21:32:20.090309] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-09T21:32:20.091219] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-09T21:32:20.091283] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-09T21:32:20.092462] [DEBUG] [LOCAL ] SLGN: Trimmed 58826 records to 40946 (keeping 200 days of data) [2025-10-09T21:32:20.343255] [DEBUG] [LOCAL ] SLGN: Primary data saved (40946 records). [2025-10-09T21:32:20.343408] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-09T21:32:20.343524] [INFO ] [MAIN ] Update Progress: 1935/2373 symbols completed. SLGN took 35.3s. Estimated remaining: 1h 1m 38s. Rate: 7.1 symbols/min [2025-10-09T21:32:20.458424] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T21:32:20.533094] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:32:20.588389] [DEBUG] [LOCAL ] SM: Loaded 52313 existing records from primary storage. [2025-10-09T21:32:20.588838] [INFO ] [MAIN ] SM: Loaded 52313 existing records. [2025-10-09T21:32:20.805100] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:32:20.805249] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-09T21:32:20.806540] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-09T21:32:20.806602] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-09T21:32:20.806844] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-09T21:32:20.806901] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-09T21:32:21.161143] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:32:21.596720] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-09T21:32:22.397889] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-09T21:32:22.400519] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T21:32:22.423257] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T21:32:23.196722] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-09T21:32:23.996717] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-09T21:32:24.170990] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T21:32:24.689032] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T21:32:24.722353] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T21:32:24.796750] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-09T21:32:25.130279] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-09T21:32:25.596757] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-09T21:32:25.912188] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-09T21:32:26.396760] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-09T21:32:26.725133] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T21:32:27.196809] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-09T21:32:27.996733] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-09T21:32:28.747429] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T21:32:28.796676] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-09T21:32:29.159243] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T21:32:29.596790] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-09T21:32:30.067059] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T21:32:30.396712] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-09T21:32:30.640332] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-09T21:32:30.641044] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1048 records). [2025-10-09T21:32:30.641166] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-09T21:32:30.816459] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-09T21:32:30.816688] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:32:30.816778] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:32:30.816874] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-09T21:32:30.816958] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-09T21:32:30.816999] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-09T21:32:30.817055] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-09T21:32:30.817160] [INFO ] [MAIN ] Update Progress: 1936/2373 symbols completed. SLNZ took 25.3s. Estimated remaining: 1h 1m 30s. Rate: 7.1 symbols/min [2025-10-09T21:32:30.986970] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:32:30.987139] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-09T21:32:30.987177] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-09T21:32:30.987325] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-09T21:32:30.987392] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-09T21:32:30.987444] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-09T21:32:30.987479] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-09T21:32:31.201792] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-09T21:32:31.366933] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:32:31.394205] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T21:32:31.996715] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-09T21:32:32.662097] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T21:32:32.796818] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-09T21:32:33.393497] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T21:32:33.596702] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-09T21:32:33.628158] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T21:32:34.396771] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-09T21:32:34.596078] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:32:34.596386] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-09T21:32:34.596513] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:32:34.596600] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-09T21:32:34.596694] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:32:34.596787] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-09T21:32:34.596868] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-09T21:32:34.596906] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-09T21:32:34.596948] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-09T21:32:34.597007] [INFO ] [MAIN ] Update Progress: 1937/2373 symbols completed. SMA took 3.8s. Estimated remaining: 1h 1m 20s. Rate: 7.1 symbols/min [2025-10-09T21:32:34.778568] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:32:34.788636] [DEBUG] [LOCAL ] SMBK: Loaded 8170 existing records from primary storage. [2025-10-09T21:32:34.788897] [INFO ] [MAIN ] SMBK: Loaded 8170 existing records. [2025-10-09T21:32:34.975948] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:32:34.976357] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-09T21:32:34.976434] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-09T21:32:34.976741] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-09T21:32:34.976894] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-09T21:32:35.166703] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T21:32:35.199779] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-09T21:32:35.410572] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:32:35.996725] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-09T21:32:36.585468] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T21:32:36.796688] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-09T21:32:36.810205] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T21:32:37.596712] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-09T21:32:37.912627] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T21:32:38.396713] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-09T21:32:38.979269] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T21:32:39.196723] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-09T21:32:39.668601] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T21:32:39.996754] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-09T21:32:40.796839] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-09T21:32:40.937333] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T21:32:41.464460] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T21:32:41.596723] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-09T21:32:41.867013] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T21:32:42.009579] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T21:32:42.396698] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-09T21:32:43.196787] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-09T21:32:43.420843] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T21:32:43.996747] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-09T21:32:44.796723] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-09T21:32:45.012891] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T21:32:45.128487] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T21:32:45.268537] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T21:32:45.596736] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-09T21:32:46.396707] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-09T21:32:46.409470] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T21:32:47.196904] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-09T21:32:47.996759] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-09T21:32:48.166362] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T21:32:48.496139] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-09T21:32:48.796723] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-09T21:32:48.992995] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T21:32:49.596723] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-09T21:32:50.149789] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T21:32:50.210584] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T21:32:50.396700] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-09T21:32:51.196711] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-09T21:32:51.996758] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-09T21:32:52.179284] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T21:32:52.197466] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T21:32:52.796728] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-09T21:32:52.806898] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T21:32:52.809854] [INFO ] [REMOTE ] SLVM: Full fetch complete (40146 records). [2025-10-09T21:32:52.809933] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-09T21:32:53.191990] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-09T21:32:53.192071] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-09T21:32:53.192857] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-09T21:32:53.192921] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-09T21:32:53.194050] [DEBUG] [LOCAL ] SLVM: Trimmed 40146 records to 28054 (keeping 200 days of data) [2025-10-09T21:32:53.368214] [DEBUG] [LOCAL ] SLVM: Primary data saved (28054 records). [2025-10-09T21:32:53.368348] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-09T21:32:53.368436] [INFO ] [MAIN ] Update Progress: 1938/2373 symbols completed. SLVM took 36.9s. Estimated remaining: 1h 1m 14s. Rate: 7.1 symbols/min [2025-10-09T21:32:53.541139] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:32:53.554533] [DEBUG] [LOCAL ] SMC: Loaded 11264 existing records from primary storage. [2025-10-09T21:32:53.554778] [INFO ] [MAIN ] SMC: Loaded 11264 existing records. [2025-10-09T21:32:53.601942] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-09T21:32:53.737244] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:32:53.737469] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-09T21:32:53.737515] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-09T21:32:53.737761] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-09T21:32:53.737818] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-09T21:32:54.093717] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:32:54.127282] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T21:32:54.396733] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-09T21:32:55.196757] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-09T21:32:55.252428] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T21:32:55.847842] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T21:32:55.920260] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T21:32:55.996721] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-09T21:32:56.796718] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-09T21:32:56.808717] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T21:32:57.596692] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-09T21:32:57.708079] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T21:32:58.014552] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T21:32:58.015864] [INFO ] [REMOTE ] SMBK: Full fetch complete (11759 records). [2025-10-09T21:32:58.015936] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-09T21:32:58.383720] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-09T21:32:58.383804] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-09T21:32:58.384082] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-09T21:32:58.384119] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-09T21:32:58.384550] [DEBUG] [LOCAL ] SMBK: Trimmed 11759 records to 8215 (keeping 200 days of data) [2025-10-09T21:32:58.406166] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-09T21:32:58.436930] [DEBUG] [LOCAL ] SMBK: Primary data saved (8215 records). [2025-10-09T21:32:58.437074] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-09T21:32:58.437159] [INFO ] [MAIN ] Update Progress: 1939/2373 symbols completed. SMBK took 23.8s. Estimated remaining: 1h 1m 5s. Rate: 7.1 symbols/min [2025-10-09T21:32:58.610126] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:32:58.657688] [DEBUG] [LOCAL ] SMFG: Loaded 48189 existing records from primary storage. [2025-10-09T21:32:58.658027] [INFO ] [MAIN ] SMFG: Loaded 48189 existing records. [2025-10-09T21:32:58.838211] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:32:58.838487] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-09T21:32:58.838535] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-09T21:32:58.838872] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-09T21:32:58.838930] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-09T21:32:59.195207] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:32:59.200690] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-09T21:32:59.207270] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T21:32:59.996728] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-09T21:33:00.468741] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T21:33:00.473567] [INFO ] [REMOTE ] SLQT: Full fetch complete (63783 records). [2025-10-09T21:33:00.473775] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-09T21:33:00.801038] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-09T21:33:00.833855] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T21:33:00.894474] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-09T21:33:00.894557] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-09T21:33:00.895576] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-09T21:33:00.895666] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-09T21:33:00.897069] [DEBUG] [LOCAL ] SLQT: Trimmed 63783 records to 43804 (keeping 200 days of data) [2025-10-09T21:33:01.147661] [DEBUG] [LOCAL ] SLQT: Primary data saved (43804 records). [2025-10-09T21:33:01.147841] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-09T21:33:01.147936] [INFO ] [MAIN ] Update Progress: 1940/2373 symbols completed. SLQT took 46.2s. Estimated remaining: 1h 0m 55s. Rate: 7.1 symbols/min [2025-10-09T21:33:01.316223] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:33:01.355213] [DEBUG] [LOCAL ] SMG: Loaded 43618 existing records from primary storage. [2025-10-09T21:33:01.355513] [INFO ] [MAIN ] SMG: Loaded 43618 existing records. [2025-10-09T21:33:01.531109] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:33:01.531361] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-09T21:33:01.531412] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-09T21:33:01.531634] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-09T21:33:01.531730] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-09T21:33:01.601989] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-09T21:33:01.888189] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:33:02.396768] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-09T21:33:02.468566] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T21:33:03.196752] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-09T21:33:03.316560] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T21:33:03.322260] [INFO ] [REMOTE ] SM: Full fetch complete (75522 records). [2025-10-09T21:33:03.322429] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-09T21:33:03.484142] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T21:33:03.772349] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-09T21:33:03.772486] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-09T21:33:03.773576] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-09T21:33:03.773662] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-09T21:33:03.775154] [DEBUG] [LOCAL ] SM: Trimmed 75522 records to 52703 (keeping 200 days of data) [2025-10-09T21:33:03.997260] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-09T21:33:04.095610] [DEBUG] [LOCAL ] SM: Primary data saved (52703 records). [2025-10-09T21:33:04.095776] [INFO ] [MAIN ] SM: Full history saved. [2025-10-09T21:33:04.095866] [INFO ] [MAIN ] Update Progress: 1941/2373 symbols completed. SM took 43.8s. Estimated remaining: 1h 0m 46s. Rate: 7.1 symbols/min [2025-10-09T21:33:04.275851] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:33:04.293045] [DEBUG] [LOCAL ] SMHI: Loaded 13112 existing records from primary storage. [2025-10-09T21:33:04.293402] [INFO ] [MAIN ] SMHI: Loaded 13112 existing records. [2025-10-09T21:33:04.507377] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:33:04.511834] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-09T21:33:04.511926] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-09T21:33:04.511536] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T21:33:04.520684] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-09T21:33:04.521543] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-09T21:33:04.801968] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-09T21:33:04.883422] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:33:05.341160] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T21:33:05.596740] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-09T21:33:06.393198] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T21:33:06.401097] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-09T21:33:06.731070] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T21:33:07.196689] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-09T21:33:07.642436] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T21:33:07.996728] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-09T21:33:08.796691] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-09T21:33:08.937891] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T21:33:08.970284] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T21:33:09.464497] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T21:33:09.596701] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-09T21:33:10.396727] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-09T21:33:11.196736] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-09T21:33:11.396205] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T21:33:11.594621] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-09T21:33:11.996771] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-09T21:33:12.796732] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-09T21:33:12.955604] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T21:33:13.596711] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-09T21:33:13.717069] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T21:33:13.771371] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T21:33:14.396750] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-09T21:33:15.080715] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T21:33:15.196706] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-09T21:33:15.385857] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T21:33:15.996725] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-09T21:33:16.592508] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T21:33:16.796728] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-09T21:33:17.596703] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-09T21:33:17.907076] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T21:33:18.355097] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T21:33:18.396669] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-09T21:33:18.611779] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T21:33:19.196699] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-09T21:33:19.291126] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T21:33:19.739660] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-09T21:33:19.996738] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-09T21:33:20.736969] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T21:33:20.796678] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-09T21:33:21.459289] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T21:33:21.596717] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-09T21:33:22.396694] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-09T21:33:22.450429] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T21:33:23.196745] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-09T21:33:23.972158] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T21:33:23.996676] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-09T21:33:24.032580] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T21:33:24.796748] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-09T21:33:24.812871] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T21:33:25.596774] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-09T21:33:26.154474] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T21:33:26.396733] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-09T21:33:26.430381] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T21:33:27.196737] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-09T21:33:27.996735] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-09T21:33:28.067145] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T21:33:28.761132] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T21:33:28.796678] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-09T21:33:28.812951] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T21:33:29.596725] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-09T21:33:29.976995] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T21:33:30.336584] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T21:33:30.338335] [INFO ] [REMOTE ] SMC: Full fetch complete (16459 records). [2025-10-09T21:33:30.338416] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-09T21:33:30.404094] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-09T21:33:30.717953] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-09T21:33:30.718034] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-09T21:33:30.718426] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-09T21:33:30.718466] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-09T21:33:30.719021] [DEBUG] [LOCAL ] SMC: Trimmed 16459 records to 11351 (keeping 200 days of data) [2025-10-09T21:33:30.790074] [DEBUG] [LOCAL ] SMC: Primary data saved (11351 records). [2025-10-09T21:33:30.790230] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-09T21:33:30.790315] [INFO ] [MAIN ] Update Progress: 1942/2373 symbols completed. SMC took 37.4s. Estimated remaining: 1h 0m 41s. Rate: 7.1 symbols/min [2025-10-09T21:33:30.967744] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:33:30.988690] [DEBUG] [LOCAL ] SMP: Loaded 18965 existing records from primary storage. [2025-10-09T21:33:30.988955] [INFO ] [MAIN ] SMP: Loaded 18965 existing records. [2025-10-09T21:33:31.169466] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:33:31.169721] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-09T21:33:31.169778] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-09T21:33:31.170033] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-09T21:33:31.170091] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-09T21:33:31.201885] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-09T21:33:31.527994] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:33:31.836150] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T21:33:31.840330] [INFO ] [REMOTE ] SMFG: Full fetch complete (69064 records). [2025-10-09T21:33:31.840469] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-09T21:33:32.010415] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-09T21:33:32.227019] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-09T21:33:32.227114] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-09T21:33:32.228193] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-09T21:33:32.228259] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-09T21:33:32.229715] [DEBUG] [LOCAL ] SMFG: Trimmed 69064 records to 48531 (keeping 200 days of data) [2025-10-09T21:33:32.532857] [DEBUG] [LOCAL ] SMFG: Primary data saved (48531 records). [2025-10-09T21:33:32.532995] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-09T21:33:32.533666] [INFO ] [MAIN ] Update Progress: 1943/2373 symbols completed. SMFG took 34.1s. Estimated remaining: 1h 0m 31s. Rate: 7.1 symbols/min [2025-10-09T21:33:32.708181] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:33:32.745019] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T21:33:32.746702] [INFO ] [REMOTE ] SMHI: Full fetch complete (22165 records). [2025-10-09T21:33:32.746822] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-09T21:33:32.800029] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-09T21:33:32.862964] [DEBUG] [LOCAL ] SMR: Loaded 53798 existing records from primary storage. [2025-10-09T21:33:32.885072] [INFO ] [MAIN ] SMR: Loaded 53798 existing records. [2025-10-09T21:33:33.041263] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T21:33:33.327355] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:33:33.332767] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-09T21:33:33.343061] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-09T21:33:33.366492] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-09T21:33:33.391505] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-09T21:33:33.434490] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-09T21:33:33.481782] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-09T21:33:33.491779] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-09T21:33:33.509434] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-09T21:33:33.533564] [DEBUG] [LOCAL ] SMHI: Trimmed 22165 records to 13175 (keeping 200 days of data) [2025-10-09T21:33:33.620555] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-09T21:33:33.719488] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T21:33:33.904727] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:33:33.916898] [DEBUG] [LOCAL ] SMHI: Primary data saved (13175 records). [2025-10-09T21:33:33.916990] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-09T21:33:33.917077] [INFO ] [MAIN ] Update Progress: 1944/2373 symbols completed. SMHI took 29.8s. Estimated remaining: 1h 0m 21s. Rate: 7.1 symbols/min [2025-10-09T21:33:34.094042] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:33:34.134003] [DEBUG] [LOCAL ] SMRT: Loaded 44025 existing records from primary storage. [2025-10-09T21:33:34.134320] [INFO ] [MAIN ] SMRT: Loaded 44025 existing records. [2025-10-09T21:33:34.313175] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:33:34.313420] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-09T21:33:34.313470] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-09T21:33:34.313712] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-09T21:33:34.313769] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-09T21:33:34.401841] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-09T21:33:34.692187] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:33:34.889066] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T21:33:34.988478] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T21:33:35.196723] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-09T21:33:35.996747] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-09T21:33:36.162517] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T21:33:36.796705] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-09T21:33:37.168425] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T21:33:37.596725] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-09T21:33:37.889146] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T21:33:38.396737] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-09T21:33:38.627814] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T21:33:39.196791] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-09T21:33:39.262529] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T21:33:39.996732] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-09T21:33:40.142122] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T21:33:40.796736] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-09T21:33:40.984336] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T21:33:40.987992] [INFO ] [REMOTE ] SMG: Full fetch complete (62784 records). [2025-10-09T21:33:40.988115] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-09T21:33:41.381048] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-09T21:33:41.381136] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-09T21:33:41.382195] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-09T21:33:41.382263] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-09T21:33:41.383553] [DEBUG] [LOCAL ] SMG: Trimmed 62784 records to 43897 (keeping 200 days of data) [2025-10-09T21:33:41.605118] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-09T21:33:41.666810] [DEBUG] [LOCAL ] SMG: Primary data saved (43897 records). [2025-10-09T21:33:41.666961] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-09T21:33:41.667172] [INFO ] [MAIN ] Update Progress: 1945/2373 symbols completed. SMG took 40.5s. Estimated remaining: 1h 0m 13s. Rate: 7.1 symbols/min [2025-10-09T21:33:41.857617] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:33:41.887565] [DEBUG] [LOCAL ] SMWB: Loaded 32277 existing records from primary storage. [2025-10-09T21:33:41.887915] [INFO ] [MAIN ] SMWB: Loaded 32277 existing records. [2025-10-09T21:33:42.060880] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:33:42.061111] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-09T21:33:42.061158] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-09T21:33:42.061404] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-09T21:33:42.061461] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-09T21:33:42.397151] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-09T21:33:42.417796] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:33:42.699883] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T21:33:43.196682] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-09T21:33:43.540418] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-09T21:33:43.828214] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T21:33:43.852115] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-09T21:33:43.996741] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-09T21:33:44.652779] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T21:33:44.796710] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-09T21:33:45.596793] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-09T21:33:45.859616] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T21:33:46.396727] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-09T21:33:47.196784] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-09T21:33:47.787901] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T21:33:47.996798] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-09T21:33:48.274934] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-09T21:33:48.426093] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T21:33:48.796694] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-09T21:33:49.409285] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T21:33:49.596777] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-09T21:33:49.785835] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T21:33:50.396735] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-09T21:33:50.744246] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T21:33:51.196712] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-09T21:33:51.996717] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-09T21:33:52.755471] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T21:33:52.796682] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-09T21:33:52.841223] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T21:33:52.843408] [INFO ] [REMOTE ] SMP: Full fetch complete (26181 records). [2025-10-09T21:33:52.843707] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-09T21:33:53.055291] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-09T21:33:53.287541] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-09T21:33:53.287618] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-09T21:33:53.288306] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-09T21:33:53.288369] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-09T21:33:53.289128] [DEBUG] [LOCAL ] SMP: Trimmed 26181 records to 19095 (keeping 200 days of data) [2025-10-09T21:33:53.412000] [DEBUG] [LOCAL ] SMP: Primary data saved (19095 records). [2025-10-09T21:33:53.412152] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-09T21:33:53.412239] [INFO ] [MAIN ] Update Progress: 1946/2373 symbols completed. SMP took 22.6s. Estimated remaining: 1h 0m 5s. Rate: 7.1 symbols/min [2025-10-09T21:33:53.586883] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:33:53.596747] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-09T21:33:53.634615] [DEBUG] [LOCAL ] SN: Loaded 49926 existing records from primary storage. [2025-10-09T21:33:53.635046] [INFO ] [MAIN ] SN: Loaded 49926 existing records. [2025-10-09T21:33:53.832301] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:33:53.832513] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-09T21:33:53.832562] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-09T21:33:53.832866] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-09T21:33:53.832929] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-09T21:33:54.234358] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:33:54.396701] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-09T21:33:54.537790] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T21:33:55.196733] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-09T21:33:55.516065] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T21:33:55.750880] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-09T21:33:55.996731] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-09T21:33:56.364317] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T21:33:56.796756] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-09T21:33:57.596762] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-09T21:33:57.692170] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T21:33:58.062361] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T21:33:58.396765] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-09T21:33:59.196743] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-09T21:33:59.996727] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-09T21:34:00.071973] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T21:34:00.217044] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-09T21:34:00.676524] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T21:34:00.796724] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-09T21:34:00.989480] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T21:34:01.596739] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-09T21:34:02.396849] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-09T21:34:02.463170] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T21:34:02.645311] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T21:34:03.196742] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-09T21:34:03.996725] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-09T21:34:04.796694] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-09T21:34:04.960602] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-09T21:34:05.003114] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T21:34:05.395169] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T21:34:05.596732] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-09T21:34:05.844520] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T21:34:05.848616] [INFO ] [REMOTE ] SMRT: Full fetch complete (62182 records). [2025-10-09T21:34:05.848761] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-09T21:34:06.246459] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-09T21:34:06.246552] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-09T21:34:06.247530] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-09T21:34:06.247594] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-09T21:34:06.248928] [DEBUG] [LOCAL ] SMRT: Trimmed 62182 records to 44367 (keeping 200 days of data) [2025-10-09T21:34:06.412143] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-09T21:34:06.508018] [DEBUG] [LOCAL ] SMRT: Primary data saved (44367 records). [2025-10-09T21:34:06.508184] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-09T21:34:06.508298] [INFO ] [MAIN ] Update Progress: 1947/2373 symbols completed. SMRT took 32.6s. Estimated remaining: 59m 58s. Rate: 7.1 symbols/min [2025-10-09T21:34:06.682428] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:34:06.708449] [DEBUG] [LOCAL ] SNA: Loaded 25697 existing records from primary storage. [2025-10-09T21:34:06.708790] [INFO ] [MAIN ] SNA: Loaded 25697 existing records. [2025-10-09T21:34:06.886908] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:34:06.887069] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-09T21:34:06.887117] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-09T21:34:06.887351] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-09T21:34:06.887409] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-09T21:34:07.201879] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-09T21:34:07.255847] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:34:07.485170] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T21:34:07.996770] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-09T21:34:08.564102] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T21:34:08.802896] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-09T21:34:08.820819] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-09T21:34:09.501912] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T21:34:09.596735] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-09T21:34:09.694814] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T21:34:10.396733] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-09T21:34:11.035395] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T21:34:11.196773] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-09T21:34:11.750843] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T21:34:11.996745] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-09T21:34:12.576411] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T21:34:12.796776] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-09T21:34:13.467004] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T21:34:13.596728] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-09T21:34:14.396758] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-09T21:34:14.861726] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T21:34:15.135953] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-09T21:34:15.196739] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-09T21:34:15.996744] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-09T21:34:16.247849] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T21:34:16.796792] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-09T21:34:17.279130] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T21:34:17.596781] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-09T21:34:17.988188] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-09T21:34:18.135281] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T21:34:18.396718] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-09T21:34:18.799084] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T21:34:19.107834] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:34:19.111792] [INFO ] [REMOTE ] SMWB: Full fetch complete (49268 records). [2025-10-09T21:34:19.111963] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-09T21:34:19.201850] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-09T21:34:19.496769] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-09T21:34:19.496850] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-09T21:34:19.497748] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-09T21:34:19.497813] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-09T21:34:19.498859] [DEBUG] [LOCAL ] SMWB: Trimmed 49268 records to 32522 (keeping 200 days of data) [2025-10-09T21:34:19.685601] [DEBUG] [LOCAL ] SMWB: Primary data saved (32522 records). [2025-10-09T21:34:19.685801] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-09T21:34:19.685937] [INFO ] [MAIN ] Update Progress: 1948/2373 symbols completed. SMWB took 38.0s. Estimated remaining: 59m 50s. Rate: 7.1 symbols/min [2025-10-09T21:34:19.856636] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:34:19.912724] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-09T21:34:19.913054] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-09T21:34:20.002046] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-09T21:34:20.104140] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:34:20.104329] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-09T21:34:20.104376] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-09T21:34:20.104601] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-09T21:34:20.104691] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-09T21:34:20.448968] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:34:20.796789] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-09T21:34:20.966785] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T21:34:21.021832] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T21:34:21.596732] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-09T21:34:22.396699] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-09T21:34:22.802347] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T21:34:22.931793] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T21:34:23.196776] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-09T21:34:23.783849] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T21:34:23.996734] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-09T21:34:24.796785] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-09T21:34:25.058728] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T21:34:25.596703] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-09T21:34:25.634803] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-09T21:34:26.097253] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T21:34:26.101522] [INFO ] [REMOTE ] SN: Full fetch complete (71217 records). [2025-10-09T21:34:26.101633] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-09T21:34:26.401963] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-09T21:34:26.509608] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-09T21:34:26.509742] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-09T21:34:26.510954] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-09T21:34:26.511027] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-09T21:34:26.512588] [DEBUG] [LOCAL ] SN: Trimmed 71217 records to 50297 (keeping 200 days of data) [2025-10-09T21:34:26.837670] [DEBUG] [LOCAL ] SN: Primary data saved (50297 records). [2025-10-09T21:34:26.837843] [INFO ] [MAIN ] SN: Full history saved. [2025-10-09T21:34:26.837968] [INFO ] [MAIN ] Update Progress: 1949/2373 symbols completed. SN took 33.4s. Estimated remaining: 59m 42s. Rate: 7.1 symbols/min [2025-10-09T21:34:27.013353] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:34:27.029367] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T21:34:27.040145] [DEBUG] [LOCAL ] SNDA: Loaded 4435 existing records from primary storage. [2025-10-09T21:34:27.040357] [INFO ] [MAIN ] SNDA: Loaded 4435 existing records. [2025-10-09T21:34:27.209490] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-09T21:34:27.214320] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:34:27.215628] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-09T21:34:27.215711] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-09T21:34:27.215889] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-09T21:34:27.215947] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-09T21:34:27.573978] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:34:27.996711] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-09T21:34:28.131376] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T21:34:28.133954] [INFO ] [REMOTE ] SNA: Full fetch complete (38740 records). [2025-10-09T21:34:28.134047] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-09T21:34:28.538130] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-09T21:34:28.538210] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-09T21:34:28.538988] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-09T21:34:28.539083] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-09T21:34:28.540069] [DEBUG] [LOCAL ] SNA: Trimmed 38740 records to 25838 (keeping 200 days of data) [2025-10-09T21:34:28.715851] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-09T21:34:28.722418] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-09T21:34:28.723083] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-09T21:34:28.801298] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-09T21:34:28.826019] [DEBUG] [LOCAL ] SNA: Primary data saved (25838 records). [2025-10-09T21:34:28.829197] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-09T21:34:28.830310] [INFO ] [MAIN ] Update Progress: 1950/2373 symbols completed. SNA took 22.3s. Estimated remaining: 59m 32s. Rate: 7.1 symbols/min [2025-10-09T21:34:28.966818] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T21:34:29.354959] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:34:29.396499] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-09T21:34:29.396586] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-09T21:34:29.397751] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-09T21:34:29.397820] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-09T21:34:29.399942] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 54188 (keeping 200 days of data) [2025-10-09T21:34:29.524194] [DEBUG] [LOCAL ] SNDR: Loaded 41104 existing records from primary storage. [2025-10-09T21:34:29.526623] [INFO ] [MAIN ] SNDR: Loaded 41104 existing records. [2025-10-09T21:34:29.597917] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-09T21:34:29.730105] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:34:29.731079] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-09T21:34:29.731442] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-09T21:34:29.732079] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-09T21:34:29.732160] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-09T21:34:30.115449] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:34:30.330847] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T21:34:30.347784] [DEBUG] [LOCAL ] SMR: Primary data saved (54188 records). [2025-10-09T21:34:30.347959] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-09T21:34:30.349028] [INFO ] [MAIN ] Update Progress: 1951/2373 symbols completed. SMR took 57.8s. Estimated remaining: 59m 22s. Rate: 7.1 symbols/min [2025-10-09T21:34:30.403006] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-09T21:34:30.521796] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:34:30.563425] [DEBUG] [LOCAL ] SNN: Loaded 44210 existing records from primary storage. [2025-10-09T21:34:30.563795] [INFO ] [MAIN ] SNN: Loaded 44210 existing records. [2025-10-09T21:34:30.738688] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:34:30.738971] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-09T21:34:30.739022] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-09T21:34:30.739250] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-09T21:34:30.739307] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-09T21:34:31.098800] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:34:31.133704] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T21:34:31.196691] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-09T21:34:31.290194] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-09T21:34:31.832114] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T21:34:31.996731] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-09T21:34:32.796788] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-09T21:34:33.270827] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-09T21:34:33.523167] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T21:34:33.596738] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-09T21:34:34.396727] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-09T21:34:34.835332] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T21:34:35.051330] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T21:34:35.196748] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-09T21:34:35.996757] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-09T21:34:36.744189] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T21:34:36.796661] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-09T21:34:37.596728] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-09T21:34:38.135416] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-09T21:34:38.218044] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T21:34:38.396696] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-09T21:34:39.107898] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T21:34:39.196694] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-09T21:34:39.996718] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-09T21:34:40.645842] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T21:34:40.765262] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-09T21:34:40.796670] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-09T21:34:41.434748] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T21:34:41.596732] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-09T21:34:42.396768] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-09T21:34:42.982548] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T21:34:43.197124] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-09T21:34:43.197054] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T21:34:43.315556] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-09T21:34:43.552156] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T21:34:43.996753] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-09T21:34:44.796782] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-09T21:34:45.602455] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-09T21:34:45.618764] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T21:34:46.203468] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T21:34:46.297372] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T21:34:46.396674] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-09T21:34:47.196714] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-09T21:34:47.996776] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-09T21:34:48.257921] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T21:34:48.598282] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T21:34:48.739877] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-09T21:34:48.796679] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-09T21:34:49.596751] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-09T21:34:50.017907] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T21:34:50.019062] [INFO ] [REMOTE ] SNDA: Full fetch complete (7734 records). [2025-10-09T21:34:50.019135] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-09T21:34:50.396019] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-09T21:34:50.396376] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-09T21:34:50.396806] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-09T21:34:50.396899] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-09T21:34:50.396960] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-09T21:34:50.398703] [DEBUG] [LOCAL ] SNDA: Trimmed 7734 records to 4468 (keeping 200 days of data) [2025-10-09T21:34:50.427940] [DEBUG] [LOCAL ] SNDA: Primary data saved (4468 records). [2025-10-09T21:34:50.428080] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-09T21:34:50.428184] [INFO ] [MAIN ] Update Progress: 1952/2373 symbols completed. SNDA took 23.6s. Estimated remaining: 59m 16s. Rate: 7.1 symbols/min [2025-10-09T21:34:50.603048] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:34:50.659348] [DEBUG] [LOCAL ] SNOW: Loaded 53593 existing records from primary storage. [2025-10-09T21:34:50.659751] [INFO ] [MAIN ] SNOW: Loaded 53593 existing records. [2025-10-09T21:34:50.866524] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:34:50.876474] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-09T21:34:50.876603] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-09T21:34:50.877259] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-09T21:34:50.877319] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-09T21:34:50.878662] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-09T21:34:51.202875] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-09T21:34:51.243517] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:34:51.996753] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-09T21:34:52.064167] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T21:34:52.796781] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-09T21:34:53.571037] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T21:34:53.596664] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-09T21:34:53.722505] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-09T21:34:54.380280] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T21:34:54.396674] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-09T21:34:54.921732] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T21:34:55.196688] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-09T21:34:55.996701] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-09T21:34:56.028479] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T21:34:56.796722] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-09T21:34:57.457245] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-09T21:34:57.596678] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-09T21:34:58.396768] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-09T21:34:58.504008] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T21:34:58.604582] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-09T21:34:59.196771] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-09T21:34:59.896528] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T21:34:59.980750] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-09T21:34:59.996668] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-09T21:35:00.438707] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T21:35:00.796729] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-09T21:35:01.596778] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-09T21:35:02.396745] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-09T21:35:02.446775] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-09T21:35:02.978724] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T21:35:02.983560] [INFO ] [REMOTE ] SNDR: Full fetch complete (59617 records). [2025-10-09T21:35:02.983739] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-09T21:35:03.204576] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-09T21:35:03.410782] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-09T21:35:03.410950] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-09T21:35:03.412069] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-09T21:35:03.412236] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-09T21:35:03.414109] [DEBUG] [LOCAL ] SNDR: Trimmed 59617 records to 41466 (keeping 200 days of data) [2025-10-09T21:35:03.447838] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-09T21:35:03.720177] [DEBUG] [LOCAL ] SNDR: Primary data saved (41466 records). [2025-10-09T21:35:03.720329] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-09T21:35:03.720420] [INFO ] [MAIN ] Update Progress: 1953/2373 symbols completed. SNDR took 34.9s. Estimated remaining: 59m 8s. Rate: 7.1 symbols/min [2025-10-09T21:35:03.897199] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:35:03.928429] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T21:35:03.975229] [DEBUG] [LOCAL ] SNV: Loaded 48866 existing records from primary storage. [2025-10-09T21:35:03.975620] [INFO ] [MAIN ] SNV: Loaded 48866 existing records. [2025-10-09T21:35:04.007240] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-09T21:35:04.158321] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:35:04.158582] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-09T21:35:04.158632] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-09T21:35:04.158900] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-09T21:35:04.158957] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-09T21:35:04.514736] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:35:04.796769] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-09T21:35:05.154630] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T21:35:05.159525] [INFO ] [REMOTE ] SNN: Full fetch complete (63040 records). [2025-10-09T21:35:05.159768] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-09T21:35:05.305536] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-09T21:35:05.603689] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-09T21:35:05.604695] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-09T21:35:05.604826] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-09T21:35:05.605958] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-09T21:35:05.607223] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-09T21:35:05.608766] [DEBUG] [LOCAL ] SNN: Trimmed 63040 records to 44528 (keeping 200 days of data) [2025-10-09T21:35:05.918067] [DEBUG] [LOCAL ] SNN: Primary data saved (44528 records). [2025-10-09T21:35:05.918203] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-09T21:35:05.919150] [INFO ] [MAIN ] Update Progress: 1954/2373 symbols completed. SNN took 35.6s. Estimated remaining: 58m 59s. Rate: 7.1 symbols/min [2025-10-09T21:35:06.087457] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:35:06.127915] [DEBUG] [LOCAL ] SNX: Loaded 40038 existing records from primary storage. [2025-10-09T21:35:06.128235] [INFO ] [MAIN ] SNX: Loaded 40038 existing records. [2025-10-09T21:35:06.306167] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:35:06.306626] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-09T21:35:06.306824] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-09T21:35:06.307121] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-09T21:35:06.307184] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-09T21:35:06.398902] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-09T21:35:06.682703] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:35:06.713288] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T21:35:07.196732] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-09T21:35:07.823809] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-09T21:35:07.828843] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-10-09T21:35:07.829028] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-09T21:35:07.998188] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-09T21:35:08.242549] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-09T21:35:08.242634] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-09T21:35:08.243751] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-09T21:35:08.243816] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-09T21:35:08.245536] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 54186 (keeping 200 days of data) [2025-10-09T21:35:08.570614] [DEBUG] [LOCAL ] SNAP: Primary data saved (54186 records). [2025-10-09T21:35:08.570822] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-09T21:35:08.571062] [INFO ] [MAIN ] Update Progress: 1955/2373 symbols completed. SNAP took 48.9s. Estimated remaining: 58m 49s. Rate: 7.1 symbols/min [2025-10-09T21:35:08.750470] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:35:08.800186] [DEBUG] [LOCAL ] SO: Loaded 53609 existing records from primary storage. [2025-10-09T21:35:08.800621] [INFO ] [MAIN ] SO: Loaded 53609 existing records. [2025-10-09T21:35:09.009558] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:35:09.026215] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-09T21:35:09.026507] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-09T21:35:09.028909] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-09T21:35:09.029125] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-09T21:35:09.041083] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-09T21:35:09.041546] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-09T21:35:09.172589] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T21:35:09.575478] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:35:09.595090] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T21:35:09.604164] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-09T21:35:10.396730] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-09T21:35:10.880468] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T21:35:11.196720] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-09T21:35:11.478000] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-09T21:35:11.914580] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T21:35:11.996712] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-09T21:35:12.757494] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T21:35:12.796720] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-09T21:35:13.596680] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-09T21:35:13.793168] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T21:35:14.396714] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-09T21:35:14.450240] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T21:35:14.983704] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T21:35:15.196731] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-09T21:35:15.766118] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T21:35:15.996804] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-09T21:35:16.796713] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-09T21:35:16.946905] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T21:35:17.596740] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-09T21:35:17.988207] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-09T21:35:18.396723] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-09T21:35:18.709964] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T21:35:18.953866] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T21:35:19.196715] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-09T21:35:19.996724] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-09T21:35:20.796809] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-09T21:35:20.835501] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-09T21:35:20.875209] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T21:35:21.399078] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T21:35:21.596800] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-09T21:35:22.396709] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-09T21:35:22.450894] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T21:35:23.196825] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-09T21:35:23.738161] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-09T21:35:23.996695] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-09T21:35:24.087432] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T21:35:24.796685] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-09T21:35:25.063297] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T21:35:25.596705] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-09T21:35:26.101580] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T21:35:26.167016] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-09T21:35:26.396742] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-09T21:35:27.196745] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-09T21:35:27.373211] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T21:35:27.996685] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-09T21:35:28.588754] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-09T21:35:28.791996] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T21:35:28.801810] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-09T21:35:29.596719] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-09T21:35:29.792300] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T21:35:29.814543] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T21:35:29.819072] [INFO ] [REMOTE ] SNV: Full fetch complete (71312 records). [2025-10-09T21:35:29.819177] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-09T21:35:30.229026] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-09T21:35:30.229106] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-09T21:35:30.230149] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-09T21:35:30.230216] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-09T21:35:30.231557] [DEBUG] [LOCAL ] SNV: Trimmed 71312 records to 49251 (keeping 200 days of data) [2025-10-09T21:35:30.409821] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-09T21:35:30.537251] [DEBUG] [LOCAL ] SNV: Primary data saved (49251 records). [2025-10-09T21:35:30.537386] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-09T21:35:30.537466] [INFO ] [MAIN ] Update Progress: 1956/2373 symbols completed. SNV took 26.8s. Estimated remaining: 58m 43s. Rate: 7.1 symbols/min [2025-10-09T21:35:30.710170] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:35:30.780113] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T21:35:30.799878] [DEBUG] [LOCAL ] SOBO: Loaded 39274 existing records from primary storage. [2025-10-09T21:35:30.800146] [INFO ] [MAIN ] SOBO: Loaded 39274 existing records. [2025-10-09T21:35:30.974290] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:35:30.974511] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-09T21:35:30.974558] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-09T21:35:30.974774] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-09T21:35:30.974831] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-09T21:35:31.206587] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-09T21:35:31.331400] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:35:31.996738] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-09T21:35:32.237148] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T21:35:32.341370] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-09T21:35:32.347500] [INFO ] [REMOTE ] SNOW: Full fetch complete (77652 records). [2025-10-09T21:35:32.347624] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-09T21:35:32.742042] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-09T21:35:32.742128] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-09T21:35:32.743284] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-09T21:35:32.743350] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-09T21:35:32.744971] [DEBUG] [LOCAL ] SNOW: Trimmed 77652 records to 53983 (keeping 200 days of data) [2025-10-09T21:35:32.798988] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-09T21:35:33.088540] [DEBUG] [LOCAL ] SNOW: Primary data saved (53983 records). [2025-10-09T21:35:33.088711] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-09T21:35:33.088821] [INFO ] [MAIN ] Update Progress: 1957/2373 symbols completed. SNOW took 42.7s. Estimated remaining: 58m 34s. Rate: 7.1 symbols/min [2025-10-09T21:35:33.596718] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-09T21:35:33.709828] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T21:35:33.835389] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T21:35:34.396731] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-09T21:35:35.172606] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T21:35:35.196684] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-09T21:35:35.800594] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T21:35:35.996756] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-09T21:35:36.698430] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T21:35:36.796694] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-09T21:35:37.191805] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T21:35:37.196396] [INFO ] [REMOTE ] SO: Full fetch complete (77597 records). [2025-10-09T21:35:37.196519] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-09T21:35:37.608069] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-09T21:35:37.635437] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-09T21:35:37.635543] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-09T21:35:37.636900] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-09T21:35:37.636992] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-09T21:35:37.662417] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T21:35:37.661275] [DEBUG] [LOCAL ] SO: Trimmed 77597 records to 53999 (keeping 200 days of data) [2025-10-09T21:35:38.003913] [DEBUG] [LOCAL ] SO: Primary data saved (53999 records). [2025-10-09T21:35:38.004054] [INFO ] [MAIN ] SO: Full history saved. [2025-10-09T21:35:38.004136] [INFO ] [MAIN ] Update Progress: 1958/2373 symbols completed. SO took 29.4s. Estimated remaining: 58m 24s. Rate: 7.1 symbols/min [2025-10-09T21:35:38.396724] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-09T21:35:39.259128] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T21:35:39.268227] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-09T21:35:39.456535] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T21:35:39.996725] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-09T21:35:40.749900] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T21:35:40.753460] [INFO ] [REMOTE ] SNX: Full fetch complete (57217 records). [2025-10-09T21:35:40.753565] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-09T21:35:41.161711] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-09T21:35:41.161804] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-09T21:35:41.162994] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-09T21:35:41.163059] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-09T21:35:41.164236] [DEBUG] [LOCAL ] SNX: Trimmed 57217 records to 40296 (keeping 200 days of data) [2025-10-09T21:35:41.414894] [DEBUG] [LOCAL ] SNX: Primary data saved (40296 records). [2025-10-09T21:35:41.415154] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-09T21:35:41.415932] [INFO ] [MAIN ] Update Progress: 1959/2373 symbols completed. SNX took 35.5s. Estimated remaining: 58m 15s. Rate: 7.1 symbols/min [2025-10-09T21:35:41.603367] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T21:35:41.612810] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-09T21:35:42.851352] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T21:35:42.860473] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-09T21:35:44.421946] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T21:35:44.431413] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-09T21:35:45.901264] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T21:35:45.910379] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-09T21:35:47.350018] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T21:35:47.358247] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-09T21:35:48.739127] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T21:35:48.747547] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-09T21:35:50.219789] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T21:35:50.228335] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-09T21:35:51.531925] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T21:35:51.535548] [INFO ] [REMOTE ] SOBO: Full fetch complete (58237 records). [2025-10-09T21:35:51.535674] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-09T21:35:51.915267] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-09T21:35:51.915354] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-09T21:35:51.916301] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-09T21:35:51.916367] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-09T21:35:51.917721] [DEBUG] [LOCAL ] SOBO: Trimmed 58237 records to 39595 (keeping 200 days of data) [2025-10-09T21:35:52.192625] [DEBUG] [LOCAL ] SOBO: Primary data saved (39595 records). [2025-10-09T21:35:52.192805] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-09T21:35:52.192906] [INFO ] [MAIN ] Update Progress: 1960/2373 symbols completed. SOBO took 21.7s. Estimated remaining: 58m 7s. Rate: 7.1 symbols/min [2025-10-09T21:35:52.845330] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:35:52.908823] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:35:52.901725] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:35:52.927933] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:35:52.937198] [DEBUG] [LOCAL ] SOJC: Loaded 4981 existing records from primary storage. [2025-10-09T21:35:52.937625] [INFO ] [MAIN ] SOJC: Loaded 4981 existing records. [2025-10-09T21:35:53.058538] [DEBUG] [LOCAL ] SOJE: Loaded 9072 existing records from primary storage. [2025-10-09T21:35:53.058826] [INFO ] [MAIN ] SOJE: Loaded 9072 existing records. [2025-10-09T21:35:53.058215] [DEBUG] [LOCAL ] SOJD: Loaded 13003 existing records from primary storage. [2025-10-09T21:35:53.065179] [INFO ] [MAIN ] SOJD: Loaded 13003 existing records. [2025-10-09T21:35:53.362795] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:35:53.381276] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-09T21:35:53.415756] [DEBUG] [LOCAL ] SOC: Loaded 50643 existing records from primary storage. [2025-10-09T21:35:53.435353] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-09T21:35:53.441509] [INFO ] [MAIN ] SOC: Loaded 50643 existing records. [2025-10-09T21:35:53.446896] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-09T21:35:53.459256] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-09T21:35:53.520009] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:35:53.617057] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-09T21:35:53.660456] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-09T21:35:53.646350] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:35:53.681357] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-09T21:35:53.710118] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-09T21:35:53.704768] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-09T21:35:53.755354] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-09T21:35:53.817226] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-09T21:35:53.890570] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-09T21:35:54.124464] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:35:54.264161] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-09T21:35:54.326567] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-09T21:35:54.423408] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-09T21:35:54.443930] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-09T21:35:55.044188] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:35:55.066696] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-09T21:35:55.210927] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:35:55.265740] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:35:55.276499] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-09T21:35:55.261388] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-09T21:35:55.377346] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:35:55.377664] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-09T21:35:55.937023] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T21:35:55.940996] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-09T21:35:56.011245] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T21:35:56.013999] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-09T21:35:56.101098] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T21:35:56.105938] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-09T21:35:56.589682] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T21:35:56.597109] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-09T21:35:56.598161] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T21:35:56.601731] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-09T21:35:56.744242] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T21:35:56.754694] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-09T21:35:56.765104] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T21:35:56.769131] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-09T21:35:56.954938] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T21:35:56.956522] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-09T21:35:57.326708] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T21:35:57.329695] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-09T21:35:57.567364] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T21:35:57.569960] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-09T21:35:57.579242] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T21:35:57.596663] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-09T21:35:58.054011] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T21:35:58.059347] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T21:35:58.386722] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T21:35:58.396676] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-09T21:35:58.433675] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T21:35:59.196712] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-09T21:35:59.296052] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T21:35:59.879555] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T21:35:59.996689] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-09T21:36:00.617028] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T21:36:00.796777] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-09T21:36:01.596854] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-09T21:36:01.778032] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T21:36:02.221999] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T21:36:02.396781] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-09T21:36:03.196774] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-09T21:36:03.892859] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T21:36:03.998301] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-09T21:36:04.000604] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T21:36:04.796685] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-09T21:36:04.874408] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T21:36:05.179406] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-09T21:36:05.596740] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-09T21:36:06.336237] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T21:36:06.396777] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-09T21:36:06.904571] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T21:36:07.196750] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-09T21:36:07.996701] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-09T21:36:08.020215] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T21:36:08.352559] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-09T21:36:08.796717] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-09T21:36:09.596706] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-09T21:36:09.957173] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T21:36:10.205881] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T21:36:10.396746] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-09T21:36:11.196793] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-09T21:36:11.793371] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T21:36:11.851102] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T21:36:11.996683] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-09T21:36:12.796766] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-09T21:36:13.398419] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T21:36:13.399520] [INFO ] [REMOTE ] SOJE: Full fetch complete (13861 records). [2025-10-09T21:36:13.399588] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-09T21:36:13.601891] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-09T21:36:13.768186] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-09T21:36:13.768294] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-09T21:36:13.768679] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-09T21:36:13.768756] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-09T21:36:13.769468] [DEBUG] [LOCAL ] SOJE: Trimmed 13861 records to 9109 (keeping 200 days of data) [2025-10-09T21:36:13.825814] [DEBUG] [LOCAL ] SOJE: Primary data saved (9109 records). [2025-10-09T21:36:13.826002] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-09T21:36:13.826135] [INFO ] [MAIN ] Update Progress: 1961/2373 symbols completed. SOJE took 21.6s. Estimated remaining: 58m 1s. Rate: 7.1 symbols/min [2025-10-09T21:36:13.983004] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T21:36:14.042756] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:36:14.042976] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-09T21:36:14.043032] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-09T21:36:14.043153] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-09T21:36:14.043199] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-09T21:36:14.043239] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-09T21:36:14.043271] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-09T21:36:14.399503] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:36:14.399589] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-09T21:36:14.546371] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T21:36:14.847150] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T21:36:14.848480] [INFO ] [REMOTE ] SOJC: Full fetch complete (7590 records). [2025-10-09T21:36:14.848560] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-09T21:36:15.203135] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-09T21:36:15.216961] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-09T21:36:15.218022] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-09T21:36:15.218355] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-09T21:36:15.218414] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-09T21:36:15.219021] [DEBUG] [LOCAL ] SOJC: Trimmed 7590 records to 5009 (keeping 200 days of data) [2025-10-09T21:36:15.251492] [DEBUG] [LOCAL ] SOJC: Primary data saved (5009 records). [2025-10-09T21:36:15.251608] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-09T21:36:15.251722] [INFO ] [MAIN ] Update Progress: 1962/2373 symbols completed. SOJC took 23.1s. Estimated remaining: 57m 51s. Rate: 7.1 symbols/min [2025-10-09T21:36:15.419269] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:36:15.434283] [DEBUG] [LOCAL ] SOL: Loaded 12994 existing records from primary storage. [2025-10-09T21:36:15.434520] [INFO ] [MAIN ] SOL: Loaded 12994 existing records. [2025-10-09T21:36:15.478366] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:36:15.509232] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-09T21:36:15.520420] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:36:15.540177] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-09T21:36:15.543026] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:36:15.543114] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-09T21:36:15.543207] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-09T21:36:15.549060] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-09T21:36:15.554435] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-09T21:36:15.564913] [INFO ] [MAIN ] Update Progress: 1963/2373 symbols completed. SOJF took 1.7s. Estimated remaining: 57m 41s. Rate: 7.1 symbols/min [2025-10-09T21:36:15.737897] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:36:15.748742] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-09T21:36:15.773854] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-09T21:36:15.795967] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-09T21:36:15.799307] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-09T21:36:15.799231] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:36:16.012520] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-09T21:36:16.140095] [DEBUG] [LOCAL ] SOLV: Loaded 43920 existing records from primary storage. [2025-10-09T21:36:16.174934] [INFO ] [MAIN ] SOLV: Loaded 43920 existing records. [2025-10-09T21:36:16.195513] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:36:16.371211] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:36:16.371411] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-09T21:36:16.371458] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-09T21:36:16.371709] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-09T21:36:16.371767] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-09T21:36:16.725871] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:36:16.796682] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-09T21:36:16.895865] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T21:36:17.596716] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-09T21:36:18.239351] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T21:36:18.396696] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-09T21:36:18.536205] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T21:36:19.196772] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-09T21:36:19.709691] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T21:36:19.712080] [INFO ] [REMOTE ] SOJD: Full fetch complete (19442 records). [2025-10-09T21:36:19.712183] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-09T21:36:20.007032] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-09T21:36:20.181128] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-09T21:36:20.181265] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-09T21:36:20.182353] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-09T21:36:20.183456] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-09T21:36:20.183325] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T21:36:20.193111] [DEBUG] [LOCAL ] SOJD: Trimmed 19442 records to 13098 (keeping 200 days of data) [2025-10-09T21:36:20.274829] [DEBUG] [LOCAL ] SOJD: Primary data saved (13098 records). [2025-10-09T21:36:20.274977] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-09T21:36:20.275061] [INFO ] [MAIN ] Update Progress: 1964/2373 symbols completed. SOJD took 28.1s. Estimated remaining: 57m 32s. Rate: 7.1 symbols/min [2025-10-09T21:36:20.446016] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:36:20.493880] [DEBUG] [LOCAL ] SON: Loaded 43020 existing records from primary storage. [2025-10-09T21:36:20.494210] [INFO ] [MAIN ] SON: Loaded 43020 existing records. [2025-10-09T21:36:20.670195] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:36:20.670404] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-09T21:36:20.670451] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-09T21:36:20.670746] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-09T21:36:20.670804] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-09T21:36:20.808787] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-09T21:36:21.054197] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:36:21.596698] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-09T21:36:21.921524] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T21:36:21.945859] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T21:36:22.396746] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-09T21:36:23.022350] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T21:36:23.196758] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-09T21:36:23.478544] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T21:36:23.996736] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-09T21:36:24.656088] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T21:36:24.796726] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-09T21:36:25.522270] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T21:36:25.596684] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-09T21:36:26.266454] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T21:36:26.396689] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-09T21:36:27.196712] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-09T21:36:27.458848] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T21:36:28.001871] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-09T21:36:28.024109] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T21:36:28.369925] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T21:36:28.796700] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-09T21:36:29.499503] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T21:36:29.504155] [INFO ] [REMOTE ] SOC: Full fetch complete (71731 records). [2025-10-09T21:36:29.504275] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-09T21:36:29.602638] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-09T21:36:29.896358] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-09T21:36:29.896442] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-09T21:36:29.897480] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-09T21:36:29.897544] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-09T21:36:29.899958] [DEBUG] [LOCAL ] SOC: Trimmed 71731 records to 51018 (keeping 200 days of data) [2025-10-09T21:36:30.131832] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T21:36:30.239378] [DEBUG] [LOCAL ] SOC: Primary data saved (51018 records). [2025-10-09T21:36:30.239513] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-09T21:36:30.239596] [INFO ] [MAIN ] Update Progress: 1965/2373 symbols completed. SOC took 38.0s. Estimated remaining: 57m 24s. Rate: 7.1 symbols/min [2025-10-09T21:36:30.400680] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-09T21:36:30.418931] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:36:30.468872] [DEBUG] [LOCAL ] SONY: Loaded 53369 existing records from primary storage. [2025-10-09T21:36:30.469260] [INFO ] [MAIN ] SONY: Loaded 53369 existing records. [2025-10-09T21:36:30.648375] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:36:30.648609] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-09T21:36:30.648694] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-09T21:36:30.648931] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-09T21:36:30.648988] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-09T21:36:31.025128] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:36:31.096499] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T21:36:31.196689] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-09T21:36:31.612630] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T21:36:31.996692] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-09T21:36:32.202304] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T21:36:32.796696] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-09T21:36:32.866958] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T21:36:33.596794] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-09T21:36:34.396687] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-09T21:36:34.504185] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T21:36:35.049716] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T21:36:35.196726] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-09T21:36:35.558461] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T21:36:35.996756] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-09T21:36:36.554886] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T21:36:36.796733] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-09T21:36:36.915221] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T21:36:37.596720] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-09T21:36:38.396697] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-09T21:36:38.519675] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T21:36:38.826173] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T21:36:39.196726] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-09T21:36:39.996777] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-09T21:36:40.054984] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T21:36:40.313688] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T21:36:40.796729] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-09T21:36:41.007384] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T21:36:41.571853] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T21:36:41.596691] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-09T21:36:42.396692] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-09T21:36:42.547219] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T21:36:43.196759] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-09T21:36:43.941302] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T21:36:43.996673] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-09T21:36:44.050816] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T21:36:44.697305] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T21:36:44.796708] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-09T21:36:45.542984] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T21:36:45.544864] [INFO ] [REMOTE ] SOL: Full fetch complete (21383 records). [2025-10-09T21:36:45.544942] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-09T21:36:45.605362] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-09T21:36:45.904879] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-09T21:36:45.904978] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-09T21:36:45.905438] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-09T21:36:45.905479] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-09T21:36:45.906075] [DEBUG] [LOCAL ] SOL: Trimmed 21383 records to 13107 (keeping 200 days of data) [2025-10-09T21:36:45.983580] [DEBUG] [LOCAL ] SOL: Primary data saved (13107 records). [2025-10-09T21:36:45.983750] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-09T21:36:45.983873] [INFO ] [MAIN ] Update Progress: 1966/2373 symbols completed. SOL took 30.7s. Estimated remaining: 57m 17s. Rate: 7.1 symbols/min [2025-10-09T21:36:46.149602] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:36:46.154961] [DEBUG] [LOCAL ] SOR: Loaded 2879 existing records from primary storage. [2025-10-09T21:36:46.155141] [INFO ] [MAIN ] SOR: Loaded 2879 existing records. [2025-10-09T21:36:46.329785] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:36:46.330008] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-09T21:36:46.330077] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-09T21:36:46.330288] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-09T21:36:46.330358] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-09T21:36:46.402482] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-09T21:36:46.687292] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:36:46.700036] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T21:36:46.704589] [INFO ] [REMOTE ] SON: Full fetch complete (62450 records). [2025-10-09T21:36:46.704795] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-09T21:36:47.136158] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-09T21:36:47.136269] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-09T21:36:47.138165] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-09T21:36:47.138234] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-09T21:36:47.139867] [DEBUG] [LOCAL ] SON: Trimmed 62450 records to 43399 (keeping 200 days of data) [2025-10-09T21:36:47.197955] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-09T21:36:47.436866] [DEBUG] [LOCAL ] SON: Primary data saved (43399 records). [2025-10-09T21:36:47.437068] [INFO ] [MAIN ] SON: Full history saved. [2025-10-09T21:36:47.437779] [INFO ] [MAIN ] Update Progress: 1967/2373 symbols completed. SON took 27.2s. Estimated remaining: 57m 7s. Rate: 7.1 symbols/min [2025-10-09T21:36:47.630304] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:36:47.654051] [DEBUG] [LOCAL ] SOS: Loaded 9141 existing records from primary storage. [2025-10-09T21:36:47.654409] [INFO ] [MAIN ] SOS: Loaded 9141 existing records. [2025-10-09T21:36:47.842446] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:36:47.842808] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-09T21:36:47.842871] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-09T21:36:47.843129] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-09T21:36:47.843190] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-09T21:36:48.000704] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-09T21:36:48.242180] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:36:48.273035] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T21:36:48.792237] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T21:36:48.796695] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-09T21:36:48.822123] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T21:36:49.596729] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-09T21:36:50.396694] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-09T21:36:50.396584] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T21:36:50.681345] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T21:36:51.196735] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-09T21:36:51.856669] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T21:36:51.884958] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T21:36:51.996719] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-09T21:36:52.803865] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-09T21:36:52.807096] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T21:36:53.413954] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T21:36:53.596729] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-09T21:36:54.054507] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T21:36:54.396728] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-09T21:36:55.196779] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-09T21:36:55.996683] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-09T21:36:56.445094] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T21:36:56.445977] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T21:36:56.461354] [INFO ] [REMOTE ] SOLV: Full fetch complete (63342 records). [2025-10-09T21:36:56.461516] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-09T21:36:56.569139] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T21:36:56.804502] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-09T21:36:56.867269] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-09T21:36:56.867359] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-09T21:36:56.868730] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-09T21:36:56.868797] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-09T21:36:56.870280] [DEBUG] [LOCAL ] SOLV: Trimmed 63342 records to 44207 (keeping 200 days of data) [2025-10-09T21:36:57.140555] [DEBUG] [LOCAL ] SOLV: Primary data saved (44207 records). [2025-10-09T21:36:57.140716] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-09T21:36:57.140815] [INFO ] [MAIN ] Update Progress: 1968/2373 symbols completed. SOLV took 41.6s. Estimated remaining: 56m 59s. Rate: 7.1 symbols/min [2025-10-09T21:36:57.309170] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:36:57.316300] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T21:36:57.345750] [DEBUG] [LOCAL ] SPB: Loaded 34211 existing records from primary storage. [2025-10-09T21:36:57.346025] [INFO ] [MAIN ] SPB: Loaded 34211 existing records. [2025-10-09T21:36:57.521226] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:36:57.521427] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-09T21:36:57.521475] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-09T21:36:57.521715] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-09T21:36:57.521777] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-09T21:36:57.601808] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-09T21:36:57.886606] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:36:58.052749] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T21:36:58.396743] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-09T21:36:59.196676] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-09T21:36:59.390215] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T21:36:59.790716] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T21:36:59.996725] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-09T21:37:00.796732] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-09T21:37:01.258535] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T21:37:01.596746] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-09T21:37:02.134393] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-09T21:37:02.396702] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-09T21:37:02.868514] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T21:37:02.972227] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T21:37:03.196763] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-09T21:37:03.996738] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-09T21:37:04.458161] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T21:37:04.796717] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-09T21:37:05.596691] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-09T21:37:06.093502] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-09T21:37:06.094783] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T21:37:06.198140] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T21:37:06.396728] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-09T21:37:06.979818] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T21:37:07.196721] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-09T21:37:07.771980] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T21:37:07.996782] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-09T21:37:08.796737] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-09T21:37:09.094442] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T21:37:09.596733] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-09T21:37:09.997353] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-09T21:37:10.273511] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T21:37:10.396706] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-09T21:37:11.196756] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-09T21:37:11.677369] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-09T21:37:11.996771] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-09T21:37:12.465421] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-09T21:37:12.796724] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-09T21:37:13.325616] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T21:37:13.346714] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T21:37:13.596762] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-09T21:37:14.396686] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-09T21:37:14.418398] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T21:37:14.674410] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-09T21:37:14.675301] [INFO ] [REMOTE ] SOR: Full fetch complete (4407 records). [2025-10-09T21:37:14.675370] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-09T21:37:15.029963] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-09T21:37:15.030045] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-09T21:37:15.030173] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-09T21:37:15.030212] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-09T21:37:15.030566] [DEBUG] [LOCAL ] SOR: Trimmed 4407 records to 2909 (keeping 200 days of data) [2025-10-09T21:37:15.049039] [DEBUG] [LOCAL ] SOR: Primary data saved (2909 records). [2025-10-09T21:37:15.049104] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-09T21:37:15.049194] [INFO ] [MAIN ] Update Progress: 1969/2373 symbols completed. SOR took 29.1s. Estimated remaining: 56m 52s. Rate: 7.1 symbols/min [2025-10-09T21:37:15.216180] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-09T21:37:15.219794] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:37:15.266722] [DEBUG] [LOCAL ] SPCE: Loaded 49933 existing records from primary storage. [2025-10-09T21:37:15.267061] [INFO ] [MAIN ] SPCE: Loaded 49933 existing records. [2025-10-09T21:37:15.457345] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:37:15.457566] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-09T21:37:15.457615] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-09T21:37:15.457932] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-09T21:37:15.457991] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-09T21:37:15.821023] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:37:15.996755] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-09T21:37:16.796754] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-09T21:37:16.981462] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T21:37:17.596683] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-09T21:37:17.624841] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T21:37:17.885150] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T21:37:18.396747] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-09T21:37:19.023544] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T21:37:19.105206] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:37:19.106839] [INFO ] [REMOTE ] SOS: Full fetch complete (11160 records). [2025-10-09T21:37:19.106910] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-09T21:37:19.201825] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-09T21:37:19.488023] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-09T21:37:19.488100] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-09T21:37:19.488375] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-09T21:37:19.488413] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-09T21:37:19.488922] [DEBUG] [LOCAL ] SOS: Trimmed 11160 records to 9215 (keeping 200 days of data) [2025-10-09T21:37:19.543295] [DEBUG] [LOCAL ] SOS: Primary data saved (9215 records). [2025-10-09T21:37:19.543409] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-09T21:37:19.543489] [INFO ] [MAIN ] Update Progress: 1970/2373 symbols completed. SOS took 32.1s. Estimated remaining: 56m 43s. Rate: 7.1 symbols/min [2025-10-09T21:37:19.713195] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:37:19.721509] [DEBUG] [LOCAL ] SPE: Loaded 6289 existing records from primary storage. [2025-10-09T21:37:19.721702] [INFO ] [MAIN ] SPE: Loaded 6289 existing records. [2025-10-09T21:37:19.896459] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:37:19.896721] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-09T21:37:19.896779] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-09T21:37:19.896946] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-09T21:37:19.897004] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-09T21:37:20.001933] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-09T21:37:20.265974] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:37:20.557482] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T21:37:20.796730] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-09T21:37:21.528907] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T21:37:21.596738] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-09T21:37:22.070506] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-09T21:37:22.295893] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T21:37:22.396704] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-09T21:37:23.154496] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T21:37:23.196707] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-09T21:37:23.996796] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-09T21:37:24.593066] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T21:37:24.598730] [INFO ] [REMOTE ] SONY: Full fetch complete (77238 records). [2025-10-09T21:37:24.598844] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-09T21:37:24.804861] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-09T21:37:25.013708] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-09T21:37:25.013827] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-09T21:37:25.014934] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-09T21:37:25.014998] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-09T21:37:25.016913] [DEBUG] [LOCAL ] SONY: Trimmed 77238 records to 53756 (keeping 200 days of data) [2025-10-09T21:37:25.347960] [DEBUG] [LOCAL ] SONY: Primary data saved (53756 records). [2025-10-09T21:37:25.348104] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-09T21:37:25.348203] [INFO ] [MAIN ] Update Progress: 1971/2373 symbols completed. SONY took 55.1s. Estimated remaining: 56m 34s. Rate: 7.1 symbols/min [2025-10-09T21:37:25.523213] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T21:37:25.573196] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:37:25.597438] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-09T21:37:25.620194] [DEBUG] [LOCAL ] SPG: Loaded 50240 existing records from primary storage. [2025-10-09T21:37:25.620519] [INFO ] [MAIN ] SPG: Loaded 50240 existing records. [2025-10-09T21:37:25.816454] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:37:25.816819] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-09T21:37:25.817030] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-09T21:37:25.817326] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-09T21:37:25.817456] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-09T21:37:25.967605] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-09T21:37:26.237609] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:37:26.359574] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T21:37:26.396707] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-09T21:37:27.196773] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-09T21:37:27.788266] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T21:37:27.996782] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-09T21:37:28.721684] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T21:37:28.796752] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-09T21:37:29.607835] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-09T21:37:29.615107] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T21:37:30.215012] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T21:37:30.396690] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-09T21:37:30.554834] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T21:37:30.869231] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T21:37:31.196728] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-09T21:37:31.996713] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-09T21:37:32.713791] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T21:37:32.799755] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-09T21:37:32.804790] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T21:37:33.596741] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-09T21:37:34.198799] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T21:37:34.396735] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-09T21:37:35.196686] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-09T21:37:35.446015] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T21:37:35.996691] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-09T21:37:36.315170] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T21:37:36.489346] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T21:37:36.611436] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T21:37:36.796703] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-09T21:37:37.596708] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-09T21:37:38.396692] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-09T21:37:38.781002] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T21:37:39.196693] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-09T21:37:39.452767] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T21:37:39.465716] [INFO ] [REMOTE ] SPB: Full fetch complete (47567 records). [2025-10-09T21:37:39.472960] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-09T21:37:39.484618] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T21:37:39.873208] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-09T21:37:39.873296] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-09T21:37:39.874214] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-09T21:37:39.874279] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-09T21:37:39.875342] [DEBUG] [LOCAL ] SPB: Trimmed 47567 records to 34429 (keeping 200 days of data) [2025-10-09T21:37:39.996748] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-09T21:37:40.091962] [DEBUG] [LOCAL ] SPB: Primary data saved (34429 records). [2025-10-09T21:37:40.092090] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-09T21:37:40.092180] [INFO ] [MAIN ] Update Progress: 1972/2373 symbols completed. SPB took 43.0s. Estimated remaining: 56m 27s. Rate: 7.1 symbols/min [2025-10-09T21:37:40.260778] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:37:40.301214] [DEBUG] [LOCAL ] SPGI: Loaded 45763 existing records from primary storage. [2025-10-09T21:37:40.301504] [INFO ] [MAIN ] SPGI: Loaded 45763 existing records. [2025-10-09T21:37:40.485073] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:37:40.485335] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-09T21:37:40.485393] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-09T21:37:40.485607] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-09T21:37:40.485705] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-09T21:37:40.784436] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T21:37:40.851213] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:37:40.820698] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-09T21:37:41.376445] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-09T21:37:41.596716] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-09T21:37:42.396756] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-09T21:37:42.574170] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T21:37:43.196746] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-09T21:37:43.253727] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T21:37:43.996696] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-09T21:37:44.057523] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T21:37:44.796763] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-09T21:37:44.978868] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T21:37:45.596698] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-09T21:37:45.745155] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T21:37:46.008964] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T21:37:46.010168] [INFO ] [REMOTE ] SPE: Full fetch complete (9864 records). [2025-10-09T21:37:46.010288] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-09T21:37:46.396996] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-09T21:37:46.398090] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-09T21:37:46.399197] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-09T21:37:46.399804] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-09T21:37:46.399882] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-09T21:37:46.401378] [DEBUG] [LOCAL ] SPE: Trimmed 9864 records to 6317 (keeping 200 days of data) [2025-10-09T21:37:46.446521] [DEBUG] [LOCAL ] SPE: Primary data saved (6317 records). [2025-10-09T21:37:46.446858] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-09T21:37:46.447096] [INFO ] [MAIN ] Update Progress: 1973/2373 symbols completed. SPE took 26.9s. Estimated remaining: 56m 18s. Rate: 7.1 symbols/min [2025-10-09T21:37:46.656975] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:37:46.665206] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T21:37:46.695560] [DEBUG] [LOCAL ] SPH: Loaded 16887 existing records from primary storage. [2025-10-09T21:37:46.695947] [INFO ] [MAIN ] SPH: Loaded 16887 existing records. [2025-10-09T21:37:46.884572] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:37:46.884922] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-09T21:37:46.884974] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-09T21:37:46.885224] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-09T21:37:46.885282] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-09T21:37:47.201983] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-09T21:37:47.277606] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:37:47.886622] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T21:37:47.996707] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-09T21:37:48.796743] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-09T21:37:48.951973] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T21:37:49.413974] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T21:37:49.596694] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-09T21:37:49.912473] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T21:37:50.396690] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-09T21:37:51.196798] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-09T21:37:51.324216] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T21:37:51.349169] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T21:37:51.996772] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-09T21:37:52.801334] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-09T21:37:52.803320] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T21:37:52.978355] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T21:37:53.596702] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-09T21:37:54.396691] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-09T21:37:54.557118] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T21:37:55.196723] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-09T21:37:55.412826] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T21:37:55.516903] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T21:37:55.996724] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-09T21:37:56.670715] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T21:37:56.796690] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-09T21:37:57.596763] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-09T21:37:57.729505] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-09T21:37:57.734616] [INFO ] [REMOTE ] SPCE: Full fetch complete (72422 records). [2025-10-09T21:37:57.734785] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-09T21:37:58.021797] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T21:37:58.066723] [INFO ] [REMOTE ] SPG: Full fetch complete (71950 records). [2025-10-09T21:37:58.078635] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-09T21:37:58.288826] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-09T21:37:58.289055] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-09T21:37:58.306535] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-09T21:37:58.311782] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-09T21:37:58.391484] [DEBUG] [LOCAL ] SPCE: Trimmed 72422 records to 50318 (keeping 200 days of data) [2025-10-09T21:37:58.412072] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-09T21:37:58.729992] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T21:37:58.734034] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-09T21:37:58.743140] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-09T21:37:58.746205] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-09T21:37:58.746489] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-09T21:37:58.752632] [DEBUG] [LOCAL ] SPG: Trimmed 71950 records to 50593 (keeping 200 days of data) [2025-10-09T21:37:59.197786] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-09T21:37:59.279520] [DEBUG] [LOCAL ] SPCE: Primary data saved (50318 records). [2025-10-09T21:37:59.280193] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-09T21:37:59.280586] [INFO ] [MAIN ] Update Progress: 1974/2373 symbols completed. SPCE took 44.2s. Estimated remaining: 56m 11s. Rate: 7.1 symbols/min [2025-10-09T21:37:59.479720] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:37:59.479870] [DEBUG] [LOCAL ] SPG: Primary data saved (50593 records). [2025-10-09T21:37:59.480763] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-09T21:37:59.480970] [INFO ] [MAIN ] Update Progress: 1975/2373 symbols completed. SPG took 34.1s. Estimated remaining: 56m 1s. Rate: 7.1 symbols/min [2025-10-09T21:37:59.612162] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T21:37:59.686396] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:37:59.702601] [DEBUG] [LOCAL ] SPHR: Loaded 40341 existing records from primary storage. [2025-10-09T21:37:59.702969] [INFO ] [MAIN ] SPHR: Loaded 40341 existing records. [2025-10-09T21:37:59.895230] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:37:59.896238] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-09T21:37:59.896426] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-09T21:37:59.907674] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-09T21:37:59.907893] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-09T21:37:59.907781] [DEBUG] [LOCAL ] SPIR: Loaded 37392 existing records from primary storage. [2025-10-09T21:37:59.951777] [INFO ] [MAIN ] SPIR: Loaded 37392 existing records. [2025-10-09T21:38:00.023290] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-09T21:38:00.388055] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:38:00.399216] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-09T21:38:00.404488] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-09T21:38:00.434744] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-09T21:38:00.440268] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-09T21:38:00.537458] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:00.839595] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:00.808270] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-09T21:38:00.873876] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T21:38:01.149012] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T21:38:01.596815] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-09T21:38:02.221424] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T21:38:02.396767] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-09T21:38:02.997989] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T21:38:03.196709] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-09T21:38:03.511276] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T21:38:03.996749] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-09T21:38:04.327051] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T21:38:04.796737] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-09T21:38:05.596703] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-09T21:38:05.736554] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T21:38:05.737887] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T21:38:06.396730] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-09T21:38:06.962491] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T21:38:07.163588] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T21:38:07.196687] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-09T21:38:07.996700] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-09T21:38:08.101852] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T21:38:08.796708] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-09T21:38:09.336212] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T21:38:09.338123] [INFO ] [REMOTE ] SPH: Full fetch complete (27989 records). [2025-10-09T21:38:09.339691] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-09T21:38:09.610216] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-09T21:38:09.706013] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T21:38:09.747875] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-09T21:38:09.747961] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-09T21:38:09.748600] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-09T21:38:09.748673] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-09T21:38:09.749354] [DEBUG] [LOCAL ] SPH: Trimmed 27989 records to 16976 (keeping 200 days of data) [2025-10-09T21:38:09.859259] [DEBUG] [LOCAL ] SPH: Primary data saved (16976 records). [2025-10-09T21:38:09.859404] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-09T21:38:09.859513] [INFO ] [MAIN ] Update Progress: 1976/2373 symbols completed. SPH took 23.4s. Estimated remaining: 55m 52s. Rate: 7.1 symbols/min [2025-10-09T21:38:10.031714] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:38:10.039553] [DEBUG] [LOCAL ] SPMC: Loaded 5333 existing records from primary storage. [2025-10-09T21:38:10.039761] [INFO ] [MAIN ] SPMC: Loaded 5333 existing records. [2025-10-09T21:38:10.213987] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:38:10.214250] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-09T21:38:10.214299] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-09T21:38:10.214486] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-09T21:38:10.214544] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-09T21:38:10.406372] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-09T21:38:10.563455] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:11.196719] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-09T21:38:11.299055] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T21:38:11.868249] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T21:38:11.996710] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-09T21:38:12.546168] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T21:38:12.796725] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-09T21:38:13.258803] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T21:38:13.395518] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T21:38:13.596678] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-09T21:38:14.181428] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T21:38:14.396699] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-09T21:38:15.196726] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-09T21:38:15.390995] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.19 seconds). [2025-10-09T21:38:15.397144] [INFO ] [REMOTE ] SPGI: Full fetch complete (67144 records). [2025-10-09T21:38:15.397276] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-09T21:38:15.827164] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-09T21:38:15.827362] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-09T21:38:15.828771] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-09T21:38:15.836998] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-09T21:38:15.852242] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T21:38:15.862821] [DEBUG] [LOCAL ] SPGI: Trimmed 67144 records to 46139 (keeping 200 days of data) [2025-10-09T21:38:15.996846] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-09T21:38:16.184273] [DEBUG] [LOCAL ] SPGI: Primary data saved (46139 records). [2025-10-09T21:38:16.184420] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-09T21:38:16.184507] [INFO ] [MAIN ] Update Progress: 1977/2373 symbols completed. SPGI took 36.1s. Estimated remaining: 55m 44s. Rate: 7.1 symbols/min [2025-10-09T21:38:16.353486] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:38:16.353740] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-09T21:38:16.353789] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-09T21:38:16.353901] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-09T21:38:16.353987] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-09T21:38:16.354065] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-09T21:38:16.354106] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-09T21:38:16.715014] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:16.796732] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-09T21:38:17.390324] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T21:38:17.596705] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-09T21:38:18.406477] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-09T21:38:18.411503] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T21:38:18.596333] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:38:18.597373] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-09T21:38:18.597504] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:38:18.597581] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-09T21:38:18.597674] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:38:18.597776] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-09T21:38:18.597841] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-09T21:38:18.597878] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-09T21:38:18.597932] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-09T21:38:18.598002] [INFO ] [MAIN ] Update Progress: 1978/2373 symbols completed. SPME took 2.4s. Estimated remaining: 55m 34s. Rate: 7.1 symbols/min [2025-10-09T21:38:18.776557] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:38:18.838539] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T21:38:18.876876] [DEBUG] [LOCAL ] SPNT: Loaded 34716 existing records from primary storage. [2025-10-09T21:38:18.877260] [INFO ] [MAIN ] SPNT: Loaded 34716 existing records. [2025-10-09T21:38:19.084485] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:38:19.084737] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-09T21:38:19.084790] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-09T21:38:19.085032] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-09T21:38:19.085088] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-09T21:38:19.201918] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-09T21:38:19.434014] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:19.671006] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T21:38:19.996741] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-09T21:38:20.749079] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T21:38:20.796713] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-09T21:38:21.596802] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-09T21:38:22.397484] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-09T21:38:22.403265] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T21:38:22.999207] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T21:38:23.196676] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-09T21:38:23.746336] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T21:38:23.996682] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-09T21:38:24.400885] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T21:38:24.796733] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-09T21:38:25.279318] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T21:38:25.304284] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T21:38:25.596720] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-09T21:38:26.246396] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T21:38:26.396723] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-09T21:38:27.196721] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-09T21:38:27.698191] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T21:38:27.794867] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T21:38:27.996749] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-09T21:38:28.796718] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-09T21:38:29.325919] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T21:38:29.596721] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-09T21:38:29.989525] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T21:38:30.396723] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-09T21:38:31.004191] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T21:38:31.196721] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-09T21:38:31.971140] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T21:38:31.996674] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-09T21:38:32.240997] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T21:38:32.796721] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-09T21:38:33.390748] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T21:38:33.471812] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T21:38:33.475531] [INFO ] [REMOTE ] SPIR: Full fetch complete (53438 records). [2025-10-09T21:38:33.475634] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-09T21:38:33.601822] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-09T21:38:33.872327] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-09T21:38:33.872410] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-09T21:38:33.873316] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-09T21:38:33.873378] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-09T21:38:33.874497] [DEBUG] [LOCAL ] SPIR: Trimmed 53438 records to 37664 (keeping 200 days of data) [2025-10-09T21:38:34.093527] [DEBUG] [LOCAL ] SPIR: Primary data saved (37664 records). [2025-10-09T21:38:34.093715] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-09T21:38:34.094129] [INFO ] [MAIN ] Update Progress: 1979/2373 symbols completed. SPIR took 34.6s. Estimated remaining: 55m 27s. Rate: 7.1 symbols/min [2025-10-09T21:38:34.267272] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:38:34.315806] [DEBUG] [LOCAL ] SPOT: Loaded 50455 existing records from primary storage. [2025-10-09T21:38:34.316197] [INFO ] [MAIN ] SPOT: Loaded 50455 existing records. [2025-10-09T21:38:34.405345] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-09T21:38:34.495105] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:38:34.495307] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-09T21:38:34.495354] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-09T21:38:34.495626] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-09T21:38:34.495717] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-09T21:38:34.854710] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:34.877438] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T21:38:35.196703] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-09T21:38:35.853290] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T21:38:35.996785] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-09T21:38:36.796769] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-09T21:38:36.875511] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T21:38:37.372958] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T21:38:37.596697] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-09T21:38:37.789462] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T21:38:38.396716] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-09T21:38:38.788061] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T21:38:39.196787] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-09T21:38:39.705835] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T21:38:39.709855] [INFO ] [REMOTE ] SPHR: Full fetch complete (58102 records). [2025-10-09T21:38:39.709976] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-09T21:38:40.002009] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-09T21:38:40.100629] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-09T21:38:40.100739] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-09T21:38:40.101814] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-09T21:38:40.101992] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-09T21:38:40.103199] [DEBUG] [LOCAL ] SPHR: Trimmed 58102 records to 40671 (keeping 200 days of data) [2025-10-09T21:38:40.328562] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T21:38:40.368507] [DEBUG] [LOCAL ] SPHR: Primary data saved (40671 records). [2025-10-09T21:38:40.368628] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-09T21:38:40.368767] [INFO ] [MAIN ] Update Progress: 1980/2373 symbols completed. SPHR took 41.1s. Estimated remaining: 55m 18s. Rate: 7.1 symbols/min [2025-10-09T21:38:40.538771] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:38:40.577005] [DEBUG] [LOCAL ] SPR: Loaded 41057 existing records from primary storage. [2025-10-09T21:38:40.577315] [INFO ] [MAIN ] SPR: Loaded 41057 existing records. [2025-10-09T21:38:40.751269] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:38:40.751506] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-09T21:38:40.751552] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-09T21:38:40.751930] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-09T21:38:40.751987] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-09T21:38:40.804813] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-09T21:38:41.103012] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:41.480313] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T21:38:41.596698] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-09T21:38:41.776255] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T21:38:42.396718] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-09T21:38:42.883368] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T21:38:42.884343] [INFO ] [REMOTE ] SPMC: Full fetch complete (8095 records). [2025-10-09T21:38:42.884412] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-09T21:38:43.200579] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-09T21:38:43.300582] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-09T21:38:43.299784] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T21:38:43.300733] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-09T21:38:43.309255] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-09T21:38:43.309800] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-09T21:38:43.310860] [DEBUG] [LOCAL ] SPMC: Trimmed 8095 records to 5366 (keeping 200 days of data) [2025-10-09T21:38:43.347984] [DEBUG] [LOCAL ] SPMC: Primary data saved (5366 records). [2025-10-09T21:38:43.348129] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-09T21:38:43.348217] [INFO ] [MAIN ] Update Progress: 1981/2373 symbols completed. SPMC took 33.5s. Estimated remaining: 55m 9s. Rate: 7.1 symbols/min [2025-10-09T21:38:43.515939] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:38:43.527129] [DEBUG] [LOCAL ] SPRU: Loaded 9534 existing records from primary storage. [2025-10-09T21:38:43.527324] [INFO ] [MAIN ] SPRU: Loaded 9534 existing records. [2025-10-09T21:38:43.702296] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:38:43.702562] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-09T21:38:43.702634] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-09T21:38:43.702910] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-09T21:38:43.702981] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-09T21:38:44.001805] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-09T21:38:44.061555] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:44.796694] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-09T21:38:45.461779] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-09T21:38:45.488528] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T21:38:45.512877] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T21:38:45.596719] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-09T21:38:46.396726] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-09T21:38:46.646449] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T21:38:47.196757] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-09T21:38:47.910851] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T21:38:47.996728] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-09T21:38:48.083128] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T21:38:48.086059] [INFO ] [REMOTE ] SPNT: Full fetch complete (48815 records). [2025-10-09T21:38:48.086141] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-09T21:38:48.463588] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-09T21:38:48.463935] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-09T21:38:48.464887] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-09T21:38:48.465216] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-09T21:38:48.466372] [DEBUG] [LOCAL ] SPNT: Trimmed 48815 records to 34903 (keeping 200 days of data) [2025-10-09T21:38:48.661073] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T21:38:48.694320] [DEBUG] [LOCAL ] SPNT: Primary data saved (34903 records). [2025-10-09T21:38:48.694488] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-09T21:38:48.694579] [INFO ] [MAIN ] Update Progress: 1982/2373 symbols completed. SPNT took 30.1s. Estimated remaining: 54m 59s. Rate: 7.1 symbols/min [2025-10-09T21:38:48.801972] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-09T21:38:48.889497] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:38:48.913725] [DEBUG] [LOCAL ] SPXC: Loaded 23256 existing records from primary storage. [2025-10-09T21:38:48.913998] [INFO ] [MAIN ] SPXC: Loaded 23256 existing records. [2025-10-09T21:38:49.089316] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:38:49.089664] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-09T21:38:49.089737] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-09T21:38:49.090151] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-09T21:38:49.090210] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-09T21:38:49.441851] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:38:49.596709] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-09T21:38:50.402263] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-09T21:38:50.404019] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T21:38:50.677153] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T21:38:50.966351] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T21:38:51.196720] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-09T21:38:51.776322] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T21:38:51.996721] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-09T21:38:52.602040] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T21:38:52.796747] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-09T21:38:53.596760] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-09T21:38:54.004532] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T21:38:54.396758] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-09T21:38:55.196841] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-09T21:38:55.488575] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T21:38:55.643806] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T21:38:55.996742] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-09T21:38:56.053184] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-09T21:38:56.796705] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-09T21:38:57.471830] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T21:38:57.596717] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-09T21:38:58.396712] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-09T21:38:58.734080] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T21:38:58.773498] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T21:38:58.983588] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T21:38:59.196736] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-09T21:38:59.996749] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-09T21:39:00.026012] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T21:39:00.796783] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-09T21:39:00.932836] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T21:39:01.596744] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-09T21:39:02.396796] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-09T21:39:02.711813] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T21:39:02.767095] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T21:39:03.196687] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-09T21:39:03.520688] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T21:39:03.996774] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-09T21:39:04.764036] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T21:39:04.796720] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-09T21:39:05.039989] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T21:39:05.596736] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-09T21:39:06.396697] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-09T21:39:06.426237] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T21:39:07.196780] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-09T21:39:07.452823] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T21:39:07.867262] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-09T21:39:07.996721] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-09T21:39:08.669945] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:39:08.799933] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-09T21:39:08.803265] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T21:39:09.596733] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-09T21:39:09.627150] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T21:39:10.396785] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-09T21:39:11.026501] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T21:39:11.153861] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T21:39:11.155574] [INFO ] [REMOTE ] SPRU: Full fetch complete (11942 records). [2025-10-09T21:39:11.155671] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-09T21:39:11.201886] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-09T21:39:11.518049] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-09T21:39:11.518127] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-09T21:39:11.518405] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-09T21:39:11.518445] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-09T21:39:11.518930] [DEBUG] [LOCAL ] SPRU: Trimmed 11942 records to 9627 (keeping 200 days of data) [2025-10-09T21:39:11.576271] [DEBUG] [LOCAL ] SPRU: Primary data saved (9627 records). [2025-10-09T21:39:11.576415] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-09T21:39:11.576501] [INFO ] [MAIN ] Update Progress: 1983/2373 symbols completed. SPRU took 28.2s. Estimated remaining: 54m 54s. Rate: 7.1 symbols/min [2025-10-09T21:39:11.754311] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:39:11.767909] [DEBUG] [LOCAL ] SPXX: Loaded 9456 existing records from primary storage. [2025-10-09T21:39:11.768270] [INFO ] [MAIN ] SPXX: Loaded 9456 existing records. [2025-10-09T21:39:11.978778] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:39:11.979022] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-09T21:39:11.979071] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-09T21:39:11.979267] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-09T21:39:11.979325] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-09T21:39:12.003574] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-09T21:39:12.350136] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:39:12.466809] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T21:39:12.796778] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-09T21:39:13.596750] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-09T21:39:13.790665] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T21:39:13.792888] [INFO ] [REMOTE ] SPXC: Full fetch complete (34061 records). [2025-10-09T21:39:13.792960] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-09T21:39:14.220987] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-09T21:39:14.221097] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-09T21:39:14.222100] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-09T21:39:14.222287] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-09T21:39:14.223632] [DEBUG] [LOCAL ] SPXC: Trimmed 34061 records to 23389 (keeping 200 days of data) [2025-10-09T21:39:14.365029] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-09T21:39:14.396948] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-09T21:39:14.429527] [DEBUG] [LOCAL ] SPXC: Primary data saved (23389 records). [2025-10-09T21:39:14.429721] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-09T21:39:14.429825] [INFO ] [MAIN ] Update Progress: 1984/2373 symbols completed. SPXC took 25.7s. Estimated remaining: 54m 44s. Rate: 7.1 symbols/min [2025-10-09T21:39:14.612555] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:39:14.640975] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T21:39:14.684635] [DEBUG] [LOCAL ] SQM: Loaded 48630 existing records from primary storage. [2025-10-09T21:39:14.685048] [INFO ] [MAIN ] SQM: Loaded 48630 existing records. [2025-10-09T21:39:14.896537] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:39:14.896856] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-09T21:39:14.896913] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-09T21:39:14.897146] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-09T21:39:14.897204] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-09T21:39:15.202574] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-09T21:39:15.290230] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:39:15.935082] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T21:39:15.996688] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-09T21:39:16.479227] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-09T21:39:16.495933] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-09T21:39:16.796737] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-09T21:39:17.596716] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-09T21:39:18.241144] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T21:39:18.255549] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T21:39:18.396711] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-09T21:39:19.196722] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-09T21:39:19.828521] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T21:39:20.004731] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-09T21:39:20.008590] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T21:39:20.796778] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-09T21:39:21.433801] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T21:39:21.596721] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-09T21:39:22.234527] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T21:39:22.396730] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-09T21:39:22.978620] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T21:39:22.982563] [INFO ] [REMOTE ] SPR: Full fetch complete (60101 records). [2025-10-09T21:39:22.982715] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-09T21:39:23.207188] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-09T21:39:23.370718] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-09T21:39:23.370814] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-09T21:39:23.371804] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-09T21:39:23.371869] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-09T21:39:23.373168] [DEBUG] [LOCAL ] SPR: Trimmed 60101 records to 41394 (keeping 200 days of data) [2025-10-09T21:39:23.625106] [DEBUG] [LOCAL ] SPR: Primary data saved (41394 records). [2025-10-09T21:39:23.625242] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-09T21:39:23.625326] [INFO ] [MAIN ] Update Progress: 1985/2373 symbols completed. SPR took 43.3s. Estimated remaining: 54m 36s. Rate: 7.1 symbols/min [2025-10-09T21:39:23.792564] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:39:23.820996] [DEBUG] [LOCAL ] SQNS: Loaded 26949 existing records from primary storage. [2025-10-09T21:39:23.821282] [INFO ] [MAIN ] SQNS: Loaded 26949 existing records. [2025-10-09T21:39:23.997226] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-09T21:39:24.001984] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:39:24.003388] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-09T21:39:24.003509] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-09T21:39:24.003871] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-09T21:39:24.003933] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-09T21:39:24.142667] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T21:39:24.206260] [INFO ] [REMOTE ] SPOT: Full fetch complete (73659 records). [2025-10-09T21:39:24.234408] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-09T21:39:24.546952] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:39:24.758824] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T21:39:24.807826] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-09T21:39:24.854301] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-09T21:39:24.869020] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-09T21:39:24.879847] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-09T21:39:24.880293] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-09T21:39:24.882234] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T21:39:24.892940] [DEBUG] [LOCAL ] SPOT: Trimmed 73659 records to 50814 (keeping 200 days of data) [2025-10-09T21:39:25.212083] [DEBUG] [LOCAL ] SPOT: Primary data saved (50814 records). [2025-10-09T21:39:25.212260] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-09T21:39:25.212363] [INFO ] [MAIN ] Update Progress: 1986/2373 symbols completed. SPOT took 51.1s. Estimated remaining: 54m 26s. Rate: 7.1 symbols/min [2025-10-09T21:39:25.377213] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:39:25.409519] [DEBUG] [LOCAL ] SR: Loaded 32604 existing records from primary storage. [2025-10-09T21:39:25.409840] [INFO ] [MAIN ] SR: Loaded 32604 existing records. [2025-10-09T21:39:25.584344] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:39:25.584516] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-09T21:39:25.584564] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-09T21:39:25.584801] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-09T21:39:25.584858] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-09T21:39:25.604880] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-09T21:39:25.889024] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T21:39:25.958259] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:39:26.379863] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T21:39:26.396675] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-09T21:39:27.196702] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-09T21:39:27.208592] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T21:39:27.996729] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-09T21:39:28.502131] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T21:39:28.600259] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T21:39:28.796759] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-09T21:39:29.596725] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-09T21:39:30.128638] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T21:39:30.396701] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-09T21:39:30.713982] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T21:39:31.196726] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-09T21:39:31.772475] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T21:39:31.996716] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-09T21:39:32.681283] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T21:39:32.716101] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T21:39:32.796727] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-09T21:39:33.596738] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-09T21:39:34.251793] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T21:39:34.396687] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-09T21:39:34.525728] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T21:39:35.196729] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-09T21:39:35.797921] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T21:39:35.996751] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-09T21:39:36.084573] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T21:39:36.796754] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-09T21:39:37.279758] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T21:39:37.596751] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-09T21:39:38.381990] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T21:39:38.406378] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-09T21:39:38.424811] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T21:39:39.196760] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-09T21:39:39.619809] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T21:39:39.996730] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-09T21:39:40.652376] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-09T21:39:40.796723] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-09T21:39:40.947866] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T21:39:41.577188] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T21:39:41.596673] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-09T21:39:42.357379] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T21:39:42.359743] [INFO ] [REMOTE ] SPXX: Full fetch complete (13364 records). [2025-10-09T21:39:42.359813] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-09T21:39:42.401929] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-09T21:39:42.720231] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-09T21:39:42.720317] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-09T21:39:42.720724] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-09T21:39:42.720786] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-09T21:39:42.721309] [DEBUG] [LOCAL ] SPXX: Trimmed 13364 records to 9562 (keeping 200 days of data) [2025-10-09T21:39:42.781756] [DEBUG] [LOCAL ] SPXX: Primary data saved (9562 records). [2025-10-09T21:39:42.781896] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-09T21:39:42.782016] [INFO ] [MAIN ] Update Progress: 1987/2373 symbols completed. SPXX took 31.2s. Estimated remaining: 54m 20s. Rate: 7.1 symbols/min [2025-10-09T21:39:42.953585] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:39:43.008984] [DEBUG] [LOCAL ] SRE: Loaded 53414 existing records from primary storage. [2025-10-09T21:39:43.009385] [INFO ] [MAIN ] SRE: Loaded 53414 existing records. [2025-10-09T21:39:43.186629] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:39:43.186937] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-09T21:39:43.187000] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-09T21:39:43.187260] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-09T21:39:43.187318] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-09T21:39:43.201818] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-09T21:39:43.541514] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:39:43.821247] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T21:39:43.996684] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-09T21:39:44.029962] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T21:39:44.796730] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-09T21:39:45.302974] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T21:39:45.596722] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-09T21:39:46.396704] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-09T21:39:46.463357] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T21:39:46.468350] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T21:39:47.196784] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-09T21:39:47.996700] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-09T21:39:48.186691] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T21:39:48.796724] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-09T21:39:49.057278] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T21:39:49.553071] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T21:39:49.596682] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-09T21:39:50.322708] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T21:39:50.396686] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-09T21:39:50.839136] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T21:39:50.843967] [INFO ] [REMOTE ] SQM: Full fetch complete (69185 records). [2025-10-09T21:39:50.844117] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-09T21:39:51.202071] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-09T21:39:51.306136] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-09T21:39:51.306217] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-09T21:39:51.307318] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-09T21:39:51.307386] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-09T21:39:51.308952] [DEBUG] [LOCAL ] SQM: Trimmed 69185 records to 49015 (keeping 200 days of data) [2025-10-09T21:39:51.596677] [DEBUG] [LOCAL ] SQM: Primary data saved (49015 records). [2025-10-09T21:39:51.596821] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-09T21:39:51.596928] [INFO ] [MAIN ] Update Progress: 1988/2373 symbols completed. SQM took 37.2s. Estimated remaining: 54m 11s. Rate: 7.1 symbols/min [2025-10-09T21:39:51.766571] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:39:51.780185] [DEBUG] [LOCAL ] SREA: Loaded 10258 existing records from primary storage. [2025-10-09T21:39:51.780483] [INFO ] [MAIN ] SREA: Loaded 10258 existing records. [2025-10-09T21:39:51.970178] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:39:51.991556] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-09T21:39:51.992461] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T21:39:51.992720] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-09T21:39:52.000403] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-09T21:39:52.000746] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-09T21:39:52.013220] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-09T21:39:52.396463] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:39:52.796733] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-09T21:39:52.909130] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T21:39:53.596749] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-09T21:39:53.823480] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T21:39:53.921073] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T21:39:54.396706] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-09T21:39:54.527534] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T21:39:55.196818] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-09T21:39:55.730068] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T21:39:55.996722] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-09T21:39:56.382493] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T21:39:56.796715] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-09T21:39:57.220289] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T21:39:57.223399] [INFO ] [REMOTE ] SR: Full fetch complete (46146 records). [2025-10-09T21:39:57.223493] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-09T21:39:57.607559] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-09T21:39:57.628545] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-09T21:39:57.628717] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-09T21:39:57.630234] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-09T21:39:57.630559] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-09T21:39:57.632748] [DEBUG] [LOCAL ] SR: Trimmed 46146 records to 32794 (keeping 200 days of data) [2025-10-09T21:39:57.864428] [DEBUG] [LOCAL ] SR: Primary data saved (32794 records). [2025-10-09T21:39:57.864681] [INFO ] [MAIN ] SR: Full history saved. [2025-10-09T21:39:57.864820] [INFO ] [MAIN ] Update Progress: 1989/2373 symbols completed. SR took 32.7s. Estimated remaining: 54m 2s. Rate: 7.1 symbols/min [2025-10-09T21:39:58.045407] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:39:58.080513] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T21:39:58.083816] [INFO ] [REMOTE ] SQNS: Full fetch complete (32718 records). [2025-10-09T21:39:58.083923] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-09T21:39:58.211582] [DEBUG] [LOCAL ] SRFM: Loaded 37831 existing records from primary storage. [2025-10-09T21:39:58.223213] [INFO ] [MAIN ] SRFM: Loaded 37831 existing records. [2025-10-09T21:39:58.412160] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-09T21:39:58.637525] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:39:58.648166] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-09T21:39:58.653377] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-09T21:39:58.684372] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-09T21:39:58.693924] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-09T21:39:58.837791] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-09T21:39:58.841364] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-09T21:39:58.842276] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-09T21:39:58.842789] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-09T21:39:58.902891] [DEBUG] [LOCAL ] SQNS: Trimmed 32718 records to 27209 (keeping 200 days of data) [2025-10-09T21:39:59.285821] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:39:59.306287] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-09T21:39:59.324343] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T21:39:59.333742] [DEBUG] [LOCAL ] SQNS: Primary data saved (27209 records). [2025-10-09T21:39:59.334457] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-09T21:39:59.335210] [INFO ] [MAIN ] Update Progress: 1990/2373 symbols completed. SQNS took 35.7s. Estimated remaining: 53m 53s. Rate: 7.1 symbols/min [2025-10-09T21:39:59.530124] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:39:59.570193] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T21:39:59.589057] [DEBUG] [LOCAL ] SRG: Loaded 15365 existing records from primary storage. [2025-10-09T21:39:59.589355] [INFO ] [MAIN ] SRG: Loaded 15365 existing records. [2025-10-09T21:39:59.779075] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:39:59.779314] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-09T21:39:59.779362] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-09T21:39:59.779578] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-09T21:39:59.779670] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-09T21:40:00.006504] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-09T21:40:00.170860] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:40:00.796917] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-09T21:40:01.009279] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T21:40:01.596752] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-09T21:40:01.937366] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T21:40:01.965298] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T21:40:02.396711] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-09T21:40:03.201785] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-09T21:40:03.210602] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T21:40:03.419029] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T21:40:03.996724] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-09T21:40:04.796770] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-09T21:40:05.006884] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T21:40:05.011292] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T21:40:05.596798] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-09T21:40:05.809717] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T21:40:06.396702] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-09T21:40:07.102365] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T21:40:07.188058] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T21:40:07.196667] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-09T21:40:07.962407] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T21:40:07.996675] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-09T21:40:08.796695] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-09T21:40:08.924077] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T21:40:09.596706] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-09T21:40:10.319138] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T21:40:10.396676] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-09T21:40:10.606243] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T21:40:11.196723] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-09T21:40:11.775136] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T21:40:11.996741] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-09T21:40:12.126518] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T21:40:12.796767] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-09T21:40:13.207977] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T21:40:13.596736] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-09T21:40:14.391820] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T21:40:14.402277] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-09T21:40:14.585337] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T21:40:15.196732] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-09T21:40:15.646378] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T21:40:15.981888] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T21:40:15.996675] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-09T21:40:16.654456] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T21:40:16.796745] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-09T21:40:17.398661] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T21:40:17.596753] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-09T21:40:18.396726] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-09T21:40:18.421570] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T21:40:19.196794] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-09T21:40:19.410280] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T21:40:19.996755] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-09T21:40:20.071256] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-09T21:40:20.256934] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-09T21:40:20.262546] [INFO ] [REMOTE ] SRE: Full fetch complete (77291 records). [2025-10-09T21:40:20.262750] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-09T21:40:20.648592] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-09T21:40:20.648715] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-09T21:40:20.649823] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-09T21:40:20.649888] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-09T21:40:20.651379] [DEBUG] [LOCAL ] SRE: Trimmed 77291 records to 53804 (keeping 200 days of data) [2025-10-09T21:40:20.836380] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-09T21:40:20.995813] [DEBUG] [LOCAL ] SRE: Primary data saved (53804 records). [2025-10-09T21:40:20.995956] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-09T21:40:20.996694] [INFO ] [MAIN ] Update Progress: 1991/2373 symbols completed. SRE took 38.2s. Estimated remaining: 53m 47s. Rate: 7.1 symbols/min [2025-10-09T21:40:21.162861] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:40:21.189320] [DEBUG] [LOCAL ] SRI: Loaded 26723 existing records from primary storage. [2025-10-09T21:40:21.189590] [INFO ] [MAIN ] SRI: Loaded 26723 existing records. [2025-10-09T21:40:21.362516] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:40:21.362744] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-09T21:40:21.362796] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-09T21:40:21.363029] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-09T21:40:21.363086] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-09T21:40:21.601929] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-09T21:40:21.720002] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:40:21.906348] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T21:40:22.396771] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-09T21:40:22.826963] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T21:40:23.196729] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-09T21:40:23.379882] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T21:40:23.996742] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-09T21:40:24.487585] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T21:40:24.570200] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:40:24.571733] [INFO ] [REMOTE ] SRG: Full fetch complete (23981 records). [2025-10-09T21:40:24.571805] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-09T21:40:24.802036] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-09T21:40:24.951545] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-09T21:40:24.951629] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-09T21:40:24.952176] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-09T21:40:24.952228] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-09T21:40:24.952980] [DEBUG] [LOCAL ] SRG: Trimmed 23981 records to 15439 (keeping 200 days of data) [2025-10-09T21:40:25.041252] [DEBUG] [LOCAL ] SRG: Primary data saved (15439 records). [2025-10-09T21:40:25.041392] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-09T21:40:25.041493] [INFO ] [MAIN ] Update Progress: 1992/2373 symbols completed. SRG took 25.7s. Estimated remaining: 53m 37s. Rate: 7.1 symbols/min [2025-10-09T21:40:25.217412] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:40:25.217597] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-09T21:40:25.217685] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-09T21:40:25.217830] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-09T21:40:25.217874] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-09T21:40:25.217913] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-09T21:40:25.217961] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-09T21:40:25.601831] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-09T21:40:25.606818] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:40:25.795160] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T21:40:26.396714] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-09T21:40:27.196723] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-09T21:40:27.423716] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T21:40:27.750152] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T21:40:27.926964] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T21:40:27.996700] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-09T21:40:28.432767] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T21:40:28.433967] [INFO ] [REMOTE ] SREA: Full fetch complete (15347 records). [2025-10-09T21:40:28.434035] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-09T21:40:28.800233] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-09T21:40:28.809484] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-09T21:40:28.809576] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-09T21:40:28.809952] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-09T21:40:28.810014] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-09T21:40:28.810685] [DEBUG] [LOCAL ] SREA: Trimmed 15347 records to 10293 (keeping 200 days of data) [2025-10-09T21:40:28.875423] [DEBUG] [LOCAL ] SREA: Primary data saved (10293 records). [2025-10-09T21:40:28.875569] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-09T21:40:28.875718] [INFO ] [MAIN ] Update Progress: 1993/2373 symbols completed. SREA took 37.3s. Estimated remaining: 53m 28s. Rate: 7.1 symbols/min [2025-10-09T21:40:29.048929] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:40:29.058968] [DEBUG] [LOCAL ] SRV: Loaded 7374 existing records from primary storage. [2025-10-09T21:40:29.059224] [INFO ] [MAIN ] SRV: Loaded 7374 existing records. [2025-10-09T21:40:29.234203] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:40:29.234425] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-09T21:40:29.234481] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-09T21:40:29.234623] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-09T21:40:29.234722] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-09T21:40:29.303292] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-09T21:40:29.596737] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-09T21:40:29.610716] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:40:30.396719] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-09T21:40:30.467499] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T21:40:31.120604] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T21:40:31.196690] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-09T21:40:31.745371] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-09T21:40:31.996801] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-09T21:40:32.796711] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-09T21:40:32.894714] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T21:40:33.200769] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T21:40:33.596723] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-09T21:40:34.396854] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-09T21:40:34.816922] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T21:40:35.196750] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-09T21:40:35.996779] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-09T21:40:36.404375] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T21:40:36.482318] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T21:40:36.804102] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-09T21:40:36.809850] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-09T21:40:37.596781] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-09T21:40:37.835674] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T21:40:38.396774] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-09T21:40:39.078084] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T21:40:39.196727] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-09T21:40:39.373784] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T21:40:39.571388] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-09T21:40:39.996792] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-09T21:40:40.538204] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T21:40:40.796756] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-09T21:40:41.596732] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-09T21:40:42.396739] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-09T21:40:42.582992] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T21:40:42.784472] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T21:40:42.830631] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-09T21:40:43.196809] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-09T21:40:43.612302] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T21:40:43.996812] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-09T21:40:44.310549] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-09T21:40:44.796729] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-09T21:40:45.596717] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-09T21:40:46.020387] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T21:40:46.396738] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-09T21:40:47.013137] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T21:40:47.015061] [INFO ] [REMOTE ] SRI: Full fetch complete (40630 records). [2025-10-09T21:40:47.015209] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-09T21:40:47.203898] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-09T21:40:47.404309] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-09T21:40:47.404476] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-09T21:40:47.405467] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-09T21:40:47.405599] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-09T21:40:47.406780] [DEBUG] [LOCAL ] SRI: Trimmed 40630 records to 26857 (keeping 200 days of data) [2025-10-09T21:40:47.529600] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-09T21:40:47.537305] [INFO ] [REMOTE ] SRFM: Full fetch complete (50176 records). [2025-10-09T21:40:47.541890] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-09T21:40:47.566099] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-09T21:40:47.706447] [DEBUG] [LOCAL ] SRI: Primary data saved (26857 records). [2025-10-09T21:40:47.712261] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-09T21:40:47.712390] [INFO ] [MAIN ] Update Progress: 1994/2373 symbols completed. SRI took 26.7s. Estimated remaining: 53m 22s. Rate: 7.1 symbols/min [2025-10-09T21:40:48.000596] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-09T21:40:48.071771] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:40:48.203530] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-09T21:40:48.203622] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-09T21:40:48.204512] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-09T21:40:48.204592] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-09T21:40:48.206042] [DEBUG] [LOCAL ] SRFM: Trimmed 50176 records to 38214 (keeping 200 days of data) [2025-10-09T21:40:48.291367] [DEBUG] [LOCAL ] SSB: Loaded 42616 existing records from primary storage. [2025-10-09T21:40:48.322763] [INFO ] [MAIN ] SSB: Loaded 42616 existing records. [2025-10-09T21:40:48.639944] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:40:48.648417] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-09T21:40:48.648510] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-09T21:40:48.650695] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-09T21:40:48.651740] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T21:40:48.655279] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-09T21:40:48.779104] [DEBUG] [LOCAL ] SRFM: Primary data saved (38214 records). [2025-10-09T21:40:48.789525] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-09T21:40:48.789681] [INFO ] [MAIN ] Update Progress: 1995/2373 symbols completed. SRFM took 50.9s. Estimated remaining: 53m 12s. Rate: 7.1 symbols/min [2025-10-09T21:40:48.800416] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-09T21:40:49.235835] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:40:49.236706] [DEBUG] [LOCAL ] SSD: No existing data file found in primary storage. [2025-10-09T21:40:49.237782] [WARN ] [MAIN ] SSD: No existing data found, performing full refresh instead. [2025-10-09T21:40:49.256597] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-09T21:40:49.256709] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-09T21:40:49.256482] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:40:49.257038] [DEBUG] [LOCAL ] SSD: No primary data file found to delete. [2025-10-09T21:40:49.257091] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-09T21:40:49.598541] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-09T21:40:49.634248] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:40:49.686349] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T21:40:50.396755] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-09T21:40:51.176267] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T21:40:51.177466] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T21:40:51.196732] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-09T21:40:51.996727] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-09T21:40:52.376243] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T21:40:52.602893] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-09T21:40:52.796735] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-09T21:40:53.596719] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-09T21:40:53.920443] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T21:40:54.396720] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-09T21:40:54.720474] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-09T21:40:55.079966] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T21:40:55.196721] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-09T21:40:55.908058] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T21:40:55.996671] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-09T21:40:56.671715] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T21:40:56.796695] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-09T21:40:57.460103] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T21:40:57.596690] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-09T21:40:57.964176] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:40:57.965108] [INFO ] [REMOTE ] SRL: Full fetch complete (1953 records). [2025-10-09T21:40:57.965186] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-09T21:40:58.243936] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-09T21:40:58.244250] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:40:58.244340] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:40:58.244438] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-09T21:40:58.244529] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-09T21:40:58.244586] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-09T21:40:58.244690] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-09T21:40:58.244829] [INFO ] [MAIN ] Update Progress: 1996/2373 symbols completed. SRL took 33.2s. Estimated remaining: 53m 3s. Rate: 7.1 symbols/min [2025-10-09T21:40:58.399885] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-09T21:40:58.515424] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:40:58.580685] [DEBUG] [LOCAL ] SSL: Loaded 41399 existing records from primary storage. [2025-10-09T21:40:58.581192] [INFO ] [MAIN ] SSL: Loaded 41399 existing records. [2025-10-09T21:40:58.865572] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:40:58.865904] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-09T21:40:58.866015] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-09T21:40:58.866558] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-09T21:40:58.866634] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-09T21:40:59.201898] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-09T21:40:59.338138] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:40:59.957450] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T21:40:59.996689] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-09T21:41:00.381675] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T21:41:00.796793] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-09T21:41:01.596760] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-09T21:41:01.711486] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T21:41:02.080785] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T21:41:02.153052] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T21:41:02.154203] [INFO ] [REMOTE ] SRV: Full fetch complete (11405 records). [2025-10-09T21:41:02.154276] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-09T21:41:02.401969] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-09T21:41:02.515593] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-09T21:41:02.515694] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-09T21:41:02.515977] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-09T21:41:02.516016] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-09T21:41:02.516437] [DEBUG] [LOCAL ] SRV: Trimmed 11405 records to 7411 (keeping 200 days of data) [2025-10-09T21:41:02.560956] [DEBUG] [LOCAL ] SRV: Primary data saved (7411 records). [2025-10-09T21:41:02.561043] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-09T21:41:02.561119] [INFO ] [MAIN ] Update Progress: 1997/2373 symbols completed. SRV took 33.7s. Estimated remaining: 52m 54s. Rate: 7.1 symbols/min [2025-10-09T21:41:03.196786] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-09T21:41:03.996715] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-09T21:41:04.160730] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T21:41:04.423220] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T21:41:04.796744] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-09T21:41:05.096164] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T21:41:05.596786] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-09T21:41:06.396695] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-09T21:41:06.511582] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T21:41:06.790885] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T21:41:07.196787] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-09T21:41:07.908089] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T21:41:07.996703] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-09T21:41:08.334829] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T21:41:08.796751] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-09T21:41:09.223190] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T21:41:09.596743] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-09T21:41:09.673461] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T21:41:10.396743] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-09T21:41:10.780279] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T21:41:11.196723] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-09T21:41:11.544950] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T21:41:11.996729] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-09T21:41:12.796761] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-09T21:41:12.904639] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T21:41:12.967088] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T21:41:13.596766] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-09T21:41:14.368895] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T21:41:14.396699] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-09T21:41:15.097361] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T21:41:15.196670] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-09T21:41:15.915352] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T21:41:15.996716] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-09T21:41:16.298792] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T21:41:16.796702] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-09T21:41:17.569995] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T21:41:17.596828] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-09T21:41:17.708448] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T21:41:17.711915] [INFO ] [REMOTE ] SSB: Full fetch complete (61305 records). [2025-10-09T21:41:17.712007] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-09T21:41:18.092394] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-09T21:41:18.092477] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-09T21:41:18.093465] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-09T21:41:18.093529] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-09T21:41:18.094815] [DEBUG] [LOCAL ] SSB: Trimmed 61305 records to 42877 (keeping 200 days of data) [2025-10-09T21:41:18.362155] [DEBUG] [LOCAL ] SSB: Primary data saved (42877 records). [2025-10-09T21:41:18.362283] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-09T21:41:18.362376] [INFO ] [MAIN ] Update Progress: 1998/2373 symbols completed. SSB took 30.6s. Estimated remaining: 52m 47s. Rate: 7.1 symbols/min [2025-10-09T21:41:18.396685] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-09T21:41:19.198394] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T21:41:19.207664] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-09T21:41:19.338078] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T21:41:19.996773] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-09T21:41:20.613064] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T21:41:20.684239] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T21:41:20.686421] [INFO ] [REMOTE ] SSD: Full fetch complete (32323 records). [2025-10-09T21:41:20.686493] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-09T21:41:20.801766] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-09T21:41:21.053732] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-09T21:41:21.053812] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-09T21:41:21.054473] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-09T21:41:21.054511] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-09T21:41:21.055307] [DEBUG] [LOCAL ] SSD: Trimmed 32323 records to 22618 (keeping 200 days of data) [2025-10-09T21:41:21.200465] [DEBUG] [LOCAL ] SSD: Primary data saved (22618 records). [2025-10-09T21:41:21.200596] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-09T21:41:21.200689] [INFO ] [MAIN ] Update Progress: 1999/2373 symbols completed. SSD took 32.4s. Estimated remaining: 52m 38s. Rate: 7.1 symbols/min [2025-10-09T21:41:22.004992] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T21:41:22.014450] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-09T21:41:23.068828] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T21:41:23.072463] [INFO ] [REMOTE ] SSL: Full fetch complete (59972 records). [2025-10-09T21:41:23.072576] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-09T21:41:23.449596] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-09T21:41:23.449708] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-09T21:41:23.450719] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-09T21:41:23.450782] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-09T21:41:23.451997] [DEBUG] [LOCAL ] SSL: Trimmed 59972 records to 41671 (keeping 200 days of data) [2025-10-09T21:41:23.682452] [DEBUG] [LOCAL ] SSL: Primary data saved (41671 records). [2025-10-09T21:41:23.682585] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-09T21:41:23.682688] [INFO ] [MAIN ] Update Progress: 2000/2373 symbols completed. SSL took 25.4s. Estimated remaining: 52m 28s. Rate: 7.1 symbols/min [2025-10-09T21:41:24.273239] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:41:24.327449] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:41:24.407484] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:41:24.410614] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:41:24.433699] [DEBUG] [LOCAL ] SST: Loaded 11764 existing records from primary storage. [2025-10-09T21:41:24.433975] [INFO ] [MAIN ] SST: Loaded 11764 existing records. [2025-10-09T21:41:24.463353] [DEBUG] [LOCAL ] SSTK: Loaded 25598 existing records from primary storage. [2025-10-09T21:41:24.496475] [INFO ] [MAIN ] SSTK: Loaded 25598 existing records. [2025-10-09T21:41:24.737264] [DEBUG] [LOCAL ] STAG: Loaded 50089 existing records from primary storage. [2025-10-09T21:41:24.777565] [INFO ] [MAIN ] STAG: Loaded 50089 existing records. [2025-10-09T21:41:24.786216] [DEBUG] [LOCAL ] ST: Loaded 49807 existing records from primary storage. [2025-10-09T21:41:24.836255] [INFO ] [MAIN ] ST: Loaded 49807 existing records. [2025-10-09T21:41:24.891563] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:41:24.906522] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-09T21:41:24.925113] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-09T21:41:24.959576] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-09T21:41:24.977162] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-09T21:41:24.949972] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:41:25.008314] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-09T21:41:25.049544] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-09T21:41:25.174354] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-09T21:41:25.238183] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-09T21:41:25.395413] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:41:25.437782] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-09T21:41:25.446713] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:41:25.463994] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-09T21:41:25.498256] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-09T21:41:25.514783] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-09T21:41:25.543318] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-09T21:41:25.548966] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-09T21:41:25.573199] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-09T21:41:25.578401] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-09T21:41:26.365333] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:41:26.418139] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-09T21:41:26.581054] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:41:26.605064] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-09T21:41:26.723393] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:41:26.766259] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-09T21:41:26.765639] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:41:26.766617] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-09T21:41:27.458897] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T21:41:27.462106] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-09T21:41:27.743196] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T21:41:27.749725] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-09T21:41:28.009463] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T21:41:28.019947] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-09T21:41:28.177061] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T21:41:28.181591] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-09T21:41:28.347552] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T21:41:28.732843] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T21:41:28.796757] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-09T21:41:28.823511] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T21:41:29.596717] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-09T21:41:29.661084] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T21:41:30.396828] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-09T21:41:30.548102] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T21:41:30.581059] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T21:41:31.196726] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-09T21:41:31.998967] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-09T21:41:32.005003] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T21:41:32.669022] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T21:41:32.796711] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-09T21:41:32.827437] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T21:41:33.596779] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-09T21:41:34.224536] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T21:41:34.396723] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-09T21:41:35.009483] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T21:41:35.196725] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-09T21:41:35.274333] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T21:41:35.996822] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-09T21:41:36.796724] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-09T21:41:36.891675] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T21:41:37.013910] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T21:41:37.596762] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-09T21:41:38.396698] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-09T21:41:38.433636] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T21:41:38.616134] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T21:41:39.196755] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-09T21:41:39.996676] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-09T21:41:40.243133] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T21:41:40.796685] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-09T21:41:40.875215] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T21:41:41.190871] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T21:41:41.596738] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-09T21:41:42.401438] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-09T21:41:42.420714] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T21:41:42.801732] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T21:41:43.196688] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-09T21:41:43.391450] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T21:41:43.996693] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-09T21:41:44.050939] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T21:41:44.725322] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T21:41:44.796680] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-09T21:41:45.444759] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T21:41:45.596704] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-09T21:41:46.396703] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-09T21:41:46.951089] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T21:41:47.196746] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-09T21:41:47.487356] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T21:41:47.691278] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T21:41:47.692521] [INFO ] [REMOTE ] SST: Full fetch complete (18588 records). [2025-10-09T21:41:47.692597] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-09T21:41:48.001828] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-09T21:41:48.073124] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-09T21:41:48.073202] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-09T21:41:48.073604] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-09T21:41:48.073668] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-09T21:41:48.074243] [DEBUG] [LOCAL ] SST: Trimmed 18588 records to 11781 (keeping 200 days of data) [2025-10-09T21:41:48.142790] [DEBUG] [LOCAL ] SST: Primary data saved (11781 records). [2025-10-09T21:41:48.142926] [INFO ] [MAIN ] SST: Full history saved. [2025-10-09T21:41:48.143022] [INFO ] [MAIN ] Update Progress: 2001/2373 symbols completed. SST took 24.5s. Estimated remaining: 52m 23s. Rate: 7.1 symbols/min [2025-10-09T21:41:48.311873] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:41:48.329066] [DEBUG] [LOCAL ] STC: Loaded 17369 existing records from primary storage. [2025-10-09T21:41:48.329300] [INFO ] [MAIN ] STC: Loaded 17369 existing records. [2025-10-09T21:41:48.506998] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:41:48.507219] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-09T21:41:48.507267] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-09T21:41:48.507470] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-09T21:41:48.507530] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-09T21:41:48.801899] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-09T21:41:48.875503] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:41:49.596687] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-09T21:41:49.854401] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T21:41:50.396755] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-09T21:41:50.532463] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T21:41:50.569972] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T21:41:51.196744] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-09T21:41:51.957135] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T21:41:51.996745] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-09T21:41:52.735753] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T21:41:52.796679] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-09T21:41:52.979023] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T21:41:53.596724] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-09T21:41:53.740143] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T21:41:54.396707] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-09T21:41:54.816994] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T21:41:55.196688] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-09T21:41:55.457862] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T21:41:55.996761] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-09T21:41:56.796696] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-09T21:41:56.974800] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T21:41:57.596774] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-09T21:41:57.722526] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T21:41:57.889971] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T21:41:58.396728] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-09T21:41:58.680831] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T21:41:58.685318] [INFO ] [REMOTE ] ST: Full fetch complete (71969 records). [2025-10-09T21:41:58.685459] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-09T21:41:59.100229] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-09T21:41:59.100339] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-09T21:41:59.101457] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-09T21:41:59.101527] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-09T21:41:59.103786] [DEBUG] [LOCAL ] ST: Trimmed 71969 records to 50184 (keeping 200 days of data) [2025-10-09T21:41:59.197046] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-09T21:41:59.412136] [DEBUG] [LOCAL ] ST: Primary data saved (50184 records). [2025-10-09T21:41:59.412271] [INFO ] [MAIN ] ST: Full history saved. [2025-10-09T21:41:59.412445] [INFO ] [MAIN ] Update Progress: 2002/2373 symbols completed. ST took 35.7s. Estimated remaining: 52m 15s. Rate: 7.1 symbols/min [2025-10-09T21:41:59.582236] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:41:59.619082] [DEBUG] [LOCAL ] STE: Loaded 35429 existing records from primary storage. [2025-10-09T21:41:59.619384] [INFO ] [MAIN ] STE: Loaded 35429 existing records. [2025-10-09T21:41:59.796937] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:41:59.797133] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-09T21:41:59.797179] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-09T21:41:59.797457] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-09T21:41:59.797514] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-09T21:42:00.001386] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-09T21:42:00.197466] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:42:00.198418] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T21:42:00.201373] [INFO ] [REMOTE ] SSTK: Full fetch complete (41626 records). [2025-10-09T21:42:00.201604] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-09T21:42:00.339237] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T21:42:00.629250] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-09T21:42:00.629338] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-09T21:42:00.630220] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-09T21:42:00.630283] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-09T21:42:00.631163] [DEBUG] [LOCAL ] SSTK: Trimmed 41626 records to 25722 (keeping 200 days of data) [2025-10-09T21:42:00.797975] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-09T21:42:00.808340] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T21:42:00.816031] [DEBUG] [LOCAL ] SSTK: Primary data saved (25722 records). [2025-10-09T21:42:00.816469] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-09T21:42:00.817313] [INFO ] [MAIN ] Update Progress: 2003/2373 symbols completed. SSTK took 37.1s. Estimated remaining: 52m 5s. Rate: 7.1 symbols/min [2025-10-09T21:42:00.995621] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:42:01.020555] [DEBUG] [LOCAL ] STEL: Loaded 22835 existing records from primary storage. [2025-10-09T21:42:01.020864] [INFO ] [MAIN ] STEL: Loaded 22835 existing records. [2025-10-09T21:42:01.206693] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:42:01.206942] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-09T21:42:01.206991] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-09T21:42:01.207243] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-09T21:42:01.207299] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-09T21:42:01.581842] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:42:01.596669] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-09T21:42:02.180834] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T21:42:02.185310] [INFO ] [REMOTE ] STAG: Full fetch complete (72199 records). [2025-10-09T21:42:02.185436] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-09T21:42:02.402426] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-09T21:42:02.595452] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-09T21:42:02.595570] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-09T21:42:02.596800] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-09T21:42:02.596885] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-09T21:42:02.598502] [DEBUG] [LOCAL ] STAG: Trimmed 72199 records to 50435 (keeping 200 days of data) [2025-10-09T21:42:02.705283] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T21:42:02.931985] [DEBUG] [LOCAL ] STAG: Primary data saved (50435 records). [2025-10-09T21:42:02.932124] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-09T21:42:02.932208] [INFO ] [MAIN ] Update Progress: 2004/2373 symbols completed. STAG took 39.2s. Estimated remaining: 51m 55s. Rate: 7.1 symbols/min [2025-10-09T21:42:03.110831] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:42:03.149452] [DEBUG] [LOCAL ] STEM: Loaded 39032 existing records from primary storage. [2025-10-09T21:42:03.149774] [INFO ] [MAIN ] STEM: Loaded 39032 existing records. [2025-10-09T21:42:03.203986] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-09T21:42:03.337072] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:42:03.337354] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-09T21:42:03.337410] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-09T21:42:03.337638] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-09T21:42:03.337746] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-09T21:42:03.693775] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:42:03.796788] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T21:42:03.996788] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-09T21:42:04.275520] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T21:42:04.796743] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-09T21:42:05.596760] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-09T21:42:05.788724] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T21:42:05.838852] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T21:42:06.256241] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T21:42:06.396696] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-09T21:42:07.196692] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-09T21:42:07.480976] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T21:42:07.996730] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-09T21:42:08.796831] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-09T21:42:09.305108] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-09T21:42:09.323454] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T21:42:09.596777] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-09T21:42:10.267816] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T21:42:10.396682] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-09T21:42:10.469168] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T21:42:11.196782] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-09T21:42:11.864421] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T21:42:11.996703] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-09T21:42:12.236713] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T21:42:12.796785] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-09T21:42:13.493219] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T21:42:13.596687] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-09T21:42:14.396717] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-09T21:42:14.722792] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-09T21:42:14.796474] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T21:42:14.994211] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T21:42:14.996197] [INFO ] [REMOTE ] STC: Full fetch complete (25705 records). [2025-10-09T21:42:14.996289] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-09T21:42:15.205362] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-09T21:42:15.375418] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-09T21:42:15.375506] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-09T21:42:15.376127] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-09T21:42:15.376190] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-09T21:42:15.377269] [DEBUG] [LOCAL ] STC: Trimmed 25705 records to 17464 (keeping 200 days of data) [2025-10-09T21:42:15.490302] [DEBUG] [LOCAL ] STC: Primary data saved (17464 records). [2025-10-09T21:42:15.490454] [INFO ] [MAIN ] STC: Full history saved. [2025-10-09T21:42:15.490554] [INFO ] [MAIN ] Update Progress: 2005/2373 symbols completed. STC took 27.3s. Estimated remaining: 51m 48s. Rate: 7.1 symbols/min [2025-10-09T21:42:15.668635] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:42:15.687138] [DEBUG] [LOCAL ] STEW: Loaded 16161 existing records from primary storage. [2025-10-09T21:42:15.687376] [INFO ] [MAIN ] STEW: Loaded 16161 existing records. [2025-10-09T21:42:15.865888] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:42:15.866160] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-09T21:42:15.866207] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-09T21:42:15.866429] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-09T21:42:15.866487] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-09T21:42:16.004851] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-09T21:42:16.224765] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:42:16.796754] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-09T21:42:16.903672] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T21:42:16.970556] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T21:42:17.354982] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T21:42:17.596717] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-09T21:42:18.396702] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-09T21:42:19.027711] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T21:42:19.196731] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-09T21:42:19.996776] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-09T21:42:20.258075] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T21:42:20.481301] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T21:42:20.796722] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-09T21:42:21.545131] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T21:42:21.601662] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-09T21:42:21.603273] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T21:42:22.396733] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-09T21:42:23.052581] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T21:42:23.067964] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-09T21:42:23.196714] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-09T21:42:23.996686] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-09T21:42:24.231878] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T21:42:24.796736] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-09T21:42:25.130186] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T21:42:25.596739] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-09T21:42:25.987508] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T21:42:26.391112] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T21:42:26.396669] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-09T21:42:27.196725] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-09T21:42:27.278057] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T21:42:27.996807] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-09T21:42:28.480675] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T21:42:28.483915] [INFO ] [REMOTE ] STE: Full fetch complete (50599 records). [2025-10-09T21:42:28.484000] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-09T21:42:28.801831] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-09T21:42:28.866720] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-09T21:42:28.866799] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-09T21:42:28.867667] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-09T21:42:28.867748] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-09T21:42:28.868784] [DEBUG] [LOCAL ] STE: Trimmed 50599 records to 35659 (keeping 200 days of data) [2025-10-09T21:42:29.092295] [DEBUG] [LOCAL ] STE: Primary data saved (35659 records). [2025-10-09T21:42:29.092434] [INFO ] [MAIN ] STE: Full history saved. [2025-10-09T21:42:29.092513] [INFO ] [MAIN ] Update Progress: 2006/2373 symbols completed. STE took 29.7s. Estimated remaining: 51m 40s. Rate: 7.1 symbols/min [2025-10-09T21:42:29.260682] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:42:29.260849] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-09T21:42:29.260886] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-09T21:42:29.260993] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-09T21:42:29.261038] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-09T21:42:29.261078] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-09T21:42:29.261110] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-09T21:42:29.615384] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-09T21:42:29.619956] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:42:29.918185] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T21:42:29.988972] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T21:42:30.396700] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-09T21:42:30.470098] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T21:42:31.196711] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-09T21:42:31.544793] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-09T21:42:31.594636] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T21:42:31.996726] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-09T21:42:32.796741] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-09T21:42:33.597093] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-09T21:42:33.606330] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T21:42:33.635320] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T21:42:34.072664] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T21:42:34.396786] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-09T21:42:35.196743] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-09T21:42:35.357043] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T21:42:35.996737] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-09T21:42:36.234485] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T21:42:36.797539] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-09T21:42:36.802276] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T21:42:37.131878] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T21:42:37.596754] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-09T21:42:38.303121] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:42:38.305181] [INFO ] [REMOTE ] STEL: Full fetch complete (31983 records). [2025-10-09T21:42:38.305282] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-09T21:42:38.402248] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-09T21:42:38.681010] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-09T21:42:38.681090] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-09T21:42:38.681740] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-09T21:42:38.681801] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-09T21:42:38.682989] [DEBUG] [LOCAL ] STEL: Trimmed 31983 records to 22955 (keeping 200 days of data) [2025-10-09T21:42:38.686278] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-09T21:42:38.829486] [DEBUG] [LOCAL ] STEL: Primary data saved (22955 records). [2025-10-09T21:42:38.829618] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-09T21:42:38.829731] [INFO ] [MAIN ] Update Progress: 2007/2373 symbols completed. STEL took 38.0s. Estimated remaining: 51m 32s. Rate: 7.1 symbols/min [2025-10-09T21:42:39.006287] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:42:39.017242] [DEBUG] [LOCAL ] STK: Loaded 9582 existing records from primary storage. [2025-10-09T21:42:39.017469] [INFO ] [MAIN ] STK: Loaded 9582 existing records. [2025-10-09T21:42:39.195835] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:42:39.196045] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-09T21:42:39.196091] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-09T21:42:39.196293] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-09T21:42:39.196350] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-09T21:42:39.201959] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-09T21:42:39.551956] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:42:39.996692] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-09T21:42:40.056158] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T21:42:40.796702] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-09T21:42:41.033531] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T21:42:41.596774] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-09T21:42:42.396791] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-09T21:42:42.496827] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T21:42:42.498622] [INFO ] [REMOTE ] STEW: Full fetch complete (21717 records). [2025-10-09T21:42:42.499148] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-09T21:42:42.764703] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-09T21:42:43.127596] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T21:42:43.142314] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-09T21:42:43.142421] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-09T21:42:43.143369] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-09T21:42:43.143455] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-09T21:42:43.144440] [DEBUG] [LOCAL ] STEW: Trimmed 21717 records to 16229 (keeping 200 days of data) [2025-10-09T21:42:43.196973] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-09T21:42:43.267827] [DEBUG] [LOCAL ] STEW: Primary data saved (16229 records). [2025-10-09T21:42:43.268007] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-09T21:42:43.268126] [INFO ] [MAIN ] Update Progress: 2008/2373 symbols completed. STEW took 27.8s. Estimated remaining: 51m 23s. Rate: 7.1 symbols/min [2025-10-09T21:42:43.452618] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:42:43.504829] [DEBUG] [LOCAL ] STLA: Loaded 53551 existing records from primary storage. [2025-10-09T21:42:43.505186] [INFO ] [MAIN ] STLA: Loaded 53551 existing records. [2025-10-09T21:42:43.692499] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:42:43.692784] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-09T21:42:43.692838] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-09T21:42:43.693052] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-09T21:42:43.693110] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-09T21:42:44.001793] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-09T21:42:44.075443] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:42:44.083970] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T21:42:44.796793] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-09T21:42:45.298689] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-09T21:42:45.402201] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T21:42:45.596732] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-09T21:42:46.152965] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T21:42:46.396710] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-09T21:42:46.758307] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-09T21:42:47.196740] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-09T21:42:47.996728] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-09T21:42:48.608543] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T21:42:48.796736] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-09T21:42:49.596816] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-09T21:42:49.809310] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T21:42:49.835990] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T21:42:50.119750] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T21:42:50.396724] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-09T21:42:51.172016] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T21:42:51.196713] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-09T21:42:51.831079] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T21:42:51.996755] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-09T21:42:52.331273] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-09T21:42:52.796698] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-09T21:42:53.596741] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-09T21:42:53.769874] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T21:42:53.773765] [INFO ] [REMOTE ] STEM: Full fetch complete (61528 records). [2025-10-09T21:42:53.774100] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-09T21:42:54.215663] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-09T21:42:54.215776] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-09T21:42:54.217040] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-09T21:42:54.217138] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-09T21:42:54.218554] [DEBUG] [LOCAL ] STEM: Trimmed 61528 records to 39229 (keeping 200 days of data) [2025-10-09T21:42:54.416714] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-09T21:42:54.451548] [DEBUG] [LOCAL ] STEM: Primary data saved (39229 records). [2025-10-09T21:42:54.451758] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-09T21:42:54.451884] [INFO ] [MAIN ] Update Progress: 2009/2373 symbols completed. STEM took 51.5s. Estimated remaining: 51m 15s. Rate: 7.1 symbols/min [2025-10-09T21:42:54.621253] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:42:54.671224] [DEBUG] [LOCAL ] STM: Loaded 53571 existing records from primary storage. [2025-10-09T21:42:54.671567] [INFO ] [MAIN ] STM: Loaded 53571 existing records. [2025-10-09T21:42:54.860962] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:42:54.861199] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-09T21:42:54.861250] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-09T21:42:54.861498] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-09T21:42:54.861557] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-09T21:42:55.200390] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-09T21:42:55.234295] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:42:55.270007] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T21:42:55.517281] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T21:42:55.725097] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-09T21:42:55.996730] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-09T21:42:56.796740] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-09T21:42:57.596803] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-09T21:42:57.623712] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T21:42:57.873276] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T21:42:58.396738] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-09T21:42:59.196766] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-09T21:42:59.485082] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T21:42:59.901989] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:42:59.903411] [INFO ] [REMOTE ] STK: Full fetch complete (14095 records). [2025-10-09T21:42:59.903480] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-09T21:43:00.002714] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-09T21:43:00.268059] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-09T21:43:00.268144] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-09T21:43:00.268487] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-09T21:43:00.268526] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-09T21:43:00.269042] [DEBUG] [LOCAL ] STK: Trimmed 14095 records to 9650 (keeping 200 days of data) [2025-10-09T21:43:00.326809] [DEBUG] [LOCAL ] STK: Primary data saved (9650 records). [2025-10-09T21:43:00.326930] [INFO ] [MAIN ] STK: Full history saved. [2025-10-09T21:43:00.327014] [INFO ] [MAIN ] Update Progress: 2010/2373 symbols completed. STK took 21.5s. Estimated remaining: 51m 6s. Rate: 7.1 symbols/min [2025-10-09T21:43:00.504502] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:43:00.529150] [DEBUG] [LOCAL ] STN: Loaded 22841 existing records from primary storage. [2025-10-09T21:43:00.529400] [INFO ] [MAIN ] STN: Loaded 22841 existing records. [2025-10-09T21:43:00.621314] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T21:43:00.722091] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:43:00.722384] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-09T21:43:00.722466] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-09T21:43:00.722865] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-09T21:43:00.722930] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-09T21:43:00.803149] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-09T21:43:00.873979] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-09T21:43:01.135112] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:43:01.319815] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T21:43:01.596747] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-09T21:43:02.396739] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-09T21:43:03.196788] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-09T21:43:03.493019] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-09T21:43:03.965466] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-09T21:43:03.996672] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-09T21:43:04.465192] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-09T21:43:04.796735] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-09T21:43:05.596694] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-09T21:43:05.816428] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T21:43:05.937967] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T21:43:06.396712] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-09T21:43:07.196694] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-09T21:43:07.373564] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T21:43:07.395106] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T21:43:07.996709] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-09T21:43:08.796748] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-09T21:43:08.861759] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T21:43:08.894679] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T21:43:09.596767] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-09T21:43:10.396718] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-09T21:43:10.540211] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T21:43:11.012068] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T21:43:11.012777] [INFO ] [REMOTE ] STG: Full fetch complete (2507 records). [2025-10-09T21:43:11.012845] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-09T21:43:11.227017] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-09T21:43:11.236085] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-09T21:43:11.237049] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:43:11.237122] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:43:11.237174] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-09T21:43:11.237227] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-09T21:43:11.237263] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-09T21:43:11.237322] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-09T21:43:11.237414] [INFO ] [MAIN ] Update Progress: 2011/2373 symbols completed. STG took 42.1s. Estimated remaining: 50m 58s. Rate: 7.1 symbols/min [2025-10-09T21:43:11.411094] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:43:11.454324] [DEBUG] [LOCAL ] STNG: Loaded 43676 existing records from primary storage. [2025-10-09T21:43:11.454633] [INFO ] [MAIN ] STNG: Loaded 43676 existing records. [2025-10-09T21:43:11.636260] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:43:11.636630] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-09T21:43:11.636734] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-09T21:43:11.637079] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-09T21:43:11.637157] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-09T21:43:11.997322] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-09T21:43:12.040416] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-09T21:43:12.044407] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:43:12.796736] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-09T21:43:13.147790] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T21:43:13.178099] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T21:43:13.596728] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-09T21:43:14.396690] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-09T21:43:14.714092] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T21:43:15.047284] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T21:43:15.196726] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-09T21:43:15.583809] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T21:43:15.996717] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-09T21:43:16.796701] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-09T21:43:17.215007] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T21:43:17.241726] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T21:43:17.596732] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-09T21:43:17.945713] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T21:43:18.396730] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-09T21:43:19.196690] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-09T21:43:19.233457] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T21:43:19.812471] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-09T21:43:19.996687] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-09T21:43:20.796704] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-09T21:43:21.014553] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T21:43:21.596736] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-09T21:43:21.712714] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T21:43:21.717419] [INFO ] [REMOTE ] STLA: Full fetch complete (77535 records). [2025-10-09T21:43:21.717611] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-09T21:43:22.133324] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-09T21:43:22.133618] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-09T21:43:22.134792] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-09T21:43:22.134871] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-09T21:43:22.158370] [DEBUG] [LOCAL ] STLA: Trimmed 77535 records to 53941 (keeping 200 days of data) [2025-10-09T21:43:22.159160] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T21:43:22.295596] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T21:43:22.400790] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-09T21:43:22.518375] [DEBUG] [LOCAL ] STLA: Primary data saved (53941 records). [2025-10-09T21:43:22.518517] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-09T21:43:22.518600] [INFO ] [MAIN ] Update Progress: 2012/2373 symbols completed. STLA took 39.3s. Estimated remaining: 50m 50s. Rate: 7.1 symbols/min [2025-10-09T21:43:22.682693] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:43:22.695988] [DEBUG] [LOCAL ] STRV: Loaded 11293 existing records from primary storage. [2025-10-09T21:43:22.696203] [INFO ] [MAIN ] STRV: Loaded 11293 existing records. [2025-10-09T21:43:22.867211] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:43:22.867446] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-09T21:43:22.867492] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-09T21:43:22.867796] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-09T21:43:22.867856] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-09T21:43:23.210151] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-09T21:43:23.215740] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:43:23.996693] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-09T21:43:24.051454] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T21:43:24.726561] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T21:43:24.796680] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-09T21:43:25.060943] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T21:43:25.596730] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-09T21:43:25.650435] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T21:43:26.396685] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-09T21:43:26.477421] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T21:43:27.196741] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-09T21:43:27.996698] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-09T21:43:28.040713] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T21:43:28.493538] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T21:43:28.796722] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-09T21:43:29.545602] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T21:43:29.596680] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-09T21:43:29.683830] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T21:43:29.686309] [INFO ] [REMOTE ] STN: Full fetch complete (32364 records). [2025-10-09T21:43:29.686387] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-09T21:43:30.050579] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-09T21:43:30.050687] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-09T21:43:30.051395] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-09T21:43:30.051456] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-09T21:43:30.052213] [DEBUG] [LOCAL ] STN: Trimmed 32364 records to 23000 (keeping 200 days of data) [2025-10-09T21:43:30.200231] [DEBUG] [LOCAL ] STN: Primary data saved (23000 records). [2025-10-09T21:43:30.200364] [INFO ] [MAIN ] STN: Full history saved. [2025-10-09T21:43:30.200443] [INFO ] [MAIN ] Update Progress: 2013/2373 symbols completed. STN took 29.9s. Estimated remaining: 50m 41s. Rate: 7.1 symbols/min [2025-10-09T21:43:30.364290] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:43:30.396744] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-09T21:43:30.420495] [DEBUG] [LOCAL ] STT: Loaded 50951 existing records from primary storage. [2025-10-09T21:43:30.420829] [INFO ] [MAIN ] STT: Loaded 50951 existing records. [2025-10-09T21:43:30.594783] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:43:30.594990] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-09T21:43:30.595066] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-09T21:43:30.595297] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-09T21:43:30.595355] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-09T21:43:30.961359] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:43:30.985822] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T21:43:31.032623] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T21:43:31.196741] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-09T21:43:31.996720] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-09T21:43:32.796686] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-09T21:43:33.024107] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T21:43:33.029068] [INFO ] [REMOTE ] STM: Full fetch complete (77522 records). [2025-10-09T21:43:33.029224] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-09T21:43:33.438163] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-09T21:43:33.438348] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-09T21:43:33.439710] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-09T21:43:33.439876] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-09T21:43:33.441703] [DEBUG] [LOCAL ] STM: Trimmed 77522 records to 53960 (keeping 200 days of data) [2025-10-09T21:43:33.561163] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T21:43:33.596744] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-09T21:43:33.811011] [DEBUG] [LOCAL ] STM: Primary data saved (53960 records). [2025-10-09T21:43:33.811153] [INFO ] [MAIN ] STM: Full history saved. [2025-10-09T21:43:33.811240] [INFO ] [MAIN ] Update Progress: 2014/2373 symbols completed. STM took 39.4s. Estimated remaining: 50m 32s. Rate: 7.1 symbols/min [2025-10-09T21:43:33.982232] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:43:33.982398] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-09T21:43:33.982437] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-09T21:43:33.982550] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-09T21:43:33.982591] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-09T21:43:33.982633] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-09T21:43:33.982704] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-09T21:43:34.349730] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:43:34.378330] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T21:43:34.396669] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-09T21:43:35.196784] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-09T21:43:35.239860] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T21:43:35.304098] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T21:43:35.420063] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:43:35.420630] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-09T21:43:35.420771] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:43:35.420836] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-09T21:43:35.420910] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:43:35.420995] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-09T21:43:35.421071] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-09T21:43:35.421107] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-09T21:43:35.421147] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-09T21:43:35.421209] [INFO ] [MAIN ] Update Progress: 2015/2373 symbols completed. STUB took 1.6s. Estimated remaining: 50m 22s. Rate: 7.1 symbols/min [2025-10-09T21:43:35.600789] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:43:35.631254] [DEBUG] [LOCAL ] STVN: Loaded 26633 existing records from primary storage. [2025-10-09T21:43:35.631669] [INFO ] [MAIN ] STVN: Loaded 26633 existing records. [2025-10-09T21:43:35.821323] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:43:35.821667] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-09T21:43:35.821748] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-09T21:43:35.821987] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-09T21:43:35.822044] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-09T21:43:35.998020] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-09T21:43:36.184321] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:43:36.796695] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-09T21:43:36.975850] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T21:43:37.596750] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-09T21:43:37.652304] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T21:43:38.396738] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-09T21:43:38.600333] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T21:43:39.196721] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-09T21:43:39.996770] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-09T21:43:40.179859] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T21:43:40.210536] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T21:43:40.796782] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-09T21:43:41.596703] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-09T21:43:41.646932] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T21:43:41.647911] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T21:43:42.396782] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-09T21:43:42.535995] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T21:43:43.141260] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T21:43:43.196737] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-09T21:43:43.636550] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T21:43:43.996763] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-09T21:43:44.796731] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-09T21:43:45.477562] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T21:43:45.596674] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-09T21:43:46.016995] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T21:43:46.396757] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-09T21:43:46.907220] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T21:43:47.180546] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T21:43:47.196740] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-09T21:43:47.996745] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-09T21:43:48.303136] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T21:43:48.697860] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T21:43:48.699665] [INFO ] [REMOTE ] STRV: Full fetch complete (17828 records). [2025-10-09T21:43:48.699773] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-09T21:43:48.798287] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-09T21:43:49.064136] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-09T21:43:49.064211] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-09T21:43:49.064596] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-09T21:43:49.064634] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-09T21:43:49.065243] [DEBUG] [LOCAL ] STRV: Trimmed 17828 records to 11368 (keeping 200 days of data) [2025-10-09T21:43:49.140283] [DEBUG] [LOCAL ] STRV: Primary data saved (11368 records). [2025-10-09T21:43:49.140484] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-09T21:43:49.140625] [INFO ] [MAIN ] Update Progress: 2016/2373 symbols completed. STRV took 26.6s. Estimated remaining: 50m 15s. Rate: 7.1 symbols/min [2025-10-09T21:43:49.344433] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:43:49.392715] [DEBUG] [LOCAL ] STWD: Loaded 51938 existing records from primary storage. [2025-10-09T21:43:49.393035] [INFO ] [MAIN ] STWD: Loaded 51938 existing records. [2025-10-09T21:43:49.569226] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:43:49.569418] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-09T21:43:49.569467] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-09T21:43:49.569727] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-09T21:43:49.569784] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-09T21:43:49.601926] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-09T21:43:49.928848] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:43:50.396775] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-09T21:43:50.742281] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T21:43:50.805964] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T21:43:51.196804] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-09T21:43:51.668379] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T21:43:51.996808] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-09T21:43:52.805821] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-09T21:43:52.812370] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T21:43:52.952408] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T21:43:52.956120] [INFO ] [REMOTE ] STNG: Full fetch complete (64408 records). [2025-10-09T21:43:52.956214] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-09T21:43:53.353722] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-09T21:43:53.353810] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-09T21:43:53.354809] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-09T21:43:53.354872] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-09T21:43:53.356583] [DEBUG] [LOCAL ] STNG: Trimmed 64408 records to 44007 (keeping 200 days of data) [2025-10-09T21:43:53.596867] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-09T21:43:53.645259] [DEBUG] [LOCAL ] STNG: Primary data saved (44007 records). [2025-10-09T21:43:53.645403] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-09T21:43:53.645574] [INFO ] [MAIN ] Update Progress: 2017/2373 symbols completed. STNG took 42.4s. Estimated remaining: 50m 6s. Rate: 7.1 symbols/min [2025-10-09T21:43:53.823835] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:43:53.827524] [DEBUG] [LOCAL ] STXD: Loaded 1238 existing records from primary storage. [2025-10-09T21:43:53.827719] [INFO ] [MAIN ] STXD: Loaded 1238 existing records. [2025-10-09T21:43:54.012492] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:43:54.012889] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-09T21:43:54.018569] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-09T21:43:54.028537] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-09T21:43:54.028605] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-09T21:43:54.029258] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T21:43:54.402740] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-09T21:43:54.410575] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:43:55.196705] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-09T21:43:55.344637] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T21:43:55.501491] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T21:43:55.523330] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-09T21:43:55.996736] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-09T21:43:56.796760] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-09T21:43:57.596742] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-09T21:43:57.866202] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T21:43:57.927838] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-09T21:43:58.399941] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-09T21:43:58.402987] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T21:43:59.196706] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-09T21:43:59.602847] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T21:43:59.996781] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-09T21:44:00.796696] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-09T21:44:01.044077] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T21:44:01.121449] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T21:44:01.596734] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-09T21:44:02.396728] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-09T21:44:02.498294] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T21:44:02.590399] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T21:44:03.196793] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-09T21:44:03.884487] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T21:44:03.996690] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-09T21:44:04.475818] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T21:44:04.479379] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T21:44:04.796725] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-09T21:44:05.596717] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-09T21:44:06.396730] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-09T21:44:06.525289] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T21:44:07.106577] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:44:07.109554] [INFO ] [REMOTE ] STVN: Full fetch complete (39191 records). [2025-10-09T21:44:07.109734] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-09T21:44:07.206435] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-09T21:44:07.615260] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-09T21:44:07.615447] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-09T21:44:07.616425] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-09T21:44:07.616617] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-09T21:44:07.645260] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-09T21:44:07.644094] [DEBUG] [LOCAL ] STVN: Trimmed 39191 records to 26765 (keeping 200 days of data) [2025-10-09T21:44:07.725746] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T21:44:07.841148] [DEBUG] [LOCAL ] STVN: Primary data saved (26765 records). [2025-10-09T21:44:07.841287] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-09T21:44:07.841372] [INFO ] [MAIN ] Update Progress: 2018/2373 symbols completed. STVN took 32.4s. Estimated remaining: 49m 58s. Rate: 7.1 symbols/min [2025-10-09T21:44:08.006541] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-09T21:44:08.043084] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:44:08.048208] [DEBUG] [LOCAL ] STXE: Loaded 2097 existing records from primary storage. [2025-10-09T21:44:08.048431] [INFO ] [MAIN ] STXE: Loaded 2097 existing records. [2025-10-09T21:44:08.264461] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:44:08.264731] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-09T21:44:08.264818] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-09T21:44:08.265069] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-09T21:44:08.265132] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-09T21:44:08.563854] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T21:44:08.653363] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:44:08.796670] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-09T21:44:09.387338] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T21:44:09.596708] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-09T21:44:10.161758] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T21:44:10.396725] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-09T21:44:11.196722] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-09T21:44:11.744694] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T21:44:11.996312] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T21:44:12.003993] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-09T21:44:12.556924] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T21:44:12.561245] [INFO ] [REMOTE ] STT: Full fetch complete (74256 records). [2025-10-09T21:44:12.561372] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-09T21:44:12.801871] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-09T21:44:12.960463] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-09T21:44:12.960609] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-09T21:44:12.961741] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-09T21:44:12.961805] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-09T21:44:12.963234] [DEBUG] [LOCAL ] STT: Trimmed 74256 records to 51314 (keeping 200 days of data) [2025-10-09T21:44:13.297326] [DEBUG] [LOCAL ] STT: Primary data saved (51314 records). [2025-10-09T21:44:13.297467] [INFO ] [MAIN ] STT: Full history saved. [2025-10-09T21:44:13.298226] [INFO ] [MAIN ] Update Progress: 2019/2373 symbols completed. STT took 43.1s. Estimated remaining: 49m 49s. Rate: 7.1 symbols/min [2025-10-09T21:44:13.364462] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T21:44:13.491296] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:44:13.496945] [DEBUG] [LOCAL ] STXG: Loaded 2469 existing records from primary storage. [2025-10-09T21:44:13.497150] [INFO ] [MAIN ] STXG: Loaded 2469 existing records. [2025-10-09T21:44:13.601483] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-09T21:44:13.681946] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:44:13.682170] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-09T21:44:13.682218] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-09T21:44:13.682403] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-09T21:44:13.682460] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-09T21:44:14.030236] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:44:14.396717] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-09T21:44:14.462994] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T21:44:14.971343] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T21:44:15.196744] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-09T21:44:15.819669] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T21:44:15.996727] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-09T21:44:16.542999] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T21:44:16.796744] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-09T21:44:17.596800] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-09T21:44:17.935597] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T21:44:18.396710] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-09T21:44:18.488674] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T21:44:18.967541] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T21:44:19.196732] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-09T21:44:19.555352] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-09T21:44:19.996721] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-09T21:44:20.621479] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T21:44:20.796701] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-09T21:44:21.139351] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T21:44:21.596705] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-09T21:44:22.039733] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-09T21:44:22.396778] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-09T21:44:23.196739] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-09T21:44:23.543125] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-09T21:44:23.930239] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T21:44:23.996733] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-09T21:44:24.796809] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-09T21:44:25.200610] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-09T21:44:25.596726] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-09T21:44:25.675359] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T21:44:25.926339] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T21:44:26.396693] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-09T21:44:26.838186] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T21:44:27.196736] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-09T21:44:27.996726] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-09T21:44:28.418417] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-09T21:44:28.649096] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T21:44:28.796750] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-09T21:44:29.596717] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-09T21:44:29.883516] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-09T21:44:29.884210] [INFO ] [REMOTE ] STXD: Full fetch complete (2024 records). [2025-10-09T21:44:29.884277] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-09T21:44:30.197739] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T21:44:30.247314] [INFO ] [REMOTE ] STWD: Full fetch complete (75195 records). [2025-10-09T21:44:30.269244] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-09T21:44:30.269095] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-09T21:44:30.269446] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-09T21:44:30.269562] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-09T21:44:30.269709] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-09T21:44:30.270282] [DEBUG] [LOCAL ] STXD: Trimmed 2024 records to 1244 (keeping 200 days of data) [2025-10-09T21:44:30.400454] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-09T21:44:30.395266] [DEBUG] [LOCAL ] STXD: Primary data saved (1244 records). [2025-10-09T21:44:30.429746] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-09T21:44:30.429926] [INFO ] [MAIN ] Update Progress: 2020/2373 symbols completed. STXD took 36.8s. Estimated remaining: 49m 42s. Rate: 7.1 symbols/min [2025-10-09T21:44:30.846482] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:44:30.846786] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-09T21:44:30.847215] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-09T21:44:30.848359] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-09T21:44:30.848498] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-09T21:44:30.852364] [DEBUG] [LOCAL ] STWD: Trimmed 75195 records to 52326 (keeping 200 days of data) [2025-10-09T21:44:30.852261] [DEBUG] [LOCAL ] STXK: Loaded 1514 existing records from primary storage. [2025-10-09T21:44:30.852890] [INFO ] [MAIN ] STXK: Loaded 1514 existing records. [2025-10-09T21:44:31.001936] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T21:44:31.150894] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:44:31.155398] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-09T21:44:31.157762] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-09T21:44:31.162116] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-09T21:44:31.164373] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-09T21:44:31.254230] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-09T21:44:31.644738] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:44:31.737203] [DEBUG] [LOCAL ] STWD: Primary data saved (52326 records). [2025-10-09T21:44:31.737338] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-09T21:44:31.737421] [INFO ] [MAIN ] Update Progress: 2021/2373 symbols completed. STWD took 42.6s. Estimated remaining: 49m 33s. Rate: 7.1 symbols/min [2025-10-09T21:44:31.841689] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T21:44:31.914309] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:44:31.914509] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-09T21:44:31.914583] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-09T21:44:31.914703] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-09T21:44:31.914755] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-09T21:44:31.914798] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-09T21:44:31.914845] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-09T21:44:32.001844] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-09T21:44:32.270075] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:44:32.391701] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-09T21:44:32.796814] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-09T21:44:33.097935] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-09T21:44:33.596722] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-09T21:44:33.960298] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T21:44:34.396712] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-09T21:44:34.849599] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T21:44:35.196712] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-09T21:44:35.641683] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T21:44:35.996720] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-09T21:44:36.462891] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T21:44:36.796714] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-09T21:44:37.217211] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-09T21:44:37.596716] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-09T21:44:37.977066] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T21:44:37.977993] [INFO ] [REMOTE ] STXE: Full fetch complete (3517 records). [2025-10-09T21:44:37.978062] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-09T21:44:38.334554] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-09T21:44:38.334725] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-09T21:44:38.334874] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-09T21:44:38.334914] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-09T21:44:38.335263] [DEBUG] [LOCAL ] STXE: Trimmed 3517 records to 2107 (keeping 200 days of data) [2025-10-09T21:44:38.348638] [DEBUG] [LOCAL ] STXE: Primary data saved (2107 records). [2025-10-09T21:44:38.348728] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-09T21:44:38.348798] [INFO ] [MAIN ] Update Progress: 2022/2373 symbols completed. STXE took 30.5s. Estimated remaining: 49m 24s. Rate: 7.1 symbols/min [2025-10-09T21:44:38.401969] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-09T21:44:38.533330] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:44:38.538606] [DEBUG] [LOCAL ] STXT: Loaded 2495 existing records from primary storage. [2025-10-09T21:44:38.538823] [INFO ] [MAIN ] STXT: Loaded 2495 existing records. [2025-10-09T21:44:38.713552] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:44:38.713789] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-09T21:44:38.713842] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-09T21:44:38.713982] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-09T21:44:38.714042] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-09T21:44:38.817914] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T21:44:39.075559] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:44:39.196731] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-09T21:44:39.778527] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T21:44:39.996750] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-09T21:44:40.343784] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-09T21:44:40.796733] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-09T21:44:41.398741] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T21:44:41.596696] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-09T21:44:41.958006] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T21:44:41.958817] [INFO ] [REMOTE ] STXG: Full fetch complete (4101 records). [2025-10-09T21:44:41.958888] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-09T21:44:42.309906] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-09T21:44:42.309980] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-09T21:44:42.310100] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-09T21:44:42.310137] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-09T21:44:42.310491] [DEBUG] [LOCAL ] STXG: Trimmed 4101 records to 2480 (keeping 200 days of data) [2025-10-09T21:44:42.325811] [DEBUG] [LOCAL ] STXG: Primary data saved (2480 records). [2025-10-09T21:44:42.325875] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-09T21:44:42.325943] [INFO ] [MAIN ] Update Progress: 2023/2373 symbols completed. STXG took 29.0s. Estimated remaining: 49m 15s. Rate: 7.1 symbols/min [2025-10-09T21:44:42.401843] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-09T21:44:42.493778] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:44:42.497539] [DEBUG] [LOCAL ] STXV: Loaded 1545 existing records from primary storage. [2025-10-09T21:44:42.497721] [INFO ] [MAIN ] STXV: Loaded 1545 existing records. [2025-10-09T21:44:42.671108] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:44:42.671288] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-09T21:44:42.671334] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-09T21:44:42.671495] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-09T21:44:42.671551] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-09T21:44:42.995197] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T21:44:43.046307] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:44:43.196813] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-09T21:44:43.657780] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T21:44:43.996808] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-09T21:44:44.331850] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T21:44:44.796748] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-09T21:44:45.127804] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-09T21:44:45.596796] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-09T21:44:46.057309] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T21:44:46.396746] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-09T21:44:46.876141] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T21:44:47.196754] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-09T21:44:47.525728] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T21:44:47.996717] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-09T21:44:48.412026] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-09T21:44:48.796725] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-09T21:44:49.097792] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-09T21:44:49.596722] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-09T21:44:50.132135] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-09T21:44:50.396716] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-09T21:44:50.839946] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T21:44:51.196787] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-09T21:44:51.740002] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T21:44:51.996745] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-09T21:44:52.428839] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T21:44:52.796713] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-09T21:44:53.228807] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T21:44:53.596755] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-09T21:44:53.910334] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-09T21:44:54.396790] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-09T21:44:54.895290] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-09T21:44:55.196763] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-09T21:44:55.456715] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-09T21:44:55.996753] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-09T21:44:56.557584] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T21:44:56.796739] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-09T21:44:57.251149] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T21:44:57.596737] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-09T21:44:58.034878] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T21:44:58.396727] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-09T21:44:58.859206] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T21:44:59.196728] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-09T21:44:59.648063] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T21:44:59.996746] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-09T21:45:00.433607] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T21:45:00.796724] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-09T21:45:01.209884] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T21:45:01.210977] [INFO ] [REMOTE ] STXT: Full fetch complete (3907 records). [2025-10-09T21:45:01.211069] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-09T21:45:01.597626] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-09T21:45:01.597327] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-09T21:45:01.598563] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-09T21:45:01.598770] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-09T21:45:01.598835] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-09T21:45:01.599245] [DEBUG] [LOCAL ] STXT: Trimmed 3907 records to 2515 (keeping 200 days of data) [2025-10-09T21:45:01.615904] [DEBUG] [LOCAL ] STXT: Primary data saved (2515 records). [2025-10-09T21:45:01.616009] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-09T21:45:01.616101] [INFO ] [MAIN ] Update Progress: 2024/2373 symbols completed. STXT took 23.3s. Estimated remaining: 49m 8s. Rate: 7.1 symbols/min [2025-10-09T21:45:01.813599] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:45:01.869893] [DEBUG] [LOCAL ] STZ: Loaded 52332 existing records from primary storage. [2025-10-09T21:45:01.870242] [INFO ] [MAIN ] STZ: Loaded 52332 existing records. [2025-10-09T21:45:01.986890] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-09T21:45:02.057032] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:45:02.057281] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-09T21:45:02.057329] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-09T21:45:02.057533] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-09T21:45:02.057589] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-09T21:45:02.397734] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-09T21:45:02.425478] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:45:02.791475] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-09T21:45:03.196717] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-09T21:45:03.662446] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T21:45:03.996746] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-09T21:45:04.796738] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-09T21:45:05.142524] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T21:45:05.596743] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-09T21:45:05.836247] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T21:45:05.897850] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T21:45:05.898855] [INFO ] [REMOTE ] STXK: Full fetch complete (2416 records). [2025-10-09T21:45:05.899166] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-09T21:45:06.251424] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-09T21:45:06.251498] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-09T21:45:06.251595] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-09T21:45:06.251633] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-09T21:45:06.251999] [DEBUG] [LOCAL ] STXK: Trimmed 2416 records to 1534 (keeping 200 days of data) [2025-10-09T21:45:06.262027] [DEBUG] [LOCAL ] STXK: Primary data saved (1534 records). [2025-10-09T21:45:06.262087] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-09T21:45:06.262202] [INFO ] [MAIN ] Update Progress: 2025/2373 symbols completed. STXK took 35.8s. Estimated remaining: 48m 59s. Rate: 7.1 symbols/min [2025-10-09T21:45:06.409253] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-09T21:45:06.445241] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:45:06.500512] [DEBUG] [LOCAL ] SU: Loaded 53435 existing records from primary storage. [2025-10-09T21:45:06.500928] [INFO ] [MAIN ] SU: Loaded 53435 existing records. [2025-10-09T21:45:06.679615] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:45:06.679882] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-09T21:45:06.679945] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-09T21:45:06.680827] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-09T21:45:06.680889] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-09T21:45:06.764122] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T21:45:06.786054] [INFO ] [REMOTE ] STXM: Full fetch complete (1412 records). [2025-10-09T21:45:06.786197] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-09T21:45:07.162208] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-09T21:45:07.172720] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:45:07.206462] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-09T21:45:07.196060] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:45:07.240381] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-09T21:45:07.241279] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-09T21:45:07.245074] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-09T21:45:07.244570] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:45:07.245207] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-09T21:45:07.245448] [INFO ] [MAIN ] Update Progress: 2026/2373 symbols completed. STXM took 35.5s. Estimated remaining: 48m 49s. Rate: 7.1 symbols/min [2025-10-09T21:45:07.424593] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:45:07.467084] [DEBUG] [LOCAL ] SUI: Loaded 41672 existing records from primary storage. [2025-10-09T21:45:07.467449] [INFO ] [MAIN ] SUI: Loaded 41672 existing records. [2025-10-09T21:45:07.652367] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:45:07.652622] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-09T21:45:07.652703] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-09T21:45:07.652957] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-09T21:45:07.653015] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-09T21:45:07.999182] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-09T21:45:08.013458] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:45:08.643203] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T21:45:08.796709] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-09T21:45:09.596730] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-09T21:45:09.704995] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T21:45:10.150000] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T21:45:10.396721] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-09T21:45:11.154414] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T21:45:11.196725] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-09T21:45:11.996732] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-09T21:45:12.068695] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T21:45:12.345180] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-09T21:45:12.801792] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-09T21:45:12.820871] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T21:45:13.596744] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-09T21:45:14.323215] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T21:45:14.396690] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-09T21:45:15.196711] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-09T21:45:15.412986] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T21:45:15.496743] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T21:45:15.620393] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T21:45:15.996718] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-09T21:45:16.796729] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-09T21:45:17.596770] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-09T21:45:18.023049] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T21:45:18.396680] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-09T21:45:18.425108] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T21:45:19.196688] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-09T21:45:19.278270] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T21:45:19.525454] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T21:45:19.996726] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-09T21:45:20.582526] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-09T21:45:20.796698] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-09T21:45:21.229527] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T21:45:21.462810] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:45:21.596775] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-09T21:45:22.036366] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T21:45:22.396788] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-09T21:45:23.196778] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-09T21:45:23.996746] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-09T21:45:24.367520] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-09T21:45:24.432995] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T21:45:24.796738] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-09T21:45:24.996922] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T21:45:25.076204] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-09T21:45:25.076964] [INFO ] [REMOTE ] STXV: Full fetch complete (2549 records). [2025-10-09T21:45:25.077030] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-09T21:45:25.425599] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-09T21:45:25.425701] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-09T21:45:25.425813] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-09T21:45:25.425852] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-09T21:45:25.426174] [DEBUG] [LOCAL ] STXV: Trimmed 2549 records to 1550 (keeping 200 days of data) [2025-10-09T21:45:25.436521] [DEBUG] [LOCAL ] STXV: Primary data saved (1550 records). [2025-10-09T21:45:25.436583] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-09T21:45:25.436667] [INFO ] [MAIN ] Update Progress: 2027/2373 symbols completed. STXV took 43.1s. Estimated remaining: 48m 43s. Rate: 7.1 symbols/min [2025-10-09T21:45:25.605120] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-09T21:45:25.609496] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:45:25.651214] [DEBUG] [LOCAL ] SUN: Loaded 37938 existing records from primary storage. [2025-10-09T21:45:25.651539] [INFO ] [MAIN ] SUN: Loaded 37938 existing records. [2025-10-09T21:45:25.836732] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:45:25.836949] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-09T21:45:25.837000] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-09T21:45:25.837255] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-09T21:45:25.837316] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-09T21:45:26.208108] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:45:26.396738] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-09T21:45:27.196713] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-09T21:45:27.468605] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T21:45:27.884251] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T21:45:27.996706] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-09T21:45:28.796757] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-09T21:45:29.137428] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T21:45:29.525447] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T21:45:29.596746] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-09T21:45:30.396732] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-09T21:45:30.517137] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T21:45:31.196737] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-09T21:45:31.581679] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T21:45:31.648996] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T21:45:31.996713] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-09T21:45:32.796711] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-09T21:45:32.991892] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T21:45:33.400974] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T21:45:33.596709] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-09T21:45:34.057683] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T21:45:34.396802] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-09T21:45:34.602283] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T21:45:35.196752] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-09T21:45:35.770097] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T21:45:35.996764] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-09T21:45:36.796841] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-09T21:45:37.356322] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T21:45:37.448803] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-09T21:45:37.596697] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-09T21:45:38.156825] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T21:45:38.161397] [INFO ] [REMOTE ] STZ: Full fetch complete (75916 records). [2025-10-09T21:45:38.161527] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-09T21:45:38.403919] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-09T21:45:38.565405] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-09T21:45:38.565567] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-09T21:45:38.566775] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-09T21:45:38.566841] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-09T21:45:38.568544] [DEBUG] [LOCAL ] STZ: Trimmed 75916 records to 52717 (keeping 200 days of data) [2025-10-09T21:45:38.699902] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T21:45:38.955123] [DEBUG] [LOCAL ] STZ: Primary data saved (52717 records). [2025-10-09T21:45:38.955245] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-09T21:45:38.956358] [INFO ] [MAIN ] Update Progress: 2028/2373 symbols completed. STZ took 37.3s. Estimated remaining: 48m 35s. Rate: 7.1 symbols/min [2025-10-09T21:45:39.122571] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:45:39.178012] [DEBUG] [LOCAL ] SUPV: Loaded 47466 existing records from primary storage. [2025-10-09T21:45:39.178367] [INFO ] [MAIN ] SUPV: Loaded 47466 existing records. [2025-10-09T21:45:39.208770] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-09T21:45:39.380306] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:45:39.380585] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-09T21:45:39.380728] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-09T21:45:39.381460] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-09T21:45:39.381538] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-09T21:45:39.779713] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:45:39.996673] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-09T21:45:40.065523] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T21:45:40.659430] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T21:45:40.796669] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-09T21:45:41.596732] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-09T21:45:41.634008] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T21:45:42.396749] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-09T21:45:42.540273] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T21:45:43.196707] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-09T21:45:43.310753] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T21:45:43.672977] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T21:45:43.996729] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-09T21:45:44.468191] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T21:45:44.796737] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-09T21:45:45.219084] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T21:45:45.223235] [INFO ] [REMOTE ] SUI: Full fetch complete (60891 records). [2025-10-09T21:45:45.223346] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-09T21:45:45.601817] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-09T21:45:45.685805] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-09T21:45:45.685903] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-09T21:45:45.687125] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-09T21:45:45.687195] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-09T21:45:45.688852] [DEBUG] [LOCAL ] SUI: Trimmed 60891 records to 42042 (keeping 200 days of data) [2025-10-09T21:45:46.000757] [DEBUG] [LOCAL ] SUI: Primary data saved (42042 records). [2025-10-09T21:45:46.000899] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-09T21:45:46.000985] [INFO ] [MAIN ] Update Progress: 2029/2373 symbols completed. SUI took 38.8s. Estimated remaining: 48m 26s. Rate: 7.1 symbols/min [2025-10-09T21:45:46.209235] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:45:46.233065] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T21:45:46.279224] [DEBUG] [LOCAL ] SUZ: Loaded 45553 existing records from primary storage. [2025-10-09T21:45:46.279562] [INFO ] [MAIN ] SUZ: Loaded 45553 existing records. [2025-10-09T21:45:46.401836] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-09T21:45:46.457988] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:45:46.458731] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-09T21:45:46.458854] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-09T21:45:46.459147] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-09T21:45:46.459224] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-09T21:45:46.910293] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:45:47.027567] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T21:45:47.196700] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-09T21:45:47.996699] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-09T21:45:48.095702] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T21:45:48.712579] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T21:45:48.796760] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-09T21:45:49.167421] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T21:45:49.596709] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-09T21:45:50.396687] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-09T21:45:50.504898] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T21:45:50.890874] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T21:45:50.897151] [INFO ] [REMOTE ] SU: Full fetch complete (77384 records). [2025-10-09T21:45:50.897277] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-09T21:45:51.201785] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-09T21:45:51.285579] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-09T21:45:51.285684] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-09T21:45:51.286815] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-09T21:45:51.286879] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-09T21:45:51.288377] [DEBUG] [LOCAL ] SU: Trimmed 77384 records to 53823 (keeping 200 days of data) [2025-10-09T21:45:51.634462] [DEBUG] [LOCAL ] SU: Primary data saved (53823 records). [2025-10-09T21:45:51.634607] [INFO ] [MAIN ] SU: Full history saved. [2025-10-09T21:45:51.634733] [INFO ] [MAIN ] Update Progress: 2030/2373 symbols completed. SU took 45.4s. Estimated remaining: 48m 17s. Rate: 7.1 symbols/min [2025-10-09T21:45:51.806578] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:45:51.854965] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T21:45:51.876529] [DEBUG] [LOCAL ] SVV: Loaded 39949 existing records from primary storage. [2025-10-09T21:45:51.876856] [INFO ] [MAIN ] SVV: Loaded 39949 existing records. [2025-10-09T21:45:52.001842] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-09T21:45:52.060295] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:45:52.060516] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-09T21:45:52.060565] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-09T21:45:52.060817] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-09T21:45:52.060876] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-09T21:45:52.468862] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:45:52.796713] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-09T21:45:52.839193] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T21:45:53.425396] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T21:45:53.429106] [INFO ] [REMOTE ] SUN: Full fetch complete (55160 records). [2025-10-09T21:45:53.429211] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-09T21:45:53.598283] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-09T21:45:53.809515] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-09T21:45:53.809683] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-09T21:45:53.810734] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-09T21:45:53.810797] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-09T21:45:53.811910] [DEBUG] [LOCAL ] SUN: Trimmed 55160 records to 38241 (keeping 200 days of data) [2025-10-09T21:45:54.052704] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T21:45:54.092608] [DEBUG] [LOCAL ] SUN: Primary data saved (38241 records). [2025-10-09T21:45:54.092752] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-09T21:45:54.093372] [INFO ] [MAIN ] Update Progress: 2031/2373 symbols completed. SUN took 28.7s. Estimated remaining: 48m 8s. Rate: 7.1 symbols/min [2025-10-09T21:45:54.267019] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:45:54.328141] [DEBUG] [LOCAL ] SW: Loaded 53184 existing records from primary storage. [2025-10-09T21:45:54.328464] [INFO ] [MAIN ] SW: Loaded 53184 existing records. [2025-10-09T21:45:54.401803] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-09T21:45:54.506973] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:45:54.507183] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-09T21:45:54.507230] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-09T21:45:54.507484] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-09T21:45:54.507541] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-09T21:45:54.859308] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:45:55.016303] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T21:45:55.196793] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-09T21:45:55.996764] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-09T21:45:56.120385] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T21:45:56.577869] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T21:45:56.796730] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-09T21:45:57.409028] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T21:45:57.596751] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-09T21:45:58.104959] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T21:45:58.396754] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-09T21:45:59.196707] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-09T21:45:59.313210] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T21:45:59.544358] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T21:45:59.996699] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-09T21:46:00.796702] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-09T21:46:01.042859] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T21:46:01.596690] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-09T21:46:01.692319] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T21:46:02.182176] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T21:46:02.396760] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-09T21:46:03.196790] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-09T21:46:03.226454] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T21:46:03.920550] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T21:46:03.996698] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-09T21:46:04.796694] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-09T21:46:05.035120] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T21:46:05.596688] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-09T21:46:05.703328] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T21:46:05.999581] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T21:46:06.396729] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-09T21:46:07.148109] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T21:46:07.196687] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-09T21:46:07.743436] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T21:46:07.996737] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-09T21:46:08.693374] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T21:46:08.796694] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-09T21:46:09.596720] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-09T21:46:09.756486] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T21:46:10.396720] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-09T21:46:10.505854] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T21:46:10.899769] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T21:46:11.196770] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-09T21:46:11.996695] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-09T21:46:12.150574] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T21:46:12.796737] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-09T21:46:12.918996] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T21:46:13.196000] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T21:46:13.200248] [INFO ] [REMOTE ] SUPV: Full fetch complete (68474 records). [2025-10-09T21:46:13.200370] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-09T21:46:13.583433] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-09T21:46:13.583519] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-09T21:46:13.584551] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-09T21:46:13.584613] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-09T21:46:13.586038] [DEBUG] [LOCAL ] SUPV: Trimmed 68474 records to 47846 (keeping 200 days of data) [2025-10-09T21:46:13.640791] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-09T21:46:13.876988] [DEBUG] [LOCAL ] SUPV: Primary data saved (47846 records). [2025-10-09T21:46:13.877133] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-09T21:46:13.877221] [INFO ] [MAIN ] Update Progress: 2032/2373 symbols completed. SUPV took 34.9s. Estimated remaining: 48m 1s. Rate: 7.1 symbols/min [2025-10-09T21:46:14.052994] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:46:14.104822] [DEBUG] [LOCAL ] SWK: Loaded 52432 existing records from primary storage. [2025-10-09T21:46:14.105224] [INFO ] [MAIN ] SWK: Loaded 52432 existing records. [2025-10-09T21:46:14.293599] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:46:14.293871] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-09T21:46:14.293922] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-09T21:46:14.294122] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-09T21:46:14.294180] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-09T21:46:14.403855] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-09T21:46:14.689700] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:46:14.710349] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T21:46:14.771075] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T21:46:15.196695] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-09T21:46:16.004273] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-09T21:46:16.021804] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T21:46:16.796741] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-09T21:46:16.871263] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T21:46:17.596679] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-09T21:46:17.886383] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T21:46:17.956765] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T21:46:18.396759] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-09T21:46:19.087535] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T21:46:19.196718] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-09T21:46:19.376209] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T21:46:19.380457] [INFO ] [REMOTE ] SUZ: Full fetch complete (66591 records). [2025-10-09T21:46:19.380587] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-09T21:46:19.789241] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-09T21:46:19.789346] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-09T21:46:19.790533] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-09T21:46:19.790607] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-09T21:46:19.792152] [DEBUG] [LOCAL ] SUZ: Trimmed 66591 records to 45890 (keeping 200 days of data) [2025-10-09T21:46:19.999592] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-09T21:46:20.062970] [DEBUG] [LOCAL ] SUZ: Primary data saved (45890 records). [2025-10-09T21:46:20.063172] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-09T21:46:20.063308] [INFO ] [MAIN ] Update Progress: 2033/2373 symbols completed. SUZ took 34.1s. Estimated remaining: 47m 53s. Rate: 7.1 symbols/min [2025-10-09T21:46:20.243239] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:46:20.267408] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T21:46:20.304504] [DEBUG] [LOCAL ] SWX: Loaded 31200 existing records from primary storage. [2025-10-09T21:46:20.304853] [INFO ] [MAIN ] SWX: Loaded 31200 existing records. [2025-10-09T21:46:20.495971] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:46:20.496256] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-09T21:46:20.496317] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-09T21:46:20.496596] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-09T21:46:20.496692] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-09T21:46:20.809490] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-09T21:46:20.851476] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:46:21.596695] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-09T21:46:21.816276] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T21:46:22.061516] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T21:46:22.396739] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-09T21:46:23.125960] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T21:46:23.196696] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-09T21:46:23.996762] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-09T21:46:24.238409] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T21:46:24.561891] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:46:24.566579] [INFO ] [REMOTE ] SW: Full fetch complete (76827 records). [2025-10-09T21:46:24.566754] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-09T21:46:24.803221] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-09T21:46:25.000917] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-09T21:46:25.001170] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-09T21:46:25.003728] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T21:46:25.002689] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-09T21:46:25.012938] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-09T21:46:25.015049] [DEBUG] [LOCAL ] SW: Trimmed 76827 records to 53574 (keeping 200 days of data) [2025-10-09T21:46:25.340951] [DEBUG] [LOCAL ] SW: Primary data saved (53574 records). [2025-10-09T21:46:25.341103] [INFO ] [MAIN ] SW: Full history saved. [2025-10-09T21:46:25.341851] [INFO ] [MAIN ] Update Progress: 2034/2373 symbols completed. SW took 31.2s. Estimated remaining: 47m 44s. Rate: 7.1 symbols/min [2025-10-09T21:46:25.516093] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:46:25.526320] [DEBUG] [LOCAL ] SWZ: Loaded 6101 existing records from primary storage. [2025-10-09T21:46:25.526540] [INFO ] [MAIN ] SWZ: Loaded 6101 existing records. [2025-10-09T21:46:25.600398] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-09T21:46:25.711931] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:46:25.712254] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-09T21:46:25.712359] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-09T21:46:25.712572] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-09T21:46:25.712639] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-09T21:46:25.936560] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T21:46:26.086071] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:46:26.396739] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-09T21:46:26.979777] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T21:46:27.196731] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-09T21:46:27.727465] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T21:46:27.996771] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-09T21:46:28.622537] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T21:46:28.628881] [INFO ] [REMOTE ] SVV: Full fetch complete (56682 records). [2025-10-09T21:46:28.629118] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-09T21:46:28.802055] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-09T21:46:29.230092] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-09T21:46:29.230316] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-09T21:46:29.231631] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-09T21:46:29.231899] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-09T21:46:29.233969] [DEBUG] [LOCAL ] SVV: Trimmed 56682 records to 40238 (keeping 200 days of data) [2025-10-09T21:46:29.375370] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T21:46:29.377164] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T21:46:29.590507] [DEBUG] [LOCAL ] SVV: Primary data saved (40238 records). [2025-10-09T21:46:29.590699] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-09T21:46:29.590801] [INFO ] [MAIN ] Update Progress: 2035/2373 symbols completed. SVV took 38.0s. Estimated remaining: 47m 34s. Rate: 7.1 symbols/min [2025-10-09T21:46:29.603232] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-09T21:46:29.786802] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:46:29.828432] [DEBUG] [LOCAL ] SXC: Loaded 41425 existing records from primary storage. [2025-10-09T21:46:29.828771] [INFO ] [MAIN ] SXC: Loaded 41425 existing records. [2025-10-09T21:46:30.016638] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:46:30.017019] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-09T21:46:30.017080] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-09T21:46:30.017332] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-09T21:46:30.017408] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-09T21:46:30.384170] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:46:30.396682] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-09T21:46:31.196812] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-09T21:46:31.561691] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-09T21:46:31.996752] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-09T21:46:32.226459] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T21:46:32.332807] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T21:46:32.796741] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-09T21:46:33.596748] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-09T21:46:33.791125] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T21:46:34.240799] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T21:46:34.265189] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T21:46:34.396684] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-09T21:46:35.196728] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-09T21:46:35.916292] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T21:46:35.996737] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-09T21:46:36.796718] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-09T21:46:36.910301] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T21:46:37.474894] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T21:46:37.596735] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-09T21:46:38.328860] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T21:46:38.396793] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-09T21:46:38.939036] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T21:46:39.196733] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-09T21:46:40.004742] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-09T21:46:40.010440] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T21:46:40.796689] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-09T21:46:40.988660] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T21:46:41.028998] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T21:46:41.436196] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T21:46:41.596729] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-09T21:46:42.396694] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-09T21:46:42.890593] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T21:46:43.199870] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-09T21:46:43.202994] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T21:46:43.996803] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-09T21:46:44.434339] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T21:46:44.526025] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T21:46:44.796767] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-09T21:46:45.596777] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-09T21:46:46.216271] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T21:46:46.396712] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-09T21:46:46.447483] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T21:46:47.196758] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-09T21:46:47.819681] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T21:46:47.996702] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-09T21:46:48.796705] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-09T21:46:48.827312] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T21:46:48.831631] [INFO ] [REMOTE ] SWK: Full fetch complete (75308 records). [2025-10-09T21:46:48.831774] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-09T21:46:49.230191] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-09T21:46:49.230400] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-09T21:46:49.231780] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-09T21:46:49.231885] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-09T21:46:49.233436] [DEBUG] [LOCAL ] SWK: Trimmed 75308 records to 52815 (keeping 200 days of data) [2025-10-09T21:46:49.348948] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T21:46:49.368877] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T21:46:49.598175] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-09T21:46:49.598331] [DEBUG] [LOCAL ] SWK: Primary data saved (52815 records). [2025-10-09T21:46:49.599518] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-09T21:46:49.599724] [INFO ] [MAIN ] Update Progress: 2036/2373 symbols completed. SWK took 35.7s. Estimated remaining: 47m 28s. Rate: 7.1 symbols/min [2025-10-09T21:46:49.772333] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:46:49.785683] [DEBUG] [LOCAL ] SXI: Loaded 11669 existing records from primary storage. [2025-10-09T21:46:49.785913] [INFO ] [MAIN ] SXI: Loaded 11669 existing records. [2025-10-09T21:46:49.966264] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:46:49.966483] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-09T21:46:49.966530] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-09T21:46:49.966806] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-09T21:46:49.966865] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-09T21:46:50.320104] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:46:50.396731] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-09T21:46:51.064377] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T21:46:51.196744] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-09T21:46:51.271413] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T21:46:51.996743] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-09T21:46:52.191442] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T21:46:52.674546] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T21:46:52.796712] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-09T21:46:53.596737] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-09T21:46:53.635719] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T21:46:54.248871] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T21:46:54.396710] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-09T21:46:55.196707] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-09T21:46:55.282456] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T21:46:55.935570] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T21:46:55.996668] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-09T21:46:56.600002] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T21:46:56.796724] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-09T21:46:57.596764] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-09T21:46:58.397352] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T21:46:58.397425] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-09T21:46:58.534176] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T21:46:58.862681] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T21:46:58.863713] [INFO ] [REMOTE ] SWZ: Full fetch complete (8175 records). [2025-10-09T21:46:58.863801] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-09T21:46:59.207676] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-09T21:46:59.226003] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-09T21:46:59.226087] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-09T21:46:59.226343] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-09T21:46:59.226391] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-09T21:46:59.226904] [DEBUG] [LOCAL ] SWZ: Trimmed 8175 records to 6129 (keeping 200 days of data) [2025-10-09T21:46:59.266760] [DEBUG] [LOCAL ] SWZ: Primary data saved (6129 records). [2025-10-09T21:46:59.266886] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-09T21:46:59.266970] [INFO ] [MAIN ] Update Progress: 2037/2373 symbols completed. SWZ took 33.9s. Estimated remaining: 47m 20s. Rate: 7.1 symbols/min [2025-10-09T21:46:59.996752] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-09T21:47:00.801769] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-09T21:47:00.804601] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T21:47:00.830221] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T21:47:01.596739] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-09T21:47:01.886458] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T21:47:01.889180] [INFO ] [REMOTE ] SWX: Full fetch complete (43921 records). [2025-10-09T21:47:01.889263] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-09T21:47:02.273579] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-09T21:47:02.273717] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-09T21:47:02.274692] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-09T21:47:02.274763] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-09T21:47:02.275941] [DEBUG] [LOCAL ] SWX: Trimmed 43921 records to 31366 (keeping 200 days of data) [2025-10-09T21:47:02.400259] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-09T21:47:02.471358] [DEBUG] [LOCAL ] SWX: Primary data saved (31366 records). [2025-10-09T21:47:02.471509] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-09T21:47:02.471609] [INFO ] [MAIN ] Update Progress: 2038/2373 symbols completed. SWX took 42.4s. Estimated remaining: 47m 10s. Rate: 7.1 symbols/min [2025-10-09T21:47:02.915207] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T21:47:02.919030] [INFO ] [REMOTE ] SXC: Full fetch complete (60916 records). [2025-10-09T21:47:02.919125] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-09T21:47:03.312972] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-09T21:47:03.320156] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-09T21:47:03.321429] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-09T21:47:03.322052] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-09T21:47:03.322443] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T21:47:03.326106] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-09T21:47:03.327597] [DEBUG] [LOCAL ] SXC: Trimmed 60916 records to 41724 (keeping 200 days of data) [2025-10-09T21:47:03.585351] [DEBUG] [LOCAL ] SXC: Primary data saved (41724 records). [2025-10-09T21:47:03.585512] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-09T21:47:03.585630] [INFO ] [MAIN ] Update Progress: 2039/2373 symbols completed. SXC took 34.0s. Estimated remaining: 47m 1s. Rate: 7.1 symbols/min [2025-10-09T21:47:04.251853] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T21:47:04.255362] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-09T21:47:05.214595] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T21:47:05.218362] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-09T21:47:06.006079] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T21:47:06.009427] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-09T21:47:06.753250] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T21:47:06.755366] [INFO ] [REMOTE ] SXI: Full fetch complete (15126 records). [2025-10-09T21:47:06.755454] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-09T21:47:07.130458] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-09T21:47:07.130572] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-09T21:47:07.130931] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-09T21:47:07.130992] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-09T21:47:07.131490] [DEBUG] [LOCAL ] SXI: Trimmed 15126 records to 11775 (keeping 200 days of data) [2025-10-09T21:47:07.206753] [DEBUG] [LOCAL ] SXI: Primary data saved (11775 records). [2025-10-09T21:47:07.206887] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-09T21:47:07.206983] [INFO ] [MAIN ] Update Progress: 2040/2373 symbols completed. SXI took 17.6s. Estimated remaining: 46m 52s. Rate: 7.1 symbols/min [2025-10-09T21:47:07.931467] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:47:07.924443] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:47:07.953181] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:47:07.974272] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:47:08.005179] [DEBUG] [LOCAL ] SXT: Loaded 29829 existing records from primary storage. [2025-10-09T21:47:08.031184] [INFO ] [MAIN ] SXT: Loaded 29829 existing records. [2025-10-09T21:47:08.168369] [DEBUG] [LOCAL ] SYK: Loaded 46882 existing records from primary storage. [2025-10-09T21:47:08.215841] [INFO ] [MAIN ] SYK: Loaded 46882 existing records. [2025-10-09T21:47:08.217918] [DEBUG] [LOCAL ] SYF: Loaded 53446 existing records from primary storage. [2025-10-09T21:47:08.246787] [INFO ] [MAIN ] SYF: Loaded 53446 existing records. [2025-10-09T21:47:08.343147] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:47:08.398058] [DEBUG] [LOCAL ] SYY: Loaded 53234 existing records from primary storage. [2025-10-09T21:47:08.455734] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-09T21:47:08.476514] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-09T21:47:08.481883] [INFO ] [MAIN ] SYY: Loaded 53234 existing records. [2025-10-09T21:47:08.526358] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-09T21:47:08.531415] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-09T21:47:08.867472] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:47:08.916740] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:47:08.922735] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-09T21:47:08.939065] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-09T21:47:08.946170] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-09T21:47:08.951771] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-09T21:47:08.961373] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-09T21:47:08.961630] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-09T21:47:08.987908] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-09T21:47:09.029212] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-09T21:47:09.223305] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:47:09.286706] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-09T21:47:09.373405] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-09T21:47:09.436713] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-09T21:47:09.559235] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-09T21:47:10.062177] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:47:10.127504] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-09T21:47:10.263910] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:47:10.334057] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-09T21:47:10.323423] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:47:10.382433] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-09T21:47:10.481730] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:47:10.482073] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-09T21:47:11.453310] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T21:47:11.457379] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-09T21:47:11.988489] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T21:47:12.000222] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-09T21:47:12.123134] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T21:47:12.132902] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-09T21:47:12.195232] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T21:47:12.206108] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-09T21:47:12.243784] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T21:47:12.796730] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-09T21:47:13.867845] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T21:47:13.882428] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-09T21:47:13.916942] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T21:47:13.948036] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T21:47:14.007807] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T21:47:14.396729] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-09T21:47:15.196723] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-09T21:47:15.555480] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T21:47:15.996682] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-09T21:47:16.142184] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T21:47:16.166722] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T21:47:16.796733] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-09T21:47:17.576368] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T21:47:17.596665] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-09T21:47:18.282472] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T21:47:18.396731] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-09T21:47:19.196796] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-09T21:47:19.641389] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T21:47:19.996749] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-09T21:47:20.108021] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T21:47:20.160995] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T21:47:20.796771] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-09T21:47:21.596755] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-09T21:47:21.684803] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T21:47:21.872195] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T21:47:22.396780] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-09T21:47:23.196787] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-09T21:47:23.386704] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T21:47:23.899586] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T21:47:23.996747] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-09T21:47:24.796737] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-09T21:47:25.220307] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T21:47:25.251474] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T21:47:25.596712] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-09T21:47:26.312388] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T21:47:26.396720] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-09T21:47:26.562434] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T21:47:27.196808] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-09T21:47:27.897817] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T21:47:27.996675] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-09T21:47:28.551838] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T21:47:28.796753] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-09T21:47:29.593542] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T21:47:29.605573] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-09T21:47:30.396697] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-09T21:47:30.550841] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T21:47:30.554153] [INFO ] [REMOTE ] SXT: Full fetch complete (39062 records). [2025-10-09T21:47:30.554361] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-09T21:47:30.709014] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T21:47:30.976267] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-09T21:47:30.976350] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-09T21:47:30.977286] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-09T21:47:30.977351] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-09T21:47:30.978278] [DEBUG] [LOCAL ] SXT: Trimmed 39062 records to 30046 (keeping 200 days of data) [2025-10-09T21:47:31.174463] [DEBUG] [LOCAL ] SXT: Primary data saved (30046 records). [2025-10-09T21:47:31.174609] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-09T21:47:31.175395] [INFO ] [MAIN ] Update Progress: 2041/2373 symbols completed. SXT took 24.0s. Estimated remaining: 46m 46s. Rate: 7.1 symbols/min [2025-10-09T21:47:31.204355] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-09T21:47:31.347823] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:47:31.403580] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-09T21:47:31.403929] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-09T21:47:31.579761] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:47:31.580027] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-09T21:47:31.580081] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-09T21:47:31.580373] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-09T21:47:31.580437] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-09T21:47:31.976355] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:47:32.000263] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-09T21:47:32.005514] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T21:47:32.796747] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-09T21:47:32.956234] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T21:47:33.574139] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T21:47:33.596666] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-09T21:47:34.396726] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-09T21:47:35.134636] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-09T21:47:35.201866] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-09T21:47:35.215220] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T21:47:35.996701] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-09T21:47:36.314664] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T21:47:36.796717] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-09T21:47:37.596747] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-09T21:47:37.674382] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-09T21:47:37.772153] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T21:47:38.326816] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T21:47:38.396682] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-09T21:47:39.196698] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-09T21:47:39.319500] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T21:47:39.996774] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-09T21:47:40.212476] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T21:47:40.550512] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T21:47:40.555074] [INFO ] [REMOTE ] SYY: Full fetch complete (76989 records). [2025-10-09T21:47:40.555193] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-09T21:47:40.801837] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-09T21:47:40.956849] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-09T21:47:40.956929] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-09T21:47:40.958044] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-09T21:47:40.958107] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-09T21:47:40.959622] [DEBUG] [LOCAL ] SYY: Trimmed 76989 records to 53622 (keeping 200 days of data) [2025-10-09T21:47:41.317859] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-09T21:47:41.353203] [DEBUG] [LOCAL ] SYY: Primary data saved (53622 records). [2025-10-09T21:47:41.353352] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-09T21:47:41.354606] [INFO ] [MAIN ] Update Progress: 2042/2373 symbols completed. SYY took 34.1s. Estimated remaining: 46m 37s. Rate: 7.1 symbols/min [2025-10-09T21:47:41.491532] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T21:47:41.550371] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:47:41.550738] [INFO ] [REMOTE ] SYF: Full fetch complete (77337 records). [2025-10-09T21:47:41.551505] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-09T21:47:41.601902] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-09T21:47:41.997822] [DEBUG] [LOCAL ] TAC: Loaded 42688 existing records from primary storage. [2025-10-09T21:47:42.024395] [INFO ] [MAIN ] TAC: Loaded 42688 existing records. [2025-10-09T21:47:42.213771] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-09T21:47:42.219468] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-09T21:47:42.231367] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-09T21:47:42.236576] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-09T21:47:42.300743] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:47:42.301198] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-09T21:47:42.301251] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-09T21:47:42.301482] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-09T21:47:42.301539] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-09T21:47:42.333420] [DEBUG] [LOCAL ] SYF: Trimmed 77337 records to 53836 (keeping 200 days of data) [2025-10-09T21:47:42.398091] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-09T21:47:42.794478] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:47:43.024795] [DEBUG] [LOCAL ] SYF: Primary data saved (53836 records). [2025-10-09T21:47:43.024939] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-09T21:47:43.025038] [INFO ] [MAIN ] Update Progress: 2043/2373 symbols completed. SYF took 35.8s. Estimated remaining: 46m 28s. Rate: 7.1 symbols/min [2025-10-09T21:47:43.205171] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:47:43.205330] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-09T21:47:43.253824] [DEBUG] [LOCAL ] TAK: Loaded 49986 existing records from primary storage. [2025-10-09T21:47:43.254170] [INFO ] [MAIN ] TAK: Loaded 49986 existing records. [2025-10-09T21:47:43.461014] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:47:43.461286] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-09T21:47:43.461568] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-09T21:47:43.464944] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-09T21:47:43.464897] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T21:47:43.474480] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-09T21:47:43.826190] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:47:43.996716] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-09T21:47:44.797093] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-09T21:47:44.803274] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T21:47:44.843348] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-09T21:47:45.319628] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T21:47:45.596759] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-09T21:47:46.122621] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T21:47:46.396741] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-09T21:47:47.196725] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-09T21:47:47.783900] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-09T21:47:47.998675] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-09T21:47:48.004078] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T21:47:48.784292] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T21:47:48.796665] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-09T21:47:49.596722] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-09T21:47:50.152304] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T21:47:50.157463] [INFO ] [REMOTE ] SYK: Full fetch complete (68920 records). [2025-10-09T21:47:50.157615] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-09T21:47:50.405781] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-09T21:47:50.513079] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T21:47:50.621599] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-09T21:47:50.621830] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-09T21:47:50.623072] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-09T21:47:50.623277] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-09T21:47:50.654357] [DEBUG] [LOCAL ] SYK: Trimmed 68920 records to 47241 (keeping 200 days of data) [2025-10-09T21:47:50.656095] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-09T21:47:50.982230] [DEBUG] [LOCAL ] SYK: Primary data saved (47241 records). [2025-10-09T21:47:50.982370] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-09T21:47:50.982453] [INFO ] [MAIN ] Update Progress: 2044/2373 symbols completed. SYK took 43.8s. Estimated remaining: 46m 19s. Rate: 7.1 symbols/min [2025-10-09T21:47:51.161037] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:47:51.197540] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-09T21:47:51.213950] [DEBUG] [LOCAL ] TAL: Loaded 51818 existing records from primary storage. [2025-10-09T21:47:51.214292] [INFO ] [MAIN ] TAL: Loaded 51818 existing records. [2025-10-09T21:47:51.396512] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:47:51.396759] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-09T21:47:51.396812] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-09T21:47:51.397250] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-09T21:47:51.397312] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-09T21:47:51.768019] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:47:51.996716] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-09T21:47:52.127841] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T21:47:52.796709] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-09T21:47:52.945961] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T21:47:53.596686] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-09T21:47:53.710721] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T21:47:54.115779] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T21:47:54.396749] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-09T21:47:55.196740] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-09T21:47:55.972515] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-09T21:47:55.996666] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-09T21:47:56.031739] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T21:47:56.796716] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-09T21:47:57.061066] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T21:47:57.596739] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-09T21:47:58.202000] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T21:47:58.285610] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-09T21:47:58.396683] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-09T21:47:59.196684] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-09T21:47:59.442919] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T21:47:59.996720] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-09T21:48:00.746721] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-09T21:48:00.796729] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-09T21:48:01.075534] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T21:48:01.596723] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-09T21:48:01.745239] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T21:48:02.396732] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-09T21:48:02.990490] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-09T21:48:03.049053] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T21:48:03.196723] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-09T21:48:03.590250] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T21:48:03.772423] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T21:48:03.776909] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-09T21:48:03.777035] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-09T21:48:04.001884] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-09T21:48:04.191986] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-09T21:48:04.192074] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-09T21:48:04.193237] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-09T21:48:04.193303] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-09T21:48:04.194790] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 54188 (keeping 200 days of data) [2025-10-09T21:48:04.538736] [DEBUG] [LOCAL ] T: Primary data saved (54188 records). [2025-10-09T21:48:04.538877] [INFO ] [MAIN ] T: Full history saved. [2025-10-09T21:48:04.539688] [INFO ] [MAIN ] Update Progress: 2045/2373 symbols completed. T took 33.4s. Estimated remaining: 46m 12s. Rate: 7.1 symbols/min [2025-10-09T21:48:04.720168] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:48:04.769094] [DEBUG] [LOCAL ] TALO: Loaded 50854 existing records from primary storage. [2025-10-09T21:48:04.769470] [INFO ] [MAIN ] TALO: Loaded 50854 existing records. [2025-10-09T21:48:04.803594] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-09T21:48:04.960784] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:48:04.960995] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-09T21:48:04.961044] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-09T21:48:04.961281] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-09T21:48:04.961340] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-09T21:48:05.328858] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:48:05.596711] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-09T21:48:05.711143] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T21:48:06.396703] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-09T21:48:06.484856] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T21:48:06.818006] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T21:48:07.196841] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-09T21:48:07.774080] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T21:48:07.996717] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-09T21:48:08.796696] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-09T21:48:08.959151] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T21:48:09.525379] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T21:48:09.596682] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-09T21:48:10.106203] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T21:48:10.396761] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-09T21:48:11.071782] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T21:48:11.196690] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-09T21:48:11.996682] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-09T21:48:12.143722] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T21:48:12.622971] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T21:48:12.627072] [INFO ] [REMOTE ] TAC: Full fetch complete (63882 records). [2025-10-09T21:48:12.627178] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-09T21:48:12.797035] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-09T21:48:13.030816] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-09T21:48:13.030941] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-09T21:48:13.032210] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-09T21:48:13.032288] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-09T21:48:13.033924] [DEBUG] [LOCAL ] TAC: Trimmed 63882 records to 43025 (keeping 200 days of data) [2025-10-09T21:48:13.303212] [DEBUG] [LOCAL ] TAC: Primary data saved (43025 records). [2025-10-09T21:48:13.303346] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-09T21:48:13.303441] [INFO ] [MAIN ] Update Progress: 2046/2373 symbols completed. TAC took 31.9s. Estimated remaining: 46m 3s. Rate: 7.1 symbols/min [2025-10-09T21:48:13.480667] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:48:13.530230] [DEBUG] [LOCAL ] TAP: Loaded 52922 existing records from primary storage. [2025-10-09T21:48:13.530692] [INFO ] [MAIN ] TAP: Loaded 52922 existing records. [2025-10-09T21:48:13.601859] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-09T21:48:13.747546] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:48:13.750078] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T21:48:13.748435] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-09T21:48:13.759411] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-09T21:48:13.760314] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-09T21:48:13.760382] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-09T21:48:14.111543] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:48:14.396690] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-09T21:48:14.578370] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T21:48:15.196696] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-09T21:48:15.515970] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T21:48:15.996693] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-09T21:48:16.050401] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T21:48:16.796769] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-09T21:48:16.913747] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T21:48:16.918333] [INFO ] [REMOTE ] TAK: Full fetch complete (71739 records). [2025-10-09T21:48:16.918452] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-09T21:48:17.307089] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-09T21:48:17.307236] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-09T21:48:17.308415] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-09T21:48:17.308478] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-09T21:48:17.309846] [DEBUG] [LOCAL ] TAK: Trimmed 71739 records to 50348 (keeping 200 days of data) [2025-10-09T21:48:17.606976] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-09T21:48:17.629266] [DEBUG] [LOCAL ] TAK: Primary data saved (50348 records). [2025-10-09T21:48:17.629390] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-09T21:48:17.629491] [INFO ] [MAIN ] Update Progress: 2047/2373 symbols completed. TAK took 34.6s. Estimated remaining: 45m 54s. Rate: 7.1 symbols/min [2025-10-09T21:48:17.841419] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:48:17.844343] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T21:48:17.865157] [DEBUG] [LOCAL ] TBB: Loaded 11692 existing records from primary storage. [2025-10-09T21:48:17.865425] [INFO ] [MAIN ] TBB: Loaded 11692 existing records. [2025-10-09T21:48:18.047558] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:48:18.047873] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-09T21:48:18.047935] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-09T21:48:18.048153] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-09T21:48:18.048211] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-09T21:48:18.409902] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-09T21:48:18.453291] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:48:18.682494] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T21:48:19.042130] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T21:48:19.196733] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-09T21:48:19.996732] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-09T21:48:20.108091] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T21:48:20.146695] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T21:48:20.796736] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-09T21:48:21.596697] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-09T21:48:21.823238] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T21:48:21.842979] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T21:48:22.396732] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-09T21:48:23.196688] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-09T21:48:23.230445] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T21:48:23.825791] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T21:48:23.960061] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T21:48:23.996681] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-09T21:48:24.796811] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-09T21:48:25.596695] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-09T21:48:25.822261] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T21:48:26.396686] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-09T21:48:26.431152] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T21:48:27.030893] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T21:48:27.071412] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T21:48:27.196715] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-09T21:48:27.996697] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-09T21:48:28.785897] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T21:48:28.791154] [INFO ] [REMOTE ] TAL: Full fetch complete (75460 records). [2025-10-09T21:48:28.791318] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-09T21:48:28.803240] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-09T21:48:29.221566] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-09T21:48:29.221915] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-09T21:48:29.224881] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-09T21:48:29.225028] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-09T21:48:29.227222] [DEBUG] [LOCAL ] TAL: Trimmed 75460 records to 52193 (keeping 200 days of data) [2025-10-09T21:48:29.625190] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-09T21:48:29.716309] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T21:48:29.770429] [DEBUG] [LOCAL ] TAL: Primary data saved (52193 records). [2025-10-09T21:48:29.770680] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-09T21:48:29.770865] [INFO ] [MAIN ] Update Progress: 2048/2373 symbols completed. TAL took 38.8s. Estimated remaining: 45m 46s. Rate: 7.1 symbols/min [2025-10-09T21:48:30.037098] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:48:30.075001] [DEBUG] [LOCAL ] TBBB: Loaded 35659 existing records from primary storage. [2025-10-09T21:48:30.075388] [INFO ] [MAIN ] TBBB: Loaded 35659 existing records. [2025-10-09T21:48:30.284860] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:48:30.285112] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-09T21:48:30.285173] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-09T21:48:30.285449] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-09T21:48:30.285509] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-09T21:48:30.402681] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-09T21:48:30.604497] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T21:48:30.686353] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:48:30.723573] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T21:48:31.196688] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-09T21:48:31.768994] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T21:48:31.996701] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-09T21:48:32.072601] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T21:48:32.796720] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-09T21:48:33.341508] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T21:48:33.596761] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-09T21:48:34.396689] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-09T21:48:34.582276] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T21:48:34.841199] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T21:48:35.196799] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-09T21:48:35.659857] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T21:48:35.996720] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-09T21:48:36.771060] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T21:48:36.796664] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-09T21:48:37.080808] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T21:48:37.596702] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-09T21:48:37.659306] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T21:48:38.396772] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-09T21:48:39.196710] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-09T21:48:39.306241] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T21:48:39.311267] [INFO ] [REMOTE ] TALO: Full fetch complete (73251 records). [2025-10-09T21:48:39.311464] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-09T21:48:39.703308] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-09T21:48:39.703418] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-09T21:48:39.704629] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-09T21:48:39.704752] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-09T21:48:39.706507] [DEBUG] [LOCAL ] TALO: Trimmed 73251 records to 51225 (keeping 200 days of data) [2025-10-09T21:48:39.997635] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-09T21:48:40.018854] [DEBUG] [LOCAL ] TALO: Primary data saved (51225 records). [2025-10-09T21:48:40.019006] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-09T21:48:40.019831] [INFO ] [MAIN ] Update Progress: 2049/2373 symbols completed. TALO took 35.5s. Estimated remaining: 45m 38s. Rate: 7.1 symbols/min [2025-10-09T21:48:40.189963] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:48:40.219881] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T21:48:40.250064] [DEBUG] [LOCAL ] TBI: Loaded 22436 existing records from primary storage. [2025-10-09T21:48:40.250337] [INFO ] [MAIN ] TBI: Loaded 22436 existing records. [2025-10-09T21:48:40.425515] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:48:40.425775] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-09T21:48:40.425840] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-09T21:48:40.426066] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-09T21:48:40.426122] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-09T21:48:40.759687] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T21:48:40.797679] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-09T21:48:40.807241] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:48:40.839493] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T21:48:41.596739] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-09T21:48:42.234694] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T21:48:42.396824] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-09T21:48:42.740994] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T21:48:43.196748] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-09T21:48:43.957964] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T21:48:43.996673] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-09T21:48:44.796694] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-09T21:48:45.139851] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T21:48:45.449843] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T21:48:45.451179] [INFO ] [REMOTE ] TBB: Full fetch complete (17043 records). [2025-10-09T21:48:45.451275] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-09T21:48:45.600482] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-09T21:48:45.633633] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T21:48:45.859922] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-09T21:48:45.860004] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-09T21:48:45.860391] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-09T21:48:45.860431] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-09T21:48:45.860974] [DEBUG] [LOCAL ] TBB: Trimmed 17043 records to 11747 (keeping 200 days of data) [2025-10-09T21:48:45.937562] [DEBUG] [LOCAL ] TBB: Primary data saved (11747 records). [2025-10-09T21:48:45.937757] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-09T21:48:45.937855] [INFO ] [MAIN ] Update Progress: 2050/2373 symbols completed. TBB took 28.3s. Estimated remaining: 45m 29s. Rate: 7.1 symbols/min [2025-10-09T21:48:46.110470] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:48:46.110826] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-09T21:48:46.110888] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-09T21:48:46.111040] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-09T21:48:46.111081] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-09T21:48:46.111123] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-09T21:48:46.111155] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-09T21:48:46.397674] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-09T21:48:46.497630] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:48:46.570724] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T21:48:47.196722] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-09T21:48:47.375283] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T21:48:47.546569] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-09T21:48:47.996774] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-09T21:48:48.341960] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-09T21:48:48.796786] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-09T21:48:49.128266] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T21:48:49.596713] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-09T21:48:50.396773] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-09T21:48:50.733471] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-09T21:48:51.049043] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T21:48:51.053595] [INFO ] [REMOTE ] TAP: Full fetch complete (76209 records). [2025-10-09T21:48:51.053769] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-09T21:48:51.201837] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-09T21:48:51.462269] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-09T21:48:51.462351] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-09T21:48:51.463569] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-09T21:48:51.463637] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-09T21:48:51.465300] [DEBUG] [LOCAL ] TAP: Trimmed 76209 records to 53307 (keeping 200 days of data) [2025-10-09T21:48:51.803246] [DEBUG] [LOCAL ] TAP: Primary data saved (53307 records). [2025-10-09T21:48:51.803421] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-09T21:48:51.803511] [INFO ] [MAIN ] Update Progress: 2051/2373 symbols completed. TAP took 38.5s. Estimated remaining: 45m 20s. Rate: 7.1 symbols/min [2025-10-09T21:48:51.979943] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:48:51.986405] [DEBUG] [LOCAL ] TBN: Loaded 3862 existing records from primary storage. [2025-10-09T21:48:51.986574] [INFO ] [MAIN ] TBN: Loaded 3862 existing records. [2025-10-09T21:48:52.007456] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-09T21:48:52.174622] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:48:52.174962] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-09T21:48:52.175023] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-09T21:48:52.175224] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-09T21:48:52.175280] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-09T21:48:52.461358] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T21:48:52.496873] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T21:48:52.568047] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:48:52.796700] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-09T21:48:53.294122] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-09T21:48:53.596772] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-09T21:48:53.896862] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T21:48:54.396734] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-09T21:48:55.196702] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-09T21:48:55.445686] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T21:48:55.996775] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-09T21:48:56.291987] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-09T21:48:56.313746] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T21:48:56.796731] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-09T21:48:57.596783] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-09T21:48:57.849400] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T21:48:57.858949] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-09T21:48:58.396697] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-09T21:48:59.196715] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-09T21:48:59.445345] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T21:48:59.996686] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-09T21:49:00.325137] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T21:49:00.796763] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-09T21:49:01.411479] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T21:49:01.431265] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T21:49:01.596724] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-09T21:49:02.396738] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-09T21:49:02.894849] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T21:49:02.985847] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T21:49:03.196734] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-09T21:49:03.826203] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T21:49:03.996744] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-09T21:49:04.796701] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-09T21:49:05.005223] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T21:49:05.008303] [INFO ] [REMOTE ] TBBB: Full fetch complete (51421 records). [2025-10-09T21:49:05.008388] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-09T21:49:05.170131] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-09T21:49:05.402228] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-09T21:49:05.402315] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-09T21:49:05.403271] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-09T21:49:05.403338] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-09T21:49:05.404477] [DEBUG] [LOCAL ] TBBB: Trimmed 51421 records to 35892 (keeping 200 days of data) [2025-10-09T21:49:05.596764] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-09T21:49:05.621855] [DEBUG] [LOCAL ] TBBB: Primary data saved (35892 records). [2025-10-09T21:49:05.622021] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-09T21:49:05.622115] [INFO ] [MAIN ] Update Progress: 2052/2373 symbols completed. TBBB took 35.9s. Estimated remaining: 45m 13s. Rate: 7.1 symbols/min [2025-10-09T21:49:05.790946] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:49:05.791170] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-09T21:49:05.791226] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-09T21:49:05.791345] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-09T21:49:05.791387] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-09T21:49:05.791429] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-09T21:49:05.791461] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-09T21:49:05.945563] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T21:49:05.957339] [INFO ] [REMOTE ] TBLU: Full fetch complete (1192 records). [2025-10-09T21:49:05.972775] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-09T21:49:06.322366] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T21:49:06.341090] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T21:49:06.341016] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:49:06.341236] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T21:49:06.341512] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-09T21:49:06.341578] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-09T21:49:06.341614] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-09T21:49:06.341690] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-09T21:49:06.341767] [INFO ] [MAIN ] Update Progress: 2053/2373 symbols completed. TBLU took 20.4s. Estimated remaining: 45m 3s. Rate: 7.1 symbols/min [2025-10-09T21:49:06.403233] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-09T21:49:06.520753] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:49:06.532990] [DEBUG] [LOCAL ] TCBX: Loaded 10176 existing records from primary storage. [2025-10-09T21:49:06.533190] [INFO ] [MAIN ] TCBX: Loaded 10176 existing records. [2025-10-09T21:49:06.642256] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:49:06.645398] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-09T21:49:06.651273] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:49:06.661634] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-09T21:49:06.671993] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:49:06.691112] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-09T21:49:06.703238] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-09T21:49:06.705798] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-09T21:49:06.706496] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-09T21:49:06.706685] [INFO ] [MAIN ] Update Progress: 2054/2373 symbols completed. TCAI took 1.1s. Estimated remaining: 44m 54s. Rate: 7.1 symbols/min [2025-10-09T21:49:06.734135] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:49:06.787503] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-09T21:49:06.787598] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-09T21:49:06.797238] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-09T21:49:06.803241] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-09T21:49:07.089668] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:49:07.207282] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-09T21:49:07.323039] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:49:07.342994] [DEBUG] [LOCAL ] TD: Loaded 52354 existing records from primary storage. [2025-10-09T21:49:07.343310] [INFO ] [MAIN ] TD: Loaded 52354 existing records. [2025-10-09T21:49:07.524062] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:49:07.524284] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-09T21:49:07.524340] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-09T21:49:07.524593] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-09T21:49:07.524682] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-09T21:49:07.875918] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:49:07.996697] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-09T21:49:08.491997] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T21:49:08.796789] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-09T21:49:09.385157] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T21:49:09.596691] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-09T21:49:09.954339] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T21:49:10.396714] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-09T21:49:10.897807] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T21:49:11.196715] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-09T21:49:11.996683] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-09T21:49:12.184964] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T21:49:12.227106] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T21:49:12.770027] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T21:49:12.796680] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-09T21:49:13.596700] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-09T21:49:14.396696] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-09T21:49:14.426904] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T21:49:14.458372] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T21:49:14.986345] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-09T21:49:15.196752] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-09T21:49:15.710297] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-09T21:49:15.996754] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-09T21:49:16.797878] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-09T21:49:16.799637] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T21:49:17.299811] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-09T21:49:17.596708] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-09T21:49:18.396762] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-09T21:49:18.778580] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T21:49:18.851100] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T21:49:19.196764] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-09T21:49:19.949619] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T21:49:19.996671] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-09T21:49:20.796707] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-09T21:49:20.866319] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T21:49:20.868980] [INFO ] [REMOTE ] TBI: Full fetch complete (31642 records). [2025-10-09T21:49:20.869073] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-09T21:49:21.269374] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-09T21:49:21.269474] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-09T21:49:21.270379] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-09T21:49:21.270446] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-09T21:49:21.271416] [DEBUG] [LOCAL ] TBI: Trimmed 31642 records to 22583 (keeping 200 days of data) [2025-10-09T21:49:21.366312] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T21:49:21.426593] [DEBUG] [LOCAL ] TBI: Primary data saved (22583 records). [2025-10-09T21:49:21.426834] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-09T21:49:21.426957] [INFO ] [MAIN ] Update Progress: 2055/2373 symbols completed. TBI took 41.4s. Estimated remaining: 44m 46s. Rate: 7.1 symbols/min [2025-10-09T21:49:21.601988] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-09T21:49:21.634578] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:49:21.686849] [DEBUG] [LOCAL ] TDC: Loaded 46558 existing records from primary storage. [2025-10-09T21:49:21.687309] [INFO ] [MAIN ] TDC: Loaded 46558 existing records. [2025-10-09T21:49:22.058464] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:49:22.058919] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-09T21:49:22.059003] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-09T21:49:22.059286] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-09T21:49:22.059365] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-09T21:49:22.401948] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-09T21:49:22.529071] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T21:49:22.594249] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:49:23.196790] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-09T21:49:23.565036] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-09T21:49:23.996715] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-09T21:49:24.258942] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T21:49:24.796808] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-09T21:49:25.340883] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T21:49:25.596696] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-09T21:49:25.705771] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T21:49:26.079561] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T21:49:26.081232] [INFO ] [REMOTE ] TBN: Full fetch complete (5720 records). [2025-10-09T21:49:26.081301] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-09T21:49:26.401788] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-09T21:49:26.450086] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-09T21:49:26.450178] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-09T21:49:26.450371] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-09T21:49:26.450413] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-09T21:49:26.450973] [DEBUG] [LOCAL ] TBN: Trimmed 5720 records to 3895 (keeping 200 days of data) [2025-10-09T21:49:26.477365] [DEBUG] [LOCAL ] TBN: Primary data saved (3895 records). [2025-10-09T21:49:26.477490] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-09T21:49:26.477579] [INFO ] [MAIN ] Update Progress: 2056/2373 symbols completed. TBN took 34.7s. Estimated remaining: 44m 37s. Rate: 7.1 symbols/min [2025-10-09T21:49:26.647350] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:49:26.657091] [DEBUG] [LOCAL ] TDF: Loaded 6248 existing records from primary storage. [2025-10-09T21:49:26.657274] [INFO ] [MAIN ] TDF: Loaded 6248 existing records. [2025-10-09T21:49:26.832485] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:49:26.832743] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-09T21:49:26.832799] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-09T21:49:26.832962] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-09T21:49:26.833018] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-09T21:49:27.201884] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-09T21:49:27.206279] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:49:27.363513] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T21:49:27.996766] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-09T21:49:28.325917] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T21:49:28.796721] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-09T21:49:29.380707] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T21:49:29.596733] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-09T21:49:30.250397] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T21:49:30.278207] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T21:49:30.396717] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-09T21:49:31.196739] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-09T21:49:31.240126] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T21:49:31.991373] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T21:49:31.996666] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-09T21:49:32.796705] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-09T21:49:32.807012] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T21:49:33.471454] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T21:49:33.596734] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-09T21:49:34.365915] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T21:49:34.396673] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-09T21:49:35.110043] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T21:49:35.111359] [INFO ] [REMOTE ] TCBX: Full fetch complete (15813 records). [2025-10-09T21:49:35.111428] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-09T21:49:35.201894] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-09T21:49:35.471367] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-09T21:49:35.471449] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-09T21:49:35.471786] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-09T21:49:35.471846] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-09T21:49:35.472316] [DEBUG] [LOCAL ] TCBX: Trimmed 15813 records to 10220 (keeping 200 days of data) [2025-10-09T21:49:35.534378] [DEBUG] [LOCAL ] TCBX: Primary data saved (10220 records). [2025-10-09T21:49:35.534500] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-09T21:49:35.534582] [INFO ] [MAIN ] Update Progress: 2057/2373 symbols completed. TCBX took 29.2s. Estimated remaining: 44m 29s. Rate: 7.1 symbols/min [2025-10-09T21:49:35.699846] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:49:35.722598] [DEBUG] [LOCAL ] TDG: Loaded 22042 existing records from primary storage. [2025-10-09T21:49:35.722857] [INFO ] [MAIN ] TDG: Loaded 22042 existing records. [2025-10-09T21:49:35.901010] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:49:35.901232] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-09T21:49:35.901279] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-09T21:49:35.901541] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-09T21:49:35.901598] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-09T21:49:35.999374] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-09T21:49:36.250963] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:49:36.592430] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T21:49:36.796687] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-09T21:49:36.960783] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T21:49:37.596768] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-09T21:49:38.396773] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-09T21:49:38.443168] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T21:49:39.198116] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-09T21:49:39.198032] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T21:49:39.288452] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T21:49:39.996758] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-09T21:49:40.008460] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T21:49:40.796717] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-09T21:49:41.569301] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T21:49:41.596668] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-09T21:49:41.824323] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T21:49:41.982464] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T21:49:42.396795] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-09T21:49:43.196792] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-09T21:49:43.996693] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-09T21:49:44.092919] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T21:49:44.764980] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T21:49:44.796674] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-09T21:49:45.173556] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T21:49:45.596726] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-09T21:49:46.192759] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T21:49:46.401806] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-09T21:49:46.422624] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T21:49:47.023871] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T21:49:47.196720] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-09T21:49:47.996751] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-09T21:49:48.801855] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-09T21:49:48.815706] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T21:49:48.889111] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T21:49:49.596698] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-09T21:49:50.030135] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T21:49:50.150349] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T21:49:50.396723] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-09T21:49:51.199619] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-09T21:49:51.200945] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T21:49:51.869992] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T21:49:51.996710] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-09T21:49:52.796739] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-09T21:49:53.278789] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T21:49:53.596733] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-09T21:49:54.006944] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T21:49:54.008003] [INFO ] [REMOTE ] TDF: Full fetch complete (10307 records). [2025-10-09T21:49:54.008072] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-09T21:49:54.368990] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-09T21:49:54.369217] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-09T21:49:54.369543] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-09T21:49:54.369621] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-09T21:49:54.370204] [DEBUG] [LOCAL ] TDF: Trimmed 10307 records to 6286 (keeping 200 days of data) [2025-10-09T21:49:54.398017] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-09T21:49:54.410970] [DEBUG] [LOCAL ] TDF: Primary data saved (6286 records). [2025-10-09T21:49:54.411047] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-09T21:49:54.411153] [INFO ] [MAIN ] Update Progress: 2058/2373 symbols completed. TDF took 27.9s. Estimated remaining: 44m 22s. Rate: 7.1 symbols/min [2025-10-09T21:49:54.590583] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T21:49:54.626392] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:49:54.626980] [DEBUG] [LOCAL ] TDOC: No existing data file found in primary storage. [2025-10-09T21:49:54.627056] [WARN ] [MAIN ] TDOC: No existing data found, performing full refresh instead. [2025-10-09T21:49:54.627305] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-09T21:49:54.627352] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-09T21:49:54.627395] [DEBUG] [LOCAL ] TDOC: No primary data file found to delete. [2025-10-09T21:49:54.627428] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-09T21:49:54.983004] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:49:55.196721] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-09T21:49:55.996796] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-09T21:49:56.160759] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T21:49:56.796741] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-09T21:49:56.847415] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T21:49:57.306520] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-09T21:49:57.596754] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-09T21:49:58.298679] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T21:49:58.304767] [INFO ] [REMOTE ] TD: Full fetch complete (75793 records). [2025-10-09T21:49:58.304895] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-09T21:49:58.401838] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-09T21:49:58.698317] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-09T21:49:58.698422] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-09T21:49:58.699657] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-09T21:49:58.699724] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-09T21:49:58.701298] [DEBUG] [LOCAL ] TD: Trimmed 75793 records to 52741 (keeping 200 days of data) [2025-10-09T21:49:59.032337] [DEBUG] [LOCAL ] TD: Primary data saved (52741 records). [2025-10-09T21:49:59.032480] [INFO ] [MAIN ] TD: Full history saved. [2025-10-09T21:49:59.032566] [INFO ] [MAIN ] Update Progress: 2059/2373 symbols completed. TD took 52.3s. Estimated remaining: 44m 13s. Rate: 7.1 symbols/min [2025-10-09T21:49:59.198442] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:49:59.197028] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-09T21:49:59.238634] [DEBUG] [LOCAL ] TDS: Loaded 42645 existing records from primary storage. [2025-10-09T21:49:59.238952] [INFO ] [MAIN ] TDS: Loaded 42645 existing records. [2025-10-09T21:49:59.417758] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:49:59.417993] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-09T21:49:59.418041] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-09T21:49:59.418300] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-09T21:49:59.418359] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-09T21:49:59.777475] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:49:59.806903] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-09T21:49:59.981297] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T21:49:59.996674] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-09T21:50:00.110830] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T21:50:00.796695] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-09T21:50:00.915889] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T21:50:01.596735] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-09T21:50:02.174248] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T21:50:02.396751] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-09T21:50:03.196711] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-09T21:50:03.371272] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T21:50:03.983842] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T21:50:03.996680] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-09T21:50:04.333203] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T21:50:04.796717] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-09T21:50:04.976274] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T21:50:05.596713] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-09T21:50:06.324140] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T21:50:06.396716] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-09T21:50:06.879717] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T21:50:06.883213] [INFO ] [REMOTE ] TDG: Full fetch complete (31850 records). [2025-10-09T21:50:06.883405] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-09T21:50:07.093119] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T21:50:07.173445] [INFO ] [REMOTE ] TDC: Full fetch complete (67239 records). [2025-10-09T21:50:07.184748] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-09T21:50:07.200536] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-09T21:50:07.425443] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-09T21:50:07.425581] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-09T21:50:07.426422] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-09T21:50:07.426505] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-09T21:50:07.463402] [DEBUG] [LOCAL ] TDG: Trimmed 31850 records to 22182 (keeping 200 days of data) [2025-10-09T21:50:07.903573] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-09T21:50:07.904013] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-09T21:50:07.906126] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-09T21:50:07.906466] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-09T21:50:07.911286] [DEBUG] [LOCAL ] TDC: Trimmed 67239 records to 46902 (keeping 200 days of data) [2025-10-09T21:50:08.003507] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-09T21:50:08.162343] [DEBUG] [LOCAL ] TDG: Primary data saved (22182 records). [2025-10-09T21:50:08.163844] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-09T21:50:08.164278] [INFO ] [MAIN ] Update Progress: 2060/2373 symbols completed. TDG took 32.6s. Estimated remaining: 44m 4s. Rate: 7.1 symbols/min [2025-10-09T21:50:08.350537] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:50:08.405026] [DEBUG] [LOCAL ] TDC: Primary data saved (46902 records). [2025-10-09T21:50:08.405186] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-09T21:50:08.405712] [INFO ] [MAIN ] Update Progress: 2061/2373 symbols completed. TDC took 47.0s. Estimated remaining: 43m 55s. Rate: 7.1 symbols/min [2025-10-09T21:50:08.556137] [DEBUG] [LOCAL ] TDW: Loaded 45083 existing records from primary storage. [2025-10-09T21:50:08.583168] [INFO ] [MAIN ] TDW: Loaded 45083 existing records. [2025-10-09T21:50:08.674529] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:50:08.811793] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:50:08.820292] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-09T21:50:08.820477] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-09T21:50:08.821000] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-09T21:50:08.821148] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-09T21:50:08.821095] [DEBUG] [LOCAL ] TDY: Loaded 22410 existing records from primary storage. [2025-10-09T21:50:08.886471] [INFO ] [MAIN ] TDY: Loaded 22410 existing records. [2025-10-09T21:50:09.245519] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:50:09.258536] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-09T21:50:09.258738] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-09T21:50:09.288781] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-09T21:50:09.296220] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-09T21:50:09.496093] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:50:09.518128] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-09T21:50:09.767659] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:50:09.768304] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-09T21:50:09.824377] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T21:50:09.826108] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-09T21:50:10.396722] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-09T21:50:10.835088] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T21:50:11.051629] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T21:50:11.196723] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-09T21:50:11.615330] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T21:50:11.996740] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-09T21:50:12.241487] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T21:50:12.796786] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-09T21:50:13.596705] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-09T21:50:13.626173] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T21:50:13.912407] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T21:50:14.396793] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-09T21:50:15.196757] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-09T21:50:15.389447] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T21:50:15.739082] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-09T21:50:15.996747] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-09T21:50:16.796763] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-09T21:50:16.971584] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T21:50:17.302289] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T21:50:17.596791] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-09T21:50:18.097101] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T21:50:18.396722] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-09T21:50:19.196733] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-09T21:50:19.369000] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T21:50:19.657147] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T21:50:19.996701] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-09T21:50:20.796686] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-09T21:50:20.837830] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T21:50:21.165817] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T21:50:21.596717] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-09T21:50:22.396756] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-09T21:50:22.595087] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T21:50:22.664244] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T21:50:23.196789] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-09T21:50:23.916945] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T21:50:23.996677] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-09T21:50:24.489803] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T21:50:24.796750] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-09T21:50:25.338715] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T21:50:25.596754] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-09T21:50:26.396721] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-09T21:50:26.543196] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T21:50:26.966377] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T21:50:27.196776] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-09T21:50:27.669983] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T21:50:27.996719] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-09T21:50:28.264287] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T21:50:28.796706] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-09T21:50:29.166663] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:50:29.168472] [INFO ] [REMOTE ] TDY: Full fetch complete (31993 records). [2025-10-09T21:50:29.168541] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-09T21:50:29.548072] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-09T21:50:29.548178] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-09T21:50:29.548851] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-09T21:50:29.548984] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-09T21:50:29.549923] [DEBUG] [LOCAL ] TDY: Trimmed 31993 records to 22540 (keeping 200 days of data) [2025-10-09T21:50:29.627448] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-09T21:50:29.669507] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T21:50:29.735853] [DEBUG] [LOCAL ] TDY: Primary data saved (22540 records). [2025-10-09T21:50:29.736012] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-09T21:50:29.736120] [INFO ] [MAIN ] Update Progress: 2062/2373 symbols completed. TDY took 21.3s. Estimated remaining: 43m 48s. Rate: 7.1 symbols/min [2025-10-09T21:50:29.903104] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:50:29.903260] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-09T21:50:29.903298] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-09T21:50:29.903419] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-09T21:50:29.903460] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-09T21:50:29.903501] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-09T21:50:29.903533] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-09T21:50:30.261217] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:50:30.396726] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-09T21:50:30.613783] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:50:30.614055] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-09T21:50:30.614163] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:50:30.614225] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-09T21:50:30.614262] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:50:30.614304] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-09T21:50:30.614376] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-09T21:50:30.614445] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-09T21:50:30.614527] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-09T21:50:30.614599] [INFO ] [MAIN ] Update Progress: 2063/2373 symbols completed. TE took 0.9s. Estimated remaining: 43m 39s. Rate: 7.1 symbols/min [2025-10-09T21:50:30.814789] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:50:30.826912] [DEBUG] [LOCAL ] TEAF: Loaded 7537 existing records from primary storage. [2025-10-09T21:50:30.827254] [INFO ] [MAIN ] TEAF: Loaded 7537 existing records. [2025-10-09T21:50:31.044132] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:50:31.044450] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-09T21:50:31.044515] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-09T21:50:31.044895] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-09T21:50:31.044957] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-09T21:50:31.201918] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-09T21:50:31.518755] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:50:31.525223] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T21:50:31.996731] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-09T21:50:32.532275] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T21:50:32.796737] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-09T21:50:33.596699] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-09T21:50:33.662673] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T21:50:34.119735] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T21:50:34.123318] [INFO ] [REMOTE ] TDS: Full fetch complete (61516 records). [2025-10-09T21:50:34.123414] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-09T21:50:34.401668] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-09T21:50:34.426890] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T21:50:34.525093] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-09T21:50:34.525174] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-09T21:50:34.526130] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-09T21:50:34.526194] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-09T21:50:34.527422] [DEBUG] [LOCAL ] TDS: Trimmed 61516 records to 42883 (keeping 200 days of data) [2025-10-09T21:50:34.791204] [DEBUG] [LOCAL ] TDS: Primary data saved (42883 records). [2025-10-09T21:50:34.791371] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-09T21:50:34.791530] [INFO ] [MAIN ] Update Progress: 2064/2373 symbols completed. TDS took 35.8s. Estimated remaining: 43m 30s. Rate: 7.1 symbols/min [2025-10-09T21:50:34.960735] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:50:35.010871] [DEBUG] [LOCAL ] TECK: Loaded 53439 existing records from primary storage. [2025-10-09T21:50:35.011204] [INFO ] [MAIN ] TECK: Loaded 53439 existing records. [2025-10-09T21:50:35.202081] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:50:35.199109] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-09T21:50:35.203059] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-09T21:50:35.203115] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-09T21:50:35.203319] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-09T21:50:35.203375] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-09T21:50:35.611311] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:50:35.762914] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T21:50:35.876352] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T21:50:35.996726] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-09T21:50:36.796768] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-09T21:50:37.386678] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T21:50:37.596723] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-09T21:50:37.959546] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-09T21:50:38.396734] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-09T21:50:39.196696] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-09T21:50:39.463258] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T21:50:39.923026] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T21:50:39.996772] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-09T21:50:40.444348] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-09T21:50:40.780981] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T21:50:40.796669] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-09T21:50:41.409990] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T21:50:41.596697] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-09T21:50:42.396729] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-09T21:50:43.196718] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-09T21:50:43.495637] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T21:50:43.579864] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T21:50:43.996698] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-09T21:50:44.724015] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T21:50:44.796678] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-09T21:50:44.988281] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T21:50:45.596794] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-09T21:50:46.195890] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T21:50:46.200025] [INFO ] [REMOTE ] TDW: Full fetch complete (66947 records). [2025-10-09T21:50:46.200183] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-09T21:50:46.403345] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-09T21:50:46.583826] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-09T21:50:46.583915] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-09T21:50:46.585000] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-09T21:50:46.585095] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-09T21:50:46.586749] [DEBUG] [LOCAL ] TDW: Trimmed 66947 records to 45430 (keeping 200 days of data) [2025-10-09T21:50:46.861276] [DEBUG] [LOCAL ] TDW: Primary data saved (45430 records). [2025-10-09T21:50:46.861472] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-09T21:50:46.861578] [INFO ] [MAIN ] Update Progress: 2065/2373 symbols completed. TDW took 38.7s. Estimated remaining: 43m 22s. Rate: 7.1 symbols/min [2025-10-09T21:50:47.034536] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:50:47.072512] [DEBUG] [LOCAL ] TEF: Loaded 37117 existing records from primary storage. [2025-10-09T21:50:47.072857] [INFO ] [MAIN ] TEF: Loaded 37117 existing records. [2025-10-09T21:50:47.201821] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-09T21:50:47.255069] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:50:47.255392] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-09T21:50:47.255500] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-09T21:50:47.255928] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-09T21:50:47.256062] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-09T21:50:47.332356] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T21:50:47.525911] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-09T21:50:47.670565] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:50:47.996732] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-09T21:50:48.796775] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-09T21:50:49.141356] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T21:50:49.145889] [INFO ] [REMOTE ] TDOC: Full fetch complete (77302 records). [2025-10-09T21:50:49.146019] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-09T21:50:49.551319] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-09T21:50:49.551429] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-09T21:50:49.552731] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-09T21:50:49.552816] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-09T21:50:49.554591] [DEBUG] [LOCAL ] TDOC: Trimmed 77302 records to 53739 (keeping 200 days of data) [2025-10-09T21:50:49.615199] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-09T21:50:49.675728] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T21:50:49.914559] [DEBUG] [LOCAL ] TDOC: Primary data saved (53739 records). [2025-10-09T21:50:49.914795] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-09T21:50:49.914893] [INFO ] [MAIN ] Update Progress: 2066/2373 symbols completed. TDOC took 55.5s. Estimated remaining: 43m 12s. Rate: 7.1 symbols/min [2025-10-09T21:50:50.122567] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:50:50.124004] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T21:50:50.152179] [DEBUG] [LOCAL ] TEI: Loaded 21277 existing records from primary storage. [2025-10-09T21:50:50.152445] [INFO ] [MAIN ] TEI: Loaded 21277 existing records. [2025-10-09T21:50:50.328618] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:50:50.328940] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-09T21:50:50.328991] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-09T21:50:50.329298] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-09T21:50:50.329358] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-09T21:50:50.401971] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-09T21:50:50.435275] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T21:50:50.690614] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:50:51.196784] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-09T21:50:51.939009] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T21:50:51.996668] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-09T21:50:52.280832] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T21:50:52.796791] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-09T21:50:53.447442] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T21:50:53.596722] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-09T21:50:53.633357] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T21:50:54.396795] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-09T21:50:55.196749] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-09T21:50:55.238099] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T21:50:55.757250] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T21:50:55.758427] [INFO ] [REMOTE ] TEAF: Full fetch complete (9983 records). [2025-10-09T21:50:55.758498] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-09T21:50:56.000740] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-09T21:50:56.133369] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-09T21:50:56.133507] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-09T21:50:56.133816] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-09T21:50:56.133922] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-09T21:50:56.134422] [DEBUG] [LOCAL ] TEAF: Trimmed 9983 records to 7566 (keeping 200 days of data) [2025-10-09T21:50:56.184553] [DEBUG] [LOCAL ] TEAF: Primary data saved (7566 records). [2025-10-09T21:50:56.184713] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-09T21:50:56.184829] [INFO ] [MAIN ] Update Progress: 2067/2373 symbols completed. TEAF took 25.6s. Estimated remaining: 43m 4s. Rate: 7.1 symbols/min [2025-10-09T21:50:56.364016] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:50:56.395875] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T21:50:56.451525] [DEBUG] [LOCAL ] TEL: Loaded 51073 existing records from primary storage. [2025-10-09T21:50:56.451871] [INFO ] [MAIN ] TEL: Loaded 51073 existing records. [2025-10-09T21:50:56.626407] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:50:56.626610] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-09T21:50:56.626685] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-09T21:50:56.626972] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-09T21:50:56.627029] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-09T21:50:56.809499] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-09T21:50:56.997228] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:50:57.177814] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T21:50:57.596769] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-09T21:50:58.396696] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-09T21:50:58.458056] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T21:50:59.196683] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-09T21:50:59.307598] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T21:50:59.996715] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-09T21:51:00.273119] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T21:51:00.736858] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T21:51:00.796734] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-09T21:51:01.323851] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T21:51:01.596731] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-09T21:51:02.386209] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T21:51:02.396669] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-09T21:51:02.938126] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T21:51:03.196721] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-09T21:51:03.996687] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-09T21:51:04.052837] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T21:51:04.093085] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T21:51:04.796728] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-09T21:51:05.549269] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T21:51:05.596677] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-09T21:51:06.396684] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-09T21:51:06.669675] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T21:51:06.983212] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T21:51:07.196702] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-09T21:51:07.455870] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T21:51:07.996733] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-09T21:51:08.288124] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T21:51:08.796695] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-09T21:51:09.144295] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T21:51:09.596751] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-09T21:51:10.396759] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-09T21:51:10.691091] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T21:51:11.196762] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-09T21:51:11.469152] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T21:51:11.504453] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T21:51:11.996720] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-09T21:51:12.796742] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-09T21:51:13.143105] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T21:51:13.142830] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-09T21:51:13.157093] [INFO ] [REMOTE ] TEF: Full fetch complete (54749 records). [2025-10-09T21:51:13.157213] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-09T21:51:13.536064] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-09T21:51:13.536144] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-09T21:51:13.537105] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-09T21:51:13.537169] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-09T21:51:13.538381] [DEBUG] [LOCAL ] TEF: Trimmed 54749 records to 37317 (keeping 200 days of data) [2025-10-09T21:51:13.597948] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-09T21:51:13.752402] [DEBUG] [LOCAL ] TEF: Primary data saved (37317 records). [2025-10-09T21:51:13.752534] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-09T21:51:13.752613] [INFO ] [MAIN ] Update Progress: 2068/2373 symbols completed. TEF took 26.9s. Estimated remaining: 42m 57s. Rate: 7.1 symbols/min [2025-10-09T21:51:13.923001] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:51:13.953151] [DEBUG] [LOCAL ] TEN: Loaded 30426 existing records from primary storage. [2025-10-09T21:51:13.953441] [INFO ] [MAIN ] TEN: Loaded 30426 existing records. [2025-10-09T21:51:14.139703] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:51:14.139982] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-09T21:51:14.140034] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-09T21:51:14.140266] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-09T21:51:14.140325] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-09T21:51:14.400822] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-09T21:51:14.519687] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:51:14.565453] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T21:51:15.096980] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T21:51:15.199520] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-09T21:51:15.205191] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T21:51:15.996737] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-09T21:51:16.337367] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T21:51:16.796746] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-09T21:51:17.596707] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-09T21:51:17.985411] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T21:51:18.116566] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T21:51:18.396742] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-09T21:51:19.196739] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-09T21:51:19.437713] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T21:51:19.505821] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T21:51:19.996732] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-09T21:51:20.335385] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T21:51:20.796766] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-09T21:51:21.544460] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T21:51:21.550993] [INFO ] [REMOTE ] TECK: Full fetch complete (77317 records). [2025-10-09T21:51:21.551124] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-09T21:51:21.605717] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-09T21:51:21.946221] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-09T21:51:21.946304] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-09T21:51:21.947449] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-09T21:51:21.947517] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-09T21:51:21.949218] [DEBUG] [LOCAL ] TECK: Trimmed 77317 records to 53829 (keeping 200 days of data) [2025-10-09T21:51:22.306111] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T21:51:22.332603] [DEBUG] [LOCAL ] TECK: Primary data saved (53829 records). [2025-10-09T21:51:22.332751] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-09T21:51:22.332847] [INFO ] [MAIN ] Update Progress: 2069/2373 symbols completed. TECK took 47.5s. Estimated remaining: 42m 48s. Rate: 7.1 symbols/min [2025-10-09T21:51:22.401809] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-09T21:51:22.511423] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:51:22.538137] [DEBUG] [LOCAL ] TEO: Loaded 22380 existing records from primary storage. [2025-10-09T21:51:22.538420] [INFO ] [MAIN ] TEO: Loaded 22380 existing records. [2025-10-09T21:51:22.741874] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:51:22.742310] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-09T21:51:22.742456] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-09T21:51:22.749940] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-09T21:51:22.762777] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-09T21:51:22.770387] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T21:51:23.201991] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-09T21:51:23.263059] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:51:23.732508] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T21:51:23.996730] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-09T21:51:24.796779] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-09T21:51:24.998418] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T21:51:25.053586] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T21:51:25.562935] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T21:51:25.596671] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-09T21:51:26.396724] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-09T21:51:26.611742] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T21:51:26.614529] [INFO ] [REMOTE ] TEI: Full fetch complete (30918 records). [2025-10-09T21:51:26.614638] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-09T21:51:26.914159] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T21:51:26.947627] [INFO ] [REMOTE ] TEL: Full fetch complete (73418 records). [2025-10-09T21:51:26.958062] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-09T21:51:27.149527] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-09T21:51:27.150029] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-09T21:51:27.156370] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-09T21:51:27.166752] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-09T21:51:27.197095] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-09T21:51:27.233280] [DEBUG] [LOCAL ] TEI: Trimmed 30918 records to 21591 (keeping 200 days of data) [2025-10-09T21:51:27.547412] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-09T21:51:27.548437] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-09T21:51:27.550082] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-09T21:51:27.550457] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-09T21:51:27.554628] [DEBUG] [LOCAL ] TEL: Trimmed 73418 records to 51443 (keeping 200 days of data) [2025-10-09T21:51:27.721110] [DEBUG] [LOCAL ] TEI: Primary data saved (21591 records). [2025-10-09T21:51:27.721742] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-09T21:51:27.721876] [INFO ] [MAIN ] Update Progress: 2070/2373 symbols completed. TEI took 37.8s. Estimated remaining: 42m 39s. Rate: 7.1 symbols/min [2025-10-09T21:51:27.922494] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:51:28.020781] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-09T21:51:28.081539] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-10-09T21:51:28.082602] [INFO ] [MAIN ] TEVA: Loaded 53633 existing records. [2025-10-09T21:51:28.273445] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:51:28.273809] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-09T21:51:28.275181] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-09T21:51:28.276586] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-09T21:51:28.277162] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-09T21:51:28.668124] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:51:28.760661] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:51:28.762608] [DEBUG] [LOCAL ] TEL: Primary data saved (51443 records). [2025-10-09T21:51:28.762940] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-09T21:51:28.763023] [INFO ] [MAIN ] Update Progress: 2071/2373 symbols completed. TEL took 32.6s. Estimated remaining: 42m 30s. Rate: 7.1 symbols/min [2025-10-09T21:51:28.806775] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-09T21:51:28.945736] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:51:28.961212] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T21:51:29.001216] [DEBUG] [LOCAL ] TEX: Loaded 43978 existing records from primary storage. [2025-10-09T21:51:29.001512] [INFO ] [MAIN ] TEX: Loaded 43978 existing records. [2025-10-09T21:51:29.187210] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:51:29.187449] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-09T21:51:29.187514] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-09T21:51:29.187790] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-09T21:51:29.187879] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-09T21:51:29.549158] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:51:29.596722] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-09T21:51:30.396775] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-09T21:51:30.779929] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T21:51:30.849494] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T21:51:31.196743] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-09T21:51:31.386744] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T21:51:31.996779] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-09T21:51:32.796747] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-09T21:51:33.111126] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T21:51:33.135767] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T21:51:33.596771] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-09T21:51:34.179890] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T21:51:34.396765] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-09T21:51:34.594426] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T21:51:35.196781] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-09T21:51:35.898167] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T21:51:35.996679] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-09T21:51:36.026480] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T21:51:36.796721] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-09T21:51:37.089874] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T21:51:37.596784] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-09T21:51:37.996679] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T21:51:38.396763] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-09T21:51:39.196707] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-09T21:51:39.709692] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-09T21:51:39.773947] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T21:51:39.996700] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-09T21:51:40.290155] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T21:51:40.796728] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-09T21:51:41.596690] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-09T21:51:41.813305] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T21:51:42.067179] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-09T21:51:42.396727] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-09T21:51:42.723437] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T21:51:42.726121] [INFO ] [REMOTE ] TEN: Full fetch complete (43870 records). [2025-10-09T21:51:42.726209] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-09T21:51:43.105258] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-09T21:51:43.105373] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-09T21:51:43.106251] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-09T21:51:43.106314] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-09T21:51:43.107313] [DEBUG] [LOCAL ] TEN: Trimmed 43870 records to 30606 (keeping 200 days of data) [2025-10-09T21:51:43.198999] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-09T21:51:43.303362] [DEBUG] [LOCAL ] TEN: Primary data saved (30606 records). [2025-10-09T21:51:43.303536] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-09T21:51:43.303689] [INFO ] [MAIN ] Update Progress: 2072/2373 symbols completed. TEN took 29.6s. Estimated remaining: 42m 22s. Rate: 7.1 symbols/min [2025-10-09T21:51:43.485539] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:51:43.486762] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T21:51:43.486873] [DEBUG] [LOCAL ] TFC: No existing data file found in primary storage. [2025-10-09T21:51:43.491522] [WARN ] [MAIN ] TFC: No existing data found, performing full refresh instead. [2025-10-09T21:51:43.492083] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-09T21:51:43.492485] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-09T21:51:43.492544] [DEBUG] [LOCAL ] TFC: No primary data file found to delete. [2025-10-09T21:51:43.492578] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-09T21:51:43.848522] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:51:43.996724] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-09T21:51:44.796689] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-09T21:51:44.894212] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T21:51:44.972765] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T21:51:45.596753] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-09T21:51:46.248587] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T21:51:46.396677] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-09T21:51:47.157408] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T21:51:47.196676] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-09T21:51:47.869786] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T21:51:47.996690] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-09T21:51:48.427032] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T21:51:48.796779] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-09T21:51:49.596695] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-09T21:51:49.688782] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T21:51:50.396749] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-09T21:51:50.943805] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T21:51:50.970569] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-09T21:51:51.196730] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-09T21:51:51.774939] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T21:51:51.996713] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-09T21:51:52.796791] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-09T21:51:53.154040] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T21:51:53.596747] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-09T21:51:53.636168] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T21:51:54.396685] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-09T21:51:54.550463] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T21:51:55.200489] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-09T21:51:55.206564] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T21:51:55.462145] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T21:51:55.464542] [INFO ] [REMOTE ] TEO: Full fetch complete (32616 records). [2025-10-09T21:51:55.464738] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-09T21:51:55.879133] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-09T21:51:55.879226] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-09T21:51:55.880015] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-09T21:51:55.880080] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-09T21:51:55.880899] [DEBUG] [LOCAL ] TEO: Trimmed 32616 records to 22593 (keeping 200 days of data) [2025-10-09T21:51:55.998378] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-09T21:51:56.013832] [DEBUG] [LOCAL ] TEO: Primary data saved (22593 records). [2025-10-09T21:51:56.013912] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-09T21:51:56.013993] [INFO ] [MAIN ] Update Progress: 2073/2373 symbols completed. TEO took 33.7s. Estimated remaining: 42m 14s. Rate: 7.1 symbols/min [2025-10-09T21:51:56.214092] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:51:56.251964] [DEBUG] [LOCAL ] TFII: Loaded 33410 existing records from primary storage. [2025-10-09T21:51:56.252271] [INFO ] [MAIN ] TFII: Loaded 33410 existing records. [2025-10-09T21:51:56.443202] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:51:56.443592] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-09T21:51:56.443689] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-09T21:51:56.443918] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-09T21:51:56.443975] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-09T21:51:56.785473] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T21:51:56.798822] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-09T21:51:56.849230] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:51:57.596708] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-09T21:51:58.217246] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T21:51:58.396764] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-09T21:51:58.751463] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T21:51:58.953488] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T21:51:59.196765] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-09T21:51:59.996760] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-09T21:52:00.576001] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-09T21:52:00.796696] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-09T21:52:01.065398] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T21:52:01.272250] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T21:52:01.596785] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-09T21:52:02.396702] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-09T21:52:02.735578] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T21:52:02.741194] [INFO ] [REMOTE ] TEVA: Full fetch complete (77704 records). [2025-10-09T21:52:02.741387] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-09T21:52:03.176917] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-09T21:52:03.177102] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-09T21:52:03.178311] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-09T21:52:03.178380] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-09T21:52:03.180037] [DEBUG] [LOCAL ] TEVA: Trimmed 77704 records to 54020 (keeping 200 days of data) [2025-10-09T21:52:03.232481] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-09T21:52:03.533434] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T21:52:03.573411] [DEBUG] [LOCAL ] TEVA: Primary data saved (54020 records). [2025-10-09T21:52:03.573568] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-09T21:52:03.573690] [INFO ] [MAIN ] Update Progress: 2074/2373 symbols completed. TEVA took 35.9s. Estimated remaining: 42m 6s. Rate: 7.1 symbols/min [2025-10-09T21:52:03.743113] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:52:03.766330] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T21:52:03.795458] [DEBUG] [LOCAL ] TFIN: Loaded 23527 existing records from primary storage. [2025-10-09T21:52:03.795746] [INFO ] [MAIN ] TFIN: Loaded 23527 existing records. [2025-10-09T21:52:03.968842] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:52:03.969113] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-09T21:52:03.969161] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-09T21:52:03.969389] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-09T21:52:03.969449] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-09T21:52:04.001935] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-09T21:52:04.324439] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:52:04.513339] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T21:52:04.796734] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-09T21:52:05.596725] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-09T21:52:05.670285] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T21:52:05.691496] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T21:52:06.396760] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-09T21:52:07.004684] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T21:52:07.196682] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-09T21:52:07.436958] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T21:52:07.996789] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-09T21:52:08.769675] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T21:52:08.797176] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-09T21:52:08.799619] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T21:52:09.596720] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-09T21:52:10.015334] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T21:52:10.396727] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-09T21:52:11.196687] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-09T21:52:11.381398] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T21:52:11.664565] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T21:52:11.668411] [INFO ] [REMOTE ] TEX: Full fetch complete (64555 records). [2025-10-09T21:52:11.668523] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-09T21:52:12.005900] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-09T21:52:12.062933] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-09T21:52:12.063032] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-09T21:52:12.064210] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-09T21:52:12.064278] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-09T21:52:12.065580] [DEBUG] [LOCAL ] TEX: Trimmed 64555 records to 44337 (keeping 200 days of data) [2025-10-09T21:52:12.338507] [DEBUG] [LOCAL ] TEX: Primary data saved (44337 records). [2025-10-09T21:52:12.338684] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-09T21:52:12.338801] [INFO ] [MAIN ] Update Progress: 2075/2373 symbols completed. TEX took 43.6s. Estimated remaining: 41m 57s. Rate: 7.1 symbols/min [2025-10-09T21:52:12.506142] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:52:12.541457] [DEBUG] [LOCAL ] TFPM: Loaded 38574 existing records from primary storage. [2025-10-09T21:52:12.541790] [INFO ] [MAIN ] TFPM: Loaded 38574 existing records. [2025-10-09T21:52:12.724161] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:52:12.724479] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-09T21:52:12.724554] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-09T21:52:12.724815] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-09T21:52:12.724873] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-09T21:52:12.797627] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-09T21:52:13.033466] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T21:52:13.116824] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:52:13.139591] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T21:52:13.596765] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-09T21:52:14.396716] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-09T21:52:14.797066] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T21:52:14.835466] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T21:52:15.196777] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-09T21:52:15.196684] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T21:52:15.996748] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-09T21:52:16.796745] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-09T21:52:16.988115] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T21:52:17.076916] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T21:52:17.596731] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-09T21:52:17.812958] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T21:52:18.396691] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-09T21:52:18.505833] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T21:52:19.196795] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-09T21:52:19.631081] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T21:52:19.996708] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-09T21:52:20.264978] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T21:52:20.796765] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-09T21:52:20.883731] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T21:52:21.596777] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-09T21:52:21.901767] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T21:52:22.396695] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-09T21:52:22.522628] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T21:52:22.731543] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-09T21:52:22.736202] [INFO ] [REMOTE ] TFC: Full fetch complete (77671 records). [2025-10-09T21:52:22.736318] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-09T21:52:23.126351] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-09T21:52:23.126456] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-09T21:52:23.127561] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-09T21:52:23.127625] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-09T21:52:23.129299] [DEBUG] [LOCAL ] TFC: Trimmed 77671 records to 54057 (keeping 200 days of data) [2025-10-09T21:52:23.218861] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-09T21:52:23.480593] [DEBUG] [LOCAL ] TFC: Primary data saved (54057 records). [2025-10-09T21:52:23.480914] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-09T21:52:23.480998] [INFO ] [MAIN ] Update Progress: 2076/2373 symbols completed. TFC took 40.2s. Estimated remaining: 41m 49s. Rate: 7.1 symbols/min [2025-10-09T21:52:23.646235] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:52:23.682262] [DEBUG] [LOCAL ] TFX: Loaded 36748 existing records from primary storage. [2025-10-09T21:52:23.682549] [INFO ] [MAIN ] TFX: Loaded 36748 existing records. [2025-10-09T21:52:23.863241] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:52:23.863451] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-09T21:52:23.863498] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-09T21:52:23.863784] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-09T21:52:23.863843] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-09T21:52:24.004415] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-09T21:52:24.225872] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:52:24.761791] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T21:52:24.796673] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-09T21:52:24.982197] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T21:52:25.596732] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-09T21:52:26.150250] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T21:52:26.372359] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T21:52:26.374701] [INFO ] [REMOTE ] TFIN: Full fetch complete (31673 records). [2025-10-09T21:52:26.374779] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-09T21:52:26.404258] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-09T21:52:26.751436] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-09T21:52:26.751547] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-09T21:52:26.752239] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-09T21:52:26.752302] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-09T21:52:26.753084] [DEBUG] [LOCAL ] TFIN: Trimmed 31673 records to 23689 (keeping 200 days of data) [2025-10-09T21:52:26.905182] [DEBUG] [LOCAL ] TFIN: Primary data saved (23689 records). [2025-10-09T21:52:26.905323] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-09T21:52:26.905408] [INFO ] [MAIN ] Update Progress: 2077/2373 symbols completed. TFIN took 23.3s. Estimated remaining: 41m 40s. Rate: 7.1 symbols/min [2025-10-09T21:52:27.196807] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-09T21:52:27.926542] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T21:52:27.996682] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-09T21:52:28.698482] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T21:52:28.796720] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-09T21:52:29.001867] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T21:52:29.596764] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-09T21:52:30.151783] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T21:52:30.396798] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-09T21:52:31.134243] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T21:52:31.196680] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-09T21:52:31.603810] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T21:52:31.996730] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-09T21:52:32.796715] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-09T21:52:32.922511] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T21:52:32.978532] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T21:52:33.596736] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-09T21:52:33.882280] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T21:52:34.396792] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-09T21:52:35.207535] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-09T21:52:35.230794] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T21:52:35.935992] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T21:52:35.996683] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-09T21:52:36.042101] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T21:52:36.044842] [INFO ] [REMOTE ] TFII: Full fetch complete (47993 records). [2025-10-09T21:52:36.044940] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-09T21:52:36.420178] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-09T21:52:36.420255] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-09T21:52:36.421083] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-09T21:52:36.421144] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-09T21:52:36.422142] [DEBUG] [LOCAL ] TFII: Trimmed 47993 records to 33623 (keeping 200 days of data) [2025-10-09T21:52:36.631405] [DEBUG] [LOCAL ] TFII: Primary data saved (33623 records). [2025-10-09T21:52:36.631551] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-09T21:52:36.631689] [INFO ] [MAIN ] Update Progress: 2078/2373 symbols completed. TFII took 40.6s. Estimated remaining: 41m 32s. Rate: 7.1 symbols/min [2025-10-09T21:52:36.796692] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-09T21:52:37.555734] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T21:52:37.596732] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-09T21:52:38.316062] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T21:52:38.396727] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-09T21:52:38.879028] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T21:52:39.196735] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-09T21:52:39.594635] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T21:52:39.598557] [INFO ] [REMOTE ] TFPM: Full fetch complete (51869 records). [2025-10-09T21:52:39.598675] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-09T21:52:40.026957] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-09T21:52:40.027036] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-09T21:52:40.028063] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-09T21:52:40.028126] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-09T21:52:40.029287] [DEBUG] [LOCAL ] TFPM: Trimmed 51869 records to 38919 (keeping 200 days of data) [2025-10-09T21:52:40.280318] [DEBUG] [LOCAL ] TFPM: Primary data saved (38919 records). [2025-10-09T21:52:40.280512] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-09T21:52:40.280624] [INFO ] [MAIN ] Update Progress: 2079/2373 symbols completed. TFPM took 27.9s. Estimated remaining: 41m 23s. Rate: 7.1 symbols/min [2025-10-09T21:52:40.349456] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T21:52:40.357892] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-09T21:52:41.851726] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T21:52:41.859490] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-09T21:52:43.137353] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T21:52:43.146191] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-09T21:52:43.972180] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T21:52:43.975514] [INFO ] [REMOTE ] TFX: Full fetch complete (54589 records). [2025-10-09T21:52:43.975600] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-09T21:52:44.361996] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-09T21:52:44.362133] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-09T21:52:44.363135] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-09T21:52:44.363197] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-09T21:52:44.364261] [DEBUG] [LOCAL ] TFX: Trimmed 54589 records to 37007 (keeping 200 days of data) [2025-10-09T21:52:44.607032] [DEBUG] [LOCAL ] TFX: Primary data saved (37007 records). [2025-10-09T21:52:44.607191] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-09T21:52:44.607279] [INFO ] [MAIN ] Update Progress: 2080/2373 symbols completed. TFX took 21.1s. Estimated remaining: 41m 14s. Rate: 7.1 symbols/min [2025-10-09T21:52:45.282255] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:52:45.346984] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:52:45.364135] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:52:45.385446] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-09T21:52:45.384969] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:52:45.385696] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-09T21:52:45.386261] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-09T21:52:45.386307] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-09T21:52:45.386350] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-09T21:52:45.386383] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-09T21:52:45.499623] [DEBUG] [LOCAL ] TG: Loaded 10354 existing records from primary storage. [2025-10-09T21:52:45.534701] [INFO ] [MAIN ] TG: Loaded 10354 existing records. [2025-10-09T21:52:45.666900] [DEBUG] [LOCAL ] TGLS: Loaded 27549 existing records from primary storage. [2025-10-09T21:52:45.744498] [INFO ] [MAIN ] TGLS: Loaded 27549 existing records. [2025-10-09T21:52:45.813611] [DEBUG] [LOCAL ] TGNA: Loaded 48633 existing records from primary storage. [2025-10-09T21:52:45.855625] [INFO ] [MAIN ] TGNA: Loaded 48633 existing records. [2025-10-09T21:52:46.061098] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:52:46.150100] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-09T21:52:46.232493] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:52:46.275529] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-09T21:52:46.280796] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-09T21:52:46.290560] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-09T21:52:46.290928] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-09T21:52:46.318576] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:52:46.436528] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-09T21:52:46.457308] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-09T21:52:46.484998] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:52:46.490335] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:52:46.495713] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-09T21:52:46.504844] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-09T21:52:46.504970] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-09T21:52:46.510804] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-09T21:52:46.511007] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-09T21:52:46.510727] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-09T21:52:46.505198] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:52:46.516354] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-09T21:52:46.601845] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:52:46.521564] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-09T21:52:46.709249] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-09T21:52:46.722733] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-09T21:52:46.722880] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-09T21:52:46.812752] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-09T21:52:46.840448] [INFO ] [MAIN ] Update Progress: 2081/2373 symbols completed. TGE took 2.2s. Estimated remaining: 41m 4s. Rate: 7.1 symbols/min [2025-10-09T21:52:47.436702] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:52:47.544324] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-09T21:52:47.528573] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:52:47.631171] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:52:47.653418] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-09T21:52:47.730787] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:52:47.731380] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-09T21:52:47.755206] [DEBUG] [LOCAL ] TGS: Loaded 32929 existing records from primary storage. [2025-10-09T21:52:47.755498] [INFO ] [MAIN ] TGS: Loaded 32929 existing records. [2025-10-09T21:52:47.935220] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:52:47.935433] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-09T21:52:47.935481] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-09T21:52:47.935722] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-09T21:52:47.935780] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-09T21:52:48.328393] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:52:48.328855] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-09T21:52:48.513718] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T21:52:48.517071] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-09T21:52:48.943886] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T21:52:48.949597] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-09T21:52:49.053980] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-09T21:52:49.056781] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-09T21:52:49.136231] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T21:52:49.146502] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-09T21:52:49.229347] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T21:52:49.513458] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T21:52:49.596692] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-09T21:52:49.778705] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T21:52:50.364927] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T21:52:50.396675] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-09T21:52:50.837784] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T21:52:51.196710] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-09T21:52:51.996694] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-09T21:52:52.246351] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T21:52:52.346570] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T21:52:52.784584] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T21:52:52.796672] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-09T21:52:53.470510] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T21:52:53.596758] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-09T21:52:54.396742] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-09T21:52:54.961110] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T21:52:55.196742] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-09T21:52:55.237366] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T21:52:55.689141] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-09T21:52:55.996715] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-09T21:52:56.796685] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-09T21:52:57.269771] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T21:52:57.596747] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-09T21:52:58.350908] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T21:52:58.396675] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-09T21:52:58.899530] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T21:52:59.196719] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-09T21:52:59.628291] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T21:52:59.996734] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-09T21:53:00.494624] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T21:53:00.796805] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-09T21:53:01.357755] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T21:53:01.596744] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-09T21:53:01.628735] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T21:53:02.396722] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-09T21:53:02.942112] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T21:53:03.119477] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T21:53:03.196696] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-09T21:53:03.996757] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-09T21:53:04.018779] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T21:53:04.796743] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-09T21:53:05.125510] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T21:53:05.596748] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-09T21:53:05.794729] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T21:53:06.396750] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-09T21:53:06.545500] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T21:53:07.196731] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-09T21:53:07.996805] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-09T21:53:08.191629] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T21:53:08.508135] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T21:53:08.728316] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T21:53:08.729735] [INFO ] [REMOTE ] TG: Full fetch complete (14956 records). [2025-10-09T21:53:08.729808] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-09T21:53:08.801808] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-09T21:53:09.099495] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-09T21:53:09.099839] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-09T21:53:09.100179] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-09T21:53:09.100222] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-09T21:53:09.100938] [DEBUG] [LOCAL ] TG: Trimmed 14956 records to 10436 (keeping 200 days of data) [2025-10-09T21:53:09.159676] [DEBUG] [LOCAL ] TG: Primary data saved (10436 records). [2025-10-09T21:53:09.159807] [INFO ] [MAIN ] TG: Full history saved. [2025-10-09T21:53:09.159889] [INFO ] [MAIN ] Update Progress: 2082/2373 symbols completed. TG took 24.6s. Estimated remaining: 40m 58s. Rate: 7.1 symbols/min [2025-10-09T21:53:09.325500] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:53:09.381764] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-09T21:53:09.382128] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-10-09T21:53:09.555988] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:53:09.556219] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-09T21:53:09.556279] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-09T21:53:09.556731] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-09T21:53:09.556794] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-09T21:53:09.601821] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-09T21:53:09.916720] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:53:09.930938] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T21:53:10.396727] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-09T21:53:11.196703] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-09T21:53:11.589275] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T21:53:11.620047] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T21:53:11.975944] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T21:53:11.996662] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-09T21:53:12.796771] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-09T21:53:13.421687] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T21:53:13.596694] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-09T21:53:14.396744] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-09T21:53:14.530880] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T21:53:14.831509] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T21:53:15.196785] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-09T21:53:15.996779] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-09T21:53:16.603329] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-09T21:53:16.617790] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T21:53:16.621961] [INFO ] [REMOTE ] TGNA: Full fetch complete (69923 records). [2025-10-09T21:53:16.622047] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-09T21:53:16.809044] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-09T21:53:17.008082] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-09T21:53:17.008169] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-09T21:53:17.009265] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-09T21:53:17.009332] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-09T21:53:17.010775] [DEBUG] [LOCAL ] TGNA: Trimmed 69923 records to 48984 (keeping 200 days of data) [2025-10-09T21:53:17.236808] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T21:53:17.240309] [INFO ] [REMOTE ] TGLS: Full fetch complete (40502 records). [2025-10-09T21:53:17.241357] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-09T21:53:17.609174] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-09T21:53:17.650937] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-09T21:53:17.652053] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-09T21:53:17.653495] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-09T21:53:17.654199] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-09T21:53:17.657282] [DEBUG] [LOCAL ] TGLS: Trimmed 40502 records to 27715 (keeping 200 days of data) [2025-10-09T21:53:17.823466] [DEBUG] [LOCAL ] TGNA: Primary data saved (48984 records). [2025-10-09T21:53:17.825597] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-09T21:53:17.825972] [INFO ] [MAIN ] Update Progress: 2083/2373 symbols completed. TGNA took 33.2s. Estimated remaining: 40m 50s. Rate: 7.1 symbols/min [2025-10-09T21:53:18.007010] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:53:18.066841] [DEBUG] [LOCAL ] TGLS: Primary data saved (27715 records). [2025-10-09T21:53:18.077075] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-09T21:53:18.077216] [INFO ] [MAIN ] Update Progress: 2084/2373 symbols completed. TGLS took 33.5s. Estimated remaining: 40m 40s. Rate: 7.1 symbols/min [2025-10-09T21:53:18.226815] [DEBUG] [LOCAL ] THC: Loaded 47368 existing records from primary storage. [2025-10-09T21:53:18.276392] [INFO ] [MAIN ] THC: Loaded 47368 existing records. [2025-10-09T21:53:18.286306] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:53:18.506438] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:53:18.475879] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T21:53:18.514312] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-09T21:53:18.514423] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-09T21:53:18.515116] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-09T21:53:18.515199] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-09T21:53:18.516087] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-09T21:53:18.605547] [DEBUG] [LOCAL ] THG: Loaded 21582 existing records from primary storage. [2025-10-09T21:53:18.631924] [INFO ] [MAIN ] THG: Loaded 21582 existing records. [2025-10-09T21:53:18.986785] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:53:19.007869] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-09T21:53:19.008302] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-09T21:53:19.024177] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-09T21:53:19.024297] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-09T21:53:19.194077] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:53:19.198775] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-09T21:53:19.462425] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:53:19.703305] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-09T21:53:19.996691] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-09T21:53:20.184369] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T21:53:20.788931] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T21:53:20.796666] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-09T21:53:20.953478] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T21:53:21.596689] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-09T21:53:21.643679] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T21:53:22.396802] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-09T21:53:23.196708] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-09T21:53:23.599941] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T21:53:23.770869] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-09T21:53:23.996772] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-09T21:53:24.434272] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T21:53:24.441398] [INFO ] [REMOTE ] TGS: Full fetch complete (47903 records). [2025-10-09T21:53:24.441552] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-09T21:53:24.798942] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-09T21:53:24.834354] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-09T21:53:24.834460] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-09T21:53:24.835427] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-09T21:53:24.835490] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-09T21:53:24.836551] [DEBUG] [LOCAL ] TGS: Trimmed 47903 records to 33223 (keeping 200 days of data) [2025-10-09T21:53:25.043210] [DEBUG] [LOCAL ] TGS: Primary data saved (33223 records). [2025-10-09T21:53:25.043381] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-09T21:53:25.043476] [INFO ] [MAIN ] Update Progress: 2085/2373 symbols completed. TGS took 38.2s. Estimated remaining: 40m 31s. Rate: 7.1 symbols/min [2025-10-09T21:53:25.214996] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:53:25.219858] [DEBUG] [LOCAL ] THIR: Loaded 2284 existing records from primary storage. [2025-10-09T21:53:25.220015] [INFO ] [MAIN ] THIR: Loaded 2284 existing records. [2025-10-09T21:53:25.395780] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:53:25.396034] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-09T21:53:25.396082] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-09T21:53:25.396234] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-09T21:53:25.396290] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-09T21:53:25.616836] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-09T21:53:25.784608] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:53:25.788785] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T21:53:26.396734] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-09T21:53:26.795070] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T21:53:27.070992] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-09T21:53:27.196731] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-09T21:53:27.753041] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T21:53:27.996735] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-09T21:53:28.334180] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-09T21:53:28.796726] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-09T21:53:29.596683] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-09T21:53:29.648383] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-09T21:53:29.680594] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T21:53:30.396821] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-09T21:53:30.967012] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T21:53:31.196702] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-09T21:53:31.360700] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T21:53:31.996733] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-09T21:53:32.796702] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-09T21:53:33.014375] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T21:53:33.188447] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-09T21:53:33.596699] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-09T21:53:34.396600] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-09T21:53:34.396696] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-09T21:53:34.674672] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-09T21:53:35.045383] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T21:53:35.196738] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-09T21:53:35.610214] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-09T21:53:35.996782] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-09T21:53:36.796685] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-09T21:53:37.075461] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T21:53:37.221006] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T21:53:37.596733] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-09T21:53:38.031033] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T21:53:38.396738] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-09T21:53:39.196759] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-09T21:53:39.442855] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T21:53:39.996775] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-09T21:53:40.796702] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-09T21:53:41.117421] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T21:53:41.147796] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-09T21:53:41.231604] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T21:53:41.596730] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-09T21:53:41.942412] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-09T21:53:42.396720] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-09T21:53:42.963207] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T21:53:43.196741] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-09T21:53:43.610059] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-09T21:53:43.996801] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-09T21:53:44.796683] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-09T21:53:45.027050] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T21:53:45.172717] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T21:53:45.173503] [INFO ] [REMOTE ] THIR: Full fetch complete (2793 records). [2025-10-09T21:53:45.173570] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-09T21:53:45.527139] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-09T21:53:45.527241] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-09T21:53:45.527352] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-09T21:53:45.527390] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-09T21:53:45.527762] [DEBUG] [LOCAL ] THIR: Trimmed 2793 records to 2297 (keeping 200 days of data) [2025-10-09T21:53:45.542317] [DEBUG] [LOCAL ] THIR: Primary data saved (2297 records). [2025-10-09T21:53:45.542380] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-09T21:53:45.542453] [INFO ] [MAIN ] Update Progress: 2086/2373 symbols completed. THIR took 20.5s. Estimated remaining: 40m 25s. Rate: 7.1 symbols/min [2025-10-09T21:53:45.605437] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-09T21:53:45.726957] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:53:45.730979] [DEBUG] [LOCAL ] THLV: Loaded 1541 existing records from primary storage. [2025-10-09T21:53:45.731129] [INFO ] [MAIN ] THLV: Loaded 1541 existing records. [2025-10-09T21:53:45.931312] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:53:45.931539] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-09T21:53:45.931585] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-09T21:53:45.931795] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-09T21:53:45.931853] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-09T21:53:46.283959] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:53:46.396778] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-09T21:53:46.778849] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-09T21:53:47.196694] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-09T21:53:47.611365] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T21:53:47.658845] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T21:53:47.996728] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-09T21:53:48.769079] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T21:53:48.796700] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-09T21:53:49.533939] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T21:53:49.536166] [INFO ] [REMOTE ] THG: Full fetch complete (30988 records). [2025-10-09T21:53:49.536255] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-09T21:53:49.601956] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-09T21:53:49.914238] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-09T21:53:49.914324] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-09T21:53:49.915039] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-09T21:53:49.915102] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-09T21:53:49.915826] [DEBUG] [LOCAL ] THG: Trimmed 30988 records to 21678 (keeping 200 days of data) [2025-10-09T21:53:50.054190] [DEBUG] [LOCAL ] THG: Primary data saved (21678 records). [2025-10-09T21:53:50.054327] [INFO ] [MAIN ] THG: Full history saved. [2025-10-09T21:53:50.054416] [INFO ] [MAIN ] Update Progress: 2087/2373 symbols completed. THG took 32.0s. Estimated remaining: 40m 16s. Rate: 7.1 symbols/min [2025-10-09T21:53:50.139916] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T21:53:50.232984] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:53:50.276660] [DEBUG] [LOCAL ] THO: Loaded 41671 existing records from primary storage. [2025-10-09T21:53:50.277023] [INFO ] [MAIN ] THO: Loaded 41671 existing records. [2025-10-09T21:53:50.401956] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-09T21:53:50.453047] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:53:50.453265] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-09T21:53:50.453313] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-09T21:53:50.453551] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-09T21:53:50.453608] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-09T21:53:50.804586] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:53:51.196774] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-09T21:53:51.996786] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-09T21:53:52.745371] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T21:53:52.796742] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-09T21:53:52.874637] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-09T21:53:53.544606] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T21:53:53.596722] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-09T21:53:54.398454] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-09T21:53:54.403009] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T21:53:54.848887] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-09T21:53:55.196734] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-09T21:53:55.571028] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T21:53:55.996725] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-09T21:53:56.667785] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T21:53:56.796730] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-09T21:53:57.173530] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T21:53:57.596717] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-09T21:53:58.246852] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T21:53:58.396747] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-09T21:53:59.196733] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-09T21:53:59.623754] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T21:54:00.001300] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-09T21:54:00.092392] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T21:54:00.104824] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-09T21:54:00.622803] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T21:54:00.796744] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-09T21:54:01.247254] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T21:54:01.251959] [INFO ] [REMOTE ] TGT: Full fetch complete (77861 records). [2025-10-09T21:54:01.252103] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-09T21:54:01.609124] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-09T21:54:01.674741] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-09T21:54:01.674987] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-09T21:54:01.676214] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-09T21:54:01.676283] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-09T21:54:01.678031] [DEBUG] [LOCAL ] TGT: Trimmed 77861 records to 54168 (keeping 200 days of data) [2025-10-09T21:54:02.031487] [DEBUG] [LOCAL ] TGT: Primary data saved (54168 records). [2025-10-09T21:54:02.031636] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-09T21:54:02.031763] [INFO ] [MAIN ] Update Progress: 2088/2373 symbols completed. TGT took 52.9s. Estimated remaining: 40m 8s. Rate: 7.1 symbols/min [2025-10-09T21:54:02.206482] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:02.232224] [DEBUG] [LOCAL ] THQ: Loaded 25201 existing records from primary storage. [2025-10-09T21:54:02.232476] [INFO ] [MAIN ] THQ: Loaded 25201 existing records. [2025-10-09T21:54:02.406447] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-09T21:54:02.412314] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:54:02.414088] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-09T21:54:02.414155] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-09T21:54:02.414391] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-09T21:54:02.414457] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-09T21:54:02.795455] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:02.866451] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T21:54:03.196821] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-09T21:54:03.835255] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T21:54:03.839232] [INFO ] [REMOTE ] THC: Full fetch complete (68899 records). [2025-10-09T21:54:03.839386] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-09T21:54:04.004707] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-09T21:54:04.253815] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-09T21:54:04.253928] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-09T21:54:04.255080] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-09T21:54:04.255146] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-09T21:54:04.256553] [DEBUG] [LOCAL ] THC: Trimmed 68899 records to 47679 (keeping 200 days of data) [2025-10-09T21:54:04.474574] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T21:54:04.559413] [DEBUG] [LOCAL ] THC: Primary data saved (47679 records). [2025-10-09T21:54:04.559555] [INFO ] [MAIN ] THC: Full history saved. [2025-10-09T21:54:04.559685] [INFO ] [MAIN ] Update Progress: 2089/2373 symbols completed. THC took 46.7s. Estimated remaining: 39m 58s. Rate: 7.1 symbols/min [2025-10-09T21:54:04.734577] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:04.734786] [DEBUG] [LOCAL ] THR: No existing data file found in primary storage. [2025-10-09T21:54:04.734934] [WARN ] [MAIN ] THR: No existing data found, performing full refresh instead. [2025-10-09T21:54:04.735144] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-09T21:54:04.735258] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-09T21:54:04.735324] [DEBUG] [LOCAL ] THR: No primary data file found to delete. [2025-10-09T21:54:04.735473] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-09T21:54:04.799010] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-09T21:54:04.985083] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T21:54:05.133901] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:05.596798] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-09T21:54:05.878489] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T21:54:06.396761] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-09T21:54:06.565121] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T21:54:07.196691] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-09T21:54:07.349022] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T21:54:07.812270] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T21:54:07.996730] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-09T21:54:08.796702] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-09T21:54:09.153334] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T21:54:09.315797] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-09T21:54:09.596729] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-09T21:54:10.396743] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-09T21:54:10.671605] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T21:54:11.196784] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-09T21:54:11.938081] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T21:54:11.996726] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-09T21:54:12.275092] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T21:54:12.796685] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-09T21:54:13.544970] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T21:54:13.596678] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-09T21:54:13.883088] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T21:54:14.396719] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-09T21:54:15.196756] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-09T21:54:15.286747] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T21:54:15.456307] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T21:54:15.469277] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-09T21:54:15.996790] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-09T21:54:16.796736] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-09T21:54:16.902286] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T21:54:17.596772] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-09T21:54:17.892422] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T21:54:17.895795] [INFO ] [REMOTE ] THO: Full fetch complete (60183 records). [2025-10-09T21:54:17.895894] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-09T21:54:18.275241] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-09T21:54:18.275318] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-09T21:54:18.276239] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-09T21:54:18.276303] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-09T21:54:18.277428] [DEBUG] [LOCAL ] THO: Trimmed 60183 records to 41932 (keeping 200 days of data) [2025-10-09T21:54:18.396846] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-09T21:54:18.541189] [DEBUG] [LOCAL ] THO: Primary data saved (41932 records). [2025-10-09T21:54:18.541354] [INFO ] [MAIN ] THO: Full history saved. [2025-10-09T21:54:18.541484] [INFO ] [MAIN ] Update Progress: 2090/2373 symbols completed. THO took 28.5s. Estimated remaining: 39m 51s. Rate: 7.1 symbols/min [2025-10-09T21:54:18.712636] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:18.733374] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T21:54:18.763785] [DEBUG] [LOCAL ] THS: Loaded 38450 existing records from primary storage. [2025-10-09T21:54:18.764076] [INFO ] [MAIN ] THS: Loaded 38450 existing records. [2025-10-09T21:54:18.863512] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T21:54:18.944992] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:54:18.945219] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-09T21:54:18.945266] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-09T21:54:18.945481] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-09T21:54:18.945536] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-09T21:54:19.201812] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-09T21:54:19.303744] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:19.996780] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-09T21:54:20.199749] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T21:54:20.738229] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T21:54:20.796734] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-09T21:54:21.596754] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-09T21:54:22.213899] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T21:54:22.396731] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-09T21:54:22.735995] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T21:54:23.196768] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-09T21:54:23.496432] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T21:54:23.497413] [INFO ] [REMOTE ] THLV: Full fetch complete (2598 records). [2025-10-09T21:54:23.497496] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-09T21:54:23.929322] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T21:54:23.970803] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-09T21:54:23.970884] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-09T21:54:23.971026] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-09T21:54:23.971067] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-09T21:54:23.971388] [DEBUG] [LOCAL ] THLV: Trimmed 2598 records to 1551 (keeping 200 days of data) [2025-10-09T21:54:23.980810] [DEBUG] [LOCAL ] THLV: Primary data saved (1551 records). [2025-10-09T21:54:23.980874] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-09T21:54:23.980953] [INFO ] [MAIN ] Update Progress: 2091/2373 symbols completed. THLV took 38.4s. Estimated remaining: 39m 42s. Rate: 7.1 symbols/min [2025-10-09T21:54:24.001819] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-09T21:54:24.150738] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:24.176841] [DEBUG] [LOCAL ] THW: Loaded 19674 existing records from primary storage. [2025-10-09T21:54:24.177093] [INFO ] [MAIN ] THW: Loaded 19674 existing records. [2025-10-09T21:54:24.393610] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:54:24.393899] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-09T21:54:24.394014] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-09T21:54:24.394321] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-09T21:54:24.394401] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-09T21:54:24.747513] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:24.796666] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-09T21:54:25.168477] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T21:54:25.584881] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T21:54:25.596683] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-09T21:54:26.396776] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-09T21:54:26.510782] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T21:54:27.196728] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-09T21:54:27.596997] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T21:54:27.996701] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-09T21:54:28.625359] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T21:54:28.796688] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-09T21:54:29.368287] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T21:54:29.596731] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-09T21:54:30.293815] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T21:54:30.396684] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-09T21:54:30.574482] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T21:54:31.196752] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-09T21:54:31.860301] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T21:54:31.996783] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-09T21:54:32.175951] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T21:54:32.796729] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-09T21:54:33.376007] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T21:54:33.596680] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-09T21:54:33.833797] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T21:54:34.396709] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-09T21:54:34.935624] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T21:54:35.196686] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-09T21:54:35.418160] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T21:54:35.996769] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-09T21:54:36.406247] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T21:54:36.796754] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-09T21:54:37.107512] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T21:54:37.596800] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-09T21:54:38.113455] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T21:54:38.396696] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-09T21:54:38.578178] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T21:54:38.580700] [INFO ] [REMOTE ] THQ: Full fetch complete (34979 records). [2025-10-09T21:54:38.580786] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-09T21:54:38.950976] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-09T21:54:38.951050] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-09T21:54:38.951778] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-09T21:54:38.951839] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-09T21:54:38.952559] [DEBUG] [LOCAL ] THQ: Trimmed 34979 records to 25352 (keeping 200 days of data) [2025-10-09T21:54:39.110686] [DEBUG] [LOCAL ] THQ: Primary data saved (25352 records). [2025-10-09T21:54:39.110813] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-09T21:54:39.110893] [INFO ] [MAIN ] Update Progress: 2092/2373 symbols completed. THQ took 37.1s. Estimated remaining: 39m 34s. Rate: 7.1 symbols/min [2025-10-09T21:54:39.202682] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-09T21:54:39.283945] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:39.284118] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-09T21:54:39.284155] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-09T21:54:39.284266] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-09T21:54:39.284308] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-09T21:54:39.284348] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-09T21:54:39.284380] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-09T21:54:39.622065] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T21:54:39.666379] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:39.962833] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T21:54:39.996685] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-09T21:54:40.796788] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-09T21:54:40.989703] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:54:40.990030] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-09T21:54:40.990131] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:54:40.990198] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-09T21:54:40.990257] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:54:40.990330] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-09T21:54:40.990399] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-09T21:54:40.990434] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-09T21:54:40.990488] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-09T21:54:40.990558] [INFO ] [MAIN ] Update Progress: 2093/2373 symbols completed. TIC took 1.9s. Estimated remaining: 39m 25s. Rate: 7.1 symbols/min [2025-10-09T21:54:41.171460] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:41.205883] [DEBUG] [LOCAL ] TIMB: Loaded 35638 existing records from primary storage. [2025-10-09T21:54:41.206164] [INFO ] [MAIN ] TIMB: Loaded 35638 existing records. [2025-10-09T21:54:41.392129] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:54:41.392381] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-09T21:54:41.392510] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-09T21:54:41.392751] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-09T21:54:41.392847] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-09T21:54:41.601797] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-09T21:54:41.768465] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T21:54:41.808453] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:42.396680] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-09T21:54:42.594238] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T21:54:42.596191] [INFO ] [REMOTE ] THR: Full fetch complete (28650 records). [2025-10-09T21:54:42.596276] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-09T21:54:42.959559] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-09T21:54:42.959638] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-09T21:54:42.960234] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-09T21:54:42.960277] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-09T21:54:42.961014] [DEBUG] [LOCAL ] THR: Trimmed 28650 records to 19941 (keeping 200 days of data) [2025-10-09T21:54:43.076894] [DEBUG] [LOCAL ] THR: Primary data saved (19941 records). [2025-10-09T21:54:43.077032] [INFO ] [MAIN ] THR: Full history saved. [2025-10-09T21:54:43.077118] [INFO ] [MAIN ] Update Progress: 2094/2373 symbols completed. THR took 38.5s. Estimated remaining: 39m 16s. Rate: 7.1 symbols/min [2025-10-09T21:54:43.201792] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-09T21:54:43.246037] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:43.251743] [DEBUG] [LOCAL ] TISI: Loaded 3473 existing records from primary storage. [2025-10-09T21:54:43.251920] [INFO ] [MAIN ] TISI: Loaded 3473 existing records. [2025-10-09T21:54:43.430224] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:54:43.430446] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-09T21:54:43.430598] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-09T21:54:43.436342] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-09T21:54:43.436430] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-09T21:54:43.488839] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T21:54:43.796700] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:43.996680] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-09T21:54:44.759919] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T21:54:44.785138] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T21:54:44.796679] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-09T21:54:45.302818] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-09T21:54:45.596756] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-09T21:54:46.396726] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-09T21:54:46.866082] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T21:54:46.925975] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T21:54:46.929852] [INFO ] [REMOTE ] THS: Full fetch complete (54290 records). [2025-10-09T21:54:46.929946] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-09T21:54:47.201911] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-09T21:54:47.312909] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-09T21:54:47.312986] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-09T21:54:47.313932] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-09T21:54:47.314002] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-09T21:54:47.315131] [DEBUG] [LOCAL ] THS: Trimmed 54290 records to 38695 (keeping 200 days of data) [2025-10-09T21:54:47.547322] [DEBUG] [LOCAL ] THS: Primary data saved (38695 records). [2025-10-09T21:54:47.547457] [INFO ] [MAIN ] THS: Full history saved. [2025-10-09T21:54:47.547556] [INFO ] [MAIN ] Update Progress: 2095/2373 symbols completed. THS took 29.0s. Estimated remaining: 39m 7s. Rate: 7.1 symbols/min [2025-10-09T21:54:47.713709] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:47.743354] [DEBUG] [LOCAL ] TIXT: Loaded 31936 existing records from primary storage. [2025-10-09T21:54:47.743610] [INFO ] [MAIN ] TIXT: Loaded 31936 existing records. [2025-10-09T21:54:47.921125] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:54:47.921360] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-09T21:54:47.921419] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-09T21:54:47.921668] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-09T21:54:47.921728] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-09T21:54:48.001855] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-09T21:54:48.296720] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:48.474819] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T21:54:48.796690] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-09T21:54:49.033573] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T21:54:49.596731] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-09T21:54:49.727344] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T21:54:50.233039] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T21:54:50.396731] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-09T21:54:50.980193] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T21:54:51.196719] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-09T21:54:51.784928] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T21:54:51.996718] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-09T21:54:52.796701] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-09T21:54:52.898561] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T21:54:53.596721] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-09T21:54:54.219476] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T21:54:54.396725] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-09T21:54:54.508544] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T21:54:54.982935] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T21:54:55.196743] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-09T21:54:55.996764] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-09T21:54:56.061499] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T21:54:56.064027] [INFO ] [REMOTE ] THW: Full fetch complete (29183 records). [2025-10-09T21:54:56.064133] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-09T21:54:56.516555] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-09T21:54:56.520672] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-09T21:54:56.521238] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-09T21:54:56.522114] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-09T21:54:56.522183] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-09T21:54:56.523150] [DEBUG] [LOCAL ] THW: Trimmed 29183 records to 19800 (keeping 200 days of data) [2025-10-09T21:54:56.666604] [DEBUG] [LOCAL ] THW: Primary data saved (19800 records). [2025-10-09T21:54:56.666850] [INFO ] [MAIN ] THW: Full history saved. [2025-10-09T21:54:56.667000] [INFO ] [MAIN ] Update Progress: 2096/2373 symbols completed. THW took 32.7s. Estimated remaining: 38m 58s. Rate: 7.1 symbols/min [2025-10-09T21:54:56.802517] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-09T21:54:56.875300] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:54:56.927229] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-09T21:54:56.927578] [INFO ] [MAIN ] TJX: Loaded 53668 existing records. [2025-10-09T21:54:57.099937] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:54:57.100162] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-09T21:54:57.100222] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-09T21:54:57.100470] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-09T21:54:57.100526] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-09T21:54:57.465228] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:54:57.596676] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-09T21:54:57.899114] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T21:54:58.396685] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-09T21:54:58.676600] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-09T21:54:58.771614] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T21:54:59.196742] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-09T21:54:59.654023] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T21:54:59.996717] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-09T21:55:00.796720] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-09T21:55:01.326506] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T21:55:01.327377] [INFO ] [REMOTE ] TISI: Full fetch complete (4913 records). [2025-10-09T21:55:01.327445] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-09T21:55:01.602056] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-09T21:55:01.739702] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-09T21:55:01.739856] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-09T21:55:01.740166] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-09T21:55:01.740235] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-09T21:55:01.740707] [DEBUG] [LOCAL ] TISI: Trimmed 4913 records to 3481 (keeping 200 days of data) [2025-10-09T21:55:01.763906] [DEBUG] [LOCAL ] TISI: Primary data saved (3481 records). [2025-10-09T21:55:01.764009] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-09T21:55:01.764117] [INFO ] [MAIN ] Update Progress: 2097/2373 symbols completed. TISI took 18.7s. Estimated remaining: 38m 49s. Rate: 7.1 symbols/min [2025-10-09T21:55:01.984237] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:55:02.030414] [DEBUG] [LOCAL ] TK: Loaded 39226 existing records from primary storage. [2025-10-09T21:55:02.030866] [INFO ] [MAIN ] TK: Loaded 39226 existing records. [2025-10-09T21:55:02.258507] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:55:02.259167] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-09T21:55:02.259298] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-09T21:55:02.259602] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-09T21:55:02.259699] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-09T21:55:02.403238] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-09T21:55:02.420332] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-09T21:55:02.733112] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:55:02.887114] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T21:55:03.196746] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-09T21:55:03.550393] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T21:55:03.996757] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-09T21:55:04.770492] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T21:55:04.796664] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-09T21:55:04.834982] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T21:55:05.596711] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-09T21:55:05.967393] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T21:55:06.396744] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-09T21:55:07.033156] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T21:55:07.196690] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-09T21:55:07.996699] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-09T21:55:08.276284] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T21:55:08.311915] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T21:55:08.796795] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-09T21:55:09.419606] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T21:55:09.596820] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-09T21:55:10.396782] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-09T21:55:10.730157] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-09T21:55:11.061054] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T21:55:11.196671] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-09T21:55:11.827211] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T21:55:11.996765] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-09T21:55:12.708556] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T21:55:12.796688] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-09T21:55:13.596719] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-09T21:55:14.048258] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T21:55:14.365825] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T21:55:14.396667] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-09T21:55:14.908782] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T21:55:15.196770] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-09T21:55:15.528829] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T21:55:15.996725] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-09T21:55:16.367863] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T21:55:16.796783] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-09T21:55:16.942028] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T21:55:17.596748] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-09T21:55:18.396721] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-09T21:55:18.886044] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T21:55:18.921886] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T21:55:19.196734] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-09T21:55:19.875046] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T21:55:19.996789] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-09T21:55:20.796674] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-09T21:55:21.267839] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-09T21:55:21.347196] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T21:55:21.596679] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-09T21:55:21.708374] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T21:55:21.711760] [INFO ] [REMOTE ] TIXT: Full fetch complete (46220 records). [2025-10-09T21:55:21.711853] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-09T21:55:22.086029] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-09T21:55:22.086114] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-09T21:55:22.086992] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-09T21:55:22.087055] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-09T21:55:22.088091] [DEBUG] [LOCAL ] TIXT: Trimmed 46220 records to 32214 (keeping 200 days of data) [2025-10-09T21:55:22.277893] [DEBUG] [LOCAL ] TIXT: Primary data saved (32214 records). [2025-10-09T21:55:22.278026] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-09T21:55:22.278145] [INFO ] [MAIN ] Update Progress: 2098/2373 symbols completed. TIXT took 34.7s. Estimated remaining: 38m 43s. Rate: 7.1 symbols/min [2025-10-09T21:55:22.401909] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-09T21:55:22.460149] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:55:22.495539] [DEBUG] [LOCAL ] TKC: Loaded 39065 existing records from primary storage. [2025-10-09T21:55:22.495854] [INFO ] [MAIN ] TKC: Loaded 39065 existing records. [2025-10-09T21:55:22.668268] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:55:22.668498] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-09T21:55:22.668554] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-09T21:55:22.669070] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-09T21:55:22.669129] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-09T21:55:23.014969] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:55:23.196690] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-09T21:55:23.533078] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T21:55:23.567733] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T21:55:23.996753] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-09T21:55:24.289417] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T21:55:24.796742] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-09T21:55:25.279959] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T21:55:25.596674] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-09T21:55:25.672924] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T21:55:26.396787] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-09T21:55:26.681499] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T21:55:27.196772] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-09T21:55:27.996746] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-09T21:55:28.300475] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T21:55:28.642616] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T21:55:28.796684] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-09T21:55:29.011424] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T21:55:29.014447] [INFO ] [REMOTE ] TIMB: Full fetch complete (53578 records). [2025-10-09T21:55:29.014639] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-09T21:55:29.414681] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-09T21:55:29.414784] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-09T21:55:29.415866] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-09T21:55:29.415936] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-09T21:55:29.417231] [DEBUG] [LOCAL ] TIMB: Trimmed 53578 records to 35792 (keeping 200 days of data) [2025-10-09T21:55:29.601926] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-09T21:55:29.663503] [DEBUG] [LOCAL ] TIMB: Primary data saved (35792 records). [2025-10-09T21:55:29.663670] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-09T21:55:29.663796] [INFO ] [MAIN ] Update Progress: 2099/2373 symbols completed. TIMB took 48.7s. Estimated remaining: 38m 34s. Rate: 7.1 symbols/min [2025-10-09T21:55:29.847397] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:55:29.898916] [DEBUG] [LOCAL ] TKO: Loaded 43861 existing records from primary storage. [2025-10-09T21:55:29.899325] [INFO ] [MAIN ] TKO: Loaded 43861 existing records. [2025-10-09T21:55:30.038973] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T21:55:30.121180] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:55:30.121424] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-09T21:55:30.121472] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-09T21:55:30.121745] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-09T21:55:30.121804] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-09T21:55:30.401857] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-09T21:55:30.507983] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:55:30.701512] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T21:55:31.196780] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-09T21:55:31.870843] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T21:55:31.996704] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-09T21:55:32.388605] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T21:55:32.391987] [INFO ] [REMOTE ] TK: Full fetch complete (56286 records). [2025-10-09T21:55:32.392085] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-09T21:55:32.770704] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-09T21:55:32.770789] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-09T21:55:32.771753] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-09T21:55:32.771815] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-09T21:55:32.772925] [DEBUG] [LOCAL ] TK: Trimmed 56286 records to 39475 (keeping 200 days of data) [2025-10-09T21:55:32.827902] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-09T21:55:33.011610] [DEBUG] [LOCAL ] TK: Primary data saved (39475 records). [2025-10-09T21:55:33.011780] [INFO ] [MAIN ] TK: Full history saved. [2025-10-09T21:55:33.011866] [INFO ] [MAIN ] Update Progress: 2100/2373 symbols completed. TK took 31.2s. Estimated remaining: 38m 25s. Rate: 7.1 symbols/min [2025-10-09T21:55:33.186169] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:55:33.222052] [DEBUG] [LOCAL ] TKR: Loaded 39922 existing records from primary storage. [2025-10-09T21:55:33.222359] [INFO ] [MAIN ] TKR: Loaded 39922 existing records. [2025-10-09T21:55:33.409985] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:55:33.410259] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-09T21:55:33.410336] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-09T21:55:33.410817] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-09T21:55:33.410881] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-09T21:55:33.514852] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T21:55:33.601820] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-09T21:55:33.817927] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:55:34.396717] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-09T21:55:34.540012] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T21:55:34.756073] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T21:55:35.196739] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-09T21:55:35.996825] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-09T21:55:36.283133] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T21:55:36.347588] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T21:55:36.796730] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-09T21:55:37.521577] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T21:55:37.596693] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-09T21:55:37.871445] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T21:55:38.396731] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-09T21:55:39.196708] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-09T21:55:39.237934] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T21:55:39.793778] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T21:55:39.996708] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-09T21:55:40.662459] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T21:55:40.796723] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-09T21:55:41.578945] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T21:55:41.596669] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-09T21:55:42.382354] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T21:55:42.396678] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-09T21:55:42.846250] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T21:55:42.850374] [INFO ] [REMOTE ] TKC: Full fetch complete (52967 records). [2025-10-09T21:55:42.850500] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-09T21:55:43.197490] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-09T21:55:43.236494] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-09T21:55:43.237694] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-09T21:55:43.238721] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-09T21:55:43.238879] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-09T21:55:43.240015] [DEBUG] [LOCAL ] TKC: Trimmed 52967 records to 39447 (keeping 200 days of data) [2025-10-09T21:55:43.467527] [DEBUG] [LOCAL ] TKC: Primary data saved (39447 records). [2025-10-09T21:55:43.467690] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-09T21:55:43.467794] [INFO ] [MAIN ] Update Progress: 2101/2373 symbols completed. TKC took 21.2s. Estimated remaining: 38m 17s. Rate: 7.1 symbols/min [2025-10-09T21:55:43.633453] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:55:43.669792] [DEBUG] [LOCAL ] TLK: Loaded 38832 existing records from primary storage. [2025-10-09T21:55:43.670105] [INFO ] [MAIN ] TLK: Loaded 38832 existing records. [2025-10-09T21:55:43.846151] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:55:43.846354] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-09T21:55:43.846400] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-09T21:55:43.846614] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-09T21:55:43.846699] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-09T21:55:43.999684] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-09T21:55:44.218215] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:55:44.247722] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T21:55:44.796690] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-09T21:55:45.169757] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-09T21:55:45.601905] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-09T21:55:45.615278] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T21:55:46.049681] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T21:55:46.396743] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-09T21:55:47.196704] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-09T21:55:47.337225] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T21:55:47.697587] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T21:55:47.996772] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-09T21:55:48.681030] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T21:55:48.796692] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-09T21:55:49.433999] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T21:55:49.596696] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-09T21:55:50.037211] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T21:55:50.396764] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-09T21:55:50.964757] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T21:55:51.196716] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-09T21:55:51.996743] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-09T21:55:52.064237] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T21:55:52.238106] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-09T21:55:52.243214] [INFO ] [REMOTE ] TJX: Full fetch complete (77682 records). [2025-10-09T21:55:52.243374] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-09T21:55:52.702567] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-09T21:55:52.702746] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-09T21:55:52.703907] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-09T21:55:52.703971] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-09T21:55:52.706282] [DEBUG] [LOCAL ] TJX: Trimmed 77682 records to 54058 (keeping 200 days of data) [2025-10-09T21:55:52.802757] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-09T21:55:52.842322] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T21:55:53.106288] [DEBUG] [LOCAL ] TJX: Primary data saved (54058 records). [2025-10-09T21:55:53.106440] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-09T21:55:53.106526] [INFO ] [MAIN ] Update Progress: 2102/2373 symbols completed. TJX took 56.4s. Estimated remaining: 38m 8s. Rate: 7.1 symbols/min [2025-10-09T21:55:53.272398] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:55:53.291882] [DEBUG] [LOCAL ] TLYS: Loaded 16495 existing records from primary storage. [2025-10-09T21:55:53.292159] [INFO ] [MAIN ] TLYS: Loaded 16495 existing records. [2025-10-09T21:55:53.465521] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:55:53.465749] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-09T21:55:53.465801] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-09T21:55:53.465982] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-09T21:55:53.466037] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-09T21:55:53.602955] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-09T21:55:53.820252] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:55:54.296140] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T21:55:54.396679] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-09T21:55:55.196725] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-09T21:55:55.237333] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T21:55:55.302886] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T21:55:55.996761] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-09T21:55:56.439201] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T21:55:56.783234] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T21:55:56.796673] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-09T21:55:57.596776] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-09T21:55:58.365538] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T21:55:58.396666] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-09T21:55:59.001414] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T21:55:59.196724] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-09T21:55:59.866599] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-09T21:56:00.007250] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-09T21:56:00.015967] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T21:56:00.593989] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-09T21:56:00.796727] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-09T21:56:01.596779] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-09T21:56:01.862949] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T21:56:02.396792] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-09T21:56:02.417601] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T21:56:02.969798] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:56:02.973746] [INFO ] [REMOTE ] TKO: Full fetch complete (64796 records). [2025-10-09T21:56:02.973847] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-09T21:56:03.201990] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-09T21:56:03.368863] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-09T21:56:03.368959] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-09T21:56:03.370096] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-09T21:56:03.370165] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-09T21:56:03.373379] [DEBUG] [LOCAL ] TKO: Trimmed 64796 records to 44214 (keeping 200 days of data) [2025-10-09T21:56:03.660835] [DEBUG] [LOCAL ] TKO: Primary data saved (44214 records). [2025-10-09T21:56:03.661001] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-09T21:56:03.662256] [INFO ] [MAIN ] Update Progress: 2103/2373 symbols completed. TKO took 34.0s. Estimated remaining: 38m 0s. Rate: 7.1 symbols/min [2025-10-09T21:56:03.839730] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:56:03.882120] [DEBUG] [LOCAL ] TM: Loaded 36372 existing records from primary storage. [2025-10-09T21:56:03.882397] [INFO ] [MAIN ] TM: Loaded 36372 existing records. [2025-10-09T21:56:04.001997] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-09T21:56:04.062476] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:56:04.062706] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-09T21:56:04.062760] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-09T21:56:04.062977] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-09T21:56:04.063033] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-09T21:56:04.416747] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:56:04.528672] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T21:56:04.796714] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-09T21:56:05.128043] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T21:56:05.596724] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-09T21:56:06.396708] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-09T21:56:06.508178] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T21:56:06.836499] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T21:56:06.840153] [INFO ] [REMOTE ] TKR: Full fetch complete (57763 records). [2025-10-09T21:56:06.840269] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-09T21:56:07.201598] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-09T21:56:07.244231] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-09T21:56:07.244330] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-09T21:56:07.245384] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-09T21:56:07.245452] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-09T21:56:07.247114] [DEBUG] [LOCAL ] TKR: Trimmed 57763 records to 40194 (keeping 200 days of data) [2025-10-09T21:56:07.505775] [DEBUG] [LOCAL ] TKR: Primary data saved (40194 records). [2025-10-09T21:56:07.505924] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-09T21:56:07.506088] [INFO ] [MAIN ] Update Progress: 2104/2373 symbols completed. TKR took 34.5s. Estimated remaining: 37m 51s. Rate: 7.1 symbols/min [2025-10-09T21:56:07.680196] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:56:07.730173] [DEBUG] [LOCAL ] TME: Loaded 53178 existing records from primary storage. [2025-10-09T21:56:07.730494] [INFO ] [MAIN ] TME: Loaded 53178 existing records. [2025-10-09T21:56:07.915632] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:56:07.915994] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-09T21:56:07.916306] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-09T21:56:07.916801] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-09T21:56:07.916891] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-09T21:56:08.012455] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-09T21:56:08.052301] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T21:56:08.321384] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:56:08.340628] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T21:56:08.796763] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-09T21:56:09.596715] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-09T21:56:09.733724] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T21:56:10.331811] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T21:56:10.396703] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-09T21:56:10.460319] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T21:56:11.196720] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-09T21:56:11.996743] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-09T21:56:12.050804] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T21:56:12.796719] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-09T21:56:13.166120] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T21:56:13.366750] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T21:56:13.596741] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-09T21:56:14.396684] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-09T21:56:14.652629] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T21:56:15.092993] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T21:56:15.196766] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-09T21:56:15.901348] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T21:56:15.996690] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-09T21:56:16.796740] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-09T21:56:17.137998] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T21:56:17.483483] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T21:56:17.596718] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-09T21:56:18.284752] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T21:56:18.396719] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-09T21:56:19.180407] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T21:56:19.196679] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-09T21:56:19.663274] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T21:56:19.996754] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-09T21:56:20.774990] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T21:56:20.796678] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-09T21:56:21.543715] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T21:56:21.596701] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-09T21:56:21.638724] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T21:56:22.396724] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-09T21:56:23.116181] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T21:56:23.196697] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-09T21:56:23.372892] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T21:56:23.996773] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-09T21:56:24.612419] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T21:56:24.613679] [INFO ] [REMOTE ] TLYS: Full fetch complete (21708 records). [2025-10-09T21:56:24.613751] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-09T21:56:24.806003] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-09T21:56:24.986124] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-09T21:56:24.986500] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-09T21:56:24.987714] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-09T21:56:24.988116] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-09T21:56:24.989259] [DEBUG] [LOCAL ] TLYS: Trimmed 21708 records to 16546 (keeping 200 days of data) [2025-10-09T21:56:25.094539] [DEBUG] [LOCAL ] TLYS: Primary data saved (16546 records). [2025-10-09T21:56:25.094714] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-09T21:56:25.094812] [INFO ] [MAIN ] Update Progress: 2105/2373 symbols completed. TLYS took 32.0s. Estimated remaining: 37m 44s. Rate: 7.1 symbols/min [2025-10-09T21:56:25.280331] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-09T21:56:25.318240] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:56:25.360279] [DEBUG] [LOCAL ] TMHC: Loaded 45297 existing records from primary storage. [2025-10-09T21:56:25.360580] [INFO ] [MAIN ] TMHC: Loaded 45297 existing records. [2025-10-09T21:56:25.533610] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:56:25.533864] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-09T21:56:25.533911] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-09T21:56:25.534130] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-09T21:56:25.534188] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-09T21:56:25.606516] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-09T21:56:25.862375] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T21:56:25.901145] [INFO ] [REMOTE ] TLK: Full fetch complete (57288 records). [2025-10-09T21:56:25.902271] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-09T21:56:25.923263] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:56:26.329781] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-09T21:56:26.329945] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-09T21:56:26.331037] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-09T21:56:26.331101] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-09T21:56:26.332315] [DEBUG] [LOCAL ] TLK: Trimmed 57288 records to 39054 (keeping 200 days of data) [2025-10-09T21:56:26.421114] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-09T21:56:26.576094] [DEBUG] [LOCAL ] TLK: Primary data saved (39054 records). [2025-10-09T21:56:26.576248] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-09T21:56:26.576348] [INFO ] [MAIN ] Update Progress: 2106/2373 symbols completed. TLK took 43.1s. Estimated remaining: 37m 35s. Rate: 7.1 symbols/min [2025-10-09T21:56:26.752283] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:56:26.801153] [DEBUG] [LOCAL ] TMO: Loaded 52421 existing records from primary storage. [2025-10-09T21:56:26.801532] [INFO ] [MAIN ] TMO: Loaded 52421 existing records. [2025-10-09T21:56:26.982808] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:56:26.983087] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-09T21:56:26.983136] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-09T21:56:26.983407] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-09T21:56:26.983465] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-09T21:56:27.198275] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-09T21:56:27.352977] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:56:27.511987] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T21:56:27.996687] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-09T21:56:28.031790] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T21:56:28.796704] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-09T21:56:28.973522] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T21:56:29.596773] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-09T21:56:29.765622] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T21:56:30.383852] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T21:56:30.396681] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-09T21:56:31.203368] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-09T21:56:31.221723] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T21:56:31.816307] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T21:56:31.996795] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-09T21:56:32.796770] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-09T21:56:33.308352] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-09T21:56:33.521116] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T21:56:33.599678] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-09T21:56:33.604868] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T21:56:33.608781] [INFO ] [REMOTE ] TM: Full fetch complete (52679 records). [2025-10-09T21:56:33.608893] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-09T21:56:34.006000] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-09T21:56:34.006108] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-09T21:56:34.007110] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-09T21:56:34.007236] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-09T21:56:34.008556] [DEBUG] [LOCAL ] TM: Trimmed 52679 records to 36635 (keeping 200 days of data) [2025-10-09T21:56:34.239452] [DEBUG] [LOCAL ] TM: Primary data saved (36635 records). [2025-10-09T21:56:34.239596] [INFO ] [MAIN ] TM: Full history saved. [2025-10-09T21:56:34.239704] [INFO ] [MAIN ] Update Progress: 2107/2373 symbols completed. TM took 30.6s. Estimated remaining: 37m 26s. Rate: 7.1 symbols/min [2025-10-09T21:56:34.411547] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:56:34.408048] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-09T21:56:34.429078] [DEBUG] [LOCAL ] TNC: Loaded 14618 existing records from primary storage. [2025-10-09T21:56:34.429315] [INFO ] [MAIN ] TNC: Loaded 14618 existing records. [2025-10-09T21:56:34.620485] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:56:34.620767] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-09T21:56:34.620819] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-09T21:56:34.621017] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-09T21:56:34.621083] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-09T21:56:34.995576] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:56:35.196718] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-09T21:56:35.641640] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T21:56:35.920406] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T21:56:35.996685] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-09T21:56:36.185251] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T21:56:36.796701] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-09T21:56:36.950056] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T21:56:37.596765] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-09T21:56:38.225068] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T21:56:38.396678] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-09T21:56:38.756865] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T21:56:39.196766] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-09T21:56:39.662505] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T21:56:39.996722] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-09T21:56:40.796696] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-09T21:56:40.966541] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T21:56:41.596773] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-09T21:56:41.974467] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T21:56:42.334081] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T21:56:42.393198] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T21:56:42.397695] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-09T21:56:43.196804] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-09T21:56:43.996748] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-09T21:56:44.177635] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T21:56:44.208579] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T21:56:44.796773] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-09T21:56:45.470233] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T21:56:45.596678] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-09T21:56:46.396737] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-09T21:56:46.453050] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T21:56:47.196755] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-09T21:56:47.306029] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T21:56:47.311295] [INFO ] [REMOTE ] TME: Full fetch complete (76920 records). [2025-10-09T21:56:47.311436] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-09T21:56:47.426517] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T21:56:47.710165] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-09T21:56:47.710249] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-09T21:56:47.711363] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-09T21:56:47.711427] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-09T21:56:47.712890] [DEBUG] [LOCAL ] TME: Trimmed 76920 records to 53567 (keeping 200 days of data) [2025-10-09T21:56:48.012070] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-09T21:56:48.040267] [DEBUG] [LOCAL ] TME: Primary data saved (53567 records). [2025-10-09T21:56:48.040387] [INFO ] [MAIN ] TME: Full history saved. [2025-10-09T21:56:48.040483] [INFO ] [MAIN ] Update Progress: 2108/2373 symbols completed. TME took 40.5s. Estimated remaining: 37m 18s. Rate: 7.1 symbols/min [2025-10-09T21:56:48.210530] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:56:48.238835] [DEBUG] [LOCAL ] TNET: Loaded 28274 existing records from primary storage. [2025-10-09T21:56:48.239152] [INFO ] [MAIN ] TNET: Loaded 28274 existing records. [2025-10-09T21:56:48.410443] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:56:48.410701] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-09T21:56:48.410761] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-09T21:56:48.410990] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-09T21:56:48.411047] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-09T21:56:48.758379] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:56:48.796666] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-09T21:56:48.985624] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T21:56:49.226710] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-09T21:56:49.596731] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-09T21:56:49.886616] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T21:56:50.396775] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-09T21:56:51.196698] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-09T21:56:51.367367] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T21:56:51.505530] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-09T21:56:51.996712] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-09T21:56:52.796692] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-09T21:56:52.899070] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T21:56:53.352748] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T21:56:53.596713] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-09T21:56:53.882987] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T21:56:54.396775] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-09T21:56:54.623793] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T21:56:55.196798] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-09T21:56:55.988050] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T21:56:55.989816] [INFO ] [REMOTE ] TNC: Full fetch complete (22535 records). [2025-10-09T21:56:55.990040] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-09T21:56:56.003856] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-09T21:56:56.333423] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T21:56:56.459573] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-09T21:56:56.459695] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-09T21:56:56.460444] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-09T21:56:56.460523] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-09T21:56:56.461260] [DEBUG] [LOCAL ] TNC: Trimmed 22535 records to 14670 (keeping 200 days of data) [2025-10-09T21:56:56.567192] [DEBUG] [LOCAL ] TNC: Primary data saved (14670 records). [2025-10-09T21:56:56.567364] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-09T21:56:56.567465] [INFO ] [MAIN ] Update Progress: 2109/2373 symbols completed. TNC took 22.3s. Estimated remaining: 37m 10s. Rate: 7.1 symbols/min [2025-10-09T21:56:56.739958] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:56:56.740204] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-09T21:56:56.740263] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-09T21:56:56.740392] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-09T21:56:56.740435] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-09T21:56:56.740478] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-09T21:56:56.740511] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-09T21:56:56.808230] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-09T21:56:57.130245] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:56:57.596706] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-09T21:56:57.842809] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T21:56:57.946031] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T21:56:58.396730] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-09T21:56:59.196690] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-09T21:56:59.268155] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T21:56:59.745355] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T21:56:59.996716] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-09T21:57:00.780187] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T21:57:00.796668] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-09T21:57:00.997106] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T21:57:01.364953] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T21:57:01.369511] [INFO ] [REMOTE ] TMO: Full fetch complete (75490 records). [2025-10-09T21:57:01.369625] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-09T21:57:01.601902] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-09T21:57:01.763435] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-09T21:57:01.763526] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-09T21:57:01.764666] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-09T21:57:01.764732] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-09T21:57:01.766209] [DEBUG] [LOCAL ] TMO: Trimmed 75490 records to 52801 (keeping 200 days of data) [2025-10-09T21:57:02.116360] [DEBUG] [LOCAL ] TMO: Primary data saved (52801 records). [2025-10-09T21:57:02.116498] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-09T21:57:02.116579] [INFO ] [MAIN ] Update Progress: 2110/2373 symbols completed. TMO took 35.5s. Estimated remaining: 37m 1s. Rate: 7.1 symbols/min [2025-10-09T21:57:02.285544] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:57:02.319030] [DEBUG] [LOCAL ] TNK: Loaded 35169 existing records from primary storage. [2025-10-09T21:57:02.319328] [INFO ] [MAIN ] TNK: Loaded 35169 existing records. [2025-10-09T21:57:02.401915] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-09T21:57:02.503149] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:57:02.503459] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-09T21:57:02.503523] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-09T21:57:02.503816] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-09T21:57:02.503890] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-09T21:57:02.866707] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T21:57:02.870227] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:57:02.874330] [INFO ] [REMOTE ] TMHC: Full fetch complete (66025 records). [2025-10-09T21:57:02.874412] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-09T21:57:03.206281] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-09T21:57:03.252833] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-09T21:57:03.253080] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-09T21:57:03.254129] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-09T21:57:03.254239] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-09T21:57:03.255601] [DEBUG] [LOCAL ] TMHC: Trimmed 66025 records to 45681 (keeping 200 days of data) [2025-10-09T21:57:03.379192] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T21:57:03.550162] [DEBUG] [LOCAL ] TMHC: Primary data saved (45681 records). [2025-10-09T21:57:03.550293] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-09T21:57:03.550372] [INFO ] [MAIN ] Update Progress: 2111/2373 symbols completed. TMHC took 38.5s. Estimated remaining: 36m 52s. Rate: 7.1 symbols/min [2025-10-09T21:57:03.714992] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:57:03.751902] [DEBUG] [LOCAL ] TNL: Loaded 41743 existing records from primary storage. [2025-10-09T21:57:03.752192] [INFO ] [MAIN ] TNL: Loaded 41743 existing records. [2025-10-09T21:57:03.924885] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:57:03.925079] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-09T21:57:03.925170] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-09T21:57:03.925426] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-09T21:57:03.925482] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-09T21:57:04.001842] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-09T21:57:04.277684] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:57:04.710273] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T21:57:04.796692] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-09T21:57:05.289948] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T21:57:05.596757] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-09T21:57:05.803399] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T21:57:05.803704] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-09T21:57:05.803788] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T21:57:05.803839] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-09T21:57:05.803899] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T21:57:05.803971] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-09T21:57:05.804032] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-09T21:57:05.804068] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-09T21:57:05.804122] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-09T21:57:05.804190] [INFO ] [MAIN ] Update Progress: 2112/2373 symbols completed. TNGY took 9.2s. Estimated remaining: 36m 42s. Rate: 7.1 symbols/min [2025-10-09T21:57:05.972554] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:57:06.022890] [DEBUG] [LOCAL ] TOL: Loaded 50750 existing records from primary storage. [2025-10-09T21:57:06.023373] [INFO ] [MAIN ] TOL: Loaded 50750 existing records. [2025-10-09T21:57:06.199864] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:57:06.200088] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-09T21:57:06.200255] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-09T21:57:06.208365] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-09T21:57:06.221377] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-09T21:57:06.285683] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T21:57:06.402366] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-09T21:57:06.586661] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:57:07.196779] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-09T21:57:07.629584] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T21:57:07.996712] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-09T21:57:08.796689] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-09T21:57:08.993702] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T21:57:09.506308] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T21:57:09.596688] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-09T21:57:10.169461] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T21:57:10.396772] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-09T21:57:11.166512] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T21:57:11.196679] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-09T21:57:11.580292] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T21:57:11.996795] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-09T21:57:12.796701] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-09T21:57:12.976413] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T21:57:13.277822] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T21:57:13.596723] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-09T21:57:14.167854] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T21:57:14.396784] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-09T21:57:15.089559] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T21:57:15.196763] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-09T21:57:15.996827] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-09T21:57:16.252400] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T21:57:16.670403] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:57:16.796713] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-09T21:57:17.571769] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T21:57:17.596668] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-09T21:57:17.934760] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T21:57:18.396772] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-09T21:57:18.942071] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T21:57:19.196719] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-09T21:57:19.720625] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T21:57:19.996717] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-09T21:57:20.794267] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T21:57:20.803193] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-09T21:57:21.597361] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-09T21:57:21.600388] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T21:57:22.138737] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T21:57:22.396703] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-09T21:57:22.621011] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T21:57:23.196707] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-09T21:57:23.996692] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-09T21:57:24.075064] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T21:57:24.369176] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T21:57:24.796838] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-09T21:57:25.428894] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T21:57:25.596702] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-09T21:57:25.696393] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T21:57:25.699059] [INFO ] [REMOTE ] TNET: Full fetch complete (41574 records). [2025-10-09T21:57:25.699143] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-09T21:57:26.083557] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-09T21:57:26.083711] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-09T21:57:26.084685] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-09T21:57:26.084756] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-09T21:57:26.085842] [DEBUG] [LOCAL ] TNET: Trimmed 41574 records to 28458 (keeping 200 days of data) [2025-10-09T21:57:26.264953] [DEBUG] [LOCAL ] TNET: Primary data saved (28458 records). [2025-10-09T21:57:26.265094] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-09T21:57:26.265191] [INFO ] [MAIN ] Update Progress: 2113/2373 symbols completed. TNET took 38.2s. Estimated remaining: 36m 36s. Rate: 7.1 symbols/min [2025-10-09T21:57:26.404921] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-09T21:57:26.438131] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:57:26.494046] [DEBUG] [LOCAL ] TOST: Loaded 53683 existing records from primary storage. [2025-10-09T21:57:26.494417] [INFO ] [MAIN ] TOST: Loaded 53683 existing records. [2025-10-09T21:57:26.676847] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:57:26.677087] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-09T21:57:26.677136] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-09T21:57:26.677418] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-09T21:57:26.677476] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-09T21:57:26.908090] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T21:57:26.969939] [INFO ] [REMOTE ] TNK: Full fetch complete (51880 records). [2025-10-09T21:57:26.970115] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-09T21:57:27.191307] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:57:27.201832] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-09T21:57:27.437465] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-09T21:57:27.437549] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-09T21:57:27.438520] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-09T21:57:27.438584] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-09T21:57:27.439674] [DEBUG] [LOCAL ] TNK: Trimmed 51880 records to 35458 (keeping 200 days of data) [2025-10-09T21:57:27.661635] [DEBUG] [LOCAL ] TNK: Primary data saved (35458 records). [2025-10-09T21:57:27.661808] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-09T21:57:27.661906] [INFO ] [MAIN ] Update Progress: 2114/2373 symbols completed. TNK took 25.5s. Estimated remaining: 36m 26s. Rate: 7.1 symbols/min [2025-10-09T21:57:27.831676] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:57:27.856453] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T21:57:27.886341] [DEBUG] [LOCAL ] TPB: Loaded 25571 existing records from primary storage. [2025-10-09T21:57:27.886606] [INFO ] [MAIN ] TPB: Loaded 25571 existing records. [2025-10-09T21:57:28.001911] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-09T21:57:28.064043] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:57:28.064255] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-09T21:57:28.064330] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-09T21:57:28.064679] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-09T21:57:28.064756] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-09T21:57:28.452375] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:57:28.796746] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-09T21:57:28.964168] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T21:57:29.565218] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T21:57:29.596697] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-09T21:57:29.880407] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T21:57:30.396728] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-09T21:57:31.196687] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-09T21:57:31.389927] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T21:57:31.996698] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-09T21:57:32.278856] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T21:57:32.322353] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T21:57:32.796747] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-09T21:57:33.527543] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T21:57:33.596682] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-09T21:57:34.396749] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-09T21:57:34.680052] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T21:57:35.097929] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T21:57:35.196700] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-09T21:57:35.312354] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T21:57:35.996773] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-09T21:57:36.796754] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-09T21:57:37.183341] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-09T21:57:37.428403] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T21:57:37.596711] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-09T21:57:38.055582] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T21:57:38.396761] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-09T21:57:39.171878] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T21:57:39.176234] [INFO ] [REMOTE ] TOL: Full fetch complete (73697 records). [2025-10-09T21:57:39.176362] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-09T21:57:39.201993] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-09T21:57:39.596384] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-09T21:57:39.596470] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-09T21:57:39.597941] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-09T21:57:39.598009] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-09T21:57:39.599617] [DEBUG] [LOCAL ] TOL: Trimmed 73697 records to 51135 (keeping 200 days of data) [2025-10-09T21:57:39.921483] [DEBUG] [LOCAL ] TOL: Primary data saved (51135 records). [2025-10-09T21:57:39.921622] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-09T21:57:39.923129] [INFO ] [MAIN ] Update Progress: 2115/2373 symbols completed. TOL took 34.1s. Estimated remaining: 36m 18s. Rate: 7.1 symbols/min [2025-10-09T21:57:40.001857] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-09T21:57:40.099418] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:57:40.155396] [DEBUG] [LOCAL ] TPC: Loaded 38968 existing records from primary storage. [2025-10-09T21:57:40.155744] [INFO ] [MAIN ] TPC: Loaded 38968 existing records. [2025-10-09T21:57:40.338006] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:57:40.338812] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-09T21:57:40.338950] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-09T21:57:40.339372] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-09T21:57:40.339456] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-09T21:57:40.498734] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T21:57:40.529235] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-09T21:57:40.803713] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-09T21:57:40.809932] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:57:41.488396] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T21:57:41.596751] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-09T21:57:42.396769] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-09T21:57:42.532196] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T21:57:42.644071] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T21:57:43.196717] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-09T21:57:43.787938] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T21:57:43.996692] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-09T21:57:44.177034] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T21:57:44.796720] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-09T21:57:45.596782] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-09T21:57:46.042551] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T21:57:46.261356] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T21:57:46.396794] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-09T21:57:47.072464] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T21:57:47.196789] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-09T21:57:47.996686] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-09T21:57:48.065972] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T21:57:48.504638] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T21:57:48.796973] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-09T21:57:48.879818] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T21:57:49.596742] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-09T21:57:49.912190] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T21:57:50.396719] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-09T21:57:50.957926] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T21:57:51.196727] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-09T21:57:51.996700] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-09T21:57:52.470199] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-09T21:57:52.470697] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T21:57:52.486695] [INFO ] [REMOTE ] TNL: Full fetch complete (59212 records). [2025-10-09T21:57:52.487228] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-09T21:57:52.801900] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-09T21:57:52.873693] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-09T21:57:52.873807] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-09T21:57:52.874896] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-09T21:57:52.874961] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-09T21:57:52.876192] [DEBUG] [LOCAL ] TNL: Trimmed 59212 records to 42062 (keeping 200 days of data) [2025-10-09T21:57:53.147508] [DEBUG] [LOCAL ] TNL: Primary data saved (42062 records). [2025-10-09T21:57:53.147698] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-09T21:57:53.147818] [INFO ] [MAIN ] Update Progress: 2116/2373 symbols completed. TNL took 49.6s. Estimated remaining: 36m 10s. Rate: 7.1 symbols/min [2025-10-09T21:57:53.320588] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:57:53.339747] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T21:57:53.384432] [DEBUG] [LOCAL ] TPH: Loaded 44861 existing records from primary storage. [2025-10-09T21:57:53.384806] [INFO ] [MAIN ] TPH: Loaded 44861 existing records. [2025-10-09T21:57:53.557994] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:57:53.558223] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-09T21:57:53.558273] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-09T21:57:53.558514] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-09T21:57:53.558573] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-09T21:57:53.601954] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-09T21:57:53.946524] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:57:54.396816] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-09T21:57:54.437442] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T21:57:54.745880] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T21:57:54.749459] [INFO ] [REMOTE ] TPB: Full fetch complete (35566 records). [2025-10-09T21:57:54.749622] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-09T21:57:55.137226] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-09T21:57:55.137312] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-09T21:57:55.138175] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-09T21:57:55.138242] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-09T21:57:55.139112] [DEBUG] [LOCAL ] TPB: Trimmed 35566 records to 25800 (keeping 200 days of data) [2025-10-09T21:57:55.203029] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-09T21:57:55.301192] [DEBUG] [LOCAL ] TPB: Primary data saved (25800 records). [2025-10-09T21:57:55.301325] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-09T21:57:55.301406] [INFO ] [MAIN ] Update Progress: 2117/2373 symbols completed. TPB took 27.6s. Estimated remaining: 36m 1s. Rate: 7.1 symbols/min [2025-10-09T21:57:55.594164] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T21:57:55.996750] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-09T21:57:56.796795] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-09T21:57:57.400028] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T21:57:57.551566] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T21:57:57.596672] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-09T21:57:58.266415] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:57:58.396783] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-09T21:57:59.160703] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T21:57:59.196695] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-09T21:57:59.924830] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T21:57:59.996699] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-09T21:58:00.796701] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-09T21:58:01.082154] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T21:58:01.462210] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T21:58:01.596810] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-09T21:58:02.396708] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-09T21:58:02.900772] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T21:58:03.196772] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-09T21:58:03.259761] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T21:58:03.996770] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-09T21:58:04.100926] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T21:58:04.796757] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-09T21:58:04.899885] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T21:58:04.904468] [INFO ] [REMOTE ] TOST: Full fetch complete (77700 records). [2025-10-09T21:58:04.904586] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-09T21:58:05.302616] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-09T21:58:05.302741] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-09T21:58:05.304049] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-09T21:58:05.304117] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-09T21:58:05.305613] [DEBUG] [LOCAL ] TOST: Trimmed 77700 records to 54073 (keeping 200 days of data) [2025-10-09T21:58:05.644759] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T21:58:05.657841] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-09T21:58:05.677397] [DEBUG] [LOCAL ] TOST: Primary data saved (54073 records). [2025-10-09T21:58:05.677527] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-09T21:58:05.677610] [INFO ] [MAIN ] Update Progress: 2118/2373 symbols completed. TOST took 39.4s. Estimated remaining: 35m 53s. Rate: 7.1 symbols/min [2025-10-09T21:58:06.290390] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T21:58:06.396731] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-09T21:58:07.256442] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T21:58:07.266399] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-09T21:58:07.654468] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T21:58:07.657796] [INFO ] [REMOTE ] TPC: Full fetch complete (55245 records). [2025-10-09T21:58:07.657899] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-09T21:58:08.084364] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-09T21:58:08.084457] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-09T21:58:08.085721] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-09T21:58:08.085796] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-09T21:58:08.087060] [DEBUG] [LOCAL ] TPC: Trimmed 55245 records to 39226 (keeping 200 days of data) [2025-10-09T21:58:08.352745] [DEBUG] [LOCAL ] TPC: Primary data saved (39226 records). [2025-10-09T21:58:08.352937] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-09T21:58:08.353173] [INFO ] [MAIN ] Update Progress: 2119/2373 symbols completed. TPC took 28.4s. Estimated remaining: 35m 44s. Rate: 7.1 symbols/min [2025-10-09T21:58:08.906028] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T21:58:08.916988] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-09T21:58:10.474797] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T21:58:10.484855] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-09T21:58:12.106387] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T21:58:12.115979] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-09T21:58:13.540723] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T21:58:13.544529] [INFO ] [REMOTE ] TPH: Full fetch complete (64884 records). [2025-10-09T21:58:13.544669] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-09T21:58:13.933117] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-09T21:58:13.933211] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-09T21:58:13.934281] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-09T21:58:13.934346] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-09T21:58:13.935841] [DEBUG] [LOCAL ] TPH: Trimmed 64884 records to 45227 (keeping 200 days of data) [2025-10-09T21:58:14.195022] [DEBUG] [LOCAL ] TPH: Primary data saved (45227 records). [2025-10-09T21:58:14.195154] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-09T21:58:14.195305] [INFO ] [MAIN ] Update Progress: 2120/2373 symbols completed. TPH took 21.0s. Estimated remaining: 35m 35s. Rate: 7.1 symbols/min [2025-10-09T21:58:14.866674] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:14.896000] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:14.932165] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:14.935780] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:14.948170] [DEBUG] [LOCAL ] TPYP: Loaded 7913 existing records from primary storage. [2025-10-09T21:58:14.952344] [INFO ] [MAIN ] TPYP: Loaded 7913 existing records. [2025-10-09T21:58:15.053237] [DEBUG] [LOCAL ] TPL: Loaded 12301 existing records from primary storage. [2025-10-09T21:58:15.081618] [DEBUG] [LOCAL ] TPVG: Loaded 27010 existing records from primary storage. [2025-10-09T21:58:15.081191] [INFO ] [MAIN ] TPL: Loaded 12301 existing records. [2025-10-09T21:58:15.112141] [INFO ] [MAIN ] TPVG: Loaded 27010 existing records. [2025-10-09T21:58:15.330570] [DEBUG] [LOCAL ] TPR: Loaded 53443 existing records from primary storage. [2025-10-09T21:58:15.363089] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:15.386779] [INFO ] [MAIN ] TPR: Loaded 53443 existing records. [2025-10-09T21:58:15.401296] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-09T21:58:15.447101] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-09T21:58:15.477431] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-09T21:58:15.558502] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-09T21:58:15.647322] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:15.703277] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-09T21:58:15.723926] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-09T21:58:15.798845] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:15.831695] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-09T21:58:15.836996] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-09T21:58:15.817298] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-09T21:58:15.848174] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-09T21:58:15.848735] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-09T21:58:15.863270] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-09T21:58:15.885752] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:15.998189] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-09T21:58:16.013704] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-09T21:58:16.072950] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-09T21:58:16.098155] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-09T21:58:16.810392] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:16.866796] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-09T21:58:17.065731] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:17.081446] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-09T21:58:17.155348] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:17.160776] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-09T21:58:17.218082] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:17.218562] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-09T21:58:17.665329] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T21:58:17.667780] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-09T21:58:17.998871] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T21:58:18.003071] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-09T21:58:18.514469] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T21:58:18.518187] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-09T21:58:18.609924] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T21:58:18.618342] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-09T21:58:18.937902] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T21:58:18.941173] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-09T21:58:19.002426] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T21:58:19.013449] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-09T21:58:19.078681] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T21:58:19.081637] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-09T21:58:19.464375] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T21:58:19.473613] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-09T21:58:19.558939] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T21:58:19.847036] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T21:58:19.996758] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-09T21:58:20.261068] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T21:58:20.379621] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T21:58:20.782682] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T21:58:20.796741] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-09T21:58:21.596761] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-09T21:58:22.396698] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-09T21:58:22.604380] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T21:58:22.652482] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T21:58:22.904444] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T21:58:23.196750] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-09T21:58:23.913386] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T21:58:23.996697] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-09T21:58:24.713618] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T21:58:24.796702] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-09T21:58:25.596749] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-09T21:58:25.604429] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T21:58:26.396760] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-09T21:58:26.568292] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T21:58:27.196782] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-09T21:58:27.566537] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T21:58:27.996745] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-09T21:58:28.173977] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T21:58:28.796693] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-09T21:58:28.827626] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T21:58:29.596694] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-09T21:58:30.161870] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T21:58:30.261860] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T21:58:30.396701] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-09T21:58:31.196777] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-09T21:58:31.996715] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-09T21:58:32.142970] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T21:58:32.284282] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T21:58:32.796718] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-09T21:58:33.039844] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T21:58:33.596700] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-09T21:58:33.636522] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T21:58:34.396757] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-09T21:58:34.911703] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T21:58:34.912862] [INFO ] [REMOTE ] TPYP: Full fetch complete (12465 records). [2025-10-09T21:58:34.912930] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-09T21:58:35.201398] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-09T21:58:35.279321] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-09T21:58:35.279430] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-09T21:58:35.279848] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-09T21:58:35.279929] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-09T21:58:35.280527] [DEBUG] [LOCAL ] TPYP: Trimmed 12465 records to 7959 (keeping 200 days of data) [2025-10-09T21:58:35.332142] [DEBUG] [LOCAL ] TPYP: Primary data saved (7959 records). [2025-10-09T21:58:35.332274] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-09T21:58:35.332354] [INFO ] [MAIN ] Update Progress: 2121/2373 symbols completed. TPYP took 21.1s. Estimated remaining: 35m 28s. Rate: 7.1 symbols/min [2025-10-09T21:58:35.506066] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:35.536048] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T21:58:35.551841] [DEBUG] [LOCAL ] TPZ: Loaded 4854 existing records from primary storage. [2025-10-09T21:58:35.552052] [INFO ] [MAIN ] TPZ: Loaded 4854 existing records. [2025-10-09T21:58:35.733805] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:35.734017] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-09T21:58:35.734065] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-09T21:58:35.734224] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-09T21:58:35.734281] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-09T21:58:36.001766] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-09T21:58:36.100449] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:36.101272] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T21:58:36.796698] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-09T21:58:37.183493] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T21:58:37.596722] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-09T21:58:38.396713] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-09T21:58:38.445459] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T21:58:38.490797] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T21:58:38.918496] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-09T21:58:39.196733] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-09T21:58:39.948331] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T21:58:39.996681] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-09T21:58:40.722682] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T21:58:40.796742] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-09T21:58:41.597086] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-09T21:58:42.383571] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T21:58:42.396673] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-09T21:58:42.515454] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T21:58:43.121954] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T21:58:43.196696] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-09T21:58:43.566240] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T21:58:43.568120] [INFO ] [REMOTE ] TPL: Full fetch complete (17635 records). [2025-10-09T21:58:43.568206] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-09T21:58:43.947246] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-09T21:58:43.947356] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-09T21:58:43.947787] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-09T21:58:43.947847] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-09T21:58:43.948350] [DEBUG] [LOCAL ] TPL: Trimmed 17635 records to 12371 (keeping 200 days of data) [2025-10-09T21:58:44.008613] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-09T21:58:44.034721] [DEBUG] [LOCAL ] TPL: Primary data saved (12371 records). [2025-10-09T21:58:44.034825] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-09T21:58:44.034916] [INFO ] [MAIN ] Update Progress: 2122/2373 symbols completed. TPL took 29.8s. Estimated remaining: 35m 20s. Rate: 7.1 symbols/min [2025-10-09T21:58:44.200398] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:44.218469] [DEBUG] [LOCAL ] TR: Loaded 18758 existing records from primary storage. [2025-10-09T21:58:44.218725] [INFO ] [MAIN ] TR: Loaded 18758 existing records. [2025-10-09T21:58:44.405518] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:44.405805] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-09T21:58:44.405854] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-09T21:58:44.406088] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-09T21:58:44.406147] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-09T21:58:44.772985] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:44.796667] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-09T21:58:45.596742] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-09T21:58:45.713894] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T21:58:46.002529] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T21:58:46.396707] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-09T21:58:46.886178] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T21:58:47.006255] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T21:58:47.196727] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-09T21:58:47.799620] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T21:58:47.996762] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-09T21:58:48.670161] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-09T21:58:48.796735] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-09T21:58:49.596764] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-09T21:58:50.396716] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-09T21:58:50.611616] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T21:58:50.708068] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T21:58:51.110723] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T21:58:51.196691] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-09T21:58:51.837319] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T21:58:51.996727] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-09T21:58:52.796724] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-09T21:58:53.596721] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-09T21:58:53.705803] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T21:58:53.895905] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T21:58:54.396771] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-09T21:58:54.974068] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T21:58:55.196849] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-09T21:58:55.707596] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T21:58:55.709372] [INFO ] [REMOTE ] TPZ: Full fetch complete (9199 records). [2025-10-09T21:58:55.709680] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-09T21:58:56.001883] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-09T21:58:56.154042] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T21:58:56.204397] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-09T21:58:56.204490] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-09T21:58:56.204869] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-09T21:58:56.204946] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-09T21:58:56.205819] [INFO ] [REMOTE ] TPR: Full fetch complete (77393 records). [2025-10-09T21:58:56.205958] [DEBUG] [LOCAL ] TPZ: Trimmed 9199 records to 4867 (keeping 200 days of data) [2025-10-09T21:58:56.206179] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-09T21:58:56.402047] [DEBUG] [LOCAL ] TPZ: Primary data saved (4867 records). [2025-10-09T21:58:56.417814] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-09T21:58:56.424479] [INFO ] [MAIN ] Update Progress: 2123/2373 symbols completed. TPZ took 21.1s. Estimated remaining: 35m 12s. Rate: 7.1 symbols/min [2025-10-09T21:58:56.785524] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:56.801459] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-09T21:58:56.828711] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-09T21:58:56.828911] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-09T21:58:56.830599] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-09T21:58:56.830852] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-09T21:58:56.835489] [DEBUG] [LOCAL ] TPR: Trimmed 77393 records to 53825 (keeping 200 days of data) [2025-10-09T21:58:56.841336] [DEBUG] [LOCAL ] TRAK: Loaded 9567 existing records from primary storage. [2025-10-09T21:58:56.841814] [INFO ] [MAIN ] TRAK: Loaded 9567 existing records. [2025-10-09T21:58:57.119951] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:57.122360] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-09T21:58:57.122993] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-09T21:58:57.124201] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-09T21:58:57.124764] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-09T21:58:57.251356] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T21:58:57.599954] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-09T21:58:57.644149] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:57.753064] [DEBUG] [LOCAL ] TPR: Primary data saved (53825 records). [2025-10-09T21:58:57.753264] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-09T21:58:57.753377] [INFO ] [MAIN ] Update Progress: 2124/2373 symbols completed. TPR took 43.5s. Estimated remaining: 35m 2s. Rate: 7.1 symbols/min [2025-10-09T21:58:57.870421] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T21:58:57.901398] [INFO ] [REMOTE ] TPVG: Full fetch complete (39751 records). [2025-10-09T21:58:57.914050] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-09T21:58:57.932510] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:58.116073] [DEBUG] [LOCAL ] TRC: Loaded 15664 existing records from primary storage. [2025-10-09T21:58:58.134475] [INFO ] [MAIN ] TRC: Loaded 15664 existing records. [2025-10-09T21:58:58.397826] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-09T21:58:58.517159] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-09T21:58:58.520771] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-09T21:58:58.521580] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-09T21:58:58.521619] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-09T21:58:58.520381] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:58.521859] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-09T21:58:58.521907] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-09T21:58:58.522307] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-09T21:58:58.522448] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-09T21:58:58.527934] [DEBUG] [LOCAL ] TPVG: Trimmed 39751 records to 27262 (keeping 200 days of data) [2025-10-09T21:58:58.811596] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T21:58:58.995552] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:59.055205] [DEBUG] [LOCAL ] TPVG: Primary data saved (27262 records). [2025-10-09T21:58:59.055333] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-09T21:58:59.055480] [INFO ] [MAIN ] Update Progress: 2125/2373 symbols completed. TPVG took 44.9s. Estimated remaining: 34m 53s. Rate: 7.1 symbols/min [2025-10-09T21:58:59.197181] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-09T21:58:59.232936] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:58:59.278510] [DEBUG] [LOCAL ] TREX: Loaded 49905 existing records from primary storage. [2025-10-09T21:58:59.278842] [INFO ] [MAIN ] TREX: Loaded 49905 existing records. [2025-10-09T21:58:59.385786] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T21:58:59.463457] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:58:59.463636] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-09T21:58:59.463725] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-09T21:58:59.463985] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-09T21:58:59.464040] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-09T21:58:59.811169] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:58:59.996735] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-09T21:59:00.182819] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T21:59:00.796740] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-09T21:59:01.433210] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T21:59:01.462333] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T21:59:01.596699] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-09T21:59:02.396737] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-09T21:59:02.709453] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T21:59:02.943274] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-09T21:59:03.196794] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-09T21:59:03.996730] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-09T21:59:04.024605] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T21:59:04.796776] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-09T21:59:05.593585] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T21:59:05.596667] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-09T21:59:05.671016] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T21:59:06.380749] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T21:59:06.396704] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-09T21:59:07.196683] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-09T21:59:07.215987] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T21:59:07.996681] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-09T21:59:08.077116] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T21:59:08.796698] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-09T21:59:09.097888] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T21:59:09.266176] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T21:59:09.596773] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-09T21:59:10.396719] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-09T21:59:11.109584] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T21:59:11.196693] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-09T21:59:11.481595] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T21:59:11.996702] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-09T21:59:12.781076] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T21:59:12.799199] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-09T21:59:12.811079] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T21:59:13.492497] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T21:59:13.596733] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-09T21:59:14.396750] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-09T21:59:14.619496] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T21:59:15.196748] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-09T21:59:15.207043] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T21:59:15.996723] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-09T21:59:16.796708] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-09T21:59:16.936956] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T21:59:16.981171] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T21:59:17.596808] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-09T21:59:17.731969] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T21:59:18.134281] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T21:59:18.396805] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-09T21:59:19.196696] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-09T21:59:19.430403] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T21:59:19.990266] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T21:59:19.996670] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-09T21:59:20.796693] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-09T21:59:20.861777] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T21:59:21.596690] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-09T21:59:21.727248] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T21:59:22.396725] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-09T21:59:23.008946] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T21:59:23.010785] [INFO ] [REMOTE ] TRAK: Full fetch complete (13625 records). [2025-10-09T21:59:23.010889] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-09T21:59:23.197226] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-09T21:59:23.427329] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-09T21:59:23.427576] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-09T21:59:23.428053] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-09T21:59:23.428400] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-09T21:59:23.430923] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T21:59:23.441712] [DEBUG] [LOCAL ] TRAK: Trimmed 13625 records to 9675 (keeping 200 days of data) [2025-10-09T21:59:23.502164] [DEBUG] [LOCAL ] TRAK: Primary data saved (9675 records). [2025-10-09T21:59:23.502304] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-09T21:59:23.502413] [INFO ] [MAIN ] Update Progress: 2126/2373 symbols completed. TRAK took 27.1s. Estimated remaining: 34m 47s. Rate: 7.1 symbols/min [2025-10-09T21:59:23.672532] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:59:23.722798] [DEBUG] [LOCAL ] TRGP: Loaded 50804 existing records from primary storage. [2025-10-09T21:59:23.723143] [INFO ] [MAIN ] TRGP: Loaded 50804 existing records. [2025-10-09T21:59:23.903016] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:59:23.903480] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-09T21:59:23.903552] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-09T21:59:23.903952] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-09T21:59:23.904026] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-09T21:59:24.001797] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-09T21:59:24.020483] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T21:59:24.286740] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:59:24.796775] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-09T21:59:25.596701] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-09T21:59:25.722521] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T21:59:26.205671] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T21:59:26.222141] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T21:59:26.224854] [INFO ] [REMOTE ] TR: Full fetch complete (25306 records). [2025-10-09T21:59:26.224940] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-09T21:59:26.411749] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-09T21:59:26.637859] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-09T21:59:26.638051] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-09T21:59:26.638786] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-09T21:59:26.638855] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-09T21:59:26.639608] [DEBUG] [LOCAL ] TR: Trimmed 25306 records to 18876 (keeping 200 days of data) [2025-10-09T21:59:26.761240] [DEBUG] [LOCAL ] TR: Primary data saved (18876 records). [2025-10-09T21:59:26.761397] [INFO ] [MAIN ] TR: Full history saved. [2025-10-09T21:59:26.761510] [INFO ] [MAIN ] Update Progress: 2127/2373 symbols completed. TR took 42.7s. Estimated remaining: 34m 38s. Rate: 7.1 symbols/min [2025-10-09T21:59:26.939197] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:59:26.974320] [DEBUG] [LOCAL ] TRN: Loaded 36813 existing records from primary storage. [2025-10-09T21:59:26.974601] [INFO ] [MAIN ] TRN: Loaded 36813 existing records. [2025-10-09T21:59:27.149024] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:59:27.149315] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-09T21:59:27.149364] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-09T21:59:27.149693] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-09T21:59:27.149752] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-09T21:59:27.202794] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-09T21:59:27.500277] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:59:27.996724] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-09T21:59:28.018226] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T21:59:28.019850] [INFO ] [REMOTE ] TRC: Full fetch complete (21893 records). [2025-10-09T21:59:28.019921] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-09T21:59:28.418269] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T21:59:28.418532] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-09T21:59:28.429215] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-09T21:59:28.430015] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-09T21:59:28.430217] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-09T21:59:28.431201] [DEBUG] [LOCAL ] TRC: Trimmed 21893 records to 15744 (keeping 200 days of data) [2025-10-09T21:59:28.526678] [DEBUG] [LOCAL ] TRC: Primary data saved (15744 records). [2025-10-09T21:59:28.526826] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-09T21:59:28.526913] [INFO ] [MAIN ] Update Progress: 2128/2373 symbols completed. TRC took 30.8s. Estimated remaining: 34m 28s. Rate: 7.1 symbols/min [2025-10-09T21:59:28.731313] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:59:28.770957] [DEBUG] [LOCAL ] TRNO: Loaded 43954 existing records from primary storage. [2025-10-09T21:59:28.771292] [INFO ] [MAIN ] TRNO: Loaded 43954 existing records. [2025-10-09T21:59:28.801915] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-09T21:59:28.948304] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:59:28.948501] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-09T21:59:28.948548] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-09T21:59:28.948823] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-09T21:59:28.948880] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-09T21:59:29.304681] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:59:29.322540] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T21:59:29.596742] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-09T21:59:30.396698] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-09T21:59:30.586477] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T21:59:31.196759] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-09T21:59:31.397276] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T21:59:31.996766] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-09T21:59:32.027278] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T21:59:32.636972] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T21:59:32.796846] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-09T21:59:33.596742] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-09T21:59:33.676297] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T21:59:34.285635] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T21:59:34.396758] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-09T21:59:34.750828] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T21:59:34.755162] [INFO ] [REMOTE ] TREX: Full fetch complete (71161 records). [2025-10-09T21:59:34.755267] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-09T21:59:35.146504] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-09T21:59:35.146836] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-09T21:59:35.147921] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-09T21:59:35.147984] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-09T21:59:35.149525] [DEBUG] [LOCAL ] TREX: Trimmed 71161 records to 50263 (keeping 200 days of data) [2025-10-09T21:59:35.199005] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-09T21:59:35.450141] [DEBUG] [LOCAL ] TREX: Primary data saved (50263 records). [2025-10-09T21:59:35.450283] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-09T21:59:35.450368] [INFO ] [MAIN ] Update Progress: 2129/2373 symbols completed. TREX took 36.4s. Estimated remaining: 34m 20s. Rate: 7.1 symbols/min [2025-10-09T21:59:35.624683] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T21:59:35.657933] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T21:59:35.699263] [DEBUG] [LOCAL ] TROX: Loaded 51979 existing records from primary storage. [2025-10-09T21:59:35.699635] [INFO ] [MAIN ] TROX: Loaded 51979 existing records. [2025-10-09T21:59:35.873977] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T21:59:35.874253] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-09T21:59:35.874301] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-09T21:59:35.874773] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-09T21:59:35.874833] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-09T21:59:36.001785] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-09T21:59:36.227731] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T21:59:36.796734] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-09T21:59:37.067501] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T21:59:37.275812] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T21:59:37.596729] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-09T21:59:38.215391] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T21:59:38.396752] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-09T21:59:39.146096] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T21:59:39.196675] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-09T21:59:39.958237] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T21:59:39.996730] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-09T21:59:40.796740] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-09T21:59:40.995169] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T21:59:41.474630] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T21:59:41.596673] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-09T21:59:42.396702] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-09T21:59:42.493877] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T21:59:43.070809] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T21:59:43.196701] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-09T21:59:43.729026] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T21:59:43.996711] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-09T21:59:44.796790] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-09T21:59:44.837102] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T21:59:45.602079] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-09T21:59:45.614176] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T21:59:46.375073] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T21:59:46.396666] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-09T21:59:47.196719] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-09T21:59:47.313068] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T21:59:47.863432] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T21:59:47.996759] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-09T21:59:48.713909] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T21:59:48.796749] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-09T21:59:49.336803] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T21:59:49.596730] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-09T21:59:50.139371] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T21:59:50.396729] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-09T21:59:51.181507] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T21:59:51.196668] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-09T21:59:51.882747] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T21:59:51.996719] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-09T21:59:52.796822] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-09T21:59:52.874161] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T21:59:53.130503] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T21:59:53.596803] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-09T21:59:54.396711] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-09T21:59:54.450464] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T21:59:55.110572] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T21:59:55.196737] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-09T21:59:55.968509] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T21:59:55.996683] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-09T21:59:56.796754] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-09T21:59:57.001196] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T21:59:57.591446] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T21:59:57.601389] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-09T21:59:58.229166] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T21:59:58.396731] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-09T21:59:58.666451] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T21:59:59.196734] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-09T21:59:59.627352] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T21:59:59.631259] [INFO ] [REMOTE ] TRNO: Full fetch complete (63278 records). [2025-10-09T21:59:59.631375] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-09T21:59:59.952839] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T21:59:59.997679] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-09T21:59:59.997832] [INFO ] [REMOTE ] TRGP: Full fetch complete (73516 records). [2025-10-09T21:59:59.999366] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-09T22:00:00.220812] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-09T22:00:00.223163] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-09T22:00:00.224218] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-09T22:00:00.224328] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-09T22:00:00.283940] [DEBUG] [LOCAL ] TRNO: Trimmed 63278 records to 44218 (keeping 200 days of data) [2025-10-09T22:00:00.630462] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-09T22:00:00.630889] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-09T22:00:00.632390] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-09T22:00:00.632812] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-09T22:00:00.636636] [DEBUG] [LOCAL ] TRGP: Trimmed 73516 records to 51169 (keeping 200 days of data) [2025-10-09T22:00:00.831633] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-09T22:00:01.067986] [DEBUG] [LOCAL ] TRNO: Primary data saved (44218 records). [2025-10-09T22:00:01.068934] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-09T22:00:01.069327] [INFO ] [MAIN ] Update Progress: 2130/2373 symbols completed. TRNO took 32.5s. Estimated remaining: 34m 13s. Rate: 7.1 symbols/min [2025-10-09T22:00:01.265054] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:00:01.377812] [DEBUG] [LOCAL ] TRP: Loaded 52151 existing records from primary storage. [2025-10-09T22:00:01.379971] [INFO ] [MAIN ] TRP: Loaded 52151 existing records. [2025-10-09T22:00:01.457461] [DEBUG] [LOCAL ] TRGP: Primary data saved (51169 records). [2025-10-09T22:00:01.480607] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-09T22:00:01.491840] [INFO ] [MAIN ] Update Progress: 2131/2373 symbols completed. TRGP took 38.0s. Estimated remaining: 34m 4s. Rate: 7.1 symbols/min [2025-10-09T22:00:01.689042] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:00:01.729936] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-09T22:00:01.743902] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-09T22:00:01.765504] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:00:01.766591] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-09T22:00:01.766823] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-09T22:00:02.137845] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T22:00:02.166189] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-09T22:00:02.173443] [DEBUG] [LOCAL ] TRTX: Loaded 37485 existing records from primary storage. [2025-10-09T22:00:02.176892] [INFO ] [REMOTE ] TRN: Full fetch complete (52644 records). [2025-10-09T22:00:02.204250] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-09T22:00:02.215097] [INFO ] [MAIN ] TRTX: Loaded 37485 existing records. [2025-10-09T22:00:02.258006] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-09T22:00:02.367378] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:00:02.495596] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-09T22:00:02.829007] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:00:02.831844] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-09T22:00:02.831941] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-09T22:00:02.832337] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-09T22:00:02.837829] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-09T22:00:03.060672] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-09T22:00:03.074070] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-09T22:00:03.086300] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-09T22:00:03.089062] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-09T22:00:03.217786] [DEBUG] [LOCAL ] TRN: Trimmed 52644 records to 37031 (keeping 200 days of data) [2025-10-09T22:00:03.414089] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:00:03.418065] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-09T22:00:03.551517] [DEBUG] [LOCAL ] TRN: Primary data saved (37031 records). [2025-10-09T22:00:03.551697] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-09T22:00:03.551799] [INFO ] [MAIN ] Update Progress: 2132/2373 symbols completed. TRN took 36.8s. Estimated remaining: 33m 55s. Rate: 7.1 symbols/min [2025-10-09T22:00:03.720733] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:00:03.767924] [DEBUG] [LOCAL ] TRU: Loaded 51337 existing records from primary storage. [2025-10-09T22:00:03.768251] [INFO ] [MAIN ] TRU: Loaded 51337 existing records. [2025-10-09T22:00:03.957603] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:00:03.958043] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-09T22:00:03.958142] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-09T22:00:03.958417] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-09T22:00:03.958474] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-09T22:00:04.339089] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:00:04.339693] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-09T22:00:04.375902] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-09T22:00:04.584945] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T22:00:04.796823] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-09T22:00:04.908032] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T22:00:05.596711] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-09T22:00:06.036522] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T22:00:06.261212] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T22:00:06.396680] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-09T22:00:06.528227] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T22:00:07.196764] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-09T22:00:07.996767] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-09T22:00:08.141635] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T22:00:08.796706] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-09T22:00:09.059296] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T22:00:09.432878] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T22:00:09.596676] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-09T22:00:10.404816] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-09T22:00:10.410306] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T22:00:11.204445] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-09T22:00:11.207084] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T22:00:11.310243] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T22:00:11.996714] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-09T22:00:12.796763] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-09T22:00:13.528816] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-09T22:00:13.596671] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-09T22:00:13.679398] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T22:00:14.396742] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-09T22:00:14.578638] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T22:00:15.196743] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-09T22:00:15.428873] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T22:00:15.705089] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T22:00:15.709424] [INFO ] [REMOTE ] TROX: Full fetch complete (73365 records). [2025-10-09T22:00:15.709519] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-09T22:00:16.002175] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-09T22:00:16.103473] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-09T22:00:16.103561] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-09T22:00:16.104667] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-09T22:00:16.104734] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-09T22:00:16.106133] [DEBUG] [LOCAL ] TROX: Trimmed 73365 records to 52360 (keeping 200 days of data) [2025-10-09T22:00:16.422503] [DEBUG] [LOCAL ] TROX: Primary data saved (52360 records). [2025-10-09T22:00:16.422672] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-09T22:00:16.422778] [INFO ] [MAIN ] Update Progress: 2133/2373 symbols completed. TROX took 41.0s. Estimated remaining: 33m 47s. Rate: 7.1 symbols/min [2025-10-09T22:00:16.601857] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:00:16.645637] [DEBUG] [LOCAL ] TRV: Loaded 47501 existing records from primary storage. [2025-10-09T22:00:16.645986] [INFO ] [MAIN ] TRV: Loaded 47501 existing records. [2025-10-09T22:00:16.802747] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-09T22:00:16.840756] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:00:16.842248] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-09T22:00:16.842371] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-09T22:00:16.842834] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-09T22:00:16.842985] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-09T22:00:17.240301] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:00:17.254460] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T22:00:17.596683] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-09T22:00:17.708477] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T22:00:18.354590] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T22:00:18.396749] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-09T22:00:19.110464] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T22:00:19.196756] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-09T22:00:19.996704] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-09T22:00:20.242986] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T22:00:20.796776] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-09T22:00:21.019562] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T22:00:21.596718] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-09T22:00:21.814125] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T22:00:22.396693] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-09T22:00:22.485042] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T22:00:23.196705] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-09T22:00:23.257819] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T22:00:23.996710] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-09T22:00:24.334529] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T22:00:24.576592] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T22:00:24.796723] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-09T22:00:25.582784] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T22:00:25.596680] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-09T22:00:25.722364] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T22:00:26.396722] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-09T22:00:27.196737] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-09T22:00:27.385206] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T22:00:27.958278] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T22:00:27.962968] [INFO ] [REMOTE ] TRP: Full fetch complete (75528 records). [2025-10-09T22:00:27.963103] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-09T22:00:28.001879] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-09T22:00:28.372949] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-09T22:00:28.373047] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-09T22:00:28.374315] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-09T22:00:28.374434] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-09T22:00:28.376057] [DEBUG] [LOCAL ] TRP: Trimmed 75528 records to 52533 (keeping 200 days of data) [2025-10-09T22:00:28.484206] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T22:00:28.727847] [DEBUG] [LOCAL ] TRP: Primary data saved (52533 records). [2025-10-09T22:00:28.728007] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-09T22:00:28.728143] [INFO ] [MAIN ] Update Progress: 2134/2373 symbols completed. TRP took 27.7s. Estimated remaining: 33m 39s. Rate: 7.1 symbols/min [2025-10-09T22:00:28.801760] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-09T22:00:28.895355] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:00:28.942244] [DEBUG] [LOCAL ] TS: Loaded 51684 existing records from primary storage. [2025-10-09T22:00:28.942549] [INFO ] [MAIN ] TS: Loaded 51684 existing records. [2025-10-09T22:00:29.114818] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:00:29.115025] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-09T22:00:29.115073] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-09T22:00:29.115290] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-09T22:00:29.115347] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-09T22:00:29.465077] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:00:29.503781] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T22:00:29.596680] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-09T22:00:30.268058] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T22:00:30.396685] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-09T22:00:31.196701] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-09T22:00:31.362346] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T22:00:31.996694] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-09T22:00:32.426534] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T22:00:32.665859] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T22:00:32.796672] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-09T22:00:33.409542] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T22:00:33.596758] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-09T22:00:34.182614] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T22:00:34.396730] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-09T22:00:34.951133] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T22:00:34.955784] [INFO ] [REMOTE ] TRU: Full fetch complete (73668 records). [2025-10-09T22:00:34.955898] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-09T22:00:35.208135] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-09T22:00:35.350129] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-09T22:00:35.350218] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-09T22:00:35.351314] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-09T22:00:35.351380] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-09T22:00:35.352813] [DEBUG] [LOCAL ] TRU: Trimmed 73668 records to 51727 (keeping 200 days of data) [2025-10-09T22:00:35.684451] [DEBUG] [LOCAL ] TRU: Primary data saved (51727 records). [2025-10-09T22:00:35.684667] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-09T22:00:35.684801] [INFO ] [MAIN ] Update Progress: 2135/2373 symbols completed. TRU took 32.1s. Estimated remaining: 33m 30s. Rate: 7.1 symbols/min [2025-10-09T22:00:35.861680] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:00:35.887596] [DEBUG] [LOCAL ] TSE: Loaded 27896 existing records from primary storage. [2025-10-09T22:00:35.888012] [INFO ] [MAIN ] TSE: Loaded 27896 existing records. [2025-10-09T22:00:35.999508] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-09T22:00:36.019825] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T22:00:36.123260] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:00:36.123487] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-09T22:00:36.123539] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-09T22:00:36.123765] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-09T22:00:36.123823] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-09T22:00:36.495991] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:00:36.796777] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-09T22:00:37.120944] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T22:00:37.187893] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T22:00:37.596733] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-09T22:00:38.396759] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-09T22:00:38.499281] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T22:00:38.776526] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T22:00:38.780875] [INFO ] [REMOTE ] TRTX: Full fetch complete (53169 records). [2025-10-09T22:00:38.780970] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-09T22:00:39.191594] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-09T22:00:39.191962] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-09T22:00:39.192958] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-09T22:00:39.193023] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-09T22:00:39.195222] [DEBUG] [LOCAL ] TRTX: Trimmed 53169 records to 37713 (keeping 200 days of data) [2025-10-09T22:00:39.196744] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-09T22:00:39.432504] [DEBUG] [LOCAL ] TRTX: Primary data saved (37713 records). [2025-10-09T22:00:39.432632] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-09T22:00:39.432844] [INFO ] [MAIN ] Update Progress: 2136/2373 symbols completed. TRTX took 37.9s. Estimated remaining: 33m 21s. Rate: 7.1 symbols/min [2025-10-09T22:00:39.615049] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:00:39.626395] [DEBUG] [LOCAL ] TSI: Loaded 7500 existing records from primary storage. [2025-10-09T22:00:39.626604] [INFO ] [MAIN ] TSI: Loaded 7500 existing records. [2025-10-09T22:00:39.836010] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:00:39.836493] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-09T22:00:39.836576] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-09T22:00:39.836845] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-09T22:00:39.836929] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-09T22:00:40.001603] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-09T22:00:40.383496] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:00:40.433674] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-09T22:00:40.796761] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-09T22:00:41.190803] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-09T22:00:41.416006] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T22:00:41.505157] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T22:00:41.596722] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-09T22:00:42.396692] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-09T22:00:42.719260] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T22:00:42.922089] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-09T22:00:43.196715] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-09T22:00:43.996815] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-09T22:00:44.796806] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-09T22:00:44.922248] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T22:00:45.596692] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-09T22:00:45.765461] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T22:00:45.947508] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-09T22:00:46.396755] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-09T22:00:46.527916] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T22:00:47.196758] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-09T22:00:47.996767] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-09T22:00:48.074582] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T22:00:48.661330] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T22:00:48.796701] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-09T22:00:48.980523] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T22:00:49.596767] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-09T22:00:50.396732] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-09T22:00:50.476602] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T22:00:50.960121] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T22:00:51.007223] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T22:00:51.196720] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-09T22:00:51.996734] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-09T22:00:52.448337] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T22:00:52.796748] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-09T22:00:53.427600] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T22:00:53.596732] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-09T22:00:53.757601] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T22:00:54.354210] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T22:00:54.396715] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-09T22:00:55.196754] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-09T22:00:55.638120] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T22:00:55.996734] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-09T22:00:56.796792] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-09T22:00:56.865294] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T22:00:57.362946] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T22:00:57.596801] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-09T22:00:58.074081] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T22:00:58.396770] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-09T22:00:59.196782] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-09T22:00:59.370554] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T22:00:59.613118] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T22:00:59.949391] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T22:00:59.996782] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-09T22:01:00.796792] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-09T22:01:01.081205] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-09T22:01:01.085243] [INFO ] [REMOTE ] TRV: Full fetch complete (69576 records). [2025-10-09T22:01:01.085351] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-09T22:01:01.495770] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-09T22:01:01.495867] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-09T22:01:01.496952] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-09T22:01:01.497019] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-09T22:01:01.498481] [DEBUG] [LOCAL ] TRV: Trimmed 69576 records to 47850 (keeping 200 days of data) [2025-10-09T22:01:01.608301] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-09T22:01:01.615044] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T22:01:01.621678] [INFO ] [REMOTE ] TS: Full fetch complete (74528 records). [2025-10-09T22:01:01.623248] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-09T22:01:02.104383] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-09T22:01:02.104749] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-09T22:01:02.106244] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-09T22:01:02.106821] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-09T22:01:02.112632] [DEBUG] [LOCAL ] TS: Trimmed 74528 records to 52055 (keeping 200 days of data) [2025-10-09T22:01:02.413541] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-09T22:01:02.462954] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T22:01:02.598718] [DEBUG] [LOCAL ] TRV: Primary data saved (47850 records). [2025-10-09T22:01:02.615806] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-09T22:01:02.617519] [INFO ] [MAIN ] Update Progress: 2137/2373 symbols completed. TRV took 46.2s. Estimated remaining: 33m 14s. Rate: 7.1 symbols/min [2025-10-09T22:01:02.799438] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:01:02.813679] [DEBUG] [LOCAL ] TS: Primary data saved (52055 records). [2025-10-09T22:01:02.813827] [INFO ] [MAIN ] TS: Full history saved. [2025-10-09T22:01:02.813917] [INFO ] [MAIN ] Update Progress: 2138/2373 symbols completed. TS took 34.1s. Estimated remaining: 33m 5s. Rate: 7.1 symbols/min [2025-10-09T22:01:02.995562] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:01:03.008478] [DEBUG] [LOCAL ] TSLX: Loaded 35390 existing records from primary storage. [2025-10-09T22:01:03.008836] [INFO ] [MAIN ] TSLX: Loaded 35390 existing records. [2025-10-09T22:01:03.189485] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:01:03.189854] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-09T22:01:03.189905] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-09T22:01:03.190139] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-09T22:01:03.190196] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-09T22:01:03.224859] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-09T22:01:03.371393] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-09T22:01:03.382840] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-09T22:01:03.752782] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:01:03.816101] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:01:03.817126] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-09T22:01:03.817256] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-09T22:01:03.824108] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-09T22:01:03.834636] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-09T22:01:03.835155] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T22:01:04.003261] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-09T22:01:04.151411] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T22:01:04.240270] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:01:04.796730] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-09T22:01:05.481430] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T22:01:05.596758] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-09T22:01:05.902960] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T22:01:06.306862] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T22:01:06.308398] [INFO ] [REMOTE ] TSI: Full fetch complete (13428 records). [2025-10-09T22:01:06.308493] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-09T22:01:06.401974] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-09T22:01:06.723615] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-09T22:01:06.723735] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-09T22:01:06.724080] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-09T22:01:06.724121] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-09T22:01:06.724887] [DEBUG] [LOCAL ] TSI: Trimmed 13428 records to 7608 (keeping 200 days of data) [2025-10-09T22:01:06.771907] [DEBUG] [LOCAL ] TSI: Primary data saved (7608 records). [2025-10-09T22:01:06.772061] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-09T22:01:06.772151] [INFO ] [MAIN ] Update Progress: 2139/2373 symbols completed. TSI took 27.3s. Estimated remaining: 32m 56s. Rate: 7.1 symbols/min [2025-10-09T22:01:06.949800] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:01:06.999087] [DEBUG] [LOCAL ] TSN: Loaded 52958 existing records from primary storage. [2025-10-09T22:01:06.999450] [INFO ] [MAIN ] TSN: Loaded 52958 existing records. [2025-10-09T22:01:07.175030] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:01:07.175290] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-09T22:01:07.175347] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-09T22:01:07.175589] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-09T22:01:07.175681] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-09T22:01:07.205412] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-09T22:01:07.532478] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:01:07.640522] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T22:01:07.931684] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T22:01:07.935061] [INFO ] [REMOTE ] TSE: Full fetch complete (40712 records). [2025-10-09T22:01:07.935190] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-09T22:01:08.004765] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-09T22:01:08.332862] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-09T22:01:08.332945] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-09T22:01:08.333775] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-09T22:01:08.333837] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-09T22:01:08.334727] [DEBUG] [LOCAL ] TSE: Trimmed 40712 records to 28066 (keeping 200 days of data) [2025-10-09T22:01:08.507846] [DEBUG] [LOCAL ] TSE: Primary data saved (28066 records). [2025-10-09T22:01:08.508057] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-09T22:01:08.508200] [INFO ] [MAIN ] Update Progress: 2140/2373 symbols completed. TSE took 32.8s. Estimated remaining: 32m 47s. Rate: 7.1 symbols/min [2025-10-09T22:01:08.686124] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:01:08.698795] [DEBUG] [LOCAL ] TSQ: Loaded 11745 existing records from primary storage. [2025-10-09T22:01:08.699006] [INFO ] [MAIN ] TSQ: Loaded 11745 existing records. [2025-10-09T22:01:08.801940] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-09T22:01:08.887845] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:01:08.888127] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-09T22:01:08.888191] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-09T22:01:08.888420] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-09T22:01:08.888502] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-09T22:01:09.250243] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:01:09.596702] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-09T22:01:09.804560] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T22:01:10.396800] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-09T22:01:10.646699] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T22:01:11.196698] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-09T22:01:11.206033] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T22:01:11.716835] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-10-09T22:01:11.996719] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-09T22:01:12.796694] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-09T22:01:12.823886] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T22:01:13.050693] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T22:01:13.596741] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-09T22:01:14.396765] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-09T22:01:15.013235] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T22:01:15.196728] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-09T22:01:15.231006] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T22:01:15.430444] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-09T22:01:15.996779] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-09T22:01:16.592711] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T22:01:16.796743] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-09T22:01:16.828042] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T22:01:17.596757] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-09T22:01:17.615283] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T22:01:18.396720] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-09T22:01:18.939029] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T22:01:19.196771] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-09T22:01:19.366713] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T22:01:19.996742] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-09T22:01:20.330163] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T22:01:20.730938] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T22:01:20.796795] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-09T22:01:21.596746] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-09T22:01:22.401837] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-09T22:01:22.418924] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T22:01:23.196718] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-09T22:01:23.827335] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T22:01:23.983793] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-09T22:01:23.996669] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-09T22:01:24.148058] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T22:01:24.796729] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-09T22:01:25.596811] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-09T22:01:26.225389] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T22:01:26.402112] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-09T22:01:26.407974] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-09T22:01:26.649488] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T22:01:27.137391] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T22:01:27.196689] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-09T22:01:27.996734] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-09T22:01:28.796725] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-09T22:01:29.376621] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T22:01:29.596713] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-09T22:01:30.007426] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-09T22:01:30.343124] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T22:01:30.396685] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-09T22:01:30.982114] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T22:01:31.196766] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-09T22:01:31.749208] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T22:01:31.750567] [INFO ] [REMOTE ] TSQ: Full fetch complete (16384 records). [2025-10-09T22:01:31.750686] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-09T22:01:32.002254] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-09T22:01:32.144748] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-09T22:01:32.144992] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-09T22:01:32.145691] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-09T22:01:32.145818] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-09T22:01:32.147069] [DEBUG] [LOCAL ] TSQ: Trimmed 16384 records to 11789 (keeping 200 days of data) [2025-10-09T22:01:32.259569] [DEBUG] [LOCAL ] TSQ: Primary data saved (11789 records). [2025-10-09T22:01:32.260315] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-09T22:01:32.260489] [INFO ] [MAIN ] Update Progress: 2141/2373 symbols completed. TSQ took 23.8s. Estimated remaining: 32m 40s. Rate: 7.1 symbols/min [2025-10-09T22:01:32.502317] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:01:32.554112] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-09T22:01:32.624077] [DEBUG] [LOCAL ] TT: Loaded 47467 existing records from primary storage. [2025-10-09T22:01:32.624637] [INFO ] [MAIN ] TT: Loaded 47467 existing records. [2025-10-09T22:01:32.802142] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-09T22:01:32.903426] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:01:32.903862] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-09T22:01:32.903993] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-09T22:01:32.904689] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-09T22:01:32.904772] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-09T22:01:33.394308] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:01:33.390164] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T22:01:33.400380] [INFO ] [REMOTE ] TSLX: Full fetch complete (49759 records). [2025-10-09T22:01:33.400560] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-09T22:01:33.602917] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-09T22:01:33.812019] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-09T22:01:33.812121] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-09T22:01:33.813169] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-09T22:01:33.813238] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-09T22:01:33.814567] [DEBUG] [LOCAL ] TSLX: Trimmed 49759 records to 35737 (keeping 200 days of data) [2025-10-09T22:01:34.052931] [DEBUG] [LOCAL ] TSLX: Primary data saved (35737 records). [2025-10-09T22:01:34.053106] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-09T22:01:34.053228] [INFO ] [MAIN ] Update Progress: 2142/2373 symbols completed. TSLX took 31.4s. Estimated remaining: 32m 31s. Rate: 7.1 symbols/min [2025-10-09T22:01:34.233322] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:01:34.233537] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-09T22:01:34.233575] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-09T22:01:34.233722] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-09T22:01:34.233772] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-09T22:01:34.233815] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-09T22:01:34.233848] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-09T22:01:34.400289] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-09T22:01:34.603532] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:01:35.196735] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-09T22:01:35.339957] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-09T22:01:35.398296] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T22:01:35.407545] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T22:01:35.408499] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-09T22:01:35.408589] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:01:35.408673] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-09T22:01:35.408740] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:01:35.408811] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-09T22:01:35.408918] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-09T22:01:35.408970] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-09T22:01:35.409027] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-09T22:01:35.409095] [INFO ] [MAIN ] Update Progress: 2143/2373 symbols completed. TTAM took 1.4s. Estimated remaining: 32m 22s. Rate: 7.1 symbols/min [2025-10-09T22:01:35.581549] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:01:35.622530] [DEBUG] [LOCAL ] TTC: Loaded 42048 existing records from primary storage. [2025-10-09T22:01:35.622872] [INFO ] [MAIN ] TTC: Loaded 42048 existing records. [2025-10-09T22:01:35.798258] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:01:35.798460] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-09T22:01:35.798507] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-09T22:01:35.798740] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-09T22:01:35.798798] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-09T22:01:35.996733] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-09T22:01:36.191189] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:01:36.302215] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T22:01:36.796803] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-09T22:01:37.537061] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T22:01:37.596694] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-09T22:01:38.396793] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-09T22:01:39.196782] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-09T22:01:39.296273] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T22:01:39.474766] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-09T22:01:39.996683] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-09T22:01:40.050194] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T22:01:40.645519] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T22:01:40.796716] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-09T22:01:41.596717] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-09T22:01:42.329822] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T22:01:42.396677] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-09T22:01:42.909505] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-09T22:01:43.146318] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T22:01:43.196696] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-09T22:01:43.687160] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T22:01:43.996752] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-09T22:01:44.796753] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-09T22:01:45.063170] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T22:01:45.596743] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-09T22:01:46.396721] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-09T22:01:46.710754] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T22:01:46.773790] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-10-09T22:01:47.196738] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-09T22:01:47.370282] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T22:01:47.903699] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T22:01:47.996669] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-09T22:01:48.796741] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-09T22:01:49.086175] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T22:01:49.596711] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-09T22:01:49.650946] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T22:01:49.893673] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T22:01:50.165618] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T22:01:50.171855] [INFO ] [REMOTE ] TSN: Full fetch complete (76388 records). [2025-10-09T22:01:50.171970] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-09T22:01:50.401822] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-09T22:01:50.570193] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-09T22:01:50.570267] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-09T22:01:50.571373] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-09T22:01:50.571437] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-09T22:01:50.572882] [DEBUG] [LOCAL ] TSN: Trimmed 76388 records to 53344 (keeping 200 days of data) [2025-10-09T22:01:50.906020] [DEBUG] [LOCAL ] TSN: Primary data saved (53344 records). [2025-10-09T22:01:50.906159] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-09T22:01:50.906244] [INFO ] [MAIN ] Update Progress: 2144/2373 symbols completed. TSN took 44.1s. Estimated remaining: 32m 14s. Rate: 7.1 symbols/min [2025-10-09T22:01:51.076569] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:01:51.125664] [DEBUG] [LOCAL ] TTE: Loaded 51598 existing records from primary storage. [2025-10-09T22:01:51.125979] [INFO ] [MAIN ] TTE: Loaded 51598 existing records. [2025-10-09T22:01:51.202322] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-09T22:01:51.309368] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:01:51.309547] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-09T22:01:51.309594] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-09T22:01:51.309846] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-09T22:01:51.309903] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-09T22:01:51.664588] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:01:51.996711] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-09T22:01:52.214850] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T22:01:52.796873] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-09T22:01:52.875206] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T22:01:53.596781] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-09T22:01:54.396701] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-09T22:01:54.457420] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-09T22:01:54.676311] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T22:01:54.936959] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T22:01:55.196740] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-09T22:01:55.996731] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-09T22:01:56.076101] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T22:01:56.789785] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T22:01:56.798016] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-09T22:01:57.601870] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-09T22:01:57.622064] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T22:01:58.396689] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-09T22:01:58.523283] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T22:01:59.090425] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T22:01:59.196747] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-09T22:01:59.996791] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-09T22:02:00.317267] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-09T22:02:00.321762] [INFO ] [REMOTE ] TT: Full fetch complete (69755 records). [2025-10-09T22:02:00.321941] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-09T22:02:00.741807] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-09T22:02:00.742135] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-09T22:02:00.743356] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-09T22:02:00.743478] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-09T22:02:00.745227] [DEBUG] [LOCAL ] TT: Trimmed 69755 records to 47820 (keeping 200 days of data) [2025-10-09T22:02:00.768526] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T22:02:00.831723] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-09T22:02:01.089728] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-09T22:02:01.100127] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-09T22:02:01.101152] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-09T22:02:01.173277] [DEBUG] [LOCAL ] TT: Primary data saved (47820 records). [2025-10-09T22:02:01.189754] [INFO ] [MAIN ] TT: Full history saved. [2025-10-09T22:02:01.195565] [INFO ] [MAIN ] Update Progress: 2145/2373 symbols completed. TT took 28.9s. Estimated remaining: 32m 6s. Rate: 7.1 symbols/min [2025-10-09T22:02:01.540500] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:02:01.605086] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-09T22:02:01.722044] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-09T22:02:01.734529] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-09T22:02:01.736030] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-09T22:02:01.736207] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-09T22:02:01.738241] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 54209 (keeping 200 days of data) [2025-10-09T22:02:01.828468] [DEBUG] [LOCAL ] TTI: Loaded 45959 existing records from primary storage. [2025-10-09T22:02:01.855523] [INFO ] [MAIN ] TTI: Loaded 45959 existing records. [2025-10-09T22:02:02.046396] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:02:02.047851] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-09T22:02:02.047924] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-09T22:02:02.049039] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-09T22:02:02.049634] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-09T22:02:02.456911] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:02:02.459563] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-09T22:02:02.599549] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T22:02:02.741688] [DEBUG] [LOCAL ] TSM: Primary data saved (54209 records). [2025-10-09T22:02:02.741837] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-09T22:02:02.741924] [INFO ] [MAIN ] Update Progress: 2146/2373 symbols completed. TSM took 59.9s. Estimated remaining: 31m 57s. Rate: 7.1 symbols/min [2025-10-09T22:02:02.913052] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:02:02.923789] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T22:02:02.928030] [INFO ] [REMOTE ] TTC: Full fetch complete (62121 records). [2025-10-09T22:02:02.928166] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-09T22:02:03.200971] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-09T22:02:03.314810] [DEBUG] [LOCAL ] TU: Loaded 49844 existing records from primary storage. [2025-10-09T22:02:03.337815] [INFO ] [MAIN ] TU: Loaded 49844 existing records. [2025-10-09T22:02:03.386595] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-09T22:02:03.425734] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-09T22:02:03.438117] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-09T22:02:03.449509] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-09T22:02:03.482443] [DEBUG] [LOCAL ] TTC: Trimmed 62121 records to 42360 (keeping 200 days of data) [2025-10-09T22:02:03.598879] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:02:03.599962] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-09T22:02:03.600014] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-09T22:02:03.600225] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-09T22:02:03.600283] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-09T22:02:04.032522] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:02:04.034258] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-09T22:02:04.071727] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T22:02:04.240108] [DEBUG] [LOCAL ] TTC: Primary data saved (42360 records). [2025-10-09T22:02:04.240251] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-09T22:02:04.240377] [INFO ] [MAIN ] Update Progress: 2147/2373 symbols completed. TTC took 28.8s. Estimated remaining: 31m 47s. Rate: 7.1 symbols/min [2025-10-09T22:02:04.411225] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:02:04.452593] [DEBUG] [LOCAL ] TUYA: Loaded 45953 existing records from primary storage. [2025-10-09T22:02:04.452934] [INFO ] [MAIN ] TUYA: Loaded 45953 existing records. [2025-10-09T22:02:04.634288] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:02:04.634484] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-09T22:02:04.634532] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-09T22:02:04.634752] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-09T22:02:04.634812] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-09T22:02:04.799036] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-09T22:02:05.013080] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:02:05.167923] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-09T22:02:05.514717] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T22:02:05.596734] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-09T22:02:06.401807] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-09T22:02:06.419369] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T22:02:06.891761] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T22:02:07.196734] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-09T22:02:07.996736] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-09T22:02:08.227221] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T22:02:08.690418] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T22:02:08.796689] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-09T22:02:09.063341] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T22:02:09.596773] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-09T22:02:10.194911] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T22:02:10.396723] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-09T22:02:11.159948] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T22:02:11.196679] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-09T22:02:11.995634] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T22:02:12.004239] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-09T22:02:12.337077] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T22:02:12.796733] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-09T22:02:13.596687] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-09T22:02:13.836453] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T22:02:14.396751] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-09T22:02:14.709351] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-09T22:02:15.196705] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-09T22:02:15.304174] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T22:02:15.996756] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-09T22:02:16.253499] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T22:02:16.654232] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T22:02:16.796685] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-09T22:02:17.596777] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-09T22:02:17.827247] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T22:02:18.396735] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-09T22:02:18.450994] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T22:02:19.049046] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T22:02:19.196719] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-09T22:02:19.995358] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T22:02:20.005363] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-09T22:02:20.796743] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-09T22:02:20.958260] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T22:02:21.596759] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-09T22:02:21.876054] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T22:02:22.255891] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T22:02:22.396692] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-09T22:02:23.031331] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T22:02:23.196709] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-09T22:02:23.996696] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-09T22:02:24.164514] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T22:02:24.170108] [INFO ] [REMOTE ] TTE: Full fetch complete (74961 records). [2025-10-09T22:02:24.170245] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-09T22:02:24.567871] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-09T22:02:24.568052] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-09T22:02:24.569232] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-09T22:02:24.569299] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-09T22:02:24.571120] [DEBUG] [LOCAL ] TTE: Trimmed 74961 records to 51981 (keeping 200 days of data) [2025-10-09T22:02:24.796929] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-09T22:02:24.834273] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T22:02:24.933519] [DEBUG] [LOCAL ] TTE: Primary data saved (51981 records). [2025-10-09T22:02:24.933681] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-09T22:02:24.933815] [INFO ] [MAIN ] Update Progress: 2148/2373 symbols completed. TTE took 34.0s. Estimated remaining: 31m 40s. Rate: 7.1 symbols/min [2025-10-09T22:02:25.099777] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:02:25.137367] [DEBUG] [LOCAL ] TV: Loaded 42009 existing records from primary storage. [2025-10-09T22:02:25.137987] [INFO ] [MAIN ] TV: Loaded 42009 existing records. [2025-10-09T22:02:25.321436] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:02:25.321804] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-09T22:02:25.321907] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-09T22:02:25.322166] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-09T22:02:25.322317] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-09T22:02:25.533984] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T22:02:25.601463] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-09T22:02:25.716245] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:02:26.396684] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-09T22:02:26.437426] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T22:02:27.196712] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-09T22:02:27.321765] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T22:02:27.734710] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T22:02:27.996729] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-09T22:02:28.764133] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T22:02:28.796698] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-09T22:02:29.287475] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T22:02:29.596764] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-09T22:02:30.051324] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T22:02:30.396751] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-09T22:02:31.196700] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-09T22:02:31.232362] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T22:02:31.948415] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T22:02:31.996672] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-09T22:02:32.687784] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T22:02:32.796690] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-09T22:02:33.493469] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T22:02:33.498361] [INFO ] [REMOTE ] TTI: Full fetch complete (65523 records). [2025-10-09T22:02:33.498501] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-09T22:02:33.606989] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-09T22:02:33.898431] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-09T22:02:33.898515] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-09T22:02:33.899590] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-09T22:02:33.899679] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-09T22:02:33.900979] [DEBUG] [LOCAL ] TTI: Trimmed 65523 records to 46300 (keeping 200 days of data) [2025-10-09T22:02:34.172767] [DEBUG] [LOCAL ] TTI: Primary data saved (46300 records). [2025-10-09T22:02:34.172972] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-09T22:02:34.173070] [INFO ] [MAIN ] Update Progress: 2149/2373 symbols completed. TTI took 33.0s. Estimated remaining: 31m 32s. Rate: 7.1 symbols/min [2025-10-09T22:02:34.342139] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:02:34.348048] [DEBUG] [LOCAL ] TVC: Loaded 3319 existing records from primary storage. [2025-10-09T22:02:34.348223] [INFO ] [MAIN ] TVC: Loaded 3319 existing records. [2025-10-09T22:02:34.402049] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-09T22:02:34.530048] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:02:34.530202] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-09T22:02:34.530248] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-09T22:02:34.530454] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-09T22:02:34.530587] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-09T22:02:34.724106] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T22:02:34.966165] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:02:34.975453] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T22:02:34.979215] [INFO ] [REMOTE ] TUYA: Full fetch complete (65827 records). [2025-10-09T22:02:34.979311] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-09T22:02:35.207133] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-09T22:02:35.379244] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-09T22:02:35.379322] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-09T22:02:35.380487] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-09T22:02:35.380596] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-09T22:02:35.381979] [DEBUG] [LOCAL ] TUYA: Trimmed 65827 records to 46266 (keeping 200 days of data) [2025-10-09T22:02:35.651283] [DEBUG] [LOCAL ] TUYA: Primary data saved (46266 records). [2025-10-09T22:02:35.651501] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-09T22:02:35.651639] [INFO ] [MAIN ] Update Progress: 2150/2373 symbols completed. TUYA took 31.4s. Estimated remaining: 31m 23s. Rate: 7.1 symbols/min [2025-10-09T22:02:35.823703] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:02:35.853575] [DEBUG] [LOCAL ] TVE: Loaded 2772 existing records from primary storage. [2025-10-09T22:02:35.854558] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T22:02:35.854853] [INFO ] [MAIN ] TVE: Loaded 2772 existing records. [2025-10-09T22:02:36.003982] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-09T22:02:36.045000] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:02:36.045170] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-09T22:02:36.045216] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-09T22:02:36.045386] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-09T22:02:36.045442] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-09T22:02:36.404386] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:02:36.796822] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-09T22:02:36.927278] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T22:02:37.447763] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T22:02:37.596696] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-09T22:02:37.813801] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T22:02:38.393568] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T22:02:38.396734] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-09T22:02:38.970894] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T22:02:39.196727] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-09T22:02:39.789516] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T22:02:39.996729] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-09T22:02:40.796743] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-09T22:02:41.213103] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-09T22:02:41.596789] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-09T22:02:41.719153] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T22:02:42.252749] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T22:02:42.396751] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-09T22:02:42.795330] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-09T22:02:43.196734] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-09T22:02:43.996723] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-09T22:02:44.605844] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T22:02:44.796747] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-09T22:02:44.870112] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T22:02:45.596802] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-09T22:02:46.054024] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T22:02:46.396782] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-09T22:02:46.944004] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T22:02:47.073582] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T22:02:47.196718] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-09T22:02:47.996774] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-09T22:02:48.776960] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T22:02:48.783330] [INFO ] [REMOTE ] TU: Full fetch complete (72758 records). [2025-10-09T22:02:48.783485] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-09T22:02:48.800685] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-09T22:02:49.204683] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-09T22:02:49.204833] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-09T22:02:49.206056] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-09T22:02:49.206121] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-09T22:02:49.207522] [DEBUG] [LOCAL ] TU: Trimmed 72758 records to 50202 (keeping 200 days of data) [2025-10-09T22:02:49.562413] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T22:02:49.568886] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T22:02:49.596971] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-09T22:02:49.600984] [DEBUG] [LOCAL ] TU: Primary data saved (50202 records). [2025-10-09T22:02:49.601080] [INFO ] [MAIN ] TU: Full history saved. [2025-10-09T22:02:49.601281] [INFO ] [MAIN ] Update Progress: 2151/2373 symbols completed. TU took 46.9s. Estimated remaining: 31m 15s. Rate: 7.1 symbols/min [2025-10-09T22:02:49.779346] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:02:49.812324] [DEBUG] [LOCAL ] TWI: Loaded 34088 existing records from primary storage. [2025-10-09T22:02:49.812691] [INFO ] [MAIN ] TWI: Loaded 34088 existing records. [2025-10-09T22:02:49.991743] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:02:49.991949] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-09T22:02:49.991996] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-09T22:02:49.992222] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-09T22:02:49.992279] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-09T22:02:50.262025] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T22:02:50.362539] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:02:50.396683] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-09T22:02:51.196732] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-09T22:02:51.655532] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T22:02:52.003476] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-09T22:02:52.020627] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T22:02:52.618707] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T22:02:52.796705] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-09T22:02:53.596727] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-09T22:02:54.291636] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T22:02:54.396727] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-09T22:02:54.793127] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T22:02:54.869006] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T22:02:55.196719] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-09T22:02:55.996743] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-09T22:02:56.619447] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T22:02:56.642831] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T22:02:56.796705] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-09T22:02:57.596788] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-09T22:02:58.161512] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T22:02:58.368601] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T22:02:58.396681] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-09T22:02:59.196859] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-09T22:03:00.001912] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-09T22:03:00.003889] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T22:03:00.701354] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T22:03:00.701674] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T22:03:00.796703] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-09T22:03:01.596736] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-09T22:03:02.271038] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T22:03:02.396763] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-09T22:03:02.945908] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T22:03:02.953063] [INFO ] [REMOTE ] TV: Full fetch complete (61588 records). [2025-10-09T22:03:02.953264] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-09T22:03:03.201835] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-09T22:03:03.374863] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-09T22:03:03.374960] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-09T22:03:03.376077] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-09T22:03:03.376144] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-09T22:03:03.377564] [DEBUG] [LOCAL ] TV: Trimmed 61588 records to 42296 (keeping 200 days of data) [2025-10-09T22:03:03.639195] [DEBUG] [LOCAL ] TV: Primary data saved (42296 records). [2025-10-09T22:03:03.639382] [INFO ] [MAIN ] TV: Full history saved. [2025-10-09T22:03:03.639672] [INFO ] [MAIN ] Update Progress: 2152/2373 symbols completed. TV took 38.7s. Estimated remaining: 31m 7s. Rate: 7.1 symbols/min [2025-10-09T22:03:03.700487] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T22:03:03.722313] [INFO ] [REMOTE ] TVE: Full fetch complete (4368 records). [2025-10-09T22:03:03.759352] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-09T22:03:03.777849] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T22:03:03.980425] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:04.001254] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-09T22:03:04.250383] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-09T22:03:04.264313] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-09T22:03:04.264635] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-09T22:03:04.264815] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-09T22:03:04.265463] [DEBUG] [LOCAL ] TVE: Trimmed 4368 records to 2784 (keeping 200 days of data) [2025-10-09T22:03:04.284602] [DEBUG] [LOCAL ] TVE: Primary data saved (2784 records). [2025-10-09T22:03:04.299945] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-09T22:03:04.300139] [INFO ] [MAIN ] Update Progress: 2153/2373 symbols completed. TVE took 28.6s. Estimated remaining: 30m 58s. Rate: 7.1 symbols/min [2025-10-09T22:03:04.306811] [DEBUG] [LOCAL ] TWLO: Loaded 52762 existing records from primary storage. [2025-10-09T22:03:04.374804] [INFO ] [MAIN ] TWLO: Loaded 52762 existing records. [2025-10-09T22:03:04.633483] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:04.698488] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:03:04.699828] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-09T22:03:04.699974] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-09T22:03:04.700213] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-09T22:03:04.700305] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-09T22:03:04.743943] [DEBUG] [LOCAL ] TWN: Loaded 3195 existing records from primary storage. [2025-10-09T22:03:04.777248] [INFO ] [MAIN ] TWN: Loaded 3195 existing records. [2025-10-09T22:03:04.818917] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-09T22:03:05.217211] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:03:05.243024] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-09T22:03:05.253861] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-09T22:03:05.278775] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-09T22:03:05.285637] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-09T22:03:05.285345] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:05.569820] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T22:03:05.601385] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-09T22:03:05.672637] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T22:03:05.713469] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:06.396756] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-09T22:03:07.035339] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T22:03:07.196694] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-09T22:03:07.376936] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T22:03:07.996796] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-09T22:03:08.377845] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-09T22:03:08.560197] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T22:03:08.796722] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-09T22:03:09.280663] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T22:03:09.596816] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-09T22:03:10.396719] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-09T22:03:10.471300] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T22:03:10.906899] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T22:03:11.196755] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-09T22:03:11.996723] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-09T22:03:12.497890] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T22:03:12.796686] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-09T22:03:13.232686] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T22:03:13.596712] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-09T22:03:13.944243] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T22:03:13.947605] [INFO ] [REMOTE ] TWI: Full fetch complete (52421 records). [2025-10-09T22:03:13.947751] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-09T22:03:14.334623] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-09T22:03:14.334729] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-09T22:03:14.335671] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-09T22:03:14.335733] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-09T22:03:14.336805] [DEBUG] [LOCAL ] TWI: Trimmed 52421 records to 34326 (keeping 200 days of data) [2025-10-09T22:03:14.421366] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-09T22:03:14.544408] [DEBUG] [LOCAL ] TWI: Primary data saved (34326 records). [2025-10-09T22:03:14.544581] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-09T22:03:14.544719] [INFO ] [MAIN ] Update Progress: 2154/2373 symbols completed. TWI took 24.9s. Estimated remaining: 30m 50s. Rate: 7.1 symbols/min [2025-10-09T22:03:14.718070] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:14.765811] [DEBUG] [LOCAL ] TWO: Loaded 48554 existing records from primary storage. [2025-10-09T22:03:14.766152] [INFO ] [MAIN ] TWO: Loaded 48554 existing records. [2025-10-09T22:03:14.919968] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T22:03:14.951835] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:03:14.952872] [INFO ] [REMOTE ] TVC: Full fetch complete (5386 records). [2025-10-09T22:03:14.953088] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-09T22:03:14.984832] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-09T22:03:15.019083] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-09T22:03:15.030383] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-09T22:03:15.035579] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-09T22:03:15.197778] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-09T22:03:15.654851] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-09T22:03:15.674011] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-09T22:03:15.710739] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:15.679891] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-09T22:03:15.710958] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-09T22:03:15.711952] [DEBUG] [LOCAL ] TVC: Trimmed 5386 records to 3335 (keeping 200 days of data) [2025-10-09T22:03:15.733289] [DEBUG] [LOCAL ] TVC: Primary data saved (3335 records). [2025-10-09T22:03:15.733361] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-09T22:03:15.733434] [INFO ] [MAIN ] Update Progress: 2155/2373 symbols completed. TVC took 41.6s. Estimated remaining: 30m 40s. Rate: 7.1 symbols/min [2025-10-09T22:03:15.879199] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-09T22:03:15.963012] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:15.963249] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-09T22:03:15.963300] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-09T22:03:15.963414] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-09T22:03:15.963455] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-09T22:03:15.963497] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-09T22:03:15.963530] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-09T22:03:16.001900] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-09T22:03:16.070713] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T22:03:16.379718] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:16.796768] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-09T22:03:17.028814] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T22:03:17.029147] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-09T22:03:17.029257] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:03:17.029349] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-09T22:03:17.029431] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:03:17.029519] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-09T22:03:17.029594] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-09T22:03:17.029633] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-09T22:03:17.029745] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-09T22:03:17.029823] [INFO ] [MAIN ] Update Progress: 2156/2373 symbols completed. TWOD took 1.3s. Estimated remaining: 30m 31s. Rate: 7.1 symbols/min [2025-10-09T22:03:17.202135] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:17.225597] [DEBUG] [LOCAL ] TX: Loaded 23363 existing records from primary storage. [2025-10-09T22:03:17.226075] [INFO ] [MAIN ] TX: Loaded 23363 existing records. [2025-10-09T22:03:17.446494] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:03:17.446747] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-09T22:03:17.446804] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-09T22:03:17.447033] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-09T22:03:17.447091] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-09T22:03:17.607734] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-09T22:03:17.850253] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:17.877215] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T22:03:18.254055] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T22:03:18.396748] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-09T22:03:19.196789] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-09T22:03:19.996684] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-09T22:03:20.092034] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T22:03:20.392595] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T22:03:20.610699] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T22:03:20.796688] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-09T22:03:21.596775] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-09T22:03:21.942401] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T22:03:22.077365] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T22:03:22.396775] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-09T22:03:23.196755] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-09T22:03:23.318731] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T22:03:23.996711] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-09T22:03:24.796692] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-09T22:03:24.847994] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T22:03:25.596687] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-09T22:03:25.721503] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T22:03:26.061538] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T22:03:26.396712] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-09T22:03:26.981973] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T22:03:27.076494] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T22:03:27.196703] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-09T22:03:27.996744] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-09T22:03:28.380901] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T22:03:28.743446] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T22:03:28.796675] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-09T22:03:29.596758] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-09T22:03:30.365140] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T22:03:30.396666] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-09T22:03:31.196692] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-09T22:03:31.289379] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T22:03:31.627483] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T22:03:31.996697] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-09T22:03:32.420435] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T22:03:32.428317] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T22:03:32.796712] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-09T22:03:33.249213] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T22:03:33.250721] [INFO ] [REMOTE ] TWN: Full fetch complete (5349 records). [2025-10-09T22:03:33.250802] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-09T22:03:33.602012] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-09T22:03:33.724025] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-09T22:03:33.724153] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-09T22:03:33.724487] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-09T22:03:33.724567] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-09T22:03:33.725497] [DEBUG] [LOCAL ] TWN: Trimmed 5349 records to 3208 (keeping 200 days of data) [2025-10-09T22:03:33.759112] [DEBUG] [LOCAL ] TWN: Primary data saved (3208 records). [2025-10-09T22:03:33.759316] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-09T22:03:33.759449] [INFO ] [MAIN ] Update Progress: 2157/2373 symbols completed. TWN took 29.5s. Estimated remaining: 30m 24s. Rate: 7.1 symbols/min [2025-10-09T22:03:34.396740] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-09T22:03:35.196728] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-09T22:03:35.390945] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T22:03:35.996743] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-09T22:03:36.153913] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T22:03:36.293130] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T22:03:36.796745] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-09T22:03:37.596727] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-09T22:03:37.670275] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T22:03:38.396699] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-09T22:03:38.696845] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T22:03:38.733414] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T22:03:39.196764] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-09T22:03:39.996692] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-09T22:03:40.185243] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T22:03:40.671104] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T22:03:40.796682] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-09T22:03:41.084482] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T22:03:41.596748] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-09T22:03:42.396772] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-09T22:03:42.656800] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T22:03:42.909092] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T22:03:43.196779] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-09T22:03:43.824551] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T22:03:43.996694] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-09T22:03:44.224446] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T22:03:44.227132] [INFO ] [REMOTE ] TX: Full fetch complete (35739 records). [2025-10-09T22:03:44.227219] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-09T22:03:44.615455] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-09T22:03:44.615542] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-09T22:03:44.616411] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-09T22:03:44.616477] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-09T22:03:44.617387] [DEBUG] [LOCAL ] TX: Trimmed 35739 records to 23510 (keeping 200 days of data) [2025-10-09T22:03:44.765070] [DEBUG] [LOCAL ] TX: Primary data saved (23510 records). [2025-10-09T22:03:44.765229] [INFO ] [MAIN ] TX: Full history saved. [2025-10-09T22:03:44.765344] [INFO ] [MAIN ] Update Progress: 2158/2373 symbols completed. TX took 27.7s. Estimated remaining: 30m 15s. Rate: 7.1 symbols/min [2025-10-09T22:03:44.796688] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-09T22:03:45.771235] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T22:03:45.775859] [INFO ] [REMOTE ] TWO: Full fetch complete (69123 records). [2025-10-09T22:03:45.775975] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-09T22:03:46.239280] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-09T22:03:46.239414] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-09T22:03:46.240761] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-09T22:03:46.240853] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-09T22:03:46.242570] [DEBUG] [LOCAL ] TWO: Trimmed 69123 records to 48896 (keeping 200 days of data) [2025-10-09T22:03:46.555773] [DEBUG] [LOCAL ] TWO: Primary data saved (48896 records). [2025-10-09T22:03:46.555908] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-09T22:03:46.555990] [INFO ] [MAIN ] Update Progress: 2159/2373 symbols completed. TWO took 32.0s. Estimated remaining: 30m 6s. Rate: 7.1 symbols/min [2025-10-09T22:03:46.603142] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T22:03:46.614704] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-09T22:03:48.397071] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T22:03:48.401903] [INFO ] [REMOTE ] TWLO: Full fetch complete (76457 records). [2025-10-09T22:03:48.402021] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-09T22:03:48.800457] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-09T22:03:48.800531] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-09T22:03:48.801695] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-09T22:03:48.801757] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-09T22:03:48.805799] [DEBUG] [LOCAL ] TWLO: Trimmed 76457 records to 53147 (keeping 200 days of data) [2025-10-09T22:03:49.131554] [DEBUG] [LOCAL ] TWLO: Primary data saved (53147 records). [2025-10-09T22:03:49.131716] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-09T22:03:49.131809] [INFO ] [MAIN ] Update Progress: 2160/2373 symbols completed. TWLO took 45.5s. Estimated remaining: 29m 57s. Rate: 7.1 symbols/min [2025-10-09T22:03:49.761944] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:49.722475] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:49.775602] [DEBUG] [LOCAL ] TXT: No existing data file found in primary storage. [2025-10-09T22:03:49.787096] [WARN ] [MAIN ] TXT: No existing data found, performing full refresh instead. [2025-10-09T22:03:49.823141] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-09T22:03:49.846626] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-09T22:03:49.847441] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:49.866465] [DEBUG] [LOCAL ] TXT: No primary data file found to delete. [2025-10-09T22:03:49.866587] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-09T22:03:49.866298] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:49.991897] [DEBUG] [LOCAL ] TXO: Loaded 19142 existing records from primary storage. [2025-10-09T22:03:49.988054] [DEBUG] [LOCAL ] TY: Loaded 7605 existing records from primary storage. [2025-10-09T22:03:50.018896] [INFO ] [MAIN ] TY: Loaded 7605 existing records. [2025-10-09T22:03:50.037789] [INFO ] [MAIN ] TXO: Loaded 19142 existing records. [2025-10-09T22:03:50.564862] [DEBUG] [LOCAL ] TXNM: Loaded 43437 existing records from primary storage. [2025-10-09T22:03:50.626454] [INFO ] [MAIN ] TXNM: Loaded 43437 existing records. [2025-10-09T22:03:50.655090] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:50.662619] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-09T22:03:50.662090] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:03:50.658906] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:03:50.668059] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-09T22:03:50.691193] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-09T22:03:50.696466] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-09T22:03:50.696572] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-09T22:03:50.726944] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-09T22:03:50.732241] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-09T22:03:50.743056] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-09T22:03:50.796953] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-09T22:03:51.118612] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:03:51.184114] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-09T22:03:51.270876] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-09T22:03:51.365817] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-09T22:03:51.381261] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-09T22:03:51.537773] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:51.575002] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-09T22:03:51.661115] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:51.671618] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-09T22:03:51.905247] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:51.905538] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-09T22:03:52.335075] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T22:03:52.338392] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-09T22:03:52.455491] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T22:03:52.465385] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-09T22:03:52.495630] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T22:03:52.498126] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-09T22:03:52.941915] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T22:03:52.945263] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-09T22:03:53.230571] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T22:03:53.232998] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-09T22:03:53.338396] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T22:03:53.596737] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-09T22:03:53.668023] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T22:03:53.684825] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T22:03:53.872148] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T22:03:54.396812] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-09T22:03:55.136179] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T22:03:55.196666] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-09T22:03:55.996687] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-09T22:03:56.033279] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T22:03:56.796712] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-09T22:03:56.820065] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T22:03:56.931256] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T22:03:57.580317] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T22:03:57.596664] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-09T22:03:58.388050] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T22:03:58.396675] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-09T22:03:58.495064] [DEBUG] [REMOTE ] TXNM: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-09T22:03:58.495352] [WARN ] [REMOTE ] TXNM: No data returned for month 2025-03 [2025-10-09T22:03:58.495446] [FATAL] [REMOTE ] TXNM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:03:58.495531] [FATAL] [MAIN ] TXNM: Failed to fetch primary data. [2025-10-09T22:03:58.495594] [WARN ] [MAIN ] TXNM: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:03:58.495693] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-09T22:03:58.495763] [DEBUG] [LOCAL ] TXNM: No primary data file found to delete. [2025-10-09T22:03:58.495799] [INFO ] [LOCAL ] TXNM: Starting deletion of derivative data. [2025-10-09T22:03:58.496057] [DEBUG] [LOCAL ] TXNM: Deleted derivative data file. [2025-10-09T22:03:58.496144] [INFO ] [MAIN ] Update Progress: 2161/2373 symbols completed. TXNM took 9.4s. Estimated remaining: 29m 49s. Rate: 7.1 symbols/min [2025-10-09T22:03:58.670196] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:03:58.684974] [DEBUG] [LOCAL ] TYG: Loaded 13922 existing records from primary storage. [2025-10-09T22:03:58.685193] [INFO ] [MAIN ] TYG: Loaded 13922 existing records. [2025-10-09T22:03:58.857732] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:03:58.857946] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-09T22:03:58.857991] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-09T22:03:58.858188] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-09T22:03:58.858244] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-09T22:03:59.202345] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-09T22:03:59.207593] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:03:59.996714] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-09T22:04:00.796737] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-09T22:04:00.842186] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T22:04:01.109545] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T22:04:01.596687] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-09T22:04:01.925088] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T22:04:02.396680] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-09T22:04:02.717197] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T22:04:02.832554] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T22:04:03.196765] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-09T22:04:03.996806] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-09T22:04:04.064668] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T22:04:04.796704] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-09T22:04:05.553950] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T22:04:05.596665] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-09T22:04:05.800501] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T22:04:06.396745] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-09T22:04:06.492282] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T22:04:07.196751] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-09T22:04:07.583211] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T22:04:07.996775] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-09T22:04:08.796745] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-09T22:04:09.075117] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T22:04:09.104933] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T22:04:09.329430] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T22:04:09.596743] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-09T22:04:10.330137] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T22:04:10.332427] [INFO ] [REMOTE ] TXO: Full fetch complete (26507 records). [2025-10-09T22:04:10.332519] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-09T22:04:10.401806] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-09T22:04:10.745326] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-09T22:04:10.745407] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-09T22:04:10.745977] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-09T22:04:10.746039] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-09T22:04:10.746721] [DEBUG] [LOCAL ] TXO: Trimmed 26507 records to 19452 (keeping 200 days of data) [2025-10-09T22:04:10.870278] [DEBUG] [LOCAL ] TXO: Primary data saved (19452 records). [2025-10-09T22:04:10.870457] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-09T22:04:10.870563] [INFO ] [MAIN ] Update Progress: 2162/2373 symbols completed. TXO took 21.7s. Estimated remaining: 29m 41s. Rate: 7.1 symbols/min [2025-10-09T22:04:11.045126] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:04:11.066602] [DEBUG] [LOCAL ] TYL: Loaded 22342 existing records from primary storage. [2025-10-09T22:04:11.066910] [INFO ] [MAIN ] TYL: Loaded 22342 existing records. [2025-10-09T22:04:11.172765] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T22:04:11.196599] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-09T22:04:11.254582] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:04:11.254779] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-09T22:04:11.254826] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-09T22:04:11.255041] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-09T22:04:11.255098] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-09T22:04:11.606911] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:04:11.996693] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-09T22:04:12.089847] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T22:04:12.796730] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-09T22:04:12.958508] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T22:04:13.596687] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-09T22:04:13.763095] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T22:04:14.396700] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-09T22:04:14.403986] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T22:04:15.072406] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T22:04:15.196725] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-09T22:04:15.996703] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-09T22:04:16.333556] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T22:04:16.536860] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T22:04:16.538002] [INFO ] [REMOTE ] TY: Full fetch complete (11590 records). [2025-10-09T22:04:16.538072] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-09T22:04:16.801982] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-09T22:04:16.893435] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-09T22:04:16.893503] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-09T22:04:16.893783] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-09T22:04:16.893843] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-09T22:04:16.894262] [DEBUG] [LOCAL ] TY: Trimmed 11590 records to 7663 (keeping 200 days of data) [2025-10-09T22:04:16.942603] [DEBUG] [LOCAL ] TY: Primary data saved (7663 records). [2025-10-09T22:04:16.942738] [INFO ] [MAIN ] TY: Full history saved. [2025-10-09T22:04:16.942824] [INFO ] [MAIN ] Update Progress: 2163/2373 symbols completed. TY took 27.8s. Estimated remaining: 29m 32s. Rate: 7.1 symbols/min [2025-10-09T22:04:17.109527] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:04:17.169505] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-09T22:04:17.169891] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-09T22:04:17.348117] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:04:17.348506] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-09T22:04:17.348553] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-09T22:04:17.348820] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-09T22:04:17.348876] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-09T22:04:17.601970] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-09T22:04:17.707194] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:04:18.396750] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-09T22:04:18.545426] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T22:04:18.866804] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T22:04:19.196698] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-09T22:04:19.427745] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T22:04:19.996807] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-09T22:04:20.498536] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T22:04:20.796769] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-09T22:04:21.596804] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-09T22:04:21.777571] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T22:04:22.396722] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-09T22:04:22.502847] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T22:04:22.581517] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-09T22:04:23.196705] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-09T22:04:23.326753] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T22:04:23.982876] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T22:04:23.996674] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-09T22:04:24.796742] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-09T22:04:25.208254] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T22:04:25.596697] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-09T22:04:25.634920] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T22:04:26.396822] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-09T22:04:27.196773] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-09T22:04:27.539762] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T22:04:27.718864] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-09T22:04:27.996726] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-09T22:04:28.796729] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-09T22:04:29.112791] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T22:04:29.596722] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-09T22:04:29.627721] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T22:04:30.310620] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-09T22:04:30.396684] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-09T22:04:30.958919] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T22:04:31.196720] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-09T22:04:31.996713] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-09T22:04:32.430609] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T22:04:32.652250] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T22:04:32.756407] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T22:04:32.796739] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-09T22:04:33.104110] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-09T22:04:33.108772] [INFO ] [REMOTE ] TXT: Full fetch complete (72246 records). [2025-10-09T22:04:33.108917] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-09T22:04:33.509368] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-09T22:04:33.509455] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-09T22:04:33.510528] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-09T22:04:33.510593] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-09T22:04:33.512008] [DEBUG] [LOCAL ] TXT: Trimmed 72246 records to 50058 (keeping 200 days of data) [2025-10-09T22:04:33.604019] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-09T22:04:33.836712] [DEBUG] [LOCAL ] TXT: Primary data saved (50058 records). [2025-10-09T22:04:33.836852] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-09T22:04:33.836928] [INFO ] [MAIN ] Update Progress: 2164/2373 symbols completed. TXT took 44.7s. Estimated remaining: 29m 25s. Rate: 7.1 symbols/min [2025-10-09T22:04:34.020137] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:04:34.066252] [DEBUG] [LOCAL ] UA: Loaded 50445 existing records from primary storage. [2025-10-09T22:04:34.066584] [INFO ] [MAIN ] UA: Loaded 50445 existing records. [2025-10-09T22:04:34.249522] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:04:34.249776] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-09T22:04:34.249841] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-09T22:04:34.250066] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-09T22:04:34.250125] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-09T22:04:34.425010] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-09T22:04:34.615016] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:04:35.196690] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-09T22:04:35.498015] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T22:04:35.652394] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T22:04:35.655758] [INFO ] [REMOTE ] TYL: Full fetch complete (31454 records). [2025-10-09T22:04:35.655951] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-09T22:04:36.020061] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-09T22:04:36.062312] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-09T22:04:36.062399] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-09T22:04:36.063165] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-09T22:04:36.063229] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-09T22:04:36.064091] [DEBUG] [LOCAL ] TYL: Trimmed 31454 records to 22514 (keeping 200 days of data) [2025-10-09T22:04:36.188142] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-09T22:04:36.250019] [DEBUG] [LOCAL ] TYL: Primary data saved (22514 records). [2025-10-09T22:04:36.250164] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-09T22:04:36.250300] [INFO ] [MAIN ] Update Progress: 2165/2373 symbols completed. TYL took 25.4s. Estimated remaining: 29m 16s. Rate: 7.1 symbols/min [2025-10-09T22:04:36.451058] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:04:36.500498] [DEBUG] [LOCAL ] UAA: Loaded 53508 existing records from primary storage. [2025-10-09T22:04:36.500858] [INFO ] [MAIN ] UAA: Loaded 53508 existing records. [2025-10-09T22:04:36.691538] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:04:36.691771] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-09T22:04:36.691824] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-09T22:04:36.692030] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-09T22:04:36.692087] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-09T22:04:36.799429] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-09T22:04:36.874125] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T22:04:37.080623] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:04:37.596723] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-09T22:04:38.319278] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T22:04:38.320922] [INFO ] [REMOTE ] TYG: Full fetch complete (22421 records). [2025-10-09T22:04:38.321011] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-09T22:04:38.396690] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-09T22:04:38.717347] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-09T22:04:38.717509] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-09T22:04:38.718249] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-09T22:04:38.718395] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-09T22:04:38.751599] [DEBUG] [LOCAL ] TYG: Trimmed 22421 records to 13993 (keeping 200 days of data) [2025-10-09T22:04:38.754852] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T22:04:38.858187] [DEBUG] [LOCAL ] TYG: Primary data saved (13993 records). [2025-10-09T22:04:38.858349] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-09T22:04:38.858461] [INFO ] [MAIN ] Update Progress: 2166/2373 symbols completed. TYG took 40.4s. Estimated remaining: 29m 7s. Rate: 7.1 symbols/min [2025-10-09T22:04:39.029951] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:04:39.037950] [DEBUG] [LOCAL ] UAN: Loaded 5432 existing records from primary storage. [2025-10-09T22:04:39.038155] [INFO ] [MAIN ] UAN: Loaded 5432 existing records. [2025-10-09T22:04:39.203476] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-09T22:04:39.226268] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:04:39.226584] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-09T22:04:39.226635] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-09T22:04:39.226879] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-09T22:04:39.226936] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-09T22:04:39.589107] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:04:39.996698] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-09T22:04:40.221591] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T22:04:40.796694] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-09T22:04:40.823221] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T22:04:41.068579] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T22:04:41.596692] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-09T22:04:42.329827] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T22:04:42.396730] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-09T22:04:42.842328] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T22:04:43.196697] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-09T22:04:43.268976] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-09T22:04:43.882398] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T22:04:43.996749] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-09T22:04:44.520522] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T22:04:44.796727] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-09T22:04:45.553597] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T22:04:45.596671] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-09T22:04:46.273526] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T22:04:46.396728] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-09T22:04:47.196746] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-09T22:04:47.787679] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T22:04:47.932007] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T22:04:47.996712] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-09T22:04:48.796747] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-09T22:04:49.596783] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-09T22:04:49.727776] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T22:04:50.227636] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T22:04:50.396731] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-09T22:04:50.855750] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-09T22:04:51.196726] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-09T22:04:51.996760] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-09T22:04:52.304510] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T22:04:52.806534] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-09T22:04:52.830470] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T22:04:53.596807] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-09T22:04:54.301160] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-09T22:04:54.396764] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-09T22:04:54.586931] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T22:04:54.975214] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T22:04:55.196758] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-09T22:04:55.996737] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-09T22:04:56.518487] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T22:04:56.620146] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T22:04:56.796709] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-09T22:04:56.954955] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T22:04:57.596796] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-09T22:04:58.101626] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T22:04:58.102597] [INFO ] [REMOTE ] UAN: Full fetch complete (8050 records). [2025-10-09T22:04:58.102698] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-09T22:04:58.398278] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-09T22:04:58.487451] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-09T22:04:58.487678] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-09T22:04:58.488063] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-09T22:04:58.488173] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-09T22:04:58.488985] [DEBUG] [LOCAL ] UAN: Trimmed 8050 records to 5459 (keeping 200 days of data) [2025-10-09T22:04:58.546942] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T22:04:58.567687] [DEBUG] [LOCAL ] UAN: Primary data saved (5459 records). [2025-10-09T22:04:58.567824] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-09T22:04:58.567908] [INFO ] [MAIN ] Update Progress: 2167/2373 symbols completed. UAN took 19.7s. Estimated remaining: 28m 59s. Rate: 7.1 symbols/min [2025-10-09T22:04:58.747309] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:04:58.803263] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-09T22:04:58.803621] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-09T22:04:58.983076] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:04:58.983322] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-09T22:04:58.983371] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-09T22:04:58.983607] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-09T22:04:58.983698] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-09T22:04:59.201893] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-09T22:04:59.362898] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:04:59.996777] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-09T22:05:00.796723] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-09T22:05:00.967709] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-09T22:05:01.354914] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-09T22:05:01.596744] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-09T22:05:01.781724] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T22:05:02.396778] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-09T22:05:03.196796] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-09T22:05:03.437743] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-09T22:05:03.889908] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-09T22:05:03.895456] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-09T22:05:03.895625] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-09T22:05:04.003214] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-09T22:05:04.269818] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T22:05:04.367829] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-09T22:05:04.367911] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-09T22:05:04.369035] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-09T22:05:04.369102] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-09T22:05:04.370811] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 54189 (keeping 200 days of data) [2025-10-09T22:05:04.707824] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T22:05:04.741260] [DEBUG] [LOCAL ] U: Primary data saved (54189 records). [2025-10-09T22:05:04.741405] [INFO ] [MAIN ] U: Full history saved. [2025-10-09T22:05:04.741505] [INFO ] [MAIN ] Update Progress: 2168/2373 symbols completed. U took 47.8s. Estimated remaining: 28m 51s. Rate: 7.1 symbols/min [2025-10-09T22:05:04.803742] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-09T22:05:04.910827] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:05:04.959996] [DEBUG] [LOCAL ] UBS: Loaded 52336 existing records from primary storage. [2025-10-09T22:05:04.960327] [INFO ] [MAIN ] UBS: Loaded 52336 existing records. [2025-10-09T22:05:05.134047] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:05:05.134302] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-09T22:05:05.134350] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-09T22:05:05.134597] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-09T22:05:05.134692] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-09T22:05:05.500196] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:05:05.596672] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-09T22:05:06.396743] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-09T22:05:06.519292] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T22:05:06.682937] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-09T22:05:07.196703] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-09T22:05:07.433914] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T22:05:07.986510] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T22:05:07.996928] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-09T22:05:08.796702] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-09T22:05:09.596737] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-09T22:05:09.687249] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-09T22:05:09.863509] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T22:05:10.396714] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-09T22:05:10.580287] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T22:05:11.196682] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-09T22:05:11.271407] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T22:05:11.275718] [INFO ] [REMOTE ] UA: Full fetch complete (72945 records). [2025-10-09T22:05:11.275823] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-09T22:05:11.664769] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-09T22:05:11.664849] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-09T22:05:11.665929] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-09T22:05:11.665991] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-09T22:05:11.667299] [DEBUG] [LOCAL ] UA: Trimmed 72945 records to 50807 (keeping 200 days of data) [2025-10-09T22:05:11.966305] [DEBUG] [LOCAL ] UA: Primary data saved (50807 records). [2025-10-09T22:05:11.966440] [INFO ] [MAIN ] UA: Full history saved. [2025-10-09T22:05:11.966523] [INFO ] [MAIN ] Update Progress: 2169/2373 symbols completed. UA took 38.1s. Estimated remaining: 28m 42s. Rate: 7.1 symbols/min [2025-10-09T22:05:12.009928] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-09T22:05:12.140676] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:05:12.177223] [DEBUG] [LOCAL ] UCB: Loaded 37776 existing records from primary storage. [2025-10-09T22:05:12.177579] [INFO ] [MAIN ] UCB: Loaded 37776 existing records. [2025-10-09T22:05:12.354193] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:05:12.354414] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-09T22:05:12.354465] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-09T22:05:12.354750] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-09T22:05:12.354825] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-09T22:05:12.749908] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:05:12.796679] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-09T22:05:12.865114] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-09T22:05:12.950243] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T22:05:13.596736] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-09T22:05:13.894981] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-09T22:05:14.235139] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T22:05:14.396691] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-09T22:05:15.196757] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-09T22:05:15.618959] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-09T22:05:15.877168] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T22:05:15.996719] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-09T22:05:16.796736] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-09T22:05:17.295540] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T22:05:17.596684] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-09T22:05:17.770298] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-09T22:05:18.396817] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-09T22:05:18.580241] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T22:05:18.586455] [INFO ] [REMOTE ] UAA: Full fetch complete (77485 records). [2025-10-09T22:05:18.586823] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-09T22:05:19.144426] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-09T22:05:19.144838] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-09T22:05:19.148407] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T22:05:19.146771] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-09T22:05:19.157187] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-09T22:05:19.160036] [DEBUG] [LOCAL ] UAA: Trimmed 77485 records to 53898 (keeping 200 days of data) [2025-10-09T22:05:19.209226] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-09T22:05:19.493855] [DEBUG] [LOCAL ] UAA: Primary data saved (53898 records). [2025-10-09T22:05:19.494011] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-09T22:05:19.494096] [INFO ] [MAIN ] Update Progress: 2170/2373 symbols completed. UAA took 43.2s. Estimated remaining: 28m 33s. Rate: 7.1 symbols/min [2025-10-09T22:05:19.663623] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:05:19.712263] [DEBUG] [LOCAL ] UDR: Loaded 51890 existing records from primary storage. [2025-10-09T22:05:19.712671] [INFO ] [MAIN ] UDR: Loaded 51890 existing records. [2025-10-09T22:05:19.892373] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:05:19.892615] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-09T22:05:19.892714] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-09T22:05:19.892962] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-09T22:05:19.893042] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-09T22:05:20.001795] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-09T22:05:20.259413] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:05:20.344537] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T22:05:20.796710] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-09T22:05:20.864005] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T22:05:21.596718] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-09T22:05:22.409848] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-09T22:05:22.416544] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-09T22:05:22.796727] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T22:05:23.196690] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-09T22:05:23.259452] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T22:05:23.436324] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T22:05:23.996714] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-09T22:05:24.796785] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-09T22:05:25.043759] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T22:05:25.288734] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T22:05:25.596737] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-09T22:05:26.396734] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-09T22:05:26.906364] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-09T22:05:27.196758] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-09T22:05:27.270860] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T22:05:28.002963] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-09T22:05:28.028055] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T22:05:28.796758] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-09T22:05:29.253849] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T22:05:29.350128] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-09T22:05:29.596716] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-09T22:05:30.257275] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T22:05:30.396665] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-09T22:05:31.196732] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-09T22:05:31.871925] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-09T22:05:31.996668] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-09T22:05:32.293938] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T22:05:32.327109] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T22:05:32.796691] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-09T22:05:33.596707] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-09T22:05:34.309352] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T22:05:34.396670] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-09T22:05:34.463284] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-09T22:05:34.995187] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T22:05:35.196773] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-09T22:05:35.797523] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T22:05:35.996727] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-09T22:05:36.588694] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T22:05:36.796677] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-09T22:05:37.181534] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T22:05:37.184925] [INFO ] [REMOTE ] UCB: Full fetch complete (54686 records). [2025-10-09T22:05:37.185017] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-09T22:05:37.566368] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-09T22:05:37.566471] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-09T22:05:37.567420] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-09T22:05:37.567484] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-09T22:05:37.568622] [DEBUG] [LOCAL ] UCB: Trimmed 54686 records to 38026 (keeping 200 days of data) [2025-10-09T22:05:37.621569] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-09T22:05:37.800137] [DEBUG] [LOCAL ] UCB: Primary data saved (38026 records). [2025-10-09T22:05:37.800277] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-09T22:05:37.800386] [INFO ] [MAIN ] Update Progress: 2171/2373 symbols completed. UCB took 25.8s. Estimated remaining: 28m 26s. Rate: 7.1 symbols/min [2025-10-09T22:05:37.968252] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:05:38.010242] [DEBUG] [LOCAL ] UE: Loaded 42577 existing records from primary storage. [2025-10-09T22:05:38.010531] [INFO ] [MAIN ] UE: Loaded 42577 existing records. [2025-10-09T22:05:38.190218] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:05:38.190565] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-09T22:05:38.190799] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-09T22:05:38.191216] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-09T22:05:38.191372] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-09T22:05:38.323584] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T22:05:38.414726] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-09T22:05:38.414534] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-09T22:05:38.429926] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-09T22:05:38.773107] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:05:38.961031] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-09T22:05:39.034165] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-09T22:05:39.034239] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-09T22:05:39.035318] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-09T22:05:39.035381] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-09T22:05:39.036804] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 54196 (keeping 200 days of data) [2025-10-09T22:05:39.213046] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-09T22:05:39.371779] [DEBUG] [LOCAL ] UBER: Primary data saved (54196 records). [2025-10-09T22:05:39.371909] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-09T22:05:39.371991] [INFO ] [MAIN ] Update Progress: 2172/2373 symbols completed. UBER took 40.8s. Estimated remaining: 28m 17s. Rate: 7.1 symbols/min [2025-10-09T22:05:39.537955] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:05:39.547897] [DEBUG] [LOCAL ] UFI: Loaded 8134 existing records from primary storage. [2025-10-09T22:05:39.548131] [INFO ] [MAIN ] UFI: Loaded 8134 existing records. [2025-10-09T22:05:39.720571] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:05:39.720770] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-09T22:05:39.720817] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-09T22:05:39.720971] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-09T22:05:39.721027] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-09T22:05:40.001828] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-09T22:05:40.076587] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:05:40.389464] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T22:05:40.796770] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-09T22:05:41.032024] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T22:05:41.492053] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T22:05:41.532304] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T22:05:41.596707] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-09T22:05:42.396774] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-09T22:05:43.073248] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T22:05:43.146137] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T22:05:43.196676] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-09T22:05:43.996770] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-09T22:05:44.633329] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T22:05:44.741762] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T22:05:44.796674] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-09T22:05:45.373246] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T22:05:45.378169] [INFO ] [REMOTE ] UDR: Full fetch complete (74704 records). [2025-10-09T22:05:45.378323] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-09T22:05:45.597744] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-09T22:05:45.851935] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-09T22:05:45.852029] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-09T22:05:45.853261] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-09T22:05:45.853346] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-09T22:05:45.854897] [DEBUG] [LOCAL ] UDR: Trimmed 74704 records to 52279 (keeping 200 days of data) [2025-10-09T22:05:46.183973] [DEBUG] [LOCAL ] UDR: Primary data saved (52279 records). [2025-10-09T22:05:46.184112] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-09T22:05:46.184200] [INFO ] [MAIN ] Update Progress: 2173/2373 symbols completed. UDR took 26.7s. Estimated remaining: 28m 8s. Rate: 7.1 symbols/min [2025-10-09T22:05:46.361464] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:05:46.407592] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-09T22:05:46.410984] [DEBUG] [LOCAL ] UGI: Loaded 50564 existing records from primary storage. [2025-10-09T22:05:46.411385] [INFO ] [MAIN ] UGI: Loaded 50564 existing records. [2025-10-09T22:05:46.592959] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:05:46.593219] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-09T22:05:46.593294] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-09T22:05:46.593491] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-09T22:05:46.593532] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-09T22:05:46.961859] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:05:47.024491] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T22:05:47.178731] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T22:05:47.196662] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-09T22:05:47.996698] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-09T22:05:48.796753] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-09T22:05:48.877298] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T22:05:49.344676] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T22:05:49.596743] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-09T22:05:50.396692] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-09T22:05:50.682480] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T22:05:51.141010] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T22:05:51.196669] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-09T22:05:51.871195] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T22:05:51.996676] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-09T22:05:52.801895] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-09T22:05:52.814267] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T22:05:53.596693] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-09T22:05:53.686107] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T22:05:53.755520] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T22:05:54.396778] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-09T22:05:55.196739] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-09T22:05:55.256571] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T22:05:55.379698] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T22:05:55.996757] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-09T22:05:56.748413] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T22:05:56.796746] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-09T22:05:56.876189] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T22:05:57.528180] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T22:05:57.596730] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-09T22:05:58.396733] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-09T22:05:59.196749] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-09T22:05:59.275496] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T22:05:59.893478] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T22:05:59.996697] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-09T22:06:00.271441] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T22:06:00.796709] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-09T22:06:01.437009] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T22:06:01.443037] [INFO ] [REMOTE ] UBS: Full fetch complete (75731 records). [2025-10-09T22:06:01.443235] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-09T22:06:01.566164] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T22:06:01.609174] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-09T22:06:01.872630] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-09T22:06:01.872762] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-09T22:06:01.873919] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-09T22:06:01.873992] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-09T22:06:01.875572] [DEBUG] [LOCAL ] UBS: Trimmed 75731 records to 52720 (keeping 200 days of data) [2025-10-09T22:06:02.204821] [DEBUG] [LOCAL ] UBS: Primary data saved (52720 records). [2025-10-09T22:06:02.205271] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-09T22:06:02.205394] [INFO ] [MAIN ] Update Progress: 2174/2373 symbols completed. UBS took 57.5s. Estimated remaining: 28m 0s. Rate: 7.1 symbols/min [2025-10-09T22:06:02.374444] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:06:02.397165] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-09T22:06:02.415349] [DEBUG] [LOCAL ] UGP: Loaded 42933 existing records from primary storage. [2025-10-09T22:06:02.415687] [INFO ] [MAIN ] UGP: Loaded 42933 existing records. [2025-10-09T22:06:02.597781] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:06:02.598042] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-09T22:06:02.598089] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-09T22:06:02.598685] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-09T22:06:02.598744] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-09T22:06:02.964935] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:06:03.159182] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T22:06:03.196669] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-09T22:06:03.412204] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T22:06:03.996785] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-09T22:06:04.024971] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T22:06:04.026605] [INFO ] [REMOTE ] UFI: Full fetch complete (12422 records). [2025-10-09T22:06:04.026705] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-09T22:06:04.384360] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-09T22:06:04.384442] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-09T22:06:04.384768] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-09T22:06:04.384856] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-09T22:06:04.385308] [DEBUG] [LOCAL ] UFI: Trimmed 12422 records to 8205 (keeping 200 days of data) [2025-10-09T22:06:04.430718] [DEBUG] [LOCAL ] UFI: Primary data saved (8205 records). [2025-10-09T22:06:04.430825] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-09T22:06:04.430908] [INFO ] [MAIN ] Update Progress: 2175/2373 symbols completed. UFI took 25.1s. Estimated remaining: 27m 51s. Rate: 7.1 symbols/min [2025-10-09T22:06:04.596261] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:06:04.613742] [DEBUG] [LOCAL ] UHAL: Loaded 16732 existing records from primary storage. [2025-10-09T22:06:04.614000] [INFO ] [MAIN ] UHAL: Loaded 16732 existing records. [2025-10-09T22:06:04.790802] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:06:04.791083] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-09T22:06:04.791147] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-09T22:06:04.791360] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-09T22:06:04.791419] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-09T22:06:04.802344] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-09T22:06:05.144054] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:06:05.290504] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T22:06:05.596743] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-09T22:06:06.396758] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-09T22:06:06.515283] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T22:06:07.196693] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-09T22:06:07.299589] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T22:06:07.438637] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T22:06:07.996724] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-09T22:06:08.801436] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-09T22:06:08.806844] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T22:06:08.895867] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T22:06:08.900978] [INFO ] [REMOTE ] UE: Full fetch complete (61124 records). [2025-10-09T22:06:08.901166] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-09T22:06:09.297574] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-09T22:06:09.297710] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-09T22:06:09.298803] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-09T22:06:09.298867] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-09T22:06:09.300418] [DEBUG] [LOCAL ] UE: Trimmed 61124 records to 42867 (keeping 200 days of data) [2025-10-09T22:06:09.577173] [DEBUG] [LOCAL ] UE: Primary data saved (42867 records). [2025-10-09T22:06:09.577316] [INFO ] [MAIN ] UE: Full history saved. [2025-10-09T22:06:09.577417] [INFO ] [MAIN ] Update Progress: 2176/2373 symbols completed. UE took 31.8s. Estimated remaining: 27m 43s. Rate: 7.1 symbols/min [2025-10-09T22:06:09.607953] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-09T22:06:09.753703] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:06:09.773103] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T22:06:09.806099] [DEBUG] [LOCAL ] UHS: Loaded 40581 existing records from primary storage. [2025-10-09T22:06:09.806410] [INFO ] [MAIN ] UHS: Loaded 40581 existing records. [2025-10-09T22:06:10.026721] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:06:10.026975] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-09T22:06:10.027025] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-09T22:06:10.027245] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-09T22:06:10.027304] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-09T22:06:10.390115] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:06:10.396670] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-09T22:06:10.846636] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T22:06:11.196729] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-09T22:06:11.997954] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-09T22:06:12.000598] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T22:06:12.018244] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T22:06:12.796723] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-09T22:06:13.596738] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-09T22:06:13.741342] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T22:06:13.900298] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T22:06:14.396724] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-09T22:06:15.196697] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-09T22:06:15.257112] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T22:06:15.956136] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T22:06:15.996712] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-09T22:06:16.176761] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T22:06:16.796739] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-09T22:06:17.595608] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T22:06:17.606233] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-09T22:06:17.841629] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T22:06:18.396728] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-09T22:06:18.961503] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T22:06:19.196725] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-09T22:06:19.996755] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-09T22:06:20.064928] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T22:06:20.796763] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-09T22:06:20.854168] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T22:06:21.596748] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-09T22:06:21.766295] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T22:06:21.766710] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T22:06:22.396751] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-09T22:06:22.848723] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T22:06:23.196742] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-09T22:06:23.996722] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-09T22:06:24.050298] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T22:06:24.156216] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T22:06:24.796707] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-09T22:06:25.533987] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T22:06:25.555557] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T22:06:25.596670] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-09T22:06:26.396734] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-09T22:06:27.196770] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-09T22:06:27.255871] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T22:06:27.381804] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T22:06:27.996723] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-09T22:06:28.785688] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T22:06:28.796680] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-09T22:06:29.038225] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T22:06:29.596721] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-09T22:06:30.401791] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-09T22:06:30.417714] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T22:06:30.503485] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T22:06:31.112969] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T22:06:31.196715] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-09T22:06:31.996724] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-09T22:06:32.475413] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T22:06:32.480384] [INFO ] [REMOTE ] UHS: Full fetch complete (58175 records). [2025-10-09T22:06:32.480531] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-09T22:06:32.798859] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-09T22:06:32.924309] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-09T22:06:32.934630] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-09T22:06:32.935853] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-09T22:06:32.935972] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-09T22:06:32.938209] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T22:06:32.949303] [DEBUG] [LOCAL ] UHS: Trimmed 58175 records to 40845 (keeping 200 days of data) [2025-10-09T22:06:33.213281] [DEBUG] [LOCAL ] UHS: Primary data saved (40845 records). [2025-10-09T22:06:33.213426] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-09T22:06:33.213512] [INFO ] [MAIN ] Update Progress: 2177/2373 symbols completed. UHS took 23.6s. Estimated remaining: 27m 36s. Rate: 7.1 symbols/min [2025-10-09T22:06:33.382602] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:06:33.394522] [DEBUG] [LOCAL ] UHT: Loaded 10003 existing records from primary storage. [2025-10-09T22:06:33.394791] [INFO ] [MAIN ] UHT: Loaded 10003 existing records. [2025-10-09T22:06:33.570394] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:06:33.570630] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-09T22:06:33.570714] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-09T22:06:33.570898] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-09T22:06:33.570956] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-09T22:06:33.601892] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-09T22:06:33.842094] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T22:06:33.871016] [INFO ] [REMOTE ] UHAL: Full fetch complete (23298 records). [2025-10-09T22:06:33.871477] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-09T22:06:34.073447] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:06:34.331498] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-09T22:06:34.331586] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-09T22:06:34.332092] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-09T22:06:34.332153] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-09T22:06:34.332764] [DEBUG] [LOCAL ] UHAL: Trimmed 23298 records to 16874 (keeping 200 days of data) [2025-10-09T22:06:34.405789] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-09T22:06:34.438837] [DEBUG] [LOCAL ] UHAL: Primary data saved (16874 records). [2025-10-09T22:06:34.439008] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-09T22:06:34.439100] [INFO ] [MAIN ] Update Progress: 2178/2373 symbols completed. UHAL took 30.0s. Estimated remaining: 27m 27s. Rate: 7.1 symbols/min [2025-10-09T22:06:34.605848] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:06:34.620845] [DEBUG] [LOCAL ] UI: Loaded 13339 existing records from primary storage. [2025-10-09T22:06:34.621070] [INFO ] [MAIN ] UI: Loaded 13339 existing records. [2025-10-09T22:06:34.794419] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:06:34.794598] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-09T22:06:34.794666] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-09T22:06:34.794865] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-09T22:06:34.794921] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-09T22:06:35.153557] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:06:35.177625] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T22:06:35.181929] [INFO ] [REMOTE ] UGI: Full fetch complete (73298 records). [2025-10-09T22:06:35.182028] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-09T22:06:35.202631] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-09T22:06:35.511097] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T22:06:35.604217] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-09T22:06:35.604302] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-09T22:06:35.605384] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-09T22:06:35.605452] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-09T22:06:35.606918] [DEBUG] [LOCAL ] UGI: Trimmed 73298 records to 50938 (keeping 200 days of data) [2025-10-09T22:06:35.910587] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T22:06:35.932058] [DEBUG] [LOCAL ] UGI: Primary data saved (50938 records). [2025-10-09T22:06:35.932148] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-09T22:06:35.932225] [INFO ] [MAIN ] Update Progress: 2179/2373 symbols completed. UGI took 49.7s. Estimated remaining: 27m 18s. Rate: 7.1 symbols/min [2025-10-09T22:06:36.001782] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-09T22:06:36.105748] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:06:36.139337] [DEBUG] [LOCAL ] UIS: Loaded 36941 existing records from primary storage. [2025-10-09T22:06:36.139608] [INFO ] [MAIN ] UIS: Loaded 36941 existing records. [2025-10-09T22:06:36.314772] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:06:36.314978] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-09T22:06:36.315077] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-09T22:06:36.315300] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-09T22:06:36.315356] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-09T22:06:36.672538] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:06:36.796684] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-09T22:06:36.961571] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T22:06:37.596765] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-09T22:06:38.182432] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T22:06:38.182214] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T22:06:38.396700] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-09T22:06:39.196723] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-09T22:06:39.331786] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T22:06:39.996705] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-09T22:06:40.092905] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T22:06:40.590977] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T22:06:40.796737] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-09T22:06:41.596742] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-09T22:06:42.190781] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T22:06:42.381045] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T22:06:42.396718] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-09T22:06:43.196727] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-09T22:06:43.969408] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T22:06:44.001217] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-09T22:06:44.006068] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T22:06:44.769447] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T22:06:44.796679] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-09T22:06:45.596717] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-09T22:06:46.180873] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T22:06:46.186571] [INFO ] [REMOTE ] UGP: Full fetch complete (62157 records). [2025-10-09T22:06:46.186758] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-09T22:06:46.403472] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-09T22:06:46.512768] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T22:06:46.593295] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-09T22:06:46.593382] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-09T22:06:46.594393] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-09T22:06:46.594464] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-09T22:06:46.595866] [DEBUG] [LOCAL ] UGP: Trimmed 62157 records to 43221 (keeping 200 days of data) [2025-10-09T22:06:46.855474] [DEBUG] [LOCAL ] UGP: Primary data saved (43221 records). [2025-10-09T22:06:46.855663] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-09T22:06:46.855845] [INFO ] [MAIN ] Update Progress: 2180/2373 symbols completed. UGP took 44.7s. Estimated remaining: 27m 9s. Rate: 7.1 symbols/min [2025-10-09T22:06:47.023164] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:06:47.073629] [DEBUG] [LOCAL ] UL: Loaded 53068 existing records from primary storage. [2025-10-09T22:06:47.073999] [INFO ] [MAIN ] UL: Loaded 53068 existing records. [2025-10-09T22:06:47.211589] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-09T22:06:47.253194] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:06:47.253421] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-09T22:06:47.253467] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-09T22:06:47.253706] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-09T22:06:47.253764] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-09T22:06:47.610493] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:06:47.920815] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T22:06:47.996670] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-09T22:06:48.107631] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T22:06:48.796868] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-09T22:06:49.026185] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T22:06:49.596780] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-09T22:06:50.396745] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-09T22:06:50.546305] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T22:06:50.664713] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T22:06:51.075464] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T22:06:51.196724] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-09T22:06:51.859905] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T22:06:51.996742] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-09T22:06:52.655294] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-09T22:06:52.796755] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-09T22:06:53.596750] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-09T22:06:54.219700] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T22:06:54.396683] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-09T22:06:54.434720] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T22:06:55.196731] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-09T22:06:55.713422] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T22:06:55.996732] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-09T22:06:56.796759] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-09T22:06:56.818486] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T22:06:57.031609] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-09T22:06:57.388909] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T22:06:57.390384] [INFO ] [REMOTE ] UHT: Full fetch complete (14984 records). [2025-10-09T22:06:57.390465] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-09T22:06:57.601806] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-09T22:06:57.751334] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-09T22:06:57.751412] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-09T22:06:57.751762] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-09T22:06:57.751855] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-09T22:06:57.752370] [DEBUG] [LOCAL ] UHT: Trimmed 14984 records to 10086 (keeping 200 days of data) [2025-10-09T22:06:57.817706] [DEBUG] [LOCAL ] UHT: Primary data saved (10086 records). [2025-10-09T22:06:57.817863] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-09T22:06:57.818018] [INFO ] [MAIN ] Update Progress: 2181/2373 symbols completed. UHT took 24.6s. Estimated remaining: 27m 1s. Rate: 7.1 symbols/min [2025-10-09T22:06:57.988936] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:06:58.025738] [DEBUG] [LOCAL ] ULS: Loaded 39447 existing records from primary storage. [2025-10-09T22:06:58.026056] [INFO ] [MAIN ] ULS: Loaded 39447 existing records. [2025-10-09T22:06:58.220075] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:06:58.220303] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-09T22:06:58.220356] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-09T22:06:58.220634] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-09T22:06:58.220728] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-09T22:06:58.398216] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-09T22:06:58.606058] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:06:58.707488] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T22:06:59.196773] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-09T22:06:59.996700] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-09T22:07:00.085750] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T22:07:00.105996] [DEBUG] [REMOTE ] UL: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-09T22:07:00.106255] [WARN ] [REMOTE ] UL: No data returned for month 2025-02 [2025-10-09T22:07:00.106362] [FATAL] [REMOTE ] UL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:07:00.106457] [FATAL] [MAIN ] UL: Failed to fetch primary data. [2025-10-09T22:07:00.106526] [WARN ] [MAIN ] UL: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:07:00.106596] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-09T22:07:00.106687] [DEBUG] [LOCAL ] UL: No primary data file found to delete. [2025-10-09T22:07:00.106758] [INFO ] [LOCAL ] UL: Starting deletion of derivative data. [2025-10-09T22:07:00.107012] [DEBUG] [LOCAL ] UL: Deleted derivative data file. [2025-10-09T22:07:00.107093] [INFO ] [MAIN ] Update Progress: 2182/2373 symbols completed. UL took 13.3s. Estimated remaining: 26m 52s. Rate: 7.1 symbols/min [2025-10-09T22:07:00.276561] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:07:00.326273] [DEBUG] [LOCAL ] UMC: Loaded 52718 existing records from primary storage. [2025-10-09T22:07:00.326604] [INFO ] [MAIN ] UMC: Loaded 52718 existing records. [2025-10-09T22:07:00.515118] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:07:00.515281] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-09T22:07:00.515328] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-09T22:07:00.515531] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-09T22:07:00.515588] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-09T22:07:00.802098] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-09T22:07:00.878477] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:07:00.900005] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T22:07:01.596792] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-09T22:07:02.396757] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-09T22:07:02.616117] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T22:07:03.196734] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-09T22:07:03.325528] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T22:07:03.996756] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-09T22:07:04.398875] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-09T22:07:04.537998] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T22:07:04.796706] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-09T22:07:05.076004] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T22:07:05.596772] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-09T22:07:06.396703] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-09T22:07:06.705917] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T22:07:06.757170] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T22:07:07.196781] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-09T22:07:07.844265] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T22:07:07.996717] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-09T22:07:08.509372] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T22:07:08.796731] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-09T22:07:09.440219] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T22:07:09.596712] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-09T22:07:09.971994] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T22:07:10.396739] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-09T22:07:11.196741] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-09T22:07:11.360455] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T22:07:11.362277] [INFO ] [REMOTE ] UI: Full fetch complete (18752 records). [2025-10-09T22:07:11.362369] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-09T22:07:11.730560] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-09T22:07:11.787725] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-09T22:07:11.787819] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-09T22:07:11.788261] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-09T22:07:11.788324] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-09T22:07:11.788971] [DEBUG] [LOCAL ] UI: Trimmed 18752 records to 13490 (keeping 200 days of data) [2025-10-09T22:07:11.878305] [DEBUG] [LOCAL ] UI: Primary data saved (13490 records). [2025-10-09T22:07:11.878463] [INFO ] [MAIN ] UI: Full history saved. [2025-10-09T22:07:11.878585] [INFO ] [MAIN ] Update Progress: 2183/2373 symbols completed. UI took 37.4s. Estimated remaining: 26m 44s. Rate: 7.1 symbols/min [2025-10-09T22:07:12.002006] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-09T22:07:12.053465] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:07:12.091867] [DEBUG] [LOCAL ] UMH: Loaded 33843 existing records from primary storage. [2025-10-09T22:07:12.092280] [INFO ] [MAIN ] UMH: Loaded 33843 existing records. [2025-10-09T22:07:12.274236] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:07:12.274492] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-09T22:07:12.274540] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-09T22:07:12.274801] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-09T22:07:12.274863] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-09T22:07:12.391890] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T22:07:12.440515] [INFO ] [REMOTE ] UIS: Full fetch complete (51883 records). [2025-10-09T22:07:12.467298] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-09T22:07:12.811713] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-09T22:07:12.836930] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:07:13.065969] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-09T22:07:13.066054] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-09T22:07:13.066955] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-09T22:07:13.067021] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-09T22:07:13.068166] [DEBUG] [LOCAL ] UIS: Trimmed 51883 records to 37228 (keeping 200 days of data) [2025-10-09T22:07:13.286580] [DEBUG] [LOCAL ] UIS: Primary data saved (37228 records). [2025-10-09T22:07:13.286744] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-09T22:07:13.286834] [INFO ] [MAIN ] Update Progress: 2184/2373 symbols completed. UIS took 37.4s. Estimated remaining: 26m 35s. Rate: 7.1 symbols/min [2025-10-09T22:07:13.452382] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:07:13.465730] [DEBUG] [LOCAL ] UNF: Loaded 12125 existing records from primary storage. [2025-10-09T22:07:13.465937] [INFO ] [MAIN ] UNF: Loaded 12125 existing records. [2025-10-09T22:07:13.603173] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-09T22:07:13.643489] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:07:13.644244] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-09T22:07:13.644320] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-09T22:07:13.644488] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-09T22:07:13.644547] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-09T22:07:14.019552] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:07:14.049708] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T22:07:14.292509] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T22:07:14.396698] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-09T22:07:15.084574] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T22:07:15.196737] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-09T22:07:15.996698] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-09T22:07:15.999411] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T22:07:16.473260] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T22:07:16.796708] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-09T22:07:17.596696] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-09T22:07:17.794522] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T22:07:17.900309] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T22:07:18.384402] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T22:07:18.396671] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-09T22:07:19.196778] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-09T22:07:19.528327] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T22:07:19.996753] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-09T22:07:20.572355] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T22:07:20.796696] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-09T22:07:20.850925] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T22:07:21.596779] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-09T22:07:22.238886] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T22:07:22.396742] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-09T22:07:23.065604] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T22:07:23.196761] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-09T22:07:23.752163] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T22:07:23.996703] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-09T22:07:24.158449] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T22:07:24.796722] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-09T22:07:25.352370] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T22:07:25.596708] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-09T22:07:25.942415] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T22:07:26.396731] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-09T22:07:26.698964] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T22:07:27.196748] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-09T22:07:27.755856] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T22:07:27.966466] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T22:07:27.996676] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-09T22:07:28.796730] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-09T22:07:28.899773] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T22:07:29.596778] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-09T22:07:30.396697] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-09T22:07:30.672368] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T22:07:30.702375] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T22:07:31.196718] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-09T22:07:31.830983] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T22:07:31.996752] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-09T22:07:32.708671] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T22:07:32.747469] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T22:07:32.796680] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-09T22:07:33.596695] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-09T22:07:33.621762] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T22:07:34.396718] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-09T22:07:35.071501] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T22:07:35.196714] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-09T22:07:35.969338] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T22:07:35.996677] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-09T22:07:36.373876] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T22:07:36.796696] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-09T22:07:37.512026] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T22:07:37.513438] [INFO ] [REMOTE ] UNF: Full fetch complete (17329 records). [2025-10-09T22:07:37.513514] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-09T22:07:37.598547] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-09T22:07:37.850431] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T22:07:37.893884] [INFO ] [REMOTE ] UMC: Full fetch complete (76544 records). [2025-10-09T22:07:37.907395] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-09T22:07:37.991790] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-09T22:07:38.008043] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-09T22:07:38.014159] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-09T22:07:38.019374] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-09T22:07:38.046549] [DEBUG] [LOCAL ] UNF: Trimmed 17329 records to 12201 (keeping 200 days of data) [2025-10-09T22:07:38.402452] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-09T22:07:38.449040] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-09T22:07:38.449821] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-09T22:07:38.451109] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-09T22:07:38.451605] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-09T22:07:38.467852] [DEBUG] [LOCAL ] UMC: Trimmed 76544 records to 53076 (keeping 200 days of data) [2025-10-09T22:07:38.522682] [DEBUG] [LOCAL ] UNF: Primary data saved (12201 records). [2025-10-09T22:07:38.532512] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-09T22:07:38.532672] [INFO ] [MAIN ] Update Progress: 2185/2373 symbols completed. UNF took 25.2s. Estimated remaining: 26m 28s. Rate: 7.1 symbols/min [2025-10-09T22:07:38.765410] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:07:38.859546] [DEBUG] [LOCAL ] UNFI: Loaded 42346 existing records from primary storage. [2025-10-09T22:07:38.869121] [INFO ] [MAIN ] UNFI: Loaded 42346 existing records. [2025-10-09T22:07:39.102015] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:07:39.117242] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-09T22:07:39.118601] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-09T22:07:39.120807] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T22:07:39.121624] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-09T22:07:39.122450] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-09T22:07:39.199450] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-09T22:07:39.532484] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:07:39.619128] [DEBUG] [LOCAL ] UMC: Primary data saved (53076 records). [2025-10-09T22:07:39.619284] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-09T22:07:39.619375] [INFO ] [MAIN ] Update Progress: 2186/2373 symbols completed. UMC took 39.5s. Estimated remaining: 26m 19s. Rate: 7.1 symbols/min [2025-10-09T22:07:39.791755] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:07:39.848918] [DEBUG] [LOCAL ] UNH: Loaded 53803 existing records from primary storage. [2025-10-09T22:07:39.849323] [INFO ] [MAIN ] UNH: Loaded 53803 existing records. [2025-10-09T22:07:40.004752] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-09T22:07:40.049703] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:07:40.050288] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-09T22:07:40.050362] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-09T22:07:40.050730] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-09T22:07:40.050841] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-09T22:07:40.159174] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T22:07:40.462390] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:07:40.521461] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T22:07:40.524795] [INFO ] [REMOTE ] UMH: Full fetch complete (46794 records). [2025-10-09T22:07:40.524879] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-09T22:07:40.806857] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-09T22:07:40.900431] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-09T22:07:40.900511] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-09T22:07:40.901406] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-09T22:07:40.901468] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-09T22:07:40.902525] [DEBUG] [LOCAL ] UMH: Trimmed 46794 records to 34107 (keeping 200 days of data) [2025-10-09T22:07:41.113837] [DEBUG] [LOCAL ] UMH: Primary data saved (34107 records). [2025-10-09T22:07:41.113976] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-09T22:07:41.114057] [INFO ] [MAIN ] Update Progress: 2187/2373 symbols completed. UMH took 29.2s. Estimated remaining: 26m 10s. Rate: 7.1 symbols/min [2025-10-09T22:07:41.284530] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:07:41.326879] [DEBUG] [LOCAL ] UNM: Loaded 48187 existing records from primary storage. [2025-10-09T22:07:41.327216] [INFO ] [MAIN ] UNM: Loaded 48187 existing records. [2025-10-09T22:07:41.509467] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:07:41.509777] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-09T22:07:41.509844] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-09T22:07:41.510091] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-09T22:07:41.510170] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-09T22:07:41.600822] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-09T22:07:41.837323] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T22:07:41.912779] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:07:42.396754] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-09T22:07:42.539562] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T22:07:42.542636] [INFO ] [REMOTE ] ULS: Full fetch complete (54101 records). [2025-10-09T22:07:42.542762] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-09T22:07:42.937808] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-09T22:07:42.938051] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-09T22:07:42.939258] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-09T22:07:42.939372] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-09T22:07:42.941181] [DEBUG] [LOCAL ] ULS: Trimmed 54101 records to 39657 (keeping 200 days of data) [2025-10-09T22:07:43.194624] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-09T22:07:43.199287] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-09T22:07:43.236548] [DEBUG] [LOCAL ] ULS: Primary data saved (39657 records). [2025-10-09T22:07:43.236697] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-09T22:07:43.236791] [INFO ] [MAIN ] Update Progress: 2188/2373 symbols completed. ULS took 45.4s. Estimated remaining: 26m 1s. Rate: 7.1 symbols/min [2025-10-09T22:07:43.405714] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:07:43.413986] [DEBUG] [LOCAL ] UNMA: Loaded 3550 existing records from primary storage. [2025-10-09T22:07:43.414170] [INFO ] [MAIN ] UNMA: Loaded 3550 existing records. [2025-10-09T22:07:43.591996] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:07:43.592192] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-09T22:07:43.592239] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-09T22:07:43.592395] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-09T22:07:43.592456] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-09T22:07:43.993714] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:07:43.989284] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T22:07:44.001237] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-09T22:07:44.630910] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T22:07:44.796715] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-09T22:07:45.596776] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-09T22:07:46.014591] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-09T22:07:46.127909] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T22:07:46.204705] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T22:07:46.396754] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-09T22:07:47.196762] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-09T22:07:47.797200] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T22:07:47.996752] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-09T22:07:48.218607] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T22:07:48.796751] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-09T22:07:49.336990] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T22:07:49.596761] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-09T22:07:50.396734] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-09T22:07:51.037722] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-09T22:07:51.196728] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-09T22:07:51.248058] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T22:07:51.931517] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T22:07:51.996692] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-09T22:07:52.796869] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-09T22:07:53.214024] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-09T22:07:53.408423] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T22:07:53.596694] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-09T22:07:53.727519] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-09T22:07:54.128266] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T22:07:54.396772] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-09T22:07:55.196715] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-09T22:07:55.823031] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T22:07:55.996724] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-09T22:07:56.796777] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-09T22:07:56.933408] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T22:07:57.596742] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-09T22:07:57.995265] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T22:07:58.396748] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-09T22:07:58.775894] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-09T22:07:58.861264] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T22:07:59.196772] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-09T22:07:59.721778] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T22:07:59.996779] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-09T22:08:00.480042] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T22:08:00.796732] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-09T22:08:01.596757] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-09T22:08:02.396762] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-09T22:08:02.574501] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T22:08:02.627060] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-09T22:08:02.746846] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-09T22:08:02.935299] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T22:08:03.196779] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-09T22:08:03.768529] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T22:08:03.996709] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-09T22:08:04.796729] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-09T22:08:05.431370] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T22:08:05.596721] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-09T22:08:06.191673] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T22:08:06.396731] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-09T22:08:07.196701] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-09T22:08:07.496621] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-09T22:08:07.996705] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-09T22:08:08.124597] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T22:08:08.754240] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T22:08:08.796680] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-09T22:08:09.596747] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-09T22:08:10.006946] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T22:08:10.160598] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T22:08:10.396684] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-09T22:08:10.564787] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-09T22:08:11.196723] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-09T22:08:11.674083] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T22:08:11.678450] [INFO ] [REMOTE ] UNFI: Full fetch complete (59462 records). [2025-10-09T22:08:11.678598] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-09T22:08:12.002057] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-09T22:08:12.187798] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-09T22:08:12.187915] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-09T22:08:12.189527] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-09T22:08:12.189624] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-09T22:08:12.191534] [DEBUG] [LOCAL ] UNFI: Trimmed 59462 records to 42684 (keeping 200 days of data) [2025-10-09T22:08:12.575867] [DEBUG] [LOCAL ] UNFI: Primary data saved (42684 records). [2025-10-09T22:08:12.576065] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-09T22:08:12.576228] [INFO ] [MAIN ] Update Progress: 2189/2373 symbols completed. UNFI took 34.0s. Estimated remaining: 25m 54s. Rate: 7.1 symbols/min [2025-10-09T22:08:12.801846] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-09T22:08:12.851267] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:08:12.907906] [DEBUG] [LOCAL ] UNP: Loaded 53309 existing records from primary storage. [2025-10-09T22:08:12.908259] [INFO ] [MAIN ] UNP: Loaded 53309 existing records. [2025-10-09T22:08:13.104683] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:08:13.105374] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-09T22:08:13.105467] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-09T22:08:13.105893] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-09T22:08:13.105955] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-09T22:08:13.378492] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T22:08:13.420868] [INFO ] [REMOTE ] UNM: Full fetch complete (69807 records). [2025-10-09T22:08:13.431783] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-09T22:08:13.421266] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T22:08:13.598579] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-09T22:08:13.616846] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:08:13.946372] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-09T22:08:13.946548] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-09T22:08:13.947833] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-09T22:08:13.947959] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-09T22:08:13.950311] [DEBUG] [LOCAL ] UNM: Trimmed 69807 records to 48566 (keeping 200 days of data) [2025-10-09T22:08:14.086767] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T22:08:14.087954] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-10-09T22:08:14.318392] [DEBUG] [LOCAL ] UNM: Primary data saved (48566 records). [2025-10-09T22:08:14.318570] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-09T22:08:14.318691] [INFO ] [MAIN ] Update Progress: 2190/2373 symbols completed. UNM took 33.2s. Estimated remaining: 25m 45s. Rate: 7.1 symbols/min [2025-10-09T22:08:14.401879] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-09T22:08:14.499130] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:08:14.542869] [DEBUG] [LOCAL ] UP: Loaded 43707 existing records from primary storage. [2025-10-09T22:08:14.543291] [INFO ] [MAIN ] UP: Loaded 43707 existing records. [2025-10-09T22:08:14.717997] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:08:14.718238] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-09T22:08:14.718287] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-09T22:08:14.718524] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-09T22:08:14.718580] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-09T22:08:15.064234] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:08:15.196752] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-09T22:08:15.996701] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-09T22:08:16.423705] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-09T22:08:16.557920] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T22:08:16.562568] [INFO ] [REMOTE ] UNH: Full fetch complete (77867 records). [2025-10-09T22:08:16.562707] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-09T22:08:16.801898] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-09T22:08:16.988193] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T22:08:16.992078] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-09T22:08:17.002153] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-09T22:08:17.003369] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-09T22:08:17.003435] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-09T22:08:17.005051] [DEBUG] [LOCAL ] UNH: Trimmed 77867 records to 54193 (keeping 200 days of data) [2025-10-09T22:08:17.360063] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T22:08:17.362059] [INFO ] [REMOTE ] UNMA: Full fetch complete (5701 records). [2025-10-09T22:08:17.362721] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-09T22:08:17.440940] [DEBUG] [LOCAL ] UNH: Primary data saved (54193 records). [2025-10-09T22:08:17.464752] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-09T22:08:17.468076] [INFO ] [MAIN ] Update Progress: 2191/2373 symbols completed. UNH took 37.8s. Estimated remaining: 25m 36s. Rate: 7.1 symbols/min [2025-10-09T22:08:17.602122] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-09T22:08:17.840693] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:08:17.922024] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-09T22:08:17.922112] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-09T22:08:17.922680] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-09T22:08:17.922748] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-09T22:08:17.923200] [DEBUG] [LOCAL ] UNMA: Trimmed 5701 records to 3567 (keeping 200 days of data) [2025-10-09T22:08:17.961322] [DEBUG] [LOCAL ] UNMA: Primary data saved (3567 records). [2025-10-09T22:08:17.961481] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-09T22:08:17.961575] [INFO ] [MAIN ] Update Progress: 2192/2373 symbols completed. UNMA took 34.7s. Estimated remaining: 25m 27s. Rate: 7.1 symbols/min [2025-10-09T22:08:18.097050] [DEBUG] [LOCAL ] UPS: Loaded 53717 existing records from primary storage. [2025-10-09T22:08:18.134436] [INFO ] [MAIN ] UPS: Loaded 53717 existing records. [2025-10-09T22:08:18.177487] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:08:18.363761] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:08:18.364149] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-09T22:08:18.364204] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-09T22:08:18.364726] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-09T22:08:18.364963] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-09T22:08:18.397669] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-09T22:08:18.497803] [DEBUG] [LOCAL ] URI: Loaded 35216 existing records from primary storage. [2025-10-09T22:08:18.508636] [INFO ] [MAIN ] URI: Loaded 35216 existing records. [2025-10-09T22:08:18.942596] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:08:18.977783] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-09T22:08:18.982944] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-09T22:08:18.982874] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:08:18.983272] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-09T22:08:18.983332] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-09T22:08:19.213279] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-09T22:08:19.340683] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:08:19.420199] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T22:08:19.996750] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-09T22:08:20.314037] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-09T22:08:20.796719] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-09T22:08:21.360337] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T22:08:21.407717] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-09T22:08:21.596706] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-09T22:08:22.265606] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T22:08:22.396687] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-09T22:08:23.196694] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-09T22:08:23.248484] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T22:08:23.996702] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-09T22:08:24.252786] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T22:08:24.375401] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T22:08:24.796701] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-09T22:08:25.596732] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-09T22:08:25.690824] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T22:08:26.396746] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-09T22:08:26.596292] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T22:08:27.196740] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-09T22:08:27.642800] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T22:08:27.679571] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-09T22:08:27.996747] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-09T22:08:28.796712] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-09T22:08:29.155687] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-09T22:08:29.543344] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T22:08:29.596659] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-09T22:08:30.337923] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T22:08:30.396791] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-09T22:08:31.196697] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-09T22:08:31.569189] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T22:08:31.996789] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-09T22:08:32.265284] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-09T22:08:32.796756] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-09T22:08:33.004441] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T22:08:33.596749] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-09T22:08:33.780813] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T22:08:34.275734] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T22:08:34.396727] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-09T22:08:35.195688] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T22:08:35.204062] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-09T22:08:35.996698] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-09T22:08:36.468470] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-09T22:08:36.798624] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-09T22:08:36.800897] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T22:08:37.575557] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T22:08:37.596677] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-09T22:08:38.396788] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-09T22:08:38.884342] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T22:08:38.934344] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T22:08:39.196724] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-09T22:08:39.996719] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-09T22:08:40.351191] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T22:08:40.796735] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-09T22:08:41.140355] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T22:08:41.596734] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-09T22:08:42.103608] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T22:08:42.187769] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T22:08:42.396783] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-09T22:08:43.196755] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-09T22:08:43.265113] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T22:08:43.996689] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-09T22:08:44.315421] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-09T22:08:44.320899] [INFO ] [REMOTE ] UNP: Full fetch complete (76911 records). [2025-10-09T22:08:44.321039] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-09T22:08:44.789873] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-09T22:08:44.790730] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-09T22:08:44.792007] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-09T22:08:44.793379] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-09T22:08:44.803274] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-09T22:08:44.804400] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-09T22:08:44.817844] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T22:08:44.823212] [INFO ] [REMOTE ] UP: Full fetch complete (62714 records). [2025-10-09T22:08:44.823379] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-09T22:08:44.823625] [DEBUG] [LOCAL ] UNP: Trimmed 76911 records to 53694 (keeping 200 days of data) [2025-10-09T22:08:45.345502] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-09T22:08:45.346449] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-09T22:08:45.347699] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-09T22:08:45.350146] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-09T22:08:45.355132] [DEBUG] [LOCAL ] UP: Trimmed 62714 records to 44091 (keeping 200 days of data) [2025-10-09T22:08:45.646106] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-09T22:08:45.843114] [DEBUG] [LOCAL ] UP: Primary data saved (44091 records). [2025-10-09T22:08:45.843792] [INFO ] [MAIN ] UP: Full history saved. [2025-10-09T22:08:45.844180] [INFO ] [MAIN ] Update Progress: 2193/2373 symbols completed. UP took 31.5s. Estimated remaining: 25m 20s. Rate: 7.1 symbols/min [2025-10-09T22:08:45.953794] [DEBUG] [LOCAL ] UNP: Primary data saved (53694 records). [2025-10-09T22:08:45.957030] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-09T22:08:45.957147] [INFO ] [MAIN ] Update Progress: 2194/2373 symbols completed. UNP took 33.4s. Estimated remaining: 25m 11s. Rate: 7.1 symbols/min [2025-10-09T22:08:46.143225] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:08:46.204991] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:08:46.234092] [DEBUG] [LOCAL ] USAC: Loaded 21606 existing records from primary storage. [2025-10-09T22:08:46.234344] [INFO ] [MAIN ] USAC: Loaded 21606 existing records. [2025-10-09T22:08:46.350604] [DEBUG] [LOCAL ] USA: Loaded 36029 existing records from primary storage. [2025-10-09T22:08:46.361924] [INFO ] [MAIN ] USA: Loaded 36029 existing records. [2025-10-09T22:08:46.464092] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:08:46.525247] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-09T22:08:46.536148] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-09T22:08:46.586222] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-09T22:08:46.589073] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-09T22:08:46.628870] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:08:46.671673] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-09T22:08:46.686194] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-09T22:08:46.713838] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-09T22:08:46.721240] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-09T22:08:46.816107] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T22:08:46.917107] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-09T22:08:47.336920] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:08:47.360265] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-09T22:08:47.391826] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:08:47.673429] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T22:08:47.996753] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-09T22:08:48.498828] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T22:08:48.558309] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T22:08:48.796759] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-09T22:08:49.354404] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T22:08:49.596787] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-09T22:08:50.061918] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T22:08:50.396768] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-09T22:08:51.196747] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-09T22:08:51.734197] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-09T22:08:51.802634] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T22:08:51.996693] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-09T22:08:52.023719] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T22:08:52.796767] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-09T22:08:53.596823] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-09T22:08:54.048918] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T22:08:54.165075] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-09T22:08:54.396747] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-09T22:08:54.574491] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T22:08:54.853146] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T22:08:54.855910] [INFO ] [REMOTE ] URI: Full fetch complete (52949 records). [2025-10-09T22:08:54.855991] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-09T22:08:55.218856] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-09T22:08:55.238323] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-09T22:08:55.238398] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-09T22:08:55.239358] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-09T22:08:55.239442] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-09T22:08:55.240573] [DEBUG] [LOCAL ] URI: Trimmed 52949 records to 35396 (keeping 200 days of data) [2025-10-09T22:08:55.470088] [DEBUG] [LOCAL ] URI: Primary data saved (35396 records). [2025-10-09T22:08:55.470218] [INFO ] [MAIN ] URI: Full history saved. [2025-10-09T22:08:55.470301] [INFO ] [MAIN ] Update Progress: 2195/2373 symbols completed. URI took 37.5s. Estimated remaining: 25m 3s. Rate: 7.1 symbols/min [2025-10-09T22:08:55.641889] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:08:55.691538] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-09T22:08:55.691899] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-09T22:08:55.876352] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:08:55.876639] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-09T22:08:55.876737] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-09T22:08:55.876990] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-09T22:08:55.877060] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-09T22:08:56.002033] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-09T22:08:56.270627] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:08:56.555076] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T22:08:56.796760] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-09T22:08:57.548308] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T22:08:57.596702] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-09T22:08:58.396732] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-09T22:08:58.557753] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T22:08:59.196720] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-09T22:08:59.692627] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-09T22:08:59.979561] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T22:08:59.996673] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-09T22:09:00.796749] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-09T22:09:00.893234] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T22:09:01.175195] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T22:09:01.218025] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T22:09:01.222957] [INFO ] [REMOTE ] UPS: Full fetch complete (77757 records). [2025-10-09T22:09:01.223067] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-09T22:09:01.605738] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-09T22:09:01.609694] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-09T22:09:01.610634] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-09T22:09:01.611857] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-09T22:09:01.612072] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-09T22:09:01.613914] [DEBUG] [LOCAL ] UPS: Trimmed 77757 records to 54107 (keeping 200 days of data) [2025-10-09T22:09:01.964248] [DEBUG] [LOCAL ] UPS: Primary data saved (54107 records). [2025-10-09T22:09:01.964421] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-09T22:09:01.964535] [INFO ] [MAIN ] Update Progress: 2196/2373 symbols completed. UPS took 44.5s. Estimated remaining: 24m 54s. Rate: 7.1 symbols/min [2025-10-09T22:09:02.158112] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:09:02.216764] [DEBUG] [LOCAL ] USFD: Loaded 51161 existing records from primary storage. [2025-10-09T22:09:02.217253] [INFO ] [MAIN ] USFD: Loaded 51161 existing records. [2025-10-09T22:09:02.399552] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-09T22:09:02.413849] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:09:02.414263] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-09T22:09:02.414331] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-09T22:09:02.414567] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-09T22:09:02.414639] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-09T22:09:02.769873] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T22:09:02.858736] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:09:03.196788] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-09T22:09:03.450039] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T22:09:03.996748] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-09T22:09:04.796797] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-09T22:09:04.952682] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T22:09:05.414779] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T22:09:05.596742] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-09T22:09:05.805087] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T22:09:06.396714] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-09T22:09:06.960482] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T22:09:07.066727] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T22:09:07.196697] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-09T22:09:07.996733] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-09T22:09:08.537342] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T22:09:08.796718] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-09T22:09:09.596699] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-09T22:09:09.893058] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T22:09:10.277028] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T22:09:10.276859] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T22:09:10.287890] [INFO ] [REMOTE ] USAC: Full fetch complete (35130 records). [2025-10-09T22:09:10.288083] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-09T22:09:10.398421] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-09T22:09:10.689800] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-09T22:09:10.689897] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-09T22:09:10.690724] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-09T22:09:10.690804] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-09T22:09:10.691827] [DEBUG] [LOCAL ] USAC: Trimmed 35130 records to 21710 (keeping 200 days of data) [2025-10-09T22:09:10.826540] [DEBUG] [LOCAL ] USAC: Primary data saved (21710 records). [2025-10-09T22:09:10.826692] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-09T22:09:10.826811] [INFO ] [MAIN ] Update Progress: 2197/2373 symbols completed. USAC took 24.9s. Estimated remaining: 24m 46s. Rate: 7.1 symbols/min [2025-10-09T22:09:11.196738] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-09T22:09:11.917033] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T22:09:11.996710] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-09T22:09:12.796739] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-09T22:09:13.159604] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T22:09:13.226264] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T22:09:13.596712] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-09T22:09:14.396742] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-09T22:09:14.848834] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T22:09:14.852166] [INFO ] [REMOTE ] USA: Full fetch complete (51963 records). [2025-10-09T22:09:14.852254] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-09T22:09:15.239542] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-09T22:09:15.239711] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-09T22:09:15.240690] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-09T22:09:15.240753] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-09T22:09:15.242494] [DEBUG] [LOCAL ] USA: Trimmed 51963 records to 36317 (keeping 200 days of data) [2025-10-09T22:09:15.357810] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-09T22:09:15.369939] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-09T22:09:15.495459] [DEBUG] [LOCAL ] USA: Primary data saved (36317 records). [2025-10-09T22:09:15.495597] [INFO ] [MAIN ] USA: Full history saved. [2025-10-09T22:09:15.495717] [INFO ] [MAIN ] Update Progress: 2198/2373 symbols completed. USA took 29.6s. Estimated remaining: 24m 37s. Rate: 7.1 symbols/min [2025-10-09T22:09:16.480521] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-09T22:09:16.492179] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-09T22:09:17.097678] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T22:09:17.107755] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-09T22:09:17.867604] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T22:09:17.878716] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-09T22:09:18.446317] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T22:09:18.457181] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-09T22:09:19.918131] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-09T22:09:19.931792] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-09T22:09:20.067566] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T22:09:20.078905] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-09T22:09:21.422048] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T22:09:21.433187] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-09T22:09:21.785369] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T22:09:21.796781] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-09T22:09:23.096194] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T22:09:23.106723] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-09T22:09:23.785318] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-09T22:09:23.797240] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-09T22:09:24.142691] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T22:09:24.147265] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-09T22:09:24.147403] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-09T22:09:24.564235] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-09T22:09:24.564339] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-09T22:09:24.565700] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-09T22:09:24.565764] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-09T22:09:24.568028] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 54078 (keeping 200 days of data) [2025-10-09T22:09:24.914601] [DEBUG] [LOCAL ] USB: Primary data saved (54078 records). [2025-10-09T22:09:24.914794] [INFO ] [MAIN ] USB: Full history saved. [2025-10-09T22:09:24.914940] [INFO ] [MAIN ] Update Progress: 2199/2373 symbols completed. USB took 29.4s. Estimated remaining: 24m 29s. Rate: 7.1 symbols/min [2025-10-09T22:09:24.961086] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T22:09:24.973216] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-09T22:09:26.396622] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T22:09:26.407834] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-09T22:09:28.027690] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T22:09:28.038637] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-09T22:09:29.629096] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T22:09:29.633559] [INFO ] [REMOTE ] USFD: Full fetch complete (74003 records). [2025-10-09T22:09:29.633717] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-09T22:09:30.045599] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-09T22:09:30.045736] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-09T22:09:30.047039] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-09T22:09:30.047123] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-09T22:09:30.048770] [DEBUG] [LOCAL ] USFD: Trimmed 74003 records to 51527 (keeping 200 days of data) [2025-10-09T22:09:30.369866] [DEBUG] [LOCAL ] USFD: Primary data saved (51527 records). [2025-10-09T22:09:30.370009] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-09T22:09:30.370093] [INFO ] [MAIN ] Update Progress: 2200/2373 symbols completed. USFD took 28.4s. Estimated remaining: 24m 20s. Rate: 7.1 symbols/min [2025-10-09T22:09:31.057583] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:09:31.042591] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:09:31.118241] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:09:31.143196] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:09:31.160029] [DEBUG] [LOCAL ] USNA: Loaded 17668 existing records from primary storage. [2025-10-09T22:09:31.160410] [INFO ] [MAIN ] USNA: Loaded 17668 existing records. [2025-10-09T22:09:31.297199] [DEBUG] [LOCAL ] USPH: Loaded 17025 existing records from primary storage. [2025-10-09T22:09:31.303353] [INFO ] [MAIN ] USPH: Loaded 17025 existing records. [2025-10-09T22:09:31.458694] [DEBUG] [LOCAL ] UTI: Loaded 40585 existing records from primary storage. [2025-10-09T22:09:31.469956] [DEBUG] [LOCAL ] UTF: Loaded 30148 existing records from primary storage. [2025-10-09T22:09:31.505977] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:09:31.517100] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-09T22:09:31.517612] [INFO ] [MAIN ] UTF: Loaded 30148 existing records. [2025-10-09T22:09:31.517880] [INFO ] [MAIN ] UTI: Loaded 40585 existing records. [2025-10-09T22:09:31.523157] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-09T22:09:31.705274] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-09T22:09:31.763924] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:09:31.798979] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-09T22:09:31.810025] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-09T22:09:31.815344] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-09T22:09:31.908261] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-09T22:09:31.993012] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-09T22:09:32.058753] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:09:32.112396] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-09T22:09:32.112569] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-09T22:09:32.118188] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:09:32.126532] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-09T22:09:32.132676] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-09T22:09:32.153516] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-09T22:09:32.225155] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-09T22:09:32.440910] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-09T22:09:32.449472] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-09T22:09:33.135254] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:09:33.195358] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-09T22:09:33.356557] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:09:33.425608] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-09T22:09:33.425216] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:09:33.461176] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-09T22:09:33.543309] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:09:33.543660] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-09T22:09:34.253763] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T22:09:34.257463] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-09T22:09:34.512608] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T22:09:34.516146] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-09T22:09:34.624288] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T22:09:34.631896] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-09T22:09:34.682489] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T22:09:34.688319] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-09T22:09:35.230823] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T22:09:35.234087] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-09T22:09:35.266466] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T22:09:35.270727] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-09T22:09:35.780749] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T22:09:35.784137] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-09T22:09:35.804891] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T22:09:35.813171] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-09T22:09:35.904820] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T22:09:35.996666] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-09T22:09:36.138907] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T22:09:36.718345] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T22:09:36.796677] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-09T22:09:36.975391] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T22:09:37.101953] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T22:09:37.596692] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-09T22:09:37.636094] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T22:09:38.396739] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-09T22:09:38.980851] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T22:09:39.196691] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-09T22:09:39.219033] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T22:09:39.996736] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-09T22:09:40.796726] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-09T22:09:40.993958] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T22:09:41.050440] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T22:09:41.596778] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-09T22:09:42.362902] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T22:09:42.396670] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-09T22:09:42.527914] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T22:09:43.196772] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-09T22:09:43.542967] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T22:09:43.999848] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-09T22:09:44.001982] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T22:09:44.796760] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-09T22:09:45.603591] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T22:09:45.602390] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-09T22:09:45.665541] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T22:09:46.396734] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-09T22:09:46.778244] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T22:09:47.196771] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-09T22:09:47.753192] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T22:09:47.996733] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-09T22:09:48.351208] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T22:09:48.796736] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-09T22:09:48.857410] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T22:09:49.596744] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-09T22:09:49.764607] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T22:09:50.396701] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-09T22:09:50.546196] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T22:09:51.017195] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T22:09:51.196770] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-09T22:09:51.996768] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-09T22:09:52.653473] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T22:09:52.796696] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-09T22:09:52.955834] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T22:09:53.596728] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-09T22:09:54.247257] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T22:09:54.396715] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-09T22:09:54.583955] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T22:09:54.586264] [INFO ] [REMOTE ] USPH: Full fetch complete (22937 records). [2025-10-09T22:09:54.586366] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-09T22:09:54.985020] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-09T22:09:54.985120] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-09T22:09:54.985604] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-09T22:09:54.985672] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-09T22:09:54.986310] [DEBUG] [LOCAL ] USPH: Trimmed 22937 records to 17114 (keeping 200 days of data) [2025-10-09T22:09:55.094937] [DEBUG] [LOCAL ] USPH: Primary data saved (17114 records). [2025-10-09T22:09:55.095188] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-09T22:09:55.095283] [INFO ] [MAIN ] Update Progress: 2201/2373 symbols completed. USPH took 24.7s. Estimated remaining: 24m 13s. Rate: 7.1 symbols/min [2025-10-09T22:09:55.197991] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-09T22:09:55.274531] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:09:55.288232] [DEBUG] [LOCAL ] UTL: Loaded 11598 existing records from primary storage. [2025-10-09T22:09:55.288587] [INFO ] [MAIN ] UTL: Loaded 11598 existing records. [2025-10-09T22:09:55.424756] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T22:09:55.490562] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:09:55.490843] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-09T22:09:55.490907] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-09T22:09:55.491117] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-09T22:09:55.491192] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-09T22:09:55.861478] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:09:55.996681] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-09T22:09:56.787175] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T22:09:56.796611] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-09T22:09:56.828776] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T22:09:57.596731] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-09T22:09:58.340597] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T22:09:58.384077] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T22:09:58.396695] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-09T22:09:59.196775] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-09T22:09:59.871495] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T22:09:59.956903] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T22:09:59.996716] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-09T22:10:00.796697] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-09T22:10:01.467242] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T22:10:01.472255] [INFO ] [REMOTE ] UTF: Full fetch complete (42713 records). [2025-10-09T22:10:01.472512] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-09T22:10:01.601893] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-09T22:10:01.722421] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T22:10:01.944158] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-09T22:10:01.944309] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-09T22:10:01.945180] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-09T22:10:01.945311] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-09T22:10:01.946275] [DEBUG] [LOCAL ] UTF: Trimmed 42713 records to 30516 (keeping 200 days of data) [2025-10-09T22:10:02.161612] [DEBUG] [LOCAL ] UTF: Primary data saved (30516 records). [2025-10-09T22:10:02.161790] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-09T22:10:02.161885] [INFO ] [MAIN ] Update Progress: 2202/2373 symbols completed. UTF took 31.8s. Estimated remaining: 24m 4s. Rate: 7.1 symbols/min [2025-10-09T22:10:02.339617] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:10:02.384746] [DEBUG] [LOCAL ] UTZ: Loaded 44598 existing records from primary storage. [2025-10-09T22:10:02.385072] [INFO ] [MAIN ] UTZ: Loaded 44598 existing records. [2025-10-09T22:10:02.401958] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-09T22:10:02.607185] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:10:02.607441] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-09T22:10:02.607495] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-09T22:10:02.607808] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-09T22:10:02.607867] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-09T22:10:02.961463] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:10:03.194247] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T22:10:03.198068] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-09T22:10:03.200100] [INFO ] [REMOTE ] UTI: Full fetch complete (58458 records). [2025-10-09T22:10:03.200272] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-09T22:10:03.526684] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T22:10:03.612187] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-09T22:10:03.612287] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-09T22:10:03.613369] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-09T22:10:03.613436] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-09T22:10:03.614793] [DEBUG] [LOCAL ] UTI: Trimmed 58458 records to 40842 (keeping 200 days of data) [2025-10-09T22:10:03.862437] [DEBUG] [LOCAL ] UTI: Primary data saved (40842 records). [2025-10-09T22:10:03.862572] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-09T22:10:03.862675] [INFO ] [MAIN ] Update Progress: 2203/2373 symbols completed. UTI took 33.5s. Estimated remaining: 23m 55s. Rate: 7.1 symbols/min [2025-10-09T22:10:04.001872] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-09T22:10:04.033897] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:10:04.034124] [DEBUG] [LOCAL ] UVE: No existing data file found in primary storage. [2025-10-09T22:10:04.034169] [WARN ] [MAIN ] UVE: No existing data found, performing full refresh instead. [2025-10-09T22:10:04.034285] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-09T22:10:04.034325] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-09T22:10:04.034366] [DEBUG] [LOCAL ] UVE: No primary data file found to delete. [2025-10-09T22:10:04.034398] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-09T22:10:04.400609] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:10:04.750347] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T22:10:04.796711] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-09T22:10:04.964091] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T22:10:05.596751] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-09T22:10:06.292511] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T22:10:06.396717] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-09T22:10:06.492971] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T22:10:07.196722] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-09T22:10:07.991107] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T22:10:07.992066] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T22:10:08.000439] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-09T22:10:08.796699] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-09T22:10:09.149992] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T22:10:09.596744] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-09T22:10:09.758796] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T22:10:10.396694] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-09T22:10:10.608026] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T22:10:11.056869] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T22:10:11.196708] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-09T22:10:11.996707] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-09T22:10:12.053509] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T22:10:12.796717] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-09T22:10:12.917774] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T22:10:12.919969] [INFO ] [REMOTE ] USNA: Full fetch complete (26548 records). [2025-10-09T22:10:12.920082] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-09T22:10:13.421922] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-09T22:10:13.422055] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-09T22:10:13.423484] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-09T22:10:13.423573] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-09T22:10:13.424849] [DEBUG] [LOCAL ] USNA: Trimmed 26548 records to 17770 (keeping 200 days of data) [2025-10-09T22:10:13.576451] [DEBUG] [LOCAL ] USNA: Primary data saved (17770 records). [2025-10-09T22:10:13.576678] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-09T22:10:13.576826] [INFO ] [MAIN ] Update Progress: 2204/2373 symbols completed. USNA took 43.2s. Estimated remaining: 23m 47s. Rate: 7.1 symbols/min [2025-10-09T22:10:13.596814] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-09T22:10:13.863292] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:10:13.890298] [DEBUG] [LOCAL ] UVV: Loaded 22680 existing records from primary storage. [2025-10-09T22:10:13.890591] [INFO ] [MAIN ] UVV: Loaded 22680 existing records. [2025-10-09T22:10:14.088842] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:10:14.089099] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-09T22:10:14.089161] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-09T22:10:14.089699] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-09T22:10:14.089786] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-09T22:10:14.401712] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-09T22:10:14.470329] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:10:14.495800] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T22:10:14.600164] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T22:10:15.196712] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-09T22:10:15.471159] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T22:10:15.996718] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-09T22:10:16.131241] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T22:10:16.133194] [INFO ] [REMOTE ] UTL: Full fetch complete (15623 records). [2025-10-09T22:10:16.133305] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-09T22:10:16.532313] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-09T22:10:16.532393] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-09T22:10:16.532759] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-09T22:10:16.532821] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-09T22:10:16.533320] [DEBUG] [LOCAL ] UTL: Trimmed 15623 records to 11697 (keeping 200 days of data) [2025-10-09T22:10:16.603346] [DEBUG] [LOCAL ] UTL: Primary data saved (11697 records). [2025-10-09T22:10:16.603479] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-09T22:10:16.603561] [INFO ] [MAIN ] Update Progress: 2205/2373 symbols completed. UTL took 21.5s. Estimated remaining: 23m 38s. Rate: 7.1 symbols/min [2025-10-09T22:10:16.776522] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:10:16.804989] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-09T22:10:16.826341] [DEBUG] [LOCAL ] UWMC: Loaded 52853 existing records from primary storage. [2025-10-09T22:10:16.826679] [INFO ] [MAIN ] UWMC: Loaded 52853 existing records. [2025-10-09T22:10:17.006921] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:10:17.007216] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-09T22:10:17.007327] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-09T22:10:17.007694] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-09T22:10:17.007777] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-09T22:10:17.121945] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T22:10:17.387282] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:10:17.596738] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-09T22:10:18.396774] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-09T22:10:18.473212] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T22:10:19.142440] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T22:10:19.196685] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-09T22:10:19.383994] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T22:10:19.996738] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-09T22:10:20.542134] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T22:10:20.796747] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-09T22:10:21.105089] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T22:10:21.596729] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-09T22:10:21.794369] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T22:10:22.396707] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-09T22:10:22.718242] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T22:10:23.196783] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-09T22:10:23.996695] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-09T22:10:24.140605] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T22:10:24.505723] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T22:10:24.796783] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-09T22:10:25.487067] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T22:10:25.596664] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-09T22:10:25.995689] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T22:10:26.396736] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-09T22:10:27.193824] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T22:10:27.203349] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-09T22:10:27.996682] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-09T22:10:28.174720] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T22:10:28.670531] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-09T22:10:28.796681] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-09T22:10:29.511304] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T22:10:29.596687] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-09T22:10:30.396751] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-09T22:10:30.605225] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T22:10:31.174615] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T22:10:31.196667] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-09T22:10:31.232764] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T22:10:31.996706] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-09T22:10:32.556790] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T22:10:32.560427] [INFO ] [REMOTE ] UTZ: Full fetch complete (64457 records). [2025-10-09T22:10:32.560533] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-09T22:10:32.800625] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-09T22:10:32.956126] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-09T22:10:32.956215] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-09T22:10:32.957265] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-09T22:10:32.957329] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-09T22:10:32.958794] [DEBUG] [LOCAL ] UTZ: Trimmed 64457 records to 44883 (keeping 200 days of data) [2025-10-09T22:10:33.194372] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T22:10:33.264934] [DEBUG] [LOCAL ] UTZ: Primary data saved (44883 records). [2025-10-09T22:10:33.265070] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-09T22:10:33.265154] [INFO ] [MAIN ] Update Progress: 2206/2373 symbols completed. UTZ took 31.1s. Estimated remaining: 23m 30s. Rate: 7.1 symbols/min [2025-10-09T22:10:33.444584] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:10:33.453748] [DEBUG] [LOCAL ] UZD: Loaded 6412 existing records from primary storage. [2025-10-09T22:10:33.453933] [INFO ] [MAIN ] UZD: Loaded 6412 existing records. [2025-10-09T22:10:33.601896] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-09T22:10:33.640744] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:10:33.641063] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-09T22:10:33.641142] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-09T22:10:33.641327] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-09T22:10:33.641387] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-09T22:10:34.008620] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:10:34.396695] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-09T22:10:34.660520] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T22:10:34.712575] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T22:10:35.196747] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-09T22:10:35.554396] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T22:10:35.996727] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-09T22:10:36.276969] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T22:10:36.796697] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-09T22:10:36.872031] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T22:10:37.270692] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-09T22:10:37.596776] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-09T22:10:38.396753] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-09T22:10:38.477769] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T22:10:38.480063] [INFO ] [REMOTE ] UVE: Full fetch complete (30030 records). [2025-10-09T22:10:38.480136] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-09T22:10:38.847898] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-09T22:10:38.847976] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-09T22:10:38.848588] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-09T22:10:38.848628] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-09T22:10:38.849497] [DEBUG] [LOCAL ] UVE: Trimmed 30030 records to 22004 (keeping 200 days of data) [2025-10-09T22:10:38.987901] [DEBUG] [LOCAL ] UVE: Primary data saved (22004 records). [2025-10-09T22:10:38.988041] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-09T22:10:38.988112] [INFO ] [MAIN ] Update Progress: 2207/2373 symbols completed. UVE took 35.1s. Estimated remaining: 23m 22s. Rate: 7.1 symbols/min [2025-10-09T22:10:39.146503] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T22:10:39.175832] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:10:39.187789] [DEBUG] [LOCAL ] UZE: Loaded 7448 existing records from primary storage. [2025-10-09T22:10:39.188004] [INFO ] [MAIN ] UZE: Loaded 7448 existing records. [2025-10-09T22:10:39.201818] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-09T22:10:39.373900] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:10:39.374156] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-09T22:10:39.374204] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-09T22:10:39.374403] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-09T22:10:39.374459] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-09T22:10:39.762408] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:10:39.996713] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-09T22:10:40.796700] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-09T22:10:41.098805] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T22:10:41.339174] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T22:10:41.364311] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T22:10:41.596715] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-09T22:10:42.396774] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-09T22:10:43.091472] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T22:10:43.196747] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-09T22:10:43.347707] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T22:10:43.996747] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-09T22:10:44.363804] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T22:10:44.796708] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-09T22:10:45.534421] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T22:10:45.596799] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-09T22:10:45.956809] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-09T22:10:46.340174] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T22:10:46.396760] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-09T22:10:47.196691] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-09T22:10:47.996754] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-09T22:10:48.547298] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T22:10:48.647825] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-09T22:10:48.796700] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-09T22:10:48.859926] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T22:10:49.596725] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-09T22:10:50.396739] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-09T22:10:50.541761] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T22:10:51.023001] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T22:10:51.025205] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-09T22:10:51.196736] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-09T22:10:51.996762] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-09T22:10:52.607418] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T22:10:52.774677] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T22:10:52.779120] [INFO ] [REMOTE ] UWMC: Full fetch complete (75662 records). [2025-10-09T22:10:52.779224] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-09T22:10:52.801864] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-09T22:10:53.171384] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-09T22:10:53.171460] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-09T22:10:53.172574] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-09T22:10:53.172638] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-09T22:10:53.174076] [DEBUG] [LOCAL ] UWMC: Trimmed 75662 records to 53243 (keeping 200 days of data) [2025-10-09T22:10:53.497454] [DEBUG] [LOCAL ] UWMC: Primary data saved (53243 records). [2025-10-09T22:10:53.497630] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-09T22:10:53.497769] [INFO ] [MAIN ] Update Progress: 2208/2373 symbols completed. UWMC took 36.9s. Estimated remaining: 23m 14s. Rate: 7.1 symbols/min [2025-10-09T22:10:53.598831] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-09T22:10:53.675814] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:10:53.673687] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T22:10:53.686104] [DEBUG] [LOCAL ] UZF: Loaded 6338 existing records from primary storage. [2025-10-09T22:10:53.686277] [INFO ] [MAIN ] UZF: Loaded 6338 existing records. [2025-10-09T22:10:53.861379] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:10:53.861583] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-09T22:10:53.861631] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-09T22:10:53.861838] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-09T22:10:53.861894] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-09T22:10:54.214975] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:10:54.309212] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T22:10:54.396738] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-09T22:10:55.067136] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T22:10:55.196730] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-09T22:10:55.937889] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T22:10:55.996780] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-09T22:10:56.622147] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T22:10:56.796737] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-09T22:10:57.390940] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T22:10:57.596762] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-09T22:10:58.215377] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T22:10:58.396741] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-09T22:10:59.196706] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-09T22:10:59.363178] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T22:10:59.365413] [INFO ] [REMOTE ] UVV: Full fetch complete (30086 records). [2025-10-09T22:10:59.365485] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-09T22:10:59.742933] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-09T22:10:59.743021] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-09T22:10:59.743710] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-09T22:10:59.743774] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-09T22:10:59.744518] [DEBUG] [LOCAL ] UVV: Trimmed 30086 records to 22860 (keeping 200 days of data) [2025-10-09T22:10:59.885400] [DEBUG] [LOCAL ] UVV: Primary data saved (22860 records). [2025-10-09T22:10:59.885539] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-09T22:10:59.885622] [INFO ] [MAIN ] Update Progress: 2209/2373 symbols completed. UVV took 46.3s. Estimated remaining: 23m 5s. Rate: 7.1 symbols/min [2025-10-09T22:10:59.997103] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-09T22:11:00.063821] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:11:00.113544] [DEBUG] [LOCAL ] V: Loaded 53752 existing records from primary storage. [2025-10-09T22:11:00.113881] [INFO ] [MAIN ] V: Loaded 53752 existing records. [2025-10-09T22:11:00.229018] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T22:11:00.321186] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:11:00.321432] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-09T22:11:00.321487] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-09T22:11:00.321758] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-09T22:11:00.321817] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-09T22:11:00.617231] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T22:11:00.694866] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:11:00.796670] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-09T22:11:01.596814] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-09T22:11:02.063311] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T22:11:02.396741] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-09T22:11:02.849538] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-09T22:11:03.095791] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-09T22:11:03.196735] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-09T22:11:03.996752] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-09T22:11:04.583586] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T22:11:04.796746] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-09T22:11:05.516099] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T22:11:05.601961] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-09T22:11:05.635233] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-09T22:11:06.141354] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T22:11:06.143204] [INFO ] [REMOTE ] UZE: Full fetch complete (10002 records). [2025-10-09T22:11:06.143375] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-09T22:11:06.406763] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-09T22:11:06.607711] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-09T22:11:06.607843] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-09T22:11:06.608231] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-09T22:11:06.608311] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-09T22:11:06.609330] [DEBUG] [LOCAL ] UZE: Trimmed 10002 records to 7495 (keeping 200 days of data) [2025-10-09T22:11:06.663120] [DEBUG] [LOCAL ] UZE: Primary data saved (7495 records). [2025-10-09T22:11:06.663278] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-09T22:11:06.663383] [INFO ] [MAIN ] Update Progress: 2210/2373 symbols completed. UZE took 27.7s. Estimated remaining: 22m 57s. Rate: 7.1 symbols/min [2025-10-09T22:11:06.841343] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:11:06.881485] [DEBUG] [LOCAL ] VAC: Loaded 34252 existing records from primary storage. [2025-10-09T22:11:06.881791] [INFO ] [MAIN ] VAC: Loaded 34252 existing records. [2025-10-09T22:11:07.083932] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:11:07.084224] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-09T22:11:07.084290] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-09T22:11:07.084507] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-09T22:11:07.084565] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-09T22:11:07.201877] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-09T22:11:07.474873] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:11:07.476474] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T22:11:07.996740] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-09T22:11:08.796786] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-09T22:11:09.204414] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T22:11:09.358416] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-09T22:11:09.423460] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T22:11:09.596784] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-09T22:11:10.396721] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-09T22:11:10.991875] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T22:11:11.196724] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-09T22:11:11.757251] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T22:11:11.758354] [INFO ] [REMOTE ] UZD: Full fetch complete (9330 records). [2025-10-09T22:11:11.758423] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-09T22:11:12.002004] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-09T22:11:12.122946] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-09T22:11:12.176681] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-09T22:11:12.176767] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-09T22:11:12.176995] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-09T22:11:12.177036] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-09T22:11:12.177453] [DEBUG] [LOCAL ] UZD: Trimmed 9330 records to 6439 (keeping 200 days of data) [2025-10-09T22:11:12.223590] [DEBUG] [LOCAL ] UZD: Primary data saved (6439 records). [2025-10-09T22:11:12.223825] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-09T22:11:12.223969] [INFO ] [MAIN ] Update Progress: 2211/2373 symbols completed. UZD took 39.0s. Estimated remaining: 22m 48s. Rate: 7.1 symbols/min [2025-10-09T22:11:12.390522] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:11:12.436533] [DEBUG] [LOCAL ] VAL: Loaded 50235 existing records from primary storage. [2025-10-09T22:11:12.436949] [INFO ] [MAIN ] VAL: Loaded 50235 existing records. [2025-10-09T22:11:12.612663] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:11:12.612920] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-09T22:11:12.612968] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-09T22:11:12.613179] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-09T22:11:12.613237] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-09T22:11:12.806225] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-09T22:11:12.979735] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:11:13.213779] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T22:11:13.596783] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-09T22:11:14.396690] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-09T22:11:14.672624] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T22:11:15.171618] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-09T22:11:15.196675] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-09T22:11:15.733421] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T22:11:15.996758] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-09T22:11:16.436794] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-09T22:11:16.796767] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-09T22:11:17.434422] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-09T22:11:17.596684] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-09T22:11:18.360220] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T22:11:18.396668] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-09T22:11:19.196728] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-09T22:11:19.875849] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-09T22:11:19.996548] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T22:11:19.996717] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-09T22:11:20.464348] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T22:11:20.687036] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T22:11:20.796741] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-09T22:11:21.596734] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-09T22:11:22.396760] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-09T22:11:22.800428] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T22:11:22.914667] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T22:11:23.209320] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-09T22:11:23.215457] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-09T22:11:23.996751] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-09T22:11:24.680089] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T22:11:24.796672] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-09T22:11:25.596743] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-09T22:11:25.801297] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T22:11:26.256747] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T22:11:26.396756] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-09T22:11:27.196736] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-09T22:11:27.604376] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T22:11:27.847269] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T22:11:27.996691] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-09T22:11:28.180731] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T22:11:28.796757] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-09T22:11:29.596719] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-09T22:11:30.095594] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T22:11:30.096527] [INFO ] [REMOTE ] UZF: Full fetch complete (8794 records). [2025-10-09T22:11:30.096593] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-09T22:11:30.219605] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T22:11:30.401924] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-09T22:11:30.498237] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-09T22:11:30.498372] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-09T22:11:30.498606] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-09T22:11:30.498671] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-09T22:11:30.499133] [DEBUG] [LOCAL ] UZF: Trimmed 8794 records to 6371 (keeping 200 days of data) [2025-10-09T22:11:30.560689] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-09T22:11:30.584178] [DEBUG] [LOCAL ] UZF: Primary data saved (6371 records). [2025-10-09T22:11:30.584864] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-09T22:11:30.585172] [INFO ] [MAIN ] Update Progress: 2212/2373 symbols completed. UZF took 37.1s. Estimated remaining: 22m 40s. Rate: 7.1 symbols/min [2025-10-09T22:11:30.755091] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:11:30.806177] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-09T22:11:30.806491] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-09T22:11:30.979528] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:11:30.979808] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-09T22:11:30.979868] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-09T22:11:30.980185] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-09T22:11:30.980243] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-09T22:11:31.201840] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-09T22:11:31.336337] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:11:31.823385] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T22:11:31.828844] [INFO ] [REMOTE ] V: Full fetch complete (77819 records). [2025-10-09T22:11:31.829023] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-09T22:11:32.009436] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-09T22:11:32.159264] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T22:11:32.289518] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-09T22:11:32.289608] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-09T22:11:32.290767] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-09T22:11:32.290830] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-09T22:11:32.292195] [DEBUG] [LOCAL ] V: Trimmed 77819 records to 54142 (keeping 200 days of data) [2025-10-09T22:11:32.644018] [DEBUG] [LOCAL ] V: Primary data saved (54142 records). [2025-10-09T22:11:32.644174] [INFO ] [MAIN ] V: Full history saved. [2025-10-09T22:11:32.644274] [INFO ] [MAIN ] Update Progress: 2213/2373 symbols completed. V took 32.8s. Estimated remaining: 22m 31s. Rate: 7.1 symbols/min [2025-10-09T22:11:32.813067] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:11:32.810169] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-09T22:11:32.820410] [DEBUG] [LOCAL ] VATE: Loaded 5259 existing records from primary storage. [2025-10-09T22:11:32.820692] [INFO ] [MAIN ] VATE: Loaded 5259 existing records. [2025-10-09T22:11:33.002800] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:11:33.003032] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-09T22:11:33.003081] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-09T22:11:33.003299] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-09T22:11:33.003364] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-09T22:11:33.360496] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:11:33.486030] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T22:11:33.596666] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-09T22:11:34.396688] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-09T22:11:34.427893] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T22:11:34.805145] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T22:11:34.808286] [INFO ] [REMOTE ] VAC: Full fetch complete (48467 records). [2025-10-09T22:11:34.808374] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-09T22:11:34.913046] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-09T22:11:35.188359] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-09T22:11:35.188437] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-09T22:11:35.189285] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-09T22:11:35.189347] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-09T22:11:35.190357] [DEBUG] [LOCAL ] VAC: Trimmed 48467 records to 34438 (keeping 200 days of data) [2025-10-09T22:11:35.245920] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-09T22:11:35.408720] [DEBUG] [LOCAL ] VAC: Primary data saved (34438 records). [2025-10-09T22:11:35.408879] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-09T22:11:35.408997] [INFO ] [MAIN ] Update Progress: 2214/2373 symbols completed. VAC took 28.7s. Estimated remaining: 22m 22s. Rate: 7.1 symbols/min [2025-10-09T22:11:35.577029] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:11:35.587074] [DEBUG] [LOCAL ] VBF: Loaded 6925 existing records from primary storage. [2025-10-09T22:11:35.587285] [INFO ] [MAIN ] VBF: Loaded 6925 existing records. [2025-10-09T22:11:35.775444] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:11:35.775724] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-09T22:11:35.775779] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-09T22:11:35.775948] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-09T22:11:35.776004] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-09T22:11:36.004242] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-09T22:11:36.130235] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:11:36.440279] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T22:11:36.796732] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-09T22:11:37.596726] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-09T22:11:38.386698] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-09T22:11:38.398199] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-09T22:11:38.437365] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T22:11:38.483359] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T22:11:39.196799] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-09T22:11:39.996783] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-09T22:11:40.535492] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-09T22:11:40.678473] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T22:11:40.798509] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-09T22:11:40.802419] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T22:11:41.596697] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-09T22:11:42.103569] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T22:11:42.396685] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-09T22:11:42.890357] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-09T22:11:42.993526] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T22:11:43.196768] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-09T22:11:43.976478] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T22:11:43.996674] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-09T22:11:44.796749] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-09T22:11:44.808188] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T22:11:45.596787] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-09T22:11:46.303238] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T22:11:46.396686] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-09T22:11:46.632759] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T22:11:46.870211] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T22:11:47.196726] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-09T22:11:47.821947] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T22:11:47.996745] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-09T22:11:48.796715] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-09T22:11:49.449497] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T22:11:49.596706] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-09T22:11:49.739721] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T22:11:50.090348] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T22:11:50.396730] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-09T22:11:51.067730] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T22:11:51.196682] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-09T22:11:51.996718] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-09T22:11:52.086432] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T22:11:52.796731] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-09T22:11:53.596686] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-09T22:11:53.748274] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T22:11:53.789196] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T22:11:54.396716] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-09T22:11:55.196685] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-09T22:11:55.402213] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T22:11:55.400896] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T22:11:55.808254] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T22:11:55.996773] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-09T22:11:56.796730] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-09T22:11:57.596730] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-09T22:11:57.972722] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T22:11:58.180208] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T22:11:58.185042] [INFO ] [REMOTE ] VAL: Full fetch complete (73138 records). [2025-10-09T22:11:58.185233] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-09T22:11:58.401818] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-09T22:11:58.479185] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T22:11:58.696933] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-09T22:11:58.697052] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-09T22:11:58.698435] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-09T22:11:58.698507] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-09T22:11:58.700336] [DEBUG] [LOCAL ] VAL: Trimmed 73138 records to 50558 (keeping 200 days of data) [2025-10-09T22:11:59.027559] [DEBUG] [LOCAL ] VAL: Primary data saved (50558 records). [2025-10-09T22:11:59.027768] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-09T22:11:59.027878] [INFO ] [MAIN ] Update Progress: 2215/2373 symbols completed. VAL took 46.8s. Estimated remaining: 22m 15s. Rate: 7.1 symbols/min [2025-10-09T22:11:59.204637] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:11:59.201428] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T22:11:59.201492] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-09T22:11:59.223597] [DEBUG] [LOCAL ] VCV: Loaded 13580 existing records from primary storage. [2025-10-09T22:11:59.223920] [INFO ] [MAIN ] VCV: Loaded 13580 existing records. [2025-10-09T22:11:59.399239] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:11:59.399472] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-09T22:11:59.399528] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-09T22:11:59.399751] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-09T22:11:59.399822] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-09T22:11:59.750687] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:11:59.996685] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-09T22:12:00.796704] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-09T22:12:00.845012] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T22:12:01.031625] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T22:12:01.499426] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T22:12:01.500911] [INFO ] [REMOTE ] VBF: Full fetch complete (10672 records). [2025-10-09T22:12:01.500981] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-09T22:12:01.601375] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-09T22:12:01.861975] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-09T22:12:01.862052] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-09T22:12:01.862307] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-09T22:12:01.862345] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-09T22:12:01.862802] [DEBUG] [LOCAL ] VBF: Trimmed 10672 records to 7049 (keeping 200 days of data) [2025-10-09T22:12:01.905263] [DEBUG] [LOCAL ] VBF: Primary data saved (7049 records). [2025-10-09T22:12:01.905352] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-09T22:12:01.905429] [INFO ] [MAIN ] Update Progress: 2216/2373 symbols completed. VBF took 26.5s. Estimated remaining: 22m 6s. Rate: 7.1 symbols/min [2025-10-09T22:12:02.071640] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:12:02.112718] [DEBUG] [LOCAL ] VEEV: Loaded 47169 existing records from primary storage. [2025-10-09T22:12:02.113018] [INFO ] [MAIN ] VEEV: Loaded 47169 existing records. [2025-10-09T22:12:02.286100] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:12:02.286298] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-09T22:12:02.286344] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-09T22:12:02.286570] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-09T22:12:02.286627] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-09T22:12:02.401904] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-09T22:12:02.694470] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:12:03.196738] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-09T22:12:03.349168] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T22:12:03.807383] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-09T22:12:03.996710] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-09T22:12:04.564050] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T22:12:04.796697] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-09T22:12:05.603492] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-09T22:12:05.611721] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T22:12:06.102276] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T22:12:06.103270] [INFO ] [REMOTE ] VATE: Full fetch complete (10506 records). [2025-10-09T22:12:06.103349] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-09T22:12:06.403597] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-09T22:12:06.479122] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-09T22:12:06.479325] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-09T22:12:06.479850] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-09T22:12:06.479965] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-09T22:12:06.480905] [DEBUG] [LOCAL ] VATE: Trimmed 10506 records to 5295 (keeping 200 days of data) [2025-10-09T22:12:06.518697] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T22:12:06.546838] [DEBUG] [LOCAL ] VATE: Primary data saved (5295 records). [2025-10-09T22:12:06.546940] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-09T22:12:06.547013] [INFO ] [MAIN ] Update Progress: 2217/2373 symbols completed. VATE took 33.9s. Estimated remaining: 21m 57s. Rate: 7.1 symbols/min [2025-10-09T22:12:06.713703] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:12:06.726680] [DEBUG] [LOCAL ] VEL: Loaded 12445 existing records from primary storage. [2025-10-09T22:12:06.726908] [INFO ] [MAIN ] VEL: Loaded 12445 existing records. [2025-10-09T22:12:06.907857] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:12:06.908116] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-09T22:12:06.908176] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-09T22:12:06.908364] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-09T22:12:06.908421] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-09T22:12:07.201858] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-09T22:12:07.274987] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:12:07.277590] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T22:12:07.996728] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-09T22:12:08.796714] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-09T22:12:08.806355] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T22:12:09.245385] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T22:12:09.596030] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T22:12:09.597947] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-09T22:12:10.396715] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-09T22:12:10.821702] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T22:12:11.154696] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T22:12:11.196668] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-09T22:12:11.900893] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T22:12:11.996737] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-09T22:12:12.796735] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-09T22:12:13.557352] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T22:12:13.561972] [INFO ] [REMOTE ] VALE: Full fetch complete (77763 records). [2025-10-09T22:12:13.562105] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-09T22:12:13.607140] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-09T22:12:13.976236] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-09T22:12:13.976337] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-09T22:12:13.977566] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-09T22:12:13.977693] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-09T22:12:13.979271] [DEBUG] [LOCAL ] VALE: Trimmed 77763 records to 54083 (keeping 200 days of data) [2025-10-09T22:12:14.320379] [DEBUG] [LOCAL ] VALE: Primary data saved (54083 records). [2025-10-09T22:12:14.320637] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-09T22:12:14.320809] [INFO ] [MAIN ] Update Progress: 2218/2373 symbols completed. VALE took 43.7s. Estimated remaining: 21m 49s. Rate: 7.1 symbols/min [2025-10-09T22:12:14.401319] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-09T22:12:14.497050] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:12:14.533239] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T22:12:14.578971] [DEBUG] [LOCAL ] VET: Loaded 44003 existing records from primary storage. [2025-10-09T22:12:14.579296] [INFO ] [MAIN ] VET: Loaded 44003 existing records. [2025-10-09T22:12:14.762763] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:12:14.762993] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-09T22:12:14.763056] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-09T22:12:14.763267] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-09T22:12:14.763325] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-09T22:12:14.881688] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T22:12:15.146253] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:12:15.196740] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-09T22:12:15.493511] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T22:12:15.996720] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-09T22:12:16.800053] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-09T22:12:16.802955] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T22:12:16.899537] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T22:12:17.596706] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-09T22:12:18.396698] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-09T22:12:18.544221] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T22:12:18.605583] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T22:12:19.196743] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-09T22:12:19.855666] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T22:12:19.996725] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-09T22:12:20.047030] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T22:12:20.796696] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-09T22:12:20.978368] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T22:12:21.596681] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-09T22:12:21.621225] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T22:12:22.396791] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-09T22:12:23.178724] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T22:12:23.197215] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T22:12:23.196921] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-09T22:12:23.996750] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-09T22:12:24.796710] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-09T22:12:24.826365] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T22:12:25.596795] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-09T22:12:25.714836] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T22:12:25.859726] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T22:12:26.396816] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-09T22:12:27.050083] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T22:12:27.196737] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-09T22:12:27.911144] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T22:12:27.996696] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-09T22:12:28.252067] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T22:12:28.784767] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T22:12:28.796664] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-09T22:12:29.580092] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T22:12:29.596664] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-09T22:12:30.399582] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-09T22:12:30.401394] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T22:12:31.088731] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T22:12:31.089940] [INFO ] [REMOTE ] VCV: Full fetch complete (18754 records). [2025-10-09T22:12:31.090009] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-09T22:12:31.201783] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-09T22:12:31.449393] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-09T22:12:31.449473] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-09T22:12:31.449985] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-09T22:12:31.450046] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-09T22:12:31.450585] [DEBUG] [LOCAL ] VCV: Trimmed 18754 records to 13626 (keeping 200 days of data) [2025-10-09T22:12:31.535308] [DEBUG] [LOCAL ] VCV: Primary data saved (13626 records). [2025-10-09T22:12:31.535445] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-09T22:12:31.535529] [INFO ] [MAIN ] Update Progress: 2219/2373 symbols completed. VCV took 32.5s. Estimated remaining: 21m 41s. Rate: 7.1 symbols/min [2025-10-09T22:12:31.703802] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:12:31.755278] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-09T22:12:31.755591] [INFO ] [MAIN ] VFC: Loaded 53607 existing records. [2025-10-09T22:12:31.944552] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:12:31.944918] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-09T22:12:31.944967] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-09T22:12:31.945261] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-09T22:12:31.945319] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-09T22:12:32.001930] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-09T22:12:32.056379] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T22:12:32.110787] [INFO ] [REMOTE ] VEL: Full fetch complete (17166 records). [2025-10-09T22:12:32.184725] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-09T22:12:32.483514] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:12:32.722034] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-09T22:12:32.722121] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-09T22:12:32.722548] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-09T22:12:32.722587] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-09T22:12:32.723152] [DEBUG] [LOCAL ] VEL: Trimmed 17166 records to 12524 (keeping 200 days of data) [2025-10-09T22:12:32.797516] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-09T22:12:32.801164] [DEBUG] [LOCAL ] VEL: Primary data saved (12524 records). [2025-10-09T22:12:32.801245] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-09T22:12:32.801338] [INFO ] [MAIN ] Update Progress: 2220/2373 symbols completed. VEL took 26.3s. Estimated remaining: 21m 32s. Rate: 7.1 symbols/min [2025-10-09T22:12:32.967631] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:12:32.967802] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-09T22:12:32.967842] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-09T22:12:32.967951] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-09T22:12:32.967991] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-09T22:12:32.968032] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-09T22:12:32.968063] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-09T22:12:33.315299] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:12:33.596746] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-09T22:12:33.742214] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T22:12:33.804210] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T22:12:33.804547] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-09T22:12:33.804638] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:12:33.804727] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-09T22:12:33.804788] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:12:33.804859] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-09T22:12:33.804922] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-09T22:12:33.804958] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-09T22:12:33.805052] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-09T22:12:33.805122] [INFO ] [MAIN ] Update Progress: 2221/2373 symbols completed. VG took 1.0s. Estimated remaining: 21m 23s. Rate: 7.1 symbols/min [2025-10-09T22:12:33.969563] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:12:33.976363] [DEBUG] [LOCAL ] VGI: Loaded 5188 existing records from primary storage. [2025-10-09T22:12:33.976516] [INFO ] [MAIN ] VGI: Loaded 5188 existing records. [2025-10-09T22:12:34.148765] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:12:34.148933] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-09T22:12:34.148977] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-09T22:12:34.149124] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-09T22:12:34.149180] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-09T22:12:34.399426] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-09T22:12:34.509521] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:12:34.609049] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T22:12:35.196743] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-09T22:12:35.808422] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T22:12:35.996683] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-09T22:12:36.170970] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T22:12:36.654772] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T22:12:36.796679] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-09T22:12:37.385619] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T22:12:37.596676] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-09T22:12:38.396738] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-09T22:12:39.022862] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T22:12:39.024199] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T22:12:39.196717] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-09T22:12:39.996772] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-09T22:12:40.801848] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-09T22:12:40.814079] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T22:12:41.474993] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T22:12:41.479547] [INFO ] [REMOTE ] VEEV: Full fetch complete (68241 records). [2025-10-09T22:12:41.479702] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-09T22:12:41.598787] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-09T22:12:41.901719] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-09T22:12:41.901814] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-09T22:12:41.902920] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-09T22:12:41.902986] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-09T22:12:41.904536] [DEBUG] [LOCAL ] VEEV: Trimmed 68241 records to 47509 (keeping 200 days of data) [2025-10-09T22:12:42.206906] [DEBUG] [LOCAL ] VEEV: Primary data saved (47509 records). [2025-10-09T22:12:42.207076] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-09T22:12:42.207182] [INFO ] [MAIN ] Update Progress: 2222/2373 symbols completed. VEEV took 40.3s. Estimated remaining: 21m 15s. Rate: 7.1 symbols/min [2025-10-09T22:12:42.380550] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:12:42.400823] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-09T22:12:42.401340] [DEBUG] [LOCAL ] VGM: Loaded 18526 existing records from primary storage. [2025-10-09T22:12:42.402593] [INFO ] [MAIN ] VGM: Loaded 18526 existing records. [2025-10-09T22:12:42.605955] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:12:42.606387] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-09T22:12:42.606624] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-09T22:12:42.607088] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-09T22:12:42.607290] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-09T22:12:42.809034] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T22:12:42.914246] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-09T22:12:43.039969] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:12:43.065222] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T22:12:43.196699] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-09T22:12:43.759606] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T22:12:43.996763] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-09T22:12:44.796753] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-09T22:12:44.974814] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T22:12:45.377799] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T22:12:45.596699] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-09T22:12:46.396772] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-09T22:12:46.491801] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T22:12:47.057336] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T22:12:47.196789] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-09T22:12:47.996719] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-09T22:12:48.740275] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T22:12:48.796676] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-09T22:12:49.003911] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T22:12:49.596741] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-09T22:12:50.396815] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-09T22:12:50.447940] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T22:12:50.488268] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T22:12:51.196735] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-09T22:12:51.996703] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-09T22:12:52.185117] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T22:12:52.221019] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T22:12:52.538573] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T22:12:52.796759] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-09T22:12:53.596732] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-09T22:12:54.396777] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-09T22:12:54.674470] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T22:12:54.678734] [INFO ] [REMOTE ] VET: Full fetch complete (64606 records). [2025-10-09T22:12:54.678845] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-09T22:12:55.020991] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-09T22:12:55.114153] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-09T22:12:55.114230] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-09T22:12:55.115277] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-09T22:12:55.115340] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-09T22:12:55.116525] [DEBUG] [LOCAL ] VET: Trimmed 64606 records to 44339 (keeping 200 days of data) [2025-10-09T22:12:55.204787] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-09T22:12:55.386369] [DEBUG] [LOCAL ] VET: Primary data saved (44339 records). [2025-10-09T22:12:55.386558] [INFO ] [MAIN ] VET: Full history saved. [2025-10-09T22:12:55.386699] [INFO ] [MAIN ] Update Progress: 2223/2373 symbols completed. VET took 41.1s. Estimated remaining: 21m 7s. Rate: 7.1 symbols/min [2025-10-09T22:12:55.467376] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T22:12:55.572734] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:12:55.577901] [DEBUG] [LOCAL ] VHI: Loaded 2718 existing records from primary storage. [2025-10-09T22:12:55.578071] [INFO ] [MAIN ] VHI: Loaded 2718 existing records. [2025-10-09T22:12:55.751596] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:12:55.751813] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-09T22:12:55.751861] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-09T22:12:55.752021] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-09T22:12:55.752077] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-09T22:12:56.003586] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-09T22:12:56.108804] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:12:56.796688] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-09T22:12:56.943992] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T22:12:56.967821] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T22:12:57.448944] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T22:12:57.596745] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-09T22:12:58.218801] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T22:12:58.396779] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-09T22:12:58.892033] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T22:12:59.196721] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-09T22:12:59.804267] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T22:12:59.996758] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-09T22:13:00.796698] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-09T22:13:01.068348] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T22:13:01.543583] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T22:13:01.596673] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-09T22:13:02.114481] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T22:13:02.115746] [INFO ] [REMOTE ] VGI: Full fetch complete (7633 records). [2025-10-09T22:13:02.115841] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-09T22:13:02.401932] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-09T22:13:02.509070] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-09T22:13:02.509163] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-09T22:13:02.509402] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-09T22:13:02.509441] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-09T22:13:02.509863] [DEBUG] [LOCAL ] VGI: Trimmed 7633 records to 5227 (keeping 200 days of data) [2025-10-09T22:13:02.542583] [DEBUG] [LOCAL ] VGI: Primary data saved (5227 records). [2025-10-09T22:13:02.542690] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-09T22:13:02.542782] [INFO ] [MAIN ] Update Progress: 2224/2373 symbols completed. VGI took 28.7s. Estimated remaining: 20m 58s. Rate: 7.1 symbols/min [2025-10-09T22:13:02.710444] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:13:02.710663] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-09T22:13:02.710721] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-09T22:13:02.710837] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-09T22:13:02.710878] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-09T22:13:02.710918] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-09T22:13:02.710950] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-09T22:13:03.058826] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:13:03.196745] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-09T22:13:03.506063] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T22:13:03.996738] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-09T22:13:04.567827] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T22:13:04.796742] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-09T22:13:05.019213] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T22:13:05.019583] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-09T22:13:05.019701] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:13:05.019758] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-09T22:13:05.019793] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:13:05.019872] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-09T22:13:05.019937] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-09T22:13:05.019973] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-09T22:13:05.020013] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-09T22:13:05.020061] [INFO ] [MAIN ] Update Progress: 2225/2373 symbols completed. VIA took 2.5s. Estimated remaining: 20m 49s. Rate: 7.1 symbols/min [2025-10-09T22:13:05.207584] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:13:05.258721] [DEBUG] [LOCAL ] VICI: Loaded 53650 existing records from primary storage. [2025-10-09T22:13:05.259145] [INFO ] [MAIN ] VICI: Loaded 53650 existing records. [2025-10-09T22:13:05.402189] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-09T22:13:05.490007] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:13:05.490284] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-09T22:13:05.490359] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-09T22:13:05.490635] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-09T22:13:05.490746] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-09T22:13:05.631054] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-09T22:13:05.890468] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:13:06.396716] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-09T22:13:06.747899] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T22:13:07.196762] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-09T22:13:08.002144] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-09T22:13:08.021730] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T22:13:08.513192] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T22:13:08.796739] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-09T22:13:09.139988] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T22:13:09.300032] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-09T22:13:09.596794] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-09T22:13:10.396747] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-09T22:13:10.412063] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T22:13:10.414413] [INFO ] [REMOTE ] VGM: Full fetch complete (26057 records). [2025-10-09T22:13:10.414502] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-09T22:13:10.786926] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-09T22:13:10.787030] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-09T22:13:10.787558] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-09T22:13:10.787614] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-09T22:13:10.788764] [DEBUG] [LOCAL ] VGM: Trimmed 26057 records to 18599 (keeping 200 days of data) [2025-10-09T22:13:10.905574] [DEBUG] [LOCAL ] VGM: Primary data saved (18599 records). [2025-10-09T22:13:10.905741] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-09T22:13:10.905833] [INFO ] [MAIN ] Update Progress: 2226/2373 symbols completed. VGM took 28.7s. Estimated remaining: 20m 41s. Rate: 7.1 symbols/min [2025-10-09T22:13:11.015964] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T22:13:11.079477] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:13:11.129049] [DEBUG] [LOCAL ] VIK: Loaded 52453 existing records from primary storage. [2025-10-09T22:13:11.129383] [INFO ] [MAIN ] VIK: Loaded 52453 existing records. [2025-10-09T22:13:11.201966] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-09T22:13:11.306372] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:13:11.306579] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-09T22:13:11.306626] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-09T22:13:11.306860] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-09T22:13:11.306941] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-09T22:13:11.658239] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:13:11.996717] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-09T22:13:12.484581] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T22:13:12.796685] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-09T22:13:13.028843] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-09T22:13:13.596716] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-09T22:13:14.097806] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T22:13:14.396691] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-09T22:13:14.729421] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T22:13:15.196701] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-09T22:13:15.970994] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T22:13:15.996676] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-09T22:13:16.796724] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-09T22:13:17.027511] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T22:13:17.596750] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-09T22:13:17.995530] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T22:13:18.396707] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-09T22:13:18.805414] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T22:13:19.196737] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-09T22:13:19.365553] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T22:13:19.996740] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-09T22:13:20.535971] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-09T22:13:20.796695] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-09T22:13:20.866349] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T22:13:21.248049] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T22:13:21.249071] [INFO ] [REMOTE ] VHI: Full fetch complete (4384 records). [2025-10-09T22:13:21.249149] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-09T22:13:21.610139] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-09T22:13:21.617546] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-09T22:13:21.618675] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-09T22:13:21.618902] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-09T22:13:21.619020] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-09T22:13:21.619915] [DEBUG] [LOCAL ] VHI: Trimmed 4384 records to 2752 (keeping 200 days of data) [2025-10-09T22:13:21.637816] [DEBUG] [LOCAL ] VHI: Primary data saved (2752 records). [2025-10-09T22:13:21.637889] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-09T22:13:21.638026] [INFO ] [MAIN ] Update Progress: 2227/2373 symbols completed. VHI took 26.2s. Estimated remaining: 20m 32s. Rate: 7.1 symbols/min [2025-10-09T22:13:21.849332] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:13:21.852208] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T22:13:21.914720] [DEBUG] [LOCAL ] VIPS: Loaded 51234 existing records from primary storage. [2025-10-09T22:13:21.915123] [INFO ] [MAIN ] VIPS: Loaded 51234 existing records. [2025-10-09T22:13:22.092444] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:13:22.092719] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-09T22:13:22.092773] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-09T22:13:22.092967] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-09T22:13:22.093023] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-09T22:13:22.408855] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-09T22:13:22.452280] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:13:23.196777] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-09T22:13:23.647330] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-09T22:13:23.996760] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-09T22:13:24.225891] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T22:13:24.796741] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-09T22:13:25.124438] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T22:13:25.546481] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T22:13:25.596678] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-09T22:13:26.396797] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-09T22:13:26.549856] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T22:13:27.196754] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-09T22:13:27.698420] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-09T22:13:27.778612] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T22:13:27.996759] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-09T22:13:28.796720] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-09T22:13:28.839290] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T22:13:28.843986] [INFO ] [REMOTE ] VFC: Full fetch complete (77590 records). [2025-10-09T22:13:28.844095] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-09T22:13:29.235084] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-09T22:13:29.235178] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-09T22:13:29.236393] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-09T22:13:29.236473] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-09T22:13:29.238127] [DEBUG] [LOCAL ] VFC: Trimmed 77590 records to 53997 (keeping 200 days of data) [2025-10-09T22:13:29.582108] [DEBUG] [LOCAL ] VFC: Primary data saved (53997 records). [2025-10-09T22:13:29.582254] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-09T22:13:29.582420] [INFO ] [MAIN ] Update Progress: 2228/2373 symbols completed. VFC took 58.0s. Estimated remaining: 20m 24s. Rate: 7.1 symbols/min [2025-10-09T22:13:29.614021] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-09T22:13:29.764056] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:13:29.806675] [DEBUG] [LOCAL ] VIRT: Loaded 46775 existing records from primary storage. [2025-10-09T22:13:29.807058] [INFO ] [MAIN ] VIRT: Loaded 46775 existing records. [2025-10-09T22:13:30.015751] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:13:30.016060] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-09T22:13:30.016243] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-09T22:13:30.016752] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-09T22:13:30.016815] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-09T22:13:30.049475] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T22:13:30.418435] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:13:30.412478] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-09T22:13:30.452135] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T22:13:31.005787] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T22:13:31.196776] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-09T22:13:31.996723] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-09T22:13:32.106954] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T22:13:32.796735] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-09T22:13:33.009680] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T22:13:33.584263] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T22:13:33.596682] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-09T22:13:34.294573] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T22:13:34.396771] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-09T22:13:35.075155] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T22:13:35.196689] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-09T22:13:35.763455] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T22:13:35.768403] [INFO ] [REMOTE ] VICI: Full fetch complete (77658 records). [2025-10-09T22:13:35.768566] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-09T22:13:36.005030] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-09T22:13:36.137368] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T22:13:36.222457] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-09T22:13:36.222537] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-09T22:13:36.223790] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-09T22:13:36.223856] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-09T22:13:36.225318] [DEBUG] [LOCAL ] VICI: Trimmed 77658 records to 54040 (keeping 200 days of data) [2025-10-09T22:13:36.571202] [DEBUG] [LOCAL ] VICI: Primary data saved (54040 records). [2025-10-09T22:13:36.571369] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-09T22:13:36.571469] [INFO ] [MAIN ] Update Progress: 2229/2373 symbols completed. VICI took 31.6s. Estimated remaining: 20m 15s. Rate: 7.1 symbols/min [2025-10-09T22:13:36.737410] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:13:36.779943] [DEBUG] [LOCAL ] VIST: Loaded 46177 existing records from primary storage. [2025-10-09T22:13:36.780245] [INFO ] [MAIN ] VIST: Loaded 46177 existing records. [2025-10-09T22:13:36.801794] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-09T22:13:36.957725] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:13:36.957965] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-09T22:13:36.958016] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-09T22:13:36.958225] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-09T22:13:36.958284] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-09T22:13:37.316406] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:13:37.596704] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-09T22:13:38.037713] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T22:13:38.338636] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T22:13:38.396671] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-09T22:13:39.196696] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-09T22:13:39.254567] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T22:13:39.996714] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-09T22:13:40.193569] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T22:13:40.564588] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T22:13:40.796717] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-09T22:13:41.597779] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-09T22:13:41.597691] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T22:13:42.396691] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-09T22:13:42.572445] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T22:13:43.042758] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T22:13:43.196773] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-09T22:13:43.967525] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T22:13:43.996715] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-09T22:13:44.404954] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T22:13:44.796710] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-09T22:13:45.596706] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-09T22:13:45.788554] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T22:13:46.376348] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T22:13:46.396672] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-09T22:13:46.979029] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T22:13:46.983500] [INFO ] [REMOTE ] VIK: Full fetch complete (75904 records). [2025-10-09T22:13:46.983624] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-09T22:13:47.201896] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-09T22:13:47.397817] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-09T22:13:47.397920] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-09T22:13:47.399105] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-09T22:13:47.399212] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-09T22:13:47.400867] [DEBUG] [LOCAL ] VIK: Trimmed 75904 records to 52834 (keeping 200 days of data) [2025-10-09T22:13:47.732162] [DEBUG] [LOCAL ] VIK: Primary data saved (52834 records). [2025-10-09T22:13:47.732337] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-09T22:13:47.732477] [INFO ] [MAIN ] Update Progress: 2230/2373 symbols completed. VIK took 36.8s. Estimated remaining: 20m 7s. Rate: 7.1 symbols/min [2025-10-09T22:13:47.907763] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:13:47.949131] [DEBUG] [LOCAL ] VIV: Loaded 44856 existing records from primary storage. [2025-10-09T22:13:47.949436] [INFO ] [MAIN ] VIV: Loaded 44856 existing records. [2025-10-09T22:13:48.005551] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-09T22:13:48.135231] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:13:48.135525] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-09T22:13:48.135590] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-09T22:13:48.135845] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-09T22:13:48.135941] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-09T22:13:48.349151] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T22:13:48.555146] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:13:48.796710] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-09T22:13:49.007699] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T22:13:49.596734] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-09T22:13:49.798022] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T22:13:50.098943] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T22:13:50.396741] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-09T22:13:51.023671] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T22:13:51.196734] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-09T22:13:51.996723] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-09T22:13:52.028893] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T22:13:52.395966] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T22:13:52.796727] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-09T22:13:53.544614] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T22:13:53.596690] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-09T22:13:54.275384] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T22:13:54.396735] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-09T22:13:55.196734] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-09T22:13:55.315085] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T22:13:55.996732] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-09T22:13:56.048658] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T22:13:56.456117] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T22:13:56.796776] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-09T22:13:57.501490] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T22:13:57.505972] [INFO ] [REMOTE ] VIPS: Full fetch complete (74553 records). [2025-10-09T22:13:57.506087] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-09T22:13:57.601873] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-09T22:13:57.914602] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-09T22:13:57.914715] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-09T22:13:57.915872] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-09T22:13:57.915937] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-09T22:13:57.917399] [DEBUG] [LOCAL ] VIPS: Trimmed 74553 records to 51610 (keeping 200 days of data) [2025-10-09T22:13:58.261921] [DEBUG] [LOCAL ] VIPS: Primary data saved (51610 records). [2025-10-09T22:13:58.262061] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-09T22:13:58.262186] [INFO ] [MAIN ] Update Progress: 2231/2373 symbols completed. VIPS took 36.6s. Estimated remaining: 19m 59s. Rate: 7.1 symbols/min [2025-10-09T22:13:58.409857] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-09T22:13:58.475936] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:13:58.506319] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T22:13:58.529256] [DEBUG] [LOCAL ] VKQ: Loaded 17454 existing records from primary storage. [2025-10-09T22:13:58.529538] [INFO ] [MAIN ] VKQ: Loaded 17454 existing records. [2025-10-09T22:13:58.721443] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:13:58.721695] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-09T22:13:58.721754] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-09T22:13:58.721969] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-09T22:13:58.722025] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-09T22:13:59.100001] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:13:59.196764] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-09T22:13:59.430768] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T22:13:59.996721] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-09T22:14:00.129737] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T22:14:00.636709] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T22:14:00.796779] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-09T22:14:01.099548] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T22:14:01.596750] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-09T22:14:02.126297] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T22:14:02.396751] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-09T22:14:02.874588] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T22:14:03.196733] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-09T22:14:03.996750] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-09T22:14:04.210447] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T22:14:04.797121] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-09T22:14:04.803665] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T22:14:05.410326] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T22:14:05.596730] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-09T22:14:06.325525] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T22:14:06.329532] [INFO ] [REMOTE ] VIST: Full fetch complete (66740 records). [2025-10-09T22:14:06.329629] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-09T22:14:06.403036] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-09T22:14:06.715800] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-09T22:14:06.715987] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-09T22:14:06.717120] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-09T22:14:06.717183] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-09T22:14:06.718468] [DEBUG] [LOCAL ] VIST: Trimmed 66740 records to 46544 (keeping 200 days of data) [2025-10-09T22:14:06.849448] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T22:14:07.026168] [DEBUG] [LOCAL ] VIST: Primary data saved (46544 records). [2025-10-09T22:14:07.026319] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-09T22:14:07.026420] [INFO ] [MAIN ] Update Progress: 2232/2373 symbols completed. VIST took 30.5s. Estimated remaining: 19m 50s. Rate: 7.1 symbols/min [2025-10-09T22:14:07.199029] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:14:07.197162] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-09T22:14:07.233622] [DEBUG] [LOCAL ] VLN: Loaded 29689 existing records from primary storage. [2025-10-09T22:14:07.233946] [INFO ] [MAIN ] VLN: Loaded 29689 existing records. [2025-10-09T22:14:07.412193] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:14:07.412399] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-09T22:14:07.412446] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-09T22:14:07.412684] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-09T22:14:07.412742] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-09T22:14:07.803151] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:14:07.996705] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-09T22:14:08.164103] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T22:14:08.201301] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T22:14:08.796718] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-09T22:14:09.479033] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T22:14:09.483193] [INFO ] [REMOTE ] VIRT: Full fetch complete (67291 records). [2025-10-09T22:14:09.483309] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-09T22:14:09.601800] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-09T22:14:09.892629] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-09T22:14:09.892759] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-09T22:14:09.893960] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-09T22:14:09.894036] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-09T22:14:09.895528] [DEBUG] [LOCAL ] VIRT: Trimmed 67291 records to 47109 (keeping 200 days of data) [2025-10-09T22:14:10.046299] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T22:14:10.248412] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T22:14:10.259584] [DEBUG] [LOCAL ] VIRT: Primary data saved (47109 records). [2025-10-09T22:14:10.259700] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-09T22:14:10.259785] [INFO ] [MAIN ] Update Progress: 2233/2373 symbols completed. VIRT took 40.7s. Estimated remaining: 19m 42s. Rate: 7.1 symbols/min [2025-10-09T22:14:10.398330] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-09T22:14:10.434795] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:14:10.485015] [DEBUG] [LOCAL ] VLO: Loaded 53081 existing records from primary storage. [2025-10-09T22:14:10.485352] [INFO ] [MAIN ] VLO: Loaded 53081 existing records. [2025-10-09T22:14:10.659982] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:14:10.660220] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-09T22:14:10.660267] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-09T22:14:10.660538] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-09T22:14:10.660594] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-09T22:14:11.006253] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:14:11.196707] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-09T22:14:11.960200] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T22:14:11.996734] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-09T22:14:12.796694] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-09T22:14:12.864221] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T22:14:13.033345] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T22:14:13.596783] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-09T22:14:13.785877] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T22:14:14.396725] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-09T22:14:15.138315] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T22:14:15.196698] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-09T22:14:15.510408] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T22:14:15.996703] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-09T22:14:16.508587] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T22:14:16.512444] [INFO ] [REMOTE ] VIV: Full fetch complete (64443 records). [2025-10-09T22:14:16.512608] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-09T22:14:16.801861] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-09T22:14:16.926315] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-09T22:14:16.927313] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T22:14:16.926958] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-09T22:14:16.932905] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-09T22:14:16.933262] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-09T22:14:16.934415] [DEBUG] [LOCAL ] VIV: Trimmed 64443 records to 45144 (keeping 200 days of data) [2025-10-09T22:14:17.206378] [DEBUG] [LOCAL ] VIV: Primary data saved (45144 records). [2025-10-09T22:14:17.206505] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-09T22:14:17.206661] [INFO ] [MAIN ] Update Progress: 2234/2373 symbols completed. VIV took 29.5s. Estimated remaining: 19m 33s. Rate: 7.1 symbols/min [2025-10-09T22:14:17.371873] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:14:17.406660] [DEBUG] [LOCAL ] VLRS: Loaded 40181 existing records from primary storage. [2025-10-09T22:14:17.406945] [INFO ] [MAIN ] VLRS: Loaded 40181 existing records. [2025-10-09T22:14:17.588199] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:14:17.588389] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-09T22:14:17.588453] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-09T22:14:17.588685] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-09T22:14:17.588743] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-09T22:14:17.601894] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-09T22:14:17.936864] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:14:18.396687] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-09T22:14:18.834684] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-09T22:14:18.856612] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T22:14:19.196702] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-09T22:14:19.615885] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T22:14:19.996776] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-09T22:14:20.796699] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-09T22:14:20.936995] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T22:14:21.038784] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T22:14:21.499736] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T22:14:21.596687] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-09T22:14:22.396760] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-09T22:14:22.705306] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T22:14:23.196728] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-09T22:14:23.621392] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T22:14:23.996724] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-09T22:14:24.796706] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-09T22:14:24.991893] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T22:14:25.133785] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T22:14:25.596696] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-09T22:14:25.934503] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T22:14:26.396727] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-09T22:14:27.196741] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-09T22:14:27.529200] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T22:14:27.564621] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T22:14:27.983443] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T22:14:27.996662] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-09T22:14:28.796709] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-09T22:14:28.984029] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T22:14:29.596755] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-09T22:14:30.022587] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T22:14:30.396778] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-09T22:14:31.169241] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T22:14:31.196677] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-09T22:14:31.904679] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T22:14:31.996726] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-09T22:14:32.802002] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-09T22:14:32.816863] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T22:14:33.596681] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-09T22:14:33.948959] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-09T22:14:34.177501] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T22:14:34.396769] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-09T22:14:34.704478] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T22:14:35.196725] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-09T22:14:35.996755] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-09T22:14:36.056884] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T22:14:36.519109] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T22:14:36.522445] [INFO ] [REMOTE ] VLN: Full fetch complete (43203 records). [2025-10-09T22:14:36.522529] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-09T22:14:36.700793] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T22:14:36.716766] [INFO ] [REMOTE ] VKQ: Full fetch complete (24387 records). [2025-10-09T22:14:36.716934] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-09T22:14:36.798148] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-09T22:14:37.268023] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-09T22:14:37.270381] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-09T22:14:37.271575] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-09T22:14:37.271718] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-09T22:14:37.329609] [DEBUG] [LOCAL ] VLN: Trimmed 43203 records to 30025 (keeping 200 days of data) [2025-10-09T22:14:37.402578] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-09T22:14:37.411871] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-09T22:14:37.412175] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-09T22:14:37.412249] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-09T22:14:37.442559] [DEBUG] [LOCAL ] VKQ: Trimmed 24387 records to 17513 (keeping 200 days of data) [2025-10-09T22:14:37.598484] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-09T22:14:37.620582] [DEBUG] [LOCAL ] VKQ: Primary data saved (17513 records). [2025-10-09T22:14:37.621695] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-09T22:14:37.622706] [INFO ] [MAIN ] Update Progress: 2235/2373 symbols completed. VKQ took 39.4s. Estimated remaining: 19m 25s. Rate: 7.1 symbols/min [2025-10-09T22:14:37.803396] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:14:37.814005] [DEBUG] [LOCAL ] VLT: Loaded 4527 existing records from primary storage. [2025-10-09T22:14:37.815026] [INFO ] [MAIN ] VLT: Loaded 4527 existing records. [2025-10-09T22:14:37.875220] [DEBUG] [LOCAL ] VLN: Primary data saved (30025 records). [2025-10-09T22:14:37.900614] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-09T22:14:37.926082] [INFO ] [MAIN ] Update Progress: 2236/2373 symbols completed. VLN took 30.9s. Estimated remaining: 19m 16s. Rate: 7.1 symbols/min [2025-10-09T22:14:38.128546] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:14:38.134736] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-09T22:14:38.140135] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-09T22:14:38.155850] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-09T22:14:38.169483] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-09T22:14:38.223321] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:14:38.379166] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T22:14:38.501525] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-09T22:14:38.629437] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:14:38.630377] [DEBUG] [LOCAL ] VLTO: Loaded 46089 existing records from primary storage. [2025-10-09T22:14:38.631097] [INFO ] [MAIN ] VLTO: Loaded 46089 existing records. [2025-10-09T22:14:38.802801] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:14:38.803045] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-09T22:14:38.803095] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-09T22:14:38.803369] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-09T22:14:38.803426] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-09T22:14:39.150813] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:14:39.196666] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-09T22:14:39.537995] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T22:14:39.996802] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-09T22:14:40.073853] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T22:14:40.353078] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T22:14:40.491046] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T22:14:40.796725] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-09T22:14:41.596750] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-09T22:14:42.396759] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-09T22:14:42.772264] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T22:14:42.821568] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T22:14:43.196717] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-09T22:14:43.347169] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T22:14:43.996756] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-09T22:14:44.465891] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T22:14:44.796703] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-09T22:14:45.596720] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-09T22:14:45.631516] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T22:14:45.951280] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T22:14:46.396738] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-09T22:14:47.041017] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T22:14:47.196691] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-09T22:14:47.286300] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T22:14:47.826584] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T22:14:47.996730] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-09T22:14:48.734419] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T22:14:48.796697] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-09T22:14:49.596733] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-09T22:14:50.396762] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-09T22:14:50.688393] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T22:14:50.928611] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T22:14:50.974230] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T22:14:51.196699] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-09T22:14:51.755369] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T22:14:51.759993] [INFO ] [REMOTE ] VLO: Full fetch complete (76887 records). [2025-10-09T22:14:51.760098] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-09T22:14:52.001932] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-09T22:14:52.170440] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-09T22:14:52.170541] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-09T22:14:52.171771] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-09T22:14:52.171846] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-09T22:14:52.173755] [DEBUG] [LOCAL ] VLO: Trimmed 76887 records to 53457 (keeping 200 days of data) [2025-10-09T22:14:52.667390] [DEBUG] [LOCAL ] VLO: Primary data saved (53457 records). [2025-10-09T22:14:52.667670] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-09T22:14:52.667825] [INFO ] [MAIN ] Update Progress: 2237/2373 symbols completed. VLO took 42.4s. Estimated remaining: 19m 8s. Rate: 7.1 symbols/min [2025-10-09T22:14:52.796804] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-09T22:14:53.303239] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T22:14:53.307750] [INFO ] [REMOTE ] VLRS: Full fetch complete (58387 records). [2025-10-09T22:14:53.307907] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-09T22:14:53.418498] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T22:14:53.605156] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-09T22:14:53.786013] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-09T22:14:53.786153] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-09T22:14:53.787221] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-09T22:14:53.787284] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-09T22:14:53.790847] [DEBUG] [LOCAL ] VLRS: Trimmed 58387 records to 40415 (keeping 200 days of data) [2025-10-09T22:14:54.022965] [DEBUG] [LOCAL ] VLRS: Primary data saved (40415 records). [2025-10-09T22:14:54.023097] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-09T22:14:54.023191] [INFO ] [MAIN ] Update Progress: 2238/2373 symbols completed. VLRS took 36.8s. Estimated remaining: 18m 60s. Rate: 7.1 symbols/min [2025-10-09T22:14:54.396807] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-09T22:14:54.965062] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T22:14:55.196726] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-09T22:14:55.392039] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T22:14:55.788034] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T22:14:55.996716] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-09T22:14:56.526089] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T22:14:56.796724] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-09T22:14:57.227677] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T22:14:57.228602] [INFO ] [REMOTE ] VLT: Full fetch complete (7487 records). [2025-10-09T22:14:57.228722] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-09T22:14:57.596694] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-09T22:14:57.597638] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-09T22:14:57.597739] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-09T22:14:57.598026] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-09T22:14:57.598083] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-09T22:14:57.598578] [DEBUG] [LOCAL ] VLT: Trimmed 7487 records to 4541 (keeping 200 days of data) [2025-10-09T22:14:57.628775] [DEBUG] [LOCAL ] VLT: Primary data saved (4541 records). [2025-10-09T22:14:57.628904] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-09T22:14:57.628996] [INFO ] [MAIN ] Update Progress: 2239/2373 symbols completed. VLT took 20.0s. Estimated remaining: 18m 51s. Rate: 7.1 symbols/min [2025-10-09T22:14:59.241462] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T22:14:59.251999] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-09T22:15:00.739287] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T22:15:00.749461] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-09T22:15:02.193065] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T22:15:02.203898] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-09T22:15:03.870221] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T22:15:03.880002] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-09T22:15:05.494733] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T22:15:05.504914] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-09T22:15:06.076148] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T22:15:06.080261] [INFO ] [REMOTE ] VLTO: Full fetch complete (66997 records). [2025-10-09T22:15:06.080368] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-09T22:15:06.471814] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-09T22:15:06.471897] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-09T22:15:06.472966] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-09T22:15:06.473032] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-09T22:15:06.474327] [DEBUG] [LOCAL ] VLTO: Trimmed 66997 records to 46451 (keeping 200 days of data) [2025-10-09T22:15:06.770721] [DEBUG] [LOCAL ] VLTO: Primary data saved (46451 records). [2025-10-09T22:15:06.770862] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-09T22:15:06.770948] [INFO ] [MAIN ] Update Progress: 2240/2373 symbols completed. VLTO took 28.8s. Estimated remaining: 18m 42s. Rate: 7.1 symbols/min [2025-10-09T22:15:07.384062] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:15:07.468977] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:15:07.450828] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:15:07.487595] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:15:07.516596] [DEBUG] [LOCAL ] VNCE: Loaded 8493 existing records from primary storage. [2025-10-09T22:15:07.518484] [DEBUG] [LOCAL ] VMO: Loaded 20901 existing records from primary storage. [2025-10-09T22:15:07.518921] [INFO ] [MAIN ] VNCE: Loaded 8493 existing records. [2025-10-09T22:15:07.519304] [INFO ] [MAIN ] VMO: Loaded 20901 existing records. [2025-10-09T22:15:07.570335] [DEBUG] [LOCAL ] VMI: Loaded 15305 existing records from primary storage. [2025-10-09T22:15:07.666699] [INFO ] [MAIN ] VMI: Loaded 15305 existing records. [2025-10-09T22:15:07.911539] [DEBUG] [LOCAL ] VMC: Loaded 42896 existing records from primary storage. [2025-10-09T22:15:07.997717] [INFO ] [MAIN ] VMC: Loaded 42896 existing records. [2025-10-09T22:15:08.001223] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:15:08.066750] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-09T22:15:08.092460] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-09T22:15:08.177377] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-09T22:15:08.179825] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-09T22:15:08.188597] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:15:08.236154] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-09T22:15:08.245751] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-09T22:15:08.202048] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:15:08.281019] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-09T22:15:08.286331] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-09T22:15:08.270601] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-09T22:15:08.352051] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-09T22:15:08.422328] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:15:08.443457] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-09T22:15:08.464732] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-09T22:15:08.464819] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-09T22:15:08.480750] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-09T22:15:08.500337] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-09T22:15:08.525302] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-09T22:15:09.413612] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:15:09.497868] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-09T22:15:09.782112] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:15:09.808480] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-09T22:15:09.875803] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:15:09.892531] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-09T22:15:09.959891] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:15:09.960280] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-09T22:15:10.735435] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T22:15:10.739729] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-09T22:15:10.881294] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T22:15:10.884467] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-09T22:15:11.029021] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T22:15:11.034332] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-09T22:15:11.458723] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T22:15:11.467103] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-09T22:15:11.774339] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T22:15:11.777855] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-09T22:15:11.861499] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T22:15:11.866041] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-09T22:15:12.077862] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T22:15:12.083260] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-09T22:15:12.402533] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T22:15:12.406443] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-09T22:15:12.632631] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T22:15:12.639936] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-09T22:15:12.667258] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T22:15:12.796727] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-09T22:15:12.834532] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T22:15:13.596727] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-09T22:15:13.741249] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T22:15:13.818261] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T22:15:14.066094] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T22:15:14.206930] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T22:15:14.396730] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-09T22:15:15.092910] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T22:15:15.196700] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-09T22:15:15.688298] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T22:15:15.996688] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-09T22:15:16.796692] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-09T22:15:17.059032] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T22:15:17.583468] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T22:15:17.596675] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-09T22:15:18.396683] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-09T22:15:18.456394] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T22:15:18.862309] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T22:15:19.196712] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-09T22:15:19.805055] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T22:15:19.996712] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-09T22:15:20.552463] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T22:15:20.796708] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-09T22:15:21.596693] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-09T22:15:21.905255] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T22:15:22.396737] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-09T22:15:22.679143] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T22:15:23.196806] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-09T22:15:23.448331] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T22:15:23.996757] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-09T22:15:24.432013] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T22:15:24.434193] [INFO ] [REMOTE ] VNCE: Full fetch complete (15996 records). [2025-10-09T22:15:24.434284] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-09T22:15:24.801849] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-09T22:15:24.869995] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-09T22:15:24.870098] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-09T22:15:24.870586] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-09T22:15:24.870675] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-09T22:15:24.871599] [DEBUG] [LOCAL ] VNCE: Trimmed 15996 records to 8599 (keeping 200 days of data) [2025-10-09T22:15:24.923354] [DEBUG] [LOCAL ] VNCE: Primary data saved (8599 records). [2025-10-09T22:15:24.923507] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-09T22:15:24.923608] [INFO ] [MAIN ] Update Progress: 2241/2373 symbols completed. VNCE took 18.1s. Estimated remaining: 18m 35s. Rate: 7.1 symbols/min [2025-10-09T22:15:25.097769] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:15:25.141366] [DEBUG] [LOCAL ] VNO: Loaded 48848 existing records from primary storage. [2025-10-09T22:15:25.141747] [INFO ] [MAIN ] VNO: Loaded 48848 existing records. [2025-10-09T22:15:25.324061] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:15:25.324284] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-09T22:15:25.324359] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-09T22:15:25.324604] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-09T22:15:25.324689] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-09T22:15:25.597945] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-09T22:15:25.682108] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:15:25.856211] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T22:15:25.896752] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T22:15:26.281968] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T22:15:26.396732] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-09T22:15:27.196738] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-09T22:15:27.396690] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T22:15:27.996762] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-09T22:15:28.796693] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-09T22:15:28.828830] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T22:15:28.920206] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T22:15:29.596792] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-09T22:15:30.396701] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-09T22:15:30.623474] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T22:15:31.196686] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-09T22:15:31.245016] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T22:15:31.547951] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T22:15:31.996757] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-09T22:15:32.796707] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-09T22:15:32.870181] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T22:15:32.872478] [INFO ] [REMOTE ] VMO: Full fetch complete (31212 records). [2025-10-09T22:15:32.872554] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-09T22:15:33.193163] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T22:15:33.294066] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-09T22:15:33.294155] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-09T22:15:33.294917] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-09T22:15:33.294982] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-09T22:15:33.295774] [DEBUG] [LOCAL ] VMO: Trimmed 31212 records to 21053 (keeping 200 days of data) [2025-10-09T22:15:33.430122] [DEBUG] [LOCAL ] VMO: Primary data saved (21053 records). [2025-10-09T22:15:33.430248] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-09T22:15:33.430351] [INFO ] [MAIN ] Update Progress: 2242/2373 symbols completed. VMO took 26.7s. Estimated remaining: 18m 26s. Rate: 7.1 symbols/min [2025-10-09T22:15:33.607017] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:15:33.602828] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-09T22:15:33.649782] [DEBUG] [LOCAL ] VNT: Loaded 43632 existing records from primary storage. [2025-10-09T22:15:33.650110] [INFO ] [MAIN ] VNT: Loaded 43632 existing records. [2025-10-09T22:15:33.853489] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:15:33.862353] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-09T22:15:33.862469] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-09T22:15:33.863365] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-09T22:15:33.863322] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T22:15:33.863471] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-09T22:15:34.216225] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:15:34.396738] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-09T22:15:35.132870] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T22:15:35.196674] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-09T22:15:35.845151] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T22:15:35.996680] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-09T22:15:36.796684] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-09T22:15:36.969182] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T22:15:37.596768] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-09T22:15:37.733254] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T22:15:37.790978] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T22:15:38.396744] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-09T22:15:39.196749] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-09T22:15:39.363009] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T22:15:39.888200] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T22:15:39.996730] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-09T22:15:40.725780] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T22:15:40.796705] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-09T22:15:41.598092] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-09T22:15:41.600419] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T22:15:42.357688] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T22:15:42.396709] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-09T22:15:42.407139] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T22:15:42.408882] [INFO ] [REMOTE ] VMI: Full fetch complete (21129 records). [2025-10-09T22:15:42.408958] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-09T22:15:42.767173] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-09T22:15:42.767252] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-09T22:15:42.767752] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-09T22:15:42.767816] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-09T22:15:42.768733] [DEBUG] [LOCAL ] VMI: Trimmed 21129 records to 15383 (keeping 200 days of data) [2025-10-09T22:15:42.870558] [DEBUG] [LOCAL ] VMI: Primary data saved (15383 records). [2025-10-09T22:15:42.870730] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-09T22:15:42.870865] [INFO ] [MAIN ] Update Progress: 2243/2373 symbols completed. VMI took 36.1s. Estimated remaining: 18m 18s. Rate: 7.1 symbols/min [2025-10-09T22:15:43.042109] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:15:43.053369] [DEBUG] [LOCAL ] VOC: Loaded 9006 existing records from primary storage. [2025-10-09T22:15:43.053592] [INFO ] [MAIN ] VOC: Loaded 9006 existing records. [2025-10-09T22:15:43.201942] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-09T22:15:43.243582] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:15:43.244005] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-09T22:15:43.244058] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-09T22:15:43.244225] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-09T22:15:43.244283] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-09T22:15:43.617333] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:15:43.996693] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-09T22:15:44.029781] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T22:15:44.512211] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T22:15:44.796785] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-09T22:15:45.304436] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T22:15:45.596794] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-09T22:15:46.355131] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T22:15:46.396674] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-09T22:15:46.469994] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T22:15:47.027116] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T22:15:47.196730] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-09T22:15:47.996709] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-09T22:15:48.009700] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T22:15:48.796729] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-09T22:15:49.596749] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-09T22:15:49.637769] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T22:15:50.292455] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T22:15:50.396726] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-09T22:15:50.424678] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T22:15:51.196732] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-09T22:15:51.656728] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T22:15:51.660290] [INFO ] [REMOTE ] VMC: Full fetch complete (62257 records). [2025-10-09T22:15:51.680526] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-09T22:15:51.682673] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T22:15:52.001947] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-09T22:15:52.079966] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-09T22:15:52.080046] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-09T22:15:52.081105] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-09T22:15:52.081168] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-09T22:15:52.082463] [DEBUG] [LOCAL ] VMC: Trimmed 62257 records to 43080 (keeping 200 days of data) [2025-10-09T22:15:52.354345] [DEBUG] [LOCAL ] VMC: Primary data saved (43080 records). [2025-10-09T22:15:52.354471] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-09T22:15:52.354564] [INFO ] [MAIN ] Update Progress: 2244/2373 symbols completed. VMC took 45.6s. Estimated remaining: 18m 9s. Rate: 7.1 symbols/min [2025-10-09T22:15:52.519818] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:15:52.561806] [DEBUG] [LOCAL ] VOYA: Loaded 42245 existing records from primary storage. [2025-10-09T22:15:52.562192] [INFO ] [MAIN ] VOYA: Loaded 42245 existing records. [2025-10-09T22:15:52.737302] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:15:52.737499] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-09T22:15:52.737557] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-09T22:15:52.737822] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-09T22:15:52.737879] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-09T22:15:52.801920] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-09T22:15:53.091154] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:15:53.586154] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T22:15:53.596775] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-09T22:15:54.396691] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-09T22:15:54.423216] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T22:15:54.460526] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T22:15:55.196754] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-09T22:15:55.996771] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-09T22:15:56.060962] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T22:15:56.779635] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T22:15:56.796665] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-09T22:15:56.832386] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T22:15:57.596730] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-09T22:15:58.279249] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T22:15:58.396754] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-09T22:15:59.196757] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-09T22:15:59.332454] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T22:15:59.926633] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T22:15:59.996675] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-09T22:16:00.796695] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-09T22:16:01.002015] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T22:16:01.596768] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-09T22:16:01.723880] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T22:16:02.230245] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T22:16:02.234809] [INFO ] [REMOTE ] VNO: Full fetch complete (70365 records). [2025-10-09T22:16:02.235049] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-09T22:16:02.358994] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T22:16:02.400781] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-09T22:16:02.649476] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-09T22:16:02.649594] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-09T22:16:02.650868] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-09T22:16:02.650933] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-09T22:16:02.652351] [DEBUG] [LOCAL ] VNO: Trimmed 70365 records to 49196 (keeping 200 days of data) [2025-10-09T22:16:02.939106] [DEBUG] [LOCAL ] VNO: Primary data saved (49196 records). [2025-10-09T22:16:02.939244] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-09T22:16:02.939357] [INFO ] [MAIN ] Update Progress: 2245/2373 symbols completed. VNO took 38.0s. Estimated remaining: 18m 1s. Rate: 7.1 symbols/min [2025-10-09T22:16:03.108052] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:03.108212] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-09T22:16:03.108250] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-09T22:16:03.108362] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-09T22:16:03.108405] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-09T22:16:03.108447] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-09T22:16:03.108480] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-09T22:16:03.201843] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-09T22:16:03.479723] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:03.818157] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T22:16:03.996755] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-09T22:16:04.212566] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T22:16:04.213022] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-09T22:16:04.213163] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:16:04.213257] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-09T22:16:04.213342] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:16:04.213435] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-09T22:16:04.213544] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-09T22:16:04.213607] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-09T22:16:04.213730] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-09T22:16:04.213826] [INFO ] [MAIN ] Update Progress: 2246/2373 symbols completed. VOYG took 1.3s. Estimated remaining: 17m 52s. Rate: 7.1 symbols/min [2025-10-09T22:16:04.414831] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:04.433868] [DEBUG] [LOCAL ] VPG: Loaded 17071 existing records from primary storage. [2025-10-09T22:16:04.434160] [INFO ] [MAIN ] VPG: Loaded 17071 existing records. [2025-10-09T22:16:04.627565] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:16:04.627979] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-09T22:16:04.628038] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-09T22:16:04.628219] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-09T22:16:04.628278] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-09T22:16:04.796721] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-09T22:16:04.861195] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T22:16:05.045225] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:05.596769] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-09T22:16:06.280135] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T22:16:06.396755] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-09T22:16:06.571304] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T22:16:07.196722] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-09T22:16:07.220259] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T22:16:07.996731] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-09T22:16:08.518057] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T22:16:08.523260] [INFO ] [REMOTE ] VNT: Full fetch complete (63497 records). [2025-10-09T22:16:08.523476] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-09T22:16:08.801825] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-09T22:16:08.934586] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-09T22:16:08.934688] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-09T22:16:08.935740] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-09T22:16:08.935801] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-09T22:16:08.936960] [DEBUG] [LOCAL ] VNT: Trimmed 63497 records to 43984 (keeping 200 days of data) [2025-10-09T22:16:09.200114] [DEBUG] [LOCAL ] VNT: Primary data saved (43984 records). [2025-10-09T22:16:09.200325] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-09T22:16:09.200436] [INFO ] [MAIN ] Update Progress: 2247/2373 symbols completed. VNT took 35.8s. Estimated remaining: 17m 43s. Rate: 7.1 symbols/min [2025-10-09T22:16:09.369582] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:09.376614] [DEBUG] [LOCAL ] VPV: Loaded 5408 existing records from primary storage. [2025-10-09T22:16:09.376813] [INFO ] [MAIN ] VPV: Loaded 5408 existing records. [2025-10-09T22:16:09.574995] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T22:16:09.580127] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:16:09.589329] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-09T22:16:09.589402] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-09T22:16:09.589855] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-09T22:16:09.590038] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-09T22:16:09.601782] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-09T22:16:09.753238] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T22:16:09.959909] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:10.396717] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-09T22:16:10.980230] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T22:16:11.021275] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T22:16:11.196716] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-09T22:16:11.979943] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T22:16:11.996663] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-09T22:16:12.739307] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T22:16:12.796702] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-09T22:16:13.461775] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T22:16:13.596732] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-09T22:16:14.396703] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-09T22:16:14.611967] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T22:16:15.196719] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-09T22:16:15.966189] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T22:16:15.996686] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-09T22:16:16.291300] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T22:16:16.796721] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-09T22:16:17.268923] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T22:16:17.596739] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-09T22:16:17.994369] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T22:16:18.168704] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T22:16:18.396684] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-09T22:16:19.200046] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-09T22:16:19.202871] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T22:16:19.996744] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-09T22:16:20.213241] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T22:16:20.780298] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T22:16:20.796675] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-09T22:16:21.596689] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-09T22:16:21.645490] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T22:16:22.326964] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T22:16:22.396695] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-09T22:16:23.196723] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-09T22:16:23.562236] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T22:16:23.565803] [INFO ] [REMOTE ] VOYA: Full fetch complete (61649 records). [2025-10-09T22:16:23.565898] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-09T22:16:23.838505] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T22:16:23.863706] [INFO ] [REMOTE ] VOC: Full fetch complete (13164 records). [2025-10-09T22:16:23.866029] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-09T22:16:24.010075] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-09T22:16:24.070436] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-09T22:16:24.086341] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-09T22:16:24.092942] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-09T22:16:24.109827] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-09T22:16:24.216289] [DEBUG] [LOCAL ] VOYA: Trimmed 61649 records to 42548 (keeping 200 days of data) [2025-10-09T22:16:24.434353] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-09T22:16:24.434744] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-09T22:16:24.435408] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-09T22:16:24.435781] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-09T22:16:24.437773] [DEBUG] [LOCAL ] VOC: Trimmed 13164 records to 9062 (keeping 200 days of data) [2025-10-09T22:16:24.619755] [DEBUG] [LOCAL ] VOC: Primary data saved (9062 records). [2025-10-09T22:16:24.620784] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-09T22:16:24.621162] [INFO ] [MAIN ] Update Progress: 2248/2373 symbols completed. VOC took 41.8s. Estimated remaining: 17m 35s. Rate: 7.1 symbols/min [2025-10-09T22:16:24.731245] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T22:16:24.798865] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-09T22:16:24.827415] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:24.883100] [DEBUG] [LOCAL ] VOYA: Primary data saved (42548 records). [2025-10-09T22:16:24.883247] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-09T22:16:24.883338] [INFO ] [MAIN ] Update Progress: 2249/2373 symbols completed. VOYA took 32.5s. Estimated remaining: 17m 27s. Rate: 7.1 symbols/min [2025-10-09T22:16:25.017485] [DEBUG] [LOCAL ] VRE: Loaded 35071 existing records from primary storage. [2025-10-09T22:16:25.036045] [INFO ] [MAIN ] VRE: Loaded 35071 existing records. [2025-10-09T22:16:25.168974] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:25.250198] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:16:25.250493] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-09T22:16:25.250543] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-09T22:16:25.250792] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-09T22:16:25.250851] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-09T22:16:25.491591] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T22:16:25.579781] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-09T22:16:25.580490] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-09T22:16:25.601766] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-09T22:16:25.797897] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:25.851763] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:16:25.852027] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-09T22:16:25.852082] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-09T22:16:25.852300] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-09T22:16:25.852356] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-09T22:16:26.209945] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:26.295996] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T22:16:26.396707] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-09T22:16:27.196695] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-09T22:16:27.604495] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T22:16:27.611905] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T22:16:27.996745] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-09T22:16:28.428444] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T22:16:28.429535] [INFO ] [REMOTE ] VPV: Full fetch complete (9087 records). [2025-10-09T22:16:28.429602] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-09T22:16:28.799391] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-09T22:16:28.806225] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-09T22:16:28.807413] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-09T22:16:28.807779] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-09T22:16:28.807844] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-09T22:16:28.808425] [DEBUG] [LOCAL ] VPV: Trimmed 9087 records to 5450 (keeping 200 days of data) [2025-10-09T22:16:28.842196] [DEBUG] [LOCAL ] VPV: Primary data saved (5450 records). [2025-10-09T22:16:28.842297] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-09T22:16:28.842375] [INFO ] [MAIN ] Update Progress: 2250/2373 symbols completed. VPV took 19.6s. Estimated remaining: 17m 18s. Rate: 7.1 symbols/min [2025-10-09T22:16:29.028344] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:29.046102] [DEBUG] [LOCAL ] VRTS: Loaded 9303 existing records from primary storage. [2025-10-09T22:16:29.046300] [INFO ] [MAIN ] VRTS: Loaded 9303 existing records. [2025-10-09T22:16:29.227626] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:16:29.227894] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-09T22:16:29.227948] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-09T22:16:29.228121] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-09T22:16:29.228177] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-09T22:16:29.609537] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-09T22:16:29.615904] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:30.073157] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T22:16:30.396725] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-09T22:16:30.535325] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T22:16:31.003847] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T22:16:31.196741] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-09T22:16:31.996736] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-09T22:16:32.641004] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T22:16:32.796719] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-09T22:16:33.596743] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-09T22:16:33.701097] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-09T22:16:33.723063] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T22:16:34.396744] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-09T22:16:34.741526] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T22:16:35.196778] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-09T22:16:35.823227] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T22:16:35.996749] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-09T22:16:36.386638] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-09T22:16:36.796743] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-09T22:16:37.394865] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T22:16:37.396530] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T22:16:37.407629] [INFO ] [REMOTE ] VPG: Full fetch complete (22734 records). [2025-10-09T22:16:37.407912] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-09T22:16:37.602042] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-09T22:16:38.012160] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-09T22:16:38.012288] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-09T22:16:38.013227] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-09T22:16:38.013311] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-09T22:16:38.014496] [DEBUG] [LOCAL ] VPG: Trimmed 22734 records to 17148 (keeping 200 days of data) [2025-10-09T22:16:38.160454] [DEBUG] [LOCAL ] VPG: Primary data saved (17148 records). [2025-10-09T22:16:38.160699] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-09T22:16:38.160868] [INFO ] [MAIN ] Update Progress: 2251/2373 symbols completed. VPG took 33.9s. Estimated remaining: 17m 9s. Rate: 7.1 symbols/min [2025-10-09T22:16:38.374596] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:38.407029] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-09T22:16:38.432503] [DEBUG] [LOCAL ] VSCO: Loaded 52746 existing records from primary storage. [2025-10-09T22:16:38.432929] [INFO ] [MAIN ] VSCO: Loaded 52746 existing records. [2025-10-09T22:16:38.643363] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:16:38.643585] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-09T22:16:38.643634] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-09T22:16:38.643924] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-09T22:16:38.643984] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-09T22:16:39.049013] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:39.070781] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T22:16:39.196759] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-09T22:16:39.534863] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-09T22:16:39.887190] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T22:16:39.996724] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-09T22:16:40.732101] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T22:16:40.796675] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-09T22:16:41.458615] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T22:16:41.596720] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-09T22:16:42.396781] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-09T22:16:43.196750] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-09T22:16:43.987789] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-09T22:16:43.998580] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-09T22:16:44.033993] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T22:16:44.070940] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T22:16:44.796724] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-09T22:16:45.404136] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T22:16:45.422049] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T22:16:45.596716] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-09T22:16:46.396742] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-09T22:16:46.684039] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T22:16:47.196748] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-09T22:16:47.968676] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T22:16:47.996742] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-09T22:16:48.216862] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T22:16:48.796788] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-09T22:16:49.391302] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T22:16:49.596695] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-09T22:16:49.616752] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T22:16:50.396760] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-09T22:16:50.878712] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T22:16:51.022978] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T22:16:51.024166] [INFO ] [REMOTE ] VRTS: Full fetch complete (11488 records). [2025-10-09T22:16:51.024237] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-09T22:16:51.208144] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-09T22:16:51.392548] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-09T22:16:51.392625] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-09T22:16:51.392925] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-09T22:16:51.392973] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-09T22:16:51.393444] [DEBUG] [LOCAL ] VRTS: Trimmed 11488 records to 9355 (keeping 200 days of data) [2025-10-09T22:16:51.452036] [DEBUG] [LOCAL ] VRTS: Primary data saved (9355 records). [2025-10-09T22:16:51.452162] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-09T22:16:51.452244] [INFO ] [MAIN ] Update Progress: 2252/2373 symbols completed. VRTS took 22.6s. Estimated remaining: 17m 1s. Rate: 7.1 symbols/min [2025-10-09T22:16:51.617766] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:51.661863] [DEBUG] [LOCAL ] VSH: Loaded 48244 existing records from primary storage. [2025-10-09T22:16:51.662164] [INFO ] [MAIN ] VSH: Loaded 48244 existing records. [2025-10-09T22:16:51.836783] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:16:51.837050] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-09T22:16:51.837099] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-09T22:16:51.837359] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-09T22:16:51.837415] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-09T22:16:52.006805] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-09T22:16:52.188699] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:52.796684] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-09T22:16:53.174032] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-09T22:16:53.475798] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T22:16:53.596743] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-09T22:16:54.396684] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-09T22:16:54.514614] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T22:16:54.579280] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T22:16:55.196728] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-09T22:16:55.996754] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-09T22:16:56.252383] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T22:16:56.557941] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-09T22:16:56.796726] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-09T22:16:57.141172] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T22:16:57.596726] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-09T22:16:57.918701] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T22:16:57.922045] [INFO ] [REMOTE ] VRE: Full fetch complete (48445 records). [2025-10-09T22:16:57.922141] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-09T22:16:58.301438] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-09T22:16:58.301548] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-09T22:16:58.302489] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-09T22:16:58.302553] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-09T22:16:58.303593] [DEBUG] [LOCAL ] VRE: Trimmed 48445 records to 35315 (keeping 200 days of data) [2025-10-09T22:16:58.398542] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-09T22:16:58.532686] [DEBUG] [LOCAL ] VRE: Primary data saved (35315 records). [2025-10-09T22:16:58.532844] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-09T22:16:58.532934] [INFO ] [MAIN ] Update Progress: 2253/2373 symbols completed. VRE took 33.9s. Estimated remaining: 16m 53s. Rate: 7.1 symbols/min [2025-10-09T22:16:58.704756] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:16:58.759277] [DEBUG] [LOCAL ] VST: Loaded 53713 existing records from primary storage. [2025-10-09T22:16:58.759616] [INFO ] [MAIN ] VST: Loaded 53713 existing records. [2025-10-09T22:16:58.931926] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:16:58.932125] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-09T22:16:58.932173] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-09T22:16:58.932441] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-09T22:16:58.932516] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-09T22:16:59.203685] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-09T22:16:59.283268] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:16:59.542606] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-09T22:16:59.996735] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-09T22:17:00.271310] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T22:17:00.628762] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T22:17:00.796760] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-09T22:17:01.596726] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-09T22:17:02.069352] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-09T22:17:02.396741] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-09T22:17:02.972406] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T22:17:03.191953] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-09T22:17:03.202718] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-09T22:17:03.996778] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-09T22:17:04.772921] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-09T22:17:04.796705] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-09T22:17:05.047686] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T22:17:05.602119] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-09T22:17:05.620920] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T22:17:06.396780] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-09T22:17:07.166851] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-09T22:17:07.196681] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-09T22:17:07.306398] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T22:17:07.601687] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T22:17:07.996705] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-09T22:17:08.796763] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-09T22:17:09.433212] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-09T22:17:09.587836] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T22:17:09.597733] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-09T22:17:10.396719] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-09T22:17:11.196733] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-09T22:17:11.380987] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-09T22:17:11.422615] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T22:17:11.803126] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T22:17:11.996723] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-09T22:17:12.796721] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-09T22:17:13.054893] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-09T22:17:13.059543] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-09T22:17:13.059698] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-09T22:17:13.478618] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-09T22:17:13.478794] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-09T22:17:13.480250] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-09T22:17:13.480365] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-09T22:17:13.482572] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 54143 (keeping 200 days of data) [2025-10-09T22:17:13.512959] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T22:17:13.619294] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-09T22:17:13.886888] [DEBUG] [LOCAL ] VRT: Primary data saved (54143 records). [2025-10-09T22:17:13.887033] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-09T22:17:13.887118] [INFO ] [MAIN ] Update Progress: 2254/2373 symbols completed. VRT took 49.0s. Estimated remaining: 16m 45s. Rate: 7.1 symbols/min [2025-10-09T22:17:14.059082] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:17:14.101900] [DEBUG] [LOCAL ] VSTS: Loaded 48958 existing records from primary storage. [2025-10-09T22:17:14.102225] [INFO ] [MAIN ] VSTS: Loaded 48958 existing records. [2025-10-09T22:17:14.280693] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:17:14.280951] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-09T22:17:14.280999] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-09T22:17:14.281269] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-09T22:17:14.281327] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-09T22:17:14.401855] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-09T22:17:14.643521] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:17:15.196697] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-09T22:17:15.406263] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-09T22:17:15.474175] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-09T22:17:15.767968] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T22:17:15.996715] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-09T22:17:16.796704] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-09T22:17:16.912949] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T22:17:17.552037] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T22:17:17.596689] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-09T22:17:18.142415] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T22:17:18.146913] [INFO ] [REMOTE ] VSCO: Full fetch complete (76224 records). [2025-10-09T22:17:18.147027] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-09T22:17:18.406826] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-09T22:17:18.549859] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-09T22:17:18.549946] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-09T22:17:18.551136] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-09T22:17:18.551202] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-09T22:17:18.552671] [DEBUG] [LOCAL ] VSCO: Trimmed 76224 records to 53132 (keeping 200 days of data) [2025-10-09T22:17:18.872014] [DEBUG] [LOCAL ] VSCO: Primary data saved (53132 records). [2025-10-09T22:17:18.872169] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-09T22:17:18.872272] [INFO ] [MAIN ] Update Progress: 2255/2373 symbols completed. VSCO took 40.7s. Estimated remaining: 16m 36s. Rate: 7.1 symbols/min [2025-10-09T22:17:19.041037] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T22:17:19.063263] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:17:19.063829] [INFO ] [REMOTE ] VSH: Full fetch complete (70801 records). [2025-10-09T22:17:19.064128] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-09T22:17:19.201854] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-09T22:17:19.409995] [DEBUG] [LOCAL ] VTEX: Loaded 42978 existing records from primary storage. [2025-10-09T22:17:19.422018] [INFO ] [MAIN ] VTEX: Loaded 42978 existing records. [2025-10-09T22:17:19.649766] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-09T22:17:19.655025] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-09T22:17:19.707322] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-09T22:17:19.713731] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-09T22:17:19.713616] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:17:19.714044] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-09T22:17:19.714105] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-09T22:17:19.714399] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-09T22:17:19.714521] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-09T22:17:19.789101] [DEBUG] [LOCAL ] VSH: Trimmed 70801 records to 48557 (keeping 200 days of data) [2025-10-09T22:17:20.225169] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:17:20.225999] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-09T22:17:20.228615] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T22:17:20.454528] [DEBUG] [LOCAL ] VSH: Primary data saved (48557 records). [2025-10-09T22:17:20.454713] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-09T22:17:20.454815] [INFO ] [MAIN ] Update Progress: 2256/2373 symbols completed. VSH took 29.0s. Estimated remaining: 16m 27s. Rate: 7.1 symbols/min [2025-10-09T22:17:20.626863] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:17:20.670922] [DEBUG] [LOCAL ] VTLE: Loaded 48266 existing records from primary storage. [2025-10-09T22:17:20.671225] [INFO ] [MAIN ] VTLE: Loaded 48266 existing records. [2025-10-09T22:17:20.806610] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-09T22:17:20.846311] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:17:20.846484] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-09T22:17:20.846537] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-09T22:17:20.846793] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-09T22:17:20.846851] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-09T22:17:21.192942] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:17:21.596763] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-09T22:17:21.756429] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T22:17:21.956855] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-09T22:17:22.401855] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-09T22:17:22.413623] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T22:17:23.077035] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T22:17:23.196671] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-09T22:17:23.301708] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T22:17:23.996752] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-09T22:17:24.380390] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T22:17:24.796750] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-09T22:17:25.596705] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-09T22:17:25.638780] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T22:17:26.152282] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T22:17:26.396731] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-09T22:17:27.196722] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-09T22:17:27.795065] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T22:17:27.996692] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-09T22:17:28.177687] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-09T22:17:28.419305] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T22:17:28.796780] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-09T22:17:29.572848] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T22:17:29.596669] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-09T22:17:30.396723] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-09T22:17:30.995780] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T22:17:31.196760] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-09T22:17:31.512700] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-09T22:17:31.996697] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-09T22:17:32.067140] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T22:17:32.705194] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T22:17:32.796725] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-09T22:17:33.596788] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-09T22:17:34.406356] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-09T22:17:34.411955] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-09T22:17:34.501015] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T22:17:34.720810] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T22:17:35.196730] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-09T22:17:35.996801] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-09T22:17:36.156912] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T22:17:36.776047] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T22:17:36.796677] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-09T22:17:37.596773] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-09T22:17:38.184860] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T22:17:38.396699] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-09T22:17:38.547756] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T22:17:39.196741] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-09T22:17:39.237335] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T22:17:39.996779] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-09T22:17:40.555260] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-09T22:17:40.796705] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-09T22:17:40.830031] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T22:17:41.596686] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-09T22:17:41.784613] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T22:17:42.396792] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-09T22:17:43.196763] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-09T22:17:43.268356] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-09T22:17:43.306275] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T22:17:43.677675] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T22:17:43.996805] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-09T22:17:44.403997] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T22:17:44.409151] [INFO ] [REMOTE ] VST: Full fetch complete (77801 records). [2025-10-09T22:17:44.409391] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-09T22:17:44.797803] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-09T22:17:44.891863] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-09T22:17:44.893866] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T22:17:44.904284] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-09T22:17:44.906591] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-09T22:17:44.907148] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-09T22:17:44.908846] [DEBUG] [LOCAL ] VST: Trimmed 77801 records to 54102 (keeping 200 days of data) [2025-10-09T22:17:45.265598] [DEBUG] [LOCAL ] VST: Primary data saved (54102 records). [2025-10-09T22:17:45.265774] [INFO ] [MAIN ] VST: Full history saved. [2025-10-09T22:17:45.265866] [INFO ] [MAIN ] Update Progress: 2257/2373 symbols completed. VST took 46.7s. Estimated remaining: 16m 20s. Rate: 7.1 symbols/min [2025-10-09T22:17:45.434690] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:17:45.454084] [DEBUG] [LOCAL ] VTMX: Loaded 17558 existing records from primary storage. [2025-10-09T22:17:45.454324] [INFO ] [MAIN ] VTMX: Loaded 17558 existing records. [2025-10-09T22:17:45.603310] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-09T22:17:45.633876] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:17:45.634055] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-09T22:17:45.634102] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-09T22:17:45.634327] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-09T22:17:45.634384] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-09T22:17:46.030021] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:17:46.396792] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-09T22:17:46.658357] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T22:17:47.196706] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-09T22:17:47.312800] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T22:17:47.366540] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T22:17:47.996764] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-09T22:17:48.451583] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T22:17:48.796739] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-09T22:17:48.960297] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T22:17:49.596744] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-09T22:17:49.903733] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T22:17:49.907124] [INFO ] [REMOTE ] VTEX: Full fetch complete (60500 records). [2025-10-09T22:17:49.907210] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-09T22:17:50.291106] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-09T22:17:50.291203] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-09T22:17:50.292225] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-09T22:17:50.292292] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-09T22:17:50.293570] [DEBUG] [LOCAL ] VTEX: Trimmed 60500 records to 43274 (keeping 200 days of data) [2025-10-09T22:17:50.396707] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-09T22:17:50.561564] [DEBUG] [LOCAL ] VTEX: Primary data saved (43274 records). [2025-10-09T22:17:50.561724] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-09T22:17:50.561816] [INFO ] [MAIN ] Update Progress: 2258/2373 symbols completed. VTEX took 31.7s. Estimated remaining: 16m 11s. Rate: 7.1 symbols/min [2025-10-09T22:17:50.737121] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:17:50.749450] [DEBUG] [LOCAL ] VTN: Loaded 6991 existing records from primary storage. [2025-10-09T22:17:50.749621] [INFO ] [MAIN ] VTN: Loaded 6991 existing records. [2025-10-09T22:17:50.972733] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:17:50.973051] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-09T22:17:50.973168] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-09T22:17:50.973347] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-09T22:17:50.973404] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-09T22:17:51.132107] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T22:17:51.167983] [INFO ] [REMOTE ] VSTS: Full fetch complete (69679 records). [2025-10-09T22:17:51.208175] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-09T22:17:51.202859] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-09T22:17:51.544766] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:17:51.697743] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T22:17:51.801232] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-09T22:17:51.801351] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-09T22:17:51.802544] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-09T22:17:51.802618] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-09T22:17:51.804392] [DEBUG] [LOCAL ] VSTS: Trimmed 69679 records to 49305 (keeping 200 days of data) [2025-10-09T22:17:51.998221] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-09T22:17:52.086225] [DEBUG] [LOCAL ] VSTS: Primary data saved (49305 records). [2025-10-09T22:17:52.086379] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-09T22:17:52.086531] [INFO ] [MAIN ] Update Progress: 2259/2373 symbols completed. VSTS took 38.2s. Estimated remaining: 16m 2s. Rate: 7.1 symbols/min [2025-10-09T22:17:52.253168] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:17:52.271972] [DEBUG] [LOCAL ] VTOL: Loaded 19500 existing records from primary storage. [2025-10-09T22:17:52.272218] [INFO ] [MAIN ] VTOL: Loaded 19500 existing records. [2025-10-09T22:17:52.449680] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:17:52.449883] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-09T22:17:52.449935] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-09T22:17:52.450129] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-09T22:17:52.450186] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-09T22:17:52.799519] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-09T22:17:52.837856] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:17:52.842842] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T22:17:52.890190] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T22:17:53.596707] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-09T22:17:53.786025] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T22:17:54.214868] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T22:17:54.396726] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-09T22:17:55.197886] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-09T22:17:55.200833] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T22:17:55.996721] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-09T22:17:56.576131] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T22:17:56.579808] [INFO ] [REMOTE ] VTLE: Full fetch complete (68693 records). [2025-10-09T22:17:56.579904] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-09T22:17:56.808701] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-09T22:17:56.973447] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-09T22:17:56.973528] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-09T22:17:56.974601] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-09T22:17:56.974685] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-09T22:17:56.976015] [DEBUG] [LOCAL ] VTLE: Trimmed 68693 records to 48528 (keeping 200 days of data) [2025-10-09T22:17:57.079909] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T22:17:57.290957] [DEBUG] [LOCAL ] VTLE: Primary data saved (48528 records). [2025-10-09T22:17:57.291183] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-09T22:17:57.291332] [INFO ] [MAIN ] Update Progress: 2260/2373 symbols completed. VTLE took 36.8s. Estimated remaining: 15m 54s. Rate: 7.1 symbols/min [2025-10-09T22:17:57.463673] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:17:57.512735] [DEBUG] [LOCAL ] VTR: Loaded 52768 existing records from primary storage. [2025-10-09T22:17:57.513074] [INFO ] [MAIN ] VTR: Loaded 52768 existing records. [2025-10-09T22:17:57.602034] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-09T22:17:57.674192] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T22:17:57.707400] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:17:57.708233] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-09T22:17:57.708288] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-09T22:17:57.708489] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-09T22:17:57.708545] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-09T22:17:58.066191] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:17:58.396683] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-09T22:17:58.769393] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T22:17:59.196697] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-09T22:17:59.692130] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T22:17:59.996759] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-09T22:18:00.165347] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T22:18:00.642748] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T22:18:00.796747] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-09T22:18:01.596720] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-09T22:18:02.234059] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T22:18:02.396711] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-09T22:18:02.574510] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T22:18:03.196734] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-09T22:18:03.237069] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T22:18:03.950340] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T22:18:03.996663] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-09T22:18:04.743585] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T22:18:04.796715] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-09T22:18:05.546666] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T22:18:05.596731] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-09T22:18:06.396742] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-09T22:18:07.196691] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-09T22:18:07.401832] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T22:18:07.511380] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T22:18:07.636490] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T22:18:07.638232] [INFO ] [REMOTE ] VTN: Full fetch complete (11085 records). [2025-10-09T22:18:07.638450] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-09T22:18:08.001079] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-09T22:18:08.001457] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-09T22:18:08.002717] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-09T22:18:08.003093] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-09T22:18:08.003142] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-09T22:18:08.003611] [DEBUG] [LOCAL ] VTN: Trimmed 11085 records to 7036 (keeping 200 days of data) [2025-10-09T22:18:08.048436] [DEBUG] [LOCAL ] VTN: Primary data saved (7036 records). [2025-10-09T22:18:08.048566] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-09T22:18:08.048696] [INFO ] [MAIN ] Update Progress: 2261/2373 symbols completed. VTN took 17.5s. Estimated remaining: 15m 45s. Rate: 7.1 symbols/min [2025-10-09T22:18:08.229732] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:18:08.262784] [DEBUG] [LOCAL ] VTS: Loaded 30151 existing records from primary storage. [2025-10-09T22:18:08.263049] [INFO ] [MAIN ] VTS: Loaded 30151 existing records. [2025-10-09T22:18:08.458225] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:18:08.458450] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-09T22:18:08.458495] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-09T22:18:08.458713] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-09T22:18:08.458770] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-09T22:18:08.797438] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-09T22:18:08.876703] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:18:09.100740] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T22:18:09.596695] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-09T22:18:09.852609] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T22:18:10.396704] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-09T22:18:10.684491] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T22:18:11.196734] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-09T22:18:11.996746] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-09T22:18:12.158386] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T22:18:12.318868] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T22:18:12.796748] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-09T22:18:13.047806] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T22:18:13.596698] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-09T22:18:13.867462] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T22:18:14.396704] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-09T22:18:14.766352] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T22:18:15.196725] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-09T22:18:16.001980] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-09T22:18:16.010615] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T22:18:16.047000] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T22:18:16.796679] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-09T22:18:17.026150] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T22:18:17.596723] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-09T22:18:18.394936] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T22:18:18.397750] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-09T22:18:18.607817] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T22:18:19.196705] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-09T22:18:19.478876] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T22:18:19.996732] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-09T22:18:20.796703] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-09T22:18:20.932595] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T22:18:21.145631] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T22:18:21.596735] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-09T22:18:21.943946] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T22:18:22.396780] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-09T22:18:23.196786] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-09T22:18:23.524850] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T22:18:23.527978] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T22:18:23.996736] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-09T22:18:24.444142] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T22:18:24.796712] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-09T22:18:25.596705] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-09T22:18:25.744496] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T22:18:25.832804] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T22:18:26.396703] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-09T22:18:26.881231] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T22:18:27.196732] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-09T22:18:27.996689] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-09T22:18:28.194236] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T22:18:28.253731] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T22:18:28.796688] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-09T22:18:28.956826] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T22:18:29.361705] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T22:18:29.366445] [INFO ] [REMOTE ] VTR: Full fetch complete (76329 records). [2025-10-09T22:18:29.366566] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-09T22:18:29.601811] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-09T22:18:29.794220] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-09T22:18:29.794316] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-09T22:18:29.795496] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-09T22:18:29.795561] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-09T22:18:29.797080] [DEBUG] [LOCAL ] VTR: Trimmed 76329 records to 53144 (keeping 200 days of data) [2025-10-09T22:18:30.130128] [DEBUG] [LOCAL ] VTR: Primary data saved (53144 records). [2025-10-09T22:18:30.130298] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-09T22:18:30.130410] [INFO ] [MAIN ] Update Progress: 2262/2373 symbols completed. VTR took 32.8s. Estimated remaining: 15m 38s. Rate: 7.1 symbols/min [2025-10-09T22:18:30.297637] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:18:30.327574] [DEBUG] [LOCAL ] VVR: Loaded 31529 existing records from primary storage. [2025-10-09T22:18:30.327920] [INFO ] [MAIN ] VVR: Loaded 31529 existing records. [2025-10-09T22:18:30.401785] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-09T22:18:30.504130] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:18:30.504341] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-09T22:18:30.504446] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-09T22:18:30.504705] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-09T22:18:30.504762] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-09T22:18:30.795882] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T22:18:30.836025] [INFO ] [REMOTE ] VTOL: Full fetch complete (26015 records). [2025-10-09T22:18:30.845889] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-09T22:18:30.865146] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:18:31.206518] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-09T22:18:31.247035] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-09T22:18:31.247116] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-09T22:18:31.247781] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-09T22:18:31.247938] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-09T22:18:31.248830] [DEBUG] [LOCAL ] VTOL: Trimmed 26015 records to 19596 (keeping 200 days of data) [2025-10-09T22:18:31.365313] [DEBUG] [LOCAL ] VTOL: Primary data saved (19596 records). [2025-10-09T22:18:31.365454] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-09T22:18:31.365536] [INFO ] [MAIN ] Update Progress: 2263/2373 symbols completed. VTOL took 39.3s. Estimated remaining: 15m 29s. Rate: 7.1 symbols/min [2025-10-09T22:18:31.545826] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:18:31.543582] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T22:18:31.592330] [DEBUG] [LOCAL ] VVV: Loaded 50287 existing records from primary storage. [2025-10-09T22:18:31.592846] [INFO ] [MAIN ] VVV: Loaded 50287 existing records. [2025-10-09T22:18:31.766776] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:18:31.767026] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-09T22:18:31.767075] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-09T22:18:31.767283] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-09T22:18:31.767341] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-09T22:18:32.001955] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-09T22:18:32.168740] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:18:32.316323] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T22:18:32.796741] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-09T22:18:33.404902] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T22:18:33.596794] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-09T22:18:34.219252] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T22:18:34.296049] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-09T22:18:34.297935] [INFO ] [REMOTE ] VTMX: Full fetch complete (25609 records). [2025-10-09T22:18:34.298011] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-09T22:18:34.400516] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-09T22:18:34.671156] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-09T22:18:34.671237] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-09T22:18:34.671795] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-09T22:18:34.671857] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-09T22:18:34.672533] [DEBUG] [LOCAL ] VTMX: Trimmed 25609 records to 17652 (keeping 200 days of data) [2025-10-09T22:18:34.784601] [DEBUG] [LOCAL ] VTMX: Primary data saved (17652 records). [2025-10-09T22:18:34.784779] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-09T22:18:34.784889] [INFO ] [MAIN ] Update Progress: 2264/2373 symbols completed. VTMX took 49.5s. Estimated remaining: 15m 20s. Rate: 7.1 symbols/min [2025-10-09T22:18:34.975249] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:18:34.998718] [DEBUG] [LOCAL ] VVX: Loaded 22935 existing records from primary storage. [2025-10-09T22:18:34.998999] [INFO ] [MAIN ] VVX: Loaded 22935 existing records. [2025-10-09T22:18:35.184673] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:18:35.184920] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-09T22:18:35.184970] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-09T22:18:35.185221] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-09T22:18:35.185279] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-09T22:18:35.206740] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-09T22:18:35.556460] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:18:35.616079] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T22:18:35.618778] [INFO ] [REMOTE ] VTS: Full fetch complete (41311 records). [2025-10-09T22:18:35.618868] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-09T22:18:35.988473] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-09T22:18:35.988558] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-09T22:18:35.989400] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-09T22:18:35.989462] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-09T22:18:35.990394] [DEBUG] [LOCAL ] VTS: Trimmed 41311 records to 30351 (keeping 200 days of data) [2025-10-09T22:18:36.043275] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-09T22:18:36.181636] [DEBUG] [LOCAL ] VTS: Primary data saved (30351 records). [2025-10-09T22:18:36.181822] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-09T22:18:36.181918] [INFO ] [MAIN ] Update Progress: 2265/2373 symbols completed. VTS took 28.1s. Estimated remaining: 15m 11s. Rate: 7.1 symbols/min [2025-10-09T22:18:36.353083] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:18:36.396608] [DEBUG] [LOCAL ] VYX: Loaded 48554 existing records from primary storage. [2025-10-09T22:18:36.396944] [INFO ] [MAIN ] VYX: Loaded 48554 existing records. [2025-10-09T22:18:36.579799] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:18:36.580096] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-09T22:18:36.580220] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-09T22:18:36.580767] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-09T22:18:36.580831] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-09T22:18:36.722761] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T22:18:36.805905] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-09T22:18:37.021291] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:18:37.037433] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T22:18:37.596768] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-09T22:18:38.396769] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-09T22:18:38.517243] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T22:18:39.196752] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-09T22:18:39.268881] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T22:18:39.476730] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T22:18:39.996799] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-09T22:18:40.796713] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-09T22:18:40.827084] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T22:18:41.436840] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T22:18:41.602172] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-09T22:18:41.612256] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T22:18:42.396727] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-09T22:18:42.852875] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T22:18:43.196729] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-09T22:18:43.891254] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T22:18:43.996754] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-09T22:18:44.589062] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T22:18:44.796725] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-09T22:18:45.596742] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-09T22:18:45.685685] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T22:18:46.396753] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-09T22:18:46.456816] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T22:18:46.586915] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T22:18:47.196725] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-09T22:18:47.407069] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T22:18:47.996703] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-09T22:18:48.363876] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T22:18:48.796729] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-09T22:18:49.596700] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-09T22:18:49.707305] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T22:18:49.770235] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T22:18:50.398608] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-09T22:18:50.399871] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T22:18:51.196787] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-09T22:18:51.751686] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T22:18:51.996714] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-09T22:18:52.775317] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T22:18:52.796672] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-09T22:18:52.946216] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T22:18:53.596702] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-09T22:18:54.396699] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-09T22:18:54.476096] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T22:18:54.538300] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T22:18:55.196766] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-09T22:18:55.999009] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-09T22:18:56.004335] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T22:18:56.314288] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T22:18:56.796762] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-09T22:18:57.596749] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-09T22:18:57.822634] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T22:18:58.396707] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-09T22:18:58.488197] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T22:18:58.526864] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T22:18:58.530136] [INFO ] [REMOTE ] VVR: Full fetch complete (46590 records). [2025-10-09T22:18:58.530248] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-09T22:18:58.903801] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-09T22:18:58.903882] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-09T22:18:58.904799] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-09T22:18:58.904860] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-09T22:18:58.905813] [DEBUG] [LOCAL ] VVR: Trimmed 46590 records to 31723 (keeping 200 days of data) [2025-10-09T22:18:59.101274] [DEBUG] [LOCAL ] VVR: Primary data saved (31723 records). [2025-10-09T22:18:59.101443] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-09T22:18:59.101560] [INFO ] [MAIN ] Update Progress: 2266/2373 symbols completed. VVR took 29.0s. Estimated remaining: 15m 4s. Rate: 7.1 symbols/min [2025-10-09T22:18:59.201767] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-09T22:18:59.292436] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:18:59.344232] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-09T22:18:59.344552] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-09T22:18:59.516892] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:18:59.517116] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-09T22:18:59.517213] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-09T22:18:59.517425] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-09T22:18:59.517481] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-09T22:18:59.870710] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:18:59.996723] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-09T22:19:00.204408] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T22:19:00.796777] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-09T22:19:00.980702] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T22:19:01.596717] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-09T22:19:01.993351] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-09T22:19:02.396758] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-09T22:19:03.196779] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-09T22:19:03.272494] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T22:19:03.996721] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-09T22:19:04.161160] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T22:19:04.796773] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-09T22:19:04.939343] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-09T22:19:05.265166] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (4.47 seconds). [2025-10-09T22:19:05.360069] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T22:19:05.459675] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T22:19:05.596735] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-09T22:19:06.396727] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-09T22:19:07.196738] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-09T22:19:07.762675] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T22:19:07.799632] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-09T22:19:07.996727] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-09T22:19:08.796756] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-09T22:19:08.919445] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T22:19:09.596726] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-09T22:19:10.392635] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-09T22:19:10.403357] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-09T22:19:10.621435] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T22:19:10.909366] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T22:19:10.913181] [INFO ] [REMOTE ] VYX: Full fetch complete (70070 records). [2025-10-09T22:19:10.913298] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-09T22:19:11.199845] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-09T22:19:11.298693] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-09T22:19:11.298845] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-09T22:19:11.299996] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-09T22:19:11.300072] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-09T22:19:11.301576] [DEBUG] [LOCAL ] VYX: Trimmed 70070 records to 48885 (keeping 200 days of data) [2025-10-09T22:19:11.424989] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T22:19:11.617706] [DEBUG] [LOCAL ] VYX: Primary data saved (48885 records). [2025-10-09T22:19:11.617918] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-09T22:19:11.618034] [INFO ] [MAIN ] Update Progress: 2267/2373 symbols completed. VYX took 35.4s. Estimated remaining: 14m 55s. Rate: 7.1 symbols/min [2025-10-09T22:19:11.818726] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:19:11.866082] [DEBUG] [LOCAL ] W: Loaded 53441 existing records from primary storage. [2025-10-09T22:19:11.866393] [INFO ] [MAIN ] W: Loaded 53441 existing records. [2025-10-09T22:19:12.002562] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-09T22:19:12.043395] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:19:12.043627] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-09T22:19:12.043723] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-09T22:19:12.043944] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-09T22:19:12.044015] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-09T22:19:12.401006] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:19:12.796768] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-09T22:19:13.158229] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T22:19:13.161058] [INFO ] [REMOTE ] VVX: Full fetch complete (33201 records). [2025-10-09T22:19:13.161182] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-09T22:19:13.541972] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-09T22:19:13.542150] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-09T22:19:13.542869] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-09T22:19:13.542945] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-09T22:19:13.544065] [DEBUG] [LOCAL ] VVX: Trimmed 33201 records to 23044 (keeping 200 days of data) [2025-10-09T22:19:13.600781] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-09T22:19:13.660305] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-09T22:19:13.721940] [DEBUG] [LOCAL ] VVX: Primary data saved (23044 records). [2025-10-09T22:19:13.722076] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-09T22:19:13.722160] [INFO ] [MAIN ] Update Progress: 2268/2373 symbols completed. VVX took 38.9s. Estimated remaining: 14m 47s. Rate: 7.1 symbols/min [2025-10-09T22:19:13.891748] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:19:13.934842] [DEBUG] [LOCAL ] WAB: Loaded 44034 existing records from primary storage. [2025-10-09T22:19:13.935166] [INFO ] [MAIN ] WAB: Loaded 44034 existing records. [2025-10-09T22:19:14.108178] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:19:14.108444] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-09T22:19:14.108492] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-09T22:19:14.108748] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-09T22:19:14.108809] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-09T22:19:14.401792] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-09T22:19:14.472171] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:19:14.721345] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T22:19:15.110512] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T22:19:15.114778] [INFO ] [REMOTE ] VVV: Full fetch complete (72385 records). [2025-10-09T22:19:15.114901] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-09T22:19:15.204549] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-09T22:19:15.507043] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-09T22:19:15.507168] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-09T22:19:15.508311] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-09T22:19:15.508375] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-09T22:19:15.510389] [DEBUG] [LOCAL ] VVV: Trimmed 72385 records to 50631 (keeping 200 days of data) [2025-10-09T22:19:15.821699] [DEBUG] [LOCAL ] VVV: Primary data saved (50631 records). [2025-10-09T22:19:15.821835] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-09T22:19:15.821930] [INFO ] [MAIN ] Update Progress: 2269/2373 symbols completed. VVV took 44.5s. Estimated remaining: 14m 38s. Rate: 7.1 symbols/min [2025-10-09T22:19:15.992302] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:19:15.996754] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-09T22:19:16.037801] [DEBUG] [LOCAL ] WAL: Loaded 45173 existing records from primary storage. [2025-10-09T22:19:16.038142] [INFO ] [MAIN ] WAL: Loaded 45173 existing records. [2025-10-09T22:19:16.213915] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:19:16.214291] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-09T22:19:16.214421] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-09T22:19:16.214730] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-09T22:19:16.214806] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-09T22:19:16.604324] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:19:16.606702] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-09T22:19:16.661911] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T22:19:16.796675] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-09T22:19:17.600433] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-09T22:19:17.605994] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T22:19:18.396687] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-09T22:19:18.508519] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T22:19:18.780869] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T22:19:19.196791] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-09T22:19:19.996770] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-09T22:19:20.125216] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T22:19:20.796692] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-09T22:19:21.285891] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-09T22:19:21.596747] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-09T22:19:21.725418] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T22:19:22.396752] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-09T22:19:22.595724] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T22:19:23.196806] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-09T22:19:23.296085] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T22:19:23.996716] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-09T22:19:24.796707] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-09T22:19:24.973155] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-09T22:19:25.084586] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T22:19:25.150563] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T22:19:25.596712] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-09T22:19:26.289380] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T22:19:26.396669] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-09T22:19:27.196736] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-09T22:19:27.560011] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-09T22:19:27.996693] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-09T22:19:28.203012] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T22:19:28.523186] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T22:19:28.796753] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-09T22:19:29.596782] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-09T22:19:29.813249] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T22:19:30.409193] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-09T22:19:30.411501] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T22:19:31.196791] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-09T22:19:31.646925] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-09T22:19:31.996789] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-09T22:19:32.398602] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T22:19:32.443015] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T22:19:32.796700] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-09T22:19:33.596697] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-09T22:19:33.652773] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T22:19:34.396694] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-09T22:19:34.870716] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-09T22:19:35.028772] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T22:19:35.196724] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-09T22:19:35.668572] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T22:19:35.996774] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-09T22:19:36.779923] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T22:19:36.796676] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-09T22:19:37.596773] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-09T22:19:38.109622] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T22:19:38.396747] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-09T22:19:38.745433] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-09T22:19:38.977893] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T22:19:38.996580] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-09T22:19:39.006091] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-09T22:19:39.008492] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T22:19:39.211690] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-09T22:19:39.415158] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-09T22:19:39.415238] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-09T22:19:39.416545] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-09T22:19:39.416613] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-09T22:19:39.418262] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 54181 (keeping 200 days of data) [2025-10-09T22:19:39.772617] [DEBUG] [LOCAL ] VZ: Primary data saved (54181 records). [2025-10-09T22:19:39.772800] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-09T22:19:39.772913] [INFO ] [MAIN ] Update Progress: 2270/2373 symbols completed. VZ took 40.7s. Estimated remaining: 14m 30s. Rate: 7.1 symbols/min [2025-10-09T22:19:39.895742] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T22:19:39.939780] [INFO ] [REMOTE ] WAB: Full fetch complete (64161 records). [2025-10-09T22:19:39.942382] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-09T22:19:40.001874] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-09T22:19:39.994960] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:19:40.320318] [DEBUG] [LOCAL ] WAT: Loaded 35446 existing records from primary storage. [2025-10-09T22:19:40.344443] [INFO ] [MAIN ] WAT: Loaded 35446 existing records. [2025-10-09T22:19:40.503784] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-09T22:19:40.504157] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-09T22:19:40.510632] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-09T22:19:40.520966] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-09T22:19:40.588487] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:19:40.588965] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-09T22:19:40.589021] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-09T22:19:40.589123] [DEBUG] [LOCAL ] WAB: Trimmed 64161 records to 44351 (keeping 200 days of data) [2025-10-09T22:19:40.589468] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-09T22:19:40.589529] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-09T22:19:40.798017] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-09T22:19:41.101228] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:19:41.253274] [DEBUG] [LOCAL ] WAB: Primary data saved (44351 records). [2025-10-09T22:19:41.253405] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-09T22:19:41.253489] [INFO ] [MAIN ] Update Progress: 2271/2373 symbols completed. WAB took 27.5s. Estimated remaining: 14m 21s. Rate: 7.1 symbols/min [2025-10-09T22:19:41.426026] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:19:41.426218] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-09T22:19:41.426275] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-09T22:19:41.426389] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-09T22:19:41.426433] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-09T22:19:41.426527] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-09T22:19:41.426593] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-09T22:19:41.604912] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-09T22:19:41.801315] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T22:19:41.807325] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:19:41.812339] [INFO ] [REMOTE ] W: Full fetch complete (77389 records). [2025-10-09T22:19:41.812481] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-09T22:19:42.220120] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-09T22:19:42.220261] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-09T22:19:42.221520] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-09T22:19:42.221631] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-09T22:19:42.223132] [DEBUG] [LOCAL ] W: Trimmed 77389 records to 53828 (keeping 200 days of data) [2025-10-09T22:19:42.357275] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T22:19:42.427407] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-09T22:19:42.583171] [DEBUG] [LOCAL ] W: Primary data saved (53828 records). [2025-10-09T22:19:42.583443] [INFO ] [MAIN ] W: Full history saved. [2025-10-09T22:19:42.583572] [INFO ] [MAIN ] Update Progress: 2272/2373 symbols completed. W took 31.0s. Estimated remaining: 14m 13s. Rate: 7.1 symbols/min [2025-10-09T22:19:42.775148] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T22:19:42.777003] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:19:42.826918] [DEBUG] [LOCAL ] WBS: Loaded 48657 existing records from primary storage. [2025-10-09T22:19:42.827225] [INFO ] [MAIN ] WBS: Loaded 48657 existing records. [2025-10-09T22:19:43.006540] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:19:43.006768] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-09T22:19:43.006818] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-09T22:19:43.007049] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-09T22:19:43.007105] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-09T22:19:43.202023] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-09T22:19:43.370373] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:19:43.996704] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-09T22:19:44.182401] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T22:19:44.211485] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T22:19:44.211822] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-09T22:19:44.211912] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:19:44.211958] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-09T22:19:44.212015] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:19:44.212087] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-09T22:19:44.212151] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-09T22:19:44.212227] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-09T22:19:44.212279] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-09T22:19:44.212326] [INFO ] [MAIN ] Update Progress: 2273/2373 symbols completed. WBI took 3.0s. Estimated remaining: 14m 4s. Rate: 7.1 symbols/min [2025-10-09T22:19:44.386863] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:19:44.407191] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T22:19:44.422296] [DEBUG] [LOCAL ] WBX: Loaded 11011 existing records from primary storage. [2025-10-09T22:19:44.422529] [INFO ] [MAIN ] WBX: Loaded 11011 existing records. [2025-10-09T22:19:44.599739] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:19:44.599960] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-09T22:19:44.600007] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-09T22:19:44.600209] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-09T22:19:44.600268] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-09T22:19:44.806076] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-09T22:19:44.973791] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:19:45.596797] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-09T22:19:46.336184] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T22:19:46.396684] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-09T22:19:47.196781] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-09T22:19:47.272669] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T22:19:47.871810] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T22:19:47.996697] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-09T22:19:48.331113] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T22:19:48.796754] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-09T22:19:49.409918] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T22:19:49.596726] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-09T22:19:49.770302] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T22:19:50.396734] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-09T22:19:51.081989] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T22:19:51.196688] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-09T22:19:51.701292] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T22:19:51.996695] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-09T22:19:52.467303] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T22:19:52.796747] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-09T22:19:53.254070] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T22:19:53.596738] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-09T22:19:54.314714] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T22:19:54.396711] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-09T22:19:55.196693] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-09T22:19:55.236149] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T22:19:55.990494] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T22:19:55.998352] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-09T22:19:56.076532] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T22:19:56.796773] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-09T22:19:57.105995] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T22:19:57.113695] [INFO ] [REMOTE ] WAL: Full fetch complete (66700 records). [2025-10-09T22:19:57.113872] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-09T22:19:57.500853] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-09T22:19:57.500935] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-09T22:19:57.501987] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-09T22:19:57.502050] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-09T22:19:57.503348] [DEBUG] [LOCAL ] WAL: Trimmed 66700 records to 45558 (keeping 200 days of data) [2025-10-09T22:19:57.598668] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-09T22:19:57.786959] [DEBUG] [LOCAL ] WAL: Primary data saved (45558 records). [2025-10-09T22:19:57.787091] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-09T22:19:57.787174] [INFO ] [MAIN ] Update Progress: 2274/2373 symbols completed. WAL took 42.0s. Estimated remaining: 13m 56s. Rate: 7.1 symbols/min [2025-10-09T22:19:57.959714] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:19:57.998901] [DEBUG] [LOCAL ] WCC: Loaded 39121 existing records from primary storage. [2025-10-09T22:19:57.999210] [INFO ] [MAIN ] WCC: Loaded 39121 existing records. [2025-10-09T22:19:58.179990] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:19:58.180341] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-09T22:19:58.180470] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-09T22:19:58.180720] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-09T22:19:58.180779] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-09T22:19:58.402330] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-09T22:19:58.541432] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:19:58.571329] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T22:19:59.175500] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T22:19:59.196683] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-09T22:19:59.670610] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T22:19:59.996747] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-09T22:20:00.733452] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T22:20:00.796733] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-09T22:20:01.093180] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T22:20:01.596772] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-09T22:20:02.284346] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T22:20:02.396699] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-09T22:20:02.880318] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T22:20:02.883751] [INFO ] [REMOTE ] WAT: Full fetch complete (50115 records). [2025-10-09T22:20:02.883846] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-09T22:20:03.200947] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-09T22:20:03.317371] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T22:20:03.317759] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-09T22:20:03.317995] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-09T22:20:03.328018] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-09T22:20:03.328199] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-09T22:20:03.329441] [DEBUG] [LOCAL ] WAT: Trimmed 50115 records to 35717 (keeping 200 days of data) [2025-10-09T22:20:03.558050] [DEBUG] [LOCAL ] WAT: Primary data saved (35717 records). [2025-10-09T22:20:03.558211] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-09T22:20:03.558299] [INFO ] [MAIN ] Update Progress: 2275/2373 symbols completed. WAT took 23.8s. Estimated remaining: 13m 47s. Rate: 7.1 symbols/min [2025-10-09T22:20:03.776398] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:20:03.825004] [DEBUG] [LOCAL ] WCN: Loaded 47963 existing records from primary storage. [2025-10-09T22:20:03.825335] [INFO ] [MAIN ] WCN: Loaded 47963 existing records. [2025-10-09T22:20:04.002404] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-09T22:20:04.007991] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:20:04.008267] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-09T22:20:04.008344] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-09T22:20:04.008623] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-09T22:20:04.008722] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-09T22:20:04.364716] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:20:04.374959] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T22:20:04.796715] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-09T22:20:05.402154] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T22:20:05.596702] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-09T22:20:06.056241] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T22:20:06.396734] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-09T22:20:07.154490] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T22:20:07.196728] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-09T22:20:07.726148] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T22:20:07.996718] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-09T22:20:08.301911] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T22:20:08.796744] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-09T22:20:09.114251] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T22:20:09.596724] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-09T22:20:10.396758] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-09T22:20:10.498348] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T22:20:10.886332] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T22:20:11.196765] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-09T22:20:11.996749] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-09T22:20:12.150851] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T22:20:12.796759] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-09T22:20:12.853574] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T22:20:13.350724] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T22:20:13.596729] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-09T22:20:14.396700] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-09T22:20:14.493299] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T22:20:14.999880] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T22:20:15.196748] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-09T22:20:15.996718] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-09T22:20:16.090195] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T22:20:16.693409] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T22:20:16.731099] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T22:20:16.796680] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-09T22:20:17.596782] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-09T22:20:18.211908] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T22:20:18.396744] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-09T22:20:18.935115] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T22:20:19.196721] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-09T22:20:19.385615] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T22:20:19.996715] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-09T22:20:20.796741] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-09T22:20:20.858051] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T22:20:21.541759] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T22:20:21.596695] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-09T22:20:22.256593] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T22:20:22.261722] [INFO ] [REMOTE ] WBS: Full fetch complete (69808 records). [2025-10-09T22:20:22.261917] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-09T22:20:22.401898] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-09T22:20:22.725940] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-09T22:20:22.726144] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-09T22:20:22.727987] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-09T22:20:22.728063] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-09T22:20:22.730124] [DEBUG] [LOCAL ] WBS: Trimmed 69808 records to 49017 (keeping 200 days of data) [2025-10-09T22:20:22.998434] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T22:20:23.113151] [DEBUG] [LOCAL ] WBS: Primary data saved (49017 records). [2025-10-09T22:20:23.113523] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-09T22:20:23.113741] [INFO ] [MAIN ] Update Progress: 2276/2373 symbols completed. WBS took 40.5s. Estimated remaining: 13m 39s. Rate: 7.1 symbols/min [2025-10-09T22:20:23.201904] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-09T22:20:23.309484] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:20:23.338413] [DEBUG] [LOCAL ] WD: Loaded 23126 existing records from primary storage. [2025-10-09T22:20:23.338889] [INFO ] [MAIN ] WD: Loaded 23126 existing records. [2025-10-09T22:20:23.545174] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:20:23.545523] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-09T22:20:23.545578] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-09T22:20:23.545893] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-09T22:20:23.545955] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-09T22:20:23.711800] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T22:20:23.971739] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:20:23.996727] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-09T22:20:24.205294] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T22:20:24.796827] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-09T22:20:25.426099] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T22:20:25.428151] [INFO ] [REMOTE ] WBX: Full fetch complete (23972 records). [2025-10-09T22:20:25.428236] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-09T22:20:25.596817] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-09T22:20:25.740246] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T22:20:25.853571] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-09T22:20:25.853673] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-09T22:20:25.854205] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-09T22:20:25.854247] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-09T22:20:25.854838] [DEBUG] [LOCAL ] WBX: Trimmed 23972 records to 11071 (keeping 200 days of data) [2025-10-09T22:20:25.918382] [DEBUG] [LOCAL ] WBX: Primary data saved (11071 records). [2025-10-09T22:20:25.918511] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-09T22:20:25.918598] [INFO ] [MAIN ] Update Progress: 2277/2373 symbols completed. WBX took 41.7s. Estimated remaining: 13m 30s. Rate: 7.1 symbols/min [2025-10-09T22:20:26.396728] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-09T22:20:27.196731] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-09T22:20:27.635709] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T22:20:27.638837] [INFO ] [REMOTE ] WCC: Full fetch complete (57401 records). [2025-10-09T22:20:27.638932] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-09T22:20:27.916228] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-09T22:20:27.997262] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-09T22:20:28.081704] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-09T22:20:28.081800] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-09T22:20:28.082815] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-09T22:20:28.082879] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-09T22:20:28.084133] [DEBUG] [LOCAL ] WCC: Trimmed 57401 records to 39384 (keeping 200 days of data) [2025-10-09T22:20:28.186016] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T22:20:28.348509] [DEBUG] [LOCAL ] WCC: Primary data saved (39384 records). [2025-10-09T22:20:28.348673] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-09T22:20:28.348776] [INFO ] [MAIN ] Update Progress: 2278/2373 symbols completed. WCC took 30.6s. Estimated remaining: 13m 22s. Rate: 7.1 symbols/min [2025-10-09T22:20:28.796752] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-09T22:20:29.660206] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T22:20:29.670362] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-09T22:20:29.822308] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T22:20:30.396726] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-09T22:20:31.365744] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T22:20:31.376372] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-09T22:20:31.515238] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T22:20:31.996745] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-09T22:20:32.666422] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T22:20:32.670604] [INFO ] [REMOTE ] WCN: Full fetch complete (69324 records). [2025-10-09T22:20:32.670757] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-09T22:20:33.110968] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-09T22:20:33.111179] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-09T22:20:33.113737] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T22:20:33.113159] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-09T22:20:33.113889] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-09T22:20:33.119976] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-09T22:20:33.122034] [DEBUG] [LOCAL ] WCN: Trimmed 69324 records to 48291 (keeping 200 days of data) [2025-10-09T22:20:33.443528] [DEBUG] [LOCAL ] WCN: Primary data saved (48291 records). [2025-10-09T22:20:33.443721] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-09T22:20:33.444618] [INFO ] [MAIN ] Update Progress: 2279/2373 symbols completed. WCN took 29.9s. Estimated remaining: 13m 13s. Rate: 7.1 symbols/min [2025-10-09T22:20:34.338178] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T22:20:34.343974] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-09T22:20:35.497583] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T22:20:35.503331] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-09T22:20:36.620901] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T22:20:36.626093] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-09T22:20:37.776689] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T22:20:37.782892] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-09T22:20:38.732419] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T22:20:38.737980] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-09T22:20:39.577040] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T22:20:39.582311] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-09T22:20:40.400267] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T22:20:40.402226] [INFO ] [REMOTE ] WD: Full fetch complete (33212 records). [2025-10-09T22:20:40.402297] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-09T22:20:40.781676] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-09T22:20:40.781765] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-09T22:20:40.782439] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-09T22:20:40.782485] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-09T22:20:40.783262] [DEBUG] [LOCAL ] WD: Trimmed 33212 records to 23234 (keeping 200 days of data) [2025-10-09T22:20:40.927824] [DEBUG] [LOCAL ] WD: Primary data saved (23234 records). [2025-10-09T22:20:40.927961] [INFO ] [MAIN ] WD: Full history saved. [2025-10-09T22:20:40.928051] [INFO ] [MAIN ] Update Progress: 2280/2373 symbols completed. WD took 17.8s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-09T22:20:41.505017] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:20:41.518596] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:20:41.616439] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:20:41.652137] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:20:41.669717] [DEBUG] [LOCAL ] WDI: Loaded 21097 existing records from primary storage. [2025-10-09T22:20:41.676025] [INFO ] [MAIN ] WDI: Loaded 21097 existing records. [2025-10-09T22:20:41.726287] [DEBUG] [LOCAL ] WEA: Loaded 7462 existing records from primary storage. [2025-10-09T22:20:41.780172] [INFO ] [MAIN ] WEA: Loaded 7462 existing records. [2025-10-09T22:20:41.765155] [DEBUG] [LOCAL ] WDH: Loaded 17977 existing records from primary storage. [2025-10-09T22:20:41.804741] [INFO ] [MAIN ] WDH: Loaded 17977 existing records. [2025-10-09T22:20:42.010573] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:20:42.016074] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-09T22:20:42.108838] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-09T22:20:42.167879] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-09T22:20:42.162596] [DEBUG] [LOCAL ] WDS: Loaded 43104 existing records from primary storage. [2025-10-09T22:20:42.173818] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-09T22:20:42.236051] [INFO ] [MAIN ] WDS: Loaded 43104 existing records. [2025-10-09T22:20:42.378058] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:20:42.404293] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-09T22:20:42.440356] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-09T22:20:42.490122] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:20:42.521863] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-09T22:20:42.522195] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-09T22:20:42.532672] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-09T22:20:42.522037] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-09T22:20:42.604752] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-09T22:20:42.661420] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-09T22:20:42.758897] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:20:42.888409] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-09T22:20:42.942963] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-09T22:20:43.027023] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-09T22:20:43.060342] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-09T22:20:43.666447] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:20:43.716174] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-09T22:20:43.727722] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:20:43.782613] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-09T22:20:43.976913] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:20:43.987562] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-09T22:20:44.048028] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:20:44.048331] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-09T22:20:44.701422] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T22:20:44.706813] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-09T22:20:44.738323] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T22:20:44.740227] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-09T22:20:45.068377] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T22:20:45.072893] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-09T22:20:45.382936] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T22:20:45.384951] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-09T22:20:45.549370] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T22:20:45.554064] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-09T22:20:45.806993] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T22:20:45.816884] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-09T22:20:45.864197] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T22:20:45.933672] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T22:20:46.190026] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T22:20:46.396724] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-09T22:20:46.967668] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T22:20:47.196692] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-09T22:20:47.312861] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T22:20:47.916491] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T22:20:47.996708] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-09T22:20:48.748342] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T22:20:48.796762] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-09T22:20:49.596728] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-09T22:20:50.291422] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T22:20:50.396692] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-09T22:20:50.467324] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T22:20:51.112409] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T22:20:51.196693] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-09T22:20:51.846299] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T22:20:51.996724] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-09T22:20:52.716789] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T22:20:52.796677] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-09T22:20:53.596701] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-09T22:20:53.731196] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T22:20:54.396750] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-09T22:20:55.111943] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T22:20:55.181920] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T22:20:55.196675] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-09T22:20:55.996726] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-09T22:20:56.506581] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T22:20:56.701168] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T22:20:56.796693] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-09T22:20:57.596709] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-09T22:20:58.397242] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-09T22:20:58.399135] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T22:20:58.504603] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T22:20:59.084002] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T22:20:59.196737] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-09T22:20:59.996715] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-09T22:21:00.796740] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-09T22:21:00.886355] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T22:21:01.091868] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T22:21:01.348298] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T22:21:01.349577] [INFO ] [REMOTE ] WEA: Full fetch complete (9888 records). [2025-10-09T22:21:01.349677] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-09T22:21:01.601925] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-09T22:21:01.765318] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-09T22:21:01.765431] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-09T22:21:01.765809] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-09T22:21:01.765873] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-09T22:21:01.766409] [DEBUG] [LOCAL ] WEA: Trimmed 9888 records to 7554 (keeping 200 days of data) [2025-10-09T22:21:01.825190] [DEBUG] [LOCAL ] WEA: Primary data saved (7554 records). [2025-10-09T22:21:01.825348] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-09T22:21:01.825440] [INFO ] [MAIN ] Update Progress: 2281/2373 symbols completed. WEA took 20.9s. Estimated remaining: 12m 57s. Rate: 7.1 symbols/min [2025-10-09T22:21:02.005440] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:21:02.043129] [DEBUG] [LOCAL ] WEAV: Loaded 41861 existing records from primary storage. [2025-10-09T22:21:02.043428] [INFO ] [MAIN ] WEAV: Loaded 41861 existing records. [2025-10-09T22:21:02.225238] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:21:02.225487] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-09T22:21:02.225534] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-09T22:21:02.225754] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-09T22:21:02.225812] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-09T22:21:02.398218] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-09T22:21:02.591501] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:21:02.705564] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T22:21:03.196694] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-09T22:21:03.334532] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T22:21:03.996695] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-09T22:21:04.237079] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T22:21:04.796722] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-09T22:21:05.605188] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-09T22:21:05.614087] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T22:21:05.999708] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T22:21:06.396735] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-09T22:21:07.227335] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-09T22:21:07.246703] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T22:21:07.403590] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T22:21:07.996704] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-09T22:21:08.299424] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T22:21:08.796758] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-09T22:21:09.579293] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T22:21:09.596677] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-09T22:21:09.911118] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T22:21:10.396693] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-09T22:21:10.657684] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T22:21:11.196699] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-09T22:21:11.286979] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T22:21:11.289135] [INFO ] [REMOTE ] WDI: Full fetch complete (30510 records). [2025-10-09T22:21:11.289219] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-09T22:21:11.660924] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-09T22:21:11.661008] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-09T22:21:11.661697] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-09T22:21:11.661770] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-09T22:21:11.662548] [DEBUG] [LOCAL ] WDI: Trimmed 30510 records to 21207 (keeping 200 days of data) [2025-10-09T22:21:11.793225] [DEBUG] [LOCAL ] WDI: Primary data saved (21207 records). [2025-10-09T22:21:11.793351] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-09T22:21:11.793431] [INFO ] [MAIN ] Update Progress: 2282/2373 symbols completed. WDI took 30.9s. Estimated remaining: 12m 48s. Rate: 7.1 symbols/min [2025-10-09T22:21:11.961200] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:21:11.996763] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-09T22:21:12.017021] [DEBUG] [LOCAL ] WEC: Loaded 52168 existing records from primary storage. [2025-10-09T22:21:12.017352] [INFO ] [MAIN ] WEC: Loaded 52168 existing records. [2025-10-09T22:21:12.190216] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:21:12.190430] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-09T22:21:12.190476] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-09T22:21:12.190717] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-09T22:21:12.190783] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-09T22:21:12.551108] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:21:12.608686] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T22:21:12.796713] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-09T22:21:13.127990] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T22:21:13.130602] [INFO ] [REMOTE ] WDH: Full fetch complete (23819 records). [2025-10-09T22:21:13.130707] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-09T22:21:13.510801] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-09T22:21:13.510881] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-09T22:21:13.511447] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-09T22:21:13.511489] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-09T22:21:13.512164] [DEBUG] [LOCAL ] WDH: Trimmed 23819 records to 18104 (keeping 200 days of data) [2025-10-09T22:21:13.597394] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-09T22:21:13.620824] [DEBUG] [LOCAL ] WDH: Primary data saved (18104 records). [2025-10-09T22:21:13.620933] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-09T22:21:13.621012] [INFO ] [MAIN ] Update Progress: 2283/2373 symbols completed. WDH took 32.7s. Estimated remaining: 12m 40s. Rate: 7.1 symbols/min [2025-10-09T22:21:13.805569] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:21:13.856949] [DEBUG] [LOCAL ] WELL: Loaded 52339 existing records from primary storage. [2025-10-09T22:21:13.857289] [INFO ] [MAIN ] WELL: Loaded 52339 existing records. [2025-10-09T22:21:14.041785] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:21:14.042054] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-09T22:21:14.042103] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-09T22:21:14.042429] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-09T22:21:14.042488] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-09T22:21:14.415015] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-09T22:21:14.420953] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:21:14.479204] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T22:21:14.724850] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T22:21:15.196716] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-09T22:21:15.996744] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-09T22:21:16.171600] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T22:21:16.796707] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-09T22:21:16.913536] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T22:21:17.080524] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T22:21:17.084896] [INFO ] [REMOTE ] WDS: Full fetch complete (64228 records). [2025-10-09T22:21:17.085083] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-09T22:21:17.540245] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-09T22:21:17.540368] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-09T22:21:17.541486] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-09T22:21:17.541567] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-09T22:21:17.543012] [DEBUG] [LOCAL ] WDS: Trimmed 64228 records to 43398 (keeping 200 days of data) [2025-10-09T22:21:17.598221] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-09T22:21:17.818962] [DEBUG] [LOCAL ] WDS: Primary data saved (43398 records). [2025-10-09T22:21:17.819114] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-09T22:21:17.819221] [INFO ] [MAIN ] Update Progress: 2284/2373 symbols completed. WDS took 36.9s. Estimated remaining: 12m 31s. Rate: 7.1 symbols/min [2025-10-09T22:21:17.990388] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:21:18.033716] [DEBUG] [LOCAL ] WES: Loaded 48275 existing records from primary storage. [2025-10-09T22:21:18.034055] [INFO ] [MAIN ] WES: Loaded 48275 existing records. [2025-10-09T22:21:18.221226] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:21:18.221600] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-09T22:21:18.221714] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-09T22:21:18.222039] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-09T22:21:18.222103] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-09T22:21:18.440448] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-09T22:21:18.483608] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T22:21:18.638394] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:21:19.093404] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T22:21:19.196718] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-09T22:21:19.578729] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T22:21:19.996709] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-09T22:21:20.796773] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-09T22:21:20.980680] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T22:21:21.544973] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T22:21:21.596690] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-09T22:21:22.401806] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-09T22:21:22.416404] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T22:21:23.205200] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-09T22:21:23.223717] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T22:21:23.996696] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-09T22:21:24.211767] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T22:21:24.425035] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T22:21:24.796716] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-09T22:21:25.596774] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-09T22:21:25.764196] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T22:21:26.396712] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-09T22:21:26.436542] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T22:21:26.656235] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T22:21:27.196764] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-09T22:21:27.817337] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T22:21:27.996710] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-09T22:21:28.696600] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T22:21:28.796686] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-09T22:21:29.083014] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T22:21:29.596788] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-09T22:21:30.396771] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-09T22:21:30.503624] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T22:21:30.968563] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T22:21:31.196717] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-09T22:21:31.990391] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T22:21:31.999579] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-09T22:21:32.580433] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T22:21:32.796771] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-09T22:21:33.596749] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-09T22:21:33.812801] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T22:21:34.352054] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T22:21:34.396694] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-09T22:21:35.196691] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-09T22:21:35.254790] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T22:21:35.768433] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T22:21:35.996715] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-09T22:21:36.686747] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T22:21:36.796709] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-09T22:21:37.596726] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-09T22:21:37.784626] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T22:21:38.396723] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-09T22:21:38.526788] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T22:21:39.186515] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T22:21:39.197003] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-09T22:21:39.748957] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T22:21:39.753534] [INFO ] [REMOTE ] WELL: Full fetch complete (75735 records). [2025-10-09T22:21:39.753699] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-09T22:21:39.999375] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-09T22:21:40.180832] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-09T22:21:40.180991] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-09T22:21:40.182205] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-09T22:21:40.182289] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-09T22:21:40.183992] [DEBUG] [LOCAL ] WELL: Trimmed 75735 records to 52728 (keeping 200 days of data) [2025-10-09T22:21:40.315132] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T22:21:40.574378] [DEBUG] [LOCAL ] WELL: Primary data saved (52728 records). [2025-10-09T22:21:40.574518] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-09T22:21:40.574598] [INFO ] [MAIN ] Update Progress: 2285/2373 symbols completed. WELL took 27.0s. Estimated remaining: 12m 23s. Rate: 7.1 symbols/min [2025-10-09T22:21:40.747205] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:21:40.784813] [DEBUG] [LOCAL ] WEX: Loaded 33689 existing records from primary storage. [2025-10-09T22:21:40.785087] [INFO ] [MAIN ] WEX: Loaded 33689 existing records. [2025-10-09T22:21:40.805180] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-09T22:21:40.970961] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:21:40.971210] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-09T22:21:40.971258] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-09T22:21:40.971548] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-09T22:21:40.971609] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-09T22:21:41.319704] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:21:41.596687] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-09T22:21:41.788390] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T22:21:42.396758] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-09T22:21:42.459697] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T22:21:43.196760] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-09T22:21:43.303150] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T22:21:43.375209] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T22:21:43.996749] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-09T22:21:44.228346] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T22:21:44.232336] [INFO ] [REMOTE ] WEAV: Full fetch complete (61627 records). [2025-10-09T22:21:44.232437] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-09T22:21:44.629683] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-09T22:21:44.629775] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-09T22:21:44.630923] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-09T22:21:44.630998] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-09T22:21:44.632250] [DEBUG] [LOCAL ] WEAV: Trimmed 61627 records to 42226 (keeping 200 days of data) [2025-10-09T22:21:44.797072] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-09T22:21:44.880004] [DEBUG] [LOCAL ] WEAV: Primary data saved (42226 records). [2025-10-09T22:21:44.880136] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-09T22:21:44.880259] [INFO ] [MAIN ] Update Progress: 2286/2373 symbols completed. WEAV took 43.1s. Estimated remaining: 12m 15s. Rate: 7.1 symbols/min [2025-10-09T22:21:45.057691] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:21:45.070475] [DEBUG] [LOCAL ] WF: Loaded 10780 existing records from primary storage. [2025-10-09T22:21:45.070770] [INFO ] [MAIN ] WF: Loaded 10780 existing records. [2025-10-09T22:21:45.256536] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:21:45.256902] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-09T22:21:45.257014] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-09T22:21:45.257220] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-09T22:21:45.257278] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-09T22:21:45.615292] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-09T22:21:45.661267] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:21:45.674611] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T22:21:46.396793] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-09T22:21:46.488549] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T22:21:47.003063] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T22:21:47.196731] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-09T22:21:47.784766] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T22:21:47.996717] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-09T22:21:48.274357] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T22:21:48.648528] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T22:21:48.796730] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-09T22:21:49.596783] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-09T22:21:50.340421] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T22:21:50.396695] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-09T22:21:50.422418] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T22:21:51.196731] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-09T22:21:51.548460] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T22:21:51.553148] [INFO ] [REMOTE ] WEC: Full fetch complete (75539 records). [2025-10-09T22:21:51.553286] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-09T22:21:51.990678] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-09T22:21:51.990938] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-09T22:21:51.992412] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-09T22:21:51.992483] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-09T22:21:51.994063] [DEBUG] [LOCAL ] WEC: Trimmed 75539 records to 52539 (keeping 200 days of data) [2025-10-09T22:21:52.056459] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-09T22:21:52.127557] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T22:21:52.400076] [DEBUG] [LOCAL ] WEC: Primary data saved (52539 records). [2025-10-09T22:21:52.400226] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-09T22:21:52.400312] [INFO ] [MAIN ] Update Progress: 2287/2373 symbols completed. WEC took 40.6s. Estimated remaining: 12m 6s. Rate: 7.1 symbols/min [2025-10-09T22:21:52.583144] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:21:52.640037] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-09T22:21:52.640478] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-09T22:21:52.800152] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-09T22:21:52.826622] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:21:52.827729] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-09T22:21:52.827784] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-09T22:21:52.828013] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-09T22:21:52.828070] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-09T22:21:52.947102] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T22:21:53.193961] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:21:53.596772] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-09T22:21:54.396718] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-09T22:21:54.745287] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T22:21:55.035956] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T22:21:55.196753] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-09T22:21:55.996796] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-09T22:21:56.476252] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T22:21:56.796755] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-09T22:21:57.008825] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T22:21:57.363314] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T22:21:57.596723] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-09T22:21:58.396769] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-09T22:21:58.567806] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T22:21:58.923634] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T22:21:59.196723] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-09T22:21:59.881519] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T22:21:59.886083] [INFO ] [REMOTE ] WES: Full fetch complete (70059 records). [2025-10-09T22:21:59.886235] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-09T22:22:00.001814] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-09T22:22:00.283985] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-09T22:22:00.284072] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-09T22:22:00.285228] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-09T22:22:00.285296] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-09T22:22:00.287323] [DEBUG] [LOCAL ] WES: Trimmed 70059 records to 48662 (keeping 200 days of data) [2025-10-09T22:22:00.594533] [DEBUG] [LOCAL ] WES: Primary data saved (48662 records). [2025-10-09T22:22:00.594750] [INFO ] [MAIN ] WES: Full history saved. [2025-10-09T22:22:00.594856] [INFO ] [MAIN ] Update Progress: 2288/2373 symbols completed. WES took 42.8s. Estimated remaining: 11m 58s. Rate: 7.1 symbols/min [2025-10-09T22:22:00.728980] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T22:22:00.790673] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:22:00.796682] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-09T22:22:00.818481] [DEBUG] [LOCAL ] WFG: Loaded 24788 existing records from primary storage. [2025-10-09T22:22:00.818798] [INFO ] [MAIN ] WFG: Loaded 24788 existing records. [2025-10-09T22:22:01.003351] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:22:01.003717] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-09T22:22:01.003865] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-09T22:22:01.004133] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-09T22:22:01.004330] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-09T22:22:01.392636] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-09T22:22:01.486296] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:22:01.596701] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-09T22:22:01.745776] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T22:22:02.396725] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-09T22:22:03.196699] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-09T22:22:03.230842] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T22:22:03.801710] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-09T22:22:03.996698] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-09T22:22:04.630299] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T22:22:04.796738] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-09T22:22:05.596779] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-09T22:22:06.085724] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T22:22:06.188504] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T22:22:06.243357] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T22:22:06.396727] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-09T22:22:07.196808] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-09T22:22:07.341821] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T22:22:07.345087] [INFO ] [REMOTE ] WEX: Full fetch complete (50363 records). [2025-10-09T22:22:07.345217] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-09T22:22:07.739957] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-09T22:22:07.740052] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-09T22:22:07.741002] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-09T22:22:07.741067] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-09T22:22:07.742139] [DEBUG] [LOCAL ] WEX: Trimmed 50363 records to 33944 (keeping 200 days of data) [2025-10-09T22:22:07.963701] [DEBUG] [LOCAL ] WEX: Primary data saved (33944 records). [2025-10-09T22:22:07.963858] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-09T22:22:07.963947] [INFO ] [MAIN ] Update Progress: 2289/2373 symbols completed. WEX took 27.4s. Estimated remaining: 11m 49s. Rate: 7.1 symbols/min [2025-10-09T22:22:08.004551] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-09T22:22:08.143171] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:22:08.179881] [DEBUG] [LOCAL ] WGO: Loaded 38466 existing records from primary storage. [2025-10-09T22:22:08.180230] [INFO ] [MAIN ] WGO: Loaded 38466 existing records. [2025-10-09T22:22:08.310039] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T22:22:08.377534] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:22:08.377845] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-09T22:22:08.377911] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-09T22:22:08.378104] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-09T22:22:08.378163] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-09T22:22:08.747752] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:22:08.796676] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-09T22:22:09.596722] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-09T22:22:09.763963] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T22:22:10.165545] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-09T22:22:10.303036] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T22:22:10.396772] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-09T22:22:11.196734] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-09T22:22:11.287348] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T22:22:11.996711] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-09T22:22:12.796676] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-09T22:22:13.213486] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T22:22:13.322876] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T22:22:13.579880] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T22:22:13.581164] [INFO ] [REMOTE ] WF: Full fetch complete (16121 records). [2025-10-09T22:22:13.581232] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-09T22:22:13.601802] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-09T22:22:13.943727] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-09T22:22:13.943826] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-09T22:22:13.944235] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-09T22:22:13.944299] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-09T22:22:13.945274] [DEBUG] [LOCAL ] WF: Trimmed 16121 records to 10809 (keeping 200 days of data) [2025-10-09T22:22:14.012688] [DEBUG] [LOCAL ] WF: Primary data saved (10809 records). [2025-10-09T22:22:14.012859] [INFO ] [MAIN ] WF: Full history saved. [2025-10-09T22:22:14.012990] [INFO ] [MAIN ] Update Progress: 2290/2373 symbols completed. WF took 29.1s. Estimated remaining: 11m 41s. Rate: 7.1 symbols/min [2025-10-09T22:22:14.179207] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:22:14.219186] [DEBUG] [LOCAL ] WH: Loaded 45268 existing records from primary storage. [2025-10-09T22:22:14.219501] [INFO ] [MAIN ] WH: Loaded 45268 existing records. [2025-10-09T22:22:14.393469] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:22:14.393753] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-09T22:22:14.393829] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-09T22:22:14.394158] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-09T22:22:14.394218] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-09T22:22:14.405499] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-09T22:22:14.751215] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:22:14.965081] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T22:22:15.196718] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-09T22:22:15.996758] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-09T22:22:16.277571] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T22:22:16.372560] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T22:22:16.796752] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-09T22:22:17.596696] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-09T22:22:17.628702] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T22:22:18.197218] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T22:22:18.396729] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-09T22:22:18.987410] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T22:22:19.196703] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-09T22:22:19.996705] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-09T22:22:20.434991] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T22:22:20.471379] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T22:22:20.759294] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T22:22:20.796735] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-09T22:22:21.596728] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-09T22:22:22.190723] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T22:22:22.396737] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-09T22:22:22.896630] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T22:22:23.196754] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-09T22:22:23.996698] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-09T22:22:24.327433] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T22:22:24.796739] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-09T22:22:24.986453] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T22:22:25.309503] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T22:22:25.596789] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-09T22:22:26.124634] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T22:22:26.396780] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-09T22:22:26.937919] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T22:22:26.942559] [INFO ] [REMOTE ] WFC: Full fetch complete (77792 records). [2025-10-09T22:22:26.942724] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-09T22:22:27.207088] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-09T22:22:27.374298] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-09T22:22:27.374566] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-09T22:22:27.376248] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-09T22:22:27.378070] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T22:22:27.378238] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-09T22:22:27.392746] [DEBUG] [LOCAL ] WFC: Trimmed 77792 records to 54138 (keeping 200 days of data) [2025-10-09T22:22:27.750399] [DEBUG] [LOCAL ] WFC: Primary data saved (54138 records). [2025-10-09T22:22:27.750594] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-09T22:22:27.750749] [INFO ] [MAIN ] Update Progress: 2291/2373 symbols completed. WFC took 35.4s. Estimated remaining: 11m 32s. Rate: 7.1 symbols/min [2025-10-09T22:22:27.920490] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:22:27.955976] [DEBUG] [LOCAL ] WHD: Loaded 40002 existing records from primary storage. [2025-10-09T22:22:27.956260] [INFO ] [MAIN ] WHD: Loaded 40002 existing records. [2025-10-09T22:22:28.002004] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-09T22:22:28.132113] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:22:28.132324] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-09T22:22:28.132371] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-09T22:22:28.132596] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-09T22:22:28.132689] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-09T22:22:28.494271] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:22:28.796699] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-09T22:22:28.900365] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T22:22:29.243429] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T22:22:29.596764] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-09T22:22:29.790864] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T22:22:30.396714] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-09T22:22:31.100015] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T22:22:31.196702] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-09T22:22:31.910027] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T22:22:31.996706] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-09T22:22:32.266320] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T22:22:32.796730] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-09T22:22:33.331613] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T22:22:33.596731] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-09T22:22:34.093537] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T22:22:34.396745] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-09T22:22:35.135188] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T22:22:35.196710] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-09T22:22:35.263195] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-09T22:22:35.996727] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-09T22:22:36.796733] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-09T22:22:36.914213] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T22:22:36.992619] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T22:22:37.596723] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-09T22:22:38.298522] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T22:22:38.396695] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-09T22:22:38.735156] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T22:22:39.196728] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-09T22:22:39.528817] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T22:22:39.996677] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-09T22:22:40.243968] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T22:22:40.796720] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-09T22:22:41.250526] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T22:22:41.596743] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-09T22:22:41.981530] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T22:22:41.985279] [INFO ] [REMOTE ] WH: Full fetch complete (64917 records). [2025-10-09T22:22:41.985397] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-09T22:22:42.371018] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-09T22:22:42.371125] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-09T22:22:42.372237] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-09T22:22:42.372311] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-09T22:22:42.373809] [DEBUG] [LOCAL ] WH: Trimmed 64917 records to 45599 (keeping 200 days of data) [2025-10-09T22:22:42.429571] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-09T22:22:42.615323] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T22:22:42.689016] [DEBUG] [LOCAL ] WH: Primary data saved (45599 records). [2025-10-09T22:22:42.689157] [INFO ] [MAIN ] WH: Full history saved. [2025-10-09T22:22:42.689253] [INFO ] [MAIN ] Update Progress: 2292/2373 symbols completed. WH took 28.7s. Estimated remaining: 11m 24s. Rate: 7.1 symbols/min [2025-10-09T22:22:42.858878] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:22:42.864461] [DEBUG] [LOCAL ] WHG: Loaded 3243 existing records from primary storage. [2025-10-09T22:22:42.864672] [INFO ] [MAIN ] WHG: Loaded 3243 existing records. [2025-10-09T22:22:43.042431] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:22:43.042676] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-09T22:22:43.042738] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-09T22:22:43.042915] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-09T22:22:43.042974] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-09T22:22:43.199428] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-09T22:22:43.421078] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:22:43.565707] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T22:22:43.568909] [INFO ] [REMOTE ] WGO: Full fetch complete (57402 records). [2025-10-09T22:22:43.569004] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-09T22:22:43.957715] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-09T22:22:43.957809] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-09T22:22:43.958919] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-09T22:22:43.958983] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-09T22:22:43.960173] [DEBUG] [LOCAL ] WGO: Trimmed 57402 records to 38744 (keeping 200 days of data) [2025-10-09T22:22:44.014767] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-09T22:22:44.216398] [DEBUG] [LOCAL ] WGO: Primary data saved (38744 records). [2025-10-09T22:22:44.216561] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-09T22:22:44.216687] [INFO ] [MAIN ] Update Progress: 2293/2373 symbols completed. WGO took 36.3s. Estimated remaining: 11m 15s. Rate: 7.1 symbols/min [2025-10-09T22:22:44.386757] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:22:44.429995] [DEBUG] [LOCAL ] WHR: Loaded 48375 existing records from primary storage. [2025-10-09T22:22:44.430304] [INFO ] [MAIN ] WHR: Loaded 48375 existing records. [2025-10-09T22:22:44.611382] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:22:44.611715] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-09T22:22:44.611846] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-09T22:22:44.612185] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-09T22:22:44.612246] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-09T22:22:44.741501] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T22:22:44.801478] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-09T22:22:44.996746] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T22:22:45.020619] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:22:45.021687] [INFO ] [REMOTE ] WFG: Full fetch complete (35956 records). [2025-10-09T22:22:45.021801] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-09T22:22:45.396185] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-09T22:22:45.396261] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-09T22:22:45.396989] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-09T22:22:45.397054] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-09T22:22:45.397865] [DEBUG] [LOCAL ] WFG: Trimmed 35956 records to 25001 (keeping 200 days of data) [2025-10-09T22:22:45.551752] [DEBUG] [LOCAL ] WFG: Primary data saved (25001 records). [2025-10-09T22:22:45.551881] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-09T22:22:45.551962] [INFO ] [MAIN ] Update Progress: 2294/2373 symbols completed. WFG took 45.0s. Estimated remaining: 11m 7s. Rate: 7.1 symbols/min [2025-10-09T22:22:45.606375] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-09T22:22:45.721831] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:22:45.728541] [DEBUG] [LOCAL ] WIA: Loaded 4969 existing records from primary storage. [2025-10-09T22:22:45.728735] [INFO ] [MAIN ] WIA: Loaded 4969 existing records. [2025-10-09T22:22:45.902927] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:22:45.903107] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-09T22:22:45.903154] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-09T22:22:45.903345] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-09T22:22:45.903401] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-09T22:22:46.259123] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:22:46.313936] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T22:22:46.396681] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-09T22:22:46.771476] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T22:22:47.196758] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-09T22:22:47.702473] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T22:22:47.859826] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T22:22:47.996715] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-09T22:22:48.588548] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T22:22:48.796696] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-09T22:22:49.109297] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T22:22:49.596722] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-09T22:22:50.094688] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T22:22:50.396715] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-09T22:22:51.196792] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-09T22:22:51.829069] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T22:22:51.996822] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-09T22:22:52.796768] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-09T22:22:53.596763] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-09T22:23:07.617296] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (14.82 seconds). [2025-10-09T22:23:07.619234] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-09T22:23:07.647334] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (16.45 seconds). [2025-10-09T22:23:07.649276] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-09T22:23:08.379302] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (16.38 seconds). [2025-10-09T22:23:08.387885] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-09T22:23:08.534480] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T22:23:08.536009] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-09T22:23:08.623991] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T22:23:08.625601] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-09T22:23:08.758090] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (15.16 seconds). [2025-10-09T22:23:08.767848] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-09T22:23:09.140363] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T22:23:09.141971] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-09T22:23:09.212191] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-09T22:23:09.213906] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-09T22:23:09.522306] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T22:23:09.531340] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-09T22:23:09.783775] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T22:23:09.786311] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-09T22:23:09.823097] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T22:23:09.825398] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-09T22:23:10.179513] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T22:23:10.188661] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-09T22:23:10.199849] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-09T22:23:10.201410] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-09T22:23:10.289575] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T22:23:10.291094] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-09T22:23:10.600854] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-09T22:23:10.602163] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-09T22:23:10.795395] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T22:23:10.809974] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-09T22:23:11.095865] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T22:23:11.097020] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-09T22:23:11.337055] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T22:23:11.338687] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-09T22:23:11.407221] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-09T22:23:11.408005] [INFO ] [REMOTE ] WHG: Full fetch complete (4556 records). [2025-10-09T22:23:11.408079] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-09T22:23:11.811636] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-09T22:23:11.811879] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-09T22:23:11.812282] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-09T22:23:11.812598] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-09T22:23:11.813394] [DEBUG] [LOCAL ] WHG: Trimmed 4556 records to 3246 (keeping 200 days of data) [2025-10-09T22:23:11.820473] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T22:23:11.842493] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T22:23:11.855849] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-09T22:23:11.857797] [INFO ] [REMOTE ] WHD: Full fetch complete (57561 records). [2025-10-09T22:23:11.860875] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-09T22:23:11.876118] [DEBUG] [LOCAL ] WHG: Primary data saved (3246 records). [2025-10-09T22:23:11.890676] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-09T22:23:11.896087] [INFO ] [MAIN ] Update Progress: 2295/2373 symbols completed. WHG took 29.2s. Estimated remaining: 10m 59s. Rate: 7.1 symbols/min [2025-10-09T22:23:12.270278] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:23:12.405811] [DEBUG] [LOCAL ] WINN: Loaded 11534 existing records from primary storage. [2025-10-09T22:23:12.456504] [INFO ] [MAIN ] WINN: Loaded 11534 existing records. [2025-10-09T22:23:12.673192] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T22:23:12.675119] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-09T22:23:12.718326] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-09T22:23:12.721062] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-09T22:23:12.743812] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-09T22:23:12.783488] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-09T22:23:12.783875] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-09T22:23:12.800178] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:23:12.800581] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-09T22:23:12.801441] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-09T22:23:12.801513] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-09T22:23:12.801732] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-09T22:23:12.801803] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-09T22:23:12.903861] [DEBUG] [LOCAL ] WHD: Trimmed 57561 records to 40299 (keeping 200 days of data) [2025-10-09T22:23:13.278775] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:23:13.279457] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-09T22:23:13.438059] [DEBUG] [LOCAL ] WHD: Primary data saved (40299 records). [2025-10-09T22:23:13.438186] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-09T22:23:13.438265] [INFO ] [MAIN ] Update Progress: 2296/2373 symbols completed. WHD took 45.7s. Estimated remaining: 10m 50s. Rate: 7.1 symbols/min [2025-10-09T22:23:13.548638] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T22:23:13.566362] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-09T22:23:13.622194] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:23:13.673180] [DEBUG] [LOCAL ] WIT: Loaded 52402 existing records from primary storage. [2025-10-09T22:23:13.673525] [INFO ] [MAIN ] WIT: Loaded 52402 existing records. [2025-10-09T22:23:13.853245] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:23:13.853475] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-09T22:23:13.853539] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-09T22:23:13.853787] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-09T22:23:13.853845] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-09T22:23:14.016671] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T22:23:14.045465] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-09T22:23:14.157852] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T22:23:14.185461] [INFO ] [REMOTE ] WIA: Full fetch complete (7314 records). [2025-10-09T22:23:14.243148] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-09T22:23:14.243034] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:23:14.243687] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-09T22:23:14.632279] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-09T22:23:14.632446] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-09T22:23:14.632731] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-09T22:23:14.632809] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-09T22:23:14.633436] [DEBUG] [LOCAL ] WIA: Trimmed 7314 records to 5003 (keeping 200 days of data) [2025-10-09T22:23:14.696361] [DEBUG] [LOCAL ] WIA: Primary data saved (5003 records). [2025-10-09T22:23:14.697995] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T22:23:14.697049] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-09T22:23:14.698138] [INFO ] [MAIN ] Update Progress: 2297/2373 symbols completed. WIA took 29.1s. Estimated remaining: 10m 42s. Rate: 7.1 symbols/min [2025-10-09T22:23:14.752617] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-09T22:23:14.884262] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:23:14.905155] [DEBUG] [LOCAL ] WIW: Loaded 20456 existing records from primary storage. [2025-10-09T22:23:14.905429] [INFO ] [MAIN ] WIW: Loaded 20456 existing records. [2025-10-09T22:23:15.100416] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:23:15.105857] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-09T22:23:15.106327] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T22:23:15.106454] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-09T22:23:15.111044] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-09T22:23:15.111109] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-09T22:23:15.207678] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-09T22:23:15.483502] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:23:15.729928] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T22:23:15.996689] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-09T22:23:16.024433] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T22:23:16.185173] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T22:23:16.715111] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T22:23:16.796679] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-09T22:23:17.596691] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-09T22:23:17.899979] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T22:23:18.396708] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-09T22:23:18.549402] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T22:23:19.196780] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-09T22:23:19.337462] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T22:23:19.996689] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-09T22:23:20.181448] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T22:23:20.796690] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-09T22:23:21.033068] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T22:23:21.357397] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T22:23:21.596763] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-09T22:23:22.396767] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-09T22:23:23.196766] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-09T22:23:23.362225] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T22:23:23.961630] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T22:23:23.996682] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-09T22:23:24.208471] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T22:23:24.796786] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-09T22:23:25.508991] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T22:23:25.596766] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-09T22:23:25.707705] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T22:23:26.396703] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-09T22:23:26.628926] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T22:23:26.854532] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-09T22:23:27.196735] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-09T22:23:27.937181] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T22:23:27.996665] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-09T22:23:28.542289] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T22:23:28.796762] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-09T22:23:29.596743] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-09T22:23:29.787217] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T22:23:30.396771] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-09T22:23:31.022802] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T22:23:31.196754] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-09T22:23:31.404870] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T22:23:31.996786] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-09T22:23:32.547522] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T22:23:32.796731] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-09T22:23:33.052322] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T22:23:33.452493] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T22:23:33.453879] [INFO ] [REMOTE ] WINN: Full fetch complete (17393 records). [2025-10-09T22:23:33.453951] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-09T22:23:33.602877] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-09T22:23:33.822204] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-09T22:23:33.822279] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-09T22:23:33.822661] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-09T22:23:33.822722] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-09T22:23:33.823258] [DEBUG] [LOCAL ] WINN: Trimmed 17393 records to 11606 (keeping 200 days of data) [2025-10-09T22:23:33.892832] [DEBUG] [LOCAL ] WINN: Primary data saved (11606 records). [2025-10-09T22:23:33.892955] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-09T22:23:33.893034] [INFO ] [MAIN ] Update Progress: 2298/2373 symbols completed. WINN took 22.0s. Estimated remaining: 10m 33s. Rate: 7.1 symbols/min [2025-10-09T22:23:34.061281] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:23:34.096630] [DEBUG] [LOCAL ] WK: Loaded 37192 existing records from primary storage. [2025-10-09T22:23:34.096967] [INFO ] [MAIN ] WK: Loaded 37192 existing records. [2025-10-09T22:23:34.271231] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:23:34.271469] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-09T22:23:34.271532] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-09T22:23:34.271867] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-09T22:23:34.271939] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-09T22:23:34.407698] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-09T22:23:34.623216] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:23:35.196699] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-09T22:23:35.519458] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T22:23:35.653793] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T22:23:35.657849] [INFO ] [REMOTE ] WHR: Full fetch complete (68914 records). [2025-10-09T22:23:35.657951] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-09T22:23:35.997354] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-09T22:23:36.047849] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-09T22:23:36.048074] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-09T22:23:36.049402] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-09T22:23:36.049550] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-09T22:23:36.051261] [DEBUG] [LOCAL ] WHR: Trimmed 68914 records to 48754 (keeping 200 days of data) [2025-10-09T22:23:36.161763] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T22:23:36.380484] [DEBUG] [LOCAL ] WHR: Primary data saved (48754 records). [2025-10-09T22:23:36.380721] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-09T22:23:36.380823] [INFO ] [MAIN ] Update Progress: 2299/2373 symbols completed. WHR took 52.2s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-09T22:23:36.549471] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:23:36.582105] [DEBUG] [LOCAL ] WKC: Loaded 34635 existing records from primary storage. [2025-10-09T22:23:36.582379] [INFO ] [MAIN ] WKC: Loaded 34635 existing records. [2025-10-09T22:23:36.756574] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:23:36.756787] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-09T22:23:36.756835] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-09T22:23:36.757042] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-09T22:23:36.757123] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-09T22:23:36.801844] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-09T22:23:37.115114] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:23:37.574289] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T22:23:37.593061] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T22:23:37.597547] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-09T22:23:38.396732] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-09T22:23:38.650977] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T22:23:39.196758] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-09T22:23:39.398638] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T22:23:39.996782] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-09T22:23:40.016153] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T22:23:40.018378] [INFO ] [REMOTE ] WIW: Full fetch complete (29601 records). [2025-10-09T22:23:40.018471] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-09T22:23:40.398404] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-09T22:23:40.398499] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-09T22:23:40.399147] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-09T22:23:40.399210] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-09T22:23:40.399993] [DEBUG] [LOCAL ] WIW: Trimmed 29601 records to 20563 (keeping 200 days of data) [2025-10-09T22:23:40.523611] [DEBUG] [LOCAL ] WIW: Primary data saved (20563 records). [2025-10-09T22:23:40.523761] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-09T22:23:40.523846] [INFO ] [MAIN ] Update Progress: 2300/2373 symbols completed. WIW took 25.8s. Estimated remaining: 10m 16s. Rate: 7.1 symbols/min [2025-10-09T22:23:40.694609] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:23:40.735735] [DEBUG] [LOCAL ] WLK: Loaded 45538 existing records from primary storage. [2025-10-09T22:23:40.736059] [INFO ] [MAIN ] WLK: Loaded 45538 existing records. [2025-10-09T22:23:40.801796] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-09T22:23:40.915198] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:23:40.915418] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-09T22:23:40.915468] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-09T22:23:40.915748] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-09T22:23:40.915814] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-09T22:23:41.272304] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:23:41.596728] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-09T22:23:41.860744] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T22:23:42.235861] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T22:23:42.396722] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-09T22:23:42.881692] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T22:23:43.196743] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-09T22:23:43.817271] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T22:23:43.996778] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-09T22:23:44.739561] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T22:23:44.796728] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-09T22:23:44.946534] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T22:23:45.596732] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-09T22:23:46.249135] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T22:23:46.396736] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-09T22:23:47.194204] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T22:23:47.202091] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-09T22:23:47.885063] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T22:23:47.996689] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-09T22:23:48.788493] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T22:23:48.799388] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-09T22:23:49.306279] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T22:23:49.596722] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-09T22:23:50.170669] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T22:23:50.396685] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-09T22:23:50.863211] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T22:23:51.196766] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-09T22:23:51.571284] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T22:23:51.996738] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-09T22:23:52.670584] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T22:23:52.796719] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-09T22:23:53.197333] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T22:23:53.596749] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-09T22:23:54.180001] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T22:23:54.396741] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-09T22:23:55.196686] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-09T22:23:55.258880] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T22:23:55.662826] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T22:23:55.996717] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-09T22:23:56.391319] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T22:23:56.796718] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-09T22:23:57.596723] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-09T22:23:57.713809] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T22:23:58.396719] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-09T22:23:58.574419] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T22:23:59.064381] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T22:23:59.196701] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-09T22:23:59.774408] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T22:23:59.996711] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-09T22:24:00.645925] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T22:24:00.796717] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-09T22:24:01.261099] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T22:24:01.596774] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-09T22:24:02.073309] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T22:24:02.078253] [INFO ] [REMOTE ] WK: Full fetch complete (52715 records). [2025-10-09T22:24:02.078454] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-09T22:24:02.401888] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-09T22:24:02.468440] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-09T22:24:02.468537] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-09T22:24:02.469526] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-09T22:24:02.469596] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-09T22:24:02.470862] [DEBUG] [LOCAL ] WK: Trimmed 52715 records to 37473 (keeping 200 days of data) [2025-10-09T22:24:02.691523] [DEBUG] [LOCAL ] WK: Primary data saved (37473 records). [2025-10-09T22:24:02.691703] [INFO ] [MAIN ] WK: Full history saved. [2025-10-09T22:24:02.691802] [INFO ] [MAIN ] Update Progress: 2301/2373 symbols completed. WK took 28.8s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-09T22:24:02.864047] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:24:02.872469] [DEBUG] [LOCAL ] WLKP: Loaded 6909 existing records from primary storage. [2025-10-09T22:24:02.872687] [INFO ] [MAIN ] WLKP: Loaded 6909 existing records. [2025-10-09T22:24:03.059010] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:24:03.059347] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-09T22:24:03.059432] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-09T22:24:03.059743] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-09T22:24:03.059803] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-09T22:24:03.208255] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-09T22:24:03.434432] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T22:24:03.529269] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:24:03.771525] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T22:24:03.996737] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-09T22:24:04.687918] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T22:24:04.796688] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-09T22:24:05.381935] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T22:24:05.395966] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T22:24:05.596726] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-09T22:24:06.396718] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-09T22:24:07.196698] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-09T22:24:07.381037] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T22:24:07.975233] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T22:24:07.980692] [INFO ] [REMOTE ] WIT: Full fetch complete (75708 records). [2025-10-09T22:24:07.980923] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-09T22:24:08.004019] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-09T22:24:08.102445] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T22:24:08.409200] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-09T22:24:08.409301] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-09T22:24:08.410511] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-09T22:24:08.410581] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-09T22:24:08.414176] [DEBUG] [LOCAL ] WIT: Trimmed 75708 records to 52792 (keeping 200 days of data) [2025-10-09T22:24:08.728390] [DEBUG] [LOCAL ] WIT: Primary data saved (52792 records). [2025-10-09T22:24:08.728556] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-09T22:24:08.728676] [INFO ] [MAIN ] Update Progress: 2302/2373 symbols completed. WIT took 55.3s. Estimated remaining: 9m 60s. Rate: 7.1 symbols/min [2025-10-09T22:24:08.805581] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-09T22:24:08.915356] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:24:08.915535] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-09T22:24:08.915573] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-09T22:24:08.915712] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-09T22:24:08.915764] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-09T22:24:08.915874] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-09T22:24:08.915929] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-09T22:24:09.269596] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:24:09.596752] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-09T22:24:09.635043] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T22:24:09.959443] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T22:24:10.259073] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T22:24:10.396797] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-09T22:24:11.196821] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-09T22:24:11.199865] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T22:24:11.996771] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-09T22:24:12.344880] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-09T22:24:12.608968] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T22:24:12.615045] [INFO ] [REMOTE ] WLK: Full fetch complete (63297 records). [2025-10-09T22:24:12.615171] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-09T22:24:12.806796] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-09T22:24:13.009765] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-09T22:24:13.009856] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-09T22:24:13.011001] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-09T22:24:13.011072] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-09T22:24:13.012428] [DEBUG] [LOCAL ] WLK: Trimmed 63297 records to 45905 (keeping 200 days of data) [2025-10-09T22:24:13.256565] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T22:24:13.334610] [DEBUG] [LOCAL ] WLK: Primary data saved (45905 records). [2025-10-09T22:24:13.334783] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-09T22:24:13.334879] [INFO ] [MAIN ] Update Progress: 2303/2373 symbols completed. WLK took 32.8s. Estimated remaining: 9m 51s. Rate: 7.1 symbols/min [2025-10-09T22:24:13.499782] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:24:13.529030] [DEBUG] [LOCAL ] WLY: Loaded 29488 existing records from primary storage. [2025-10-09T22:24:13.529315] [INFO ] [MAIN ] WLY: Loaded 29488 existing records. [2025-10-09T22:24:13.601914] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-09T22:24:13.713256] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:24:13.713575] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-09T22:24:13.713628] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-09T22:24:13.713889] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-09T22:24:13.713946] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-09T22:24:14.076448] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:24:14.213425] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T22:24:14.396709] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-09T22:24:14.746232] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-09T22:24:15.196720] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-09T22:24:15.635958] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T22:24:15.996728] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-09T22:24:16.796757] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-09T22:24:16.995264] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T22:24:17.000816] [INFO ] [REMOTE ] WKC: Full fetch complete (50493 records). [2025-10-09T22:24:17.000928] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-09T22:24:17.419443] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-09T22:24:17.419524] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-09T22:24:17.420465] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-09T22:24:17.420528] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-09T22:24:17.421558] [DEBUG] [LOCAL ] WKC: Trimmed 50493 records to 34872 (keeping 200 days of data) [2025-10-09T22:24:17.597782] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-09T22:24:17.645864] [DEBUG] [LOCAL ] WKC: Primary data saved (34872 records). [2025-10-09T22:24:17.646133] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-09T22:24:17.646238] [INFO ] [MAIN ] Update Progress: 2304/2373 symbols completed. WKC took 41.3s. Estimated remaining: 9m 43s. Rate: 7.1 symbols/min [2025-10-09T22:24:17.824895] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:24:17.845731] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T22:24:17.899905] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T22:24:17.900869] [DEBUG] [LOCAL ] WM: Loaded 50985 existing records from primary storage. [2025-10-09T22:24:17.902358] [INFO ] [MAIN ] WM: Loaded 50985 existing records. [2025-10-09T22:24:18.091246] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:24:18.091527] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-09T22:24:18.091585] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-09T22:24:18.091845] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-09T22:24:18.091903] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-09T22:24:18.397374] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-09T22:24:18.502920] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:24:18.749637] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T22:24:19.196748] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-09T22:24:19.970451] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T22:24:19.996673] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-09T22:24:20.605381] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T22:24:20.796704] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-09T22:24:21.130601] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-09T22:24:21.596736] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-09T22:24:22.396730] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-09T22:24:22.836839] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T22:24:23.196717] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-09T22:24:23.996681] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-09T22:24:24.402530] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T22:24:24.516014] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-09T22:24:24.663288] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T22:24:24.796676] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-09T22:24:25.596791] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-09T22:24:25.955306] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-09T22:24:26.162398] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T22:24:26.396820] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-09T22:24:26.722715] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T22:24:27.196777] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-09T22:24:27.737475] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T22:24:27.996724] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-09T22:24:28.796740] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-09T22:24:29.041146] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T22:24:29.519897] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T22:24:29.596681] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-09T22:24:30.345723] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T22:24:30.396691] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-09T22:24:31.196766] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-09T22:24:31.789075] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T22:24:31.790237] [INFO ] [REMOTE ] WLKP: Full fetch complete (10211 records). [2025-10-09T22:24:31.790305] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-09T22:24:32.003570] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-09T22:24:32.165570] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-09T22:24:32.165806] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-09T22:24:32.166121] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-09T22:24:32.166194] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-09T22:24:32.166900] [DEBUG] [LOCAL ] WLKP: Trimmed 10211 records to 6946 (keeping 200 days of data) [2025-10-09T22:24:32.242226] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T22:24:32.243826] [DEBUG] [LOCAL ] WLKP: Primary data saved (6946 records). [2025-10-09T22:24:32.254629] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-09T22:24:32.255128] [INFO ] [MAIN ] Update Progress: 2305/2373 symbols completed. WLKP took 29.6s. Estimated remaining: 9m 34s. Rate: 7.1 symbols/min [2025-10-09T22:24:32.407716] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T22:24:32.426603] [INFO ] [REMOTE ] WLTG: Full fetch complete (1676 records). [2025-10-09T22:24:32.428460] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-09T22:24:32.429551] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:24:32.609604] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T22:24:32.609834] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T22:24:32.609904] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T22:24:32.609954] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-09T22:24:32.610010] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-09T22:24:32.610079] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-09T22:24:32.610147] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-09T22:24:32.610206] [INFO ] [MAIN ] Update Progress: 2306/2373 symbols completed. WLTG took 23.9s. Estimated remaining: 9m 26s. Rate: 7.1 symbols/min [2025-10-09T22:24:32.810223] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:24:32.807874] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-09T22:24:32.812878] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-09T22:24:32.813421] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-09T22:24:32.954679] [DEBUG] [LOCAL ] WMK: Loaded 14571 existing records from primary storage. [2025-10-09T22:24:32.978529] [INFO ] [MAIN ] WMK: Loaded 14571 existing records. [2025-10-09T22:24:33.114104] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:24:33.134988] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-09T22:24:33.163206] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-09T22:24:33.187724] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-09T22:24:33.193417] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-09T22:24:33.193323] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:24:33.261218] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-09T22:24:33.282406] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-09T22:24:33.292535] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-09T22:24:33.292899] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-09T22:24:33.609906] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-09T22:24:33.858126] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:24:33.914972] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:24:34.396744] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-09T22:24:34.635003] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T22:24:35.037812] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T22:24:35.196723] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-09T22:24:35.827488] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T22:24:35.996824] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-09T22:24:36.796703] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-09T22:24:36.871082] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T22:24:37.596743] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-09T22:24:37.736772] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T22:24:38.396749] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-09T22:24:38.413625] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T22:24:38.667076] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T22:24:39.196779] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-09T22:24:39.996715] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-09T22:24:40.220618] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T22:24:40.796696] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-09T22:24:40.956862] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T22:24:41.273502] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T22:24:41.596727] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-09T22:24:42.131035] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T22:24:42.396723] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-09T22:24:42.436500] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T22:24:43.196775] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-09T22:24:43.965981] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T22:24:43.996667] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-09T22:24:44.356434] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T22:24:44.796691] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-09T22:24:45.111995] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T22:24:45.596712] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-09T22:24:46.289726] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T22:24:46.396684] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-09T22:24:46.568772] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T22:24:47.196719] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-09T22:24:47.329273] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T22:24:47.996719] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-09T22:24:48.796707] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-09T22:24:49.027382] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T22:24:49.596754] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-09T22:24:49.648102] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T22:24:49.691360] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T22:24:50.396715] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-09T22:24:50.861477] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T22:24:51.196720] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-09T22:24:51.996691] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-09T22:24:52.105248] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T22:24:52.143080] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T22:24:52.146930] [INFO ] [REMOTE ] WLY: Full fetch complete (42706 records). [2025-10-09T22:24:52.147064] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-09T22:24:52.546269] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-09T22:24:52.546368] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-09T22:24:52.547441] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-09T22:24:52.547506] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-09T22:24:52.548444] [DEBUG] [LOCAL ] WLY: Trimmed 42706 records to 29747 (keeping 200 days of data) [2025-10-09T22:24:52.732760] [DEBUG] [LOCAL ] WLY: Primary data saved (29747 records). [2025-10-09T22:24:52.732896] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-09T22:24:52.733028] [INFO ] [MAIN ] Update Progress: 2307/2373 symbols completed. WLY took 39.4s. Estimated remaining: 9m 18s. Rate: 7.1 symbols/min [2025-10-09T22:24:52.801885] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-09T22:24:52.907099] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:24:52.946314] [DEBUG] [LOCAL ] WMS: Loaded 39565 existing records from primary storage. [2025-10-09T22:24:52.946591] [INFO ] [MAIN ] WMS: Loaded 39565 existing records. [2025-10-09T22:24:53.121900] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:24:53.122084] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-09T22:24:53.122129] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-09T22:24:53.122449] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-09T22:24:53.122506] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-09T22:24:53.482516] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:24:53.495896] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T22:24:53.596670] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-09T22:24:53.841877] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T22:24:54.396710] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-09T22:24:54.564911] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T22:24:55.196728] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-09T22:24:55.922281] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T22:24:55.970561] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T22:24:55.996667] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-09T22:24:56.777255] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T22:24:56.779031] [INFO ] [REMOTE ] WMK: Full fetch complete (19805 records). [2025-10-09T22:24:56.779110] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-09T22:24:56.801868] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-09T22:24:57.149969] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-09T22:24:57.150051] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-09T22:24:57.150518] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-09T22:24:57.150581] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-09T22:24:57.151188] [DEBUG] [LOCAL ] WMK: Trimmed 19805 records to 14682 (keeping 200 days of data) [2025-10-09T22:24:57.241635] [DEBUG] [LOCAL ] WMK: Primary data saved (14682 records). [2025-10-09T22:24:57.241795] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-09T22:24:57.241891] [INFO ] [MAIN ] Update Progress: 2308/2373 symbols completed. WMK took 24.6s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-09T22:24:57.418392] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:24:57.470708] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-09T22:24:57.471097] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-09T22:24:57.601808] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-09T22:24:57.659018] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:24:57.659321] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-09T22:24:57.659373] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-09T22:24:57.659686] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-09T22:24:57.659746] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-09T22:24:58.030456] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:24:58.293221] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T22:24:58.396697] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-09T22:24:59.196712] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-09T22:24:59.616171] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T22:24:59.695782] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T22:24:59.996716] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-09T22:25:00.796735] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-09T22:25:01.392688] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-09T22:25:01.452376] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T22:25:01.596751] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-09T22:25:02.396721] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-09T22:25:03.043709] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T22:25:03.196709] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-09T22:25:03.264368] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-09T22:25:03.996726] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-09T22:25:04.508614] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T22:25:04.587460] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T22:25:04.796738] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-09T22:25:05.596720] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-09T22:25:06.396735] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-09T22:25:06.574115] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-09T22:25:06.663542] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T22:25:07.196679] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-09T22:25:07.507211] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T22:25:07.563709] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T22:25:07.996704] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-09T22:25:08.558771] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T22:25:08.563050] [INFO ] [REMOTE ] WM: Full fetch complete (73741 records). [2025-10-09T22:25:08.563178] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-09T22:25:08.801837] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-09T22:25:08.957734] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-09T22:25:08.957824] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-09T22:25:08.959001] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-09T22:25:08.959065] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-09T22:25:08.961127] [DEBUG] [LOCAL ] WM: Trimmed 73741 records to 51339 (keeping 200 days of data) [2025-10-09T22:25:09.282431] [DEBUG] [LOCAL ] WM: Primary data saved (51339 records). [2025-10-09T22:25:09.282575] [INFO ] [MAIN ] WM: Full history saved. [2025-10-09T22:25:09.282681] [INFO ] [MAIN ] Update Progress: 2309/2373 symbols completed. WM took 51.6s. Estimated remaining: 9m 1s. Rate: 7.1 symbols/min [2025-10-09T22:25:09.456108] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:25:09.491331] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-09T22:25:09.532982] [DEBUG] [LOCAL ] WNC: Loaded 38808 existing records from primary storage. [2025-10-09T22:25:09.533356] [INFO ] [MAIN ] WNC: Loaded 38808 existing records. [2025-10-09T22:25:09.601862] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-09T22:25:09.719236] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:25:09.719464] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-09T22:25:09.719517] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-09T22:25:09.719745] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-09T22:25:09.719803] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-09T22:25:10.124952] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:25:10.154271] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T22:25:10.396726] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-09T22:25:11.196715] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-09T22:25:11.586693] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T22:25:11.982404] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T22:25:11.996670] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-09T22:25:12.796745] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-09T22:25:13.596701] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-09T22:25:13.684989] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-09T22:25:13.720465] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T22:25:13.773292] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T22:25:14.001225] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T22:25:14.006074] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-10-09T22:25:14.006203] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-09T22:25:14.411296] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-09T22:25:14.415889] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-09T22:25:14.415949] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-09T22:25:14.417248] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-09T22:25:14.417444] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-09T22:25:14.419000] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 54062 (keeping 200 days of data) [2025-10-09T22:25:14.754098] [DEBUG] [LOCAL ] WMB: Primary data saved (54062 records). [2025-10-09T22:25:14.754259] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-09T22:25:14.754346] [INFO ] [MAIN ] Update Progress: 2310/2373 symbols completed. WMB took 42.5s. Estimated remaining: 8m 52s. Rate: 7.1 symbols/min [2025-10-09T22:25:14.936903] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:25:14.974050] [DEBUG] [LOCAL ] WNS: Loaded 39858 existing records from primary storage. [2025-10-09T22:25:14.974352] [INFO ] [MAIN ] WNS: Loaded 39858 existing records. [2025-10-09T22:25:15.151577] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:25:15.151917] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-09T22:25:15.151979] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-09T22:25:15.152242] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-09T22:25:15.152302] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-09T22:25:15.201935] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-09T22:25:15.540348] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T22:25:15.544620] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:25:15.550123] [INFO ] [REMOTE ] WMS: Full fetch complete (57125 records). [2025-10-09T22:25:15.550357] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-09T22:25:15.947962] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-09T22:25:15.948079] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-09T22:25:15.949183] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-09T22:25:15.949248] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-09T22:25:15.950625] [DEBUG] [LOCAL ] WMS: Trimmed 57125 records to 39854 (keeping 200 days of data) [2025-10-09T22:25:16.012211] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-09T22:25:16.213817] [DEBUG] [LOCAL ] WMS: Primary data saved (39854 records). [2025-10-09T22:25:16.214024] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-09T22:25:16.214136] [INFO ] [MAIN ] Update Progress: 2311/2373 symbols completed. WMS took 23.5s. Estimated remaining: 8m 43s. Rate: 7.1 symbols/min [2025-10-09T22:25:16.393323] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:25:16.393633] [DEBUG] [LOCAL ] WOLF: No existing data file found in primary storage. [2025-10-09T22:25:16.393767] [WARN ] [MAIN ] WOLF: No existing data found, performing full refresh instead. [2025-10-09T22:25:16.394039] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-09T22:25:16.394096] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-09T22:25:16.394139] [DEBUG] [LOCAL ] WOLF: No primary data file found to delete. [2025-10-09T22:25:16.394172] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-09T22:25:16.703608] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T22:25:16.789258] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:25:16.796689] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-09T22:25:17.596720] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-09T22:25:18.397265] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-09T22:25:18.397118] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T22:25:18.721710] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-09T22:25:18.750540] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T22:25:19.196769] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-09T22:25:19.996735] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-09T22:25:20.102368] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T22:25:20.227283] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T22:25:20.796736] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-09T22:25:21.596687] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-09T22:25:21.683168] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T22:25:22.057380] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T22:25:22.396722] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-09T22:25:23.196742] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-09T22:25:23.996700] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-09T22:25:24.179211] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-09T22:25:24.512572] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T22:25:24.716861] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-09T22:25:24.796690] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-09T22:25:25.593435] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T22:25:25.602778] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-09T22:25:26.396693] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-09T22:25:27.124059] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T22:25:27.193311] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-09T22:25:27.203264] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-09T22:25:27.996721] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-09T22:25:28.463837] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-09T22:25:28.625555] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T22:25:28.796698] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-09T22:25:29.596713] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-09T22:25:30.096821] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T22:25:30.360707] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-09T22:25:30.396680] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-09T22:25:31.196750] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-09T22:25:31.435217] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T22:25:31.996772] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-09T22:25:32.796710] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-09T22:25:32.914135] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T22:25:32.998504] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-09T22:25:33.042682] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T22:25:33.596786] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-09T22:25:34.396740] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-09T22:25:34.811503] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T22:25:35.043923] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T22:25:35.196732] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-09T22:25:35.686533] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T22:25:35.996759] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-09T22:25:36.667771] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T22:25:36.796723] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-09T22:25:37.440010] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T22:25:37.596679] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-09T22:25:37.816527] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T22:25:37.820059] [INFO ] [REMOTE ] WNS: Full fetch complete (55077 records). [2025-10-09T22:25:37.820182] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-09T22:25:38.257093] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-09T22:25:38.257207] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-09T22:25:38.258432] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-09T22:25:38.258501] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-09T22:25:38.259772] [DEBUG] [LOCAL ] WNS: Trimmed 55077 records to 40148 (keeping 200 days of data) [2025-10-09T22:25:38.446291] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-09T22:25:38.529325] [DEBUG] [LOCAL ] WNS: Primary data saved (40148 records). [2025-10-09T22:25:38.529447] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-09T22:25:38.529543] [INFO ] [MAIN ] Update Progress: 2312/2373 symbols completed. WNS took 23.8s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-09T22:25:38.703763] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:25:38.731093] [DEBUG] [LOCAL ] WOR: Loaded 24680 existing records from primary storage. [2025-10-09T22:25:38.731389] [INFO ] [MAIN ] WOR: Loaded 24680 existing records. [2025-10-09T22:25:38.923983] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:25:38.936968] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T22:25:38.937143] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-09T22:25:38.943570] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-09T22:25:38.944306] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-09T22:25:38.944715] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-09T22:25:39.205574] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-09T22:25:39.299351] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:25:39.996768] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-09T22:25:40.796688] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-09T22:25:40.945719] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-09T22:25:41.072296] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T22:25:41.075520] [INFO ] [REMOTE ] WNC: Full fetch complete (57517 records). [2025-10-09T22:25:41.075665] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-09T22:25:41.460816] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-09T22:25:41.460942] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-09T22:25:41.462071] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-09T22:25:41.462153] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-09T22:25:41.496319] [DEBUG] [LOCAL ] WNC: Trimmed 57517 records to 39050 (keeping 200 days of data) [2025-10-09T22:25:41.498131] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-09T22:25:41.599131] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-09T22:25:41.741101] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T22:25:41.775891] [DEBUG] [LOCAL ] WNC: Primary data saved (39050 records). [2025-10-09T22:25:41.776042] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-09T22:25:41.776134] [INFO ] [MAIN ] Update Progress: 2313/2373 symbols completed. WNC took 32.5s. Estimated remaining: 8m 27s. Rate: 7.1 symbols/min [2025-10-09T22:25:41.961668] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:25:41.964547] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-09T22:25:41.969852] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-09T22:25:41.970024] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-09T22:25:42.162430] [DEBUG] [LOCAL ] WOW: Loaded 30408 existing records from primary storage. [2025-10-09T22:25:42.182821] [INFO ] [MAIN ] WOW: Loaded 30408 existing records. [2025-10-09T22:25:42.400123] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-09T22:25:42.504383] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:25:42.532575] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-09T22:25:42.540516] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-09T22:25:42.541834] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-09T22:25:42.556466] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-09T22:25:42.616342] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-09T22:25:42.643280] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-09T22:25:42.659950] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-09T22:25:42.667071] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-09T22:25:42.713488] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 54190 (keeping 200 days of data) [2025-10-09T22:25:43.080422] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:25:43.196947] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-09T22:25:43.301129] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T22:25:43.333444] [DEBUG] [LOCAL ] WMT: Primary data saved (54190 records). [2025-10-09T22:25:43.333592] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-09T22:25:43.333712] [INFO ] [MAIN ] Update Progress: 2314/2373 symbols completed. WMT took 46.1s. Estimated remaining: 8m 18s. Rate: 7.1 symbols/min [2025-10-09T22:25:43.497839] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:25:43.540985] [DEBUG] [LOCAL ] WPC: Loaded 48324 existing records from primary storage. [2025-10-09T22:25:43.541316] [INFO ] [MAIN ] WPC: Loaded 48324 existing records. [2025-10-09T22:25:43.714259] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:25:43.714437] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-09T22:25:43.714483] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-09T22:25:43.714721] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-09T22:25:43.714779] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-09T22:25:44.001870] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-09T22:25:44.070983] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:25:44.796786] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-09T22:25:45.206591] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T22:25:45.596708] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-09T22:25:45.854561] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-09T22:25:45.883069] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T22:25:46.359396] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T22:25:46.396675] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-09T22:25:47.196732] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-09T22:25:47.996729] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-09T22:25:48.700863] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-09T22:25:48.755307] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T22:25:48.796669] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-09T22:25:49.422974] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T22:25:49.596708] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-09T22:25:50.396745] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-09T22:25:50.514499] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T22:25:50.857833] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T22:25:51.103053] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T22:25:51.196696] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-09T22:25:51.996726] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-09T22:25:52.439821] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T22:25:52.796763] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-09T22:25:53.351320] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T22:25:53.596695] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-09T22:25:54.011208] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T22:25:54.396769] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-09T22:25:55.196742] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-09T22:25:55.457098] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T22:25:55.996685] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-09T22:25:56.064185] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-09T22:25:56.796697] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-09T22:25:56.985076] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T22:25:57.161480] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T22:25:57.596701] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-09T22:25:57.931091] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T22:25:58.396736] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-09T22:25:58.735974] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T22:25:59.196734] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-09T22:25:59.996755] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-09T22:26:00.054815] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T22:26:00.796687] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-09T22:26:01.166962] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T22:26:01.417204] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T22:26:01.596740] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-09T22:26:02.396741] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-09T22:26:02.609168] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T22:26:03.196716] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-09T22:26:03.650511] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-09T22:26:03.725309] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T22:26:03.996687] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-09T22:26:04.141157] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T22:26:04.796719] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-09T22:26:05.596673] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-09T22:26:05.985866] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-09T22:26:05.990349] [INFO ] [REMOTE ] WOLF: Full fetch complete (77238 records). [2025-10-09T22:26:05.990461] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-09T22:26:06.404229] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-09T22:26:06.410909] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-09T22:26:06.411049] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-09T22:26:06.412722] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-09T22:26:06.413542] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-09T22:26:06.426115] [DEBUG] [LOCAL ] WOLF: Trimmed 77238 records to 53561 (keeping 200 days of data) [2025-10-09T22:26:06.446906] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T22:26:06.795951] [DEBUG] [LOCAL ] WOLF: Primary data saved (53561 records). [2025-10-09T22:26:06.796095] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-09T22:26:06.796170] [INFO ] [MAIN ] Update Progress: 2315/2373 symbols completed. WOLF took 50.6s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-09T22:26:07.001033] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:26:06.997947] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T22:26:07.061043] [DEBUG] [LOCAL ] WPM: Loaded 52738 existing records from primary storage. [2025-10-09T22:26:07.061359] [INFO ] [MAIN ] WPM: Loaded 52738 existing records. [2025-10-09T22:26:07.201996] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-09T22:26:07.244157] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:26:07.244750] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-09T22:26:07.244811] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-09T22:26:07.245405] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-09T22:26:07.245463] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-09T22:26:07.602107] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T22:26:07.621730] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:26:07.996742] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-09T22:26:08.462276] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T22:26:08.465205] [INFO ] [REMOTE ] WOW: Full fetch complete (42372 records). [2025-10-09T22:26:08.465305] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-09T22:26:08.799314] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-09T22:26:08.890017] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-09T22:26:08.890093] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-09T22:26:08.890947] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-09T22:26:08.891009] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-09T22:26:08.891858] [DEBUG] [LOCAL ] WOW: Trimmed 42372 records to 30654 (keeping 200 days of data) [2025-10-09T22:26:09.067466] [DEBUG] [LOCAL ] WOW: Primary data saved (30654 records). [2025-10-09T22:26:09.067603] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-09T22:26:09.067754] [INFO ] [MAIN ] Update Progress: 2316/2373 symbols completed. WOW took 27.3s. Estimated remaining: 8m 2s. Rate: 7.1 symbols/min [2025-10-09T22:26:09.244669] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:26:09.277165] [DEBUG] [LOCAL ] WPP: Loaded 34089 existing records from primary storage. [2025-10-09T22:26:09.277430] [INFO ] [MAIN ] WPP: Loaded 34089 existing records. [2025-10-09T22:26:09.464816] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:26:09.465212] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-09T22:26:09.465383] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-09T22:26:09.465679] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-09T22:26:09.465785] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-09T22:26:09.600170] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-09T22:26:09.752496] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T22:26:09.877706] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:26:10.396796] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-09T22:26:10.717713] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T22:26:10.926259] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T22:26:11.196723] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-09T22:26:11.511121] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T22:26:11.996792] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-09T22:26:12.809843] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-09T22:26:12.818784] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T22:26:13.596706] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-09T22:26:13.749383] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T22:26:13.783368] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T22:26:13.785857] [INFO ] [REMOTE ] WOR: Full fetch complete (36345 records). [2025-10-09T22:26:13.785947] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-09T22:26:14.176882] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-09T22:26:14.176966] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-09T22:26:14.177888] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-09T22:26:14.177952] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-09T22:26:14.178749] [DEBUG] [LOCAL ] WOR: Trimmed 36345 records to 24817 (keeping 200 days of data) [2025-10-09T22:26:14.334147] [DEBUG] [LOCAL ] WOR: Primary data saved (24817 records). [2025-10-09T22:26:14.334292] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-09T22:26:14.334398] [INFO ] [MAIN ] Update Progress: 2317/2373 symbols completed. WOR took 35.8s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-09T22:26:14.396762] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-09T22:26:15.196745] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-09T22:26:15.302246] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T22:26:15.982531] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T22:26:15.996663] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-09T22:26:16.260445] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T22:26:16.796737] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-09T22:26:17.596861] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-09T22:26:17.938015] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T22:26:17.961606] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T22:26:17.966025] [INFO ] [REMOTE ] WPC: Full fetch complete (70643 records). [2025-10-09T22:26:17.966162] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-09T22:26:18.362300] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-09T22:26:18.362397] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-09T22:26:18.363548] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-09T22:26:18.363615] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-09T22:26:18.365103] [DEBUG] [LOCAL ] WPC: Trimmed 70643 records to 48659 (keeping 200 days of data) [2025-10-09T22:26:18.418726] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-09T22:26:18.672812] [DEBUG] [LOCAL ] WPC: Primary data saved (48659 records). [2025-10-09T22:26:18.672948] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-09T22:26:18.673028] [INFO ] [MAIN ] Update Progress: 2318/2373 symbols completed. WPC took 35.3s. Estimated remaining: 7m 44s. Rate: 7.1 symbols/min [2025-10-09T22:26:18.707481] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T22:26:19.196765] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-09T22:26:20.252542] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T22:26:20.264583] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-09T22:26:20.519060] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T22:26:20.796713] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-09T22:26:22.030671] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T22:26:22.041991] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-09T22:26:22.306198] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T22:26:22.396681] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-09T22:26:23.781344] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T22:26:23.787997] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-09T22:26:23.835057] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T22:26:23.996698] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-09T22:26:24.782609] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T22:26:24.796672] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-09T22:26:25.894227] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T22:26:25.907276] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-09T22:26:26.538074] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T22:26:26.546821] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-09T22:26:27.763183] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T22:26:27.775239] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-09T22:26:28.081939] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T22:26:28.091061] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-09T22:26:29.465979] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T22:26:29.473817] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-09T22:26:29.592857] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T22:26:29.606355] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-09T22:26:30.589677] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T22:26:30.593038] [INFO ] [REMOTE ] WPP: Full fetch complete (46243 records). [2025-10-09T22:26:30.593173] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-09T22:26:30.974857] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-09T22:26:30.975061] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-09T22:26:30.976098] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-09T22:26:30.976175] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-09T22:26:30.977460] [DEBUG] [LOCAL ] WPP: Trimmed 46243 records to 34404 (keeping 200 days of data) [2025-10-09T22:26:31.190164] [DEBUG] [LOCAL ] WPP: Primary data saved (34404 records). [2025-10-09T22:26:31.190291] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-09T22:26:31.190378] [INFO ] [MAIN ] Update Progress: 2319/2373 symbols completed. WPP took 22.1s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-09T22:26:31.220342] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T22:26:31.225765] [INFO ] [REMOTE ] WPM: Full fetch complete (75976 records). [2025-10-09T22:26:31.225956] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-09T22:26:31.648726] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-09T22:26:31.648856] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-09T22:26:31.650695] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-09T22:26:31.650766] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-09T22:26:31.653516] [DEBUG] [LOCAL ] WPM: Trimmed 75976 records to 53128 (keeping 200 days of data) [2025-10-09T22:26:32.021151] [DEBUG] [LOCAL ] WPM: Primary data saved (53128 records). [2025-10-09T22:26:32.021364] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-09T22:26:32.021472] [INFO ] [MAIN ] Update Progress: 2320/2373 symbols completed. WPM took 25.2s. Estimated remaining: 7m 27s. Rate: 7.1 symbols/min [2025-10-09T22:26:32.686330] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:26:32.765635] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:26:32.828032] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:26:32.854685] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:26:32.914464] [DEBUG] [LOCAL ] WS: Loaded 23537 existing records from primary storage. [2025-10-09T22:26:32.914799] [INFO ] [MAIN ] WS: Loaded 23537 existing records. [2025-10-09T22:26:33.067606] [DEBUG] [LOCAL ] WRB: Loaded 50677 existing records from primary storage. [2025-10-09T22:26:33.090765] [INFO ] [MAIN ] WRB: Loaded 50677 existing records. [2025-10-09T22:26:33.110351] [DEBUG] [LOCAL ] WRBY: Loaded 50712 existing records from primary storage. [2025-10-09T22:26:33.137344] [DEBUG] [LOCAL ] WSM: Loaded 49319 existing records from primary storage. [2025-10-09T22:26:33.178175] [INFO ] [MAIN ] WRBY: Loaded 50712 existing records. [2025-10-09T22:26:33.209120] [INFO ] [MAIN ] WSM: Loaded 49319 existing records. [2025-10-09T22:26:33.234034] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:26:33.308622] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-09T22:26:33.367483] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-09T22:26:33.568115] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-09T22:26:33.646959] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-09T22:26:33.709431] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:26:33.810535] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-09T22:26:33.813365] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-09T22:26:33.775560] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:26:33.831239] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-09T22:26:33.836573] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-09T22:26:33.852262] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-09T22:26:33.831003] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:26:33.863337] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-09T22:26:33.867727] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-09T22:26:33.889514] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-09T22:26:33.904198] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-09T22:26:33.873431] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-09T22:26:34.031913] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-09T22:26:34.049043] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-09T22:26:34.974704] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:26:35.031339] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-09T22:26:35.203098] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:26:35.206838] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-09T22:26:35.250476] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:26:35.256096] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-09T22:26:35.342691] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:26:35.343441] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-09T22:26:36.517069] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T22:26:36.523947] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-09T22:26:36.553750] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T22:26:36.563362] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-09T22:26:36.629780] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T22:26:36.640275] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-09T22:26:36.878519] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T22:26:36.888713] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-09T22:26:37.451790] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T22:26:37.457456] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-09T22:26:37.821685] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T22:26:37.832130] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-09T22:26:38.001809] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T22:26:38.396831] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-09T22:26:38.526454] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T22:26:38.591782] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T22:26:39.099419] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T22:26:39.196720] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-09T22:26:39.996761] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-09T22:26:40.057783] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T22:26:40.566535] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T22:26:40.796788] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-09T22:26:41.596766] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-09T22:26:41.671376] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T22:26:41.967229] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T22:26:42.396723] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-09T22:26:43.176473] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T22:26:43.196676] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-09T22:26:43.996762] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-09T22:26:44.222830] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T22:26:44.796695] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-09T22:26:44.908177] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T22:26:45.186146] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T22:26:45.596712] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-09T22:26:46.402522] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-09T22:26:46.421539] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T22:26:47.196770] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-09T22:26:47.275044] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T22:26:47.996690] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-09T22:26:48.111206] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T22:26:48.740343] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T22:26:48.796680] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-09T22:26:49.409864] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T22:26:49.596721] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-09T22:26:50.396689] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-09T22:26:50.658880] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T22:26:51.196692] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-09T22:26:51.299735] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T22:26:51.999233] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-09T22:26:52.005360] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T22:26:52.185615] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T22:26:52.796794] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-09T22:26:53.596757] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-09T22:26:53.648320] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T22:26:54.396704] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-09T22:26:54.555330] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T22:26:54.582351] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T22:26:55.196722] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-09T22:26:55.701936] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T22:26:55.996715] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-09T22:26:56.463544] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T22:26:56.796797] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-09T22:26:57.278738] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T22:26:57.596723] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-09T22:26:58.106081] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T22:26:58.251010] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T22:26:58.396811] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-09T22:26:59.196735] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-09T22:26:59.884558] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T22:26:59.978808] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T22:26:59.996696] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-09T22:27:00.796755] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-09T22:27:01.003416] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T22:27:01.005775] [INFO ] [REMOTE ] WS: Full fetch complete (36440 records). [2025-10-09T22:27:01.005861] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-09T22:27:01.427076] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T22:27:01.426696] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-09T22:27:01.427221] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-09T22:27:01.432102] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-09T22:27:01.432237] [INFO ] [REMOTE ] WSM: Full fetch complete (71644 records). [2025-10-09T22:27:01.432427] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-09T22:27:01.432522] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-09T22:27:01.535487] [DEBUG] [LOCAL ] WS: Trimmed 36440 records to 23727 (keeping 200 days of data) [2025-10-09T22:27:01.638684] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-09T22:27:01.966190] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-09T22:27:01.966581] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-09T22:27:01.968019] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-09T22:27:01.968659] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-09T22:27:01.973134] [DEBUG] [LOCAL ] WSM: Trimmed 71644 records to 49654 (keeping 200 days of data) [2025-10-09T22:27:02.126524] [DEBUG] [LOCAL ] WS: Primary data saved (23727 records). [2025-10-09T22:27:02.127944] [INFO ] [MAIN ] WS: Full history saved. [2025-10-09T22:27:02.128779] [INFO ] [MAIN ] Update Progress: 2321/2373 symbols completed. WS took 30.1s. Estimated remaining: 7m 20s. Rate: 7.1 symbols/min [2025-10-09T22:27:02.307684] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:27:02.408496] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-09T22:27:02.409508] [DEBUG] [LOCAL ] WSO: Loaded 25075 existing records from primary storage. [2025-10-09T22:27:02.437314] [INFO ] [MAIN ] WSO: Loaded 25075 existing records. [2025-10-09T22:27:02.635852] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:27:02.637118] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-09T22:27:02.637200] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-09T22:27:02.638135] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-09T22:27:02.638209] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-09T22:27:03.013370] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:27:03.092423] [DEBUG] [LOCAL ] WSM: Primary data saved (49654 records). [2025-10-09T22:27:03.092572] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-09T22:27:03.093920] [INFO ] [MAIN ] Update Progress: 2322/2373 symbols completed. WSM took 31.1s. Estimated remaining: 7m 11s. Rate: 7.1 symbols/min [2025-10-09T22:27:03.206671] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-09T22:27:03.269383] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:27:03.305302] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T22:27:03.333915] [DEBUG] [LOCAL ] WSR: Loaded 22909 existing records from primary storage. [2025-10-09T22:27:03.334194] [INFO ] [MAIN ] WSR: Loaded 22909 existing records. [2025-10-09T22:27:03.516212] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:27:03.516499] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-09T22:27:03.516561] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-09T22:27:03.516807] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-09T22:27:03.516864] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-09T22:27:03.890934] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:27:03.884455] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T22:27:03.895943] [INFO ] [REMOTE ] WRBY: Full fetch complete (73541 records). [2025-10-09T22:27:03.896069] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-09T22:27:04.001814] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-09T22:27:04.358105] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-09T22:27:04.358234] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-09T22:27:04.360564] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-09T22:27:04.361051] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-09T22:27:04.362867] [DEBUG] [LOCAL ] WRBY: Trimmed 73541 records to 51073 (keeping 200 days of data) [2025-10-09T22:27:04.488632] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T22:27:04.796952] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-09T22:27:04.806309] [DEBUG] [LOCAL ] WRBY: Primary data saved (51073 records). [2025-10-09T22:27:04.806519] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-09T22:27:04.806727] [INFO ] [MAIN ] Update Progress: 2323/2373 symbols completed. WRBY took 32.8s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-09T22:27:05.022770] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:27:05.060406] [DEBUG] [LOCAL ] WST: Loaded 36892 existing records from primary storage. [2025-10-09T22:27:05.068140] [INFO ] [MAIN ] WST: Loaded 36892 existing records. [2025-10-09T22:27:05.087351] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T22:27:05.335454] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:27:05.335734] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-09T22:27:05.335791] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-09T22:27:05.335999] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-09T22:27:05.336100] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-09T22:27:05.601919] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-09T22:27:05.696965] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:27:06.396753] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-09T22:27:06.511989] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T22:27:06.560361] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T22:27:07.196735] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-09T22:27:07.555712] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T22:27:07.996712] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-09T22:27:08.789284] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T22:27:08.800431] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-09T22:27:09.058114] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T22:27:09.596717] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-09T22:27:10.010880] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T22:27:10.396734] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-09T22:27:10.594112] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T22:27:11.196732] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-09T22:27:11.568892] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T22:27:11.996768] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-09T22:27:12.354074] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T22:27:12.796777] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-09T22:27:13.395437] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T22:27:13.596783] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-09T22:27:13.798440] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T22:27:14.168710] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T22:27:14.173154] [INFO ] [REMOTE ] WRB: Full fetch complete (73391 records). [2025-10-09T22:27:14.173281] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-09T22:27:14.402099] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-09T22:27:14.564660] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-09T22:27:14.564757] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-09T22:27:14.565941] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-09T22:27:14.566006] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-09T22:27:14.567369] [DEBUG] [LOCAL ] WRB: Trimmed 73391 records to 51053 (keeping 200 days of data) [2025-10-09T22:27:14.901372] [DEBUG] [LOCAL ] WRB: Primary data saved (51053 records). [2025-10-09T22:27:14.901535] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-09T22:27:14.901625] [INFO ] [MAIN ] Update Progress: 2324/2373 symbols completed. WRB took 42.9s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-09T22:27:15.073827] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:27:15.117127] [DEBUG] [LOCAL ] WT: Loaded 47891 existing records from primary storage. [2025-10-09T22:27:15.117431] [INFO ] [MAIN ] WT: Loaded 47891 existing records. [2025-10-09T22:27:15.204733] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-09T22:27:15.292821] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:27:15.293100] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-09T22:27:15.293155] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-09T22:27:15.293350] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-09T22:27:15.293406] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-09T22:27:15.660517] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:27:15.920913] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T22:27:15.996676] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-09T22:27:16.796703] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-09T22:27:16.847467] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T22:27:16.909071] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T22:27:17.596714] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-09T22:27:18.396749] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-09T22:27:18.483203] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T22:27:18.547639] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T22:27:19.196778] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-09T22:27:19.831121] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T22:27:19.996712] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-09T22:27:20.796705] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-09T22:27:20.888134] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T22:27:21.272307] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T22:27:21.596722] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-09T22:27:21.704169] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T22:27:22.396730] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-09T22:27:23.141152] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T22:27:23.196725] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-09T22:27:23.215114] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T22:27:23.996788] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-09T22:27:24.421187] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T22:27:24.796718] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-09T22:27:25.428538] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T22:27:25.596678] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-09T22:27:25.945905] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T22:27:26.396727] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-09T22:27:27.196736] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-09T22:27:27.244865] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T22:27:27.530426] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T22:27:27.996780] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-09T22:27:28.654785] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T22:27:28.796744] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-09T22:27:29.439199] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T22:27:29.596757] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-09T22:27:29.709344] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T22:27:30.396769] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-09T22:27:30.906873] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T22:27:31.196770] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-09T22:27:31.996709] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-09T22:27:32.039334] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T22:27:32.084130] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T22:27:32.086833] [INFO ] [REMOTE ] WSO: Full fetch complete (34954 records). [2025-10-09T22:27:32.086910] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-09T22:27:32.461351] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-09T22:27:32.461440] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-09T22:27:32.462208] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-09T22:27:32.462270] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-09T22:27:32.463096] [DEBUG] [LOCAL ] WSO: Trimmed 34954 records to 25356 (keeping 200 days of data) [2025-10-09T22:27:32.622829] [DEBUG] [LOCAL ] WSO: Primary data saved (25356 records). [2025-10-09T22:27:32.622956] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-09T22:27:32.623052] [INFO ] [MAIN ] Update Progress: 2325/2373 symbols completed. WSO took 30.5s. Estimated remaining: 6m 46s. Rate: 7.1 symbols/min [2025-10-09T22:27:32.800078] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:27:32.798560] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-09T22:27:32.841314] [DEBUG] [LOCAL ] WTI: Loaded 44135 existing records from primary storage. [2025-10-09T22:27:32.841630] [INFO ] [MAIN ] WTI: Loaded 44135 existing records. [2025-10-09T22:27:33.029610] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:27:33.029854] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-09T22:27:33.029904] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-09T22:27:33.030194] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-09T22:27:33.030253] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-09T22:27:33.402252] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:27:33.596871] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-09T22:27:33.597822] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T22:27:34.396696] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-09T22:27:34.578145] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T22:27:34.766088] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T22:27:35.196812] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-09T22:27:35.529093] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T22:27:35.996773] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-09T22:27:36.710821] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T22:27:36.796667] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-09T22:27:36.957071] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T22:27:37.596777] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-09T22:27:38.402426] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-09T22:27:38.413307] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T22:27:39.196686] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-09T22:27:39.306554] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T22:27:39.308928] [INFO ] [REMOTE ] WSR: Full fetch complete (32756 records). [2025-10-09T22:27:39.309069] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-09T22:27:39.446964] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T22:27:39.737639] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T22:27:39.737908] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-09T22:27:39.741031] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-09T22:27:39.741953] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-09T22:27:39.742030] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-09T22:27:39.742229] [INFO ] [REMOTE ] WST: Full fetch complete (54002 records). [2025-10-09T22:27:39.742533] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-09T22:27:39.775051] [DEBUG] [LOCAL ] WSR: Trimmed 32756 records to 23050 (keeping 200 days of data) [2025-10-09T22:27:40.011074] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-09T22:27:40.252070] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-09T22:27:40.252428] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-09T22:27:40.253509] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-09T22:27:40.254187] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-09T22:27:40.259565] [DEBUG] [LOCAL ] WST: Trimmed 54002 records to 37212 (keeping 200 days of data) [2025-10-09T22:27:40.405435] [DEBUG] [LOCAL ] WSR: Primary data saved (23050 records). [2025-10-09T22:27:40.406337] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-09T22:27:40.406772] [INFO ] [MAIN ] Update Progress: 2326/2373 symbols completed. WSR took 37.3s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-09T22:27:40.592715] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:27:40.594117] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-09T22:27:40.594194] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-09T22:27:40.595921] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-09T22:27:40.596251] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-09T22:27:40.596869] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-09T22:27:40.597178] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-09T22:27:40.805521] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-09T22:27:41.049153] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:27:41.077666] [DEBUG] [LOCAL ] WST: Primary data saved (37212 records). [2025-10-09T22:27:41.077793] [INFO ] [MAIN ] WST: Full history saved. [2025-10-09T22:27:41.077869] [INFO ] [MAIN ] Update Progress: 2327/2373 symbols completed. WST took 36.3s. Estimated remaining: 6m 29s. Rate: 7.1 symbols/min [2025-10-09T22:27:41.251760] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:27:41.300547] [DEBUG] [LOCAL ] WTRG: Loaded 50969 existing records from primary storage. [2025-10-09T22:27:41.300909] [INFO ] [MAIN ] WTRG: Loaded 50969 existing records. [2025-10-09T22:27:41.484450] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:27:41.484732] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-09T22:27:41.484787] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-09T22:27:41.485029] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-09T22:27:41.485085] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-09T22:27:41.600327] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-09T22:27:41.874054] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T22:27:41.906752] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:27:42.069173] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-09T22:27:42.396708] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-09T22:27:42.425895] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T22:27:43.196718] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-09T22:27:43.981762] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T22:27:43.996669] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-09T22:27:44.796703] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-09T22:27:44.949291] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T22:27:45.211286] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-09T22:27:45.355774] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T22:27:45.596741] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-09T22:27:46.396740] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-09T22:27:47.138285] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T22:27:47.196695] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-09T22:27:47.718598] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T22:27:47.996728] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-09T22:27:48.564635] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T22:27:48.796737] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-09T22:27:49.596737] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-09T22:27:49.857594] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T22:27:50.160217] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T22:27:50.164542] [INFO ] [REMOTE ] WT: Full fetch complete (69363 records). [2025-10-09T22:27:50.164682] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-09T22:27:50.401960] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-09T22:27:50.564754] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-09T22:27:50.564841] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-09T22:27:50.565962] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-09T22:27:50.566028] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-09T22:27:50.567371] [DEBUG] [LOCAL ] WT: Trimmed 69363 records to 48271 (keeping 200 days of data) [2025-10-09T22:27:50.896670] [DEBUG] [LOCAL ] WT: Primary data saved (48271 records). [2025-10-09T22:27:50.896841] [INFO ] [MAIN ] WT: Full history saved. [2025-10-09T22:27:50.896940] [INFO ] [MAIN ] Update Progress: 2328/2373 symbols completed. WT took 36.0s. Estimated remaining: 6m 20s. Rate: 7.1 symbols/min [2025-10-09T22:27:51.100821] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:27:51.120398] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T22:27:51.146568] [DEBUG] [LOCAL ] WTS: Loaded 17746 existing records from primary storage. [2025-10-09T22:27:51.146865] [INFO ] [MAIN ] WTS: Loaded 17746 existing records. [2025-10-09T22:27:51.207783] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-09T22:27:51.323242] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:27:51.323429] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-09T22:27:51.323477] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-09T22:27:51.323699] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-09T22:27:51.323758] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-09T22:27:51.698602] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T22:27:51.720678] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:27:51.996673] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-09T22:27:52.189610] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T22:27:52.615866] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T22:27:52.796743] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-09T22:27:53.596745] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-09T22:27:54.396695] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-09T22:27:54.530619] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T22:27:54.536815] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T22:27:54.803854] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-09T22:27:55.196730] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-09T22:27:55.996728] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-09T22:27:56.799180] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-09T22:27:56.836364] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T22:27:57.123275] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T22:27:57.346097] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T22:27:57.596759] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-09T22:27:58.353783] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T22:27:58.396746] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-09T22:27:59.197530] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-09T22:27:59.197392] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T22:27:59.996733] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-09T22:28:00.746426] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T22:28:00.796699] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-09T22:28:01.596764] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-09T22:28:01.879926] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T22:28:02.037167] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T22:28:02.174919] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T22:28:02.396748] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-09T22:28:03.196831] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-09T22:28:03.996811] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-09T22:28:04.137856] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T22:28:04.492814] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-09T22:28:04.796761] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-09T22:28:04.963318] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T22:28:05.158168] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T22:28:05.596720] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-09T22:28:06.396774] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-09T22:28:06.905517] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T22:28:06.994797] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T22:28:07.196767] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-09T22:28:07.996721] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-09T22:28:08.649236] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T22:28:08.724100] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T22:28:08.796673] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-09T22:28:09.596693] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-09T22:28:09.976738] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T22:28:09.982065] [INFO ] [REMOTE ] WTI: Full fetch complete (64041 records). [2025-10-09T22:28:09.982235] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-09T22:28:10.394526] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-09T22:28:10.394756] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-09T22:28:10.396028] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-09T22:28:10.396147] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-09T22:28:10.401817] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-09T22:28:10.413888] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T22:28:10.418713] [DEBUG] [LOCAL ] WTI: Trimmed 64041 records to 44511 (keeping 200 days of data) [2025-10-09T22:28:10.693479] [DEBUG] [LOCAL ] WTI: Primary data saved (44511 records). [2025-10-09T22:28:10.693662] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-09T22:28:10.693778] [INFO ] [MAIN ] Update Progress: 2329/2373 symbols completed. WTI took 38.1s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-09T22:28:10.866307] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:28:10.906697] [DEBUG] [LOCAL ] WTTR: Loaded 44656 existing records from primary storage. [2025-10-09T22:28:10.907062] [INFO ] [MAIN ] WTTR: Loaded 44656 existing records. [2025-10-09T22:28:11.083502] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:28:11.083811] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-09T22:28:11.083871] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-09T22:28:11.084131] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-09T22:28:11.084189] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-09T22:28:11.202020] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-09T22:28:11.448071] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:28:11.888466] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T22:28:11.889620] [INFO ] [REMOTE ] WTM: Full fetch complete (2645 records). [2025-10-09T22:28:11.889726] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-09T22:28:11.997578] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-09T22:28:12.077159] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T22:28:12.077486] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T22:28:12.077578] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T22:28:12.083276] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-09T22:28:12.088444] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-09T22:28:12.089448] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T22:28:12.089583] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-09T22:28:12.094065] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-09T22:28:12.094189] [INFO ] [MAIN ] Update Progress: 2330/2373 symbols completed. WTM took 31.7s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-09T22:28:12.099704] [INFO ] [REMOTE ] WTRG: Full fetch complete (73516 records). [2025-10-09T22:28:12.139048] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-09T22:28:12.421956] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:28:12.693374] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-09T22:28:12.693549] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-09T22:28:12.707703] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-09T22:28:12.708976] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-09T22:28:12.710576] [DEBUG] [LOCAL ] WU: Loaded 53462 existing records from primary storage. [2025-10-09T22:28:12.711149] [INFO ] [MAIN ] WU: Loaded 53462 existing records. [2025-10-09T22:28:12.797733] [DEBUG] [LOCAL ] WTRG: Trimmed 73516 records to 51344 (keeping 200 days of data) [2025-10-09T22:28:12.797827] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-09T22:28:13.018238] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:28:13.021090] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-09T22:28:13.022025] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-09T22:28:13.025419] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-09T22:28:13.025902] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-09T22:28:13.242587] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T22:28:13.437453] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:28:13.599315] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-09T22:28:13.641703] [DEBUG] [LOCAL ] WTRG: Primary data saved (51344 records). [2025-10-09T22:28:13.641824] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-09T22:28:13.641907] [INFO ] [MAIN ] Update Progress: 2331/2373 symbols completed. WTRG took 32.6s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-09T22:28:13.807376] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:28:13.850636] [DEBUG] [LOCAL ] WWW: Loaded 49239 existing records from primary storage. [2025-10-09T22:28:13.850980] [INFO ] [MAIN ] WWW: Loaded 49239 existing records. [2025-10-09T22:28:14.026142] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:28:14.026384] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-09T22:28:14.026457] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-09T22:28:14.026700] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-09T22:28:14.026757] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-09T22:28:14.391911] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:28:14.396675] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-09T22:28:14.502611] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T22:28:14.560042] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T22:28:15.196736] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-09T22:28:15.996701] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-09T22:28:16.324571] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T22:28:16.397016] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-09T22:28:16.796757] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-09T22:28:17.482145] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T22:28:17.596716] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-09T22:28:17.747232] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T22:28:18.396729] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-09T22:28:18.775218] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T22:28:19.196759] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-09T22:28:19.760075] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T22:28:19.996727] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-09T22:28:20.749035] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T22:28:20.750748] [INFO ] [REMOTE ] WTS: Full fetch complete (25767 records). [2025-10-09T22:28:20.750827] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-09T22:28:20.804067] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-09T22:28:21.127200] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-09T22:28:21.127426] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-09T22:28:21.128337] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-09T22:28:21.139989] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-09T22:28:21.161088] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T22:28:21.159719] [DEBUG] [LOCAL ] WTS: Trimmed 25767 records to 17817 (keeping 200 days of data) [2025-10-09T22:28:21.288104] [DEBUG] [LOCAL ] WTS: Primary data saved (17817 records). [2025-10-09T22:28:21.288252] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-09T22:28:21.288337] [INFO ] [MAIN ] Update Progress: 2332/2373 symbols completed. WTS took 30.4s. Estimated remaining: 5m 46s. Rate: 7.1 symbols/min [2025-10-09T22:28:21.490987] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:28:21.539216] [DEBUG] [LOCAL ] WY: Loaded 53138 existing records from primary storage. [2025-10-09T22:28:21.539535] [INFO ] [MAIN ] WY: Loaded 53138 existing records. [2025-10-09T22:28:21.608541] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-09T22:28:21.743714] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:28:21.743956] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-09T22:28:21.744018] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-09T22:28:21.744531] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-09T22:28:21.744589] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-09T22:28:22.094609] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:28:22.396693] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-09T22:28:22.544803] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T22:28:23.204888] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-09T22:28:23.222285] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T22:28:23.996723] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-09T22:28:24.228613] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T22:28:24.796703] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-09T22:28:24.845756] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T22:28:25.219116] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T22:28:25.596719] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-09T22:28:26.396692] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-09T22:28:26.655730] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T22:28:27.155430] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T22:28:27.196697] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-09T22:28:27.996735] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-09T22:28:28.175395] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T22:28:28.706632] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T22:28:28.796677] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-09T22:28:29.596682] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-09T22:28:29.702160] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T22:28:30.397074] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-09T22:28:30.403096] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T22:28:31.144305] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T22:28:31.196671] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-09T22:28:31.996688] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-09T22:28:32.088931] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T22:28:32.796752] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-09T22:28:32.924168] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T22:28:33.411474] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T22:28:33.596762] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-09T22:28:34.400277] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-09T22:28:34.405361] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T22:28:35.196699] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-09T22:28:35.381526] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T22:28:35.996747] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-09T22:28:36.378470] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T22:28:36.796691] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-09T22:28:36.882114] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T22:28:37.566039] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T22:28:37.596671] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-09T22:28:38.310492] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T22:28:38.396704] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-09T22:28:39.196705] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-09T22:28:39.483052] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T22:28:39.619083] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T22:28:39.996752] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-09T22:28:40.492483] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T22:28:40.496268] [INFO ] [REMOTE ] WTTR: Full fetch complete (65433 records). [2025-10-09T22:28:40.496364] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-09T22:28:40.799775] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-09T22:28:40.897361] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-09T22:28:40.897458] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-09T22:28:40.898574] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-09T22:28:40.898662] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-09T22:28:40.900517] [DEBUG] [LOCAL ] WTTR: Trimmed 65433 records to 44933 (keeping 200 days of data) [2025-10-09T22:28:41.179272] [DEBUG] [LOCAL ] WTTR: Primary data saved (44933 records). [2025-10-09T22:28:41.179407] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-09T22:28:41.179496] [INFO ] [MAIN ] Update Progress: 2333/2373 symbols completed. WTTR took 30.5s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-09T22:28:41.346687] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:28:41.377790] [DEBUG] [LOCAL ] XFLT: Loaded 29925 existing records from primary storage. [2025-10-09T22:28:41.378089] [INFO ] [MAIN ] XFLT: Loaded 29925 existing records. [2025-10-09T22:28:41.556500] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:28:41.556758] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-09T22:28:41.556810] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-09T22:28:41.557024] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-09T22:28:41.557080] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-09T22:28:41.602414] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-09T22:28:41.927691] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:28:41.962382] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-09T22:28:42.396699] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-09T22:28:42.551071] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T22:28:43.196804] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-09T22:28:43.340674] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T22:28:43.996835] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-09T22:28:44.446839] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-09T22:28:44.603586] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T22:28:44.796791] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-09T22:28:45.524817] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T22:28:45.596728] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-09T22:28:46.396799] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-09T22:28:46.611480] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T22:28:47.196712] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-09T22:28:47.375941] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T22:28:47.422032] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T22:28:47.996786] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-09T22:28:48.706095] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T22:28:48.796686] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-09T22:28:49.147267] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T22:28:49.596728] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-09T22:28:49.878635] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-09T22:28:49.883113] [INFO ] [REMOTE ] WY: Full fetch complete (76851 records). [2025-10-09T22:28:49.883254] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-09T22:28:50.278778] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-09T22:28:50.278938] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-09T22:28:50.280296] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-09T22:28:50.280405] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-09T22:28:50.281931] [DEBUG] [LOCAL ] WY: Trimmed 76851 records to 53527 (keeping 200 days of data) [2025-10-09T22:28:50.397509] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-09T22:28:50.561884] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T22:28:50.658981] [DEBUG] [LOCAL ] WY: Primary data saved (53527 records). [2025-10-09T22:28:50.659115] [INFO ] [MAIN ] WY: Full history saved. [2025-10-09T22:28:50.659214] [INFO ] [MAIN ] Update Progress: 2334/2373 symbols completed. WY took 29.4s. Estimated remaining: 5m 30s. Rate: 7.1 symbols/min [2025-10-09T22:28:50.826050] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:28:50.866588] [DEBUG] [LOCAL ] XHR: Loaded 43665 existing records from primary storage. [2025-10-09T22:28:50.866927] [INFO ] [MAIN ] XHR: Loaded 43665 existing records. [2025-10-09T22:28:51.040257] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:28:51.040446] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-09T22:28:51.040518] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-09T22:28:51.040810] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-09T22:28:51.040878] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-09T22:28:51.196731] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-09T22:28:51.402619] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:28:51.457969] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T22:28:51.996728] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-09T22:28:52.796758] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-09T22:28:53.121457] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T22:28:53.519577] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T22:28:53.596717] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-09T22:28:53.748114] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T22:28:54.396772] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-09T22:28:55.028590] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T22:28:55.196727] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-09T22:28:55.699085] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T22:28:55.996771] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-09T22:28:56.236417] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T22:28:56.796694] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-09T22:28:57.180604] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T22:28:57.596718] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-09T22:28:58.080167] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T22:28:58.396726] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-09T22:28:59.196692] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-09T22:28:59.229332] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T22:28:59.233926] [INFO ] [REMOTE ] WU: Full fetch complete (77347 records). [2025-10-09T22:28:59.234040] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-09T22:28:59.626339] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-09T22:28:59.626531] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-09T22:28:59.627751] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-09T22:28:59.627867] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-09T22:28:59.629490] [DEBUG] [LOCAL ] WU: Trimmed 77347 records to 53845 (keeping 200 days of data) [2025-10-09T22:28:59.785788] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T22:29:00.003934] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-09T22:29:00.032037] [DEBUG] [LOCAL ] WU: Primary data saved (53845 records). [2025-10-09T22:29:00.032204] [INFO ] [MAIN ] WU: Full history saved. [2025-10-09T22:29:00.032291] [INFO ] [MAIN ] Update Progress: 2335/2373 symbols completed. WU took 47.9s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-09T22:29:00.206159] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:00.206345] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-09T22:29:00.206383] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-09T22:29:00.206492] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-09T22:29:00.206535] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-09T22:29:00.206576] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-09T22:29:00.206610] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-09T22:29:00.581456] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:00.654915] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T22:29:00.796730] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-09T22:29:01.596755] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-09T22:29:01.738199] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T22:29:02.154894] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T22:29:02.396783] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-09T22:29:02.874961] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T22:29:02.879434] [INFO ] [REMOTE ] WWW: Full fetch complete (70354 records). [2025-10-09T22:29:02.879551] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-09T22:29:03.201925] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-09T22:29:03.292340] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-09T22:29:03.292513] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-09T22:29:03.294165] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-09T22:29:03.294259] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-09T22:29:03.295882] [DEBUG] [LOCAL ] WWW: Trimmed 70354 records to 49580 (keeping 200 days of data) [2025-10-09T22:29:03.650457] [DEBUG] [LOCAL ] WWW: Primary data saved (49580 records). [2025-10-09T22:29:03.650612] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-09T22:29:03.650749] [INFO ] [MAIN ] Update Progress: 2336/2373 symbols completed. WWW took 50.0s. Estimated remaining: 5m 13s. Rate: 7.1 symbols/min [2025-10-09T22:29:03.855297] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:03.857006] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T22:29:03.920605] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-09T22:29:03.920973] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-09T22:29:04.004528] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-09T22:29:04.113594] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:29:04.113829] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-09T22:29:04.113879] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-09T22:29:04.114083] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-09T22:29:04.114140] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-09T22:29:04.273160] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T22:29:04.331950] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-09T22:29:04.375321] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:29:04.404290] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-09T22:29:04.415304] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:29:04.420558] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-09T22:29:04.430929] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-09T22:29:04.459361] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-09T22:29:04.493834] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:04.494343] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-09T22:29:04.494448] [INFO ] [MAIN ] Update Progress: 2337/2373 symbols completed. XIFR took 4.5s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-09T22:29:04.664687] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:04.697197] [DEBUG] [LOCAL ] XPER: Loaded 30107 existing records from primary storage. [2025-10-09T22:29:04.697463] [INFO ] [MAIN ] XPER: Loaded 30107 existing records. [2025-10-09T22:29:04.802046] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-09T22:29:04.883455] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:29:04.883969] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-09T22:29:04.884039] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-09T22:29:04.884367] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-09T22:29:04.884443] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-09T22:29:05.034516] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T22:29:05.360519] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:05.596817] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-09T22:29:05.754590] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T22:29:05.758318] [INFO ] [REMOTE ] XFLT: Full fetch complete (43930 records). [2025-10-09T22:29:05.758541] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-09T22:29:06.269463] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-09T22:29:06.269553] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-09T22:29:06.270538] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-09T22:29:06.270603] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-09T22:29:06.271721] [DEBUG] [LOCAL ] XFLT: Trimmed 43930 records to 30065 (keeping 200 days of data) [2025-10-09T22:29:06.396863] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-09T22:29:06.465977] [DEBUG] [LOCAL ] XFLT: Primary data saved (30065 records). [2025-10-09T22:29:06.466126] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-09T22:29:06.466301] [INFO ] [MAIN ] Update Progress: 2338/2373 symbols completed. XFLT took 25.3s. Estimated remaining: 4m 56s. Rate: 7.1 symbols/min [2025-10-09T22:29:06.635824] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:06.687169] [DEBUG] [LOCAL ] XPEV: Loaded 53634 existing records from primary storage. [2025-10-09T22:29:06.687562] [INFO ] [MAIN ] XPEV: Loaded 53634 existing records. [2025-10-09T22:29:06.862723] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:29:06.862938] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-09T22:29:06.862986] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-09T22:29:06.863205] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-09T22:29:06.863262] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-09T22:29:07.204235] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-09T22:29:07.246579] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:07.881909] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-09T22:29:07.918123] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T22:29:07.996682] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-09T22:29:08.147580] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T22:29:08.796731] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-09T22:29:09.596851] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-09T22:29:10.001030] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T22:29:10.396758] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-09T22:29:10.476056] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-09T22:29:11.196747] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-09T22:29:11.679675] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T22:29:11.996700] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-09T22:29:12.079781] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T22:29:12.333130] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T22:29:12.796736] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-09T22:29:13.596699] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-09T22:29:13.831863] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T22:29:14.248091] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-09T22:29:14.396749] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-09T22:29:15.196791] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-09T22:29:15.748246] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T22:29:15.787416] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-09T22:29:15.996697] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-09T22:29:16.796734] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-09T22:29:17.013718] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T22:29:17.596735] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-09T22:29:17.627114] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-09T22:29:18.367205] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T22:29:18.396687] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-09T22:29:18.561055] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T22:29:19.196722] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-09T22:29:19.603822] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T22:29:19.996741] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-09T22:29:20.796790] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-09T22:29:21.382768] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T22:29:21.444987] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-09T22:29:21.596717] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-09T22:29:21.809907] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T22:29:21.813557] [INFO ] [REMOTE ] XHR: Full fetch complete (61779 records). [2025-10-09T22:29:21.813698] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-09T22:29:22.210495] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-09T22:29:22.210604] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-09T22:29:22.211816] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-09T22:29:22.211882] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-09T22:29:22.213089] [DEBUG] [LOCAL ] XHR: Trimmed 61779 records to 43952 (keeping 200 days of data) [2025-10-09T22:29:22.401703] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-09T22:29:22.491554] [DEBUG] [LOCAL ] XHR: Primary data saved (43952 records). [2025-10-09T22:29:22.491715] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-09T22:29:22.491808] [INFO ] [MAIN ] Update Progress: 2339/2373 symbols completed. XHR took 31.8s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-09T22:29:22.656811] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:22.700297] [DEBUG] [LOCAL ] XPO: Loaded 47785 existing records from primary storage. [2025-10-09T22:29:22.700706] [INFO ] [MAIN ] XPO: Loaded 47785 existing records. [2025-10-09T22:29:22.875077] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:29:22.875288] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-09T22:29:22.875334] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-09T22:29:22.875563] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-09T22:29:22.875619] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-09T22:29:23.206599] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-09T22:29:23.236718] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:23.996709] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-09T22:29:24.110121] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-09T22:29:24.447820] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T22:29:24.698095] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T22:29:24.796689] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-09T22:29:25.421092] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T22:29:25.596724] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-09T22:29:26.396720] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-09T22:29:27.053148] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-09T22:29:27.201801] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-09T22:29:27.218229] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T22:29:27.996754] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-09T22:29:28.539167] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T22:29:28.796765] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-09T22:29:29.493456] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T22:29:29.596692] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-09T22:29:29.641236] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-09T22:29:30.396720] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-09T22:29:31.071937] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-09T22:29:31.196719] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-09T22:29:31.469331] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T22:29:31.996787] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-09T22:29:32.622505] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-09T22:29:32.796747] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-09T22:29:33.403348] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-09T22:29:33.596728] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-09T22:29:33.893989] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T22:29:33.956615] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T22:29:34.396733] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-09T22:29:35.196746] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-09T22:29:35.499695] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T22:29:35.503247] [INFO ] [REMOTE ] XPER: Full fetch complete (43243 records). [2025-10-09T22:29:35.503372] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-09T22:29:35.898721] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-09T22:29:35.898956] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-09T22:29:35.899965] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-09T22:29:35.900094] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-09T22:29:35.901424] [DEBUG] [LOCAL ] XPER: Trimmed 43243 records to 30306 (keeping 200 days of data) [2025-10-09T22:29:36.000943] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-09T22:29:36.027154] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-09T22:29:36.126018] [DEBUG] [LOCAL ] XPER: Primary data saved (30306 records). [2025-10-09T22:29:36.126186] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-09T22:29:36.126295] [INFO ] [MAIN ] Update Progress: 2340/2373 symbols completed. XPER took 31.6s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-09T22:29:36.300850] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:36.336050] [DEBUG] [LOCAL ] XPOF: Loaded 37639 existing records from primary storage. [2025-10-09T22:29:36.336340] [INFO ] [MAIN ] XPOF: Loaded 37639 existing records. [2025-10-09T22:29:36.550555] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:29:36.550898] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-09T22:29:36.550958] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-09T22:29:36.551200] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-09T22:29:36.551256] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-09T22:29:36.798250] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-09T22:29:36.910949] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:36.939449] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T22:29:37.596730] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-09T22:29:38.407406] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-09T22:29:38.427474] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-09T22:29:38.872281] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T22:29:39.000937] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T22:29:39.196722] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-09T22:29:39.246793] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T22:29:39.996711] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-09T22:29:40.796725] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-09T22:29:41.328273] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-09T22:29:41.596736] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-09T22:29:41.893624] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T22:29:42.396686] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-09T22:29:42.483852] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T22:29:43.102175] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-09T22:29:43.196693] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-09T22:29:43.996690] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-09T22:29:44.143935] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T22:29:44.328774] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-09T22:29:44.335585] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-09T22:29:44.335756] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-09T22:29:44.744902] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-09T22:29:44.744993] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-09T22:29:44.746183] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-09T22:29:44.746248] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-09T22:29:44.747831] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 54183 (keeping 200 days of data) [2025-10-09T22:29:44.805354] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-09T22:29:45.113095] [DEBUG] [LOCAL ] XOM: Primary data saved (54183 records). [2025-10-09T22:29:45.113278] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-09T22:29:45.113370] [INFO ] [MAIN ] Update Progress: 2341/2373 symbols completed. XOM took 41.5s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-09T22:29:45.291019] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:45.330913] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-09T22:29:45.350443] [INFO ] [REMOTE ] XPEV: Full fetch complete (77681 records). [2025-10-09T22:29:45.350638] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-09T22:29:45.351595] [DEBUG] [LOCAL ] XPRO: Loaded 45859 existing records from primary storage. [2025-10-09T22:29:45.351934] [INFO ] [MAIN ] XPRO: Loaded 45859 existing records. [2025-10-09T22:29:45.598730] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-09T22:29:45.723668] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:29:45.751860] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-09T22:29:45.786613] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-09T22:29:45.852880] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-09T22:29:45.864959] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-09T22:29:46.071875] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-09T22:29:46.072022] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-09T22:29:46.084150] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-09T22:29:46.113348] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-09T22:29:46.171083] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T22:29:46.217814] [DEBUG] [LOCAL ] XPEV: Trimmed 77681 records to 54024 (keeping 200 days of data) [2025-10-09T22:29:46.396735] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-09T22:29:46.461397] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:46.699981] [DEBUG] [LOCAL ] XPEV: Primary data saved (54024 records). [2025-10-09T22:29:46.700127] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-09T22:29:46.700212] [INFO ] [MAIN ] Update Progress: 2342/2373 symbols completed. XPEV took 40.2s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-09T22:29:46.868830] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:46.899178] [DEBUG] [LOCAL ] XYF: Loaded 28288 existing records from primary storage. [2025-10-09T22:29:46.899461] [INFO ] [MAIN ] XYF: Loaded 28288 existing records. [2025-10-09T22:29:47.090391] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:29:47.090858] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-09T22:29:47.090964] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-09T22:29:47.091350] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-09T22:29:47.091452] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-09T22:29:47.198271] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-09T22:29:47.313374] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T22:29:47.517826] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:47.996703] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-09T22:29:48.099795] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T22:29:48.522260] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-09T22:29:48.796702] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-09T22:29:48.911972] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T22:29:49.596728] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-09T22:29:49.994681] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T22:29:50.396717] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-09T22:29:51.146690] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T22:29:51.196714] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-09T22:29:51.790171] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T22:29:51.996769] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-09T22:29:52.345873] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T22:29:52.670439] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T22:29:52.796754] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-09T22:29:53.596748] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-09T22:29:54.293059] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T22:29:54.298264] [INFO ] [REMOTE ] XPO: Full fetch complete (69827 records). [2025-10-09T22:29:54.298496] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-09T22:29:54.401954] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-09T22:29:54.747722] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-09T22:29:54.747851] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-09T22:29:54.749350] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-09T22:29:54.749494] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-09T22:29:54.751053] [DEBUG] [LOCAL ] XPO: Trimmed 69827 records to 48148 (keeping 200 days of data) [2025-10-09T22:29:54.990731] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T22:29:55.080531] [DEBUG] [LOCAL ] XPO: Primary data saved (48148 records). [2025-10-09T22:29:55.080733] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-09T22:29:55.080837] [INFO ] [MAIN ] Update Progress: 2343/2373 symbols completed. XPO took 32.6s. Estimated remaining: 4m 13s. Rate: 7.1 symbols/min [2025-10-09T22:29:55.201827] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-09T22:29:55.256617] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:29:55.301552] [DEBUG] [LOCAL ] XYL: Loaded 47900 existing records from primary storage. [2025-10-09T22:29:55.301911] [INFO ] [MAIN ] XYL: Loaded 47900 existing records. [2025-10-09T22:29:55.416739] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T22:29:55.491894] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:29:55.492118] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-09T22:29:55.492166] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-09T22:29:55.492424] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-09T22:29:55.492483] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-09T22:29:55.851245] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:29:55.996722] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-09T22:29:56.543703] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T22:29:56.796775] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-09T22:29:57.250547] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T22:29:57.596744] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-09T22:29:58.026368] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T22:29:58.396736] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-09T22:29:58.759836] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T22:29:59.196785] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-09T22:29:59.805679] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T22:29:59.996824] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-09T22:30:00.796739] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-09T22:30:00.870284] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T22:30:01.433265] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T22:30:01.596798] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-09T22:30:02.396820] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-09T22:30:02.767430] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T22:30:03.095835] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T22:30:03.196737] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-09T22:30:03.628152] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T22:30:03.996772] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-09T22:30:04.786432] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T22:30:04.789746] [INFO ] [REMOTE ] XPOF: Full fetch complete (52501 records). [2025-10-09T22:30:04.789877] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-09T22:30:04.801964] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-09T22:30:05.189957] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-09T22:30:05.190061] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-09T22:30:05.191135] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-09T22:30:05.191252] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-09T22:30:05.192585] [DEBUG] [LOCAL ] XPOF: Trimmed 52501 records to 37887 (keeping 200 days of data) [2025-10-09T22:30:05.304254] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-09T22:30:05.448394] [DEBUG] [LOCAL ] XPOF: Primary data saved (37887 records). [2025-10-09T22:30:05.448530] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-09T22:30:05.448627] [INFO ] [MAIN ] Update Progress: 2344/2373 symbols completed. XPOF took 29.3s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-09T22:30:05.613793] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-09T22:30:05.618680] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:30:05.618938] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-09T22:30:05.618994] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-09T22:30:05.619106] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-09T22:30:05.619148] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-09T22:30:05.619189] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-09T22:30:05.619221] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-09T22:30:05.975720] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:30:06.278621] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T22:30:06.396736] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-09T22:30:07.196732] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-09T22:30:07.244857] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T22:30:07.451245] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T22:30:07.451542] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-09T22:30:07.451682] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T22:30:07.451759] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-09T22:30:07.451824] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T22:30:07.451896] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-09T22:30:07.451959] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-09T22:30:07.451994] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-09T22:30:07.452048] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-09T22:30:07.452130] [INFO ] [MAIN ] Update Progress: 2345/2373 symbols completed. XYZ took 2.0s. Estimated remaining: 3m 56s. Rate: 7.1 symbols/min [2025-10-09T22:30:07.625818] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:30:07.660131] [DEBUG] [LOCAL ] YALA: Loaded 37037 existing records from primary storage. [2025-10-09T22:30:07.660467] [INFO ] [MAIN ] YALA: Loaded 37037 existing records. [2025-10-09T22:30:07.842285] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:30:07.860990] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-09T22:30:07.861140] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-09T22:30:07.861798] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-09T22:30:07.861860] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-09T22:30:07.862473] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T22:30:08.001794] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-09T22:30:08.229618] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:30:08.796770] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-09T22:30:09.596701] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-09T22:30:09.937314] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T22:30:10.140760] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T22:30:10.396698] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-09T22:30:11.012601] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T22:30:11.196727] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-09T22:30:11.785470] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T22:30:11.996743] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-09T22:30:12.260441] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T22:30:12.796751] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-09T22:30:13.062980] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T22:30:13.596717] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-09T22:30:14.282552] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T22:30:14.396785] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-09T22:30:14.837358] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T22:30:15.196735] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-09T22:30:15.996713] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-09T22:30:16.080043] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T22:30:16.514874] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T22:30:16.796727] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-09T22:30:17.385254] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T22:30:17.596753] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-09T22:30:18.124053] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T22:30:18.396733] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-09T22:30:18.692090] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T22:30:19.196723] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-09T22:30:19.859965] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T22:30:19.996744] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-09T22:30:20.796703] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-09T22:30:21.112312] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T22:30:21.456001] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T22:30:21.596726] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-09T22:30:21.909196] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T22:30:22.396720] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-09T22:30:23.156612] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T22:30:23.159373] [INFO ] [REMOTE ] XYF: Full fetch complete (32574 records). [2025-10-09T22:30:23.159543] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-09T22:30:23.207095] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-09T22:30:23.317428] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T22:30:23.589550] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-09T22:30:23.589660] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-09T22:30:23.590371] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-09T22:30:23.590416] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-09T22:30:23.591444] [DEBUG] [LOCAL ] XYF: Trimmed 32574 records to 28444 (keeping 200 days of data) [2025-10-09T22:30:23.776916] [DEBUG] [LOCAL ] XYF: Primary data saved (28444 records). [2025-10-09T22:30:23.777055] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-09T22:30:23.777140] [INFO ] [MAIN ] Update Progress: 2346/2373 symbols completed. XYF took 37.1s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-09T22:30:23.942818] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:30:23.983854] [DEBUG] [LOCAL ] YELP: Loaded 45425 existing records from primary storage. [2025-10-09T22:30:23.984165] [INFO ] [MAIN ] YELP: Loaded 45425 existing records. [2025-10-09T22:30:24.004434] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-09T22:30:24.165221] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:30:24.165849] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-09T22:30:24.165909] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-09T22:30:24.166549] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-09T22:30:24.166608] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-09T22:30:24.522682] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:30:24.532468] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T22:30:24.536482] [INFO ] [REMOTE ] XPRO: Full fetch complete (66358 records). [2025-10-09T22:30:24.536575] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-09T22:30:24.801837] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-09T22:30:24.930033] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-09T22:30:24.930120] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-09T22:30:24.931213] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-09T22:30:24.931277] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-09T22:30:24.932713] [DEBUG] [LOCAL ] XPRO: Trimmed 66358 records to 46201 (keeping 200 days of data) [2025-10-09T22:30:25.158632] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T22:30:25.168882] [INFO ] [REMOTE ] XYL: Full fetch complete (69668 records). [2025-10-09T22:30:25.169623] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-09T22:30:25.603190] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-09T22:30:25.623013] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-09T22:30:25.623188] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-09T22:30:25.635853] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-09T22:30:25.637422] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-09T22:30:25.655785] [DEBUG] [LOCAL ] XYL: Trimmed 69668 records to 48238 (keeping 200 days of data) [2025-10-09T22:30:25.738103] [DEBUG] [LOCAL ] XPRO: Primary data saved (46201 records). [2025-10-09T22:30:25.752411] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T22:30:25.752632] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-09T22:30:25.752828] [INFO ] [MAIN ] Update Progress: 2347/2373 symbols completed. XPRO took 40.6s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-09T22:30:25.971151] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:30:26.099260] [DEBUG] [LOCAL ] YETI: Loaded 52467 existing records from primary storage. [2025-10-09T22:30:26.126036] [INFO ] [MAIN ] YETI: Loaded 52467 existing records. [2025-10-09T22:30:26.313087] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:30:26.316913] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-09T22:30:26.317667] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-09T22:30:26.318452] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-09T22:30:26.319105] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-09T22:30:26.400903] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-09T22:30:26.713337] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:30:26.790945] [DEBUG] [LOCAL ] XYL: Primary data saved (48238 records). [2025-10-09T22:30:26.791129] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-09T22:30:26.791225] [INFO ] [MAIN ] Update Progress: 2348/2373 symbols completed. XYL took 31.7s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-09T22:30:26.985929] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:30:27.027465] [DEBUG] [LOCAL ] YEXT: Loaded 43106 existing records from primary storage. [2025-10-09T22:30:27.027866] [INFO ] [MAIN ] YEXT: Loaded 43106 existing records. [2025-10-09T22:30:27.216439] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:30:27.216591] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-09T22:30:27.217253] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-09T22:30:27.218330] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-09T22:30:27.218737] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-09T22:30:27.218815] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-09T22:30:27.368328] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T22:30:27.634460] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:30:27.918758] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T22:30:27.996692] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-09T22:30:28.796694] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-09T22:30:29.547789] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-09T22:30:29.596716] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-09T22:30:29.664542] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T22:30:30.149029] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T22:30:30.396761] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-09T22:30:31.196736] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-09T22:30:31.274314] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T22:30:31.900017] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T22:30:31.996694] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-09T22:30:32.522798] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T22:30:32.796728] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-09T22:30:33.059533] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T22:30:33.596717] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-09T22:30:34.396716] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-09T22:30:34.468140] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T22:30:34.727511] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T22:30:35.196718] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-09T22:30:35.586776] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T22:30:35.996716] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-09T22:30:36.796705] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-09T22:30:36.966168] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T22:30:37.606316] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-09T22:30:37.612082] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T22:30:38.074030] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T22:30:38.396703] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-09T22:30:39.046505] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T22:30:39.196713] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-09T22:30:39.421025] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T22:30:39.424119] [INFO ] [REMOTE ] YALA: Full fetch complete (46743 records). [2025-10-09T22:30:39.424206] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-09T22:30:39.831279] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-09T22:30:39.831358] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-09T22:30:39.832281] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-09T22:30:39.832343] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-09T22:30:39.833388] [DEBUG] [LOCAL ] YALA: Trimmed 46743 records to 37208 (keeping 200 days of data) [2025-10-09T22:30:40.014993] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-09T22:30:40.046064] [DEBUG] [LOCAL ] YALA: Primary data saved (37208 records). [2025-10-09T22:30:40.046192] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-09T22:30:40.046274] [INFO ] [MAIN ] Update Progress: 2349/2373 symbols completed. YALA took 32.6s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-09T22:30:40.217123] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:30:40.268436] [DEBUG] [LOCAL ] YMM: Loaded 52596 existing records from primary storage. [2025-10-09T22:30:40.268860] [INFO ] [MAIN ] YMM: Loaded 52596 existing records. [2025-10-09T22:30:40.443186] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:30:40.443409] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-09T22:30:40.443467] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-09T22:30:40.443698] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-09T22:30:40.443754] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-09T22:30:40.796758] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-09T22:30:40.860959] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:30:40.893270] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T22:30:41.431189] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T22:30:41.596715] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-09T22:30:42.396695] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-09T22:30:42.481637] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T22:30:43.183684] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T22:30:43.196678] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-09T22:30:43.817148] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T22:30:43.996713] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-09T22:30:44.721624] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T22:30:44.796678] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-09T22:30:45.596686] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-09T22:30:45.690533] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T22:30:46.396772] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-09T22:30:46.567393] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T22:30:47.095079] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T22:30:47.196686] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-09T22:30:47.916884] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T22:30:47.996704] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-09T22:30:48.796692] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-09T22:30:49.282385] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T22:30:49.549095] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T22:30:49.596666] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-09T22:30:50.396753] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-09T22:30:50.522633] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T22:30:50.847828] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T22:30:51.196691] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-09T22:30:51.996701] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-09T22:30:52.262943] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T22:30:52.796716] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-09T22:30:52.896953] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T22:30:53.501213] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T22:30:53.596728] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-09T22:30:54.053566] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T22:30:54.396718] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-09T22:30:54.771209] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T22:30:55.196721] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-09T22:30:55.709575] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T22:30:55.996717] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-09T22:30:56.796689] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-09T22:30:56.926733] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T22:30:57.596728] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-09T22:30:57.808931] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T22:30:57.871506] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T22:30:57.875559] [INFO ] [REMOTE ] YELP: Full fetch complete (64636 records). [2025-10-09T22:30:57.875697] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-09T22:30:58.255350] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-09T22:30:58.255492] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-09T22:30:58.256573] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-09T22:30:58.256636] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-09T22:30:58.258579] [DEBUG] [LOCAL ] YELP: Trimmed 64636 records to 45748 (keeping 200 days of data) [2025-10-09T22:30:58.424151] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-09T22:30:58.528479] [DEBUG] [LOCAL ] YELP: Primary data saved (45748 records). [2025-10-09T22:30:58.528599] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-09T22:30:58.528706] [INFO ] [MAIN ] Update Progress: 2350/2373 symbols completed. YELP took 34.8s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-09T22:30:58.695130] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:30:58.738861] [DEBUG] [LOCAL ] YOU: Loaded 49690 existing records from primary storage. [2025-10-09T22:30:58.739171] [INFO ] [MAIN ] YOU: Loaded 49690 existing records. [2025-10-09T22:30:58.914227] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:30:58.914408] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-09T22:30:58.914453] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-09T22:30:58.914687] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-09T22:30:58.914766] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-09T22:30:59.208867] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-09T22:30:59.271326] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T22:30:59.301682] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:30:59.307158] [INFO ] [REMOTE ] YETI: Full fetch complete (75400 records). [2025-10-09T22:30:59.307311] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-09T22:30:59.691486] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-09T22:30:59.691581] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-09T22:30:59.692978] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-09T22:30:59.693065] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-09T22:30:59.694923] [DEBUG] [LOCAL ] YETI: Trimmed 75400 records to 52832 (keeping 200 days of data) [2025-10-09T22:31:00.000295] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-09T22:31:00.049975] [DEBUG] [LOCAL ] YETI: Primary data saved (52832 records). [2025-10-09T22:31:00.050130] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-09T22:31:00.050240] [INFO ] [MAIN ] Update Progress: 2351/2373 symbols completed. YETI took 34.3s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-09T22:31:00.239320] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:31:00.271060] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T22:31:00.327794] [DEBUG] [LOCAL ] YPF: Loaded 50525 existing records from primary storage. [2025-10-09T22:31:00.328180] [INFO ] [MAIN ] YPF: Loaded 50525 existing records. [2025-10-09T22:31:00.504078] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:31:00.504560] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-09T22:31:00.504685] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-09T22:31:00.513989] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-09T22:31:00.514120] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-09T22:31:00.558273] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T22:31:00.600472] [INFO ] [REMOTE ] YEXT: Full fetch complete (63120 records). [2025-10-09T22:31:00.620111] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-09T22:31:00.820507] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-09T22:31:01.217685] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:31:01.299612] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-09T22:31:01.299758] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-09T22:31:01.300826] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-09T22:31:01.300888] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-09T22:31:01.302130] [DEBUG] [LOCAL ] YEXT: Trimmed 63120 records to 43406 (keeping 200 days of data) [2025-10-09T22:31:01.437542] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T22:31:01.596949] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-09T22:31:01.599679] [DEBUG] [LOCAL ] YEXT: Primary data saved (43406 records). [2025-10-09T22:31:01.599756] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-09T22:31:01.599837] [INFO ] [MAIN ] Update Progress: 2352/2373 symbols completed. YEXT took 34.8s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-09T22:31:01.775082] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:31:01.792634] [DEBUG] [LOCAL ] YRD: Loaded 11994 existing records from primary storage. [2025-10-09T22:31:01.792932] [INFO ] [MAIN ] YRD: Loaded 11994 existing records. [2025-10-09T22:31:01.968367] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:31:01.968557] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-09T22:31:01.968604] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-09T22:31:01.968827] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-09T22:31:01.968907] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-09T22:31:02.316938] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:31:02.396677] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-09T22:31:02.700262] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T22:31:03.058281] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T22:31:03.196710] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-09T22:31:03.398954] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T22:31:03.996729] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-09T22:31:04.796706] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-09T22:31:04.902336] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T22:31:05.443056] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T22:31:05.513122] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T22:31:05.596679] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-09T22:31:06.396719] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-09T22:31:07.196743] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-09T22:31:07.331853] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T22:31:07.996723] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-09T22:31:08.189331] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T22:31:08.223272] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T22:31:08.796745] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-09T22:31:09.596764] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-09T22:31:09.660663] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T22:31:10.396793] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-09T22:31:10.553178] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T22:31:10.674152] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T22:31:11.196762] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-09T22:31:11.837407] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T22:31:11.996709] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-09T22:31:12.725330] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T22:31:12.796704] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-09T22:31:13.596732] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-09T22:31:13.777496] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T22:31:13.778568] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T22:31:14.396735] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-09T22:31:14.898456] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T22:31:15.196712] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-09T22:31:15.977429] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T22:31:15.996671] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-09T22:31:16.796723] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-09T22:31:16.882003] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T22:31:17.032950] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T22:31:17.596748] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-09T22:31:18.216120] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T22:31:18.396783] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-09T22:31:19.196752] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-09T22:31:19.334986] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T22:31:19.415367] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T22:31:19.996704] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-09T22:31:20.749795] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T22:31:20.754523] [INFO ] [REMOTE ] YMM: Full fetch complete (76330 records). [2025-10-09T22:31:20.754718] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-09T22:31:20.801924] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-09T22:31:21.173399] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-09T22:31:21.173543] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-09T22:31:21.175115] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-09T22:31:21.175230] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-09T22:31:21.177132] [DEBUG] [LOCAL ] YMM: Trimmed 76330 records to 52979 (keeping 200 days of data) [2025-10-09T22:31:21.423811] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T22:31:21.447009] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T22:31:21.559741] [DEBUG] [LOCAL ] YMM: Primary data saved (52979 records). [2025-10-09T22:31:21.559894] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-09T22:31:21.560088] [INFO ] [MAIN ] Update Progress: 2353/2373 symbols completed. YMM took 41.5s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-09T22:31:21.602612] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-09T22:31:21.737860] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:31:21.762186] [DEBUG] [LOCAL ] YSG: Loaded 25279 existing records from primary storage. [2025-10-09T22:31:21.762464] [INFO ] [MAIN ] YSG: Loaded 25279 existing records. [2025-10-09T22:31:21.940022] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:31:21.940247] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-09T22:31:21.940318] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-09T22:31:21.940567] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-09T22:31:21.940628] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-09T22:31:22.295006] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:31:22.396709] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-09T22:31:23.196694] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-09T22:31:23.440213] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T22:31:23.717981] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T22:31:23.996708] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-09T22:31:24.564081] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T22:31:24.796726] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-09T22:31:25.504282] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T22:31:25.601066] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-09T22:31:25.604336] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T22:31:26.241477] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T22:31:26.396723] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-09T22:31:27.196724] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-09T22:31:27.207503] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T22:31:27.996731] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-09T22:31:28.796717] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-09T22:31:29.039191] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T22:31:29.112605] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T22:31:29.596691] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-09T22:31:30.204504] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T22:31:30.396680] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-09T22:31:30.628042] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T22:31:31.196724] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-09T22:31:31.751107] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T22:31:31.996688] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-09T22:31:32.109681] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T22:31:32.796749] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-09T22:31:33.374517] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T22:31:33.378960] [INFO ] [REMOTE ] YOU: Full fetch complete (72191 records). [2025-10-09T22:31:33.379074] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-09T22:31:33.606047] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-09T22:31:33.778512] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-09T22:31:33.778595] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-09T22:31:33.779887] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-09T22:31:33.779955] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-09T22:31:33.781835] [DEBUG] [LOCAL ] YOU: Trimmed 72191 records to 50065 (keeping 200 days of data) [2025-10-09T22:31:33.882383] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T22:31:34.103630] [DEBUG] [LOCAL ] YOU: Primary data saved (50065 records). [2025-10-09T22:31:34.103798] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-09T22:31:34.103894] [INFO ] [MAIN ] Update Progress: 2354/2373 symbols completed. YOU took 35.6s. Estimated remaining: 2m 41s. Rate: 7.1 symbols/min [2025-10-09T22:31:34.269460] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:31:34.319809] [DEBUG] [LOCAL ] YUM: Loaded 51198 existing records from primary storage. [2025-10-09T22:31:34.320122] [INFO ] [MAIN ] YUM: Loaded 51198 existing records. [2025-10-09T22:31:34.401956] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-09T22:31:34.502862] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:31:34.503084] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-09T22:31:34.503143] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-09T22:31:34.503375] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-09T22:31:34.503432] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-09T22:31:34.858240] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:31:35.196686] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-09T22:31:35.519589] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T22:31:35.821748] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T22:31:35.996702] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-09T22:31:36.796748] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-09T22:31:36.967379] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T22:31:37.531580] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T22:31:37.536021] [INFO ] [REMOTE ] YPF: Full fetch complete (73466 records). [2025-10-09T22:31:37.536157] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-09T22:31:37.602733] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-09T22:31:37.960496] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-09T22:31:37.960677] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-09T22:31:37.962051] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-09T22:31:37.962137] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-09T22:31:37.982783] [DEBUG] [LOCAL ] YPF: Trimmed 73466 records to 50911 (keeping 200 days of data) [2025-10-09T22:31:37.983777] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T22:31:38.299792] [DEBUG] [LOCAL ] YPF: Primary data saved (50911 records). [2025-10-09T22:31:38.299995] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-09T22:31:38.300137] [INFO ] [MAIN ] Update Progress: 2355/2373 symbols completed. YPF took 38.2s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-09T22:31:38.402690] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-09T22:31:38.483736] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:31:38.531911] [DEBUG] [LOCAL ] YUMC: Loaded 52603 existing records from primary storage. [2025-10-09T22:31:38.532284] [INFO ] [MAIN ] YUMC: Loaded 52603 existing records. [2025-10-09T22:31:38.716391] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:31:38.716626] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-09T22:31:38.716709] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-09T22:31:38.716948] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-09T22:31:38.717009] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-09T22:31:39.094800] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:31:39.196690] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-09T22:31:39.406843] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T22:31:39.742708] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T22:31:39.996723] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-09T22:31:40.678730] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T22:31:40.712404] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T22:31:40.713926] [INFO ] [REMOTE ] YRD: Full fetch complete (19072 records). [2025-10-09T22:31:40.714002] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-09T22:31:40.801938] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-09T22:31:41.100961] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-09T22:31:41.101075] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-09T22:31:41.101538] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-09T22:31:41.101581] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-09T22:31:41.102180] [DEBUG] [LOCAL ] YRD: Trimmed 19072 records to 12033 (keeping 200 days of data) [2025-10-09T22:31:41.174561] [DEBUG] [LOCAL ] YRD: Primary data saved (12033 records). [2025-10-09T22:31:41.174723] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-09T22:31:41.174824] [INFO ] [MAIN ] Update Progress: 2356/2373 symbols completed. YRD took 39.6s. Estimated remaining: 2m 24s. Rate: 7.1 symbols/min [2025-10-09T22:31:41.348591] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:31:41.396416] [DEBUG] [LOCAL ] ZBH: Loaded 50845 existing records from primary storage. [2025-10-09T22:31:41.396761] [INFO ] [MAIN ] ZBH: Loaded 50845 existing records. [2025-10-09T22:31:41.607714] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-09T22:31:41.612781] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:31:41.614133] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-09T22:31:41.614269] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-09T22:31:41.614576] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-09T22:31:41.614635] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-09T22:31:41.977897] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:31:42.209298] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T22:31:42.396813] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-09T22:31:42.857776] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T22:31:43.196759] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-09T22:31:43.996688] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-09T22:31:44.199533] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T22:31:44.347385] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T22:31:44.350390] [INFO ] [REMOTE ] YSG: Full fetch complete (32289 records). [2025-10-09T22:31:44.350470] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-09T22:31:44.723577] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-09T22:31:44.723677] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-09T22:31:44.724360] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-09T22:31:44.724402] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-09T22:31:44.725258] [DEBUG] [LOCAL ] YSG: Trimmed 32289 records to 25476 (keeping 200 days of data) [2025-10-09T22:31:44.805967] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-09T22:31:44.874928] [DEBUG] [LOCAL ] YSG: Primary data saved (25476 records). [2025-10-09T22:31:44.875078] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-09T22:31:44.875166] [INFO ] [MAIN ] Update Progress: 2357/2373 symbols completed. YSG took 23.3s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-09T22:31:45.545890] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T22:31:45.596814] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-09T22:31:46.401779] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-09T22:31:46.418721] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T22:31:47.196689] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-09T22:31:47.458251] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T22:31:47.913366] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T22:31:47.996672] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-09T22:31:48.796707] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-09T22:31:49.054275] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T22:31:49.596763] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-09T22:31:49.723347] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T22:31:50.396699] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-09T22:31:50.546082] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T22:31:51.032882] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T22:31:51.196765] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-09T22:31:51.996773] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-09T22:31:52.316995] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T22:31:52.722613] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T22:31:52.796718] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-09T22:31:53.596703] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-09T22:31:53.833055] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T22:31:54.396690] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-09T22:31:54.747469] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T22:31:55.196689] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-09T22:31:55.421540] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T22:31:55.996695] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-09T22:31:56.202516] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T22:31:56.796750] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-09T22:31:56.924112] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T22:31:57.458574] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T22:31:57.596733] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-09T22:31:58.396736] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-09T22:31:58.559805] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T22:31:59.196683] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-09T22:31:59.313188] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T22:31:59.400454] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.20 seconds). [2025-10-09T22:31:59.405218] [INFO ] [REMOTE ] YUM: Full fetch complete (74451 records). [2025-10-09T22:31:59.405348] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-09T22:31:59.809513] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-09T22:31:59.809757] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-09T22:31:59.810943] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-09T22:31:59.811131] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-09T22:31:59.813022] [DEBUG] [LOCAL ] YUM: Trimmed 74451 records to 51558 (keeping 200 days of data) [2025-10-09T22:31:59.937719] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T22:32:00.042363] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-09T22:32:00.187697] [DEBUG] [LOCAL ] YUM: Primary data saved (51558 records). [2025-10-09T22:32:00.187857] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-09T22:32:00.187949] [INFO ] [MAIN ] Update Progress: 2358/2373 symbols completed. YUM took 26.1s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-09T22:32:00.796776] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-09T22:32:01.889992] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T22:32:01.902035] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-09T22:32:02.205877] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T22:32:02.396725] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-09T22:32:03.734128] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T22:32:03.745970] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-09T22:32:04.068162] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T22:32:04.079771] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-09T22:32:05.069246] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T22:32:05.081418] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-09T22:32:05.657397] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T22:32:05.668562] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-09T22:32:06.221971] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T22:32:06.226771] [INFO ] [REMOTE ] ZBH: Full fetch complete (73672 records). [2025-10-09T22:32:06.227358] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-09T22:32:06.638015] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-09T22:32:06.638192] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-09T22:32:06.644773] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-09T22:32:06.650664] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-09T22:32:06.651086] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T22:32:06.656786] [INFO ] [REMOTE ] YUMC: Full fetch complete (76144 records). [2025-10-09T22:32:06.656918] [DEBUG] [LOCAL ] ZBH: Trimmed 73672 records to 51177 (keeping 200 days of data) [2025-10-09T22:32:06.657152] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-09T22:32:07.180172] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-09T22:32:07.180810] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-09T22:32:07.182587] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-09T22:32:07.182958] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-09T22:32:07.187355] [DEBUG] [LOCAL ] YUMC: Trimmed 76144 records to 52975 (keeping 200 days of data) [2025-10-09T22:32:07.734329] [DEBUG] [LOCAL ] ZBH: Primary data saved (51177 records). [2025-10-09T22:32:07.735017] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-09T22:32:07.735466] [INFO ] [MAIN ] Update Progress: 2359/2373 symbols completed. ZBH took 26.6s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-09T22:32:07.751671] [DEBUG] [LOCAL ] YUMC: Primary data saved (52975 records). [2025-10-09T22:32:07.751760] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-09T22:32:07.751847] [INFO ] [MAIN ] Update Progress: 2360/2373 symbols completed. YUMC took 29.5s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-09T22:32:08.421326] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:32:08.422232] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:32:08.449269] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:32:08.473856] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:32:08.490176] [DEBUG] [LOCAL ] ZEPP: Loaded 18238 existing records from primary storage. [2025-10-09T22:32:08.490637] [INFO ] [MAIN ] ZEPP: Loaded 18238 existing records. [2025-10-09T22:32:08.641228] [DEBUG] [LOCAL ] ZH: Loaded 25762 existing records from primary storage. [2025-10-09T22:32:08.728241] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:32:08.710616] [INFO ] [MAIN ] ZH: Loaded 25762 existing records. [2025-10-09T22:32:08.748809] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-09T22:32:08.764340] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-09T22:32:08.790897] [DEBUG] [LOCAL ] ZETA: Loaded 53609 existing records from primary storage. [2025-10-09T22:32:08.819350] [INFO ] [MAIN ] ZETA: Loaded 53609 existing records. [2025-10-09T22:32:08.813963] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-09T22:32:08.784467] [DEBUG] [LOCAL ] ZGN: Loaded 40720 existing records from primary storage. [2025-10-09T22:32:08.843083] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-09T22:32:08.885798] [INFO ] [MAIN ] ZGN: Loaded 40720 existing records. [2025-10-09T22:32:09.440330] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:32:09.510315] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:32:09.560134] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-09T22:32:09.563718] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:32:09.571050] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-09T22:32:09.563907] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-09T22:32:09.623141] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-09T22:32:09.633630] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-09T22:32:09.633771] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-09T22:32:09.628429] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-09T22:32:09.633951] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-09T22:32:09.725008] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-09T22:32:09.733984] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-09T22:32:09.734218] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-09T22:32:09.755293] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-09T22:32:10.221268] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:32:10.236988] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-09T22:32:10.824822] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:32:10.813616] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:32:10.880953] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:32:10.877820] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-09T22:32:10.884671] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-09T22:32:10.885867] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T22:32:10.885752] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-09T22:32:10.887215] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-09T22:32:11.381291] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T22:32:11.382623] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-09T22:32:11.852776] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T22:32:11.860851] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-09T22:32:11.885580] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T22:32:11.996683] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-09T22:32:12.458277] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T22:32:12.484177] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T22:32:12.637806] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T22:32:12.796759] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-09T22:32:13.340700] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-09T22:32:13.596691] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-09T22:32:14.354215] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T22:32:14.396675] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-09T22:32:15.196773] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-09T22:32:15.996746] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-09T22:32:16.037000] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-09T22:32:16.094454] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T22:32:16.351802] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T22:32:16.563997] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T22:32:16.796706] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-09T22:32:17.596731] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-09T22:32:18.209707] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T22:32:18.396733] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-09T22:32:18.964931] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T22:32:19.196769] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-09T22:32:19.383764] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T22:32:19.693667] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-09T22:32:19.996714] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-09T22:32:20.607191] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-09T22:32:20.796697] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-09T22:32:21.596736] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-09T22:32:22.396726] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-09T22:32:23.116006] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-09T22:32:23.143431] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T22:32:23.196673] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-09T22:32:23.572118] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T22:32:23.996788] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-09T22:32:24.796680] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-09T22:32:24.865408] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T22:32:25.236691] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T22:32:25.596733] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-09T22:32:26.329385] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T22:32:26.396764] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-09T22:32:27.149321] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T22:32:27.196669] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-09T22:32:27.996675] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-09T22:32:28.308232] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T22:32:28.310521] [INFO ] [REMOTE ] ZEPP: Full fetch complete (19938 records). [2025-10-09T22:32:28.310595] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-09T22:32:28.695347] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-09T22:32:28.695482] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-09T22:32:28.696014] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-09T22:32:28.696096] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-09T22:32:28.726882] [DEBUG] [LOCAL ] ZEPP: Trimmed 19938 records to 18435 (keeping 200 days of data) [2025-10-09T22:32:28.729918] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-09T22:32:28.818030] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-09T22:32:28.855327] [DEBUG] [LOCAL ] ZEPP: Primary data saved (18435 records). [2025-10-09T22:32:28.855468] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-09T22:32:28.855570] [INFO ] [MAIN ] Update Progress: 2361/2373 symbols completed. ZEPP took 21.1s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-09T22:32:29.035526] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:32:29.049945] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T22:32:29.103598] [DEBUG] [LOCAL ] ZIM: Loaded 53502 existing records from primary storage. [2025-10-09T22:32:29.103961] [INFO ] [MAIN ] ZIM: Loaded 53502 existing records. [2025-10-09T22:32:29.290010] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:32:29.290232] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-09T22:32:29.290280] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-09T22:32:29.290540] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-09T22:32:29.290597] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-09T22:32:29.601800] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-09T22:32:29.670666] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:32:30.396757] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-09T22:32:30.864189] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T22:32:30.905787] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T22:32:31.196754] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-09T22:32:31.996770] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-09T22:32:32.521307] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T22:32:32.641853] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-09T22:32:32.796763] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-09T22:32:33.596690] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-09T22:32:33.914581] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T22:32:34.396777] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-09T22:32:34.543809] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T22:32:34.545504] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T22:32:34.551820] [INFO ] [REMOTE ] ZH: Full fetch complete (39959 records). [2025-10-09T22:32:34.558217] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-09T22:32:34.938112] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-09T22:32:34.938194] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-09T22:32:34.939042] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-09T22:32:34.939103] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-09T22:32:34.939967] [DEBUG] [LOCAL ] ZH: Trimmed 39959 records to 25874 (keeping 200 days of data) [2025-10-09T22:32:35.085437] [DEBUG] [LOCAL ] ZH: Primary data saved (25874 records). [2025-10-09T22:32:35.085569] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-09T22:32:35.085682] [INFO ] [MAIN ] Update Progress: 2362/2373 symbols completed. ZH took 27.3s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-09T22:32:35.201802] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-09T22:32:35.259334] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:32:35.303788] [DEBUG] [LOCAL ] ZIP: Loaded 43870 existing records from primary storage. [2025-10-09T22:32:35.304145] [INFO ] [MAIN ] ZIP: Loaded 43870 existing records. [2025-10-09T22:32:35.483999] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:32:35.484222] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-09T22:32:35.484271] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-09T22:32:35.484545] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-09T22:32:35.484605] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-09T22:32:35.834427] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:32:35.996720] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-09T22:32:36.670685] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-09T22:32:36.796681] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-09T22:32:36.950845] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T22:32:37.313375] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T22:32:37.596778] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-09T22:32:37.831481] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T22:32:38.396687] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-09T22:32:38.822706] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T22:32:39.196719] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-09T22:32:39.996721] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-09T22:32:40.555498] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T22:32:40.693748] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-09T22:32:40.796712] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-09T22:32:41.596770] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-09T22:32:42.007989] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T22:32:42.402007] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-09T22:32:42.414976] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T22:32:43.196742] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-09T22:32:43.904074] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T22:32:43.996691] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-09T22:32:44.130070] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-09T22:32:44.796738] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-09T22:32:45.196750] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T22:32:45.283353] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T22:32:45.596777] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-09T22:32:46.396772] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-09T22:32:47.152016] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-09T22:32:47.196676] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-09T22:32:47.973743] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T22:32:47.996665] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-09T22:32:48.079949] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-09T22:32:48.796735] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-09T22:32:49.265700] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-09T22:32:49.272009] [INFO ] [REMOTE ] ZETA: Full fetch complete (77680 records). [2025-10-09T22:32:49.272164] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-09T22:32:49.602455] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-09T22:32:49.707361] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T22:32:49.716077] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-09T22:32:49.716156] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-09T22:32:49.717527] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-09T22:32:49.717773] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-09T22:32:49.720198] [DEBUG] [LOCAL ] ZETA: Trimmed 77680 records to 53999 (keeping 200 days of data) [2025-10-09T22:32:49.967849] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T22:32:50.100741] [DEBUG] [LOCAL ] ZETA: Primary data saved (53999 records). [2025-10-09T22:32:50.100899] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-09T22:32:50.101005] [INFO ] [MAIN ] Update Progress: 2363/2373 symbols completed. ZETA took 42.3s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-09T22:32:50.270277] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:32:50.309855] [DEBUG] [LOCAL ] ZK: Loaded 39135 existing records from primary storage. [2025-10-09T22:32:50.310148] [INFO ] [MAIN ] ZK: Loaded 39135 existing records. [2025-10-09T22:32:50.406764] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-09T22:32:50.489553] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:32:50.489770] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-09T22:32:50.489820] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-09T22:32:50.490012] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-09T22:32:50.490068] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-09T22:32:50.844210] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:32:51.196690] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-09T22:32:51.962500] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T22:32:51.998719] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-09T22:32:52.001553] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-09T22:32:52.609387] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T22:32:52.796703] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-09T22:32:53.596716] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-09T22:32:53.632756] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T22:32:54.324504] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T22:32:54.396698] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-09T22:32:55.196723] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-09T22:32:55.567667] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T22:32:55.873808] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T22:32:55.996804] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-09T22:32:56.280601] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T22:32:56.796726] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-09T22:32:57.489621] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T22:32:57.596745] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-09T22:32:58.341524] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T22:32:58.396676] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-09T22:32:59.196775] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-09T22:32:59.941739] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-09T22:32:59.996670] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-09T22:33:00.080030] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T22:33:00.461407] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T22:33:00.464818] [INFO ] [REMOTE ] ZGN: Full fetch complete (58061 records). [2025-10-09T22:33:00.464900] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-09T22:33:00.806667] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-09T22:33:00.852836] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-09T22:33:00.852920] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-09T22:33:00.854003] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-09T22:33:00.854070] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-09T22:33:00.855254] [DEBUG] [LOCAL ] ZGN: Trimmed 58061 records to 41074 (keeping 200 days of data) [2025-10-09T22:33:01.098039] [DEBUG] [LOCAL ] ZGN: Primary data saved (41074 records). [2025-10-09T22:33:01.098173] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-09T22:33:01.099512] [INFO ] [MAIN ] Update Progress: 2364/2373 symbols completed. ZGN took 53.3s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-09T22:33:01.268165] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:33:01.277581] [DEBUG] [LOCAL ] ZKH: Loaded 7652 existing records from primary storage. [2025-10-09T22:33:01.277868] [INFO ] [MAIN ] ZKH: Loaded 7652 existing records. [2025-10-09T22:33:01.457519] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:33:01.457849] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-09T22:33:01.457901] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-09T22:33:01.458104] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-09T22:33:01.458193] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-09T22:33:01.605591] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-09T22:33:01.867389] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:33:01.898175] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T22:33:01.933481] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T22:33:01.937453] [INFO ] [REMOTE ] ZIP: Full fetch complete (59948 records). [2025-10-09T22:33:01.937538] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-09T22:33:02.312407] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-09T22:33:02.312484] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-09T22:33:02.313521] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-09T22:33:02.313609] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-09T22:33:02.314791] [DEBUG] [LOCAL ] ZIP: Trimmed 59948 records to 44170 (keeping 200 days of data) [2025-10-09T22:33:02.396874] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-09T22:33:02.562381] [DEBUG] [LOCAL ] ZIP: Primary data saved (44170 records). [2025-10-09T22:33:02.562510] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-09T22:33:02.562592] [INFO ] [MAIN ] Update Progress: 2365/2373 symbols completed. ZIP took 27.5s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-09T22:33:02.729995] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:33:02.774593] [DEBUG] [LOCAL ] ZTO: Loaded 49554 existing records from primary storage. [2025-10-09T22:33:02.774923] [INFO ] [MAIN ] ZTO: Loaded 49554 existing records. [2025-10-09T22:33:02.959179] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:33:02.964615] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-09T22:33:02.964412] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T22:33:02.966626] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-09T22:33:02.966939] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-09T22:33:02.966999] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-09T22:33:03.197925] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-09T22:33:03.341433] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:33:03.423343] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T22:33:03.924138] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T22:33:03.996683] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-09T22:33:04.576294] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T22:33:04.796751] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-09T22:33:05.540571] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T22:33:05.596698] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-09T22:33:06.210234] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T22:33:06.396728] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-09T22:33:06.966822] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T22:33:07.196746] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-09T22:33:07.996776] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-09T22:33:08.389344] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T22:33:08.796728] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-09T22:33:09.208572] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-09T22:33:09.213274] [INFO ] [REMOTE ] ZIM: Full fetch complete (77497 records). [2025-10-09T22:33:09.213385] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-09T22:33:09.616168] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-09T22:33:09.621064] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-09T22:33:09.621160] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-09T22:33:09.622378] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-09T22:33:09.622558] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-09T22:33:09.624671] [DEBUG] [LOCAL ] ZIM: Trimmed 77497 records to 53891 (keeping 200 days of data) [2025-10-09T22:33:09.972903] [DEBUG] [LOCAL ] ZIM: Primary data saved (53891 records). [2025-10-09T22:33:09.973048] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-09T22:33:09.973130] [INFO ] [MAIN ] Update Progress: 2366/2373 symbols completed. ZIM took 41.1s. Estimated remaining: 59.1s. Rate: 7.1 symbols/min [2025-10-09T22:33:10.165943] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:33:10.183953] [DEBUG] [LOCAL ] ZTR: Loaded 16796 existing records from primary storage. [2025-10-09T22:33:10.184186] [INFO ] [MAIN ] ZTR: Loaded 16796 existing records. [2025-10-09T22:33:10.372780] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:33:10.373144] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-09T22:33:10.373340] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-09T22:33:10.373602] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-09T22:33:10.373738] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-09T22:33:10.406096] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-09T22:33:10.604870] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T22:33:10.791794] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:33:11.196743] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-09T22:33:11.431052] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T22:33:11.531073] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T22:33:11.996742] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-09T22:33:12.295211] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T22:33:12.796794] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-09T22:33:13.596761] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-09T22:33:13.672735] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T22:33:13.950311] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T22:33:14.396735] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-09T22:33:15.025324] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T22:33:15.196776] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-09T22:33:15.996726] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-09T22:33:16.039080] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T22:33:16.138512] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T22:33:16.796722] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-09T22:33:17.178076] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T22:33:17.596718] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-09T22:33:18.396736] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-09T22:33:18.603149] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T22:33:18.663538] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T22:33:18.814707] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T22:33:19.196735] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-09T22:33:19.616752] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T22:33:19.617990] [INFO ] [REMOTE ] ZKH: Full fetch complete (11986 records). [2025-10-09T22:33:19.618061] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-09T22:33:20.000909] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-09T22:33:20.001496] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-09T22:33:20.002486] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-09T22:33:20.002985] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-09T22:33:20.003052] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-09T22:33:20.003727] [DEBUG] [LOCAL ] ZKH: Trimmed 11986 records to 7684 (keeping 200 days of data) [2025-10-09T22:33:20.052739] [DEBUG] [LOCAL ] ZKH: Primary data saved (7684 records). [2025-10-09T22:33:20.052909] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-09T22:33:20.053071] [INFO ] [MAIN ] Update Progress: 2367/2373 symbols completed. ZKH took 19.0s. Estimated remaining: 50.7s. Rate: 7.1 symbols/min [2025-10-09T22:33:20.238095] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:33:20.304920] [DEBUG] [LOCAL ] ZTS: Loaded 53076 existing records from primary storage. [2025-10-09T22:33:20.305274] [INFO ] [MAIN ] ZTS: Loaded 53076 existing records. [2025-10-09T22:33:20.490210] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:33:20.490430] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-09T22:33:20.490480] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-09T22:33:20.490762] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-09T22:33:20.490821] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-09T22:33:20.805727] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-09T22:33:20.853865] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:33:21.596709] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-09T22:33:21.751806] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T22:33:22.309762] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T22:33:22.396739] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-09T22:33:23.065983] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T22:33:23.196756] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-09T22:33:23.514272] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T22:33:23.996691] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-09T22:33:24.261823] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T22:33:24.796722] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-09T22:33:25.596695] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-09T22:33:25.657680] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T22:33:25.662129] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T22:33:26.396731] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-09T22:33:27.205873] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-09T22:33:27.235860] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T22:33:27.387306] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T22:33:27.996728] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-09T22:33:28.544307] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T22:33:28.549263] [INFO ] [REMOTE ] ZK: Full fetch complete (56945 records). [2025-10-09T22:33:28.549448] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-09T22:33:28.801875] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-09T22:33:28.973555] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-09T22:33:28.973672] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-09T22:33:28.974746] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-09T22:33:28.974854] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-09T22:33:28.976169] [DEBUG] [LOCAL ] ZK: Trimmed 56945 records to 39481 (keeping 200 days of data) [2025-10-09T22:33:29.078504] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T22:33:29.231260] [DEBUG] [LOCAL ] ZK: Primary data saved (39481 records). [2025-10-09T22:33:29.231407] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-09T22:33:29.231509] [INFO ] [MAIN ] Update Progress: 2368/2373 symbols completed. ZK took 39.1s. Estimated remaining: 42.2s. Rate: 7.1 symbols/min [2025-10-09T22:33:29.403158] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:33:29.443609] [DEBUG] [LOCAL ] ZVIA: Loaded 35417 existing records from primary storage. [2025-10-09T22:33:29.443940] [INFO ] [MAIN ] ZVIA: Loaded 35417 existing records. [2025-10-09T22:33:29.597521] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-09T22:33:29.638833] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:33:29.639288] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-09T22:33:29.639342] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-09T22:33:29.639568] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-09T22:33:29.639624] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-09T22:33:29.988661] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:33:30.396700] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-09T22:33:30.589596] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T22:33:30.642685] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T22:33:31.196757] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-09T22:33:31.868417] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T22:33:31.996726] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-09T22:33:32.703734] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T22:33:32.796686] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-09T22:33:32.956742] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T22:33:33.596743] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-09T22:33:33.631552] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T22:33:33.633563] [INFO ] [REMOTE ] ZTR: Full fetch complete (26859 records). [2025-10-09T22:33:33.633634] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-09T22:33:33.996104] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-09T22:33:33.996179] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-09T22:33:33.996686] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-09T22:33:33.996748] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-09T22:33:33.997379] [DEBUG] [LOCAL ] ZTR: Trimmed 26859 records to 16901 (keeping 200 days of data) [2025-10-09T22:33:34.104074] [DEBUG] [LOCAL ] ZTR: Primary data saved (16901 records). [2025-10-09T22:33:34.104389] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-09T22:33:34.104566] [INFO ] [MAIN ] Update Progress: 2369/2373 symbols completed. ZTR took 24.1s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-09T22:33:34.273352] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T22:33:34.313216] [DEBUG] [LOCAL ] ZWS: Loaded 42273 existing records from primary storage. [2025-10-09T22:33:34.313545] [INFO ] [MAIN ] ZWS: Loaded 42273 existing records. [2025-10-09T22:33:34.402371] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-09T22:33:34.493532] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T22:33:34.493751] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-09T22:33:34.493803] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-09T22:33:34.494029] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-09T22:33:34.494088] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-09T22:33:34.857677] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T22:33:34.910390] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T22:33:35.196687] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-09T22:33:35.996695] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-09T22:33:36.082432] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T22:33:36.796754] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-09T22:33:36.959062] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T22:33:37.331312] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T22:33:37.596728] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-09T22:33:38.246270] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T22:33:38.396818] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-09T22:33:38.752528] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T22:33:39.196750] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-09T22:33:39.996765] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-09T22:33:40.274444] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T22:33:40.442155] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T22:33:40.796754] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-09T22:33:40.914151] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T22:33:41.596756] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-09T22:33:41.994435] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T22:33:42.396777] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-09T22:33:43.196736] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-09T22:33:43.559078] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T22:33:43.996740] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-09T22:33:44.197129] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T22:33:44.796799] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-09T22:33:44.846461] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T22:33:45.596727] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-09T22:33:46.097079] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-09T22:33:46.396728] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-09T22:33:46.594417] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T22:33:46.981135] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T22:33:47.196734] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-09T22:33:47.996779] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-09T22:33:48.099100] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T22:33:48.715473] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T22:33:48.796750] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-09T22:33:49.596723] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-09T22:33:50.350551] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-09T22:33:50.396669] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-09T22:33:50.444403] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T22:33:50.448494] [INFO ] [REMOTE ] ZTO: Full fetch complete (72712 records). [2025-10-09T22:33:50.448595] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-09T22:33:50.849893] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-09T22:33:50.849988] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-09T22:33:50.851271] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-09T22:33:50.851339] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-09T22:33:50.852833] [DEBUG] [LOCAL ] ZTO: Trimmed 72712 records to 49914 (keeping 200 days of data) [2025-10-09T22:33:51.170993] [DEBUG] [LOCAL ] ZTO: Primary data saved (49914 records). [2025-10-09T22:33:51.171180] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-09T22:33:51.171341] [INFO ] [MAIN ] Update Progress: 2370/2373 symbols completed. ZTO took 48.6s. Estimated remaining: 25.4s. Rate: 7.1 symbols/min [2025-10-09T22:33:51.196724] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-09T22:33:51.801249] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T22:33:51.880586] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-09T22:33:51.996675] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-09T22:33:52.268779] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T22:33:52.796745] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-09T22:33:53.596692] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-09T22:33:53.920904] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T22:33:54.396752] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-09T22:33:54.514448] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T22:33:55.076947] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T22:33:55.196758] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-09T22:33:56.005925] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-09T22:33:56.008679] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T22:33:56.275390] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T22:33:56.796823] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-09T22:33:57.516389] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T22:33:57.596687] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-09T22:33:58.234793] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T22:33:58.396787] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-09T22:33:59.190724] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T22:33:59.196706] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-09T22:33:59.494127] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-09T22:33:59.498779] [INFO ] [REMOTE ] ZTS: Full fetch complete (76719 records). [2025-10-09T22:33:59.498911] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-09T22:33:59.645417] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T22:33:59.677108] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52784 records). [2025-10-09T22:33:59.684972] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-09T22:33:59.997631] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-09T22:34:00.133162] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-09T22:34:00.149413] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-09T22:34:00.179020] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-09T22:34:00.179139] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-09T22:34:00.254347] [DEBUG] [LOCAL ] ZTS: Trimmed 76719 records to 53465 (keeping 200 days of data) [2025-10-09T22:34:00.434797] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-09T22:34:00.435601] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-09T22:34:00.436590] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-09T22:34:00.436698] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-09T22:34:00.439924] [DEBUG] [LOCAL ] ZVIA: Trimmed 52784 records to 35698 (keeping 200 days of data) [2025-10-09T22:34:00.786781] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35698 records). [2025-10-09T22:34:00.787416] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-09T22:34:00.787811] [INFO ] [MAIN ] Update Progress: 2371/2373 symbols completed. ZVIA took 31.6s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-09T22:34:00.882948] [DEBUG] [LOCAL ] ZTS: Primary data saved (53465 records). [2025-10-09T22:34:00.883083] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-09T22:34:00.883163] [INFO ] [MAIN ] Update Progress: 2372/2373 symbols completed. ZTS took 40.8s. Estimated remaining: 8.4s. Rate: 7.1 symbols/min [2025-10-09T22:34:01.441165] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T22:34:01.444878] [INFO ] [REMOTE ] ZWS: Full fetch complete (61911 records). [2025-10-09T22:34:01.444982] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-09T22:34:01.845759] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-09T22:34:01.845857] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-09T22:34:01.846912] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-09T22:34:01.846975] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-09T22:34:01.848339] [DEBUG] [LOCAL ] ZWS: Trimmed 61911 records to 42540 (keeping 200 days of data) [2025-10-09T22:34:02.120332] [DEBUG] [LOCAL ] ZWS: Primary data saved (42540 records). [2025-10-09T22:34:02.120539] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-09T22:34:02.120716] [INFO ] [MAIN ] Update Progress: 2373/2373 symbols completed. ZWS took 28.0s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-09T22:34:02.123694] [INFO ] [MAIN ] Parallel update completed in 5h 33m 59s [2025-10-09T22:34:02.123810] [WARN ] [MAIN ] Failed symbols (683): AAMI, AAM, AAUC, ABBV, ACCO, ACP, AD, AEE, AEXA, AFL... [2025-10-09T22:34:02.123896] [INFO ] [MAIN ] Update success rate: 71.2% (1690/2373 symbols) [2025-10-09T22:34:02.875722] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1690/2373 @ 71.22%)' [2025-10-09T22:34:02.876625] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-09T22:34:02.876979] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-09T22:34:02.877021] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-09T22:34:02.877140] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-09T22:34:02.877197] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-09T22:34:04.352069] [DEBUG] [SYMBOL ] Found 2425 valid NYSE symbols. [2025-10-09T22:34:04.352230] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-09T22:34:04.352456] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-09T22:34:04.354449] [INFO ] [LOCAL ] Symbols cache updated with 2373 symbols. [2025-10-09T22:34:04.354507] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-09T22:34:04.354540] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-09T22:34:04.354664] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-09T22:34:04.354723] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-09T22:34:04.354755] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-09T22:34:04.355096] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-10-09T22:34:04.355128] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-09T22:34:04.355348] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-09T22:34:04.355379] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2373 valid symbols. [2025-10-09T22:34:04.355408] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-09T22:34:04.355508] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-09T22:34:04.375657] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-09T22:34:04.397430] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-09T22:34:04.397489] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-09T22:34:04.397521] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-09T22:34:04.397549] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-09T22:34:04.397615] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-09T22:34:04.397693] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-09T22:34:04.397740] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-09T22:34:04.398741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-09T22:34:04.399941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-09T22:34:04.400695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-09T22:34:04.400894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-09T22:34:04.401047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-09T22:34:04.401187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-09T22:34:04.401337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-09T22:34:04.401450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-09T22:34:04.401568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-09T22:34:04.402295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-09T22:34:04.402439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-09T22:34:04.402591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-09T22:34:04.402881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-09T22:34:04.403033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-09T22:34:04.403161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-09T22:34:04.403287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-09T22:34:04.403406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-09T22:34:04.403563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-10-09T22:34:04.403726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-09T22:34:04.403852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-09T22:34:04.403970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-09T22:34:04.404132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-09T22:34:04.404256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-09T22:34:04.404398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-09T22:34:04.404508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-09T22:34:04.404616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-09T22:34:04.404735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-09T22:34:04.404861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-09T22:34:04.405010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-09T22:34:04.405169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-09T22:34:04.405299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-09T22:34:04.405403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-09T22:34:04.405554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-09T22:34:04.405681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-09T22:34:04.405811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-09T22:34:04.405933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-09T22:34:04.406066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-09T22:34:04.406191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-09T22:34:04.406565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-09T22:34:04.406749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-09T22:34:04.406859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-09T22:34:04.406961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-09T22:34:04.407078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-09T22:34:04.407194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-09T22:34:04.407295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-09T22:34:04.407454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-09T22:34:04.407596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-09T22:34:04.407775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-09T22:34:04.407879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-09T22:34:04.407988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-09T22:34:04.408103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-09T22:34:04.408219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-09T22:34:04.408341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-09T22:34:04.408446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-09T22:34:04.408575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-09T22:34:04.408741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-09T22:34:04.408918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-09T22:34:04.409051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-09T22:34:04.409178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-09T22:34:04.409318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-09T22:34:04.409418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-09T22:34:04.409546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-09T22:34:04.409674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-09T22:34:04.409840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-09T22:34:04.409970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-09T22:34:04.410105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-09T22:34:04.410223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-09T22:34:04.410364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-09T22:34:04.410484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-09T22:34:04.410608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-09T22:34:04.410757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-09T22:34:04.410838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-09T22:34:04.410933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-09T22:34:04.411062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-09T22:34:04.411240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-09T22:34:04.411360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-09T22:34:04.411469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-09T22:34:04.411600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-09T22:34:04.411743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-09T22:34:04.411853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-09T22:34:04.411975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-09T22:34:04.412090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-09T22:34:04.412209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-09T22:34:04.412292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-09T22:34:04.412366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-09T22:34:04.412461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-09T22:34:04.412542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-09T22:34:04.412629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-09T22:34:04.412818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-09T22:34:04.412926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-09T22:34:04.413035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-09T22:34:04.413152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-09T22:34:04.413234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-09T22:34:04.413307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-09T22:34:04.413440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-09T22:34:04.413542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-09T22:34:04.413677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-09T22:34:04.413762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-09T22:34:04.413834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-09T22:34:04.413947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-09T22:34:04.414064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-09T22:34:04.414164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-09T22:34:04.414273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-09T22:34:04.414364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-09T22:34:04.414465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-09T22:34:04.414546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-09T22:34:04.414637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-09T22:34:04.414772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-09T22:34:04.414951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-09T22:34:04.415099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-09T22:34:04.415194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-09T22:34:04.415331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-09T22:34:04.415427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-09T22:34:04.415580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-09T22:34:04.415709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-09T22:34:04.415877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-09T22:34:04.415968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-09T22:34:04.416093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-09T22:34:04.416199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-09T22:34:04.416315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-09T22:34:04.416406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-09T22:34:04.416507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-09T22:34:04.416601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-09T22:34:04.416756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-09T22:34:04.416874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-09T22:34:04.416992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-09T22:34:04.417076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-09T22:34:04.417154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-09T22:34:04.417297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-09T22:34:04.417398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-09T22:34:04.417492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-09T22:34:04.417607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-09T22:34:04.418052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-09T22:34:04.418189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-09T22:34:04.418350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-09T22:34:04.418445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-09T22:34:04.418550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-09T22:34:04.418671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-09T22:34:04.418795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-09T22:34:04.418896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-09T22:34:04.419014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-09T22:34:04.419108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-09T22:34:04.419191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-09T22:34:04.419270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-09T22:34:04.419375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-09T22:34:04.419469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-09T22:34:04.419588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-09T22:34:04.419716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-09T22:34:04.419802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-09T22:34:04.419874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-09T22:34:04.419953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-09T22:34:04.420031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-09T22:34:04.420110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-09T22:34:04.420214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-09T22:34:04.420324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-09T22:34:04.420446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-09T22:34:04.420540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-09T22:34:04.420674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-09T22:34:04.420786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-09T22:34:04.420872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-09T22:34:04.420960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-09T22:34:04.421080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-09T22:34:04.421194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-09T22:34:04.421285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-09T22:34:04.421344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-09T22:34:04.421421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-09T22:34:04.421567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-09T22:34:04.421711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-09T22:34:04.421816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-09T22:34:04.421927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-09T22:34:04.422015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-09T22:34:04.422147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-09T22:34:04.422291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-09T22:34:04.422415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-09T22:34:04.422504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-09T22:34:04.422616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-09T22:34:04.422753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-09T22:34:04.422841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-09T22:34:04.422960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-09T22:34:04.423087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-09T22:34:04.423195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-09T22:34:04.423316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-09T22:34:04.423426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-09T22:34:04.423531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-09T22:34:04.423631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-09T22:34:04.423782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-09T22:34:04.423872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-09T22:34:04.423961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-09T22:34:04.424095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-09T22:34:04.424272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-09T22:34:04.424385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-09T22:34:04.424503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-09T22:34:04.424610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-09T22:34:04.424764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-09T22:34:04.424874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-09T22:34:04.424976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-09T22:34:04.425065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-09T22:34:04.425142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-09T22:34:04.425264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-09T22:34:04.425381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-09T22:34:04.425493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-09T22:34:04.425614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-09T22:34:04.425807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-09T22:34:04.425908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-09T22:34:04.426015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-09T22:34:04.426165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-09T22:34:04.426267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-09T22:34:04.426355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-09T22:34:04.426454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-09T22:34:04.426585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-09T22:34:04.426698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-09T22:34:04.426782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-09T22:34:04.426885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-09T22:34:04.427002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-09T22:34:04.427103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-09T22:34:04.427208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-09T22:34:04.427316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-09T22:34:04.427400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-09T22:34:04.427476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-09T22:34:04.427575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-09T22:34:04.427706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-09T22:34:04.427784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-09T22:34:04.427845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-09T22:34:04.427951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-09T22:34:04.428056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-09T22:34:04.428160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-09T22:34:04.428244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-09T22:34:04.428327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-09T22:34:04.428435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-09T22:34:04.428530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-09T22:34:04.428668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-09T22:34:04.428779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-09T22:34:04.428892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-09T22:34:04.428991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-09T22:34:04.429078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-09T22:34:04.429170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-09T22:34:04.429275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-09T22:34:04.429383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-09T22:34:04.429495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-09T22:34:04.429592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-09T22:34:04.429704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-09T22:34:04.429796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-09T22:34:04.429908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-09T22:34:04.430030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-09T22:34:04.430134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-09T22:34:04.430210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-09T22:34:04.430329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-09T22:34:04.430449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-09T22:34:04.430553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-09T22:34:04.430682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-09T22:34:04.430767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-09T22:34:04.430843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-09T22:34:04.430925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-09T22:34:04.431029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-09T22:34:04.431127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-09T22:34:04.431213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-09T22:34:04.431275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-09T22:34:04.431347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-09T22:34:04.431468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-09T22:34:04.431574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-09T22:34:04.431687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-09T22:34:04.431781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-09T22:34:04.431842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-09T22:34:04.431899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-09T22:34:04.432004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-09T22:34:04.432086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-09T22:34:04.432161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-09T22:34:04.432255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-09T22:34:04.432353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-09T22:34:04.432504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-09T22:34:04.432611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-09T22:34:04.432742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-09T22:34:04.432821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-09T22:34:04.432923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-09T22:34:04.433048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-09T22:34:04.433152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-09T22:34:04.433278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-09T22:34:04.433359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-09T22:34:04.433419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-09T22:34:04.433516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-09T22:34:04.433600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-09T22:34:04.433791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-10-09T22:34:04.433877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-09T22:34:04.433937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-09T22:34:04.434008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-09T22:34:04.434121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-09T22:34:04.434210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-09T22:34:04.434301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-09T22:34:04.434361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-09T22:34:04.434443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-09T22:34:04.434555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-09T22:34:04.434670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-09T22:34:04.434804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-09T22:34:04.434923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-10-09T22:34:04.435026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-09T22:34:04.435117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-09T22:34:04.435208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-09T22:34:04.435302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-09T22:34:04.435420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-09T22:34:04.435525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-09T22:34:04.435592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-09T22:34:04.435686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-09T22:34:04.435783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-09T22:34:04.435890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-09T22:34:04.435995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-09T22:34:04.436077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-09T22:34:04.436150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-09T22:34:04.436252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-09T22:34:04.436368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-09T22:34:04.436463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-09T22:34:04.436542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-09T22:34:04.436600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-09T22:34:04.436712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-09T22:34:04.436807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-09T22:34:04.436910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-09T22:34:04.437018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-09T22:34:04.437112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-09T22:34:04.437235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-09T22:34:04.437316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-09T22:34:04.437375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-09T22:34:04.437445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-09T22:34:04.437526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-09T22:34:04.437619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-09T22:34:04.437744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-09T22:34:04.437859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-09T22:34:04.437955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-09T22:34:04.438050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-09T22:34:04.438130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-09T22:34:04.438234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-09T22:34:04.438336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-09T22:34:04.438431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-09T22:34:04.438531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-09T22:34:04.438665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-09T22:34:04.438779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-09T22:34:04.438865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-09T22:34:04.438923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-09T22:34:04.438993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-09T22:34:04.439072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-10-09T22:34:04.439165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-09T22:34:04.439269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-09T22:34:04.439351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-09T22:34:04.439450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-09T22:34:04.439564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-09T22:34:04.439675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-09T22:34:04.439785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-09T22:34:04.439883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-09T22:34:04.439985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-09T22:34:04.440133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-09T22:34:04.440244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-09T22:34:04.440350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-09T22:34:04.440453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-09T22:34:04.440552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-09T22:34:04.440637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-09T22:34:04.440757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-09T22:34:04.440826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-09T22:34:04.440920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-09T22:34:04.441038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-09T22:34:04.441127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-09T22:34:04.441191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-09T22:34:04.441265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-09T22:34:04.441346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-09T22:34:04.441442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-09T22:34:04.441551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-09T22:34:04.441857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-09T22:34:04.441990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-09T22:34:04.442077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-09T22:34:04.442138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-09T22:34:04.442198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-09T22:34:04.442256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-09T22:34:04.442312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-09T22:34:04.442389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-09T22:34:04.442489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-09T22:34:04.442588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-09T22:34:04.442710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-09T22:34:04.442821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-09T22:34:04.442949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-09T22:34:04.443033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-09T22:34:04.443093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-09T22:34:04.443189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-09T22:34:04.443285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-09T22:34:04.443389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-09T22:34:04.443486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-09T22:34:04.443580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-09T22:34:04.443700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-09T22:34:04.443795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-09T22:34:04.443875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-09T22:34:04.443959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-09T22:34:04.444034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-09T22:34:04.444115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-09T22:34:04.444189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-09T22:34:04.444292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-09T22:34:04.444471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-09T22:34:04.444565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-10-09T22:34:04.444696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-09T22:34:04.444786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-09T22:34:04.444868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-09T22:34:04.444987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-09T22:34:04.445083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-09T22:34:04.445166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-09T22:34:04.445231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-09T22:34:04.445339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-09T22:34:04.445422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-09T22:34:04.445481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-09T22:34:04.445551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-09T22:34:04.445631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-09T22:34:04.445758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-09T22:34:04.445868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-09T22:34:04.445949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-09T22:34:04.446031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-09T22:34:04.446112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-09T22:34:04.446171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-09T22:34:04.446227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-09T22:34:04.446311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-09T22:34:04.446406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-09T22:34:04.446500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-09T22:34:04.446602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-09T22:34:04.446729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-09T22:34:04.446823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-09T22:34:04.446941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-09T22:34:04.447030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-09T22:34:04.447141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-09T22:34:04.447252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-09T22:34:04.447353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-09T22:34:04.447435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-09T22:34:04.447508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-09T22:34:04.447604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-09T22:34:04.447714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-09T22:34:04.447807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-09T22:34:04.447913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-09T22:34:04.448023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-09T22:34:04.448105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-09T22:34:04.448162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-09T22:34:04.448225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-09T22:34:04.448293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-09T22:34:04.448371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-09T22:34:04.448426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-09T22:34:04.448479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-09T22:34:04.448531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-09T22:34:04.448613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-09T22:34:04.448739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-09T22:34:04.448831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-09T22:34:04.448920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-09T22:34:04.448996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-09T22:34:04.449096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-09T22:34:04.449175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-09T22:34:04.449261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-09T22:34:04.449363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-09T22:34:04.449476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-09T22:34:04.449569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-09T22:34:04.449790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-09T22:34:04.449894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-09T22:34:04.449974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-09T22:34:04.450030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-09T22:34:04.450082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-09T22:34:04.450134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-09T22:34:04.450204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-09T22:34:04.450285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-09T22:34:04.450342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-10-09T22:34:04.450395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-09T22:34:04.450465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-09T22:34:04.450536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-09T22:34:04.450633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-09T22:34:04.450759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-09T22:34:04.450839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-09T22:34:04.450896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-09T22:34:04.450951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-09T22:34:04.451060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-10-09T22:34:04.451128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-09T22:34:04.451246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-09T22:34:04.451330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-09T22:34:04.451401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-09T22:34:04.451497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-09T22:34:04.451580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-09T22:34:04.451668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-09T22:34:04.451754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-09T22:34:04.451814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-09T22:34:04.451902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-09T22:34:04.451974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-09T22:34:04.452048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-09T22:34:04.452142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-09T22:34:04.452221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-09T22:34:04.452294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-09T22:34:04.452376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-09T22:34:04.452431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-09T22:34:04.452488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-09T22:34:04.452555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-09T22:34:04.452635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-09T22:34:04.452748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-09T22:34:04.452809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-09T22:34:04.452914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-09T22:34:04.452990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-09T22:34:04.453073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-09T22:34:04.453149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-09T22:34:04.453226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-09T22:34:04.453294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-09T22:34:04.453387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-09T22:34:04.453481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-09T22:34:04.453582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-09T22:34:04.453693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-09T22:34:04.453775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-09T22:34:04.453844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-09T22:34:04.453946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-09T22:34:04.454026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-09T22:34:04.454098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-09T22:34:04.454192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-09T22:34:04.454283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-09T22:34:04.454340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-09T22:34:04.454395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-09T22:34:04.454456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-09T22:34:04.454519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-09T22:34:04.454603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-09T22:34:04.454711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-09T22:34:04.454796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-09T22:34:04.454889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-09T22:34:04.454968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-09T22:34:04.455054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-09T22:34:04.455178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-09T22:34:04.455259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-09T22:34:04.455330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-09T22:34:04.455421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-09T22:34:04.455504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-09T22:34:04.455562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-09T22:34:04.455626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-09T22:34:04.455722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-09T22:34:04.455787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-09T22:34:04.455857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-09T22:34:04.455935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-09T22:34:04.455990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-09T22:34:04.456077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-09T22:34:04.456157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-09T22:34:04.456227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-09T22:34:04.456320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-09T22:34:04.456399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-09T22:34:04.456455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-09T22:34:04.456524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-09T22:34:04.456612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-09T22:34:04.456723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-09T22:34:04.456806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-09T22:34:04.456861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-09T22:34:04.456928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-09T22:34:04.457007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-09T22:34:04.457072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-09T22:34:04.457148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-09T22:34:04.457228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-09T22:34:04.457284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-09T22:34:04.457356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-09T22:34:04.457450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-09T22:34:04.457564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-09T22:34:04.457864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-09T22:34:04.457953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-09T22:34:04.458009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-09T22:34:04.458087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-09T22:34:04.458189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-09T22:34:04.458317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-09T22:34:04.458407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-09T22:34:04.458476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-09T22:34:04.458565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-09T22:34:04.458637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-09T22:34:04.458759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-09T22:34:04.458837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-09T22:34:04.458990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-09T22:34:04.459095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-09T22:34:04.459236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-09T22:34:04.459317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-09T22:34:04.459375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-09T22:34:04.459471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-09T22:34:04.459554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-09T22:34:04.459635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-09T22:34:04.459801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-09T22:34:04.459919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-09T22:34:04.459995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-09T22:34:04.460077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-09T22:34:04.460170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-09T22:34:04.460263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-09T22:34:04.460361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-09T22:34:04.460456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-09T22:34:04.460570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-09T22:34:04.460704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-09T22:34:04.460799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-09T22:34:04.460897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-09T22:34:04.461033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-09T22:34:04.461129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-09T22:34:04.461210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-09T22:34:04.461328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-09T22:34:04.461457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-09T22:34:04.461549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-09T22:34:04.461619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-09T22:34:04.461914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-09T22:34:04.462030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-09T22:34:04.462125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-09T22:34:04.462218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-09T22:34:04.462308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-09T22:34:04.462413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-09T22:34:04.462517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-09T22:34:04.462589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-09T22:34:04.462705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-09T22:34:04.462807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-09T22:34:04.462899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-09T22:34:04.462995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-09T22:34:04.463054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-09T22:34:04.463110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-09T22:34:04.463189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-09T22:34:04.463285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-09T22:34:04.463366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-09T22:34:04.463423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-09T22:34:04.463477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-09T22:34:04.463541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-09T22:34:04.463593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-09T22:34:04.463691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-09T22:34:04.463773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-09T22:34:04.463843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-09T22:34:04.463956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-09T22:34:04.464038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-09T22:34:04.464118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-09T22:34:04.464199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-09T22:34:04.464256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-09T22:34:04.464309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-09T22:34:04.464363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-09T22:34:04.464416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-09T22:34:04.464481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-09T22:34:04.464562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-09T22:34:04.464620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-09T22:34:04.464711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-09T22:34:04.464794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-09T22:34:04.464861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-09T22:34:04.464969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-09T22:34:04.465089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-09T22:34:04.465194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-09T22:34:04.465281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-09T22:34:04.465402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-09T22:34:04.465476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-09T22:34:04.465603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-09T22:34:04.465854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-09T22:34:04.465943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-09T22:34:04.466011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-09T22:34:04.466116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-09T22:34:04.466199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-09T22:34:04.466257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-09T22:34:04.466314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-09T22:34:04.466393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-09T22:34:04.466497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-09T22:34:04.466583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-09T22:34:04.466663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-09T22:34:04.466750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-09T22:34:04.466823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-09T22:34:04.466908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-09T22:34:04.467012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-09T22:34:04.467113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-09T22:34:04.467249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-09T22:34:04.467337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-09T22:34:04.467396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-09T22:34:04.467452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-09T22:34:04.467518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-09T22:34:04.467610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-09T22:34:04.467731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-09T22:34:04.467822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-09T22:34:04.467907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-09T22:34:04.467966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-09T22:34:04.468021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-09T22:34:04.468108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-09T22:34:04.468190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-09T22:34:04.468261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-09T22:34:04.468342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-09T22:34:04.468415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-09T22:34:04.468531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-09T22:34:04.468614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-09T22:34:04.468707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-09T22:34:04.468872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-09T22:34:04.468970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-09T22:34:04.469054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-09T22:34:04.469157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-09T22:34:04.469253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-09T22:34:04.469338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-09T22:34:04.469398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-09T22:34:04.469456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-09T22:34:04.469558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-09T22:34:04.469738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-09T22:34:04.469844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-09T22:34:04.469965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-09T22:34:04.470055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-09T22:34:04.470135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-09T22:34:04.470218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-09T22:34:04.470278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-09T22:34:04.470380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-09T22:34:04.470478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-09T22:34:04.470578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-09T22:34:04.470711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-09T22:34:04.470798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-09T22:34:04.470873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-09T22:34:04.470932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-09T22:34:04.471019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-09T22:34:04.471104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-09T22:34:04.471165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-09T22:34:04.471245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-09T22:34:04.471352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-09T22:34:04.471437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-09T22:34:04.471499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-09T22:34:04.471558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-09T22:34:04.471614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-09T22:34:04.471705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-09T22:34:04.471816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-09T22:34:04.471906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-09T22:34:04.472018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-09T22:34:04.472084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-09T22:34:04.472151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-09T22:34:04.472211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-09T22:34:04.472299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-09T22:34:04.472387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-09T22:34:04.472472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-09T22:34:04.472540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-09T22:34:04.472599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-09T22:34:04.472684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-09T22:34:04.472796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-09T22:34:04.472871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-09T22:34:04.472946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-09T22:34:04.473026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-09T22:34:04.473084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-09T22:34:04.473164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-09T22:34:04.473247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-09T22:34:04.473306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-09T22:34:04.473376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-09T22:34:04.473458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-09T22:34:04.473517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-09T22:34:04.473572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-09T22:34:04.473628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-09T22:34:04.473736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-09T22:34:04.473850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-09T22:34:04.474020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-09T22:34:04.474106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-09T22:34:04.474178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-09T22:34:04.474261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-09T22:34:04.474335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-09T22:34:04.474432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-09T22:34:04.474489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-09T22:34:04.474553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-09T22:34:04.474632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-09T22:34:04.474740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-09T22:34:04.474811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-09T22:34:04.474883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-09T22:34:04.474965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-09T22:34:04.475023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-09T22:34:04.475078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-09T22:34:04.475133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-09T22:34:04.475188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-09T22:34:04.475275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-09T22:34:04.475374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-09T22:34:04.475477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-09T22:34:04.475558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-09T22:34:04.475617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-09T22:34:04.475716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-09T22:34:04.475790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-09T22:34:04.475853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-09T22:34:04.475908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-09T22:34:04.475964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-09T22:34:04.476031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-09T22:34:04.476113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-09T22:34:04.476186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-09T22:34:04.476275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-09T22:34:04.476334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-09T22:34:04.476416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-09T22:34:04.476496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-09T22:34:04.476576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-09T22:34:04.476670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-09T22:34:04.476781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-09T22:34:04.476877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-09T22:34:04.476973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-09T22:34:04.477099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-09T22:34:04.477182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-09T22:34:04.477239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-09T22:34:04.477296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-09T22:34:04.477360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-09T22:34:04.477443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-09T22:34:04.477512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-09T22:34:04.477728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-09T22:34:04.477824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-09T22:34:04.477916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-09T22:34:04.478033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-09T22:34:04.478125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-09T22:34:04.478205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-09T22:34:04.478260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-09T22:34:04.478320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-09T22:34:04.478394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-09T22:34:04.478503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-09T22:34:04.478592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-09T22:34:04.478743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-09T22:34:04.478840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-09T22:34:04.478928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-09T22:34:04.479000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-09T22:34:04.479083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-09T22:34:04.479140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-09T22:34:04.479193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-09T22:34:04.479245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-09T22:34:04.479301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-09T22:34:04.479365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-09T22:34:04.479459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-09T22:34:04.479518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-09T22:34:04.479574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-09T22:34:04.479627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-09T22:34:04.479723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-09T22:34:04.479808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-09T22:34:04.479913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-09T22:34:04.479981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-09T22:34:04.480035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-09T22:34:04.480088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-09T22:34:04.480165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-09T22:34:04.480247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-09T22:34:04.480305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-09T22:34:04.480361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-09T22:34:04.480415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-09T22:34:04.480511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-09T22:34:04.480593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-09T22:34:04.480699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-09T22:34:04.480831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-09T22:34:04.480929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-09T22:34:04.481011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-09T22:34:04.481069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-09T22:34:04.481147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-09T22:34:04.481251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-09T22:34:04.481323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-09T22:34:04.481408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-09T22:34:04.481496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-09T22:34:04.481572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-09T22:34:04.481628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-09T22:34:04.481728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-09T22:34:04.481840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-09T22:34:04.481938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-09T22:34:04.482062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-09T22:34:04.482146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-09T22:34:04.482206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-09T22:34:04.482274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-09T22:34:04.482378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-09T22:34:04.482460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-09T22:34:04.482519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-09T22:34:04.482575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-09T22:34:04.482629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-09T22:34:04.482727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-09T22:34:04.482794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-09T22:34:04.482852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-09T22:34:04.482916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-09T22:34:04.482973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-09T22:34:04.483049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-09T22:34:04.483131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-09T22:34:04.483189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-09T22:34:04.483300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-09T22:34:04.483417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-09T22:34:04.483512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-09T22:34:04.483609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-09T22:34:04.483719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-09T22:34:04.483847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-09T22:34:04.483968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-09T22:34:04.484050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-09T22:34:04.484130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-09T22:34:04.484188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-09T22:34:04.484258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-09T22:34:04.484340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-09T22:34:04.484423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-09T22:34:04.484512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-09T22:34:04.484570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-09T22:34:04.484690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-09T22:34:04.484815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-09T22:34:04.484899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-09T22:34:04.484958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-09T22:34:04.485014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-09T22:34:04.485093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-09T22:34:04.485188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-09T22:34:04.485272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-09T22:34:04.485339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-09T22:34:04.485405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-09T22:34:04.485489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-09T22:34:04.485545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-09T22:34:04.485610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-09T22:34:04.485827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-09T22:34:04.485920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-09T22:34:04.485982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-09T22:34:04.486050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-09T22:34:04.486146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-09T22:34:04.486251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-09T22:34:04.486340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-09T22:34:04.486398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-09T22:34:04.486467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-09T22:34:04.486562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-09T22:34:04.486689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-09T22:34:04.486800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-09T22:34:04.486859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-09T22:34:04.486913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-09T22:34:04.486985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-09T22:34:04.487069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-09T22:34:04.487153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-09T22:34:04.487253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-09T22:34:04.487335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-09T22:34:04.487403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-09T22:34:04.487489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-09T22:34:04.487549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-09T22:34:04.487634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-09T22:34:04.487769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-09T22:34:04.487865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-09T22:34:04.487950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-09T22:34:04.488086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-09T22:34:04.488192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-09T22:34:04.488299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-09T22:34:04.488385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-09T22:34:04.488445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-09T22:34:04.488501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-09T22:34:04.488559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-09T22:34:04.488627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-09T22:34:04.488745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-09T22:34:04.488811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-09T22:34:04.488879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-09T22:34:04.488950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-09T22:34:04.489031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-09T22:34:04.489105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-09T22:34:04.489184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-09T22:34:04.489243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-09T22:34:04.489308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-09T22:34:04.489393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-09T22:34:04.489526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-09T22:34:04.489628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-09T22:34:04.489769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-09T22:34:04.489852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-09T22:34:04.489911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-09T22:34:04.489967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-09T22:34:04.490023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-09T22:34:04.490086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-09T22:34:04.490157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-09T22:34:04.490246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-09T22:34:04.490317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-09T22:34:04.490419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-09T22:34:04.490506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-09T22:34:04.490575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-09T22:34:04.490683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-09T22:34:04.490766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-09T22:34:04.490825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-09T22:34:04.490891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-09T22:34:04.490977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-09T22:34:04.491036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-09T22:34:04.491130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-09T22:34:04.491211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-09T22:34:04.491269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-09T22:34:04.491325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-09T22:34:04.491401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-09T22:34:04.491498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-09T22:34:04.491605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-09T22:34:04.491692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-09T22:34:04.491773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-09T22:34:04.491842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-09T22:34:04.491948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-09T22:34:04.492030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-09T22:34:04.492098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-09T22:34:04.492173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-09T22:34:04.492255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-09T22:34:04.492329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-09T22:34:04.492431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-09T22:34:04.492537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-09T22:34:04.492620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-09T22:34:04.492733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-09T22:34:04.492809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-09T22:34:04.492894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-09T22:34:04.492989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-09T22:34:04.493068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-09T22:34:04.493139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-09T22:34:04.493230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-09T22:34:04.493299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-09T22:34:04.493356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-09T22:34:04.493412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-09T22:34:04.493465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-09T22:34:04.493542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-09T22:34:04.493624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-09T22:34:04.493795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-09T22:34:04.493867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-09T22:34:04.493939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-09T22:34:04.494029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-09T22:34:04.494096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-09T22:34:04.494190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-09T22:34:04.494319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-09T22:34:04.494424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-09T22:34:04.494504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-09T22:34:04.494562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-09T22:34:04.494694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-09T22:34:04.494776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-09T22:34:04.494858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-09T22:34:04.494945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-09T22:34:04.495023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-09T22:34:04.495107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-09T22:34:04.495176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-09T22:34:04.495232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-09T22:34:04.495298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-09T22:34:04.495418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-09T22:34:04.495501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-09T22:34:04.495562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-09T22:34:04.495661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-09T22:34:04.495775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-10-09T22:34:04.495854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-09T22:34:04.495937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-09T22:34:04.495998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-09T22:34:04.496061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-09T22:34:04.496118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-09T22:34:04.496178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-09T22:34:04.496243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-09T22:34:04.496300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-09T22:34:04.496371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-09T22:34:04.496463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-09T22:34:04.496540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-09T22:34:04.496621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-09T22:34:04.496733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-09T22:34:04.496806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-09T22:34:04.496918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-09T22:34:04.497002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-09T22:34:04.497062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-09T22:34:04.497120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-09T22:34:04.497187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-09T22:34:04.497273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-09T22:34:04.497363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-09T22:34:04.497447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-09T22:34:04.497507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-09T22:34:04.497564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-09T22:34:04.497678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-09T22:34:04.497778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-09T22:34:04.497867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-09T22:34:04.497926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-09T22:34:04.497983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-09T22:34:04.498040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-09T22:34:04.498146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-09T22:34:04.498230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-09T22:34:04.498289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-09T22:34:04.498354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-09T22:34:04.498411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-09T22:34:04.498478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-09T22:34:04.498563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-09T22:34:04.498622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-09T22:34:04.498727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-09T22:34:04.498798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-09T22:34:04.498856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-09T22:34:04.498941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-09T22:34:04.499023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-09T22:34:04.499098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-09T22:34:04.499238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-09T22:34:04.499333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-09T22:34:04.499415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-09T22:34:04.499475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-09T22:34:04.499531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-09T22:34:04.499597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-09T22:34:04.499693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-09T22:34:04.499783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-09T22:34:04.499867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-09T22:34:04.499970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-09T22:34:04.500052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-09T22:34:04.500135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-09T22:34:04.500222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-09T22:34:04.500304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-09T22:34:04.500407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-09T22:34:04.500514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-09T22:34:04.500621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-09T22:34:04.500742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-09T22:34:04.500809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-09T22:34:04.500879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-09T22:34:04.500935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-09T22:34:04.500989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-09T22:34:04.501087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-09T22:34:04.501152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-09T22:34:04.501222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-09T22:34:04.501305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-09T22:34:04.501363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-09T22:34:04.501429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-09T22:34:04.501525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-09T22:34:04.501609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-09T22:34:04.501810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-09T22:34:04.501888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-09T22:34:04.501945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-09T22:34:04.501999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-09T22:34:04.502063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-09T22:34:04.502118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-09T22:34:04.502173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-09T22:34:04.502226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-09T22:34:04.502279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-09T22:34:04.502333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-09T22:34:04.502443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-09T22:34:04.502499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-09T22:34:04.502573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-09T22:34:04.502629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-09T22:34:04.502727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-09T22:34:04.502810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-09T22:34:04.502891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-09T22:34:04.502974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-09T22:34:04.503057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-09T22:34:04.503139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-09T22:34:04.503220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-09T22:34:04.503278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-09T22:34:04.503343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-09T22:34:04.503429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-09T22:34:04.503503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-09T22:34:04.503559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-09T22:34:04.503614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-09T22:34:04.503702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-09T22:34:04.503802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-09T22:34:04.503902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-09T22:34:04.503960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-09T22:34:04.504015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-09T22:34:04.504069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-09T22:34:04.504123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-09T22:34:04.504177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-09T22:34:04.504230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-09T22:34:04.504293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-09T22:34:04.504376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-09T22:34:04.504456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-09T22:34:04.504541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-09T22:34:04.504612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-09T22:34:04.504744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-09T22:34:04.504827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-09T22:34:04.504887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-09T22:34:04.504943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-09T22:34:04.505001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-09T22:34:04.505067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-09T22:34:04.505128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-09T22:34:04.505187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-09T22:34:04.505244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-09T22:34:04.505298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-09T22:34:04.505352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-09T22:34:04.505406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-09T22:34:04.505462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-09T22:34:04.505518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-09T22:34:04.505572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-09T22:34:04.505628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-09T22:34:04.505735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-09T22:34:04.505810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-09T22:34:04.505866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-10-09T22:34:04.505922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-09T22:34:04.506014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-09T22:34:04.506091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-09T22:34:04.506202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-09T22:34:04.506269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-09T22:34:04.506325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-09T22:34:04.506381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-09T22:34:04.506460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-09T22:34:04.506577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-09T22:34:04.506719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-09T22:34:04.506805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-09T22:34:04.506888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-09T22:34:04.506946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-09T22:34:04.507003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-09T22:34:04.507060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-09T22:34:04.507138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-09T22:34:04.507237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-09T22:34:04.507320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-09T22:34:04.507381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-09T22:34:04.507438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-09T22:34:04.507502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-09T22:34:04.507558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-09T22:34:04.507702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-09T22:34:04.507798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-09T22:34:04.507863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-09T22:34:04.507938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-09T22:34:04.508029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-10-09T22:34:04.508090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-09T22:34:04.508182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-09T22:34:04.508264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-09T22:34:04.508324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-09T22:34:04.508401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-09T22:34:04.508483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-09T22:34:04.508542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-09T22:34:04.508616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-09T22:34:04.508736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-09T22:34:04.508802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-09T22:34:04.508889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-09T22:34:04.508970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-09T22:34:04.509034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-09T22:34:04.509130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-09T22:34:04.509216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-09T22:34:04.509275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-09T22:34:04.509329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-09T22:34:04.509385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-09T22:34:04.509457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-09T22:34:04.509546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-09T22:34:04.509604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-09T22:34:04.509791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-09T22:34:04.509915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-09T22:34:04.509998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-09T22:34:04.510056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-09T22:34:04.510121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-09T22:34:04.510175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-09T22:34:04.510229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-09T22:34:04.510306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-09T22:34:04.510410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-09T22:34:04.510471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-09T22:34:04.510535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-09T22:34:04.510591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-09T22:34:04.510667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-09T22:34:04.510751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-09T22:34:04.510818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-09T22:34:04.510897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-09T22:34:04.510991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-09T22:34:04.511079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-09T22:34:04.511153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-09T22:34:04.511234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-09T22:34:04.511292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-09T22:34:04.511346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-09T22:34:04.511409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-09T22:34:04.511492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-09T22:34:04.511548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-09T22:34:04.511615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-09T22:34:04.511747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-09T22:34:04.511810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-09T22:34:04.511865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-09T22:34:04.511952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-09T22:34:04.512040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-09T22:34:04.512119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-09T22:34:04.512186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-09T22:34:04.512242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-09T22:34:04.512296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-09T22:34:04.512374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-09T22:34:04.512453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-09T22:34:04.512510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-09T22:34:04.512564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-09T22:34:04.512626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-09T22:34:04.512745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-09T22:34:04.512828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-09T22:34:04.512898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-09T22:34:04.512979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-09T22:34:04.513036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-09T22:34:04.513089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-09T22:34:04.513159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-09T22:34:04.513224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-09T22:34:04.513280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-09T22:34:04.513334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-09T22:34:04.513411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-09T22:34:04.513495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-09T22:34:04.513555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-09T22:34:04.513667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-09T22:34:04.513766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-09T22:34:04.513867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-09T22:34:04.513934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-09T22:34:04.514012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-09T22:34:04.514071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-09T22:34:04.514151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-09T22:34:04.514265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-09T22:34:04.514356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-09T22:34:04.514439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-09T22:34:04.514541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-09T22:34:04.514625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-09T22:34:04.514733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-09T22:34:04.514799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-09T22:34:04.514857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-09T22:34:04.514954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-09T22:34:04.515046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-09T22:34:04.515105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-09T22:34:04.515161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-09T22:34:04.515216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-09T22:34:04.515271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-09T22:34:04.515326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-09T22:34:04.515383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-09T22:34:04.515446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-09T22:34:04.515533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-09T22:34:04.515616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-09T22:34:04.515739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-09T22:34:04.515828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-09T22:34:04.515914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-09T22:34:04.515984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-09T22:34:04.516084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-09T22:34:04.516217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-09T22:34:04.516315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-09T22:34:04.516384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-09T22:34:04.516455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-09T22:34:04.516522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-09T22:34:04.516593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-09T22:34:04.516700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-09T22:34:04.516825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-10-09T22:34:04.516927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-09T22:34:04.517003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-09T22:34:04.517129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-09T22:34:04.517270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-09T22:34:04.517375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-09T22:34:04.517490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-09T22:34:04.517569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-09T22:34:04.517825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-09T22:34:04.517910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-09T22:34:04.517983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-09T22:34:04.518064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-09T22:34:04.518121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-09T22:34:04.518221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-09T22:34:04.518316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-09T22:34:04.518431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-09T22:34:04.518505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-09T22:34:04.518563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-09T22:34:04.518628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-09T22:34:04.518732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-09T22:34:04.518887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-09T22:34:04.518992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-09T22:34:04.519073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-09T22:34:04.519140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-09T22:34:04.519197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-09T22:34:04.519251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-09T22:34:04.519319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-09T22:34:04.519400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-09T22:34:04.519493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-09T22:34:04.519574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-09T22:34:04.519630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-09T22:34:04.519746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-09T22:34:04.519833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-09T22:34:04.519923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-09T22:34:04.520023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-09T22:34:04.520150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-09T22:34:04.520256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-09T22:34:04.520363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-09T22:34:04.520476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-09T22:34:04.520582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-09T22:34:04.520756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-09T22:34:04.520868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-09T22:34:04.521007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-09T22:34:04.521113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-09T22:34:04.521219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-09T22:34:04.521323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-09T22:34:04.521435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-09T22:34:04.521559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-09T22:34:04.521708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-09T22:34:04.521818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-09T22:34:04.521934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-10-09T22:34:04.522042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-09T22:34:04.522171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-09T22:34:04.522310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-09T22:34:04.522418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-09T22:34:04.522528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-09T22:34:04.522639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-09T22:34:04.522769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-09T22:34:04.522884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-09T22:34:04.522993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-09T22:34:04.523099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-09T22:34:04.523210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-09T22:34:04.523335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-09T22:34:04.523452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-09T22:34:04.523602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-09T22:34:04.523742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-09T22:34:04.523907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-09T22:34:04.524014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-09T22:34:04.524120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-09T22:34:04.524224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-09T22:34:04.524329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-09T22:34:04.524414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-09T22:34:04.524553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-09T22:34:04.524684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-09T22:34:04.524769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-09T22:34:04.524852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-09T22:34:04.524910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-09T22:34:04.525029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-09T22:34:04.525126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-09T22:34:04.525208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-09T22:34:04.525277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-09T22:34:04.525334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-09T22:34:04.525390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-09T22:34:04.525445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-09T22:34:04.525501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-09T22:34:04.525581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-09T22:34:04.525793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-09T22:34:04.525879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-09T22:34:04.525953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-09T22:34:04.526037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-09T22:34:04.526094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-09T22:34:04.526209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-09T22:34:04.526300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-09T22:34:04.526360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-09T22:34:04.526415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-09T22:34:04.526485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-09T22:34:04.526564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-09T22:34:04.526620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-09T22:34:04.526717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-09T22:34:04.526803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-09T22:34:04.526902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-09T22:34:04.526982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-09T22:34:04.527039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-09T22:34:04.527121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-09T22:34:04.527196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-09T22:34:04.527269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-09T22:34:04.527350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-09T22:34:04.527436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-09T22:34:04.527520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-09T22:34:04.527578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-09T22:34:04.527703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-09T22:34:04.527779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-09T22:34:04.527872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-09T22:34:04.527949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-09T22:34:04.528017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-09T22:34:04.528111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-09T22:34:04.528196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-09T22:34:04.528256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-09T22:34:04.528312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-09T22:34:04.528367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-09T22:34:04.528421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-09T22:34:04.528475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-09T22:34:04.528528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-09T22:34:04.528582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-09T22:34:04.528636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-09T22:34:04.528766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-09T22:34:04.528862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-09T22:34:04.528958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-09T22:34:04.529039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-09T22:34:04.529128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-09T22:34:04.529213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-09T22:34:04.529282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-09T22:34:04.529367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-09T22:34:04.529463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-09T22:34:04.529542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-09T22:34:04.529600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-09T22:34:04.529687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-09T22:34:04.529829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-09T22:34:04.529964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-09T22:34:04.530045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-09T22:34:04.530102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-09T22:34:04.530156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-09T22:34:04.530238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-09T22:34:04.530370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-09T22:34:04.530455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-09T22:34:04.530528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-09T22:34:04.530595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-09T22:34:04.530730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-09T22:34:04.530861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-09T22:34:04.530942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-09T22:34:04.531056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-09T22:34:04.531219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-09T22:34:04.531305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-09T22:34:04.531374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-09T22:34:04.531434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-09T22:34:04.531500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-09T22:34:04.531568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-09T22:34:04.531671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-09T22:34:04.531757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-09T22:34:04.531819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-09T22:34:04.531877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-09T22:34:04.531957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-09T22:34:04.532044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-09T22:34:04.532105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-09T22:34:04.532163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-09T22:34:04.532258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-09T22:34:04.532343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-09T22:34:04.532423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-09T22:34:04.532523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-09T22:34:04.532617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-10-09T22:34:04.532736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-09T22:34:04.532803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-09T22:34:04.532867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-09T22:34:04.532923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-09T22:34:04.532978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-09T22:34:04.533033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-09T22:34:04.533096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-09T22:34:04.533181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-09T22:34:04.533265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-09T22:34:04.533334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-09T22:34:04.533391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-09T22:34:04.533454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-09T22:34:04.533511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-09T22:34:04.533590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-09T22:34:04.533805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-09T22:34:04.533918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-09T22:34:04.534001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-09T22:34:04.534090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-09T22:34:04.534183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-09T22:34:04.534269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-09T22:34:04.534329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-09T22:34:04.534384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-09T22:34:04.534440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-09T22:34:04.534516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-09T22:34:04.534623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-09T22:34:04.534738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-09T22:34:04.534804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-09T22:34:04.534871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-09T22:34:04.534956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-09T22:34:04.535056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-09T22:34:04.535154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-09T22:34:04.535212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-09T22:34:04.535269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-09T22:34:04.535324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-09T22:34:04.535402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-09T22:34:04.535473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-09T22:34:04.535564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-09T22:34:04.535633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-09T22:34:04.535750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-09T22:34:04.535882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-09T22:34:04.535974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-09T22:34:04.536049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-09T22:34:04.536143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-09T22:34:04.536225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-09T22:34:04.536284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-09T22:34:04.536363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-09T22:34:04.536445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-09T22:34:04.536512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-09T22:34:04.536569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-09T22:34:04.536705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-09T22:34:04.536780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-09T22:34:04.536847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-09T22:34:04.536903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-09T22:34:04.536985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-09T22:34:04.537075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-09T22:34:04.537156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-09T22:34:04.537237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-09T22:34:04.537295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-09T22:34:04.537350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-10-09T22:34:04.537405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-09T22:34:04.537458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-09T22:34:04.537513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-09T22:34:04.537567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-09T22:34:04.537681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-09T22:34:04.537768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-09T22:34:04.537838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-09T22:34:04.537918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-09T22:34:04.537998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-09T22:34:04.538061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-09T22:34:04.538117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-09T22:34:04.538170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-09T22:34:04.538223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-09T22:34:04.538304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-09T22:34:04.538358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-09T22:34:04.538432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-09T22:34:04.538512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-09T22:34:04.538569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-09T22:34:04.538625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-09T22:34:04.538724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-09T22:34:04.538821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-09T22:34:04.538927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-09T22:34:04.539011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-09T22:34:04.539071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-09T22:34:04.539141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-09T22:34:04.539222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-09T22:34:04.539282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-09T22:34:04.539337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-09T22:34:04.539393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-09T22:34:04.539469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-09T22:34:04.539527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-09T22:34:04.539591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-09T22:34:04.539670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-09T22:34:04.539756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-09T22:34:04.539818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-09T22:34:04.539897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-09T22:34:04.539976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-09T22:34:04.540033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-09T22:34:04.540108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-09T22:34:04.540190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-09T22:34:04.540248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-09T22:34:04.540304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-09T22:34:04.540360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-09T22:34:04.540413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-09T22:34:04.540468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-09T22:34:04.540523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-09T22:34:04.540576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-09T22:34:04.540676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-09T22:34:04.540763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-09T22:34:04.540823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-09T22:34:04.540879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-09T22:34:04.540932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-09T22:34:04.540988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-09T22:34:04.541048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-09T22:34:04.541115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-09T22:34:04.541172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-09T22:34:04.541227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-09T22:34:04.541280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-09T22:34:04.541344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-09T22:34:04.541426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-09T22:34:04.541484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-09T22:34:04.541605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-09T22:34:04.541781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-09T22:34:04.541858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-09T22:34:04.541940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-09T22:34:04.542022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-09T22:34:04.542079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-09T22:34:04.542135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-09T22:34:04.542214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-09T22:34:04.542297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-09T22:34:04.542355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-09T22:34:04.542410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-09T22:34:04.542490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-09T22:34:04.542571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-09T22:34:04.542629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-09T22:34:04.542727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-09T22:34:04.542796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-09T22:34:04.542856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-09T22:34:04.542940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-09T22:34:04.543021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-09T22:34:04.543102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-09T22:34:04.543158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-09T22:34:04.543212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-09T22:34:04.543266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-09T22:34:04.543352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-09T22:34:04.543437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-09T22:34:04.543493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-09T22:34:04.543573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-09T22:34:04.543678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-09T22:34:04.543773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-09T22:34:04.543881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-09T22:34:04.543995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-09T22:34:04.544084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-09T22:34:04.544165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-09T22:34:04.544224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-09T22:34:04.544278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-09T22:34:04.544332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-09T22:34:04.544384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-09T22:34:04.544449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-09T22:34:04.544505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-09T22:34:04.544559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-09T22:34:04.544613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-09T22:34:04.544744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-09T22:34:04.544830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-09T22:34:04.544914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-09T22:34:04.544993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-09T22:34:04.545062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-09T22:34:04.545145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-09T22:34:04.545227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-09T22:34:04.545336] [INFO ] [LOCAL ] Deleted 1602 derivative data files. [2025-10-09T22:34:04.545371] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-09T22:34:04.547128] [INFO ] [LOCAL ] Found 1690 symbols with primary data. [2025-10-09T22:34:04.547382] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1690 symbols [2025-10-09T22:34:04.549223] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:04.549495] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:04.550381] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:04.631370] [DEBUG] [LOCAL ] AAP: Loaded 52268 existing records from primary storage. [2025-10-09T22:34:04.631527] [INFO ] [MAIN ] AAP: Loaded 52268 primary data records. [2025-10-09T22:34:04.776585] [DEBUG] [LOCAL ] A: Loaded 51104 existing records from primary storage. [2025-10-09T22:34:04.798674] [DEBUG] [LOCAL ] AA: Loaded 54010 existing records from primary storage. [2025-10-09T22:34:04.818113] [INFO ] [MAIN ] A: Loaded 51104 primary data records. [2025-10-09T22:34:04.827967] [INFO ] [MAIN ] AA: Loaded 54010 primary data records. [2025-10-09T22:34:05.694557] [DEBUG] [MAIN ] AAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:05.696014] [INFO ] [MAIN ] AAP: Generated 1807 derivative records from 52268 primary records. [2025-10-09T22:34:05.696326] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-09T22:34:05.719069] [DEBUG] [LOCAL ] AAP: Derivative data saved (1807 records). [2025-10-09T22:34:05.720593] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-09T22:34:05.723440] [INFO ] [MAIN ] Derivative Progress: 1/1690 symbols completed. AAP took 1.2s. Estimated remaining: 33m 7s. Rate: 51.0 symbols/min [2025-10-09T22:34:05.723771] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:05.749580] [DEBUG] [MAIN ] AA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:05.750005] [DEBUG] [MAIN ] A: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:05.751364] [INFO ] [MAIN ] A: Generated 1807 derivative records from 51104 primary records. [2025-10-09T22:34:05.751427] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-09T22:34:05.750752] [INFO ] [MAIN ] AA: Generated 1807 derivative records from 54010 primary records. [2025-10-09T22:34:05.752698] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-09T22:34:05.792675] [DEBUG] [LOCAL ] AA: Derivative data saved (1807 records). [2025-10-09T22:34:05.793452] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-09T22:34:05.797347] [INFO ] [MAIN ] Derivative Progress: 2/1690 symbols completed. AA took 1.2s. Estimated remaining: 17m 35s. Rate: 96.0 symbols/min [2025-10-09T22:34:05.798897] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:05.802315] [DEBUG] [LOCAL ] A: Derivative data saved (1807 records). [2025-10-09T22:34:05.811406] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-09T22:34:05.814226] [INFO ] [MAIN ] Derivative Progress: 3/1690 symbols completed. A took 1.3s. Estimated remaining: 11m 52s. Rate: 142.1 symbols/min [2025-10-09T22:34:05.814544] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:05.815698] [DEBUG] [LOCAL ] AAT: Loaded 30487 existing records from primary storage. [2025-10-09T22:34:05.815889] [INFO ] [MAIN ] AAT: Loaded 30487 primary data records. [2025-10-09T22:34:06.023463] [DEBUG] [LOCAL ] AB: Loaded 26515 existing records from primary storage. [2025-10-09T22:34:06.139302] [INFO ] [MAIN ] AB: Loaded 26515 primary data records. [2025-10-09T22:34:06.172035] [DEBUG] [LOCAL ] ABCB: Loaded 30682 existing records from primary storage. [2025-10-09T22:34:06.202402] [INFO ] [MAIN ] ABCB: Loaded 30682 primary data records. [2025-10-09T22:34:06.869784] [DEBUG] [MAIN ] AAT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:34:06.871801] [INFO ] [MAIN ] AAT: Generated 1806 derivative records from 30487 primary records. [2025-10-09T22:34:06.872032] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-09T22:34:06.890367] [DEBUG] [LOCAL ] AAT: Derivative data saved (1806 records). [2025-10-09T22:34:06.890991] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-09T22:34:06.893083] [INFO ] [MAIN ] Derivative Progress: 4/1690 symbols completed. AAT took 1.2s. Estimated remaining: 16m 29s. Rate: 102.3 symbols/min [2025-10-09T22:34:06.893586] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:06.914155] [DEBUG] [MAIN ] AB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:06.915028] [INFO ] [MAIN ] AB: Generated 1807 derivative records from 26515 primary records. [2025-10-09T22:34:06.915210] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-09T22:34:06.944551] [DEBUG] [MAIN ] ABCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:06.945806] [INFO ] [MAIN ] ABCB: Generated 1807 derivative records from 30682 primary records. [2025-10-09T22:34:06.946583] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-09T22:34:06.949034] [DEBUG] [LOCAL ] AB: Derivative data saved (1807 records). [2025-10-09T22:34:06.949272] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-09T22:34:06.958557] [INFO ] [MAIN ] Derivative Progress: 5/1690 symbols completed. AB took 1.2s. Estimated remaining: 13m 33s. Rate: 124.4 symbols/min [2025-10-09T22:34:06.958857] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:06.967467] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1807 records). [2025-10-09T22:34:06.980690] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-09T22:34:06.983466] [INFO ] [MAIN ] Derivative Progress: 6/1690 symbols completed. ABCB took 1.2s. Estimated remaining: 11m 24s. Rate: 147.8 symbols/min [2025-10-09T22:34:06.983827] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:07.012730] [DEBUG] [LOCAL ] ABG: Loaded 18588 existing records from primary storage. [2025-10-09T22:34:07.012990] [INFO ] [MAIN ] ABG: Loaded 18588 primary data records. [2025-10-09T22:34:07.014094] [DEBUG] [LOCAL ] ABEV: Loaded 53667 existing records from primary storage. [2025-10-09T22:34:07.014251] [INFO ] [MAIN ] ABEV: Loaded 53667 primary data records. [2025-10-09T22:34:07.263883] [DEBUG] [LOCAL ] ABM: Loaded 32168 existing records from primary storage. [2025-10-09T22:34:07.314575] [INFO ] [MAIN ] ABM: Loaded 32168 primary data records. [2025-10-09T22:34:08.012395] [DEBUG] [MAIN ] ABG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:08.025504] [INFO ] [MAIN ] ABG: Generated 1807 derivative records from 18588 primary records. [2025-10-09T22:34:08.026324] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-09T22:34:08.026247] [DEBUG] [MAIN ] ABEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:08.028159] [INFO ] [MAIN ] ABEV: Generated 1807 derivative records from 53667 primary records. [2025-10-09T22:34:08.028476] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-09T22:34:08.062836] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1807 records). [2025-10-09T22:34:08.064670] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-09T22:34:08.066943] [INFO ] [MAIN ] Derivative Progress: 7/1690 symbols completed. ABEV took 1.2s. Estimated remaining: 14m 6s. Rate: 119.3 symbols/min [2025-10-09T22:34:08.067915] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:08.067779] [DEBUG] [LOCAL ] ABG: Derivative data saved (1807 records). [2025-10-09T22:34:08.068638] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-09T22:34:08.070802] [INFO ] [MAIN ] Derivative Progress: 8/1690 symbols completed. ABG took 1.1s. Estimated remaining: 12m 21s. Rate: 136.2 symbols/min [2025-10-09T22:34:08.071147] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:08.085293] [DEBUG] [MAIN ] ABM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:08.086294] [INFO ] [MAIN ] ABM: Generated 1807 derivative records from 32168 primary records. [2025-10-09T22:34:08.086461] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-09T22:34:08.105701] [DEBUG] [LOCAL ] ABM: Derivative data saved (1807 records). [2025-10-09T22:34:08.105889] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-09T22:34:08.108709] [INFO ] [MAIN ] Derivative Progress: 9/1690 symbols completed. ABM took 1.1s. Estimated remaining: 11m 5s. Rate: 151.6 symbols/min [2025-10-09T22:34:08.109082] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:08.154178] [DEBUG] [LOCAL ] ABR: Loaded 52338 existing records from primary storage. [2025-10-09T22:34:08.168472] [INFO ] [MAIN ] ABR: Loaded 52338 primary data records. [2025-10-09T22:34:08.287783] [DEBUG] [LOCAL ] ACA: Loaded 23314 existing records from primary storage. [2025-10-09T22:34:08.329108] [INFO ] [MAIN ] ACA: Loaded 23314 primary data records. [2025-10-09T22:34:08.331784] [DEBUG] [LOCAL ] ABT: Loaded 54012 existing records from primary storage. [2025-10-09T22:34:08.384396] [INFO ] [MAIN ] ABT: Loaded 54012 primary data records. [2025-10-09T22:34:09.217596] [DEBUG] [MAIN ] ABR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:09.218538] [INFO ] [MAIN ] ABR: Generated 1807 derivative records from 52338 primary records. [2025-10-09T22:34:09.219230] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-09T22:34:09.243426] [DEBUG] [LOCAL ] ABR: Derivative data saved (1807 records). [2025-10-09T22:34:09.256022] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-09T22:34:09.270735] [INFO ] [MAIN ] Derivative Progress: 10/1690 symbols completed. ABR took 1.2s. Estimated remaining: 13m 14s. Rate: 127.0 symbols/min [2025-10-09T22:34:09.271904] [DEBUG] [MAIN ] ACA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:09.271143] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:09.272969] [INFO ] [MAIN ] ACA: Generated 1807 derivative records from 23314 primary records. [2025-10-09T22:34:09.271500] [DEBUG] [MAIN ] ABT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:09.274051] [INFO ] [MAIN ] ABT: Generated 1807 derivative records from 54012 primary records. [2025-10-09T22:34:09.273241] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-09T22:34:09.274688] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-09T22:34:09.306476] [DEBUG] [LOCAL ] ACA: Derivative data saved (1807 records). [2025-10-09T22:34:09.306669] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-09T22:34:09.309099] [INFO ] [MAIN ] Derivative Progress: 11/1690 symbols completed. ACA took 1.2s. Estimated remaining: 12m 7s. Rate: 138.6 symbols/min [2025-10-09T22:34:09.318626] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:09.318452] [DEBUG] [LOCAL ] ABT: Derivative data saved (1807 records). [2025-10-09T22:34:09.318959] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-09T22:34:09.322050] [INFO ] [MAIN ] Derivative Progress: 12/1690 symbols completed. ABT took 1.3s. Estimated remaining: 11m 8s. Rate: 150.8 symbols/min [2025-10-09T22:34:09.322379] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:09.334061] [DEBUG] [LOCAL ] ACEL: Loaded 26864 existing records from primary storage. [2025-10-09T22:34:09.334268] [INFO ] [MAIN ] ACEL: Loaded 26864 primary data records. [2025-10-09T22:34:09.708258] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-09T22:34:09.709594] [INFO ] [MAIN ] ACHR: Loaded 54208 primary data records. [2025-10-09T22:34:09.711088] [DEBUG] [LOCAL ] ACI: Loaded 53644 existing records from primary storage. [2025-10-09T22:34:09.758919] [INFO ] [MAIN ] ACI: Loaded 53644 primary data records. [2025-10-09T22:34:10.443125] [DEBUG] [MAIN ] ACEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:10.444827] [INFO ] [MAIN ] ACEL: Generated 1807 derivative records from 26864 primary records. [2025-10-09T22:34:10.445121] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-09T22:34:10.466619] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1807 records). [2025-10-09T22:34:10.467508] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-09T22:34:10.470003] [INFO ] [MAIN ] Derivative Progress: 13/1690 symbols completed. ACEL took 1.2s. Estimated remaining: 12m 44s. Rate: 131.7 symbols/min [2025-10-09T22:34:10.490275] [DEBUG] [MAIN ] ACHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:10.491193] [INFO ] [MAIN ] ACHR: Generated 1807 derivative records from 54208 primary records. [2025-10-09T22:34:10.491494] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-09T22:34:10.522691] [DEBUG] [MAIN ] ACI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:10.525048] [INFO ] [MAIN ] ACI: Generated 1807 derivative records from 53644 primary records. [2025-10-09T22:34:10.526058] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-09T22:34:10.526705] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1807 records). [2025-10-09T22:34:10.527220] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-09T22:34:10.529138] [INFO ] [MAIN ] Derivative Progress: 14/1690 symbols completed. ACHR took 1.2s. Estimated remaining: 11m 56s. Rate: 140.4 symbols/min [2025-10-09T22:34:10.545962] [DEBUG] [LOCAL ] ACI: Derivative data saved (1807 records). [2025-10-09T22:34:10.546075] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-09T22:34:10.549542] [INFO ] [MAIN ] Derivative Progress: 15/1690 symbols completed. ACI took 1.2s. Estimated remaining: 11m 10s. Rate: 149.9 symbols/min [2025-10-09T22:34:10.550254] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:10.550447] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:10.550143] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:10.560925] [DEBUG] [LOCAL ] ACR: Loaded 5643 existing records from primary storage. [2025-10-09T22:34:10.561379] [INFO ] [MAIN ] ACR: Loaded 5643 primary data records. [2025-10-09T22:34:10.933911] [DEBUG] [LOCAL ] ACM: Loaded 43290 existing records from primary storage. [2025-10-09T22:34:10.934255] [INFO ] [MAIN ] ACM: Loaded 43290 primary data records. [2025-10-09T22:34:10.940886] [DEBUG] [LOCAL ] ACN: Loaded 53818 existing records from primary storage. [2025-10-09T22:34:10.949242] [INFO ] [MAIN ] ACN: Loaded 53818 primary data records. [2025-10-09T22:34:11.599635] [DEBUG] [MAIN ] ACR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:11.601497] [INFO ] [MAIN ] ACR: Generated 1807 derivative records from 5643 primary records. [2025-10-09T22:34:11.601600] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-09T22:34:11.620357] [DEBUG] [LOCAL ] ACR: Derivative data saved (1807 records). [2025-10-09T22:34:11.622792] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-09T22:34:11.625556] [INFO ] [MAIN ] Derivative Progress: 16/1690 symbols completed. ACR took 1.1s. Estimated remaining: 12m 21s. Rate: 135.6 symbols/min [2025-10-09T22:34:11.625998] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:11.648982] [DEBUG] [MAIN ] ACM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:11.650065] [INFO ] [MAIN ] ACM: Generated 1807 derivative records from 43290 primary records. [2025-10-09T22:34:11.658232] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-09T22:34:11.664401] [DEBUG] [MAIN ] ACN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:11.674107] [INFO ] [MAIN ] ACN: Generated 1807 derivative records from 53818 primary records. [2025-10-09T22:34:11.674286] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-09T22:34:11.690257] [DEBUG] [LOCAL ] ACM: Derivative data saved (1807 records). [2025-10-09T22:34:11.709012] [DEBUG] [LOCAL ] ACRE: Loaded 33893 existing records from primary storage. [2025-10-09T22:34:11.708270] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-09T22:34:11.711310] [INFO ] [MAIN ] ACRE: Loaded 33893 primary data records. [2025-10-09T22:34:11.711180] [INFO ] [MAIN ] Derivative Progress: 17/1690 symbols completed. ACM took 1.2s. Estimated remaining: 11m 45s. Rate: 142.4 symbols/min [2025-10-09T22:34:11.741018] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:11.753032] [DEBUG] [LOCAL ] ACN: Derivative data saved (1807 records). [2025-10-09T22:34:11.781075] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-09T22:34:11.791710] [INFO ] [MAIN ] Derivative Progress: 18/1690 symbols completed. ACN took 1.2s. Estimated remaining: 11m 13s. Rate: 149.1 symbols/min [2025-10-09T22:34:11.804564] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:11.852358] [DEBUG] [LOCAL ] ACV: Loaded 7732 existing records from primary storage. [2025-10-09T22:34:11.868392] [INFO ] [MAIN ] ACV: Loaded 7732 primary data records. [2025-10-09T22:34:12.265026] [DEBUG] [LOCAL ] ACVA: Loaded 49581 existing records from primary storage. [2025-10-09T22:34:12.385232] [INFO ] [MAIN ] ACVA: Loaded 49581 primary data records. [2025-10-09T22:34:12.767468] [DEBUG] [MAIN ] ACRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:12.768303] [INFO ] [MAIN ] ACRE: Generated 1807 derivative records from 33893 primary records. [2025-10-09T22:34:12.768435] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-09T22:34:12.803837] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1807 records). [2025-10-09T22:34:12.803979] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-09T22:34:12.805940] [INFO ] [MAIN ] Derivative Progress: 19/1690 symbols completed. ACRE took 1.2s. Estimated remaining: 12m 6s. Rate: 138.0 symbols/min [2025-10-09T22:34:12.806840] [DEBUG] [MAIN ] ACV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:12.807732] [INFO ] [MAIN ] ACV: Generated 1807 derivative records from 7732 primary records. [2025-10-09T22:34:12.806294] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:12.807961] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-09T22:34:12.827764] [DEBUG] [LOCAL ] ACV: Derivative data saved (1807 records). [2025-10-09T22:34:12.827886] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-09T22:34:12.830002] [INFO ] [MAIN ] Derivative Progress: 20/1690 symbols completed. ACV took 1.1s. Estimated remaining: 11m 32s. Rate: 144.9 symbols/min [2025-10-09T22:34:12.832533] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:12.847690] [DEBUG] [MAIN ] ACVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:12.848524] [INFO ] [MAIN ] ACVA: Generated 1807 derivative records from 49581 primary records. [2025-10-09T22:34:12.848728] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-09T22:34:12.875786] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1807 records). [2025-10-09T22:34:12.876117] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-09T22:34:12.878802] [INFO ] [MAIN ] Derivative Progress: 21/1690 symbols completed. ACVA took 1.1s. Estimated remaining: 11m 2s. Rate: 151.2 symbols/min [2025-10-09T22:34:12.879072] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:12.903406] [DEBUG] [LOCAL ] ADC: Loaded 46495 existing records from primary storage. [2025-10-09T22:34:12.903702] [INFO ] [MAIN ] ADC: Loaded 46495 primary data records. [2025-10-09T22:34:13.018049] [DEBUG] [LOCAL ] ADCT: Loaded 35427 existing records from primary storage. [2025-10-09T22:34:13.018371] [INFO ] [MAIN ] ADCT: Loaded 35427 primary data records. [2025-10-09T22:34:13.558276] [DEBUG] [LOCAL ] ADM: Loaded 53778 existing records from primary storage. [2025-10-09T22:34:13.568804] [INFO ] [MAIN ] ADM: Loaded 53778 primary data records. [2025-10-09T22:34:13.911053] [DEBUG] [MAIN ] ADC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:13.912704] [INFO ] [MAIN ] ADC: Generated 1807 derivative records from 46495 primary records. [2025-10-09T22:34:13.913091] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-09T22:34:13.935420] [DEBUG] [LOCAL ] ADC: Derivative data saved (1807 records). [2025-10-09T22:34:13.948949] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-09T22:34:13.951718] [INFO ] [MAIN ] Derivative Progress: 22/1690 symbols completed. ADC took 1.1s. Estimated remaining: 11m 53s. Rate: 140.4 symbols/min [2025-10-09T22:34:13.952029] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:13.953205] [DEBUG] [MAIN ] ADCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:13.954205] [INFO ] [MAIN ] ADCT: Generated 1807 derivative records from 35427 primary records. [2025-10-09T22:34:13.954383] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-09T22:34:13.987797] [DEBUG] [MAIN ] ADM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:13.987457] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1807 records). [2025-10-09T22:34:13.988713] [INFO ] [MAIN ] ADM: Generated 1807 derivative records from 53778 primary records. [2025-10-09T22:34:13.987934] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-09T22:34:13.990889] [INFO ] [MAIN ] Derivative Progress: 23/1690 symbols completed. ADCT took 1.2s. Estimated remaining: 11m 24s. Rate: 146.1 symbols/min [2025-10-09T22:34:13.991124] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-09T22:34:13.991213] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:14.009152] [DEBUG] [LOCAL ] ADM: Derivative data saved (1807 records). [2025-10-09T22:34:14.019756] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-09T22:34:14.022320] [INFO ] [MAIN ] Derivative Progress: 24/1690 symbols completed. ADM took 1.1s. Estimated remaining: 10m 58s. Rate: 152.0 symbols/min [2025-10-09T22:34:14.022736] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:14.045454] [DEBUG] [LOCAL ] ADNT: Loaded 47491 existing records from primary storage. [2025-10-09T22:34:14.052149] [INFO ] [MAIN ] ADNT: Loaded 47491 primary data records. [2025-10-09T22:34:14.178329] [DEBUG] [LOCAL ] ADX: Loaded 27755 existing records from primary storage. [2025-10-09T22:34:14.181941] [INFO ] [MAIN ] ADX: Loaded 27755 primary data records. [2025-10-09T22:34:14.388018] [DEBUG] [LOCAL ] ADT: Loaded 53834 existing records from primary storage. [2025-10-09T22:34:14.501193] [INFO ] [MAIN ] ADT: Loaded 53834 primary data records. [2025-10-09T22:34:15.084175] [DEBUG] [MAIN ] ADNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:15.086421] [INFO ] [MAIN ] ADNT: Generated 1807 derivative records from 47491 primary records. [2025-10-09T22:34:15.087185] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-09T22:34:15.109773] [DEBUG] [MAIN ] ADX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:15.116562] [INFO ] [MAIN ] ADX: Generated 1807 derivative records from 27755 primary records. [2025-10-09T22:34:15.118161] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-09T22:34:15.119352] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1807 records). [2025-10-09T22:34:15.119573] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-09T22:34:15.121787] [INFO ] [MAIN ] Derivative Progress: 25/1690 symbols completed. ADNT took 1.2s. Estimated remaining: 11m 44s. Rate: 141.8 symbols/min [2025-10-09T22:34:15.122726] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:15.142190] [DEBUG] [LOCAL ] ADX: Derivative data saved (1807 records). [2025-10-09T22:34:15.145514] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-09T22:34:15.149937] [INFO ] [MAIN ] Derivative Progress: 26/1690 symbols completed. ADX took 1.1s. Estimated remaining: 11m 19s. Rate: 147.1 symbols/min [2025-10-09T22:34:15.150350] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:15.167515] [DEBUG] [LOCAL ] AEFC: Loaded 8470 existing records from primary storage. [2025-10-09T22:34:15.175364] [INFO ] [MAIN ] AEFC: Loaded 8470 primary data records. [2025-10-09T22:34:15.175303] [DEBUG] [MAIN ] ADT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:15.176138] [INFO ] [MAIN ] ADT: Generated 1807 derivative records from 53834 primary records. [2025-10-09T22:34:15.206813] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-09T22:34:15.273809] [DEBUG] [LOCAL ] ADT: Derivative data saved (1807 records). [2025-10-09T22:34:15.295339] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-09T22:34:15.297792] [INFO ] [MAIN ] Derivative Progress: 27/1690 symbols completed. ADT took 1.3s. Estimated remaining: 11m 2s. Rate: 150.7 symbols/min [2025-10-09T22:34:15.314085] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:15.521911] [DEBUG] [LOCAL ] AEG: Loaded 49927 existing records from primary storage. [2025-10-09T22:34:15.522599] [INFO ] [MAIN ] AEG: Loaded 49927 primary data records. [2025-10-09T22:34:15.734580] [DEBUG] [LOCAL ] AEM: Loaded 53856 existing records from primary storage. [2025-10-09T22:34:15.735637] [INFO ] [MAIN ] AEM: Loaded 53856 primary data records. [2025-10-09T22:34:15.839345] [DEBUG] [MAIN ] AEFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:15.996151] [INFO ] [MAIN ] AEFC: Generated 1807 derivative records from 8470 primary records. [2025-10-09T22:34:16.019334] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-09T22:34:16.261128] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1807 records). [2025-10-09T22:34:16.261274] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-09T22:34:16.263446] [INFO ] [MAIN ] Derivative Progress: 28/1690 symbols completed. AEFC took 1.1s. Estimated remaining: 11m 35s. Rate: 143.4 symbols/min [2025-10-09T22:34:16.283236] [DEBUG] [MAIN ] AEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:16.283976] [INFO ] [MAIN ] AEG: Generated 1807 derivative records from 49927 primary records. [2025-10-09T22:34:16.284145] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-09T22:34:16.304131] [DEBUG] [LOCAL ] AEG: Derivative data saved (1807 records). [2025-10-09T22:34:16.316452] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-09T22:34:16.316758] [DEBUG] [MAIN ] AEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:16.318966] [INFO ] [MAIN ] Derivative Progress: 29/1690 symbols completed. AEG took 1.2s. Estimated remaining: 11m 14s. Rate: 147.8 symbols/min [2025-10-09T22:34:16.319765] [INFO ] [MAIN ] AEM: Generated 1807 derivative records from 53856 primary records. [2025-10-09T22:34:16.319982] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-09T22:34:16.336244] [DEBUG] [LOCAL ] AEM: Derivative data saved (1807 records). [2025-10-09T22:34:16.336314] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-09T22:34:16.338567] [INFO ] [MAIN ] Derivative Progress: 30/1690 symbols completed. AEM took 1.0s. Estimated remaining: 10m 52s. Rate: 152.7 symbols/min [2025-10-09T22:34:16.339005] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:16.339161] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:16.339102] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:16.427191] [DEBUG] [LOCAL ] AER: Loaded 48578 existing records from primary storage. [2025-10-09T22:34:16.429002] [INFO ] [MAIN ] AER: Loaded 48578 primary data records. [2025-10-09T22:34:16.429945] [DEBUG] [LOCAL ] AES: Loaded 54060 existing records from primary storage. [2025-10-09T22:34:16.441244] [INFO ] [MAIN ] AES: Loaded 54060 primary data records. [2025-10-09T22:34:16.550941] [DEBUG] [LOCAL ] AEO: Loaded 53953 existing records from primary storage. [2025-10-09T22:34:16.606325] [INFO ] [MAIN ] AEO: Loaded 53953 primary data records. [2025-10-09T22:34:17.469936] [DEBUG] [MAIN ] AER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:17.475219] [DEBUG] [MAIN ] AES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:17.476122] [INFO ] [MAIN ] AER: Generated 1807 derivative records from 48578 primary records. [2025-10-09T22:34:17.477171] [INFO ] [MAIN ] AES: Generated 1807 derivative records from 54060 primary records. [2025-10-09T22:34:17.477564] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-09T22:34:17.477501] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-09T22:34:17.510283] [DEBUG] [LOCAL ] AER: Derivative data saved (1807 records). [2025-10-09T22:34:17.511091] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-09T22:34:17.514161] [INFO ] [MAIN ] Derivative Progress: 31/1690 symbols completed. AER took 1.2s. Estimated remaining: 11m 34s. Rate: 143.4 symbols/min [2025-10-09T22:34:17.515319] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:17.516227] [DEBUG] [LOCAL ] AES: Derivative data saved (1807 records). [2025-10-09T22:34:17.516682] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-09T22:34:17.518840] [INFO ] [MAIN ] Derivative Progress: 32/1690 symbols completed. AES took 1.2s. Estimated remaining: 11m 12s. Rate: 148.0 symbols/min [2025-10-09T22:34:17.520956] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:17.535203] [DEBUG] [MAIN ] AEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:17.536002] [INFO ] [MAIN ] AEO: Generated 1807 derivative records from 53953 primary records. [2025-10-09T22:34:17.536245] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-09T22:34:17.560010] [DEBUG] [LOCAL ] AFB: Loaded 11507 existing records from primary storage. [2025-10-09T22:34:17.560892] [INFO ] [MAIN ] AFB: Loaded 11507 primary data records. [2025-10-09T22:34:17.583570] [DEBUG] [LOCAL ] AEO: Derivative data saved (1807 records). [2025-10-09T22:34:17.606330] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-09T22:34:17.629901] [INFO ] [MAIN ] Derivative Progress: 33/1690 symbols completed. AEO took 1.3s. Estimated remaining: 10m 57s. Rate: 151.3 symbols/min [2025-10-09T22:34:17.647024] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:17.915816] [DEBUG] [LOCAL ] AESI: Loaded 49944 existing records from primary storage. [2025-10-09T22:34:17.916741] [INFO ] [MAIN ] AESI: Loaded 49944 primary data records. [2025-10-09T22:34:18.021254] [DEBUG] [LOCAL ] AFG: Loaded 32429 existing records from primary storage. [2025-10-09T22:34:18.039094] [INFO ] [MAIN ] AFG: Loaded 32429 primary data records. [2025-10-09T22:34:18.617844] [DEBUG] [MAIN ] AFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:18.619078] [INFO ] [MAIN ] AFB: Generated 1807 derivative records from 11507 primary records. [2025-10-09T22:34:18.619826] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-09T22:34:18.643045] [DEBUG] [LOCAL ] AFB: Derivative data saved (1807 records). [2025-10-09T22:34:18.643384] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-09T22:34:18.645883] [INFO ] [MAIN ] Derivative Progress: 34/1690 symbols completed. AFB took 1.1s. Estimated remaining: 11m 27s. Rate: 144.7 symbols/min [2025-10-09T22:34:18.646250] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:18.663474] [DEBUG] [MAIN ] AESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:18.665580] [INFO ] [MAIN ] AESI: Generated 1807 derivative records from 49944 primary records. [2025-10-09T22:34:18.668307] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-09T22:34:18.668192] [DEBUG] [LOCAL ] AFGB: Loaded 2317 existing records from primary storage. [2025-10-09T22:34:18.668679] [INFO ] [MAIN ] AFGB: Loaded 2317 primary data records. [2025-10-09T22:34:18.828202] [DEBUG] [LOCAL ] AESI: Derivative data saved (1807 records). [2025-10-09T22:34:18.851542] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-09T22:34:18.859771] [INFO ] [MAIN ] Derivative Progress: 35/1690 symbols completed. AESI took 1.3s. Estimated remaining: 11m 17s. Rate: 146.7 symbols/min [2025-10-09T22:34:18.884980] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:19.018962] [DEBUG] [MAIN ] AFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:19.022173] [INFO ] [MAIN ] AFG: Generated 1807 derivative records from 32429 primary records. [2025-10-09T22:34:19.022499] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-09T22:34:19.026862] [DEBUG] [LOCAL ] AFGC: Loaded 2560 existing records from primary storage. [2025-10-09T22:34:19.036075] [INFO ] [MAIN ] AFGC: Loaded 2560 primary data records. [2025-10-09T22:34:19.162198] [DEBUG] [LOCAL ] AFG: Derivative data saved (1807 records). [2025-10-09T22:34:19.209250] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-09T22:34:19.229131] [INFO ] [MAIN ] Derivative Progress: 36/1690 symbols completed. AFG took 1.6s. Estimated remaining: 11m 15s. Rate: 147.1 symbols/min [2025-10-09T22:34:19.233912] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:19.356638] [DEBUG] [LOCAL ] AFGD: Loaded 1815 existing records from primary storage. [2025-10-09T22:34:19.357257] [INFO ] [MAIN ] AFGD: Loaded 1815 primary data records. [2025-10-09T22:34:19.523113] [DEBUG] [MAIN ] AFGB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:34:19.686009] [INFO ] [MAIN ] AFGB: Generated 1806 derivative records from 2317 primary records. [2025-10-09T22:34:19.687007] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-09T22:34:19.706057] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1806 records). [2025-10-09T22:34:19.706547] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-09T22:34:19.709131] [INFO ] [MAIN ] Derivative Progress: 37/1690 symbols completed. AFGB took 1.1s. Estimated remaining: 11m 17s. Rate: 146.4 symbols/min [2025-10-09T22:34:19.709767] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:19.719910] [DEBUG] [LOCAL ] AFGE: Loaded 2436 existing records from primary storage. [2025-10-09T22:34:19.720161] [INFO ] [MAIN ] AFGE: Loaded 2436 primary data records. [2025-10-09T22:34:19.754985] [DEBUG] [MAIN ] AFGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:19.771950] [INFO ] [MAIN ] AFGC: Generated 1807 derivative records from 2560 primary records. [2025-10-09T22:34:19.793376] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-09T22:34:19.910737] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1807 records). [2025-10-09T22:34:19.936111] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-09T22:34:19.957508] [INFO ] [MAIN ] Derivative Progress: 38/1690 symbols completed. AFGC took 1.1s. Estimated remaining: 11m 10s. Rate: 148.0 symbols/min [2025-10-09T22:34:19.975934] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:20.105497] [DEBUG] [MAIN ] AFGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:20.121866] [INFO ] [MAIN ] AFGD: Generated 1807 derivative records from 1815 primary records. [2025-10-09T22:34:20.122171] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-09T22:34:20.148361] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1807 records). [2025-10-09T22:34:20.148565] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-09T22:34:20.151486] [INFO ] [MAIN ] Derivative Progress: 39/1690 symbols completed. AFGD took 0.9s. Estimated remaining: 11m 1s. Rate: 150.0 symbols/min [2025-10-09T22:34:20.151866] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:20.187568] [DEBUG] [MAIN ] AFGE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:34:20.207761] [INFO ] [MAIN ] AFGE: Generated 1806 derivative records from 2436 primary records. [2025-10-09T22:34:20.209669] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-09T22:34:20.211340] [DEBUG] [LOCAL ] AG: Loaded 54032 existing records from primary storage. [2025-10-09T22:34:20.212073] [INFO ] [MAIN ] AG: Loaded 54032 primary data records. [2025-10-09T22:34:20.265995] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1806 records). [2025-10-09T22:34:20.271314] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-09T22:34:20.314065] [DEBUG] [LOCAL ] AGD: Loaded 18787 existing records from primary storage. [2025-10-09T22:34:20.307092] [INFO ] [MAIN ] Derivative Progress: 40/1690 symbols completed. AFGE took 0.6s. Estimated remaining: 10m 50s. Rate: 152.3 symbols/min [2025-10-09T22:34:20.324473] [INFO ] [MAIN ] AGD: Loaded 18787 primary data records. [2025-10-09T22:34:20.330234] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:20.934272] [DEBUG] [LOCAL ] AGI: Loaded 53810 existing records from primary storage. [2025-10-09T22:34:20.935633] [INFO ] [MAIN ] AGI: Loaded 53810 primary data records. [2025-10-09T22:34:21.257225] [DEBUG] [MAIN ] AG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:21.259923] [INFO ] [MAIN ] AG: Generated 1807 derivative records from 54032 primary records. [2025-10-09T22:34:21.260833] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-09T22:34:21.290303] [DEBUG] [MAIN ] AGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:21.293008] [INFO ] [MAIN ] AGD: Generated 1807 derivative records from 18787 primary records. [2025-10-09T22:34:21.293983] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-09T22:34:21.297253] [DEBUG] [LOCAL ] AG: Derivative data saved (1807 records). [2025-10-09T22:34:21.306029] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-09T22:34:21.308220] [INFO ] [MAIN ] Derivative Progress: 41/1690 symbols completed. AG took 1.3s. Estimated remaining: 11m 14s. Rate: 146.8 symbols/min [2025-10-09T22:34:21.311093] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:21.316186] [DEBUG] [LOCAL ] AGD: Derivative data saved (1807 records). [2025-10-09T22:34:21.316428] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-09T22:34:21.318554] [INFO ] [MAIN ] Derivative Progress: 42/1690 symbols completed. AGD took 1.2s. Estimated remaining: 10m 58s. Rate: 150.3 symbols/min [2025-10-09T22:34:21.318973] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:21.340432] [DEBUG] [MAIN ] AGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:21.341336] [INFO ] [MAIN ] AGI: Generated 1807 derivative records from 53810 primary records. [2025-10-09T22:34:21.341476] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-09T22:34:21.354442] [DEBUG] [LOCAL ] AGM: Loaded 10514 existing records from primary storage. [2025-10-09T22:34:21.361692] [INFO ] [MAIN ] AGM: Loaded 10514 primary data records. [2025-10-09T22:34:21.384111] [DEBUG] [LOCAL ] AGI: Derivative data saved (1807 records). [2025-10-09T22:34:21.410601] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-09T22:34:21.464195] [INFO ] [MAIN ] Derivative Progress: 43/1690 symbols completed. AGI took 1.1s. Estimated remaining: 10m 48s. Rate: 152.5 symbols/min [2025-10-09T22:34:21.570007] [DEBUG] [LOCAL ] AGL: Loaded 52884 existing records from primary storage. [2025-10-09T22:34:21.588536] [INFO ] [MAIN ] AGL: Loaded 52884 primary data records. [2025-10-09T22:34:22.069286] [DEBUG] [MAIN ] AGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:22.070467] [INFO ] [MAIN ] AGM: Generated 1807 derivative records from 10514 primary records. [2025-10-09T22:34:22.071126] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-09T22:34:22.088071] [DEBUG] [LOCAL ] AGM: Derivative data saved (1807 records). [2025-10-09T22:34:22.088274] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-09T22:34:22.090363] [INFO ] [MAIN ] Derivative Progress: 44/1690 symbols completed. AGM took 0.8s. Estimated remaining: 10m 56s. Rate: 150.5 symbols/min [2025-10-09T22:34:22.106098] [DEBUG] [MAIN ] AGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:22.106743] [INFO ] [MAIN ] AGL: Generated 1807 derivative records from 52884 primary records. [2025-10-09T22:34:22.106807] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-09T22:34:22.122250] [DEBUG] [LOCAL ] AGL: Derivative data saved (1807 records). [2025-10-09T22:34:22.122309] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-09T22:34:22.124357] [INFO ] [MAIN ] Derivative Progress: 45/1690 symbols completed. AGL took 0.8s. Estimated remaining: 10m 43s. Rate: 153.6 symbols/min [2025-10-09T22:34:22.125036] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:22.125170] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:22.125972] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:22.164488] [DEBUG] [LOCAL ] AGO: Loaded 28116 existing records from primary storage. [2025-10-09T22:34:22.175229] [INFO ] [MAIN ] AGO: Loaded 28116 primary data records. [2025-10-09T22:34:22.181017] [DEBUG] [LOCAL ] AGRO: Loaded 33620 existing records from primary storage. [2025-10-09T22:34:22.198171] [INFO ] [MAIN ] AGRO: Loaded 33620 primary data records. [2025-10-09T22:34:22.346698] [DEBUG] [LOCAL ] AGX: Loaded 33340 existing records from primary storage. [2025-10-09T22:34:22.368026] [INFO ] [MAIN ] AGX: Loaded 33340 primary data records. [2025-10-09T22:34:23.236819] [DEBUG] [MAIN ] AGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:23.239131] [INFO ] [MAIN ] AGO: Generated 1807 derivative records from 28116 primary records. [2025-10-09T22:34:23.239230] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-09T22:34:23.260922] [DEBUG] [MAIN ] AGRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:23.268990] [INFO ] [MAIN ] AGRO: Generated 1807 derivative records from 33620 primary records. [2025-10-09T22:34:23.273273] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-09T22:34:23.275365] [DEBUG] [LOCAL ] AGO: Derivative data saved (1807 records). [2025-10-09T22:34:23.275604] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-09T22:34:23.278211] [INFO ] [MAIN ] Derivative Progress: 46/1690 symbols completed. AGO took 1.2s. Estimated remaining: 11m 9s. Rate: 147.3 symbols/min [2025-10-09T22:34:23.278502] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:23.315344] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1807 records). [2025-10-09T22:34:23.317221] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-09T22:34:23.320386] [INFO ] [MAIN ] Derivative Progress: 47/1690 symbols completed. AGRO took 1.2s. Estimated remaining: 10m 56s. Rate: 150.2 symbols/min [2025-10-09T22:34:23.320920] [DEBUG] [MAIN ] AGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:23.321361] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:23.322637] [INFO ] [MAIN ] AGX: Generated 1807 derivative records from 33340 primary records. [2025-10-09T22:34:23.323409] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-09T22:34:23.360961] [DEBUG] [LOCAL ] AGX: Derivative data saved (1807 records). [2025-10-09T22:34:23.361218] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-09T22:34:23.363832] [INFO ] [MAIN ] Derivative Progress: 48/1690 symbols completed. AGX took 1.2s. Estimated remaining: 10m 44s. Rate: 153.1 symbols/min [2025-10-09T22:34:23.364183] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:23.392479] [DEBUG] [LOCAL ] AHH: Loaded 41015 existing records from primary storage. [2025-10-09T22:34:23.392805] [INFO ] [MAIN ] AHH: Loaded 41015 primary data records. [2025-10-09T22:34:23.435437] [DEBUG] [LOCAL ] AHT: Loaded 6268 existing records from primary storage. [2025-10-09T22:34:23.454597] [INFO ] [MAIN ] AHT: Loaded 6268 primary data records. [2025-10-09T22:34:23.589930] [DEBUG] [LOCAL ] AHR: Loaded 49469 existing records from primary storage. [2025-10-09T22:34:23.601860] [INFO ] [MAIN ] AHR: Loaded 49469 primary data records. [2025-10-09T22:34:24.476096] [DEBUG] [MAIN ] AHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:24.479547] [INFO ] [MAIN ] AHH: Generated 1807 derivative records from 41015 primary records. [2025-10-09T22:34:24.479975] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-09T22:34:24.506949] [DEBUG] [MAIN ] AHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:24.509921] [INFO ] [MAIN ] AHT: Generated 1807 derivative records from 6268 primary records. [2025-10-09T22:34:24.510282] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-09T22:34:24.540326] [DEBUG] [MAIN ] AHR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:34:24.542186] [DEBUG] [LOCAL ] AHH: Derivative data saved (1807 records). [2025-10-09T22:34:24.545941] [DEBUG] [LOCAL ] AHT: Derivative data saved (1807 records). [2025-10-09T22:34:24.545836] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-09T22:34:24.543068] [INFO ] [MAIN ] AHR: Generated 1806 derivative records from 49469 primary records. [2025-10-09T22:34:24.549121] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-09T22:34:24.548898] [INFO ] [MAIN ] Derivative Progress: 49/1690 symbols completed. AHH took 1.3s. Estimated remaining: 11m 10s. Rate: 147.0 symbols/min [2025-10-09T22:34:24.551678] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:24.549219] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-09T22:34:24.552858] [INFO ] [MAIN ] Derivative Progress: 50/1690 symbols completed. AHT took 1.2s. Estimated remaining: 10m 56s. Rate: 150.0 symbols/min [2025-10-09T22:34:24.560966] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:24.570957] [DEBUG] [LOCAL ] AHR: Derivative data saved (1806 records). [2025-10-09T22:34:24.571109] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-09T22:34:24.573966] [INFO ] [MAIN ] Derivative Progress: 51/1690 symbols completed. AHR took 1.3s. Estimated remaining: 10m 44s. Rate: 152.8 symbols/min [2025-10-09T22:34:24.574223] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:24.627408] [DEBUG] [LOCAL ] AIN: Loaded 24721 existing records from primary storage. [2025-10-09T22:34:24.627544] [INFO ] [MAIN ] AIN: Loaded 24721 primary data records. [2025-10-09T22:34:24.770418] [DEBUG] [LOCAL ] AIG: Loaded 53863 existing records from primary storage. [2025-10-09T22:34:24.781173] [INFO ] [MAIN ] AIG: Loaded 53863 primary data records. [2025-10-09T22:34:24.782456] [DEBUG] [LOCAL ] AI: Loaded 54145 existing records from primary storage. [2025-10-09T22:34:24.791676] [INFO ] [MAIN ] AI: Loaded 54145 primary data records. [2025-10-09T22:34:25.672732] [DEBUG] [MAIN ] AIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:25.674360] [INFO ] [MAIN ] AIN: Generated 1807 derivative records from 24721 primary records. [2025-10-09T22:34:25.674831] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-09T22:34:25.714829] [DEBUG] [LOCAL ] AIN: Derivative data saved (1807 records). [2025-10-09T22:34:25.717481] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-09T22:34:25.719893] [INFO ] [MAIN ] Derivative Progress: 52/1690 symbols completed. AIN took 1.1s. Estimated remaining: 11m 7s. Rate: 147.4 symbols/min [2025-10-09T22:34:25.734344] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:25.734183] [DEBUG] [MAIN ] AIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:25.736242] [INFO ] [MAIN ] AIG: Generated 1807 derivative records from 53863 primary records. [2025-10-09T22:34:25.736341] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-09T22:34:25.737825] [DEBUG] [MAIN ] AI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:25.751840] [INFO ] [MAIN ] AI: Generated 1807 derivative records from 54145 primary records. [2025-10-09T22:34:25.752077] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-09T22:34:25.759679] [DEBUG] [LOCAL ] AIG: Derivative data saved (1807 records). [2025-10-09T22:34:25.764138] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-09T22:34:25.767316] [INFO ] [MAIN ] Derivative Progress: 53/1690 symbols completed. AIG took 1.2s. Estimated remaining: 10m 55s. Rate: 149.9 symbols/min [2025-10-09T22:34:25.767617] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:25.790343] [DEBUG] [LOCAL ] AIO: Loaded 13483 existing records from primary storage. [2025-10-09T22:34:25.791487] [INFO ] [MAIN ] AIO: Loaded 13483 primary data records. [2025-10-09T22:34:25.817216] [DEBUG] [LOCAL ] AI: Derivative data saved (1807 records). [2025-10-09T22:34:25.834188] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-09T22:34:25.836686] [INFO ] [MAIN ] Derivative Progress: 54/1690 symbols completed. AI took 1.3s. Estimated remaining: 10m 45s. Rate: 152.2 symbols/min [2025-10-09T22:34:25.844774] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:26.133811] [DEBUG] [LOCAL ] AIT: Loaded 27293 existing records from primary storage. [2025-10-09T22:34:26.134598] [INFO ] [MAIN ] AIT: Loaded 27293 primary data records. [2025-10-09T22:34:26.214423] [DEBUG] [LOCAL ] AIV: Loaded 41248 existing records from primary storage. [2025-10-09T22:34:26.220390] [INFO ] [MAIN ] AIV: Loaded 41248 primary data records. [2025-10-09T22:34:26.795166] [DEBUG] [MAIN ] AIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:26.796459] [INFO ] [MAIN ] AIO: Generated 1807 derivative records from 13483 primary records. [2025-10-09T22:34:26.796938] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-09T22:34:26.821094] [DEBUG] [LOCAL ] AIO: Derivative data saved (1807 records). [2025-10-09T22:34:26.821515] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-09T22:34:26.823719] [INFO ] [MAIN ] Derivative Progress: 55/1690 symbols completed. AIO took 1.1s. Estimated remaining: 11m 2s. Rate: 148.1 symbols/min [2025-10-09T22:34:26.824073] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:26.838837] [DEBUG] [MAIN ] AIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:26.841592] [INFO ] [MAIN ] AIT: Generated 1807 derivative records from 27293 primary records. [2025-10-09T22:34:26.842749] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-09T22:34:26.865190] [DEBUG] [MAIN ] AIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:26.870172] [INFO ] [MAIN ] AIV: Generated 1807 derivative records from 41248 primary records. [2025-10-09T22:34:26.875116] [DEBUG] [LOCAL ] AIT: Derivative data saved (1807 records). [2025-10-09T22:34:26.874278] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-09T22:34:26.875313] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-09T22:34:26.877693] [INFO ] [MAIN ] Derivative Progress: 56/1690 symbols completed. AIT took 1.1s. Estimated remaining: 10m 52s. Rate: 150.5 symbols/min [2025-10-09T22:34:26.877984] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:26.909519] [DEBUG] [LOCAL ] AIZN: Loaded 4137 existing records from primary storage. [2025-10-09T22:34:26.920731] [INFO ] [MAIN ] AIZN: Loaded 4137 primary data records. [2025-10-09T22:34:26.941036] [DEBUG] [LOCAL ] AIV: Derivative data saved (1807 records). [2025-10-09T22:34:26.949310] [DEBUG] [LOCAL ] AIZ: Loaded 29831 existing records from primary storage. [2025-10-09T22:34:26.954601] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-09T22:34:26.991780] [INFO ] [MAIN ] AIZ: Loaded 29831 primary data records. [2025-10-09T22:34:26.994202] [INFO ] [MAIN ] Derivative Progress: 57/1690 symbols completed. AIV took 1.1s. Estimated remaining: 10m 43s. Rate: 152.4 symbols/min [2025-10-09T22:34:27.015675] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:27.661388] [DEBUG] [LOCAL ] AJG: Loaded 46983 existing records from primary storage. [2025-10-09T22:34:27.662300] [INFO ] [MAIN ] AJG: Loaded 46983 primary data records. [2025-10-09T22:34:28.002425] [DEBUG] [MAIN ] AIZN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:28.003361] [INFO ] [MAIN ] AIZN: Generated 1807 derivative records from 4137 primary records. [2025-10-09T22:34:28.003692] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-09T22:34:28.036975] [DEBUG] [MAIN ] AIZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:28.038129] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1807 records). [2025-10-09T22:34:28.038331] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-09T22:34:28.039174] [INFO ] [MAIN ] AIZ: Generated 1807 derivative records from 29831 primary records. [2025-10-09T22:34:28.039631] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-09T22:34:28.042739] [INFO ] [MAIN ] Derivative Progress: 58/1690 symbols completed. AIZN took 1.2s. Estimated remaining: 11m 1s. Rate: 148.1 symbols/min [2025-10-09T22:34:28.060180] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1807 records). [2025-10-09T22:34:28.060289] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-09T22:34:28.063928] [INFO ] [MAIN ] Derivative Progress: 59/1690 symbols completed. AIZ took 1.2s. Estimated remaining: 10m 50s. Rate: 150.5 symbols/min [2025-10-09T22:34:28.079784] [DEBUG] [MAIN ] AJG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:28.080373] [INFO ] [MAIN ] AJG: Generated 1807 derivative records from 46983 primary records. [2025-10-09T22:34:28.080433] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-09T22:34:28.096614] [DEBUG] [LOCAL ] AJG: Derivative data saved (1807 records). [2025-10-09T22:34:28.096719] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-09T22:34:28.099034] [INFO ] [MAIN ] Derivative Progress: 60/1690 symbols completed. AJG took 1.1s. Estimated remaining: 10m 40s. Rate: 152.9 symbols/min [2025-10-09T22:34:28.099512] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:28.099670] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:28.099789] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:28.168863] [DEBUG] [LOCAL ] ALB: Loaded 53678 existing records from primary storage. [2025-10-09T22:34:28.180970] [INFO ] [MAIN ] ALB: Loaded 53678 primary data records. [2025-10-09T22:34:28.181620] [DEBUG] [LOCAL ] AL: Loaded 44819 existing records from primary storage. [2025-10-09T22:34:28.218693] [INFO ] [MAIN ] AL: Loaded 44819 primary data records. [2025-10-09T22:34:28.323009] [DEBUG] [LOCAL ] AKR: Loaded 46135 existing records from primary storage. [2025-10-09T22:34:28.361338] [INFO ] [MAIN ] AKR: Loaded 46135 primary data records. [2025-10-09T22:34:29.318809] [DEBUG] [MAIN ] AL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:29.321341] [INFO ] [MAIN ] AL: Generated 1807 derivative records from 44819 primary records. [2025-10-09T22:34:29.322305] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-09T22:34:29.355877] [DEBUG] [MAIN ] ALB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:29.371404] [DEBUG] [LOCAL ] AL: Derivative data saved (1807 records). [2025-10-09T22:34:29.372287] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-09T22:34:29.375212] [INFO ] [MAIN ] ALB: Generated 1807 derivative records from 53678 primary records. [2025-10-09T22:34:29.372085] [DEBUG] [MAIN ] AKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:29.375474] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-09T22:34:29.376556] [INFO ] [MAIN ] AKR: Generated 1807 derivative records from 46135 primary records. [2025-10-09T22:34:29.374240] [INFO ] [MAIN ] Derivative Progress: 61/1690 symbols completed. AL took 1.3s. Estimated remaining: 11m 3s. Rate: 147.4 symbols/min [2025-10-09T22:34:29.377315] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-09T22:34:29.377517] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:29.413836] [DEBUG] [LOCAL ] AKR: Derivative data saved (1807 records). [2025-10-09T22:34:29.414119] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-09T22:34:29.417171] [INFO ] [MAIN ] Derivative Progress: 62/1690 symbols completed. AKR took 1.3s. Estimated remaining: 10m 53s. Rate: 149.6 symbols/min [2025-10-09T22:34:29.419159] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:29.420675] [DEBUG] [LOCAL ] ALB: Derivative data saved (1807 records). [2025-10-09T22:34:29.420846] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-09T22:34:29.423795] [INFO ] [MAIN ] Derivative Progress: 63/1690 symbols completed. ALB took 1.3s. Estimated remaining: 10m 42s. Rate: 152.0 symbols/min [2025-10-09T22:34:29.424245] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:29.482031] [DEBUG] [LOCAL ] ALC: Loaded 51409 existing records from primary storage. [2025-10-09T22:34:29.482232] [INFO ] [MAIN ] ALC: Loaded 51409 primary data records. [2025-10-09T22:34:29.608536] [DEBUG] [LOCAL ] ALEX: Loaded 31426 existing records from primary storage. [2025-10-09T22:34:29.609257] [INFO ] [MAIN ] ALEX: Loaded 31426 primary data records. [2025-10-09T22:34:29.804254] [DEBUG] [LOCAL ] ALE: Loaded 31566 existing records from primary storage. [2025-10-09T22:34:29.811901] [INFO ] [MAIN ] ALE: Loaded 31566 primary data records. [2025-10-09T22:34:30.494880] [DEBUG] [MAIN ] ALC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:30.496930] [INFO ] [MAIN ] ALC: Generated 1807 derivative records from 51409 primary records. [2025-10-09T22:34:30.498363] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-09T22:34:30.534289] [DEBUG] [MAIN ] ALEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:30.541768] [INFO ] [MAIN ] ALEX: Generated 1807 derivative records from 31426 primary records. [2025-10-09T22:34:30.542094] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-09T22:34:30.541970] [DEBUG] [LOCAL ] ALC: Derivative data saved (1807 records). [2025-10-09T22:34:30.542467] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-09T22:34:30.557981] [INFO ] [MAIN ] Derivative Progress: 64/1690 symbols completed. ALC took 1.2s. Estimated remaining: 11m 1s. Rate: 147.6 symbols/min [2025-10-09T22:34:30.559553] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:30.559040] [DEBUG] [MAIN ] ALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:30.568832] [INFO ] [MAIN ] ALE: Generated 1807 derivative records from 31566 primary records. [2025-10-09T22:34:30.569134] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-09T22:34:30.577934] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1807 records). [2025-10-09T22:34:30.585241] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-09T22:34:30.594207] [INFO ] [MAIN ] Derivative Progress: 65/1690 symbols completed. ALEX took 1.2s. Estimated remaining: 10m 51s. Rate: 149.7 symbols/min [2025-10-09T22:34:30.594701] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:30.604179] [DEBUG] [LOCAL ] ALE: Derivative data saved (1807 records). [2025-10-09T22:34:30.604308] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-09T22:34:30.607728] [INFO ] [MAIN ] Derivative Progress: 66/1690 symbols completed. ALE took 1.2s. Estimated remaining: 10m 41s. Rate: 152.0 symbols/min [2025-10-09T22:34:30.605012] [DEBUG] [LOCAL ] ALG: Loaded 9904 existing records from primary storage. [2025-10-09T22:34:30.608070] [INFO ] [MAIN ] ALG: Loaded 9904 primary data records. [2025-10-09T22:34:30.608178] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:30.969338] [DEBUG] [LOCAL ] ALIT: Loaded 53167 existing records from primary storage. [2025-10-09T22:34:30.970798] [DEBUG] [LOCAL ] ALK: Loaded 53447 existing records from primary storage. [2025-10-09T22:34:30.971137] [INFO ] [MAIN ] ALK: Loaded 53447 primary data records. [2025-10-09T22:34:30.972014] [INFO ] [MAIN ] ALIT: Loaded 53167 primary data records. [2025-10-09T22:34:31.703063] [DEBUG] [MAIN ] ALG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:31.705213] [INFO ] [MAIN ] ALG: Generated 1807 derivative records from 9904 primary records. [2025-10-09T22:34:31.705424] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-09T22:34:31.731427] [DEBUG] [LOCAL ] ALG: Derivative data saved (1807 records). [2025-10-09T22:34:31.731960] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-09T22:34:31.734465] [INFO ] [MAIN ] Derivative Progress: 67/1690 symbols completed. ALG took 1.2s. Estimated remaining: 10m 59s. Rate: 147.9 symbols/min [2025-10-09T22:34:31.735999] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:31.762203] [DEBUG] [MAIN ] ALK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:31.763686] [INFO ] [MAIN ] ALK: Generated 1807 derivative records from 53447 primary records. [2025-10-09T22:34:31.776808] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-09T22:34:31.776722] [DEBUG] [MAIN ] ALIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:31.777894] [INFO ] [MAIN ] ALIT: Generated 1807 derivative records from 53167 primary records. [2025-10-09T22:34:31.779180] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-09T22:34:31.795086] [DEBUG] [LOCAL ] ALK: Derivative data saved (1807 records). [2025-10-09T22:34:31.795303] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-09T22:34:31.797681] [INFO ] [MAIN ] Derivative Progress: 68/1690 symbols completed. ALK took 1.2s. Estimated remaining: 10m 50s. Rate: 149.7 symbols/min [2025-10-09T22:34:31.798183] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:31.831077] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1807 records). [2025-10-09T22:34:31.831344] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-09T22:34:31.834367] [INFO ] [MAIN ] Derivative Progress: 69/1690 symbols completed. ALIT took 1.2s. Estimated remaining: 10m 41s. Rate: 151.7 symbols/min [2025-10-09T22:34:31.834631] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:31.873712] [DEBUG] [LOCAL ] ALL: Loaded 50206 existing records from primary storage. [2025-10-09T22:34:31.874177] [INFO ] [MAIN ] ALL: Loaded 50206 primary data records. [2025-10-09T22:34:32.121456] [DEBUG] [LOCAL ] ALLY: Loaded 53617 existing records from primary storage. [2025-10-09T22:34:32.228376] [DEBUG] [LOCAL ] ALSN: Loaded 43701 existing records from primary storage. [2025-10-09T22:34:32.245242] [INFO ] [MAIN ] ALLY: Loaded 53617 primary data records. [2025-10-09T22:34:32.245395] [INFO ] [MAIN ] ALSN: Loaded 43701 primary data records. [2025-10-09T22:34:32.873377] [DEBUG] [MAIN ] ALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:32.874971] [INFO ] [MAIN ] ALL: Generated 1807 derivative records from 50206 primary records. [2025-10-09T22:34:32.875263] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-09T22:34:32.893028] [DEBUG] [LOCAL ] ALL: Derivative data saved (1807 records). [2025-10-09T22:34:32.893488] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-09T22:34:32.895677] [INFO ] [MAIN ] Derivative Progress: 70/1690 symbols completed. ALL took 1.2s. Estimated remaining: 10m 56s. Rate: 148.2 symbols/min [2025-10-09T22:34:32.896016] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:32.912883] [DEBUG] [MAIN ] ALLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:32.914467] [INFO ] [MAIN ] ALLY: Generated 1807 derivative records from 53617 primary records. [2025-10-09T22:34:32.915369] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-09T22:34:32.946316] [DEBUG] [MAIN ] ALSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:32.950039] [INFO ] [MAIN ] ALSN: Generated 1807 derivative records from 43701 primary records. [2025-10-09T22:34:32.951159] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1807 records). [2025-10-09T22:34:32.951243] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-09T22:34:32.959301] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-09T22:34:32.962779] [INFO ] [MAIN ] Derivative Progress: 71/1690 symbols completed. ALLY took 1.2s. Estimated remaining: 10m 48s. Rate: 149.9 symbols/min [2025-10-09T22:34:32.970335] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:32.972269] [DEBUG] [LOCAL ] ALTG: Loaded 23737 existing records from primary storage. [2025-10-09T22:34:32.972635] [INFO ] [MAIN ] ALTG: Loaded 23737 primary data records. [2025-10-09T22:34:33.067853] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1807 records). [2025-10-09T22:34:33.066945] [DEBUG] [LOCAL ] ALUR: Loaded 10452 existing records from primary storage. [2025-10-09T22:34:33.096782] [INFO ] [MAIN ] ALUR: Loaded 10452 primary data records. [2025-10-09T22:34:33.085215] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-09T22:34:33.099637] [INFO ] [MAIN ] Derivative Progress: 72/1690 symbols completed. ALSN took 1.3s. Estimated remaining: 10m 42s. Rate: 151.3 symbols/min [2025-10-09T22:34:33.100268] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:33.667313] [DEBUG] [LOCAL ] ALV: Loaded 42387 existing records from primary storage. [2025-10-09T22:34:33.667674] [INFO ] [MAIN ] ALV: Loaded 42387 primary data records. [2025-10-09T22:34:33.875144] [DEBUG] [MAIN ] ALTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:34.001070] [INFO ] [MAIN ] ALTG: Generated 1807 derivative records from 23737 primary records. [2025-10-09T22:34:34.011866] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-09T22:34:34.035258] [DEBUG] [MAIN ] ALUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:34.039053] [INFO ] [MAIN ] ALUR: Generated 1807 derivative records from 10452 primary records. [2025-10-09T22:34:34.039628] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-09T22:34:34.045915] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1807 records). [2025-10-09T22:34:34.053201] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-09T22:34:34.056995] [INFO ] [MAIN ] Derivative Progress: 73/1690 symbols completed. ALTG took 1.2s. Estimated remaining: 10m 54s. Rate: 148.4 symbols/min [2025-10-09T22:34:34.064669] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1807 records). [2025-10-09T22:34:34.064759] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-09T22:34:34.069153] [INFO ] [MAIN ] Derivative Progress: 74/1690 symbols completed. ALUR took 1.1s. Estimated remaining: 10m 45s. Rate: 150.4 symbols/min [2025-10-09T22:34:34.088586] [DEBUG] [MAIN ] ALV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:34.089276] [INFO ] [MAIN ] ALV: Generated 1807 derivative records from 42387 primary records. [2025-10-09T22:34:34.089337] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-09T22:34:34.104880] [DEBUG] [LOCAL ] ALV: Derivative data saved (1807 records). [2025-10-09T22:34:34.104945] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-09T22:34:34.107489] [INFO ] [MAIN ] Derivative Progress: 75/1690 symbols completed. ALV took 1.0s. Estimated remaining: 10m 37s. Rate: 152.2 symbols/min [2025-10-09T22:34:34.108234] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:34.108154] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:34.108787] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:34.120803] [DEBUG] [LOCAL ] ALX: Loaded 6663 existing records from primary storage. [2025-10-09T22:34:34.121025] [INFO ] [MAIN ] ALX: Loaded 6663 primary data records. [2025-10-09T22:34:34.465719] [DEBUG] [LOCAL ] AMBC: Loaded 36609 existing records from primary storage. [2025-10-09T22:34:34.466163] [INFO ] [MAIN ] AMBC: Loaded 36609 primary data records. [2025-10-09T22:34:34.596035] [DEBUG] [LOCAL ] AM: Loaded 52383 existing records from primary storage. [2025-10-09T22:34:34.616838] [INFO ] [MAIN ] AM: Loaded 52383 primary data records. [2025-10-09T22:34:35.128719] [DEBUG] [MAIN ] ALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:35.130008] [INFO ] [MAIN ] ALX: Generated 1807 derivative records from 6663 primary records. [2025-10-09T22:34:35.130206] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-09T22:34:35.147223] [DEBUG] [LOCAL ] ALX: Derivative data saved (1807 records). [2025-10-09T22:34:35.147445] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-09T22:34:35.150188] [INFO ] [MAIN ] Derivative Progress: 76/1690 symbols completed. ALX took 1.0s. Estimated remaining: 10m 50s. Rate: 149.0 symbols/min [2025-10-09T22:34:35.151027] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:35.169853] [DEBUG] [MAIN ] AMBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:35.170958] [INFO ] [MAIN ] AMBC: Generated 1807 derivative records from 36609 primary records. [2025-10-09T22:34:35.171258] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-09T22:34:35.189195] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1807 records). [2025-10-09T22:34:35.191333] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-09T22:34:35.194557] [INFO ] [MAIN ] Derivative Progress: 77/1690 symbols completed. AMBC took 1.1s. Estimated remaining: 10m 42s. Rate: 150.7 symbols/min [2025-10-09T22:34:35.194913] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:35.218219] [DEBUG] [MAIN ] AM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:35.219057] [INFO ] [MAIN ] AM: Generated 1807 derivative records from 52383 primary records. [2025-10-09T22:34:35.219120] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-09T22:34:35.249081] [DEBUG] [LOCAL ] AMBP: Loaded 44975 existing records from primary storage. [2025-10-09T22:34:35.249904] [DEBUG] [LOCAL ] AM: Derivative data saved (1807 records). [2025-10-09T22:34:35.250074] [INFO ] [MAIN ] AMBP: Loaded 44975 primary data records. [2025-10-09T22:34:35.250362] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-09T22:34:35.274337] [INFO ] [MAIN ] Derivative Progress: 78/1690 symbols completed. AM took 1.2s. Estimated remaining: 10m 35s. Rate: 152.3 symbols/min [2025-10-09T22:34:35.297662] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:35.470194] [DEBUG] [LOCAL ] AMC: Loaded 54151 existing records from primary storage. [2025-10-09T22:34:35.470669] [INFO ] [MAIN ] AMC: Loaded 54151 primary data records. [2025-10-09T22:34:35.958800] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-10-09T22:34:35.960370] [INFO ] [MAIN ] AMCR: Loaded 54059 primary data records. [2025-10-09T22:34:36.320262] [DEBUG] [MAIN ] AMBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:36.321393] [INFO ] [MAIN ] AMBP: Generated 1807 derivative records from 44975 primary records. [2025-10-09T22:34:36.321615] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-09T22:34:36.340224] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1807 records). [2025-10-09T22:34:36.343158] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-09T22:34:36.345763] [INFO ] [MAIN ] Derivative Progress: 79/1690 symbols completed. AMBP took 1.2s. Estimated remaining: 10m 48s. Rate: 149.1 symbols/min [2025-10-09T22:34:36.347293] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:36.363737] [DEBUG] [MAIN ] AMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:36.364738] [INFO ] [MAIN ] AMC: Generated 1807 derivative records from 54151 primary records. [2025-10-09T22:34:36.365052] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-09T22:34:36.384397] [DEBUG] [LOCAL ] AMC: Derivative data saved (1807 records). [2025-10-09T22:34:36.384629] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-09T22:34:36.387240] [INFO ] [MAIN ] Derivative Progress: 80/1690 symbols completed. AMC took 1.2s. Estimated remaining: 10m 41s. Rate: 150.8 symbols/min [2025-10-09T22:34:36.387546] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:36.407393] [DEBUG] [MAIN ] AMCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:36.408488] [INFO ] [MAIN ] AMCR: Generated 1807 derivative records from 54059 primary records. [2025-10-09T22:34:36.408630] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-09T22:34:36.442004] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1807 records). [2025-10-09T22:34:36.449458] [DEBUG] [LOCAL ] AMG: Loaded 20269 existing records from primary storage. [2025-10-09T22:34:36.449848] [INFO ] [MAIN ] AMG: Loaded 20269 primary data records. [2025-10-09T22:34:36.449753] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-09T22:34:36.458908] [INFO ] [MAIN ] Derivative Progress: 81/1690 symbols completed. AMCR took 1.2s. Estimated remaining: 10m 34s. Rate: 152.3 symbols/min [2025-10-09T22:34:36.491693] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:36.574381] [DEBUG] [LOCAL ] AME: Loaded 49074 existing records from primary storage. [2025-10-09T22:34:36.574821] [INFO ] [MAIN ] AME: Loaded 49074 primary data records. [2025-10-09T22:34:37.141714] [DEBUG] [LOCAL ] AMH: Loaded 52145 existing records from primary storage. [2025-10-09T22:34:37.142625] [INFO ] [MAIN ] AMH: Loaded 52145 primary data records. [2025-10-09T22:34:37.352284] [DEBUG] [MAIN ] AMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:37.446865] [INFO ] [MAIN ] AMG: Generated 1807 derivative records from 20269 primary records. [2025-10-09T22:34:37.509493] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-09T22:34:37.543767] [DEBUG] [LOCAL ] AMG: Derivative data saved (1807 records). [2025-10-09T22:34:37.544376] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-09T22:34:37.546688] [INFO ] [MAIN ] Derivative Progress: 82/1690 symbols completed. AMG took 1.2s. Estimated remaining: 10m 47s. Rate: 149.1 symbols/min [2025-10-09T22:34:37.547167] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:37.561283] [DEBUG] [MAIN ] AME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:37.562164] [INFO ] [MAIN ] AME: Generated 1807 derivative records from 49074 primary records. [2025-10-09T22:34:37.562447] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-09T22:34:37.581355] [DEBUG] [LOCAL ] AME: Derivative data saved (1807 records). [2025-10-09T22:34:37.581475] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-09T22:34:37.584372] [INFO ] [MAIN ] Derivative Progress: 83/1690 symbols completed. AME took 1.2s. Estimated remaining: 10m 40s. Rate: 150.7 symbols/min [2025-10-09T22:34:37.584804] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:37.604444] [DEBUG] [MAIN ] AMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:37.605164] [INFO ] [MAIN ] AMH: Generated 1807 derivative records from 52145 primary records. [2025-10-09T22:34:37.605257] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-09T22:34:37.640203] [DEBUG] [LOCAL ] AMH: Derivative data saved (1807 records). [2025-10-09T22:34:37.654418] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-09T22:34:37.656534] [INFO ] [MAIN ] Derivative Progress: 84/1690 symbols completed. AMH took 1.2s. Estimated remaining: 10m 33s. Rate: 152.2 symbols/min [2025-10-09T22:34:37.666397] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:37.669339] [DEBUG] [LOCAL ] AMN: Loaded 42026 existing records from primary storage. [2025-10-09T22:34:37.670032] [INFO ] [MAIN ] AMN: Loaded 42026 primary data records. [2025-10-09T22:34:37.669951] [DEBUG] [LOCAL ] AMP: Loaded 32147 existing records from primary storage. [2025-10-09T22:34:37.702061] [INFO ] [MAIN ] AMP: Loaded 32147 primary data records. [2025-10-09T22:34:38.307522] [DEBUG] [LOCAL ] AMPX: Loaded 52708 existing records from primary storage. [2025-10-09T22:34:38.308402] [INFO ] [MAIN ] AMPX: Loaded 52708 primary data records. [2025-10-09T22:34:38.645312] [DEBUG] [MAIN ] AMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:38.648328] [INFO ] [MAIN ] AMN: Generated 1807 derivative records from 42026 primary records. [2025-10-09T22:34:38.649333] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-09T22:34:38.676560] [DEBUG] [MAIN ] AMP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:34:38.678962] [INFO ] [MAIN ] AMP: Generated 1806 derivative records from 32147 primary records. [2025-10-09T22:34:38.679290] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-09T22:34:38.682167] [DEBUG] [LOCAL ] AMN: Derivative data saved (1807 records). [2025-10-09T22:34:38.690091] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-09T22:34:38.693015] [INFO ] [MAIN ] Derivative Progress: 85/1690 symbols completed. AMN took 1.1s. Estimated remaining: 10m 45s. Rate: 149.4 symbols/min [2025-10-09T22:34:38.694353] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:38.702964] [DEBUG] [LOCAL ] AMP: Derivative data saved (1806 records). [2025-10-09T22:34:38.703232] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-09T22:34:38.706044] [INFO ] [MAIN ] Derivative Progress: 86/1690 symbols completed. AMP took 1.1s. Estimated remaining: 10m 37s. Rate: 151.1 symbols/min [2025-10-09T22:34:38.706267] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:38.724380] [DEBUG] [MAIN ] AMPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:38.725204] [INFO ] [MAIN ] AMPX: Generated 1807 derivative records from 52708 primary records. [2025-10-09T22:34:38.725328] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-09T22:34:38.757852] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1807 records). [2025-10-09T22:34:38.767962] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-09T22:34:38.771248] [INFO ] [MAIN ] Derivative Progress: 87/1690 symbols completed. AMPX took 1.1s. Estimated remaining: 10m 31s. Rate: 152.5 symbols/min [2025-10-09T22:34:38.771466] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:38.772863] [DEBUG] [LOCAL ] AMPY: Loaded 38919 existing records from primary storage. [2025-10-09T22:34:38.773057] [INFO ] [MAIN ] AMPY: Loaded 38919 primary data records. [2025-10-09T22:34:38.819483] [DEBUG] [LOCAL ] AMR: Loaded 29174 existing records from primary storage. [2025-10-09T22:34:38.837731] [INFO ] [MAIN ] AMR: Loaded 29174 primary data records. [2025-10-09T22:34:39.081706] [DEBUG] [LOCAL ] AMRC: Loaded 38412 existing records from primary storage. [2025-10-09T22:34:39.136699] [INFO ] [MAIN ] AMRC: Loaded 38412 primary data records. [2025-10-09T22:34:39.771767] [DEBUG] [MAIN ] AMPY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:39.777686] [INFO ] [MAIN ] AMPY: Generated 1807 derivative records from 38919 primary records. [2025-10-09T22:34:39.777955] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-09T22:34:39.776919] [DEBUG] [MAIN ] AMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:39.778732] [INFO ] [MAIN ] AMR: Generated 1807 derivative records from 29174 primary records. [2025-10-09T22:34:39.779188] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-09T22:34:39.809665] [DEBUG] [LOCAL ] AMR: Derivative data saved (1807 records). [2025-10-09T22:34:39.810188] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-09T22:34:39.813749] [INFO ] [MAIN ] Derivative Progress: 88/1690 symbols completed. AMR took 1.1s. Estimated remaining: 10m 42s. Rate: 149.7 symbols/min [2025-10-09T22:34:39.814863] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1807 records). [2025-10-09T22:34:39.816001] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-09T22:34:39.818702] [INFO ] [MAIN ] Derivative Progress: 89/1690 symbols completed. AMPY took 1.1s. Estimated remaining: 10m 34s. Rate: 151.4 symbols/min [2025-10-09T22:34:39.831418] [DEBUG] [MAIN ] AMRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:39.832039] [INFO ] [MAIN ] AMRC: Generated 1807 derivative records from 38412 primary records. [2025-10-09T22:34:39.832100] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-09T22:34:39.847638] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1807 records). [2025-10-09T22:34:39.847772] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-09T22:34:39.850191] [INFO ] [MAIN ] Derivative Progress: 90/1690 symbols completed. AMRC took 1.1s. Estimated remaining: 10m 28s. Rate: 153.0 symbols/min [2025-10-09T22:34:39.850756] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:39.850818] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:39.850714] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:39.857775] [DEBUG] [LOCAL ] AMTD: Loaded 3770 existing records from primary storage. [2025-10-09T22:34:39.858017] [INFO ] [MAIN ] AMTD: Loaded 3770 primary data records. [2025-10-09T22:34:39.997982] [DEBUG] [LOCAL ] AMTB: Loaded 20610 existing records from primary storage. [2025-10-09T22:34:40.004195] [INFO ] [MAIN ] AMTB: Loaded 20610 primary data records. [2025-10-09T22:34:40.450611] [DEBUG] [LOCAL ] AMT: Loaded 52828 existing records from primary storage. [2025-10-09T22:34:40.460979] [INFO ] [MAIN ] AMT: Loaded 52828 primary data records. [2025-10-09T22:34:41.167811] [DEBUG] [MAIN ] AMTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:41.169049] [INFO ] [MAIN ] AMTD: Generated 1807 derivative records from 3770 primary records. [2025-10-09T22:34:41.169880] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-09T22:34:41.187207] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1807 records). [2025-10-09T22:34:41.187505] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-09T22:34:41.189600] [INFO ] [MAIN ] Derivative Progress: 91/1690 symbols completed. AMTD took 1.3s. Estimated remaining: 10m 44s. Rate: 149.0 symbols/min [2025-10-09T22:34:41.189821] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:41.208285] [DEBUG] [MAIN ] AMTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:41.209237] [INFO ] [MAIN ] AMTB: Generated 1807 derivative records from 20610 primary records. [2025-10-09T22:34:41.209522] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-09T22:34:41.229318] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1807 records). [2025-10-09T22:34:41.229579] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-09T22:34:41.232205] [INFO ] [MAIN ] Derivative Progress: 92/1690 symbols completed. AMTB took 1.4s. Estimated remaining: 10m 37s. Rate: 150.5 symbols/min [2025-10-09T22:34:41.244988] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:41.245188] [DEBUG] [MAIN ] AMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:41.246111] [INFO ] [MAIN ] AMT: Generated 1807 derivative records from 52828 primary records. [2025-10-09T22:34:41.246361] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-09T22:34:41.285291] [DEBUG] [LOCAL ] AMWL: Loaded 9317 existing records from primary storage. [2025-10-09T22:34:41.286050] [INFO ] [MAIN ] AMWL: Loaded 9317 primary data records. [2025-10-09T22:34:41.286589] [DEBUG] [LOCAL ] AMT: Derivative data saved (1807 records). [2025-10-09T22:34:41.286720] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-09T22:34:41.310256] [INFO ] [MAIN ] Derivative Progress: 93/1690 symbols completed. AMT took 1.5s. Estimated remaining: 10m 31s. Rate: 151.8 symbols/min [2025-10-09T22:34:41.333536] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:41.426349] [DEBUG] [LOCAL ] AMTM: Loaded 51005 existing records from primary storage. [2025-10-09T22:34:41.458961] [INFO ] [MAIN ] AMTM: Loaded 51005 primary data records. [2025-10-09T22:34:41.760249] [DEBUG] [LOCAL ] AN: Loaded 31875 existing records from primary storage. [2025-10-09T22:34:41.764290] [INFO ] [MAIN ] AN: Loaded 31875 primary data records. [2025-10-09T22:34:42.301348] [DEBUG] [MAIN ] AMWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:42.302861] [INFO ] [MAIN ] AMWL: Generated 1807 derivative records from 9317 primary records. [2025-10-09T22:34:42.302991] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-09T22:34:42.324214] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1807 records). [2025-10-09T22:34:42.326266] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-09T22:34:42.328632] [INFO ] [MAIN ] Derivative Progress: 94/1690 symbols completed. AMWL took 1.1s. Estimated remaining: 10m 41s. Rate: 149.3 symbols/min [2025-10-09T22:34:42.329408] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:42.343813] [DEBUG] [MAIN ] AMTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:42.344485] [INFO ] [MAIN ] AMTM: Generated 1807 derivative records from 51005 primary records. [2025-10-09T22:34:42.344800] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-09T22:34:42.364301] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1807 records). [2025-10-09T22:34:42.364501] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-09T22:34:42.368088] [INFO ] [MAIN ] Derivative Progress: 95/1690 symbols completed. AMTM took 1.2s. Estimated remaining: 10m 35s. Rate: 150.7 symbols/min [2025-10-09T22:34:42.369231] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:42.383845] [DEBUG] [MAIN ] AN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:42.384417] [INFO ] [MAIN ] AN: Generated 1807 derivative records from 31875 primary records. [2025-10-09T22:34:42.384473] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-09T22:34:42.401331] [DEBUG] [LOCAL ] AN: Derivative data saved (1807 records). [2025-10-09T22:34:42.401494] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-09T22:34:42.404511] [INFO ] [MAIN ] Derivative Progress: 96/1690 symbols completed. AN took 1.1s. Estimated remaining: 10m 29s. Rate: 152.2 symbols/min [2025-10-09T22:34:42.404720] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:42.431257] [DEBUG] [LOCAL ] ANRO: Loaded 19411 existing records from primary storage. [2025-10-09T22:34:42.431409] [INFO ] [MAIN ] ANRO: Loaded 19411 primary data records. [2025-10-09T22:34:42.551869] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-09T22:34:42.574681] [INFO ] [MAIN ] ANET: Loaded 54156 primary data records. [2025-10-09T22:34:42.607507] [DEBUG] [LOCAL ] ANVS: Loaded 23421 existing records from primary storage. [2025-10-09T22:34:42.715316] [INFO ] [MAIN ] ANVS: Loaded 23421 primary data records. [2025-10-09T22:34:43.435177] [DEBUG] [MAIN ] ANRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:43.436150] [INFO ] [MAIN ] ANRO: Generated 1807 derivative records from 19411 primary records. [2025-10-09T22:34:43.437039] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-09T22:34:43.467123] [DEBUG] [MAIN ] ANET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:43.481213] [INFO ] [MAIN ] ANET: Generated 1807 derivative records from 54156 primary records. [2025-10-09T22:34:43.482020] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-09T22:34:43.483485] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1807 records). [2025-10-09T22:34:43.483783] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-09T22:34:43.483065] [DEBUG] [MAIN ] ANVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:43.485851] [INFO ] [MAIN ] Derivative Progress: 97/1690 symbols completed. ANRO took 1.1s. Estimated remaining: 10m 39s. Rate: 149.5 symbols/min [2025-10-09T22:34:43.494216] [INFO ] [MAIN ] ANVS: Generated 1807 derivative records from 23421 primary records. [2025-10-09T22:34:43.494349] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:43.494446] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-09T22:34:43.511438] [DEBUG] [LOCAL ] ANET: Derivative data saved (1807 records). [2025-10-09T22:34:43.514402] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-09T22:34:43.517014] [INFO ] [MAIN ] Derivative Progress: 98/1690 symbols completed. ANET took 1.2s. Estimated remaining: 10m 33s. Rate: 150.9 symbols/min [2025-10-09T22:34:43.517179] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:43.522784] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1807 records). [2025-10-09T22:34:43.522935] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-09T22:34:43.525950] [INFO ] [MAIN ] Derivative Progress: 99/1690 symbols completed. ANVS took 1.1s. Estimated remaining: 10m 26s. Rate: 152.4 symbols/min [2025-10-09T22:34:43.526235] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:43.555114] [DEBUG] [LOCAL ] AOD: Loaded 30853 existing records from primary storage. [2025-10-09T22:34:43.555375] [INFO ] [MAIN ] AOD: Loaded 30853 primary data records. [2025-10-09T22:34:43.654873] [DEBUG] [LOCAL ] AORT: Loaded 29364 existing records from primary storage. [2025-10-09T22:34:43.665825] [INFO ] [MAIN ] AORT: Loaded 29364 primary data records. [2025-10-09T22:34:43.894705] [DEBUG] [LOCAL ] AOS: Loaded 49043 existing records from primary storage. [2025-10-09T22:34:43.895188] [INFO ] [MAIN ] AOS: Loaded 49043 primary data records. [2025-10-09T22:34:44.615893] [DEBUG] [MAIN ] AOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:44.621259] [DEBUG] [MAIN ] AORT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:44.622145] [INFO ] [MAIN ] AOD: Generated 1807 derivative records from 30853 primary records. [2025-10-09T22:34:44.624022] [INFO ] [MAIN ] AORT: Generated 1807 derivative records from 29364 primary records. [2025-10-09T22:34:44.624466] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-09T22:34:44.624358] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-09T22:34:44.659227] [DEBUG] [LOCAL ] AOD: Derivative data saved (1807 records). [2025-10-09T22:34:44.661908] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-09T22:34:44.664621] [INFO ] [MAIN ] Derivative Progress: 100/1690 symbols completed. AOD took 1.2s. Estimated remaining: 10m 38s. Rate: 149.6 symbols/min [2025-10-09T22:34:44.666130] [DEBUG] [LOCAL ] AORT: Derivative data saved (1807 records). [2025-10-09T22:34:44.665804] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:44.673954] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-09T22:34:44.676485] [INFO ] [MAIN ] Derivative Progress: 101/1690 symbols completed. AORT took 1.2s. Estimated remaining: 10m 31s. Rate: 151.0 symbols/min [2025-10-09T22:34:44.681916] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:44.683054] [DEBUG] [MAIN ] AOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:44.683693] [INFO ] [MAIN ] AOS: Generated 1807 derivative records from 49043 primary records. [2025-10-09T22:34:44.683795] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-09T22:34:44.701694] [DEBUG] [LOCAL ] AOS: Derivative data saved (1807 records). [2025-10-09T22:34:44.701928] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-09T22:34:44.705044] [INFO ] [MAIN ] Derivative Progress: 102/1690 symbols completed. AOS took 1.2s. Estimated remaining: 10m 25s. Rate: 152.4 symbols/min [2025-10-09T22:34:44.705235] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:44.738527] [DEBUG] [LOCAL ] APD: Loaded 45648 existing records from primary storage. [2025-10-09T22:34:44.738705] [INFO ] [MAIN ] APD: Loaded 45648 primary data records. [2025-10-09T22:34:44.922392] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-10-09T22:34:44.960135] [INFO ] [MAIN ] APH: Loaded 54081 primary data records. [2025-10-09T22:34:45.221069] [DEBUG] [LOCAL ] APLE: Loaded 52309 existing records from primary storage. [2025-10-09T22:34:45.254502] [INFO ] [MAIN ] APLE: Loaded 52309 primary data records. [2025-10-09T22:34:45.777302] [DEBUG] [MAIN ] APD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:45.778616] [INFO ] [MAIN ] APD: Generated 1807 derivative records from 45648 primary records. [2025-10-09T22:34:45.779832] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-09T22:34:45.804148] [DEBUG] [LOCAL ] APD: Derivative data saved (1807 records). [2025-10-09T22:34:45.804362] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-09T22:34:45.806558] [INFO ] [MAIN ] Derivative Progress: 103/1690 symbols completed. APD took 1.1s. Estimated remaining: 10m 36s. Rate: 149.8 symbols/min [2025-10-09T22:34:45.820105] [DEBUG] [MAIN ] APH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:45.821594] [INFO ] [MAIN ] APH: Generated 1807 derivative records from 54081 primary records. [2025-10-09T22:34:45.821776] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-09T22:34:45.852007] [DEBUG] [MAIN ] APLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:45.853834] [INFO ] [MAIN ] APLE: Generated 1807 derivative records from 52309 primary records. [2025-10-09T22:34:45.854156] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-09T22:34:45.856848] [DEBUG] [LOCAL ] APH: Derivative data saved (1807 records). [2025-10-09T22:34:45.864510] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-09T22:34:45.871983] [INFO ] [MAIN ] Derivative Progress: 104/1690 symbols completed. APH took 1.2s. Estimated remaining: 10m 30s. Rate: 151.0 symbols/min [2025-10-09T22:34:45.874698] [DEBUG] [LOCAL ] APLE: Derivative data saved (1807 records). [2025-10-09T22:34:45.874766] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-09T22:34:45.877767] [INFO ] [MAIN ] Derivative Progress: 105/1690 symbols completed. APLE took 1.2s. Estimated remaining: 10m 24s. Rate: 152.4 symbols/min [2025-10-09T22:34:45.878184] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:45.878337] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:45.878298] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:45.888201] [DEBUG] [LOCAL ] AQNB: Loaded 4155 existing records from primary storage. [2025-10-09T22:34:45.888371] [INFO ] [MAIN ] AQNB: Loaded 4155 primary data records. [2025-10-09T22:34:45.971215] [DEBUG] [LOCAL ] APOS: Loaded 7556 existing records from primary storage. [2025-10-09T22:34:45.984377] [INFO ] [MAIN ] APOS: Loaded 7556 primary data records. [2025-10-09T22:34:46.568432] [DEBUG] [LOCAL ] APO: Loaded 53773 existing records from primary storage. [2025-10-09T22:34:46.568931] [INFO ] [MAIN ] APO: Loaded 53773 primary data records. [2025-10-09T22:34:46.921328] [DEBUG] [MAIN ] APOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:46.922250] [DEBUG] [MAIN ] AQNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:46.923324] [INFO ] [MAIN ] APOS: Generated 1807 derivative records from 7556 primary records. [2025-10-09T22:34:46.925522] [INFO ] [MAIN ] AQNB: Generated 1807 derivative records from 4155 primary records. [2025-10-09T22:34:46.925895] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-09T22:34:46.926002] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-09T22:34:46.955765] [DEBUG] [LOCAL ] APOS: Derivative data saved (1807 records). [2025-10-09T22:34:46.956972] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-09T22:34:46.959444] [INFO ] [MAIN ] Derivative Progress: 106/1690 symbols completed. APOS took 1.1s. Estimated remaining: 10m 34s. Rate: 150.0 symbols/min [2025-10-09T22:34:46.960412] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:46.965368] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1807 records). [2025-10-09T22:34:46.965549] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-09T22:34:46.967967] [INFO ] [MAIN ] Derivative Progress: 107/1690 symbols completed. AQNB took 1.1s. Estimated remaining: 10m 28s. Rate: 151.3 symbols/min [2025-10-09T22:34:46.968185] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:46.982858] [DEBUG] [MAIN ] APO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:46.983666] [INFO ] [MAIN ] APO: Generated 1807 derivative records from 53773 primary records. [2025-10-09T22:34:46.983853] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-09T22:34:47.015222] [DEBUG] [LOCAL ] APO: Derivative data saved (1807 records). [2025-10-09T22:34:47.015509] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-09T22:34:47.018151] [INFO ] [MAIN ] Derivative Progress: 108/1690 symbols completed. APO took 1.1s. Estimated remaining: 10m 22s. Rate: 152.6 symbols/min [2025-10-09T22:34:47.018453] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:47.039442] [DEBUG] [LOCAL ] ARDT: Loaded 27921 existing records from primary storage. [2025-10-09T22:34:47.040228] [INFO ] [MAIN ] ARDT: Loaded 27921 primary data records. [2025-10-09T22:34:47.129226] [DEBUG] [LOCAL ] ARCO: Loaded 44723 existing records from primary storage. [2025-10-09T22:34:47.152537] [INFO ] [MAIN ] ARCO: Loaded 44723 primary data records. [2025-10-09T22:34:47.563510] [DEBUG] [LOCAL ] ARE: Loaded 51142 existing records from primary storage. [2025-10-09T22:34:47.594400] [INFO ] [MAIN ] ARE: Loaded 51142 primary data records. [2025-10-09T22:34:48.099028] [DEBUG] [MAIN ] ARDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:48.100428] [INFO ] [MAIN ] ARDT: Generated 1807 derivative records from 27921 primary records. [2025-10-09T22:34:48.102788] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-09T22:34:48.131692] [DEBUG] [MAIN ] ARCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:48.134869] [INFO ] [MAIN ] ARCO: Generated 1807 derivative records from 44723 primary records. [2025-10-09T22:34:48.135000] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-09T22:34:48.156772] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1807 records). [2025-10-09T22:34:48.155935] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1807 records). [2025-10-09T22:34:48.157091] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-09T22:34:48.157162] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-09T22:34:48.159552] [INFO ] [MAIN ] Derivative Progress: 109/1690 symbols completed. ARCO took 1.2s. Estimated remaining: 10m 33s. Rate: 150.0 symbols/min [2025-10-09T22:34:48.162714] [INFO ] [MAIN ] Derivative Progress: 110/1690 symbols completed. ARDT took 1.2s. Estimated remaining: 10m 26s. Rate: 151.3 symbols/min [2025-10-09T22:34:48.162390] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:48.162846] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:48.181067] [DEBUG] [MAIN ] ARE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:48.181937] [INFO ] [MAIN ] ARE: Generated 1807 derivative records from 51142 primary records. [2025-10-09T22:34:48.182006] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-09T22:34:48.198534] [DEBUG] [LOCAL ] ARE: Derivative data saved (1807 records). [2025-10-09T22:34:48.198805] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-09T22:34:48.205989] [INFO ] [MAIN ] Derivative Progress: 111/1690 symbols completed. ARE took 1.2s. Estimated remaining: 10m 21s. Rate: 152.5 symbols/min [2025-10-09T22:34:48.206228] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:48.255424] [DEBUG] [LOCAL ] ARI: Loaded 43991 existing records from primary storage. [2025-10-09T22:34:48.256277] [INFO ] [MAIN ] ARI: Loaded 43991 primary data records. [2025-10-09T22:34:48.337056] [DEBUG] [LOCAL ] ARES: Loaded 50035 existing records from primary storage. [2025-10-09T22:34:48.369087] [INFO ] [MAIN ] ARES: Loaded 50035 primary data records. [2025-10-09T22:34:48.494626] [DEBUG] [LOCAL ] ARIS: Loaded 42740 existing records from primary storage. [2025-10-09T22:34:48.508217] [INFO ] [MAIN ] ARIS: Loaded 42740 primary data records. [2025-10-09T22:34:49.238639] [DEBUG] [MAIN ] ARI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:49.240100] [INFO ] [MAIN ] ARI: Generated 1807 derivative records from 43991 primary records. [2025-10-09T22:34:49.240739] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-09T22:34:49.271486] [DEBUG] [LOCAL ] ARI: Derivative data saved (1807 records). [2025-10-09T22:34:49.272209] [DEBUG] [MAIN ] ARES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:49.272960] [INFO ] [MAIN ] ARES: Generated 1807 derivative records from 50035 primary records. [2025-10-09T22:34:49.272268] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-09T22:34:49.275217] [INFO ] [MAIN ] Derivative Progress: 112/1690 symbols completed. ARI took 1.1s. Estimated remaining: 10m 30s. Rate: 150.2 symbols/min [2025-10-09T22:34:49.275466] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-09T22:34:49.275590] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:49.295805] [DEBUG] [LOCAL ] ARES: Derivative data saved (1807 records). [2025-10-09T22:34:49.296071] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-09T22:34:49.298734] [INFO ] [MAIN ] Derivative Progress: 113/1690 symbols completed. ARES took 1.1s. Estimated remaining: 10m 25s. Rate: 151.5 symbols/min [2025-10-09T22:34:49.298983] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:49.312300] [DEBUG] [MAIN ] ARIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:49.312979] [INFO ] [MAIN ] ARIS: Generated 1807 derivative records from 42740 primary records. [2025-10-09T22:34:49.313089] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-10-09T22:34:49.340180] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1807 records). [2025-10-09T22:34:49.340342] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-10-09T22:34:49.342873] [INFO ] [MAIN ] Derivative Progress: 114/1690 symbols completed. ARIS took 1.1s. Estimated remaining: 10m 19s. Rate: 152.7 symbols/min [2025-10-09T22:34:49.343179] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:49.374373] [DEBUG] [LOCAL ] ARLO: Loaded 43989 existing records from primary storage. [2025-10-09T22:34:49.374696] [INFO ] [MAIN ] ARLO: Loaded 43989 primary data records. [2025-10-09T22:34:49.519339] [DEBUG] [LOCAL ] ARMK: Loaded 50707 existing records from primary storage. [2025-10-09T22:34:49.529815] [INFO ] [MAIN ] ARMK: Loaded 50707 primary data records. [2025-10-09T22:34:49.830265] [DEBUG] [LOCAL ] AROC: Loaded 49324 existing records from primary storage. [2025-10-09T22:34:49.834879] [INFO ] [MAIN ] AROC: Loaded 49324 primary data records. [2025-10-09T22:34:50.397495] [DEBUG] [MAIN ] ARLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:50.399184] [INFO ] [MAIN ] ARLO: Generated 1807 derivative records from 43989 primary records. [2025-10-09T22:34:50.399296] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-09T22:34:50.420166] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1807 records). [2025-10-09T22:34:50.428189] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-09T22:34:50.431222] [INFO ] [MAIN ] Derivative Progress: 115/1690 symbols completed. ARLO took 1.2s. Estimated remaining: 10m 28s. Rate: 150.4 symbols/min [2025-10-09T22:34:50.436752] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:50.437831] [DEBUG] [MAIN ] ARMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:50.439120] [INFO ] [MAIN ] ARMK: Generated 1807 derivative records from 50707 primary records. [2025-10-09T22:34:50.439501] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-09T22:34:50.464270] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1807 records). [2025-10-09T22:34:50.465365] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-09T22:34:50.469491] [INFO ] [MAIN ] Derivative Progress: 116/1690 symbols completed. ARMK took 1.2s. Estimated remaining: 10m 23s. Rate: 151.6 symbols/min [2025-10-09T22:34:50.469715] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:50.484394] [DEBUG] [MAIN ] AROC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:50.485338] [INFO ] [MAIN ] AROC: Generated 1807 derivative records from 49324 primary records. [2025-10-09T22:34:50.485552] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-09T22:34:50.516937] [DEBUG] [LOCAL ] AROC: Derivative data saved (1807 records). [2025-10-09T22:34:50.517175] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-09T22:34:50.519940] [INFO ] [MAIN ] Derivative Progress: 117/1690 symbols completed. AROC took 1.2s. Estimated remaining: 10m 18s. Rate: 152.7 symbols/min [2025-10-09T22:34:50.520202] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:50.555271] [DEBUG] [LOCAL ] ARR: Loaded 52462 existing records from primary storage. [2025-10-09T22:34:50.555454] [INFO ] [MAIN ] ARR: Loaded 52462 primary data records. [2025-10-09T22:34:50.646783] [DEBUG] [LOCAL ] ARW: Loaded 33052 existing records from primary storage. [2025-10-09T22:34:50.664353] [INFO ] [MAIN ] ARW: Loaded 33052 primary data records. [2025-10-09T22:34:51.040042] [DEBUG] [LOCAL ] AS: Loaded 53512 existing records from primary storage. [2025-10-09T22:34:51.105687] [INFO ] [MAIN ] AS: Loaded 53512 primary data records. [2025-10-09T22:34:51.576342] [DEBUG] [MAIN ] ARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:51.578416] [INFO ] [MAIN ] ARR: Generated 1807 derivative records from 52462 primary records. [2025-10-09T22:34:51.586669] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-09T22:34:51.593745] [DEBUG] [MAIN ] ARW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:51.607332] [INFO ] [MAIN ] ARW: Generated 1807 derivative records from 33052 primary records. [2025-10-09T22:34:51.607465] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-09T22:34:51.631052] [DEBUG] [LOCAL ] ARR: Derivative data saved (1807 records). [2025-10-09T22:34:51.639244] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-09T22:34:51.648304] [INFO ] [MAIN ] Derivative Progress: 118/1690 symbols completed. ARR took 1.2s. Estimated remaining: 10m 27s. Rate: 150.3 symbols/min [2025-10-09T22:34:51.648910] [DEBUG] [MAIN ] AS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:34:51.649955] [DEBUG] [LOCAL ] ARW: Derivative data saved (1807 records). [2025-10-09T22:34:51.650187] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-09T22:34:51.650969] [INFO ] [MAIN ] AS: Generated 1806 derivative records from 53512 primary records. [2025-10-09T22:34:51.653137] [INFO ] [MAIN ] Derivative Progress: 119/1690 symbols completed. ARW took 1.2s. Estimated remaining: 10m 22s. Rate: 151.6 symbols/min [2025-10-09T22:34:51.653294] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-09T22:34:51.669680] [DEBUG] [LOCAL ] AS: Derivative data saved (1806 records). [2025-10-09T22:34:51.669747] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-09T22:34:51.673240] [INFO ] [MAIN ] Derivative Progress: 120/1690 symbols completed. AS took 1.2s. Estimated remaining: 10m 17s. Rate: 152.8 symbols/min [2025-10-09T22:34:51.673790] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:51.673946] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:51.674069] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:51.694244] [DEBUG] [LOCAL ] ASA: Loaded 14879 existing records from primary storage. [2025-10-09T22:34:51.694458] [INFO ] [MAIN ] ASA: Loaded 14879 primary data records. [2025-10-09T22:34:52.005661] [DEBUG] [LOCAL ] ASAN: Loaded 53111 existing records from primary storage. [2025-10-09T22:34:52.073260] [DEBUG] [LOCAL ] ASB: Loaded 49923 existing records from primary storage. [2025-10-09T22:34:52.073551] [INFO ] [MAIN ] ASB: Loaded 49923 primary data records. [2025-10-09T22:34:52.073399] [INFO ] [MAIN ] ASAN: Loaded 53111 primary data records. [2025-10-09T22:34:52.729226] [DEBUG] [MAIN ] ASA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:52.730285] [INFO ] [MAIN ] ASA: Generated 1807 derivative records from 14879 primary records. [2025-10-09T22:34:52.731576] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-09T22:34:52.764148] [DEBUG] [LOCAL ] ASA: Derivative data saved (1807 records). [2025-10-09T22:34:52.764320] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-09T22:34:52.763365] [DEBUG] [MAIN ] ASAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:52.766803] [INFO ] [MAIN ] Derivative Progress: 121/1690 symbols completed. ASA took 1.1s. Estimated remaining: 10m 25s. Rate: 150.6 symbols/min [2025-10-09T22:34:52.766998] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:52.768287] [INFO ] [MAIN ] ASAN: Generated 1807 derivative records from 53111 primary records. [2025-10-09T22:34:52.768736] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-09T22:34:52.788876] [DEBUG] [LOCAL ] ASBA: Loaded 3471 existing records from primary storage. [2025-10-09T22:34:52.789162] [INFO ] [MAIN ] ASBA: Loaded 3471 primary data records. [2025-10-09T22:34:52.873832] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1807 records). [2025-10-09T22:34:52.880486] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-09T22:34:52.868039] [DEBUG] [MAIN ] ASB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:52.882816] [INFO ] [MAIN ] Derivative Progress: 122/1690 symbols completed. ASAN took 1.2s. Estimated remaining: 10m 21s. Rate: 151.4 symbols/min [2025-10-09T22:34:52.902199] [INFO ] [MAIN ] ASB: Generated 1807 derivative records from 49923 primary records. [2025-10-09T22:34:52.914634] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:52.915041] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-09T22:34:53.130386] [DEBUG] [LOCAL ] ASB: Derivative data saved (1807 records). [2025-10-09T22:34:53.139829] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-09T22:34:53.142509] [INFO ] [MAIN ] Derivative Progress: 123/1690 symbols completed. ASB took 1.5s. Estimated remaining: 10m 19s. Rate: 151.9 symbols/min [2025-10-09T22:34:53.143120] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:53.158942] [DEBUG] [LOCAL ] ASC: Loaded 37693 existing records from primary storage. [2025-10-09T22:34:53.159496] [INFO ] [MAIN ] ASC: Loaded 37693 primary data records. [2025-10-09T22:34:53.265324] [DEBUG] [LOCAL ] ASG: Loaded 19644 existing records from primary storage. [2025-10-09T22:34:53.284460] [INFO ] [MAIN ] ASG: Loaded 19644 primary data records. [2025-10-09T22:34:53.302636] [DEBUG] [MAIN ] ASBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:53.340210] [INFO ] [MAIN ] ASBA: Generated 1807 derivative records from 3471 primary records. [2025-10-09T22:34:53.374554] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-09T22:34:53.621956] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1807 records). [2025-10-09T22:34:53.643693] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-09T22:34:53.679820] [INFO ] [MAIN ] Derivative Progress: 124/1690 symbols completed. ASBA took 0.9s. Estimated remaining: 10m 20s. Rate: 151.4 symbols/min [2025-10-09T22:34:53.717107] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:53.928907] [DEBUG] [MAIN ] ASC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:53.929689] [INFO ] [MAIN ] ASC: Generated 1807 derivative records from 37693 primary records. [2025-10-09T22:34:53.930115] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-09T22:34:53.955208] [DEBUG] [LOCAL ] ASC: Derivative data saved (1807 records). [2025-10-09T22:34:53.955973] [DEBUG] [LOCAL ] ASGI: Loaded 22863 existing records from primary storage. [2025-10-09T22:34:53.956519] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-09T22:34:53.956469] [INFO ] [MAIN ] ASGI: Loaded 22863 primary data records. [2025-10-09T22:34:53.958968] [INFO ] [MAIN ] Derivative Progress: 125/1690 symbols completed. ASC took 1.0s. Estimated remaining: 10m 19s. Rate: 151.8 symbols/min [2025-10-09T22:34:53.970592] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:54.177707] [DEBUG] [MAIN ] ASG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:54.316565] [INFO ] [MAIN ] ASG: Generated 1807 derivative records from 19644 primary records. [2025-10-09T22:34:54.332815] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-09T22:34:54.361795] [DEBUG] [LOCAL ] ASG: Derivative data saved (1807 records). [2025-10-09T22:34:54.363307] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-09T22:34:54.363218] [DEBUG] [LOCAL ] ASGN: Loaded 36566 existing records from primary storage. [2025-10-09T22:34:54.365523] [INFO ] [MAIN ] Derivative Progress: 126/1690 symbols completed. ASG took 1.2s. Estimated remaining: 10m 18s. Rate: 151.8 symbols/min [2025-10-09T22:34:54.365911] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:54.365737] [INFO ] [MAIN ] ASGN: Loaded 36566 primary data records. [2025-10-09T22:34:54.707710] [DEBUG] [LOCAL ] ASH: Loaded 37885 existing records from primary storage. [2025-10-09T22:34:54.710116] [INFO ] [MAIN ] ASH: Loaded 37885 primary data records. [2025-10-09T22:34:54.723541] [DEBUG] [MAIN ] ASGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:54.787261] [INFO ] [MAIN ] ASGI: Generated 1807 derivative records from 22863 primary records. [2025-10-09T22:34:54.810981] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-09T22:34:55.045409] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1807 records). [2025-10-09T22:34:55.045558] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-09T22:34:55.048188] [INFO ] [MAIN ] Derivative Progress: 127/1690 symbols completed. ASGI took 1.3s. Estimated remaining: 10m 22s. Rate: 150.9 symbols/min [2025-10-09T22:34:55.049360] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:55.078254] [DEBUG] [MAIN ] ASGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:55.079462] [INFO ] [MAIN ] ASGN: Generated 1807 derivative records from 36566 primary records. [2025-10-09T22:34:55.079525] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-09T22:34:55.104497] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1807 records). [2025-10-09T22:34:55.104863] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-09T22:34:55.120011] [INFO ] [MAIN ] Derivative Progress: 128/1690 symbols completed. ASGN took 1.1s. Estimated remaining: 10m 17s. Rate: 151.9 symbols/min [2025-10-09T22:34:55.117810] [DEBUG] [MAIN ] ASH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:55.128318] [INFO ] [MAIN ] ASH: Generated 1807 derivative records from 37885 primary records. [2025-10-09T22:34:55.120599] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:55.128788] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-09T22:34:55.129319] [DEBUG] [LOCAL ] ASIX: Loaded 22989 existing records from primary storage. [2025-10-09T22:34:55.129675] [INFO ] [MAIN ] ASIX: Loaded 22989 primary data records. [2025-10-09T22:34:55.329834] [DEBUG] [LOCAL ] ASH: Derivative data saved (1807 records). [2025-10-09T22:34:55.429915] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-09T22:34:55.432867] [INFO ] [MAIN ] Derivative Progress: 129/1690 symbols completed. ASH took 1.1s. Estimated remaining: 10m 16s. Rate: 152.1 symbols/min [2025-10-09T22:34:55.446963] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:55.474257] [DEBUG] [LOCAL ] ASR: Loaded 9380 existing records from primary storage. [2025-10-09T22:34:55.474469] [INFO ] [MAIN ] ASR: Loaded 9380 primary data records. [2025-10-09T22:34:55.601370] [DEBUG] [LOCAL ] ASPN: Loaded 50114 existing records from primary storage. [2025-10-09T22:34:55.623983] [INFO ] [MAIN ] ASPN: Loaded 50114 primary data records. [2025-10-09T22:34:55.912132] [DEBUG] [MAIN ] ASIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:55.924799] [INFO ] [MAIN ] ASIX: Generated 1807 derivative records from 22989 primary records. [2025-10-09T22:34:55.925259] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-09T22:34:56.201584] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1807 records). [2025-10-09T22:34:56.202378] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-09T22:34:56.205265] [INFO ] [MAIN ] Derivative Progress: 130/1690 symbols completed. ASIX took 1.2s. Estimated remaining: 10m 20s. Rate: 151.0 symbols/min [2025-10-09T22:34:56.205885] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:56.225407] [DEBUG] [MAIN ] ASR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:56.226554] [INFO ] [MAIN ] ASR: Generated 1807 derivative records from 9380 primary records. [2025-10-09T22:34:56.226715] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-09T22:34:56.255232] [DEBUG] [MAIN ] ASPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:56.256304] [INFO ] [MAIN ] ASPN: Generated 1807 derivative records from 50114 primary records. [2025-10-09T22:34:56.256674] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-09T22:34:56.274315] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1807 records). [2025-10-09T22:34:56.274830] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-09T22:34:56.274775] [DEBUG] [LOCAL ] ASR: Derivative data saved (1807 records). [2025-10-09T22:34:56.274972] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-09T22:34:56.291869] [INFO ] [MAIN ] Derivative Progress: 131/1690 symbols completed. ASPN took 1.2s. Estimated remaining: 10m 16s. Rate: 151.9 symbols/min [2025-10-09T22:34:56.292095] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:56.294869] [INFO ] [MAIN ] Derivative Progress: 132/1690 symbols completed. ASR took 0.8s. Estimated remaining: 10m 11s. Rate: 153.1 symbols/min [2025-10-09T22:34:56.295124] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:56.316316] [DEBUG] [LOCAL ] ASX: Loaded 53246 existing records from primary storage. [2025-10-09T22:34:56.316532] [INFO ] [MAIN ] ASX: Loaded 53246 primary data records. [2025-10-09T22:34:56.446874] [DEBUG] [LOCAL ] ATGE: Loaded 31305 existing records from primary storage. [2025-10-09T22:34:56.452621] [INFO ] [MAIN ] ATGE: Loaded 31305 primary data records. [2025-10-09T22:34:56.562559] [DEBUG] [LOCAL ] ATEN: Loaded 39032 existing records from primary storage. [2025-10-09T22:34:56.743549] [INFO ] [MAIN ] ATEN: Loaded 39032 primary data records. [2025-10-09T22:34:57.296390] [DEBUG] [MAIN ] ASX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:57.297299] [INFO ] [MAIN ] ASX: Generated 1807 derivative records from 53246 primary records. [2025-10-09T22:34:57.297668] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-09T22:34:57.319280] [DEBUG] [LOCAL ] ASX: Derivative data saved (1807 records). [2025-10-09T22:34:57.331778] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-09T22:34:57.334466] [INFO ] [MAIN ] Derivative Progress: 133/1690 symbols completed. ASX took 1.1s. Estimated remaining: 10m 18s. Rate: 151.2 symbols/min [2025-10-09T22:34:57.335424] [DEBUG] [MAIN ] ATGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:57.336261] [INFO ] [MAIN ] ATGE: Generated 1807 derivative records from 31305 primary records. [2025-10-09T22:34:57.336423] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-09T22:34:57.353068] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1807 records). [2025-10-09T22:34:57.353964] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-09T22:34:57.357299] [INFO ] [MAIN ] Derivative Progress: 134/1690 symbols completed. ATGE took 1.1s. Estimated remaining: 10m 13s. Rate: 152.2 symbols/min [2025-10-09T22:34:57.371101] [DEBUG] [MAIN ] ATEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:57.371669] [INFO ] [MAIN ] ATEN: Generated 1807 derivative records from 39032 primary records. [2025-10-09T22:34:57.371732] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-09T22:34:57.387789] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1807 records). [2025-10-09T22:34:57.387849] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-09T22:34:57.390524] [INFO ] [MAIN ] Derivative Progress: 135/1690 symbols completed. ATEN took 1.1s. Estimated remaining: 10m 9s. Rate: 153.3 symbols/min [2025-10-09T22:34:57.391027] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:57.391114] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:57.391184] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:57.403549] [DEBUG] [LOCAL ] ATHS: Loaded 6815 existing records from primary storage. [2025-10-09T22:34:57.403850] [INFO ] [MAIN ] ATHS: Loaded 6815 primary data records. [2025-10-09T22:34:57.605581] [DEBUG] [LOCAL ] ATHM: Loaded 32029 existing records from primary storage. [2025-10-09T22:34:57.628356] [INFO ] [MAIN ] ATHM: Loaded 32029 primary data records. [2025-10-09T22:34:57.858328] [DEBUG] [LOCAL ] ATI: Loaded 51732 existing records from primary storage. [2025-10-09T22:34:57.872407] [INFO ] [MAIN ] ATI: Loaded 51732 primary data records. [2025-10-09T22:34:58.468675] [DEBUG] [MAIN ] ATHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:58.469966] [INFO ] [MAIN ] ATHS: Generated 1807 derivative records from 6815 primary records. [2025-10-09T22:34:58.470215] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-09T22:34:58.489516] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1807 records). [2025-10-09T22:34:58.490903] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-09T22:34:58.494722] [INFO ] [MAIN ] Derivative Progress: 136/1690 symbols completed. ATHS took 1.1s. Estimated remaining: 10m 16s. Rate: 151.3 symbols/min [2025-10-09T22:34:58.495331] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:58.512987] [DEBUG] [MAIN ] ATHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:58.514566] [INFO ] [MAIN ] ATHM: Generated 1807 derivative records from 32029 primary records. [2025-10-09T22:34:58.514717] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-09T22:34:58.537622] [DEBUG] [MAIN ] ATI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:58.544828] [INFO ] [MAIN ] ATI: Generated 1807 derivative records from 51732 primary records. [2025-10-09T22:34:58.545444] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-09T22:34:58.546212] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1807 records). [2025-10-09T22:34:58.546367] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-09T22:34:58.549170] [INFO ] [MAIN ] Derivative Progress: 137/1690 symbols completed. ATHM took 1.2s. Estimated remaining: 10m 12s. Rate: 152.2 symbols/min [2025-10-09T22:34:58.549373] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:58.576941] [DEBUG] [LOCAL ] ATI: Derivative data saved (1807 records). [2025-10-09T22:34:58.577085] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-09T22:34:58.579676] [INFO ] [MAIN ] Derivative Progress: 138/1690 symbols completed. ATI took 1.2s. Estimated remaining: 10m 8s. Rate: 153.2 symbols/min [2025-10-09T22:34:58.580037] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:58.592483] [DEBUG] [LOCAL ] ATKR: Loaded 35606 existing records from primary storage. [2025-10-09T22:34:58.592776] [INFO ] [MAIN ] ATKR: Loaded 35606 primary data records. [2025-10-09T22:34:58.775514] [DEBUG] [LOCAL ] ATMU: Loaded 39408 existing records from primary storage. [2025-10-09T22:34:58.822826] [INFO ] [MAIN ] ATMU: Loaded 39408 primary data records. [2025-10-09T22:34:59.055050] [DEBUG] [LOCAL ] ATO: Loaded 42098 existing records from primary storage. [2025-10-09T22:34:59.066692] [INFO ] [MAIN ] ATO: Loaded 42098 primary data records. [2025-10-09T22:34:59.611866] [DEBUG] [MAIN ] ATKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:59.613995] [INFO ] [MAIN ] ATKR: Generated 1807 derivative records from 35606 primary records. [2025-10-09T22:34:59.614442] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-09T22:34:59.632328] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1807 records). [2025-10-09T22:34:59.632502] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-09T22:34:59.635360] [INFO ] [MAIN ] Derivative Progress: 139/1690 symbols completed. ATKR took 1.1s. Estimated remaining: 10m 15s. Rate: 151.4 symbols/min [2025-10-09T22:34:59.636415] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:59.654559] [DEBUG] [MAIN ] ATMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:59.655634] [INFO ] [MAIN ] ATMU: Generated 1807 derivative records from 39408 primary records. [2025-10-09T22:34:59.655936] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-09T22:34:59.678179] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1807 records). [2025-10-09T22:34:59.686486] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-09T22:34:59.686914] [DEBUG] [LOCAL ] ATS: Loaded 17815 existing records from primary storage. [2025-10-09T22:34:59.690766] [INFO ] [MAIN ] ATS: Loaded 17815 primary data records. [2025-10-09T22:34:59.690355] [INFO ] [MAIN ] Derivative Progress: 140/1690 symbols completed. ATMU took 1.1s. Estimated remaining: 10m 11s. Rate: 152.3 symbols/min [2025-10-09T22:34:59.740562] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:34:59.746291] [DEBUG] [MAIN ] ATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:34:59.789728] [INFO ] [MAIN ] ATO: Generated 1807 derivative records from 42098 primary records. [2025-10-09T22:34:59.801777] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-09T22:34:59.916906] [DEBUG] [LOCAL ] ATO: Derivative data saved (1807 records). [2025-10-09T22:34:59.922856] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-09T22:35:00.072456] [INFO ] [MAIN ] Derivative Progress: 141/1690 symbols completed. ATO took 1.5s. Estimated remaining: 10m 10s. Rate: 152.4 symbols/min [2025-10-09T22:35:00.097849] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:00.120428] [DEBUG] [LOCAL ] ATUS: Loaded 49851 existing records from primary storage. [2025-10-09T22:35:00.121460] [INFO ] [MAIN ] ATUS: Loaded 49851 primary data records. [2025-10-09T22:35:00.469435] [DEBUG] [MAIN ] ATS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:00.470449] [INFO ] [MAIN ] ATS: Generated 1807 derivative records from 17815 primary records. [2025-10-09T22:35:00.483547] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-09T22:35:00.487496] [DEBUG] [LOCAL ] AU: Loaded 53379 existing records from primary storage. [2025-10-09T22:35:00.496282] [INFO ] [MAIN ] AU: Loaded 53379 primary data records. [2025-10-09T22:35:00.608263] [DEBUG] [LOCAL ] ATS: Derivative data saved (1807 records). [2025-10-09T22:35:00.630539] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-09T22:35:00.638458] [INFO ] [MAIN ] Derivative Progress: 142/1690 symbols completed. ATS took 1.0s. Estimated remaining: 10m 11s. Rate: 151.9 symbols/min [2025-10-09T22:35:00.652208] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:00.828370] [DEBUG] [MAIN ] ATUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:00.829790] [INFO ] [MAIN ] ATUS: Generated 1807 derivative records from 49851 primary records. [2025-10-09T22:35:00.830673] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-09T22:35:00.857923] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1807 records). [2025-10-09T22:35:00.858291] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-09T22:35:00.861311] [INFO ] [MAIN ] Derivative Progress: 143/1690 symbols completed. ATUS took 1.1s. Estimated remaining: 10m 9s. Rate: 152.4 symbols/min [2025-10-09T22:35:00.861573] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:00.879338] [DEBUG] [LOCAL ] AUB: Loaded 46506 existing records from primary storage. [2025-10-09T22:35:00.879573] [INFO ] [MAIN ] AUB: Loaded 46506 primary data records. [2025-10-09T22:35:00.928412] [DEBUG] [LOCAL ] AUNA: Loaded 5085 existing records from primary storage. [2025-10-09T22:35:00.974529] [INFO ] [MAIN ] AUNA: Loaded 5085 primary data records. [2025-10-09T22:35:01.001197] [DEBUG] [MAIN ] AU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:01.013411] [INFO ] [MAIN ] AU: Generated 1807 derivative records from 53379 primary records. [2025-10-09T22:35:01.038310] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-09T22:35:01.448704] [DEBUG] [LOCAL ] AU: Derivative data saved (1807 records). [2025-10-09T22:35:01.608561] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-09T22:35:01.629185] [INFO ] [MAIN ] Derivative Progress: 144/1690 symbols completed. AU took 1.5s. Estimated remaining: 10m 13s. Rate: 151.4 symbols/min [2025-10-09T22:35:01.630132] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:01.654370] [DEBUG] [MAIN ] AUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:01.655829] [INFO ] [MAIN ] AUB: Generated 1807 derivative records from 46506 primary records. [2025-10-09T22:35:01.655984] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-09T22:35:01.674394] [DEBUG] [LOCAL ] AUB: Derivative data saved (1807 records). [2025-10-09T22:35:01.674812] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-09T22:35:01.677691] [INFO ] [MAIN ] Derivative Progress: 145/1690 symbols completed. AUB took 1.0s. Estimated remaining: 10m 9s. Rate: 152.3 symbols/min [2025-10-09T22:35:01.687673] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:01.718933] [DEBUG] [MAIN ] AUNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:01.721083] [INFO ] [MAIN ] AUNA: Generated 1807 derivative records from 5085 primary records. [2025-10-09T22:35:01.721951] [DEBUG] [LOCAL ] AVA: Loaded 39336 existing records from primary storage. [2025-10-09T22:35:01.722097] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-09T22:35:01.726246] [DEBUG] [LOCAL ] AVAL: Loaded 8696 existing records from primary storage. [2025-10-09T22:35:01.726351] [INFO ] [MAIN ] AVA: Loaded 39336 primary data records. [2025-10-09T22:35:01.727495] [INFO ] [MAIN ] AVAL: Loaded 8696 primary data records. [2025-10-09T22:35:02.231323] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1807 records). [2025-10-09T22:35:02.307955] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-09T22:35:02.338149] [INFO ] [MAIN ] Derivative Progress: 146/1690 symbols completed. AUNA took 1.5s. Estimated remaining: 10m 11s. Rate: 151.6 symbols/min [2025-10-09T22:35:02.339292] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:02.501739] [DEBUG] [LOCAL ] AVD: Loaded 22339 existing records from primary storage. [2025-10-09T22:35:02.502259] [INFO ] [MAIN ] AVD: Loaded 22339 primary data records. [2025-10-09T22:35:02.615604] [DEBUG] [MAIN ] AVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:02.641887] [INFO ] [MAIN ] AVA: Generated 1807 derivative records from 39336 primary records. [2025-10-09T22:35:02.651502] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-09T22:35:02.676175] [DEBUG] [MAIN ] AVAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:02.756689] [INFO ] [MAIN ] AVAL: Generated 1807 derivative records from 8696 primary records. [2025-10-09T22:35:02.877305] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-09T22:35:02.912626] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1807 records). [2025-10-09T22:35:02.913973] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-09T22:35:02.914600] [DEBUG] [LOCAL ] AVA: Derivative data saved (1807 records). [2025-10-09T22:35:02.918060] [INFO ] [MAIN ] Derivative Progress: 147/1690 symbols completed. AVAL took 1.2s. Estimated remaining: 10m 13s. Rate: 151.1 symbols/min [2025-10-09T22:35:02.918707] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-09T22:35:02.920996] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:02.921540] [INFO ] [MAIN ] Derivative Progress: 148/1690 symbols completed. AVA took 1.3s. Estimated remaining: 10m 8s. Rate: 152.1 symbols/min [2025-10-09T22:35:02.947965] [DEBUG] [MAIN ] AVD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:02.948772] [INFO ] [MAIN ] AVD: Generated 1807 derivative records from 22339 primary records. [2025-10-09T22:35:02.948902] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-09T22:35:02.967356] [DEBUG] [LOCAL ] AVK: Loaded 18448 existing records from primary storage. [2025-10-09T22:35:02.968478] [INFO ] [MAIN ] AVK: Loaded 18448 primary data records. [2025-10-09T22:35:03.073805] [DEBUG] [LOCAL ] AVD: Derivative data saved (1807 records). [2025-10-09T22:35:03.074016] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-09T22:35:03.077279] [INFO ] [MAIN ] Derivative Progress: 149/1690 symbols completed. AVD took 0.7s. Estimated remaining: 10m 5s. Rate: 152.7 symbols/min [2025-10-09T22:35:03.284770] [DEBUG] [MAIN ] AVK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:03.285466] [INFO ] [MAIN ] AVK: Generated 1807 derivative records from 18448 primary records. [2025-10-09T22:35:03.285528] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-09T22:35:03.300872] [DEBUG] [LOCAL ] AVK: Derivative data saved (1807 records). [2025-10-09T22:35:03.300977] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-09T22:35:03.303320] [INFO ] [MAIN ] Derivative Progress: 150/1690 symbols completed. AVK took 0.4s. Estimated remaining: 10m 3s. Rate: 153.2 symbols/min [2025-10-09T22:35:03.303993] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:03.304125] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:03.304313] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:03.358924] [DEBUG] [LOCAL ] AVNS: Loaded 33765 existing records from primary storage. [2025-10-09T22:35:03.368410] [INFO ] [MAIN ] AVNS: Loaded 33765 primary data records. [2025-10-09T22:35:03.520235] [DEBUG] [LOCAL ] AVY: Loaded 37848 existing records from primary storage. [2025-10-09T22:35:03.525776] [INFO ] [MAIN ] AVY: Loaded 37848 primary data records. [2025-10-09T22:35:03.599323] [DEBUG] [LOCAL ] AVTR: Loaded 53951 existing records from primary storage. [2025-10-09T22:35:03.757465] [INFO ] [MAIN ] AVTR: Loaded 53951 primary data records. [2025-10-09T22:35:04.415240] [DEBUG] [MAIN ] AVNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:04.416153] [INFO ] [MAIN ] AVNS: Generated 1807 derivative records from 33765 primary records. [2025-10-09T22:35:04.416491] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-09T22:35:04.434082] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1807 records). [2025-10-09T22:35:04.435476] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-09T22:35:04.439149] [INFO ] [MAIN ] Derivative Progress: 151/1690 symbols completed. AVNS took 1.1s. Estimated remaining: 10m 10s. Rate: 151.3 symbols/min [2025-10-09T22:35:04.439509] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:04.453760] [DEBUG] [MAIN ] AVTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:04.454512] [INFO ] [MAIN ] AVTR: Generated 1807 derivative records from 53951 primary records. [2025-10-09T22:35:04.454814] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-09T22:35:04.491884] [DEBUG] [MAIN ] AVY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:04.493685] [INFO ] [MAIN ] AVY: Generated 1807 derivative records from 37848 primary records. [2025-10-09T22:35:04.492957] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1807 records). [2025-10-09T22:35:04.493827] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-09T22:35:04.494579] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-09T22:35:04.498287] [INFO ] [MAIN ] Derivative Progress: 152/1690 symbols completed. AVTR took 1.2s. Estimated remaining: 10m 7s. Rate: 152.1 symbols/min [2025-10-09T22:35:04.510322] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:04.522421] [DEBUG] [LOCAL ] AVY: Derivative data saved (1807 records). [2025-10-09T22:35:04.522550] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-09T22:35:04.525490] [INFO ] [MAIN ] Derivative Progress: 153/1690 symbols completed. AVY took 1.2s. Estimated remaining: 10m 3s. Rate: 153.1 symbols/min [2025-10-09T22:35:04.526445] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:04.526269] [DEBUG] [LOCAL ] AWF: Loaded 24414 existing records from primary storage. [2025-10-09T22:35:04.526793] [INFO ] [MAIN ] AWF: Loaded 24414 primary data records. [2025-10-09T22:35:04.811393] [DEBUG] [LOCAL ] AWI: Loaded 25458 existing records from primary storage. [2025-10-09T22:35:04.851524] [INFO ] [MAIN ] AWI: Loaded 25458 primary data records. [2025-10-09T22:35:04.970629] [DEBUG] [LOCAL ] AWK: Loaded 49030 existing records from primary storage. [2025-10-09T22:35:04.986561] [INFO ] [MAIN ] AWK: Loaded 49030 primary data records. [2025-10-09T22:35:05.480713] [DEBUG] [MAIN ] AWF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:05.482190] [INFO ] [MAIN ] AWF: Generated 1807 derivative records from 24414 primary records. [2025-10-09T22:35:05.482297] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-09T22:35:05.500008] [DEBUG] [LOCAL ] AWF: Derivative data saved (1807 records). [2025-10-09T22:35:05.500670] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-09T22:35:05.502871] [INFO ] [MAIN ] Derivative Progress: 154/1690 symbols completed. AWF took 1.1s. Estimated remaining: 10m 8s. Rate: 151.6 symbols/min [2025-10-09T22:35:05.503160] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:05.521400] [DEBUG] [MAIN ] AWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:05.522152] [INFO ] [MAIN ] AWI: Generated 1807 derivative records from 25458 primary records. [2025-10-09T22:35:05.522461] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-09T22:35:05.544917] [DEBUG] [LOCAL ] AWI: Derivative data saved (1807 records). [2025-10-09T22:35:05.546076] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-09T22:35:05.548831] [INFO ] [MAIN ] Derivative Progress: 155/1690 symbols completed. AWI took 1.0s. Estimated remaining: 10m 4s. Rate: 152.5 symbols/min [2025-10-09T22:35:05.549856] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:05.558942] [DEBUG] [LOCAL ] AWR: Loaded 22850 existing records from primary storage. [2025-10-09T22:35:05.571278] [INFO ] [MAIN ] AWR: Loaded 22850 primary data records. [2025-10-09T22:35:05.571525] [DEBUG] [MAIN ] AWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:05.572334] [INFO ] [MAIN ] AWK: Generated 1807 derivative records from 49030 primary records. [2025-10-09T22:35:05.608257] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-09T22:35:05.755509] [DEBUG] [LOCAL ] AWK: Derivative data saved (1807 records). [2025-10-09T22:35:05.787828] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-09T22:35:05.913121] [INFO ] [MAIN ] Derivative Progress: 156/1690 symbols completed. AWK took 1.4s. Estimated remaining: 10m 3s. Rate: 152.5 symbols/min [2025-10-09T22:35:05.922776] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:05.924020] [DEBUG] [LOCAL ] AXL: Loaded 50878 existing records from primary storage. [2025-10-09T22:35:05.924183] [INFO ] [MAIN ] AXL: Loaded 50878 primary data records. [2025-10-09T22:35:06.029100] [DEBUG] [LOCAL ] AXR: Loaded 3001 existing records from primary storage. [2025-10-09T22:35:06.032511] [INFO ] [MAIN ] AXR: Loaded 3001 primary data records. [2025-10-09T22:35:06.600394] [DEBUG] [MAIN ] AWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:06.601422] [INFO ] [MAIN ] AWR: Generated 1807 derivative records from 22850 primary records. [2025-10-09T22:35:06.601521] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-09T22:35:06.636530] [DEBUG] [MAIN ] AXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:06.637514] [DEBUG] [LOCAL ] AWR: Derivative data saved (1807 records). [2025-10-09T22:35:06.637783] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-09T22:35:06.638616] [INFO ] [MAIN ] AXL: Generated 1807 derivative records from 50878 primary records. [2025-10-09T22:35:06.641253] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-09T22:35:06.641057] [INFO ] [MAIN ] Derivative Progress: 157/1690 symbols completed. AWR took 1.1s. Estimated remaining: 10m 6s. Rate: 151.7 symbols/min [2025-10-09T22:35:06.642143] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:06.660789] [DEBUG] [LOCAL ] AXL: Derivative data saved (1807 records). [2025-10-09T22:35:06.661270] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-09T22:35:06.663945] [INFO ] [MAIN ] Derivative Progress: 158/1690 symbols completed. AXL took 1.1s. Estimated remaining: 10m 2s. Rate: 152.6 symbols/min [2025-10-09T22:35:06.664220] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:06.677742] [DEBUG] [MAIN ] AXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:06.678583] [INFO ] [MAIN ] AXR: Generated 1807 derivative records from 3001 primary records. [2025-10-09T22:35:06.678667] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-09T22:35:06.693486] [DEBUG] [LOCAL ] AXR: Derivative data saved (1807 records). [2025-10-09T22:35:06.693665] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-09T22:35:06.696623] [INFO ] [MAIN ] Derivative Progress: 159/1690 symbols completed. AXR took 0.8s. Estimated remaining: 9m 58s. Rate: 153.5 symbols/min [2025-10-09T22:35:06.702092] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:06.744957] [DEBUG] [LOCAL ] AXS: Loaded 38952 existing records from primary storage. [2025-10-09T22:35:06.745270] [INFO ] [MAIN ] AXS: Loaded 38952 primary data records. [2025-10-09T22:35:06.879688] [DEBUG] [LOCAL ] AXTA: Loaded 52567 existing records from primary storage. [2025-10-09T22:35:06.879954] [INFO ] [MAIN ] AXTA: Loaded 52567 primary data records. [2025-10-09T22:35:07.036569] [DEBUG] [LOCAL ] AYI: Loaded 25419 existing records from primary storage. [2025-10-09T22:35:07.199429] [INFO ] [MAIN ] AYI: Loaded 25419 primary data records. [2025-10-09T22:35:07.713416] [DEBUG] [MAIN ] AXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:07.714878] [INFO ] [MAIN ] AXS: Generated 1807 derivative records from 38952 primary records. [2025-10-09T22:35:07.715145] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-09T22:35:07.739776] [DEBUG] [LOCAL ] AXS: Derivative data saved (1807 records). [2025-10-09T22:35:07.747380] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-09T22:35:07.749472] [INFO ] [MAIN ] Derivative Progress: 160/1690 symbols completed. AXS took 1.1s. Estimated remaining: 10m 4s. Rate: 151.9 symbols/min [2025-10-09T22:35:07.754480] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:07.754796] [DEBUG] [MAIN ] AXTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:07.755850] [INFO ] [MAIN ] AXTA: Generated 1807 derivative records from 52567 primary records. [2025-10-09T22:35:07.756395] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-09T22:35:07.775555] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1807 records). [2025-10-09T22:35:07.778092] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-09T22:35:07.780687] [INFO ] [MAIN ] Derivative Progress: 161/1690 symbols completed. AXTA took 1.1s. Estimated remaining: 10m 1s. Rate: 152.8 symbols/min [2025-10-09T22:35:07.780903] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:07.799438] [DEBUG] [LOCAL ] AZO: Loaded 11333 existing records from primary storage. [2025-10-09T22:35:07.794506] [DEBUG] [MAIN ] AYI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:35:07.800235] [INFO ] [MAIN ] AYI: Generated 1806 derivative records from 25419 primary records. [2025-10-09T22:35:07.800409] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-09T22:35:07.800490] [INFO ] [MAIN ] AZO: Loaded 11333 primary data records. [2025-10-09T22:35:07.871629] [DEBUG] [LOCAL ] AYI: Derivative data saved (1806 records). [2025-10-09T22:35:07.908138] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-09T22:35:07.927502] [INFO ] [MAIN ] Derivative Progress: 162/1690 symbols completed. AYI took 1.2s. Estimated remaining: 9m 58s. Rate: 153.4 symbols/min [2025-10-09T22:35:07.948950] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:08.157762] [DEBUG] [LOCAL ] AZZ: Loaded 22454 existing records from primary storage. [2025-10-09T22:35:08.182053] [INFO ] [MAIN ] AZZ: Loaded 22454 primary data records. [2025-10-09T22:35:08.565000] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-09T22:35:08.565462] [INFO ] [MAIN ] BA: Loaded 54180 primary data records. [2025-10-09T22:35:08.735095] [DEBUG] [MAIN ] AZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:08.766386] [INFO ] [MAIN ] AZO: Generated 1807 derivative records from 11333 primary records. [2025-10-09T22:35:08.882848] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-09T22:35:08.905473] [DEBUG] [LOCAL ] AZO: Derivative data saved (1807 records). [2025-10-09T22:35:08.907252] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-09T22:35:08.910394] [INFO ] [MAIN ] Derivative Progress: 163/1690 symbols completed. AZO took 1.2s. Estimated remaining: 10m 3s. Rate: 152.0 symbols/min [2025-10-09T22:35:08.926708] [DEBUG] [MAIN ] AZZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:08.927493] [INFO ] [MAIN ] AZZ: Generated 1807 derivative records from 22454 primary records. [2025-10-09T22:35:08.927736] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-09T22:35:08.945381] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1807 records). [2025-10-09T22:35:08.946399] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-09T22:35:08.949722] [INFO ] [MAIN ] Derivative Progress: 164/1690 symbols completed. AZZ took 1.2s. Estimated remaining: 9m 59s. Rate: 152.8 symbols/min [2025-10-09T22:35:08.964240] [DEBUG] [MAIN ] BA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:08.964846] [INFO ] [MAIN ] BA: Generated 1807 derivative records from 54180 primary records. [2025-10-09T22:35:08.964910] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-09T22:35:08.981941] [DEBUG] [LOCAL ] BA: Derivative data saved (1807 records). [2025-10-09T22:35:08.982016] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-09T22:35:08.984921] [INFO ] [MAIN ] Derivative Progress: 165/1690 symbols completed. BA took 1.0s. Estimated remaining: 9m 56s. Rate: 153.6 symbols/min [2025-10-09T22:35:08.985417] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:08.985345] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:08.985678] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:09.056107] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-09T22:35:09.056325] [INFO ] [MAIN ] BAC: Loaded 54198 primary data records. [2025-10-09T22:35:09.227188] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-09T22:35:09.226517] [DEBUG] [LOCAL ] BAH: Loaded 52055 existing records from primary storage. [2025-10-09T22:35:09.227873] [INFO ] [MAIN ] BAH: Loaded 52055 primary data records. [2025-10-09T22:35:09.233216] [INFO ] [MAIN ] BABA: Loaded 54210 primary data records. [2025-10-09T22:35:10.109406] [DEBUG] [MAIN ] BAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:10.110231] [INFO ] [MAIN ] BAC: Generated 1807 derivative records from 54198 primary records. [2025-10-09T22:35:10.110425] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-09T22:35:10.152300] [DEBUG] [LOCAL ] BAC: Derivative data saved (1807 records). [2025-10-09T22:35:10.152434] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-09T22:35:10.155207] [INFO ] [MAIN ] Derivative Progress: 166/1690 symbols completed. BAC took 1.2s. Estimated remaining: 10m 2s. Rate: 151.8 symbols/min [2025-10-09T22:35:10.150908] [DEBUG] [MAIN ] BAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:10.155527] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:10.169270] [INFO ] [MAIN ] BAH: Generated 1807 derivative records from 52055 primary records. [2025-10-09T22:35:10.169913] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-09T22:35:10.170222] [DEBUG] [MAIN ] BABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:10.171981] [INFO ] [MAIN ] BABA: Generated 1807 derivative records from 54210 primary records. [2025-10-09T22:35:10.172253] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-09T22:35:10.211168] [DEBUG] [LOCAL ] BABA: Derivative data saved (1807 records). [2025-10-09T22:35:10.211399] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-09T22:35:10.215582] [INFO ] [MAIN ] Derivative Progress: 167/1690 symbols completed. BABA took 1.2s. Estimated remaining: 9m 59s. Rate: 152.6 symbols/min [2025-10-09T22:35:10.217133] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:10.228437] [DEBUG] [LOCAL ] BAH: Derivative data saved (1807 records). [2025-10-09T22:35:10.229959] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-09T22:35:10.233224] [INFO ] [MAIN ] Derivative Progress: 168/1690 symbols completed. BAH took 1.2s. Estimated remaining: 9m 55s. Rate: 153.5 symbols/min [2025-10-09T22:35:10.233658] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:10.250841] [DEBUG] [LOCAL ] BAK: Loaded 39681 existing records from primary storage. [2025-10-09T22:35:10.251128] [INFO ] [MAIN ] BAK: Loaded 39681 primary data records. [2025-10-09T22:35:10.685281] [DEBUG] [LOCAL ] BALL: Loaded 52213 existing records from primary storage. [2025-10-09T22:35:10.686262] [INFO ] [MAIN ] BALL: Loaded 52213 primary data records. [2025-10-09T22:35:10.687135] [DEBUG] [LOCAL ] BAM: Loaded 52387 existing records from primary storage. [2025-10-09T22:35:10.718260] [INFO ] [MAIN ] BAM: Loaded 52387 primary data records. [2025-10-09T22:35:11.399204] [DEBUG] [MAIN ] BAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:11.400826] [INFO ] [MAIN ] BAK: Generated 1807 derivative records from 39681 primary records. [2025-10-09T22:35:11.401636] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-09T22:35:11.420474] [DEBUG] [LOCAL ] BAK: Derivative data saved (1807 records). [2025-10-09T22:35:11.420757] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-09T22:35:11.423787] [INFO ] [MAIN ] Derivative Progress: 169/1690 symbols completed. BAK took 1.3s. Estimated remaining: 10m 2s. Rate: 151.6 symbols/min [2025-10-09T22:35:11.425042] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:11.446325] [DEBUG] [MAIN ] BALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:11.449839] [INFO ] [MAIN ] BALL: Generated 1807 derivative records from 52213 primary records. [2025-10-09T22:35:11.450082] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-09T22:35:11.471623] [DEBUG] [MAIN ] BAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:11.473566] [INFO ] [MAIN ] BAM: Generated 1807 derivative records from 52387 primary records. [2025-10-09T22:35:11.476400] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-09T22:35:11.480601] [DEBUG] [LOCAL ] BALL: Derivative data saved (1807 records). [2025-10-09T22:35:11.480992] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-09T22:35:11.483713] [INFO ] [MAIN ] Derivative Progress: 170/1690 symbols completed. BALL took 1.3s. Estimated remaining: 9m 58s. Rate: 152.4 symbols/min [2025-10-09T22:35:11.492117] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:11.515982] [DEBUG] [LOCAL ] BAM: Derivative data saved (1807 records). [2025-10-09T22:35:11.516113] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-09T22:35:11.519087] [INFO ] [MAIN ] Derivative Progress: 171/1690 symbols completed. BAM took 1.3s. Estimated remaining: 9m 55s. Rate: 153.2 symbols/min [2025-10-09T22:35:11.519441] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:11.556015] [DEBUG] [LOCAL ] BANC: Loaded 51663 existing records from primary storage. [2025-10-09T22:35:11.556787] [DEBUG] [LOCAL ] BAP: Loaded 26069 existing records from primary storage. [2025-10-09T22:35:11.557189] [INFO ] [MAIN ] BAP: Loaded 26069 primary data records. [2025-10-09T22:35:11.557067] [INFO ] [MAIN ] BANC: Loaded 51663 primary data records. [2025-10-09T22:35:11.857177] [DEBUG] [LOCAL ] BARK: Loaded 38242 existing records from primary storage. [2025-10-09T22:35:11.916706] [INFO ] [MAIN ] BARK: Loaded 38242 primary data records. [2025-10-09T22:35:12.633365] [DEBUG] [MAIN ] BAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:12.634872] [INFO ] [MAIN ] BAP: Generated 1807 derivative records from 26069 primary records. [2025-10-09T22:35:12.635012] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-09T22:35:12.634035] [DEBUG] [MAIN ] BANC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:12.636957] [INFO ] [MAIN ] BANC: Generated 1807 derivative records from 51663 primary records. [2025-10-09T22:35:12.653913] [DEBUG] [LOCAL ] BAP: Derivative data saved (1807 records). [2025-10-09T22:35:12.654148] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-09T22:35:12.656792] [INFO ] [MAIN ] Derivative Progress: 172/1690 symbols completed. BAP took 1.2s. Estimated remaining: 10m 1s. Rate: 151.5 symbols/min [2025-10-09T22:35:12.646734] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-09T22:35:12.657229] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:12.676607] [DEBUG] [LOCAL ] BANC: Derivative data saved (1807 records). [2025-10-09T22:35:12.677130] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-09T22:35:12.679242] [INFO ] [MAIN ] Derivative Progress: 173/1690 symbols completed. BANC took 1.3s. Estimated remaining: 9m 57s. Rate: 152.4 symbols/min [2025-10-09T22:35:12.679958] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:12.701256] [DEBUG] [MAIN ] BARK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:12.701952] [INFO ] [MAIN ] BARK: Generated 1807 derivative records from 38242 primary records. [2025-10-09T22:35:12.702103] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-09T22:35:12.736858] [DEBUG] [LOCAL ] BARK: Derivative data saved (1807 records). [2025-10-09T22:35:12.737007] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-09T22:35:12.740267] [INFO ] [MAIN ] Derivative Progress: 174/1690 symbols completed. BARK took 1.2s. Estimated remaining: 9m 54s. Rate: 153.1 symbols/min [2025-10-09T22:35:12.740547] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:12.773118] [DEBUG] [LOCAL ] BAX: Loaded 53893 existing records from primary storage. [2025-10-09T22:35:12.773282] [INFO ] [MAIN ] BAX: Loaded 53893 primary data records. [2025-10-09T22:35:12.898149] [DEBUG] [LOCAL ] BB: Loaded 53323 existing records from primary storage. [2025-10-09T22:35:12.902210] [INFO ] [MAIN ] BB: Loaded 53323 primary data records. [2025-10-09T22:35:13.271048] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-09T22:35:13.308076] [INFO ] [MAIN ] BBAI: Loaded 54210 primary data records. [2025-10-09T22:35:13.822831] [DEBUG] [MAIN ] BAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:13.824064] [INFO ] [MAIN ] BAX: Generated 1807 derivative records from 53893 primary records. [2025-10-09T22:35:13.825368] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-09T22:35:13.854434] [DEBUG] [MAIN ] BB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:13.855281] [INFO ] [MAIN ] BB: Generated 1807 derivative records from 53323 primary records. [2025-10-09T22:35:13.855773] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-09T22:35:13.878038] [DEBUG] [LOCAL ] BAX: Derivative data saved (1807 records). [2025-10-09T22:35:13.879350] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-09T22:35:13.881739] [INFO ] [MAIN ] Derivative Progress: 175/1690 symbols completed. BAX took 1.2s. Estimated remaining: 10m 0s. Rate: 151.4 symbols/min [2025-10-09T22:35:13.881972] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:13.896306] [DEBUG] [LOCAL ] BB: Derivative data saved (1807 records). [2025-10-09T22:35:13.896420] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-09T22:35:13.895994] [DEBUG] [MAIN ] BBAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:13.900039] [INFO ] [MAIN ] Derivative Progress: 176/1690 symbols completed. BB took 1.2s. Estimated remaining: 9m 57s. Rate: 152.3 symbols/min [2025-10-09T22:35:13.900337] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:13.897278] [INFO ] [MAIN ] BBAI: Generated 1807 derivative records from 54210 primary records. [2025-10-09T22:35:13.900577] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-09T22:35:13.917732] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1807 records). [2025-10-09T22:35:13.917828] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-09T22:35:13.921025] [INFO ] [MAIN ] Derivative Progress: 177/1690 symbols completed. BBAI took 1.2s. Estimated remaining: 9m 53s. Rate: 153.1 symbols/min [2025-10-09T22:35:13.921422] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:13.993889] [DEBUG] [LOCAL ] BBD: Loaded 53631 existing records from primary storage. [2025-10-09T22:35:13.994212] [INFO ] [MAIN ] BBD: Loaded 53631 primary data records. [2025-10-09T22:35:14.007530] [DEBUG] [LOCAL ] BBAR: Loaded 42187 existing records from primary storage. [2025-10-09T22:35:14.060969] [DEBUG] [LOCAL ] BBDC: Loaded 33271 existing records from primary storage. [2025-10-09T22:35:14.074747] [INFO ] [MAIN ] BBDC: Loaded 33271 primary data records. [2025-10-09T22:35:14.042144] [INFO ] [MAIN ] BBAR: Loaded 42187 primary data records. [2025-10-09T22:35:15.020945] [DEBUG] [MAIN ] BBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:15.023815] [INFO ] [MAIN ] BBD: Generated 1807 derivative records from 53631 primary records. [2025-10-09T22:35:15.024004] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-09T22:35:15.051273] [DEBUG] [MAIN ] BBAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:15.052543] [INFO ] [MAIN ] BBAR: Generated 1807 derivative records from 42187 primary records. [2025-10-09T22:35:15.053490] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-09T22:35:15.071018] [DEBUG] [LOCAL ] BBD: Derivative data saved (1807 records). [2025-10-09T22:35:15.071628] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-09T22:35:15.075193] [INFO ] [MAIN ] Derivative Progress: 178/1690 symbols completed. BBD took 1.2s. Estimated remaining: 9m 59s. Rate: 151.4 symbols/min [2025-10-09T22:35:15.091240] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1807 records). [2025-10-09T22:35:15.091461] [DEBUG] [MAIN ] BBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:15.091676] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-09T22:35:15.094283] [INFO ] [MAIN ] Derivative Progress: 179/1690 symbols completed. BBAR took 1.2s. Estimated remaining: 9m 56s. Rate: 152.2 symbols/min [2025-10-09T22:35:15.095133] [INFO ] [MAIN ] BBDC: Generated 1807 derivative records from 33271 primary records. [2025-10-09T22:35:15.095204] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-09T22:35:15.110764] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1807 records). [2025-10-09T22:35:15.110825] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-09T22:35:15.113736] [INFO ] [MAIN ] Derivative Progress: 180/1690 symbols completed. BBDC took 1.2s. Estimated remaining: 9m 52s. Rate: 153.0 symbols/min [2025-10-09T22:35:15.114294] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:15.114217] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:15.114812] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:15.129841] [DEBUG] [LOCAL ] BBDO: Loaded 5042 existing records from primary storage. [2025-10-09T22:35:15.135246] [INFO ] [MAIN ] BBDO: Loaded 5042 primary data records. [2025-10-09T22:35:15.135044] [DEBUG] [LOCAL ] BBUC: Loaded 13573 existing records from primary storage. [2025-10-09T22:35:15.156340] [INFO ] [MAIN ] BBUC: Loaded 13573 primary data records. [2025-10-09T22:35:15.315984] [DEBUG] [LOCAL ] BBN: Loaded 18140 existing records from primary storage. [2025-10-09T22:35:15.355680] [INFO ] [MAIN ] BBN: Loaded 18140 primary data records. [2025-10-09T22:35:16.118218] [DEBUG] [MAIN ] BBDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:16.119806] [INFO ] [MAIN ] BBDO: Generated 1807 derivative records from 5042 primary records. [2025-10-09T22:35:16.120223] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-09T22:35:16.167951] [DEBUG] [MAIN ] BBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:16.168601] [DEBUG] [MAIN ] BBUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:16.169826] [INFO ] [MAIN ] BBUC: Generated 1807 derivative records from 13573 primary records. [2025-10-09T22:35:16.170212] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-09T22:35:16.171789] [INFO ] [MAIN ] BBN: Generated 1807 derivative records from 18140 primary records. [2025-10-09T22:35:16.172331] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-09T22:35:16.175007] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1807 records). [2025-10-09T22:35:16.185918] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-09T22:35:16.196078] [INFO ] [MAIN ] Derivative Progress: 181/1690 symbols completed. BBDO took 1.1s. Estimated remaining: 9m 57s. Rate: 151.6 symbols/min [2025-10-09T22:35:16.201210] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:16.204792] [DEBUG] [LOCAL ] BBN: Derivative data saved (1807 records). [2025-10-09T22:35:16.208135] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-09T22:35:16.211244] [INFO ] [MAIN ] Derivative Progress: 182/1690 symbols completed. BBN took 1.1s. Estimated remaining: 9m 54s. Rate: 152.4 symbols/min [2025-10-09T22:35:16.211394] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:16.213815] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1807 records). [2025-10-09T22:35:16.213898] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-09T22:35:16.216297] [INFO ] [MAIN ] Derivative Progress: 183/1690 symbols completed. BBUC took 1.1s. Estimated remaining: 9m 50s. Rate: 153.2 symbols/min [2025-10-09T22:35:16.216681] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:16.254675] [DEBUG] [LOCAL ] BBW: Loaded 27318 existing records from primary storage. [2025-10-09T22:35:16.254896] [INFO ] [MAIN ] BBW: Loaded 27318 primary data records. [2025-10-09T22:35:16.468487] [DEBUG] [LOCAL ] BBVA: Loaded 49530 existing records from primary storage. [2025-10-09T22:35:16.522604] [INFO ] [MAIN ] BBVA: Loaded 49530 primary data records. [2025-10-09T22:35:16.638321] [DEBUG] [LOCAL ] BBWI: Loaded 53972 existing records from primary storage. [2025-10-09T22:35:16.680893] [INFO ] [MAIN ] BBWI: Loaded 53972 primary data records. [2025-10-09T22:35:17.311607] [DEBUG] [MAIN ] BBW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:17.314400] [INFO ] [MAIN ] BBW: Generated 1807 derivative records from 27318 primary records. [2025-10-09T22:35:17.315027] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-09T22:35:17.341286] [DEBUG] [LOCAL ] BBW: Derivative data saved (1807 records). [2025-10-09T22:35:17.349742] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-09T22:35:17.357367] [INFO ] [MAIN ] Derivative Progress: 184/1690 symbols completed. BBW took 1.1s. Estimated remaining: 9m 56s. Rate: 151.6 symbols/min [2025-10-09T22:35:17.358390] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:17.360577] [DEBUG] [MAIN ] BBVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:17.362740] [INFO ] [MAIN ] BBVA: Generated 1807 derivative records from 49530 primary records. [2025-10-09T22:35:17.362830] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-09T22:35:17.395050] [DEBUG] [MAIN ] BBWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:17.396499] [INFO ] [MAIN ] BBWI: Generated 1807 derivative records from 53972 primary records. [2025-10-09T22:35:17.396941] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-09T22:35:17.413449] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1807 records). [2025-10-09T22:35:17.413695] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-09T22:35:17.416901] [INFO ] [MAIN ] Derivative Progress: 185/1690 symbols completed. BBVA took 1.2s. Estimated remaining: 9m 53s. Rate: 152.3 symbols/min [2025-10-09T22:35:17.417301] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:17.421736] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1807 records). [2025-10-09T22:35:17.421835] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-09T22:35:17.424686] [INFO ] [MAIN ] Derivative Progress: 186/1690 symbols completed. BBWI took 1.2s. Estimated remaining: 9m 49s. Rate: 153.1 symbols/min [2025-10-09T22:35:17.424878] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:17.465358] [DEBUG] [LOCAL ] BBY: Loaded 53840 existing records from primary storage. [2025-10-09T22:35:17.465577] [INFO ] [MAIN ] BBY: Loaded 53840 primary data records. [2025-10-09T22:35:17.596888] [DEBUG] [LOCAL ] BCAT: Loaded 34322 existing records from primary storage. [2025-10-09T22:35:17.622553] [INFO ] [MAIN ] BCAT: Loaded 34322 primary data records. [2025-10-09T22:35:17.694586] [DEBUG] [LOCAL ] BC: Loaded 44402 existing records from primary storage. [2025-10-09T22:35:17.798179] [INFO ] [MAIN ] BC: Loaded 44402 primary data records. [2025-10-09T22:35:18.552326] [DEBUG] [MAIN ] BBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:18.554533] [INFO ] [MAIN ] BBY: Generated 1807 derivative records from 53840 primary records. [2025-10-09T22:35:18.555045] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-09T22:35:18.576414] [DEBUG] [MAIN ] BCAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:18.582375] [INFO ] [MAIN ] BCAT: Generated 1807 derivative records from 34322 primary records. [2025-10-09T22:35:18.583007] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-09T22:35:18.587114] [DEBUG] [LOCAL ] BBY: Derivative data saved (1807 records). [2025-10-09T22:35:18.587735] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-09T22:35:18.590272] [INFO ] [MAIN ] Derivative Progress: 187/1690 symbols completed. BBY took 1.2s. Estimated remaining: 9m 55s. Rate: 151.5 symbols/min [2025-10-09T22:35:18.590464] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:18.610013] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1807 records). [2025-10-09T22:35:18.610283] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-09T22:35:18.613146] [INFO ] [MAIN ] Derivative Progress: 188/1690 symbols completed. BCAT took 1.2s. Estimated remaining: 9m 52s. Rate: 152.3 symbols/min [2025-10-09T22:35:18.620952] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:18.626348] [DEBUG] [MAIN ] BC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:18.627191] [INFO ] [MAIN ] BC: Generated 1807 derivative records from 44402 primary records. [2025-10-09T22:35:18.627615] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-09T22:35:18.664960] [DEBUG] [LOCAL ] BC: Derivative data saved (1807 records). [2025-10-09T22:35:18.666617] [DEBUG] [LOCAL ] BCC: Loaded 28437 existing records from primary storage. [2025-10-09T22:35:18.666761] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-09T22:35:18.669768] [INFO ] [MAIN ] Derivative Progress: 189/1690 symbols completed. BC took 1.3s. Estimated remaining: 9m 49s. Rate: 153.0 symbols/min [2025-10-09T22:35:18.670083] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:18.667029] [INFO ] [MAIN ] BCC: Loaded 28437 primary data records. [2025-10-09T22:35:18.904191] [DEBUG] [LOCAL ] BCH: Loaded 30038 existing records from primary storage. [2025-10-09T22:35:19.042441] [INFO ] [MAIN ] BCH: Loaded 30038 primary data records. [2025-10-09T22:35:19.049214] [DEBUG] [LOCAL ] BCE: Loaded 52590 existing records from primary storage. [2025-10-09T22:35:19.078422] [INFO ] [MAIN ] BCE: Loaded 52590 primary data records. [2025-10-09T22:35:19.721886] [DEBUG] [MAIN ] BCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:19.723046] [INFO ] [MAIN ] BCC: Generated 1807 derivative records from 28437 primary records. [2025-10-09T22:35:19.724682] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-09T22:35:19.744547] [DEBUG] [LOCAL ] BCC: Derivative data saved (1807 records). [2025-10-09T22:35:19.744767] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-09T22:35:19.747132] [INFO ] [MAIN ] Derivative Progress: 190/1690 symbols completed. BCC took 1.2s. Estimated remaining: 9m 54s. Rate: 151.6 symbols/min [2025-10-09T22:35:19.747285] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:19.767572] [DEBUG] [MAIN ] BCH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:19.768451] [INFO ] [MAIN ] BCH: Generated 1807 derivative records from 30038 primary records. [2025-10-09T22:35:19.768756] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-09T22:35:19.809436] [DEBUG] [LOCAL ] BCH: Derivative data saved (1807 records). [2025-10-09T22:35:19.810119] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-09T22:35:19.812884] [INFO ] [MAIN ] Derivative Progress: 191/1690 symbols completed. BCH took 1.1s. Estimated remaining: 9m 51s. Rate: 152.3 symbols/min [2025-10-09T22:35:19.813069] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:19.809901] [DEBUG] [MAIN ] BCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:19.814273] [INFO ] [MAIN ] BCE: Generated 1807 derivative records from 52590 primary records. [2025-10-09T22:35:19.814886] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-09T22:35:19.841768] [DEBUG] [LOCAL ] BCO: Loaded 25899 existing records from primary storage. [2025-10-09T22:35:19.846286] [DEBUG] [LOCAL ] BCE: Derivative data saved (1807 records). [2025-10-09T22:35:19.846426] [INFO ] [MAIN ] BCO: Loaded 25899 primary data records. [2025-10-09T22:35:19.846632] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-09T22:35:19.850229] [INFO ] [MAIN ] Derivative Progress: 192/1690 symbols completed. BCE took 1.2s. Estimated remaining: 9m 48s. Rate: 153.0 symbols/min [2025-10-09T22:35:19.850583] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:20.074020] [DEBUG] [LOCAL ] BCX: Loaded 21780 existing records from primary storage. [2025-10-09T22:35:20.091478] [INFO ] [MAIN ] BCX: Loaded 21780 primary data records. [2025-10-09T22:35:20.092474] [DEBUG] [LOCAL ] BCSF: Loaded 28234 existing records from primary storage. [2025-10-09T22:35:20.214472] [INFO ] [MAIN ] BCSF: Loaded 28234 primary data records. [2025-10-09T22:35:20.938021] [DEBUG] [MAIN ] BCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:20.940216] [INFO ] [MAIN ] BCO: Generated 1807 derivative records from 25899 primary records. [2025-10-09T22:35:20.940431] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-09T22:35:20.962945] [DEBUG] [LOCAL ] BCO: Derivative data saved (1807 records). [2025-10-09T22:35:20.963295] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-09T22:35:20.965889] [INFO ] [MAIN ] Derivative Progress: 193/1690 symbols completed. BCO took 1.2s. Estimated remaining: 9m 53s. Rate: 151.5 symbols/min [2025-10-09T22:35:20.982519] [DEBUG] [MAIN ] BCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:20.984417] [INFO ] [MAIN ] BCX: Generated 1807 derivative records from 21780 primary records. [2025-10-09T22:35:20.985174] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-09T22:35:21.012009] [DEBUG] [MAIN ] BCSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:21.014100] [INFO ] [MAIN ] BCSF: Generated 1807 derivative records from 28234 primary records. [2025-10-09T22:35:21.014191] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-09T22:35:21.032590] [DEBUG] [LOCAL ] BCX: Derivative data saved (1807 records). [2025-10-09T22:35:21.034685] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-09T22:35:21.036332] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1807 records). [2025-10-09T22:35:21.039061] [INFO ] [MAIN ] Derivative Progress: 194/1690 symbols completed. BCX took 1.2s. Estimated remaining: 9m 50s. Rate: 152.2 symbols/min [2025-10-09T22:35:21.039276] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-09T22:35:21.042743] [INFO ] [MAIN ] Derivative Progress: 195/1690 symbols completed. BCSF took 1.2s. Estimated remaining: 9m 46s. Rate: 153.0 symbols/min [2025-10-09T22:35:21.043182] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:21.043354] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:21.043258] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:21.081408] [DEBUG] [LOCAL ] BDC: Loaded 24705 existing records from primary storage. [2025-10-09T22:35:21.081635] [INFO ] [MAIN ] BDC: Loaded 24705 primary data records. [2025-10-09T22:35:21.276829] [DEBUG] [LOCAL ] BDJ: Loaded 29460 existing records from primary storage. [2025-10-09T22:35:21.277886] [DEBUG] [LOCAL ] BDN: Loaded 47913 existing records from primary storage. [2025-10-09T22:35:21.300708] [INFO ] [MAIN ] BDN: Loaded 47913 primary data records. [2025-10-09T22:35:21.408742] [INFO ] [MAIN ] BDJ: Loaded 29460 primary data records. [2025-10-09T22:35:22.053158] [DEBUG] [MAIN ] BDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:22.054170] [INFO ] [MAIN ] BDC: Generated 1807 derivative records from 24705 primary records. [2025-10-09T22:35:22.054581] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-09T22:35:22.072814] [DEBUG] [LOCAL ] BDC: Derivative data saved (1807 records). [2025-10-09T22:35:22.073203] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-09T22:35:22.077057] [INFO ] [MAIN ] Derivative Progress: 196/1690 symbols completed. BDC took 1.0s. Estimated remaining: 9m 51s. Rate: 151.7 symbols/min [2025-10-09T22:35:22.077498] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:22.103793] [DEBUG] [MAIN ] BDJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:22.106354] [INFO ] [MAIN ] BDJ: Generated 1807 derivative records from 29460 primary records. [2025-10-09T22:35:22.106765] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-09T22:35:22.127948] [DEBUG] [MAIN ] BDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:22.132913] [INFO ] [MAIN ] BDN: Generated 1807 derivative records from 47913 primary records. [2025-10-09T22:35:22.134153] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-09T22:35:22.150347] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1807 records). [2025-10-09T22:35:22.153920] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-09T22:35:22.157067] [INFO ] [MAIN ] Derivative Progress: 197/1690 symbols completed. BDJ took 1.1s. Estimated remaining: 9m 48s. Rate: 152.3 symbols/min [2025-10-09T22:35:22.158377] [DEBUG] [LOCAL ] BDN: Derivative data saved (1807 records). [2025-10-09T22:35:22.158754] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:22.158581] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-09T22:35:22.162700] [INFO ] [MAIN ] Derivative Progress: 198/1690 symbols completed. BDN took 1.1s. Estimated remaining: 9m 45s. Rate: 153.1 symbols/min [2025-10-09T22:35:22.163329] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:22.228016] [DEBUG] [LOCAL ] BDX: Loaded 52620 existing records from primary storage. [2025-10-09T22:35:22.250723] [INFO ] [MAIN ] BDX: Loaded 52620 primary data records. [2025-10-09T22:35:22.520386] [DEBUG] [LOCAL ] BEKE: Loaded 53617 existing records from primary storage. [2025-10-09T22:35:22.629949] [INFO ] [MAIN ] BEKE: Loaded 53617 primary data records. [2025-10-09T22:35:22.640611] [DEBUG] [LOCAL ] BE: Loaded 54049 existing records from primary storage. [2025-10-09T22:35:22.652283] [INFO ] [MAIN ] BE: Loaded 54049 primary data records. [2025-10-09T22:35:23.388592] [DEBUG] [MAIN ] BDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:23.390042] [INFO ] [MAIN ] BDX: Generated 1807 derivative records from 52620 primary records. [2025-10-09T22:35:23.390286] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-09T22:35:23.413215] [DEBUG] [LOCAL ] BDX: Derivative data saved (1807 records). [2025-10-09T22:35:23.414198] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-09T22:35:23.417706] [INFO ] [MAIN ] Derivative Progress: 199/1690 symbols completed. BDX took 1.3s. Estimated remaining: 9m 51s. Rate: 151.4 symbols/min [2025-10-09T22:35:23.420022] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:23.434174] [DEBUG] [MAIN ] BEKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:23.435934] [INFO ] [MAIN ] BEKE: Generated 1807 derivative records from 53617 primary records. [2025-10-09T22:35:23.436923] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-09T22:35:23.463692] [DEBUG] [MAIN ] BE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:23.465139] [INFO ] [MAIN ] BE: Generated 1807 derivative records from 54049 primary records. [2025-10-09T22:35:23.465518] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-09T22:35:23.482034] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1807 records). [2025-10-09T22:35:23.483043] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-09T22:35:23.485485] [INFO ] [MAIN ] Derivative Progress: 200/1690 symbols completed. BEKE took 1.3s. Estimated remaining: 9m 48s. Rate: 152.0 symbols/min [2025-10-09T22:35:23.486333] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:23.488901] [DEBUG] [LOCAL ] BE: Derivative data saved (1807 records). [2025-10-09T22:35:23.489040] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-09T22:35:23.492571] [INFO ] [MAIN ] Derivative Progress: 201/1690 symbols completed. BE took 1.3s. Estimated remaining: 9m 45s. Rate: 152.8 symbols/min [2025-10-09T22:35:23.493118] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:23.539362] [DEBUG] [LOCAL ] BEN: Loaded 53434 existing records from primary storage. [2025-10-09T22:35:23.539624] [INFO ] [MAIN ] BEN: Loaded 53434 primary data records. [2025-10-09T22:35:23.735585] [DEBUG] [LOCAL ] BEP: Loaded 39259 existing records from primary storage. [2025-10-09T22:35:23.775066] [INFO ] [MAIN ] BEP: Loaded 39259 primary data records. [2025-10-09T22:35:23.955156] [DEBUG] [LOCAL ] BEPC: Loaded 46858 existing records from primary storage. [2025-10-09T22:35:23.971170] [INFO ] [MAIN ] BEPC: Loaded 46858 primary data records. [2025-10-09T22:35:24.613402] [DEBUG] [MAIN ] BEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:24.615303] [INFO ] [MAIN ] BEN: Generated 1807 derivative records from 53434 primary records. [2025-10-09T22:35:24.615581] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-09T22:35:24.637244] [DEBUG] [LOCAL ] BEN: Derivative data saved (1807 records). [2025-10-09T22:35:24.637873] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-09T22:35:24.640801] [INFO ] [MAIN ] Derivative Progress: 202/1690 symbols completed. BEN took 1.2s. Estimated remaining: 9m 50s. Rate: 151.3 symbols/min [2025-10-09T22:35:24.641317] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:24.662089] [DEBUG] [MAIN ] BEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:24.666596] [DEBUG] [LOCAL ] BEPH: Loaded 5383 existing records from primary storage. [2025-10-09T22:35:24.667483] [INFO ] [MAIN ] BEP: Generated 1807 derivative records from 39259 primary records. [2025-10-09T22:35:24.668692] [INFO ] [MAIN ] BEPH: Loaded 5383 primary data records. [2025-10-09T22:35:24.669540] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-09T22:35:24.802483] [DEBUG] [LOCAL ] BEP: Derivative data saved (1807 records). [2025-10-09T22:35:24.803359] [DEBUG] [MAIN ] BEPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:24.815247] [INFO ] [MAIN ] BEPC: Generated 1807 derivative records from 46858 primary records. [2025-10-09T22:35:24.809208] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-09T22:35:24.818263] [INFO ] [MAIN ] Derivative Progress: 203/1690 symbols completed. BEP took 1.3s. Estimated remaining: 9m 48s. Rate: 151.7 symbols/min [2025-10-09T22:35:24.818425] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:24.818553] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-09T22:35:24.887210] [DEBUG] [LOCAL ] BEPI: Loaded 3623 existing records from primary storage. [2025-10-09T22:35:24.904700] [INFO ] [MAIN ] BEPI: Loaded 3623 primary data records. [2025-10-09T22:35:24.904582] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1807 records). [2025-10-09T22:35:24.932133] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-09T22:35:24.961402] [INFO ] [MAIN ] Derivative Progress: 204/1690 symbols completed. BEPC took 1.5s. Estimated remaining: 9m 46s. Rate: 152.2 symbols/min [2025-10-09T22:35:25.076965] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:25.410892] [DEBUG] [LOCAL ] BFAM: Loaded 33733 existing records from primary storage. [2025-10-09T22:35:25.413629] [INFO ] [MAIN ] BFAM: Loaded 33733 primary data records. [2025-10-09T22:35:25.442579] [DEBUG] [MAIN ] BEPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:25.453162] [INFO ] [MAIN ] BEPH: Generated 1807 derivative records from 5383 primary records. [2025-10-09T22:35:25.470540] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-09T22:35:25.576463] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1807 records). [2025-10-09T22:35:25.576740] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-09T22:35:25.584438] [INFO ] [MAIN ] Derivative Progress: 205/1690 symbols completed. BEPH took 0.9s. Estimated remaining: 9m 47s. Rate: 151.8 symbols/min [2025-10-09T22:35:25.601121] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:25.806083] [DEBUG] [MAIN ] BEPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:25.806950] [INFO ] [MAIN ] BEPI: Generated 1807 derivative records from 3623 primary records. [2025-10-09T22:35:25.807240] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-09T22:35:25.840125] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1807 records). [2025-10-09T22:35:25.840468] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-09T22:35:25.843747] [INFO ] [MAIN ] Derivative Progress: 206/1690 symbols completed. BEPI took 1.0s. Estimated remaining: 9m 46s. Rate: 152.0 symbols/min [2025-10-09T22:35:25.844462] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:25.863393] [DEBUG] [LOCAL ] BFH: Loaded 41731 existing records from primary storage. [2025-10-09T22:35:25.875468] [INFO ] [MAIN ] BFH: Loaded 41731 primary data records. [2025-10-09T22:35:25.876335] [DEBUG] [MAIN ] BFAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:25.892110] [INFO ] [MAIN ] BFAM: Generated 1807 derivative records from 33733 primary records. [2025-10-09T22:35:25.901792] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-09T22:35:26.002936] [DEBUG] [LOCAL ] BFK: Loaded 13777 existing records from primary storage. [2025-10-09T22:35:26.011447] [INFO ] [MAIN ] BFK: Loaded 13777 primary data records. [2025-10-09T22:35:26.058809] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1807 records). [2025-10-09T22:35:26.110318] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-09T22:35:26.114011] [INFO ] [MAIN ] Derivative Progress: 207/1690 symbols completed. BFAM took 1.0s. Estimated remaining: 9m 44s. Rate: 152.3 symbols/min [2025-10-09T22:35:26.129589] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:26.518350] [DEBUG] [LOCAL ] BFZ: Loaded 11992 existing records from primary storage. [2025-10-09T22:35:26.533511] [INFO ] [MAIN ] BFZ: Loaded 11992 primary data records. [2025-10-09T22:35:26.868443] [DEBUG] [MAIN ] BFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:26.870113] [INFO ] [MAIN ] BFH: Generated 1807 derivative records from 41731 primary records. [2025-10-09T22:35:26.870319] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-09T22:35:26.891940] [DEBUG] [LOCAL ] BFH: Derivative data saved (1807 records). [2025-10-09T22:35:26.904090] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-09T22:35:26.906717] [INFO ] [MAIN ] Derivative Progress: 208/1690 symbols completed. BFH took 1.3s. Estimated remaining: 9m 47s. Rate: 151.5 symbols/min [2025-10-09T22:35:26.908347] [DEBUG] [MAIN ] BFK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:26.909484] [INFO ] [MAIN ] BFK: Generated 1807 derivative records from 13777 primary records. [2025-10-09T22:35:26.909737] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-09T22:35:26.934825] [DEBUG] [LOCAL ] BFK: Derivative data saved (1807 records). [2025-10-09T22:35:26.935132] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-09T22:35:26.937948] [INFO ] [MAIN ] Derivative Progress: 209/1690 symbols completed. BFK took 1.1s. Estimated remaining: 9m 44s. Rate: 152.2 symbols/min [2025-10-09T22:35:26.950588] [DEBUG] [MAIN ] BFZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:26.951259] [INFO ] [MAIN ] BFZ: Generated 1807 derivative records from 11992 primary records. [2025-10-09T22:35:26.951320] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-09T22:35:26.966731] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1807 records). [2025-10-09T22:35:26.966814] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-09T22:35:26.969862] [INFO ] [MAIN ] Derivative Progress: 210/1690 symbols completed. BFZ took 0.8s. Estimated remaining: 9m 41s. Rate: 152.9 symbols/min [2025-10-09T22:35:26.970257] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:26.970377] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:26.970471] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:27.001918] [DEBUG] [LOCAL ] BGH: Loaded 17324 existing records from primary storage. [2025-10-09T22:35:27.002417] [DEBUG] [LOCAL ] BGB: Loaded 18011 existing records from primary storage. [2025-10-09T22:35:27.002588] [INFO ] [MAIN ] BGH: Loaded 17324 primary data records. [2025-10-09T22:35:27.002713] [INFO ] [MAIN ] BGB: Loaded 18011 primary data records. [2025-10-09T22:35:27.261407] [DEBUG] [LOCAL ] BG: Loaded 50781 existing records from primary storage. [2025-10-09T22:35:27.316741] [INFO ] [MAIN ] BG: Loaded 50781 primary data records. [2025-10-09T22:35:28.040501] [DEBUG] [MAIN ] BGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:28.042359] [INFO ] [MAIN ] BGH: Generated 1807 derivative records from 17324 primary records. [2025-10-09T22:35:28.042513] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-09T22:35:28.040794] [DEBUG] [MAIN ] BGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:28.043922] [INFO ] [MAIN ] BGB: Generated 1807 derivative records from 18011 primary records. [2025-10-09T22:35:28.044286] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-09T22:35:28.079192] [DEBUG] [MAIN ] BG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:28.085882] [INFO ] [MAIN ] BG: Generated 1807 derivative records from 50781 primary records. [2025-10-09T22:35:28.087290] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-09T22:35:28.090477] [DEBUG] [LOCAL ] BGH: Derivative data saved (1807 records). [2025-10-09T22:35:28.100831] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-09T22:35:28.109199] [INFO ] [MAIN ] Derivative Progress: 211/1690 symbols completed. BGH took 1.1s. Estimated remaining: 9m 46s. Rate: 151.5 symbols/min [2025-10-09T22:35:28.114130] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:28.114567] [DEBUG] [LOCAL ] BGB: Derivative data saved (1807 records). [2025-10-09T22:35:28.115666] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-09T22:35:28.118427] [INFO ] [MAIN ] Derivative Progress: 212/1690 symbols completed. BGB took 1.1s. Estimated remaining: 9m 43s. Rate: 152.2 symbols/min [2025-10-09T22:35:28.115342] [DEBUG] [LOCAL ] BG: Derivative data saved (1807 records). [2025-10-09T22:35:28.119103] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-09T22:35:28.118971] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:28.122436] [INFO ] [MAIN ] Derivative Progress: 213/1690 symbols completed. BG took 1.2s. Estimated remaining: 9m 40s. Rate: 152.9 symbols/min [2025-10-09T22:35:28.122989] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:28.150699] [DEBUG] [LOCAL ] BGR: Loaded 13650 existing records from primary storage. [2025-10-09T22:35:28.154928] [INFO ] [MAIN ] BGR: Loaded 13650 primary data records. [2025-10-09T22:35:28.154828] [DEBUG] [LOCAL ] BGSF: Loaded 7799 existing records from primary storage. [2025-10-09T22:35:28.166749] [INFO ] [MAIN ] BGSF: Loaded 7799 primary data records. [2025-10-09T22:35:28.690386] [DEBUG] [LOCAL ] BGS: Loaded 50853 existing records from primary storage. [2025-10-09T22:35:28.800559] [INFO ] [MAIN ] BGS: Loaded 50853 primary data records. [2025-10-09T22:35:29.209067] [DEBUG] [MAIN ] BGSF: Filtered 6966 bins outside market hours, 7763 incomplete bins [2025-10-09T22:35:29.210001] [DEBUG] [MAIN ] BGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:29.211257] [INFO ] [MAIN ] BGSF: Generated 1803 derivative records from 7799 primary records. [2025-10-09T22:35:29.211536] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-09T22:35:29.212946] [INFO ] [MAIN ] BGR: Generated 1807 derivative records from 13650 primary records. [2025-10-09T22:35:29.213231] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-09T22:35:29.244797] [DEBUG] [LOCAL ] BGR: Derivative data saved (1807 records). [2025-10-09T22:35:29.245199] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-09T22:35:29.247786] [INFO ] [MAIN ] Derivative Progress: 214/1690 symbols completed. BGR took 1.1s. Estimated remaining: 9m 44s. Rate: 151.6 symbols/min [2025-10-09T22:35:29.245269] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1803 records). [2025-10-09T22:35:29.248367] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:29.248441] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-09T22:35:29.251478] [INFO ] [MAIN ] Derivative Progress: 215/1690 symbols completed. BGSF took 1.1s. Estimated remaining: 9m 41s. Rate: 152.3 symbols/min [2025-10-09T22:35:29.252207] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:29.270627] [DEBUG] [MAIN ] BGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:29.274186] [INFO ] [MAIN ] BGS: Generated 1807 derivative records from 50853 primary records. [2025-10-09T22:35:29.278487] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-09T22:35:29.292522] [DEBUG] [LOCAL ] BGX: Loaded 11222 existing records from primary storage. [2025-10-09T22:35:29.304966] [DEBUG] [LOCAL ] BGS: Derivative data saved (1807 records). [2025-10-09T22:35:29.299635] [INFO ] [MAIN ] BGX: Loaded 11222 primary data records. [2025-10-09T22:35:29.305493] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-09T22:35:29.308361] [INFO ] [MAIN ] Derivative Progress: 216/1690 symbols completed. BGS took 1.2s. Estimated remaining: 9m 38s. Rate: 152.9 symbols/min [2025-10-09T22:35:29.305378] [DEBUG] [LOCAL ] BGT: Loaded 16689 existing records from primary storage. [2025-10-09T22:35:29.308521] [INFO ] [MAIN ] BGT: Loaded 16689 primary data records. [2025-10-09T22:35:29.356286] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:29.646838] [DEBUG] [LOCAL ] BGY: Loaded 22233 existing records from primary storage. [2025-10-09T22:35:29.696727] [INFO ] [MAIN ] BGY: Loaded 22233 primary data records. [2025-10-09T22:35:30.301967] [DEBUG] [MAIN ] BGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:30.315327] [INFO ] [MAIN ] BGX: Generated 1807 derivative records from 11222 primary records. [2025-10-09T22:35:30.316527] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-09T22:35:30.316886] [DEBUG] [MAIN ] BGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:30.318804] [INFO ] [MAIN ] BGT: Generated 1807 derivative records from 16689 primary records. [2025-10-09T22:35:30.319208] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-09T22:35:30.347104] [DEBUG] [LOCAL ] BGX: Derivative data saved (1807 records). [2025-10-09T22:35:30.350230] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-09T22:35:30.354419] [INFO ] [MAIN ] Derivative Progress: 217/1690 symbols completed. BGX took 1.1s. Estimated remaining: 9m 42s. Rate: 151.7 symbols/min [2025-10-09T22:35:30.354979] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:30.358348] [DEBUG] [LOCAL ] BGT: Derivative data saved (1807 records). [2025-10-09T22:35:30.359170] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-09T22:35:30.362051] [INFO ] [MAIN ] Derivative Progress: 218/1690 symbols completed. BGT took 1.1s. Estimated remaining: 9m 39s. Rate: 152.4 symbols/min [2025-10-09T22:35:30.362434] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:30.375734] [DEBUG] [MAIN ] BGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:30.376436] [INFO ] [MAIN ] BGY: Generated 1807 derivative records from 22233 primary records. [2025-10-09T22:35:30.376569] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-09T22:35:30.392762] [DEBUG] [LOCAL ] BGY: Derivative data saved (1807 records). [2025-10-09T22:35:30.396775] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-09T22:35:30.399829] [INFO ] [MAIN ] Derivative Progress: 219/1690 symbols completed. BGY took 1.0s. Estimated remaining: 9m 37s. Rate: 153.1 symbols/min [2025-10-09T22:35:30.400310] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:30.409363] [DEBUG] [LOCAL ] BH: Loaded 16265 existing records from primary storage. [2025-10-09T22:35:30.409551] [INFO ] [MAIN ] BH: Loaded 16265 primary data records. [2025-10-09T22:35:30.621999] [DEBUG] [LOCAL ] BHC: Loaded 47131 existing records from primary storage. [2025-10-09T22:35:30.744839] [INFO ] [MAIN ] BHC: Loaded 47131 primary data records. [2025-10-09T22:35:30.744370] [DEBUG] [LOCAL ] BHE: Loaded 24178 existing records from primary storage. [2025-10-09T22:35:30.766938] [INFO ] [MAIN ] BHE: Loaded 24178 primary data records. [2025-10-09T22:35:31.448238] [DEBUG] [MAIN ] BH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:31.450763] [INFO ] [MAIN ] BH: Generated 1807 derivative records from 16265 primary records. [2025-10-09T22:35:31.451238] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-09T22:35:31.470204] [DEBUG] [LOCAL ] BH: Derivative data saved (1807 records). [2025-10-09T22:35:31.470568] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-09T22:35:31.473159] [INFO ] [MAIN ] Derivative Progress: 220/1690 symbols completed. BH took 1.1s. Estimated remaining: 9m 41s. Rate: 151.9 symbols/min [2025-10-09T22:35:31.473752] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:31.517886] [DEBUG] [MAIN ] BHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:31.519578] [INFO ] [MAIN ] BHC: Generated 1807 derivative records from 47131 primary records. [2025-10-09T22:35:31.518712] [DEBUG] [MAIN ] BHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:31.519815] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-09T22:35:31.520965] [INFO ] [MAIN ] BHE: Generated 1807 derivative records from 24178 primary records. [2025-10-09T22:35:31.522090] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-09T22:35:31.548931] [DEBUG] [LOCAL ] BHK: Loaded 23537 existing records from primary storage. [2025-10-09T22:35:31.549106] [INFO ] [MAIN ] BHK: Loaded 23537 primary data records. [2025-10-09T22:35:31.605321] [DEBUG] [LOCAL ] BHE: Derivative data saved (1807 records). [2025-10-09T22:35:31.627938] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-09T22:35:31.648378] [INFO ] [MAIN ] Derivative Progress: 221/1690 symbols completed. BHE took 1.2s. Estimated remaining: 9m 39s. Rate: 152.2 symbols/min [2025-10-09T22:35:31.605424] [DEBUG] [LOCAL ] BHC: Derivative data saved (1807 records). [2025-10-09T22:35:31.648615] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-09T22:35:31.653901] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:31.675036] [INFO ] [MAIN ] Derivative Progress: 222/1690 symbols completed. BHC took 1.3s. Estimated remaining: 9m 36s. Rate: 152.9 symbols/min [2025-10-09T22:35:31.675297] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:31.895357] [DEBUG] [LOCAL ] BHR: Loaded 22080 existing records from primary storage. [2025-10-09T22:35:31.895852] [INFO ] [MAIN ] BHR: Loaded 22080 primary data records. [2025-10-09T22:35:32.071597] [DEBUG] [LOCAL ] BHP: Loaded 53762 existing records from primary storage. [2025-10-09T22:35:32.098068] [INFO ] [MAIN ] BHP: Loaded 53762 primary data records. [2025-10-09T22:35:32.457238] [DEBUG] [MAIN ] BHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:32.473223] [INFO ] [MAIN ] BHK: Generated 1807 derivative records from 23537 primary records. [2025-10-09T22:35:32.489079] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-09T22:35:32.549129] [DEBUG] [LOCAL ] BHK: Derivative data saved (1807 records). [2025-10-09T22:35:32.604220] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-09T22:35:32.634940] [INFO ] [MAIN ] Derivative Progress: 223/1690 symbols completed. BHK took 1.2s. Estimated remaining: 9m 39s. Rate: 151.9 symbols/min [2025-10-09T22:35:32.829257] [DEBUG] [MAIN ] BHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:32.830324] [INFO ] [MAIN ] BHR: Generated 1807 derivative records from 22080 primary records. [2025-10-09T22:35:32.830466] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-09T22:35:32.852353] [DEBUG] [LOCAL ] BHR: Derivative data saved (1807 records). [2025-10-09T22:35:32.852508] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-09T22:35:32.855251] [INFO ] [MAIN ] Derivative Progress: 224/1690 symbols completed. BHR took 1.2s. Estimated remaining: 9m 38s. Rate: 152.2 symbols/min [2025-10-09T22:35:32.878380] [DEBUG] [MAIN ] BHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:32.879342] [INFO ] [MAIN ] BHP: Generated 1807 derivative records from 53762 primary records. [2025-10-09T22:35:32.879419] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-09T22:35:32.899694] [DEBUG] [LOCAL ] BHP: Derivative data saved (1807 records). [2025-10-09T22:35:32.899867] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-09T22:35:32.903631] [INFO ] [MAIN ] Derivative Progress: 225/1690 symbols completed. BHP took 1.2s. Estimated remaining: 9m 35s. Rate: 152.8 symbols/min [2025-10-09T22:35:32.904342] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:32.904260] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:32.904676] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:33.013938] [DEBUG] [LOCAL ] BHVN: Loaded 50578 existing records from primary storage. [2025-10-09T22:35:33.031150] [INFO ] [MAIN ] BHVN: Loaded 50578 primary data records. [2025-10-09T22:35:33.032222] [DEBUG] [LOCAL ] BIP: Loaded 39590 existing records from primary storage. [2025-10-09T22:35:33.042733] [INFO ] [MAIN ] BIP: Loaded 39590 primary data records. [2025-10-09T22:35:33.309041] [DEBUG] [LOCAL ] BILL: Loaded 52792 existing records from primary storage. [2025-10-09T22:35:33.333357] [INFO ] [MAIN ] BILL: Loaded 52792 primary data records. [2025-10-09T22:35:34.138751] [DEBUG] [MAIN ] BIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:34.152543] [INFO ] [MAIN ] BIP: Generated 1807 derivative records from 39590 primary records. [2025-10-09T22:35:34.153059] [DEBUG] [MAIN ] BHVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:34.153179] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-09T22:35:34.154618] [INFO ] [MAIN ] BHVN: Generated 1807 derivative records from 50578 primary records. [2025-10-09T22:35:34.154996] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-09T22:35:34.199409] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1807 records). [2025-10-09T22:35:34.200884] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-09T22:35:34.204394] [INFO ] [MAIN ] Derivative Progress: 226/1690 symbols completed. BHVN took 1.3s. Estimated remaining: 9m 41s. Rate: 151.2 symbols/min [2025-10-09T22:35:34.205270] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:34.204852] [DEBUG] [MAIN ] BILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:34.207339] [INFO ] [MAIN ] BILL: Generated 1807 derivative records from 52792 primary records. [2025-10-09T22:35:34.208043] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-09T22:35:34.227132] [DEBUG] [LOCAL ] BILL: Derivative data saved (1807 records). [2025-10-09T22:35:34.227972] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-09T22:35:34.232129] [INFO ] [MAIN ] Derivative Progress: 227/1690 symbols completed. BILL took 1.3s. Estimated remaining: 9m 38s. Rate: 151.9 symbols/min [2025-10-09T22:35:34.227848] [DEBUG] [LOCAL ] BIP: Derivative data saved (1807 records). [2025-10-09T22:35:34.234895] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:34.235062] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-09T22:35:34.237422] [INFO ] [MAIN ] Derivative Progress: 228/1690 symbols completed. BIP took 1.3s. Estimated remaining: 9m 35s. Rate: 152.5 symbols/min [2025-10-09T22:35:34.237712] [DEBUG] [LOCAL ] BIPH: Loaded 2577 existing records from primary storage. [2025-10-09T22:35:34.237936] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:34.238663] [INFO ] [MAIN ] BIPH: Loaded 2577 primary data records. [2025-10-09T22:35:34.298377] [DEBUG] [LOCAL ] BIPI: Loaded 3170 existing records from primary storage. [2025-10-09T22:35:34.319222] [INFO ] [MAIN ] BIPI: Loaded 3170 primary data records. [2025-10-09T22:35:34.338564] [DEBUG] [LOCAL ] BIPJ: Loaded 3177 existing records from primary storage. [2025-10-09T22:35:34.396753] [INFO ] [MAIN ] BIPJ: Loaded 3177 primary data records. [2025-10-09T22:35:35.204466] [DEBUG] [MAIN ] BIPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:35.205309] [INFO ] [MAIN ] BIPH: Generated 1807 derivative records from 2577 primary records. [2025-10-09T22:35:35.205533] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-09T22:35:35.224307] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1807 records). [2025-10-09T22:35:35.224743] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-09T22:35:35.251591] [DEBUG] [MAIN ] BIPJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:35.251233] [INFO ] [MAIN ] Derivative Progress: 229/1690 symbols completed. BIPH took 1.0s. Estimated remaining: 9m 39s. Rate: 151.5 symbols/min [2025-10-09T22:35:35.252706] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:35.252935] [DEBUG] [MAIN ] BIPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:35.253817] [INFO ] [MAIN ] BIPI: Generated 1807 derivative records from 3170 primary records. [2025-10-09T22:35:35.254019] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-09T22:35:35.252514] [INFO ] [MAIN ] BIPJ: Generated 1807 derivative records from 3177 primary records. [2025-10-09T22:35:35.254483] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-09T22:35:35.281922] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1807 records). [2025-10-09T22:35:35.282598] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-09T22:35:35.285622] [INFO ] [MAIN ] Derivative Progress: 230/1690 symbols completed. BIPJ took 1.0s. Estimated remaining: 9m 36s. Rate: 152.1 symbols/min [2025-10-09T22:35:35.286306] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1807 records). [2025-10-09T22:35:35.286544] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-09T22:35:35.286024] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:35.289635] [INFO ] [MAIN ] Derivative Progress: 231/1690 symbols completed. BIPI took 1.1s. Estimated remaining: 9m 33s. Rate: 152.7 symbols/min [2025-10-09T22:35:35.289999] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:35.331747] [DEBUG] [LOCAL ] BIT: Loaded 23392 existing records from primary storage. [2025-10-09T22:35:35.332040] [INFO ] [MAIN ] BIT: Loaded 23392 primary data records. [2025-10-09T22:35:35.410246] [DEBUG] [LOCAL ] BIRK: Loaded 51374 existing records from primary storage. [2025-10-09T22:35:35.446967] [INFO ] [MAIN ] BIRK: Loaded 51374 primary data records. [2025-10-09T22:35:35.855564] [DEBUG] [LOCAL ] BJ: Loaded 51896 existing records from primary storage. [2025-10-09T22:35:35.989081] [INFO ] [MAIN ] BJ: Loaded 51896 primary data records. [2025-10-09T22:35:36.326923] [DEBUG] [MAIN ] BIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:36.327959] [INFO ] [MAIN ] BIT: Generated 1807 derivative records from 23392 primary records. [2025-10-09T22:35:36.328079] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-09T22:35:36.341693] [DEBUG] [MAIN ] BIRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:36.342894] [INFO ] [MAIN ] BIRK: Generated 1807 derivative records from 51374 primary records. [2025-10-09T22:35:36.343161] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-09T22:35:36.372374] [DEBUG] [LOCAL ] BIT: Derivative data saved (1807 records). [2025-10-09T22:35:36.373457] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-09T22:35:36.376077] [INFO ] [MAIN ] Derivative Progress: 232/1690 symbols completed. BIT took 1.1s. Estimated remaining: 9m 37s. Rate: 151.6 symbols/min [2025-10-09T22:35:36.374111] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1807 records). [2025-10-09T22:35:36.376375] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:36.376580] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-09T22:35:36.379224] [INFO ] [MAIN ] Derivative Progress: 233/1690 symbols completed. BIRK took 1.1s. Estimated remaining: 9m 34s. Rate: 152.2 symbols/min [2025-10-09T22:35:36.379467] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:36.396821] [DEBUG] [MAIN ] BJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:36.397481] [INFO ] [MAIN ] BJ: Generated 1807 derivative records from 51896 primary records. [2025-10-09T22:35:36.397568] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-09T22:35:36.419553] [DEBUG] [LOCAL ] BJ: Derivative data saved (1807 records). [2025-10-09T22:35:36.419954] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-09T22:35:36.425230] [INFO ] [MAIN ] Derivative Progress: 234/1690 symbols completed. BJ took 1.1s. Estimated remaining: 9m 32s. Rate: 152.8 symbols/min [2025-10-09T22:35:36.425712] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:36.474513] [DEBUG] [LOCAL ] BKD: Loaded 50711 existing records from primary storage. [2025-10-09T22:35:36.474842] [INFO ] [MAIN ] BKD: Loaded 50711 primary data records. [2025-10-09T22:35:36.612246] [DEBUG] [LOCAL ] BK: Loaded 53922 existing records from primary storage. [2025-10-09T22:35:36.613767] [INFO ] [MAIN ] BK: Loaded 53922 primary data records. [2025-10-09T22:35:36.613685] [DEBUG] [LOCAL ] BKE: Loaded 34235 existing records from primary storage. [2025-10-09T22:35:36.614178] [INFO ] [MAIN ] BKE: Loaded 34235 primary data records. [2025-10-09T22:35:37.495690] [DEBUG] [MAIN ] BKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:37.496751] [INFO ] [MAIN ] BKD: Generated 1807 derivative records from 50711 primary records. [2025-10-09T22:35:37.496925] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-09T22:35:37.511291] [DEBUG] [MAIN ] BK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:37.523338] [INFO ] [MAIN ] BK: Generated 1807 derivative records from 53922 primary records. [2025-10-09T22:35:37.524109] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-09T22:35:37.553677] [DEBUG] [MAIN ] BKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:37.555071] [INFO ] [MAIN ] BKE: Generated 1807 derivative records from 34235 primary records. [2025-10-09T22:35:37.556206] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-09T22:35:37.558415] [DEBUG] [LOCAL ] BKD: Derivative data saved (1807 records). [2025-10-09T22:35:37.558662] [DEBUG] [LOCAL ] BK: Derivative data saved (1807 records). [2025-10-09T22:35:37.565767] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-09T22:35:37.569133] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-09T22:35:37.572625] [INFO ] [MAIN ] Derivative Progress: 235/1690 symbols completed. BKD took 1.2s. Estimated remaining: 9m 36s. Rate: 151.6 symbols/min [2025-10-09T22:35:37.576317] [INFO ] [MAIN ] Derivative Progress: 236/1690 symbols completed. BK took 1.2s. Estimated remaining: 9m 33s. Rate: 152.2 symbols/min [2025-10-09T22:35:37.572790] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:37.577360] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:37.578574] [DEBUG] [LOCAL ] BKE: Derivative data saved (1807 records). [2025-10-09T22:35:37.578725] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-09T22:35:37.581778] [INFO ] [MAIN ] Derivative Progress: 237/1690 symbols completed. BKE took 1.2s. Estimated remaining: 9m 30s. Rate: 152.8 symbols/min [2025-10-09T22:35:37.582216] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:37.592904] [DEBUG] [LOCAL ] BKN: Loaded 7712 existing records from primary storage. [2025-10-09T22:35:37.593038] [INFO ] [MAIN ] BKN: Loaded 7712 primary data records. [2025-10-09T22:35:37.784181] [DEBUG] [LOCAL ] BKKT: Loaded 36101 existing records from primary storage. [2025-10-09T22:35:37.813773] [DEBUG] [LOCAL ] BKH: Loaded 37211 existing records from primary storage. [2025-10-09T22:35:37.920386] [INFO ] [MAIN ] BKH: Loaded 37211 primary data records. [2025-10-09T22:35:37.928676] [INFO ] [MAIN ] BKKT: Loaded 36101 primary data records. [2025-10-09T22:35:38.555470] [DEBUG] [MAIN ] BKN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:38.557523] [INFO ] [MAIN ] BKN: Generated 1807 derivative records from 7712 primary records. [2025-10-09T22:35:38.558066] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-09T22:35:38.578811] [DEBUG] [LOCAL ] BKN: Derivative data saved (1807 records). [2025-10-09T22:35:38.579148] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-09T22:35:38.582099] [INFO ] [MAIN ] Derivative Progress: 238/1690 symbols completed. BKN took 1.0s. Estimated remaining: 9m 34s. Rate: 151.9 symbols/min [2025-10-09T22:35:38.596169] [DEBUG] [MAIN ] BKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:38.596954] [INFO ] [MAIN ] BKH: Generated 1807 derivative records from 37211 primary records. [2025-10-09T22:35:38.597098] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-09T22:35:38.609855] [DEBUG] [MAIN ] BKKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:38.610682] [INFO ] [MAIN ] BKKT: Generated 1807 derivative records from 36101 primary records. [2025-10-09T22:35:38.617892] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-09T22:35:38.638588] [DEBUG] [LOCAL ] BKH: Derivative data saved (1807 records). [2025-10-09T22:35:38.638914] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-09T22:35:38.641571] [INFO ] [MAIN ] Derivative Progress: 239/1690 symbols completed. BKH took 1.1s. Estimated remaining: 9m 31s. Rate: 152.4 symbols/min [2025-10-09T22:35:38.644364] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1807 records). [2025-10-09T22:35:38.644426] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-09T22:35:38.647889] [INFO ] [MAIN ] Derivative Progress: 240/1690 symbols completed. BKKT took 1.1s. Estimated remaining: 9m 29s. Rate: 153.0 symbols/min [2025-10-09T22:35:38.648254] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:38.648484] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:38.648401] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:38.665039] [DEBUG] [LOCAL ] BKT: Loaded 12044 existing records from primary storage. [2025-10-09T22:35:38.665179] [INFO ] [MAIN ] BKT: Loaded 12044 primary data records. [2025-10-09T22:35:39.010735] [DEBUG] [LOCAL ] BKU: Loaded 42027 existing records from primary storage. [2025-10-09T22:35:39.011473] [DEBUG] [LOCAL ] BKSY: Loaded 48849 existing records from primary storage. [2025-10-09T22:35:39.011567] [INFO ] [MAIN ] BKU: Loaded 42027 primary data records. [2025-10-09T22:35:39.011761] [INFO ] [MAIN ] BKSY: Loaded 48849 primary data records. [2025-10-09T22:35:39.708918] [DEBUG] [MAIN ] BKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:39.709951] [INFO ] [MAIN ] BKT: Generated 1807 derivative records from 12044 primary records. [2025-10-09T22:35:39.710179] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-09T22:35:39.729494] [DEBUG] [LOCAL ] BKT: Derivative data saved (1807 records). [2025-10-09T22:35:39.731104] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-09T22:35:39.734044] [INFO ] [MAIN ] Derivative Progress: 241/1690 symbols completed. BKT took 1.1s. Estimated remaining: 9m 32s. Rate: 151.9 symbols/min [2025-10-09T22:35:39.734427] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:39.749425] [DEBUG] [MAIN ] BKU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:39.750250] [INFO ] [MAIN ] BKU: Generated 1807 derivative records from 42027 primary records. [2025-10-09T22:35:39.750502] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-09T22:35:39.791075] [DEBUG] [LOCAL ] BKU: Derivative data saved (1807 records). [2025-10-09T22:35:39.790992] [DEBUG] [MAIN ] BKSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:39.792020] [INFO ] [MAIN ] BKSY: Generated 1807 derivative records from 48849 primary records. [2025-10-09T22:35:39.791275] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-09T22:35:39.794241] [INFO ] [MAIN ] Derivative Progress: 242/1690 symbols completed. BKU took 1.1s. Estimated remaining: 9m 30s. Rate: 152.4 symbols/min [2025-10-09T22:35:39.792189] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-09T22:35:39.794971] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:39.819857] [DEBUG] [LOCAL ] BKV: Loaded 30121 existing records from primary storage. [2025-10-09T22:35:39.821061] [INFO ] [MAIN ] BKV: Loaded 30121 primary data records. [2025-10-09T22:35:39.834065] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1807 records). [2025-10-09T22:35:39.880763] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-09T22:35:39.930161] [INFO ] [MAIN ] Derivative Progress: 243/1690 symbols completed. BKSY took 1.3s. Estimated remaining: 9m 28s. Rate: 152.9 symbols/min [2025-10-09T22:35:39.968972] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:39.994268] [DEBUG] [LOCAL ] BLCO: Loaded 35773 existing records from primary storage. [2025-10-09T22:35:40.027331] [INFO ] [MAIN ] BLCO: Loaded 35773 primary data records. [2025-10-09T22:35:40.482386] [DEBUG] [LOCAL ] BLDR: Loaded 52091 existing records from primary storage. [2025-10-09T22:35:40.483154] [INFO ] [MAIN ] BLDR: Loaded 52091 primary data records. [2025-10-09T22:35:40.792397] [DEBUG] [MAIN ] BKV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:40.809538] [INFO ] [MAIN ] BKV: Generated 1807 derivative records from 30121 primary records. [2025-10-09T22:35:40.809955] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-09T22:35:40.830026] [DEBUG] [LOCAL ] BKV: Derivative data saved (1807 records). [2025-10-09T22:35:40.830729] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-09T22:35:40.841069] [INFO ] [MAIN ] Derivative Progress: 244/1690 symbols completed. BKV took 1.1s. Estimated remaining: 9m 31s. Rate: 152.0 symbols/min [2025-10-09T22:35:40.846766] [DEBUG] [MAIN ] BLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:40.848144] [INFO ] [MAIN ] BLCO: Generated 1807 derivative records from 35773 primary records. [2025-10-09T22:35:40.848444] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:40.848716] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-09T22:35:40.867455] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1807 records). [2025-10-09T22:35:40.871044] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-09T22:35:40.873788] [INFO ] [MAIN ] Derivative Progress: 245/1690 symbols completed. BLCO took 1.1s. Estimated remaining: 9m 28s. Rate: 152.6 symbols/min [2025-10-09T22:35:40.874287] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:40.883058] [DEBUG] [LOCAL ] BLE: Loaded 14158 existing records from primary storage. [2025-10-09T22:35:40.884018] [INFO ] [MAIN ] BLE: Loaded 14158 primary data records. [2025-10-09T22:35:41.004494] [DEBUG] [MAIN ] BLDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:41.010566] [INFO ] [MAIN ] BLDR: Generated 1807 derivative records from 52091 primary records. [2025-10-09T22:35:41.016666] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-09T22:35:41.237978] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1807 records). [2025-10-09T22:35:41.249506] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-09T22:35:41.253338] [INFO ] [MAIN ] Derivative Progress: 246/1690 symbols completed. BLDR took 1.3s. Estimated remaining: 9m 28s. Rate: 152.6 symbols/min [2025-10-09T22:35:41.254757] [DEBUG] [LOCAL ] BLK: Loaded 34297 existing records from primary storage. [2025-10-09T22:35:41.255423] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:41.254996] [INFO ] [MAIN ] BLK: Loaded 34297 primary data records. [2025-10-09T22:35:41.661223] [DEBUG] [MAIN ] BLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:41.664795] [INFO ] [MAIN ] BLE: Generated 1807 derivative records from 14158 primary records. [2025-10-09T22:35:41.663574] [DEBUG] [LOCAL ] BLND: Loaded 49568 existing records from primary storage. [2025-10-09T22:35:41.665472] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-09T22:35:41.666979] [INFO ] [MAIN ] BLND: Loaded 49568 primary data records. [2025-10-09T22:35:41.795579] [DEBUG] [LOCAL ] BLE: Derivative data saved (1807 records). [2025-10-09T22:35:41.822303] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-09T22:35:41.864627] [INFO ] [MAIN ] Derivative Progress: 247/1690 symbols completed. BLE took 1.0s. Estimated remaining: 9m 29s. Rate: 152.3 symbols/min [2025-10-09T22:35:41.889973] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:42.029627] [DEBUG] [MAIN ] BLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:42.030489] [INFO ] [MAIN ] BLK: Generated 1807 derivative records from 34297 primary records. [2025-10-09T22:35:42.030704] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-09T22:35:42.059446] [DEBUG] [LOCAL ] BLK: Derivative data saved (1807 records). [2025-10-09T22:35:42.059578] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-09T22:35:42.062177] [INFO ] [MAIN ] Derivative Progress: 248/1690 symbols completed. BLK took 1.2s. Estimated remaining: 9m 27s. Rate: 152.6 symbols/min [2025-10-09T22:35:42.057158] [DEBUG] [LOCAL ] BLW: Loaded 13433 existing records from primary storage. [2025-10-09T22:35:42.062703] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:42.062388] [INFO ] [MAIN ] BLW: Loaded 13433 primary data records. [2025-10-09T22:35:42.216197] [DEBUG] [LOCAL ] BLX: Loaded 15705 existing records from primary storage. [2025-10-09T22:35:42.226873] [INFO ] [MAIN ] BLX: Loaded 15705 primary data records. [2025-10-09T22:35:42.733697] [DEBUG] [MAIN ] BLND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:42.735602] [INFO ] [MAIN ] BLND: Generated 1807 derivative records from 49568 primary records. [2025-10-09T22:35:42.736233] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-09T22:35:42.766395] [DEBUG] [LOCAL ] BLND: Derivative data saved (1807 records). [2025-10-09T22:35:42.769464] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-09T22:35:42.772933] [INFO ] [MAIN ] Derivative Progress: 249/1690 symbols completed. BLND took 1.5s. Estimated remaining: 9m 28s. Rate: 152.1 symbols/min [2025-10-09T22:35:42.773592] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:42.788193] [DEBUG] [MAIN ] BLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:42.789244] [INFO ] [MAIN ] BLW: Generated 1807 derivative records from 13433 primary records. [2025-10-09T22:35:42.789383] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-09T22:35:42.821916] [DEBUG] [LOCAL ] BLW: Derivative data saved (1807 records). [2025-10-09T22:35:42.822299] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-09T22:35:42.825239] [DEBUG] [MAIN ] BLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:42.824863] [INFO ] [MAIN ] Derivative Progress: 250/1690 symbols completed. BLW took 0.9s. Estimated remaining: 9m 26s. Rate: 152.6 symbols/min [2025-10-09T22:35:42.826341] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:42.826187] [INFO ] [MAIN ] BLX: Generated 1807 derivative records from 15705 primary records. [2025-10-09T22:35:42.835279] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-09T22:35:42.865339] [DEBUG] [LOCAL ] BLX: Derivative data saved (1807 records). [2025-10-09T22:35:42.866065] [DEBUG] [LOCAL ] BMA: Loaded 35935 existing records from primary storage. [2025-10-09T22:35:42.866371] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-09T22:35:42.869422] [INFO ] [MAIN ] Derivative Progress: 251/1690 symbols completed. BLX took 0.8s. Estimated remaining: 9m 24s. Rate: 153.2 symbols/min [2025-10-09T22:35:42.869605] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:42.866551] [INFO ] [MAIN ] BMA: Loaded 35935 primary data records. [2025-10-09T22:35:42.875572] [DEBUG] [LOCAL ] BME: Loaded 11174 existing records from primary storage. [2025-10-09T22:35:42.907472] [INFO ] [MAIN ] BME: Loaded 11174 primary data records. [2025-10-09T22:35:43.165617] [DEBUG] [LOCAL ] BMEZ: Loaded 26718 existing records from primary storage. [2025-10-09T22:35:43.177037] [INFO ] [MAIN ] BMEZ: Loaded 26718 primary data records. [2025-10-09T22:35:43.912524] [DEBUG] [MAIN ] BMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:43.913435] [INFO ] [MAIN ] BMA: Generated 1807 derivative records from 35935 primary records. [2025-10-09T22:35:43.913849] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-09T22:35:43.936304] [DEBUG] [MAIN ] BME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:43.941006] [INFO ] [MAIN ] BME: Generated 1807 derivative records from 11174 primary records. [2025-10-09T22:35:43.944348] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-09T22:35:43.945401] [DEBUG] [LOCAL ] BMA: Derivative data saved (1807 records). [2025-10-09T22:35:43.946572] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-09T22:35:43.961146] [INFO ] [MAIN ] Derivative Progress: 252/1690 symbols completed. BMA took 1.2s. Estimated remaining: 9m 27s. Rate: 152.1 symbols/min [2025-10-09T22:35:43.963829] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:43.968334] [DEBUG] [LOCAL ] BME: Derivative data saved (1807 records). [2025-10-09T22:35:43.968460] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-09T22:35:43.971217] [INFO ] [MAIN ] Derivative Progress: 253/1690 symbols completed. BME took 1.1s. Estimated remaining: 9m 25s. Rate: 152.7 symbols/min [2025-10-09T22:35:43.984098] [DEBUG] [MAIN ] BMEZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:43.984886] [INFO ] [MAIN ] BMEZ: Generated 1807 derivative records from 26718 primary records. [2025-10-09T22:35:43.984947] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-09T22:35:44.001182] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1807 records). [2025-10-09T22:35:44.001267] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-09T22:35:44.004480] [INFO ] [MAIN ] Derivative Progress: 254/1690 symbols completed. BMEZ took 1.1s. Estimated remaining: 9m 22s. Rate: 153.2 symbols/min [2025-10-09T22:35:44.021932] [DEBUG] [LOCAL ] BMI: Loaded 24507 existing records from primary storage. [2025-10-09T22:35:44.022068] [INFO ] [MAIN ] BMI: Loaded 24507 primary data records. [2025-10-09T22:35:44.337818] [DEBUG] [MAIN ] BMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:44.338407] [INFO ] [MAIN ] BMI: Generated 1807 derivative records from 24507 primary records. [2025-10-09T22:35:44.338468] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-09T22:35:44.353912] [DEBUG] [LOCAL ] BMI: Derivative data saved (1807 records). [2025-10-09T22:35:44.353977] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-09T22:35:44.356107] [INFO ] [MAIN ] Derivative Progress: 255/1690 symbols completed. BMI took 0.4s. Estimated remaining: 9m 22s. Rate: 153.3 symbols/min [2025-10-09T22:35:44.356690] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:44.356909] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:44.356808] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:44.363121] [DEBUG] [LOCAL ] BMN: Loaded 2597 existing records from primary storage. [2025-10-09T22:35:44.363276] [INFO ] [MAIN ] BMN: Loaded 2597 primary data records. [2025-10-09T22:35:44.714416] [DEBUG] [LOCAL ] BMO: Loaded 41397 existing records from primary storage. [2025-10-09T22:35:44.714818] [INFO ] [MAIN ] BMO: Loaded 41397 primary data records. [2025-10-09T22:35:44.846294] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-09T22:35:44.892082] [INFO ] [MAIN ] BMY: Loaded 54147 primary data records. [2025-10-09T22:35:45.248678] [DEBUG] [MAIN ] BMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:45.369885] [INFO ] [MAIN ] BMN: Generated 1807 derivative records from 2597 primary records. [2025-10-09T22:35:45.370493] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-09T22:35:45.393958] [DEBUG] [LOCAL ] BMN: Derivative data saved (1807 records). [2025-10-09T22:35:45.395525] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-09T22:35:45.398190] [INFO ] [MAIN ] Derivative Progress: 256/1690 symbols completed. BMN took 1.0s. Estimated remaining: 9m 25s. Rate: 152.3 symbols/min [2025-10-09T22:35:45.398919] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:45.415386] [DEBUG] [MAIN ] BMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:45.416293] [INFO ] [MAIN ] BMO: Generated 1807 derivative records from 41397 primary records. [2025-10-09T22:35:45.416450] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-09T22:35:45.439454] [DEBUG] [LOCAL ] BMO: Derivative data saved (1807 records). [2025-10-09T22:35:45.451488] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-09T22:35:45.454830] [INFO ] [MAIN ] Derivative Progress: 257/1690 symbols completed. BMO took 1.1s. Estimated remaining: 9m 23s. Rate: 152.8 symbols/min [2025-10-09T22:35:45.455320] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:45.456012] [DEBUG] [MAIN ] BMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:45.457140] [INFO ] [MAIN ] BMY: Generated 1807 derivative records from 54147 primary records. [2025-10-09T22:35:45.457220] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-09T22:35:45.488169] [DEBUG] [LOCAL ] BMY: Derivative data saved (1807 records). [2025-10-09T22:35:45.488467] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-09T22:35:45.491347] [INFO ] [MAIN ] Derivative Progress: 258/1690 symbols completed. BMY took 1.1s. Estimated remaining: 9m 20s. Rate: 153.4 symbols/min [2025-10-09T22:35:45.492394] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:45.516290] [DEBUG] [LOCAL ] BN: Loaded 53376 existing records from primary storage. [2025-10-09T22:35:45.516574] [INFO ] [MAIN ] BN: Loaded 53376 primary data records. [2025-10-09T22:35:45.563481] [DEBUG] [LOCAL ] BNH: Loaded 5264 existing records from primary storage. [2025-10-09T22:35:45.569354] [DEBUG] [LOCAL ] BNED: Loaded 29262 existing records from primary storage. [2025-10-09T22:35:45.579427] [INFO ] [MAIN ] BNED: Loaded 29262 primary data records. [2025-10-09T22:35:45.610150] [INFO ] [MAIN ] BNH: Loaded 5264 primary data records. [2025-10-09T22:35:46.610547] [DEBUG] [MAIN ] BN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:46.639331] [DEBUG] [MAIN ] BNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:46.639041] [INFO ] [MAIN ] BN: Generated 1807 derivative records from 53376 primary records. [2025-10-09T22:35:46.640401] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-09T22:35:46.640296] [INFO ] [MAIN ] BNH: Generated 1807 derivative records from 5264 primary records. [2025-10-09T22:35:46.640543] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-09T22:35:46.642070] [DEBUG] [MAIN ] BNED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:46.651476] [INFO ] [MAIN ] BNED: Generated 1807 derivative records from 29262 primary records. [2025-10-09T22:35:46.654771] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-09T22:35:46.690368] [DEBUG] [LOCAL ] BNED: Derivative data saved (1807 records). [2025-10-09T22:35:46.691887] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-09T22:35:46.695408] [INFO ] [MAIN ] Derivative Progress: 259/1690 symbols completed. BNED took 1.2s. Estimated remaining: 9m 24s. Rate: 152.1 symbols/min [2025-10-09T22:35:46.696450] [DEBUG] [LOCAL ] BN: Derivative data saved (1807 records). [2025-10-09T22:35:46.695803] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:46.691780] [DEBUG] [LOCAL ] BNH: Derivative data saved (1807 records). [2025-10-09T22:35:46.696802] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-09T22:35:46.699088] [INFO ] [MAIN ] Derivative Progress: 260/1690 symbols completed. BNH took 1.2s. Estimated remaining: 9m 22s. Rate: 152.7 symbols/min [2025-10-09T22:35:46.699549] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-09T22:35:46.702072] [INFO ] [MAIN ] Derivative Progress: 261/1690 symbols completed. BN took 1.3s. Estimated remaining: 9m 19s. Rate: 153.3 symbols/min [2025-10-09T22:35:46.701984] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:46.702383] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:46.708399] [DEBUG] [LOCAL ] BNJ: Loaded 2684 existing records from primary storage. [2025-10-09T22:35:46.708546] [INFO ] [MAIN ] BNJ: Loaded 2684 primary data records. [2025-10-09T22:35:47.083943] [DEBUG] [LOCAL ] BNL: Loaded 47534 existing records from primary storage. [2025-10-09T22:35:47.097626] [INFO ] [MAIN ] BNL: Loaded 47534 primary data records. [2025-10-09T22:35:47.135140] [DEBUG] [LOCAL ] BNS: Loaded 51843 existing records from primary storage. [2025-10-09T22:35:47.168063] [INFO ] [MAIN ] BNS: Loaded 51843 primary data records. [2025-10-09T22:35:47.771911] [DEBUG] [MAIN ] BNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:47.772973] [INFO ] [MAIN ] BNJ: Generated 1807 derivative records from 2684 primary records. [2025-10-09T22:35:47.773149] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-09T22:35:47.791203] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1807 records). [2025-10-09T22:35:47.791543] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-09T22:35:47.793857] [INFO ] [MAIN ] Derivative Progress: 262/1690 symbols completed. BNJ took 1.1s. Estimated remaining: 9m 23s. Rate: 152.3 symbols/min [2025-10-09T22:35:47.794240] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:47.811859] [DEBUG] [MAIN ] BNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:47.815012] [INFO ] [MAIN ] BNL: Generated 1807 derivative records from 47534 primary records. [2025-10-09T22:35:47.817124] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-09T22:35:47.817381] [DEBUG] [LOCAL ] BNT: Loaded 3368 existing records from primary storage. [2025-10-09T22:35:47.817560] [INFO ] [MAIN ] BNT: Loaded 3368 primary data records. [2025-10-09T22:35:47.893618] [DEBUG] [MAIN ] BNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:47.898012] [INFO ] [MAIN ] BNS: Generated 1807 derivative records from 51843 primary records. [2025-10-09T22:35:47.900309] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-09T22:35:48.015532] [DEBUG] [LOCAL ] BNL: Derivative data saved (1807 records). [2025-10-09T22:35:48.039818] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-09T22:35:48.042225] [INFO ] [MAIN ] Derivative Progress: 263/1690 symbols completed. BNL took 1.3s. Estimated remaining: 9m 22s. Rate: 152.5 symbols/min [2025-10-09T22:35:48.096023] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:48.163407] [DEBUG] [LOCAL ] BNS: Derivative data saved (1807 records). [2025-10-09T22:35:48.163572] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-09T22:35:48.166459] [INFO ] [MAIN ] Derivative Progress: 264/1690 symbols completed. BNS took 1.5s. Estimated remaining: 9m 20s. Rate: 152.9 symbols/min [2025-10-09T22:35:48.166753] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:48.194152] [DEBUG] [LOCAL ] BOC: Loaded 18567 existing records from primary storage. [2025-10-09T22:35:48.194318] [INFO ] [MAIN ] BOC: Loaded 18567 primary data records. [2025-10-09T22:35:48.291259] [DEBUG] [LOCAL ] BOE: Loaded 18227 existing records from primary storage. [2025-10-09T22:35:48.309967] [INFO ] [MAIN ] BOE: Loaded 18227 primary data records. [2025-10-09T22:35:48.492129] [DEBUG] [MAIN ] BNT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:35:48.525372] [INFO ] [MAIN ] BNT: Generated 1806 derivative records from 3368 primary records. [2025-10-09T22:35:48.646892] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-09T22:35:48.842553] [DEBUG] [LOCAL ] BNT: Derivative data saved (1806 records). [2025-10-09T22:35:48.843963] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-09T22:35:48.847317] [INFO ] [MAIN ] Derivative Progress: 265/1690 symbols completed. BNT took 1.1s. Estimated remaining: 9m 21s. Rate: 152.4 symbols/min [2025-10-09T22:35:48.848303] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:48.873131] [DEBUG] [MAIN ] BOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:48.874158] [INFO ] [MAIN ] BOC: Generated 1807 derivative records from 18567 primary records. [2025-10-09T22:35:48.874349] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-09T22:35:48.887937] [DEBUG] [MAIN ] BOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:48.888902] [INFO ] [MAIN ] BOE: Generated 1807 derivative records from 18227 primary records. [2025-10-09T22:35:48.905162] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-09T22:35:48.934468] [DEBUG] [LOCAL ] BOH: Loaded 30612 existing records from primary storage. [2025-10-09T22:35:48.935809] [INFO ] [MAIN ] BOH: Loaded 30612 primary data records. [2025-10-09T22:35:48.959915] [DEBUG] [LOCAL ] BOC: Derivative data saved (1807 records). [2025-10-09T22:35:48.960250] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-09T22:35:48.974111] [INFO ] [MAIN ] Derivative Progress: 266/1690 symbols completed. BOC took 0.9s. Estimated remaining: 9m 19s. Rate: 152.8 symbols/min [2025-10-09T22:35:48.979693] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:48.987692] [DEBUG] [LOCAL ] BOE: Derivative data saved (1807 records). [2025-10-09T22:35:48.992960] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-09T22:35:49.003848] [INFO ] [MAIN ] Derivative Progress: 267/1690 symbols completed. BOE took 0.8s. Estimated remaining: 9m 17s. Rate: 153.4 symbols/min [2025-10-09T22:35:49.013365] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:49.283489] [DEBUG] [LOCAL ] BOND: Loaded 32491 existing records from primary storage. [2025-10-09T22:35:49.284251] [INFO ] [MAIN ] BOND: Loaded 32491 primary data records. [2025-10-09T22:35:49.425696] [DEBUG] [LOCAL ] BOOT: Loaded 40347 existing records from primary storage. [2025-10-09T22:35:49.458613] [INFO ] [MAIN ] BOOT: Loaded 40347 primary data records. [2025-10-09T22:35:49.970836] [DEBUG] [MAIN ] BOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:49.973027] [INFO ] [MAIN ] BOH: Generated 1807 derivative records from 30612 primary records. [2025-10-09T22:35:49.973493] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-09T22:35:49.992039] [DEBUG] [LOCAL ] BOH: Derivative data saved (1807 records). [2025-10-09T22:35:49.992485] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-09T22:35:49.995732] [INFO ] [MAIN ] Derivative Progress: 268/1690 symbols completed. BOH took 1.1s. Estimated remaining: 9m 20s. Rate: 152.5 symbols/min [2025-10-09T22:35:50.011510] [DEBUG] [MAIN ] BOND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:50.012236] [INFO ] [MAIN ] BOND: Generated 1807 derivative records from 32491 primary records. [2025-10-09T22:35:50.012382] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-09T22:35:50.028513] [DEBUG] [LOCAL ] BOND: Derivative data saved (1807 records). [2025-10-09T22:35:50.028587] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-09T22:35:50.031092] [INFO ] [MAIN ] Derivative Progress: 269/1690 symbols completed. BOND took 1.1s. Estimated remaining: 9m 17s. Rate: 153.0 symbols/min [2025-10-09T22:35:50.046108] [DEBUG] [MAIN ] BOOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:50.046715] [INFO ] [MAIN ] BOOT: Generated 1807 derivative records from 40347 primary records. [2025-10-09T22:35:50.046780] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-09T22:35:50.062136] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1807 records). [2025-10-09T22:35:50.062195] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-09T22:35:50.064856] [INFO ] [MAIN ] Derivative Progress: 270/1690 symbols completed. BOOT took 1.1s. Estimated remaining: 9m 15s. Rate: 153.5 symbols/min [2025-10-09T22:35:50.065335] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:50.065278] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:50.065439] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:50.091547] [DEBUG] [LOCAL ] BOW: Loaded 23981 existing records from primary storage. [2025-10-09T22:35:50.091727] [INFO ] [MAIN ] BOW: Loaded 23981 primary data records. [2025-10-09T22:35:50.442570] [DEBUG] [LOCAL ] BOX: Loaded 50568 existing records from primary storage. [2025-10-09T22:35:50.441340] [DEBUG] [LOCAL ] BORR: Loaded 51475 existing records from primary storage. [2025-10-09T22:35:50.442862] [INFO ] [MAIN ] BORR: Loaded 51475 primary data records. [2025-10-09T22:35:50.442942] [INFO ] [MAIN ] BOX: Loaded 50568 primary data records. [2025-10-09T22:35:51.070783] [DEBUG] [MAIN ] BOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:51.071882] [INFO ] [MAIN ] BOW: Generated 1807 derivative records from 23981 primary records. [2025-10-09T22:35:51.072490] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-09T22:35:51.110253] [DEBUG] [MAIN ] BORR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:51.109470] [DEBUG] [LOCAL ] BOW: Derivative data saved (1807 records). [2025-10-09T22:35:51.111101] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-09T22:35:51.111007] [INFO ] [MAIN ] BORR: Generated 1807 derivative records from 51475 primary records. [2025-10-09T22:35:51.113762] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-09T22:35:51.113608] [INFO ] [MAIN ] Derivative Progress: 271/1690 symbols completed. BOW took 1.0s. Estimated remaining: 9m 18s. Rate: 152.6 symbols/min [2025-10-09T22:35:51.126624] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:51.134561] [DEBUG] [MAIN ] BOX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:51.139798] [INFO ] [MAIN ] BOX: Generated 1807 derivative records from 50568 primary records. [2025-10-09T22:35:51.140491] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-09T22:35:51.158559] [DEBUG] [LOCAL ] BOX: Derivative data saved (1807 records). [2025-10-09T22:35:51.159211] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-09T22:35:51.162237] [INFO ] [MAIN ] Derivative Progress: 272/1690 symbols completed. BOX took 1.1s. Estimated remaining: 9m 16s. Rate: 153.1 symbols/min [2025-10-09T22:35:51.162511] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:51.162745] [DEBUG] [LOCAL ] BORR: Derivative data saved (1807 records). [2025-10-09T22:35:51.163063] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-09T22:35:51.165172] [INFO ] [MAIN ] Derivative Progress: 273/1690 symbols completed. BORR took 1.1s. Estimated remaining: 9m 13s. Rate: 153.6 symbols/min [2025-10-09T22:35:51.165375] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:51.216974] [DEBUG] [LOCAL ] BP: Loaded 54099 existing records from primary storage. [2025-10-09T22:35:51.231069] [INFO ] [MAIN ] BP: Loaded 54099 primary data records. [2025-10-09T22:35:51.396297] [DEBUG] [LOCAL ] BRBR: Loaded 51836 existing records from primary storage. [2025-10-09T22:35:51.448805] [DEBUG] [LOCAL ] BROS: Loaded 53689 existing records from primary storage. [2025-10-09T22:35:51.453346] [INFO ] [MAIN ] BROS: Loaded 53689 primary data records. [2025-10-09T22:35:51.433940] [INFO ] [MAIN ] BRBR: Loaded 51836 primary data records. [2025-10-09T22:35:52.237544] [DEBUG] [MAIN ] BP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:52.239020] [INFO ] [MAIN ] BP: Generated 1807 derivative records from 54099 primary records. [2025-10-09T22:35:52.239496] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-09T22:35:52.257668] [DEBUG] [LOCAL ] BP: Derivative data saved (1807 records). [2025-10-09T22:35:52.258697] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-09T22:35:52.260707] [INFO ] [MAIN ] Derivative Progress: 274/1690 symbols completed. BP took 1.1s. Estimated remaining: 9m 17s. Rate: 152.6 symbols/min [2025-10-09T22:35:52.261087] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:52.282356] [DEBUG] [MAIN ] BROS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:52.291069] [INFO ] [MAIN ] BROS: Generated 1807 derivative records from 53689 primary records. [2025-10-09T22:35:52.296312] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-09T22:35:52.296714] [DEBUG] [MAIN ] BRBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:52.298473] [INFO ] [MAIN ] BRBR: Generated 1807 derivative records from 51836 primary records. [2025-10-09T22:35:52.298585] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-09T22:35:52.337040] [DEBUG] [LOCAL ] BROS: Derivative data saved (1807 records). [2025-10-09T22:35:52.338853] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-09T22:35:52.342229] [INFO ] [MAIN ] Derivative Progress: 275/1690 symbols completed. BROS took 1.2s. Estimated remaining: 9m 15s. Rate: 153.1 symbols/min [2025-10-09T22:35:52.345947] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1807 records). [2025-10-09T22:35:52.343439] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:52.346589] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-09T22:35:52.359917] [INFO ] [MAIN ] Derivative Progress: 276/1690 symbols completed. BRBR took 1.2s. Estimated remaining: 9m 12s. Rate: 153.6 symbols/min [2025-10-09T22:35:52.360240] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:52.361716] [DEBUG] [LOCAL ] BRSP: Loaded 36934 existing records from primary storage. [2025-10-09T22:35:52.361913] [INFO ] [MAIN ] BRSP: Loaded 36934 primary data records. [2025-10-09T22:35:52.435177] [DEBUG] [LOCAL ] BRT: Loaded 5083 existing records from primary storage. [2025-10-09T22:35:52.457834] [INFO ] [MAIN ] BRT: Loaded 5083 primary data records. [2025-10-09T22:35:53.013605] [DEBUG] [LOCAL ] BRX: Loaded 52155 existing records from primary storage. [2025-10-09T22:35:53.014298] [INFO ] [MAIN ] BRX: Loaded 52155 primary data records. [2025-10-09T22:35:53.422678] [DEBUG] [MAIN ] BRSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:53.426129] [INFO ] [MAIN ] BRSP: Generated 1807 derivative records from 36934 primary records. [2025-10-09T22:35:53.426660] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-09T22:35:53.453384] [DEBUG] [MAIN ] BRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:53.462068] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1807 records). [2025-10-09T22:35:53.463916] [INFO ] [MAIN ] BRT: Generated 1807 derivative records from 5083 primary records. [2025-10-09T22:35:53.464154] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-09T22:35:53.466561] [INFO ] [MAIN ] Derivative Progress: 277/1690 symbols completed. BRSP took 1.2s. Estimated remaining: 9m 16s. Rate: 152.6 symbols/min [2025-10-09T22:35:53.466781] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-09T22:35:53.467054] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:53.486808] [DEBUG] [LOCAL ] BRT: Derivative data saved (1807 records). [2025-10-09T22:35:53.487109] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-09T22:35:53.489791] [INFO ] [MAIN ] Derivative Progress: 278/1690 symbols completed. BRT took 1.1s. Estimated remaining: 9m 13s. Rate: 153.1 symbols/min [2025-10-09T22:35:53.490360] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:53.523623] [DEBUG] [MAIN ] BRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:53.524585] [INFO ] [MAIN ] BRX: Generated 1807 derivative records from 52155 primary records. [2025-10-09T22:35:53.524747] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-09T22:35:53.529896] [DEBUG] [LOCAL ] BSL: Loaded 8276 existing records from primary storage. [2025-10-09T22:35:53.542217] [INFO ] [MAIN ] BSL: Loaded 8276 primary data records. [2025-10-09T22:35:53.547357] [DEBUG] [LOCAL ] BRX: Derivative data saved (1807 records). [2025-10-09T22:35:53.553103] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-09T22:35:53.588528] [INFO ] [MAIN ] Derivative Progress: 279/1690 symbols completed. BRX took 1.2s. Estimated remaining: 9m 11s. Rate: 153.5 symbols/min [2025-10-09T22:35:53.662990] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:53.669449] [DEBUG] [LOCAL ] BSBR: Loaded 35593 existing records from primary storage. [2025-10-09T22:35:53.675584] [INFO ] [MAIN ] BSBR: Loaded 35593 primary data records. [2025-10-09T22:35:53.892463] [DEBUG] [LOCAL ] BST: Loaded 19081 existing records from primary storage. [2025-10-09T22:35:53.991003] [INFO ] [MAIN ] BST: Loaded 19081 primary data records. [2025-10-09T22:35:54.680668] [DEBUG] [MAIN ] BSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:54.682782] [INFO ] [MAIN ] BSL: Generated 1807 derivative records from 8276 primary records. [2025-10-09T22:35:54.683736] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-09T22:35:54.712148] [DEBUG] [MAIN ] BSBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:54.714198] [INFO ] [MAIN ] BSBR: Generated 1807 derivative records from 35593 primary records. [2025-10-09T22:35:54.714599] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-09T22:35:54.731102] [DEBUG] [LOCAL ] BSL: Derivative data saved (1807 records). [2025-10-09T22:35:54.735309] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-09T22:35:54.735215] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1807 records). [2025-10-09T22:35:54.737935] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-09T22:35:54.737701] [INFO ] [MAIN ] Derivative Progress: 280/1690 symbols completed. BSL took 1.2s. Estimated remaining: 9m 15s. Rate: 152.5 symbols/min [2025-10-09T22:35:54.754883] [DEBUG] [MAIN ] BST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:54.754557] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:54.756206] [INFO ] [MAIN ] BST: Generated 1807 derivative records from 19081 primary records. [2025-10-09T22:35:54.756684] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-09T22:35:54.755326] [INFO ] [MAIN ] Derivative Progress: 281/1690 symbols completed. BSBR took 1.3s. Estimated remaining: 9m 13s. Rate: 153.0 symbols/min [2025-10-09T22:35:54.757459] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:54.777469] [DEBUG] [LOCAL ] BST: Derivative data saved (1807 records). [2025-10-09T22:35:54.781348] [DEBUG] [LOCAL ] BTA: Loaded 5536 existing records from primary storage. [2025-10-09T22:35:54.781592] [INFO ] [MAIN ] BTA: Loaded 5536 primary data records. [2025-10-09T22:35:54.781484] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-09T22:35:54.846999] [INFO ] [MAIN ] Derivative Progress: 282/1690 symbols completed. BST took 1.2s. Estimated remaining: 9m 11s. Rate: 153.4 symbols/min [2025-10-09T22:35:54.874388] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:55.169813] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-09T22:35:55.186553] [INFO ] [MAIN ] BSX: Loaded 54078 primary data records. [2025-10-09T22:35:55.230753] [DEBUG] [LOCAL ] BTCM: Loaded 16265 existing records from primary storage. [2025-10-09T22:35:55.236313] [INFO ] [MAIN ] BTCM: Loaded 16265 primary data records. [2025-10-09T22:35:55.908832] [DEBUG] [MAIN ] BTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:55.910367] [INFO ] [MAIN ] BTA: Generated 1807 derivative records from 5536 primary records. [2025-10-09T22:35:55.911471] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-09T22:35:55.931940] [DEBUG] [LOCAL ] BTA: Derivative data saved (1807 records). [2025-10-09T22:35:55.932065] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-09T22:35:55.934385] [INFO ] [MAIN ] Derivative Progress: 283/1690 symbols completed. BTA took 1.2s. Estimated remaining: 9m 14s. Rate: 152.4 symbols/min [2025-10-09T22:35:55.966169] [DEBUG] [MAIN ] BSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:55.966483] [DEBUG] [MAIN ] BTCM: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:35:55.968070] [INFO ] [MAIN ] BTCM: Generated 1806 derivative records from 16265 primary records. [2025-10-09T22:35:55.968161] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-09T22:35:55.967295] [INFO ] [MAIN ] BSX: Generated 1807 derivative records from 54078 primary records. [2025-10-09T22:35:55.968735] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-09T22:35:55.998559] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1806 records). [2025-10-09T22:35:56.000551] [DEBUG] [LOCAL ] BSX: Derivative data saved (1807 records). [2025-10-09T22:35:56.000673] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-09T22:35:56.000760] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-09T22:35:56.003844] [INFO ] [MAIN ] Derivative Progress: 284/1690 symbols completed. BTCM took 1.1s. Estimated remaining: 9m 12s. Rate: 152.9 symbols/min [2025-10-09T22:35:56.006602] [INFO ] [MAIN ] Derivative Progress: 285/1690 symbols completed. BSX took 1.3s. Estimated remaining: 9m 9s. Rate: 153.4 symbols/min [2025-10-09T22:35:56.007000] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:56.007152] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:56.007541] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:56.019147] [DEBUG] [LOCAL ] BTO: Loaded 8777 existing records from primary storage. [2025-10-09T22:35:56.019417] [INFO ] [MAIN ] BTO: Loaded 8777 primary data records. [2025-10-09T22:35:56.127991] [DEBUG] [LOCAL ] BTT: Loaded 15974 existing records from primary storage. [2025-10-09T22:35:56.131258] [INFO ] [MAIN ] BTT: Loaded 15974 primary data records. [2025-10-09T22:35:56.533301] [DEBUG] [LOCAL ] BTI: Loaded 53966 existing records from primary storage. [2025-10-09T22:35:56.554907] [INFO ] [MAIN ] BTI: Loaded 53966 primary data records. [2025-10-09T22:35:57.017938] [DEBUG] [MAIN ] BTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:57.028145] [INFO ] [MAIN ] BTO: Generated 1807 derivative records from 8777 primary records. [2025-10-09T22:35:57.028288] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-09T22:35:57.049189] [DEBUG] [LOCAL ] BTO: Derivative data saved (1807 records). [2025-10-09T22:35:57.049733] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-09T22:35:57.052576] [INFO ] [MAIN ] Derivative Progress: 286/1690 symbols completed. BTO took 1.0s. Estimated remaining: 9m 12s. Rate: 152.5 symbols/min [2025-10-09T22:35:57.060355] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:57.067006] [DEBUG] [MAIN ] BTT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:57.067905] [INFO ] [MAIN ] BTT: Generated 1807 derivative records from 15974 primary records. [2025-10-09T22:35:57.068677] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-09T22:35:57.086564] [DEBUG] [LOCAL ] BTT: Derivative data saved (1807 records). [2025-10-09T22:35:57.086996] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-09T22:35:57.089553] [INFO ] [MAIN ] Derivative Progress: 287/1690 symbols completed. BTT took 1.1s. Estimated remaining: 9m 10s. Rate: 153.0 symbols/min [2025-10-09T22:35:57.089740] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:57.111607] [DEBUG] [MAIN ] BTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:57.112347] [INFO ] [MAIN ] BTI: Generated 1807 derivative records from 53966 primary records. [2025-10-09T22:35:57.112949] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-09T22:35:57.121441] [DEBUG] [LOCAL ] BTZ: Loaded 22883 existing records from primary storage. [2025-10-09T22:35:57.129126] [INFO ] [MAIN ] BTZ: Loaded 22883 primary data records. [2025-10-09T22:35:57.264227] [DEBUG] [LOCAL ] BTI: Derivative data saved (1807 records). [2025-10-09T22:35:57.275421] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-09T22:35:57.288850] [INFO ] [MAIN ] Derivative Progress: 288/1690 symbols completed. BTI took 1.3s. Estimated remaining: 9m 9s. Rate: 153.3 symbols/min [2025-10-09T22:35:57.318393] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:57.482633] [DEBUG] [LOCAL ] BUD: Loaded 53080 existing records from primary storage. [2025-10-09T22:35:57.482940] [INFO ] [MAIN ] BUD: Loaded 53080 primary data records. [2025-10-09T22:35:57.573142] [DEBUG] [LOCAL ] BUI: Loaded 11912 existing records from primary storage. [2025-10-09T22:35:57.584140] [INFO ] [MAIN ] BUI: Loaded 11912 primary data records. [2025-10-09T22:35:58.187733] [DEBUG] [MAIN ] BTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:58.188551] [INFO ] [MAIN ] BTZ: Generated 1807 derivative records from 22883 primary records. [2025-10-09T22:35:58.188618] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-09T22:35:58.212763] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1807 records). [2025-10-09T22:35:58.213238] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-09T22:35:58.216084] [INFO ] [MAIN ] Derivative Progress: 289/1690 symbols completed. BTZ took 1.2s. Estimated remaining: 9m 11s. Rate: 152.5 symbols/min [2025-10-09T22:35:58.216247] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:58.237993] [DEBUG] [MAIN ] BUD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:58.238886] [INFO ] [MAIN ] BUD: Generated 1807 derivative records from 53080 primary records. [2025-10-09T22:35:58.250933] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-09T22:35:58.251880] [DEBUG] [MAIN ] BUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:58.253102] [INFO ] [MAIN ] BUI: Generated 1807 derivative records from 11912 primary records. [2025-10-09T22:35:58.264301] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-09T22:35:58.269671] [DEBUG] [LOCAL ] BUD: Derivative data saved (1807 records). [2025-10-09T22:35:58.269951] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-09T22:35:58.272699] [INFO ] [MAIN ] Derivative Progress: 290/1690 symbols completed. BUD took 1.2s. Estimated remaining: 9m 9s. Rate: 153.0 symbols/min [2025-10-09T22:35:58.284003] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:58.298153] [DEBUG] [LOCAL ] BUI: Derivative data saved (1807 records). [2025-10-09T22:35:58.298244] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-09T22:35:58.301683] [INFO ] [MAIN ] Derivative Progress: 291/1690 symbols completed. BUI took 1.0s. Estimated remaining: 9m 7s. Rate: 153.5 symbols/min [2025-10-09T22:35:58.302039] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:58.319041] [DEBUG] [LOCAL ] BUR: Loaded 45527 existing records from primary storage. [2025-10-09T22:35:58.319355] [INFO ] [MAIN ] BUR: Loaded 45527 primary data records. [2025-10-09T22:35:58.431792] [DEBUG] [LOCAL ] BUXX: Loaded 15346 existing records from primary storage. [2025-10-09T22:35:58.432012] [INFO ] [MAIN ] BUXX: Loaded 15346 primary data records. [2025-10-09T22:35:58.790963] [DEBUG] [LOCAL ] BURL: Loaded 46039 existing records from primary storage. [2025-10-09T22:35:58.820792] [INFO ] [MAIN ] BURL: Loaded 46039 primary data records. [2025-10-09T22:35:59.313522] [DEBUG] [MAIN ] BUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:59.314461] [INFO ] [MAIN ] BUR: Generated 1807 derivative records from 45527 primary records. [2025-10-09T22:35:59.314781] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-09T22:35:59.342499] [DEBUG] [MAIN ] BUXX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:59.346541] [INFO ] [MAIN ] BUXX: Generated 1807 derivative records from 15346 primary records. [2025-10-09T22:35:59.347021] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-09T22:35:59.359634] [DEBUG] [LOCAL ] BUR: Derivative data saved (1807 records). [2025-10-09T22:35:59.366280] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-09T22:35:59.369994] [INFO ] [MAIN ] Derivative Progress: 292/1690 symbols completed. BUR took 1.2s. Estimated remaining: 9m 10s. Rate: 152.6 symbols/min [2025-10-09T22:35:59.372336] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:59.371144] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1807 records). [2025-10-09T22:35:59.374358] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-09T22:35:59.377176] [INFO ] [MAIN ] Derivative Progress: 293/1690 symbols completed. BUXX took 1.1s. Estimated remaining: 9m 7s. Rate: 153.1 symbols/min [2025-10-09T22:35:59.377541] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:59.392023] [DEBUG] [MAIN ] BURL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:35:59.392795] [INFO ] [MAIN ] BURL: Generated 1807 derivative records from 46039 primary records. [2025-10-09T22:35:59.392903] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-09T22:35:59.410980] [DEBUG] [LOCAL ] BURL: Derivative data saved (1807 records). [2025-10-09T22:35:59.411212] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-09T22:35:59.414526] [INFO ] [MAIN ] Derivative Progress: 294/1690 symbols completed. BURL took 1.1s. Estimated remaining: 9m 5s. Rate: 153.6 symbols/min [2025-10-09T22:35:59.414817] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:35:59.455055] [DEBUG] [LOCAL ] BV: Loaded 38789 existing records from primary storage. [2025-10-09T22:35:59.455739] [INFO ] [MAIN ] BV: Loaded 38789 primary data records. [2025-10-09T22:35:59.535934] [DEBUG] [LOCAL ] BVN: Loaded 44431 existing records from primary storage. [2025-10-09T22:35:59.550414] [INFO ] [MAIN ] BVN: Loaded 44431 primary data records. [2025-10-09T22:35:59.695278] [DEBUG] [LOCAL ] BW: Loaded 40536 existing records from primary storage. [2025-10-09T22:35:59.716091] [INFO ] [MAIN ] BW: Loaded 40536 primary data records. [2025-10-09T22:36:00.485978] [DEBUG] [MAIN ] BV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:00.486919] [INFO ] [MAIN ] BV: Generated 1807 derivative records from 38789 primary records. [2025-10-09T22:36:00.487028] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-09T22:36:00.508036] [DEBUG] [LOCAL ] BV: Derivative data saved (1807 records). [2025-10-09T22:36:00.508353] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-09T22:36:00.511555] [INFO ] [MAIN ] Derivative Progress: 295/1690 symbols completed. BV took 1.1s. Estimated remaining: 9m 8s. Rate: 152.6 symbols/min [2025-10-09T22:36:00.511902] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:00.527734] [DEBUG] [MAIN ] BVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:00.528987] [INFO ] [MAIN ] BVN: Generated 1807 derivative records from 44431 primary records. [2025-10-09T22:36:00.529229] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-09T22:36:00.543896] [DEBUG] [MAIN ] BW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:00.545093] [INFO ] [MAIN ] BW: Generated 1807 derivative records from 40536 primary records. [2025-10-09T22:36:00.556695] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-09T22:36:00.573980] [DEBUG] [LOCAL ] BVN: Derivative data saved (1807 records). [2025-10-09T22:36:00.574562] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-09T22:36:00.578432] [INFO ] [MAIN ] Derivative Progress: 296/1690 symbols completed. BVN took 1.2s. Estimated remaining: 9m 6s. Rate: 153.1 symbols/min [2025-10-09T22:36:00.580720] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:00.582157] [DEBUG] [LOCAL ] BW: Derivative data saved (1807 records). [2025-10-09T22:36:00.582430] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-09T22:36:00.585511] [INFO ] [MAIN ] Derivative Progress: 297/1690 symbols completed. BW took 1.2s. Estimated remaining: 9m 4s. Rate: 153.6 symbols/min [2025-10-09T22:36:00.585687] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:00.609144] [DEBUG] [LOCAL ] BWMX: Loaded 7763 existing records from primary storage. [2025-10-09T22:36:00.609357] [INFO ] [MAIN ] BWMX: Loaded 7763 primary data records. [2025-10-09T22:36:00.725379] [DEBUG] [LOCAL ] BWA: Loaded 52541 existing records from primary storage. [2025-10-09T22:36:00.746844] [INFO ] [MAIN ] BWA: Loaded 52541 primary data records. [2025-10-09T22:36:00.763544] [DEBUG] [LOCAL ] BWLP: Loaded 32641 existing records from primary storage. [2025-10-09T22:36:00.780061] [INFO ] [MAIN ] BWLP: Loaded 32641 primary data records. [2025-10-09T22:36:01.645721] [DEBUG] [MAIN ] BWLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:01.645430] [DEBUG] [MAIN ] BWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:01.647121] [INFO ] [MAIN ] BWA: Generated 1807 derivative records from 52541 primary records. [2025-10-09T22:36:01.646498] [INFO ] [MAIN ] BWLP: Generated 1807 derivative records from 32641 primary records. [2025-10-09T22:36:01.645075] [DEBUG] [MAIN ] BWMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:01.647225] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-09T22:36:01.647343] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-09T22:36:01.648034] [INFO ] [MAIN ] BWMX: Generated 1807 derivative records from 7763 primary records. [2025-10-09T22:36:01.657001] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-09T22:36:01.679630] [DEBUG] [LOCAL ] BWA: Derivative data saved (1807 records). [2025-10-09T22:36:01.679766] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-09T22:36:01.693980] [INFO ] [MAIN ] Derivative Progress: 298/1690 symbols completed. BWA took 1.2s. Estimated remaining: 9m 7s. Rate: 152.6 symbols/min [2025-10-09T22:36:01.681001] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1807 records). [2025-10-09T22:36:01.697573] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-09T22:36:01.698363] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1807 records). [2025-10-09T22:36:01.701257] [INFO ] [MAIN ] Derivative Progress: 299/1690 symbols completed. BWLP took 1.1s. Estimated remaining: 9m 5s. Rate: 153.1 symbols/min [2025-10-09T22:36:01.701351] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-09T22:36:01.703627] [INFO ] [MAIN ] Derivative Progress: 300/1690 symbols completed. BWMX took 1.1s. Estimated remaining: 9m 3s. Rate: 153.6 symbols/min [2025-10-09T22:36:01.704042] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:01.703993] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:01.704743] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:01.714248] [DEBUG] [LOCAL ] BWNB: Loaded 4267 existing records from primary storage. [2025-10-09T22:36:01.714504] [INFO ] [MAIN ] BWNB: Loaded 4267 primary data records. [2025-10-09T22:36:01.750338] [DEBUG] [LOCAL ] BWSN: Loaded 5154 existing records from primary storage. [2025-10-09T22:36:01.768825] [INFO ] [MAIN ] BWSN: Loaded 5154 primary data records. [2025-10-09T22:36:02.387964] [DEBUG] [LOCAL ] BWXT: Loaded 47178 existing records from primary storage. [2025-10-09T22:36:02.388574] [INFO ] [MAIN ] BWXT: Loaded 47178 primary data records. [2025-10-09T22:36:02.722789] [DEBUG] [MAIN ] BWNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:02.723861] [INFO ] [MAIN ] BWNB: Generated 1807 derivative records from 4267 primary records. [2025-10-09T22:36:02.723949] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-09T22:36:02.742033] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1807 records). [2025-10-09T22:36:02.743416] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-09T22:36:02.746590] [INFO ] [MAIN ] Derivative Progress: 301/1690 symbols completed. BWNB took 1.0s. Estimated remaining: 9m 5s. Rate: 152.8 symbols/min [2025-10-09T22:36:02.747229] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:02.762765] [DEBUG] [MAIN ] BWSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:02.763679] [INFO ] [MAIN ] BWSN: Generated 1807 derivative records from 5154 primary records. [2025-10-09T22:36:02.763781] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-09T22:36:02.782259] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1807 records). [2025-10-09T22:36:02.782540] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-09T22:36:02.785782] [INFO ] [MAIN ] Derivative Progress: 302/1690 symbols completed. BWSN took 1.1s. Estimated remaining: 9m 3s. Rate: 153.2 symbols/min [2025-10-09T22:36:02.787175] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:02.803306] [DEBUG] [MAIN ] BWXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:02.804205] [INFO ] [MAIN ] BWXT: Generated 1807 derivative records from 47178 primary records. [2025-10-09T22:36:02.804335] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-09T22:36:02.839039] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1807 records). [2025-10-09T22:36:02.839195] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-09T22:36:02.842106] [INFO ] [MAIN ] Derivative Progress: 303/1690 symbols completed. BWXT took 1.1s. Estimated remaining: 9m 2s. Rate: 153.7 symbols/min [2025-10-09T22:36:02.842416] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:02.849786] [DEBUG] [LOCAL ] BXC: Loaded 13770 existing records from primary storage. [2025-10-09T22:36:02.850139] [INFO ] [MAIN ] BXC: Loaded 13770 primary data records. [2025-10-09T22:36:02.923155] [DEBUG] [LOCAL ] BX: Loaded 53869 existing records from primary storage. [2025-10-09T22:36:02.938504] [INFO ] [MAIN ] BX: Loaded 53869 primary data records. [2025-10-09T22:36:03.505611] [DEBUG] [LOCAL ] BXMT: Loaded 47558 existing records from primary storage. [2025-10-09T22:36:03.505983] [INFO ] [MAIN ] BXMT: Loaded 47558 primary data records. [2025-10-09T22:36:03.917197] [DEBUG] [MAIN ] BXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:03.918919] [INFO ] [MAIN ] BXC: Generated 1807 derivative records from 13770 primary records. [2025-10-09T22:36:03.919137] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-09T22:36:03.918021] [DEBUG] [MAIN ] BX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:03.920680] [INFO ] [MAIN ] BX: Generated 1807 derivative records from 53869 primary records. [2025-10-09T22:36:03.928431] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-09T22:36:03.953348] [DEBUG] [LOCAL ] BXC: Derivative data saved (1807 records). [2025-10-09T22:36:03.953875] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-09T22:36:03.957124] [INFO ] [MAIN ] Derivative Progress: 304/1690 symbols completed. BXC took 1.2s. Estimated remaining: 9m 4s. Rate: 152.8 symbols/min [2025-10-09T22:36:03.971174] [DEBUG] [MAIN ] BXMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:03.965303] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:03.972976] [INFO ] [MAIN ] BXMT: Generated 1807 derivative records from 47558 primary records. [2025-10-09T22:36:03.974493] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-09T22:36:03.974398] [DEBUG] [LOCAL ] BX: Derivative data saved (1807 records). [2025-10-09T22:36:03.975232] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-09T22:36:03.978519] [INFO ] [MAIN ] Derivative Progress: 305/1690 symbols completed. BX took 1.2s. Estimated remaining: 9m 2s. Rate: 153.2 symbols/min [2025-10-09T22:36:03.986419] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:04.000576] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1807 records). [2025-10-09T22:36:04.000807] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-09T22:36:04.004457] [INFO ] [MAIN ] Derivative Progress: 306/1690 symbols completed. BXMT took 1.2s. Estimated remaining: 9m 0s. Rate: 153.7 symbols/min [2025-10-09T22:36:04.004730] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:04.016053] [DEBUG] [LOCAL ] BXMX: Loaded 19639 existing records from primary storage. [2025-10-09T22:36:04.016232] [INFO ] [MAIN ] BXMX: Loaded 19639 primary data records. [2025-10-09T22:36:04.243795] [DEBUG] [LOCAL ] BY: Loaded 21764 existing records from primary storage. [2025-10-09T22:36:04.366936] [INFO ] [MAIN ] BY: Loaded 21764 primary data records. [2025-10-09T22:36:04.368477] [DEBUG] [LOCAL ] BXSL: Loaded 48220 existing records from primary storage. [2025-10-09T22:36:04.368778] [INFO ] [MAIN ] BXSL: Loaded 48220 primary data records. [2025-10-09T22:36:05.012800] [DEBUG] [MAIN ] BXMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:05.013759] [INFO ] [MAIN ] BXMX: Generated 1807 derivative records from 19639 primary records. [2025-10-09T22:36:05.014044] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-09T22:36:05.032854] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1807 records). [2025-10-09T22:36:05.033207] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-09T22:36:05.035845] [INFO ] [MAIN ] Derivative Progress: 307/1690 symbols completed. BXMX took 1.1s. Estimated remaining: 9m 3s. Rate: 152.9 symbols/min [2025-10-09T22:36:05.036176] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:05.053446] [DEBUG] [MAIN ] BY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:05.054851] [INFO ] [MAIN ] BY: Generated 1807 derivative records from 21764 primary records. [2025-10-09T22:36:05.055631] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-09T22:36:05.077821] [DEBUG] [MAIN ] BXSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:05.081607] [INFO ] [MAIN ] BXSL: Generated 1807 derivative records from 48220 primary records. [2025-10-09T22:36:05.082345] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-09T22:36:05.101782] [DEBUG] [LOCAL ] BY: Derivative data saved (1807 records). [2025-10-09T22:36:05.102471] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-09T22:36:05.106126] [INFO ] [MAIN ] Derivative Progress: 308/1690 symbols completed. BY took 1.1s. Estimated remaining: 9m 1s. Rate: 153.3 symbols/min [2025-10-09T22:36:05.108127] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1807 records). [2025-10-09T22:36:05.108520] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-09T22:36:05.108428] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:05.111801] [INFO ] [MAIN ] Derivative Progress: 309/1690 symbols completed. BXSL took 1.1s. Estimated remaining: 8m 59s. Rate: 153.8 symbols/min [2025-10-09T22:36:05.112192] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:05.143913] [DEBUG] [LOCAL ] BYD: Loaded 45181 existing records from primary storage. [2025-10-09T22:36:05.144214] [INFO ] [MAIN ] BYD: Loaded 45181 primary data records. [2025-10-09T22:36:05.242549] [DEBUG] [LOCAL ] BYM: Loaded 12051 existing records from primary storage. [2025-10-09T22:36:05.258987] [INFO ] [MAIN ] BYM: Loaded 12051 primary data records. [2025-10-09T22:36:05.374398] [DEBUG] [LOCAL ] BZH: Loaded 32653 existing records from primary storage. [2025-10-09T22:36:05.395302] [INFO ] [MAIN ] BZH: Loaded 32653 primary data records. [2025-10-09T22:36:06.191693] [DEBUG] [MAIN ] BYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:06.204867] [DEBUG] [MAIN ] BYM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:06.204606] [INFO ] [MAIN ] BYD: Generated 1807 derivative records from 45181 primary records. [2025-10-09T22:36:06.205954] [INFO ] [MAIN ] BYM: Generated 1807 derivative records from 12051 primary records. [2025-10-09T22:36:06.205293] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-09T22:36:06.206916] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-09T22:36:06.240559] [DEBUG] [LOCAL ] BYD: Derivative data saved (1807 records). [2025-10-09T22:36:06.240736] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-09T22:36:06.244817] [INFO ] [MAIN ] Derivative Progress: 310/1690 symbols completed. BYD took 1.2s. Estimated remaining: 9m 2s. Rate: 152.8 symbols/min [2025-10-09T22:36:06.246591] [DEBUG] [LOCAL ] BYM: Derivative data saved (1807 records). [2025-10-09T22:36:06.246352] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:06.246872] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-09T22:36:06.249796] [INFO ] [MAIN ] Derivative Progress: 311/1690 symbols completed. BYM took 1.1s. Estimated remaining: 8m 60s. Rate: 153.3 symbols/min [2025-10-09T22:36:06.250331] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:06.265122] [DEBUG] [MAIN ] BZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:06.265949] [INFO ] [MAIN ] BZH: Generated 1807 derivative records from 32653 primary records. [2025-10-09T22:36:06.266061] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-09T22:36:06.288994] [DEBUG] [LOCAL ] BZH: Derivative data saved (1807 records). [2025-10-09T22:36:06.289147] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-09T22:36:06.292488] [INFO ] [MAIN ] Derivative Progress: 312/1690 symbols completed. BZH took 1.2s. Estimated remaining: 8m 58s. Rate: 153.8 symbols/min [2025-10-09T22:36:06.301725] [DEBUG] [LOCAL ] CAAP: Loaded 19969 existing records from primary storage. [2025-10-09T22:36:06.301097] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:06.302083] [INFO ] [MAIN ] CAAP: Loaded 19969 primary data records. [2025-10-09T22:36:06.476550] [DEBUG] [LOCAL ] CABO: Loaded 16965 existing records from primary storage. [2025-10-09T22:36:06.515080] [INFO ] [MAIN ] CABO: Loaded 16965 primary data records. [2025-10-09T22:36:06.703237] [DEBUG] [LOCAL ] C: Loaded 54130 existing records from primary storage. [2025-10-09T22:36:06.726689] [INFO ] [MAIN ] C: Loaded 54130 primary data records. [2025-10-09T22:36:07.278604] [DEBUG] [MAIN ] CAAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:07.279945] [INFO ] [MAIN ] CAAP: Generated 1807 derivative records from 19969 primary records. [2025-10-09T22:36:07.280367] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-09T22:36:07.317210] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1807 records). [2025-10-09T22:36:07.317851] [DEBUG] [MAIN ] CABO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:07.317958] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-09T22:36:07.322150] [INFO ] [MAIN ] CABO: Generated 1807 derivative records from 16965 primary records. [2025-10-09T22:36:07.321124] [INFO ] [MAIN ] Derivative Progress: 313/1690 symbols completed. CAAP took 1.1s. Estimated remaining: 9m 0s. Rate: 153.0 symbols/min [2025-10-09T22:36:07.322539] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-09T22:36:07.352897] [DEBUG] [MAIN ] C: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:07.354380] [INFO ] [MAIN ] C: Generated 1807 derivative records from 54130 primary records. [2025-10-09T22:36:07.354982] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-09T22:36:07.356172] [DEBUG] [LOCAL ] CABO: Derivative data saved (1807 records). [2025-10-09T22:36:07.356537] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-09T22:36:07.359538] [INFO ] [MAIN ] Derivative Progress: 314/1690 symbols completed. CABO took 1.1s. Estimated remaining: 8m 58s. Rate: 153.4 symbols/min [2025-10-09T22:36:07.374917] [DEBUG] [LOCAL ] C: Derivative data saved (1807 records). [2025-10-09T22:36:07.374993] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-09T22:36:07.378944] [INFO ] [MAIN ] Derivative Progress: 315/1690 symbols completed. C took 1.1s. Estimated remaining: 8m 56s. Rate: 153.9 symbols/min [2025-10-09T22:36:07.379528] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:07.379721] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:07.379428] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:07.409938] [DEBUG] [LOCAL ] CACI: Loaded 23891 existing records from primary storage. [2025-10-09T22:36:07.429788] [INFO ] [MAIN ] CACI: Loaded 23891 primary data records. [2025-10-09T22:36:07.546269] [DEBUG] [LOCAL ] CADE: Loaded 49553 existing records from primary storage. [2025-10-09T22:36:07.558990] [DEBUG] [LOCAL ] CAE: Loaded 39472 existing records from primary storage. [2025-10-09T22:36:07.574818] [INFO ] [MAIN ] CAE: Loaded 39472 primary data records. [2025-10-09T22:36:07.574738] [INFO ] [MAIN ] CADE: Loaded 49553 primary data records. [2025-10-09T22:36:08.439411] [DEBUG] [MAIN ] CACI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:08.440533] [INFO ] [MAIN ] CACI: Generated 1807 derivative records from 23891 primary records. [2025-10-09T22:36:08.440866] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-09T22:36:08.470853] [DEBUG] [MAIN ] CADE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:08.473265] [INFO ] [MAIN ] CADE: Generated 1807 derivative records from 49553 primary records. [2025-10-09T22:36:08.474738] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-09T22:36:08.475602] [DEBUG] [LOCAL ] CACI: Derivative data saved (1807 records). [2025-10-09T22:36:08.476356] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-09T22:36:08.479361] [INFO ] [MAIN ] Derivative Progress: 316/1690 symbols completed. CACI took 1.1s. Estimated remaining: 8m 59s. Rate: 153.0 symbols/min [2025-10-09T22:36:08.479527] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:08.504603] [DEBUG] [MAIN ] CAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:08.505818] [INFO ] [MAIN ] CAE: Generated 1807 derivative records from 39472 primary records. [2025-10-09T22:36:08.506540] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-09T22:36:08.525521] [DEBUG] [LOCAL ] CADE: Derivative data saved (1807 records). [2025-10-09T22:36:08.525586] [DEBUG] [LOCAL ] CAE: Derivative data saved (1807 records). [2025-10-09T22:36:08.525761] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-09T22:36:08.528886] [INFO ] [MAIN ] Derivative Progress: 317/1690 symbols completed. CADE took 1.1s. Estimated remaining: 8m 57s. Rate: 153.4 symbols/min [2025-10-09T22:36:08.525835] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-09T22:36:08.529085] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:08.533163] [INFO ] [MAIN ] Derivative Progress: 318/1690 symbols completed. CAE took 1.2s. Estimated remaining: 8m 55s. Rate: 153.9 symbols/min [2025-10-09T22:36:08.533681] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:08.585603] [DEBUG] [LOCAL ] CAG: Loaded 54054 existing records from primary storage. [2025-10-09T22:36:08.585900] [INFO ] [MAIN ] CAG: Loaded 54054 primary data records. [2025-10-09T22:36:08.793224] [DEBUG] [LOCAL ] CAH: Loaded 51836 existing records from primary storage. [2025-10-09T22:36:08.803530] [DEBUG] [LOCAL ] CAL: Loaded 43336 existing records from primary storage. [2025-10-09T22:36:08.820800] [INFO ] [MAIN ] CAH: Loaded 51836 primary data records. [2025-10-09T22:36:08.823722] [INFO ] [MAIN ] CAL: Loaded 43336 primary data records. [2025-10-09T22:36:09.616405] [DEBUG] [MAIN ] CAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:09.617254] [INFO ] [MAIN ] CAG: Generated 1807 derivative records from 54054 primary records. [2025-10-09T22:36:09.617439] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-09T22:36:09.642314] [DEBUG] [LOCAL ] CAG: Derivative data saved (1807 records). [2025-10-09T22:36:09.648169] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-09T22:36:09.664336] [INFO ] [MAIN ] Derivative Progress: 319/1690 symbols completed. CAG took 1.2s. Estimated remaining: 8m 58s. Rate: 153.0 symbols/min [2025-10-09T22:36:09.665064] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:09.665483] [DEBUG] [MAIN ] CAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:09.669224] [INFO ] [MAIN ] CAH: Generated 1807 derivative records from 51836 primary records. [2025-10-09T22:36:09.670137] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-09T22:36:09.703391] [DEBUG] [MAIN ] CAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:09.705133] [INFO ] [MAIN ] CAL: Generated 1807 derivative records from 43336 primary records. [2025-10-09T22:36:09.705994] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-09T22:36:09.728749] [DEBUG] [LOCAL ] CAH: Derivative data saved (1807 records). [2025-10-09T22:36:09.729734] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-09T22:36:09.742717] [INFO ] [MAIN ] Derivative Progress: 320/1690 symbols completed. CAH took 1.2s. Estimated remaining: 8m 56s. Rate: 153.4 symbols/min [2025-10-09T22:36:09.743474] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:09.746421] [DEBUG] [LOCAL ] CAL: Derivative data saved (1807 records). [2025-10-09T22:36:09.746572] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-09T22:36:09.749891] [INFO ] [MAIN ] Derivative Progress: 321/1690 symbols completed. CAL took 1.2s. Estimated remaining: 8m 54s. Rate: 153.8 symbols/min [2025-10-09T22:36:09.750079] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:09.763299] [DEBUG] [LOCAL ] CALX: Loaded 37960 existing records from primary storage. [2025-10-09T22:36:09.763451] [INFO ] [MAIN ] CALX: Loaded 37960 primary data records. [2025-10-09T22:36:09.826631] [DEBUG] [LOCAL ] CAPL: Loaded 5748 existing records from primary storage. [2025-10-09T22:36:09.848270] [INFO ] [MAIN ] CAPL: Loaded 5748 primary data records. [2025-10-09T22:36:10.089710] [DEBUG] [LOCAL ] CANG: Loaded 27185 existing records from primary storage. [2025-10-09T22:36:10.093740] [INFO ] [MAIN ] CANG: Loaded 27185 primary data records. [2025-10-09T22:36:10.831597] [DEBUG] [MAIN ] CALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:10.834625] [INFO ] [MAIN ] CALX: Generated 1807 derivative records from 37960 primary records. [2025-10-09T22:36:10.835004] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-09T22:36:10.858144] [DEBUG] [MAIN ] CAPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:10.863122] [INFO ] [MAIN ] CAPL: Generated 1807 derivative records from 5748 primary records. [2025-10-09T22:36:10.864245] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-09T22:36:10.896329] [DEBUG] [LOCAL ] CALX: Derivative data saved (1807 records). [2025-10-09T22:36:10.896772] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-09T22:36:10.896860] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1807 records). [2025-10-09T22:36:10.899542] [INFO ] [MAIN ] Derivative Progress: 322/1690 symbols completed. CALX took 1.2s. Estimated remaining: 8m 57s. Rate: 152.9 symbols/min [2025-10-09T22:36:10.899626] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-09T22:36:10.897222] [DEBUG] [MAIN ] CANG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:10.903420] [INFO ] [MAIN ] CANG: Generated 1807 derivative records from 27185 primary records. [2025-10-09T22:36:10.903585] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:10.903901] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-09T22:36:10.903680] [INFO ] [MAIN ] Derivative Progress: 323/1690 symbols completed. CAPL took 1.2s. Estimated remaining: 8m 55s. Rate: 153.4 symbols/min [2025-10-09T22:36:10.904452] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:10.921464] [DEBUG] [LOCAL ] CANG: Derivative data saved (1807 records). [2025-10-09T22:36:10.921705] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-09T22:36:10.924852] [INFO ] [MAIN ] Derivative Progress: 324/1690 symbols completed. CANG took 1.2s. Estimated remaining: 8m 53s. Rate: 153.8 symbols/min [2025-10-09T22:36:10.925181] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:10.994186] [DEBUG] [LOCAL ] CARS: Loaded 40024 existing records from primary storage. [2025-10-09T22:36:10.994515] [INFO ] [MAIN ] CARS: Loaded 40024 primary data records. [2025-10-09T22:36:11.008545] [DEBUG] [LOCAL ] CARR: Loaded 53987 existing records from primary storage. [2025-10-09T22:36:11.043109] [INFO ] [MAIN ] CARR: Loaded 53987 primary data records. [2025-10-09T22:36:11.320626] [DEBUG] [LOCAL ] CAT: Loaded 53301 existing records from primary storage. [2025-10-09T22:36:11.345462] [INFO ] [MAIN ] CAT: Loaded 53301 primary data records. [2025-10-09T22:36:12.085015] [DEBUG] [MAIN ] CARS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:12.086806] [INFO ] [MAIN ] CARS: Generated 1807 derivative records from 40024 primary records. [2025-10-09T22:36:12.085792] [DEBUG] [MAIN ] CARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:12.087919] [INFO ] [MAIN ] CARR: Generated 1807 derivative records from 53987 primary records. [2025-10-09T22:36:12.088126] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-09T22:36:12.087076] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-09T22:36:12.117810] [DEBUG] [LOCAL ] CARS: Derivative data saved (1807 records). [2025-10-09T22:36:12.120518] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-09T22:36:12.125698] [INFO ] [MAIN ] Derivative Progress: 325/1690 symbols completed. CARS took 1.2s. Estimated remaining: 8m 56s. Rate: 152.8 symbols/min [2025-10-09T22:36:12.127122] [DEBUG] [LOCAL ] CARR: Derivative data saved (1807 records). [2025-10-09T22:36:12.127323] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:12.127773] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-09T22:36:12.143446] [INFO ] [MAIN ] Derivative Progress: 326/1690 symbols completed. CARR took 1.2s. Estimated remaining: 8m 54s. Rate: 153.3 symbols/min [2025-10-09T22:36:12.144465] [DEBUG] [MAIN ] CAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:12.145707] [INFO ] [MAIN ] CAT: Generated 1807 derivative records from 53301 primary records. [2025-10-09T22:36:12.144766] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:12.145803] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-09T22:36:12.165724] [DEBUG] [LOCAL ] CAT: Derivative data saved (1807 records). [2025-10-09T22:36:12.165990] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-09T22:36:12.169195] [INFO ] [MAIN ] Derivative Progress: 327/1690 symbols completed. CAT took 1.2s. Estimated remaining: 8m 52s. Rate: 153.7 symbols/min [2025-10-09T22:36:12.169744] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:12.173760] [DEBUG] [LOCAL ] CATO: Loaded 6908 existing records from primary storage. [2025-10-09T22:36:12.173875] [INFO ] [MAIN ] CATO: Loaded 6908 primary data records. [2025-10-09T22:36:12.315451] [DEBUG] [LOCAL ] CBAN: Loaded 10711 existing records from primary storage. [2025-10-09T22:36:12.360918] [INFO ] [MAIN ] CBAN: Loaded 10711 primary data records. [2025-10-09T22:36:12.622341] [DEBUG] [LOCAL ] CB: Loaded 50296 existing records from primary storage. [2025-10-09T22:36:12.643948] [INFO ] [MAIN ] CB: Loaded 50296 primary data records. [2025-10-09T22:36:13.161456] [DEBUG] [MAIN ] CATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:13.162758] [INFO ] [MAIN ] CATO: Generated 1807 derivative records from 6908 primary records. [2025-10-09T22:36:13.163014] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-09T22:36:13.183307] [DEBUG] [LOCAL ] CATO: Derivative data saved (1807 records). [2025-10-09T22:36:13.183535] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-09T22:36:13.186053] [INFO ] [MAIN ] Derivative Progress: 328/1690 symbols completed. CATO took 1.1s. Estimated remaining: 8m 54s. Rate: 153.0 symbols/min [2025-10-09T22:36:13.199595] [DEBUG] [MAIN ] CBAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:13.200940] [INFO ] [MAIN ] CBAN: Generated 1807 derivative records from 10711 primary records. [2025-10-09T22:36:13.201196] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-09T22:36:13.233423] [DEBUG] [MAIN ] CB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:13.235396] [INFO ] [MAIN ] CB: Generated 1807 derivative records from 50296 primary records. [2025-10-09T22:36:13.234675] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1807 records). [2025-10-09T22:36:13.235548] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-09T22:36:13.235669] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-09T22:36:13.238634] [INFO ] [MAIN ] Derivative Progress: 329/1690 symbols completed. CBAN took 1.1s. Estimated remaining: 8m 52s. Rate: 153.4 symbols/min [2025-10-09T22:36:13.255106] [DEBUG] [LOCAL ] CB: Derivative data saved (1807 records). [2025-10-09T22:36:13.255172] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-09T22:36:13.258168] [INFO ] [MAIN ] Derivative Progress: 330/1690 symbols completed. CB took 1.1s. Estimated remaining: 8m 50s. Rate: 153.8 symbols/min [2025-10-09T22:36:13.258626] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:13.259023] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:13.259133] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:13.265785] [DEBUG] [LOCAL ] CBNA: Loaded 2910 existing records from primary storage. [2025-10-09T22:36:13.265974] [INFO ] [MAIN ] CBNA: Loaded 2910 primary data records. [2025-10-09T22:36:13.384326] [DEBUG] [LOCAL ] CBL: Loaded 16385 existing records from primary storage. [2025-10-09T22:36:13.408480] [INFO ] [MAIN ] CBL: Loaded 16385 primary data records. [2025-10-09T22:36:13.733386] [DEBUG] [LOCAL ] CBRE: Loaded 50764 existing records from primary storage. [2025-10-09T22:36:13.744256] [INFO ] [MAIN ] CBRE: Loaded 50764 primary data records. [2025-10-09T22:36:14.345350] [DEBUG] [MAIN ] CBNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:14.346443] [INFO ] [MAIN ] CBNA: Generated 1807 derivative records from 2910 primary records. [2025-10-09T22:36:14.346762] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-09T22:36:14.362129] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1807 records). [2025-10-09T22:36:14.362238] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-09T22:36:14.364818] [INFO ] [MAIN ] Derivative Progress: 331/1690 symbols completed. CBNA took 1.1s. Estimated remaining: 8m 53s. Rate: 153.0 symbols/min [2025-10-09T22:36:14.365103] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:14.384020] [DEBUG] [MAIN ] CBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:14.385146] [INFO ] [MAIN ] CBL: Generated 1807 derivative records from 16385 primary records. [2025-10-09T22:36:14.385442] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-09T22:36:14.427991] [DEBUG] [LOCAL ] CBL: Derivative data saved (1807 records). [2025-10-09T22:36:14.428351] [DEBUG] [MAIN ] CBRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:14.429436] [INFO ] [MAIN ] CBRE: Generated 1807 derivative records from 50764 primary records. [2025-10-09T22:36:14.429544] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-09T22:36:14.429627] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-09T22:36:14.441180] [INFO ] [MAIN ] Derivative Progress: 332/1690 symbols completed. CBL took 1.2s. Estimated remaining: 8m 51s. Rate: 153.4 symbols/min [2025-10-09T22:36:14.442322] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:14.443167] [DEBUG] [LOCAL ] CBT: Loaded 31037 existing records from primary storage. [2025-10-09T22:36:14.443471] [INFO ] [MAIN ] CBT: Loaded 31037 primary data records. [2025-10-09T22:36:14.626494] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1807 records). [2025-10-09T22:36:14.651450] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-09T22:36:14.657317] [DEBUG] [LOCAL ] CBU: Loaded 22667 existing records from primary storage. [2025-10-09T22:36:14.770105] [INFO ] [MAIN ] Derivative Progress: 333/1690 symbols completed. CBRE took 1.5s. Estimated remaining: 8m 51s. Rate: 153.4 symbols/min [2025-10-09T22:36:14.657499] [INFO ] [MAIN ] CBU: Loaded 22667 primary data records. [2025-10-09T22:36:14.779628] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:15.145687] [DEBUG] [MAIN ] CBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:15.148205] [INFO ] [MAIN ] CBT: Generated 1807 derivative records from 31037 primary records. [2025-10-09T22:36:15.149953] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-09T22:36:15.149860] [DEBUG] [LOCAL ] CC: Loaded 53381 existing records from primary storage. [2025-10-09T22:36:15.151263] [INFO ] [MAIN ] CC: Loaded 53381 primary data records. [2025-10-09T22:36:15.288297] [DEBUG] [LOCAL ] CBT: Derivative data saved (1807 records). [2025-10-09T22:36:15.293918] [DEBUG] [MAIN ] CBU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:15.310317] [INFO ] [MAIN ] CBU: Generated 1807 derivative records from 22667 primary records. [2025-10-09T22:36:15.304404] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-09T22:36:15.344952] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-09T22:36:15.362924] [INFO ] [MAIN ] Derivative Progress: 334/1690 symbols completed. CBT took 1.0s. Estimated remaining: 8m 51s. Rate: 153.2 symbols/min [2025-10-09T22:36:15.473875] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:15.504547] [DEBUG] [LOCAL ] CBU: Derivative data saved (1807 records). [2025-10-09T22:36:15.504710] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-09T22:36:15.508100] [INFO ] [MAIN ] Derivative Progress: 335/1690 symbols completed. CBU took 1.1s. Estimated remaining: 8m 50s. Rate: 153.5 symbols/min [2025-10-09T22:36:15.509022] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:15.529545] [DEBUG] [LOCAL ] CCIF: Loaded 15738 existing records from primary storage. [2025-10-09T22:36:15.529710] [INFO ] [MAIN ] CCIF: Loaded 15738 primary data records. [2025-10-09T22:36:15.605577] [DEBUG] [MAIN ] CC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:15.658901] [INFO ] [MAIN ] CC: Generated 1807 derivative records from 53381 primary records. [2025-10-09T22:36:15.659096] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-09T22:36:15.754031] [DEBUG] [LOCAL ] CC: Derivative data saved (1807 records). [2025-10-09T22:36:15.871630] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-09T22:36:15.887634] [INFO ] [MAIN ] Derivative Progress: 336/1690 symbols completed. CC took 1.1s. Estimated remaining: 8m 49s. Rate: 153.5 symbols/min [2025-10-09T22:36:15.888169] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:15.893118] [DEBUG] [LOCAL ] CCI: Loaded 53516 existing records from primary storage. [2025-10-09T22:36:15.893435] [INFO ] [MAIN ] CCI: Loaded 53516 primary data records. [2025-10-09T22:36:16.298149] [DEBUG] [LOCAL ] CCJ: Loaded 54065 existing records from primary storage. [2025-10-09T22:36:16.298370] [INFO ] [MAIN ] CCJ: Loaded 54065 primary data records. [2025-10-09T22:36:16.297794] [DEBUG] [MAIN ] CCIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:16.299377] [INFO ] [MAIN ] CCIF: Generated 1807 derivative records from 15738 primary records. [2025-10-09T22:36:16.319403] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-09T22:36:16.445442] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1807 records). [2025-10-09T22:36:16.450871] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-09T22:36:16.477479] [INFO ] [MAIN ] Derivative Progress: 337/1690 symbols completed. CCIF took 1.0s. Estimated remaining: 8m 50s. Rate: 153.3 symbols/min [2025-10-09T22:36:16.477693] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:16.657114] [DEBUG] [MAIN ] CCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:16.658184] [INFO ] [MAIN ] CCI: Generated 1807 derivative records from 53516 primary records. [2025-10-09T22:36:16.658586] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-09T22:36:16.681899] [DEBUG] [LOCAL ] CCI: Derivative data saved (1807 records). [2025-10-09T22:36:16.682252] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-09T22:36:16.684805] [INFO ] [MAIN ] Derivative Progress: 338/1690 symbols completed. CCI took 1.2s. Estimated remaining: 8m 49s. Rate: 153.5 symbols/min [2025-10-09T22:36:16.686190] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:16.716181] [DEBUG] [MAIN ] CCJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:16.716849] [INFO ] [MAIN ] CCJ: Generated 1807 derivative records from 54065 primary records. [2025-10-09T22:36:16.716968] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-09T22:36:16.748177] [DEBUG] [LOCAL ] CCK: Loaded 46656 existing records from primary storage. [2025-10-09T22:36:16.749302] [INFO ] [MAIN ] CCK: Loaded 46656 primary data records. [2025-10-09T22:36:16.750754] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1807 records). [2025-10-09T22:36:16.774786] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-09T22:36:16.778904] [INFO ] [MAIN ] Derivative Progress: 339/1690 symbols completed. CCJ took 0.9s. Estimated remaining: 8m 47s. Rate: 153.8 symbols/min [2025-10-09T22:36:16.827100] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:17.128058] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-09T22:36:17.141018] [INFO ] [MAIN ] CCL: Loaded 54190 primary data records. [2025-10-09T22:36:17.290464] [DEBUG] [LOCAL ] CCO: Loaded 48377 existing records from primary storage. [2025-10-09T22:36:17.331052] [INFO ] [MAIN ] CCO: Loaded 48377 primary data records. [2025-10-09T22:36:17.615946] [DEBUG] [MAIN ] CCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:17.673917] [INFO ] [MAIN ] CCK: Generated 1807 derivative records from 46656 primary records. [2025-10-09T22:36:17.678411] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-09T22:36:17.822875] [DEBUG] [LOCAL ] CCK: Derivative data saved (1807 records). [2025-10-09T22:36:17.824008] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-09T22:36:17.826958] [INFO ] [MAIN ] Derivative Progress: 340/1690 symbols completed. CCK took 1.3s. Estimated remaining: 8m 49s. Rate: 153.1 symbols/min [2025-10-09T22:36:17.827345] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:17.842674] [DEBUG] [MAIN ] CCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:17.843467] [INFO ] [MAIN ] CCL: Generated 1807 derivative records from 54190 primary records. [2025-10-09T22:36:17.843895] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-09T22:36:17.864550] [DEBUG] [LOCAL ] CCL: Derivative data saved (1807 records). [2025-10-09T22:36:17.869296] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-09T22:36:17.869113] [DEBUG] [LOCAL ] CCRD: Loaded 9287 existing records from primary storage. [2025-10-09T22:36:17.872485] [INFO ] [MAIN ] Derivative Progress: 341/1690 symbols completed. CCL took 1.2s. Estimated remaining: 8m 47s. Rate: 153.5 symbols/min [2025-10-09T22:36:17.872714] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:17.869628] [INFO ] [MAIN ] CCRD: Loaded 9287 primary data records. [2025-10-09T22:36:17.981352] [DEBUG] [MAIN ] CCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:17.992339] [INFO ] [MAIN ] CCO: Generated 1807 derivative records from 48377 primary records. [2025-10-09T22:36:18.006186] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-09T22:36:18.274929] [DEBUG] [LOCAL ] CCS: Loaded 30479 existing records from primary storage. [2025-10-09T22:36:18.276209] [INFO ] [MAIN ] CCS: Loaded 30479 primary data records. [2025-10-09T22:36:18.395362] [DEBUG] [LOCAL ] CCO: Derivative data saved (1807 records). [2025-10-09T22:36:18.401743] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-09T22:36:18.405431] [INFO ] [MAIN ] Derivative Progress: 342/1690 symbols completed. CCO took 1.6s. Estimated remaining: 8m 48s. Rate: 153.3 symbols/min [2025-10-09T22:36:18.411071] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:18.629131] [DEBUG] [MAIN ] CCRD: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:36:18.637445] [INFO ] [MAIN ] CCRD: Generated 1805 derivative records from 9287 primary records. [2025-10-09T22:36:18.637806] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-09T22:36:18.648590] [DEBUG] [LOCAL ] CCU: Loaded 22934 existing records from primary storage. [2025-10-09T22:36:18.654340] [INFO ] [MAIN ] CCU: Loaded 22934 primary data records. [2025-10-09T22:36:18.757790] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1805 records). [2025-10-09T22:36:18.763426] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-09T22:36:18.783442] [INFO ] [MAIN ] Derivative Progress: 343/1690 symbols completed. CCRD took 1.0s. Estimated remaining: 8m 47s. Rate: 153.3 symbols/min [2025-10-09T22:36:18.909305] [DEBUG] [MAIN ] CCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:18.919468] [INFO ] [MAIN ] CCS: Generated 1807 derivative records from 30479 primary records. [2025-10-09T22:36:18.931362] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-09T22:36:19.042107] [DEBUG] [LOCAL ] CCS: Derivative data saved (1807 records). [2025-10-09T22:36:19.042452] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-09T22:36:19.045257] [INFO ] [MAIN ] Derivative Progress: 344/1690 symbols completed. CCS took 1.2s. Estimated remaining: 8m 46s. Rate: 153.5 symbols/min [2025-10-09T22:36:19.068804] [DEBUG] [MAIN ] CCU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:19.069711] [INFO ] [MAIN ] CCU: Generated 1807 derivative records from 22934 primary records. [2025-10-09T22:36:19.069779] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-09T22:36:19.087156] [DEBUG] [LOCAL ] CCU: Derivative data saved (1807 records). [2025-10-09T22:36:19.087294] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-09T22:36:19.090612] [INFO ] [MAIN ] Derivative Progress: 345/1690 symbols completed. CCU took 0.7s. Estimated remaining: 8m 45s. Rate: 153.9 symbols/min [2025-10-09T22:36:19.091716] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:19.091614] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:19.091494] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:19.106765] [DEBUG] [LOCAL ] CDLR: Loaded 9990 existing records from primary storage. [2025-10-09T22:36:19.106944] [INFO ] [MAIN ] CDLR: Loaded 9990 primary data records. [2025-10-09T22:36:19.503284] [DEBUG] [LOCAL ] CDE: Loaded 54032 existing records from primary storage. [2025-10-09T22:36:19.505153] [INFO ] [MAIN ] CDE: Loaded 54032 primary data records. [2025-10-09T22:36:19.504986] [DEBUG] [LOCAL ] CDP: Loaded 42803 existing records from primary storage. [2025-10-09T22:36:19.505438] [INFO ] [MAIN ] CDP: Loaded 42803 primary data records. [2025-10-09T22:36:20.216123] [DEBUG] [MAIN ] CDLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:20.219684] [INFO ] [MAIN ] CDLR: Generated 1807 derivative records from 9990 primary records. [2025-10-09T22:36:20.219885] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-09T22:36:20.239808] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1807 records). [2025-10-09T22:36:20.240358] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-09T22:36:20.243150] [INFO ] [MAIN ] Derivative Progress: 346/1690 symbols completed. CDLR took 1.2s. Estimated remaining: 8m 47s. Rate: 153.0 symbols/min [2025-10-09T22:36:20.243684] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:20.273110] [DEBUG] [MAIN ] CDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:20.274973] [INFO ] [MAIN ] CDE: Generated 1807 derivative records from 54032 primary records. [2025-10-09T22:36:20.281319] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-09T22:36:20.331142] [DEBUG] [LOCAL ] CDRE: Loaded 24827 existing records from primary storage. [2025-10-09T22:36:20.332821] [INFO ] [MAIN ] CDRE: Loaded 24827 primary data records. [2025-10-09T22:36:20.333283] [DEBUG] [MAIN ] CDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:20.334547] [INFO ] [MAIN ] CDP: Generated 1807 derivative records from 42803 primary records. [2025-10-09T22:36:20.340265] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-09T22:36:20.406622] [DEBUG] [LOCAL ] CDE: Derivative data saved (1807 records). [2025-10-09T22:36:20.412029] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-09T22:36:20.432768] [INFO ] [MAIN ] Derivative Progress: 347/1690 symbols completed. CDE took 1.3s. Estimated remaining: 8m 46s. Rate: 153.2 symbols/min [2025-10-09T22:36:20.446170] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:20.715274] [DEBUG] [LOCAL ] CDP: Derivative data saved (1807 records). [2025-10-09T22:36:20.715906] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-09T22:36:20.721011] [INFO ] [MAIN ] Derivative Progress: 348/1690 symbols completed. CDP took 1.6s. Estimated remaining: 8m 45s. Rate: 153.3 symbols/min [2025-10-09T22:36:20.721458] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:20.758636] [DEBUG] [LOCAL ] CEE: Loaded 5657 existing records from primary storage. [2025-10-09T22:36:20.759009] [INFO ] [MAIN ] CEE: Loaded 5657 primary data records. [2025-10-09T22:36:20.889994] [DEBUG] [LOCAL ] CE: Loaded 51809 existing records from primary storage. [2025-10-09T22:36:20.897006] [INFO ] [MAIN ] CE: Loaded 51809 primary data records. [2025-10-09T22:36:21.000816] [DEBUG] [MAIN ] CDRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:21.052508] [INFO ] [MAIN ] CDRE: Generated 1807 derivative records from 24827 primary records. [2025-10-09T22:36:21.079330] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-09T22:36:21.469171] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1807 records). [2025-10-09T22:36:21.471013] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-09T22:36:21.474319] [INFO ] [MAIN ] Derivative Progress: 349/1690 symbols completed. CDRE took 1.2s. Estimated remaining: 8m 46s. Rate: 152.9 symbols/min [2025-10-09T22:36:21.475294] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:21.497783] [DEBUG] [MAIN ] CEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:21.500153] [INFO ] [MAIN ] CEE: Generated 1807 derivative records from 5657 primary records. [2025-10-09T22:36:21.509901] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-09T22:36:21.539226] [DEBUG] [LOCAL ] CEE: Derivative data saved (1807 records). [2025-10-09T22:36:21.539603] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-09T22:36:21.542371] [INFO ] [MAIN ] Derivative Progress: 350/1690 symbols completed. CEE took 0.8s. Estimated remaining: 8m 44s. Rate: 153.3 symbols/min [2025-10-09T22:36:21.543862] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:21.543550] [DEBUG] [MAIN ] CE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:21.553534] [INFO ] [MAIN ] CE: Generated 1807 derivative records from 51809 primary records. [2025-10-09T22:36:21.554206] [DEBUG] [LOCAL ] CEPU: Loaded 26302 existing records from primary storage. [2025-10-09T22:36:21.554318] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-09T22:36:21.555936] [INFO ] [MAIN ] CEPU: Loaded 26302 primary data records. [2025-10-09T22:36:21.692713] [DEBUG] [LOCAL ] CE: Derivative data saved (1807 records). [2025-10-09T22:36:21.714633] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-09T22:36:21.718438] [INFO ] [MAIN ] Derivative Progress: 351/1690 symbols completed. CE took 1.3s. Estimated remaining: 8m 43s. Rate: 153.5 symbols/min [2025-10-09T22:36:21.731757] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:21.937501] [DEBUG] [LOCAL ] CF: Loaded 52500 existing records from primary storage. [2025-10-09T22:36:21.938869] [INFO ] [MAIN ] CF: Loaded 52500 primary data records. [2025-10-09T22:36:22.298763] [DEBUG] [LOCAL ] CFG: Loaded 54013 existing records from primary storage. [2025-10-09T22:36:22.299279] [INFO ] [MAIN ] CFG: Loaded 54013 primary data records. [2025-10-09T22:36:22.500503] [DEBUG] [MAIN ] CEPU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:22.526234] [INFO ] [MAIN ] CEPU: Generated 1807 derivative records from 26302 primary records. [2025-10-09T22:36:22.529156] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-09T22:36:22.789931] [DEBUG] [MAIN ] CF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:22.792227] [INFO ] [MAIN ] CF: Generated 1807 derivative records from 52500 primary records. [2025-10-09T22:36:22.793122] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-09T22:36:22.792981] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1807 records). [2025-10-09T22:36:22.795845] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-09T22:36:22.799170] [INFO ] [MAIN ] Derivative Progress: 352/1690 symbols completed. CEPU took 1.3s. Estimated remaining: 8m 46s. Rate: 152.8 symbols/min [2025-10-09T22:36:22.807190] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:22.819569] [DEBUG] [LOCAL ] CF: Derivative data saved (1807 records). [2025-10-09T22:36:22.821344] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-09T22:36:22.824073] [INFO ] [MAIN ] Derivative Progress: 353/1690 symbols completed. CF took 1.3s. Estimated remaining: 8m 44s. Rate: 153.2 symbols/min [2025-10-09T22:36:22.824505] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:22.838426] [DEBUG] [MAIN ] CFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:22.839388] [INFO ] [MAIN ] CFG: Generated 1807 derivative records from 54013 primary records. [2025-10-09T22:36:22.839552] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-09T22:36:22.864765] [DEBUG] [LOCAL ] CFG: Derivative data saved (1807 records). [2025-10-09T22:36:22.864921] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-09T22:36:22.867739] [INFO ] [MAIN ] Derivative Progress: 354/1690 symbols completed. CFG took 1.1s. Estimated remaining: 8m 42s. Rate: 153.6 symbols/min [2025-10-09T22:36:22.868114] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:22.883240] [DEBUG] [LOCAL ] CGV: Loaded 1399 existing records from primary storage. [2025-10-09T22:36:22.884253] [INFO ] [MAIN ] CGV: Loaded 1399 primary data records. [2025-10-09T22:36:22.906329] [DEBUG] [LOCAL ] CFR: Loaded 33080 existing records from primary storage. [2025-10-09T22:36:22.953500] [INFO ] [MAIN ] CFR: Loaded 33080 primary data records. [2025-10-09T22:36:23.178722] [DEBUG] [LOCAL ] CGAU: Loaded 43452 existing records from primary storage. [2025-10-09T22:36:23.210362] [INFO ] [MAIN ] CGAU: Loaded 43452 primary data records. [2025-10-09T22:36:23.912306] [DEBUG] [MAIN ] CGV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:36:23.913865] [INFO ] [MAIN ] CGV: Generated 1805 derivative records from 1399 primary records. [2025-10-09T22:36:23.914298] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-09T22:36:23.941217] [DEBUG] [MAIN ] CFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:23.944847] [DEBUG] [LOCAL ] CGV: Derivative data saved (1805 records). [2025-10-09T22:36:23.946059] [INFO ] [MAIN ] CFR: Generated 1807 derivative records from 33080 primary records. [2025-10-09T22:36:23.946350] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-09T22:36:23.946174] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-09T22:36:23.950005] [INFO ] [MAIN ] Derivative Progress: 355/1690 symbols completed. CGV took 1.1s. Estimated remaining: 8m 44s. Rate: 152.8 symbols/min [2025-10-09T22:36:23.950421] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:23.986716] [DEBUG] [MAIN ] CGAU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:23.994615] [INFO ] [MAIN ] CGAU: Generated 1807 derivative records from 43452 primary records. [2025-10-09T22:36:23.995026] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-09T22:36:23.994852] [DEBUG] [LOCAL ] CFR: Derivative data saved (1807 records). [2025-10-09T22:36:23.996042] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-09T22:36:24.018123] [INFO ] [MAIN ] Derivative Progress: 356/1690 symbols completed. CFR took 1.2s. Estimated remaining: 8m 43s. Rate: 153.2 symbols/min [2025-10-09T22:36:24.026514] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:24.030854] [DEBUG] [LOCAL ] CHCT: Loaded 24068 existing records from primary storage. [2025-10-09T22:36:24.031464] [INFO ] [MAIN ] CHCT: Loaded 24068 primary data records. [2025-10-09T22:36:24.097808] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1807 records). [2025-10-09T22:36:24.109321] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-09T22:36:24.112226] [INFO ] [MAIN ] Derivative Progress: 357/1690 symbols completed. CGAU took 1.3s. Estimated remaining: 8m 41s. Rate: 153.5 symbols/min [2025-10-09T22:36:24.134276] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:24.437513] [DEBUG] [LOCAL ] CHD: Loaded 52580 existing records from primary storage. [2025-10-09T22:36:24.438749] [INFO ] [MAIN ] CHD: Loaded 52580 primary data records. [2025-10-09T22:36:24.558190] [DEBUG] [LOCAL ] CHGG: Loaded 48154 existing records from primary storage. [2025-10-09T22:36:24.564488] [INFO ] [MAIN ] CHGG: Loaded 48154 primary data records. [2025-10-09T22:36:25.137621] [DEBUG] [MAIN ] CHCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:25.138758] [INFO ] [MAIN ] CHCT: Generated 1807 derivative records from 24068 primary records. [2025-10-09T22:36:25.138867] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-09T22:36:25.161578] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1807 records). [2025-10-09T22:36:25.161935] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-09T22:36:25.164836] [INFO ] [MAIN ] Derivative Progress: 358/1690 symbols completed. CHCT took 1.2s. Estimated remaining: 8m 43s. Rate: 152.8 symbols/min [2025-10-09T22:36:25.185200] [DEBUG] [MAIN ] CHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:25.186249] [INFO ] [MAIN ] CHD: Generated 1807 derivative records from 52580 primary records. [2025-10-09T22:36:25.186429] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-09T22:36:25.218072] [DEBUG] [MAIN ] CHGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:25.219383] [INFO ] [MAIN ] CHGG: Generated 1807 derivative records from 48154 primary records. [2025-10-09T22:36:25.220014] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-09T22:36:25.222012] [DEBUG] [LOCAL ] CHD: Derivative data saved (1807 records). [2025-10-09T22:36:25.229691] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-09T22:36:25.236943] [INFO ] [MAIN ] Derivative Progress: 359/1690 symbols completed. CHD took 1.2s. Estimated remaining: 8m 42s. Rate: 153.1 symbols/min [2025-10-09T22:36:25.240725] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1807 records). [2025-10-09T22:36:25.240795] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-09T22:36:25.244298] [INFO ] [MAIN ] Derivative Progress: 360/1690 symbols completed. CHGG took 1.1s. Estimated remaining: 8m 40s. Rate: 153.5 symbols/min [2025-10-09T22:36:25.244981] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:25.245305] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:25.245160] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:25.256251] [DEBUG] [LOCAL ] CHN: Loaded 4772 existing records from primary storage. [2025-10-09T22:36:25.256478] [INFO ] [MAIN ] CHN: Loaded 4772 primary data records. [2025-10-09T22:36:25.458968] [DEBUG] [LOCAL ] CHH: Loaded 32538 existing records from primary storage. [2025-10-09T22:36:25.497992] [INFO ] [MAIN ] CHH: Loaded 32538 primary data records. [2025-10-09T22:36:25.739012] [DEBUG] [LOCAL ] CHPT: Loaded 48419 existing records from primary storage. [2025-10-09T22:36:25.740680] [INFO ] [MAIN ] CHPT: Loaded 48419 primary data records. [2025-10-09T22:36:26.278195] [DEBUG] [MAIN ] CHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:26.279512] [INFO ] [MAIN ] CHN: Generated 1807 derivative records from 4772 primary records. [2025-10-09T22:36:26.280016] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-09T22:36:26.297751] [DEBUG] [LOCAL ] CHN: Derivative data saved (1807 records). [2025-10-09T22:36:26.298076] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-09T22:36:26.300726] [INFO ] [MAIN ] Derivative Progress: 361/1690 symbols completed. CHN took 1.1s. Estimated remaining: 8m 42s. Rate: 152.8 symbols/min [2025-10-09T22:36:26.301073] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:26.320397] [DEBUG] [MAIN ] CHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:26.321530] [INFO ] [MAIN ] CHH: Generated 1807 derivative records from 32538 primary records. [2025-10-09T22:36:26.321694] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-09T22:36:26.358221] [DEBUG] [MAIN ] CHPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:26.365892] [INFO ] [MAIN ] CHPT: Generated 1807 derivative records from 48419 primary records. [2025-10-09T22:36:26.369300] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-09T22:36:26.369234] [DEBUG] [LOCAL ] CHH: Derivative data saved (1807 records). [2025-10-09T22:36:26.369899] [DEBUG] [LOCAL ] CHT: Loaded 19652 existing records from primary storage. [2025-10-09T22:36:26.369502] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-09T22:36:26.371243] [INFO ] [MAIN ] CHT: Loaded 19652 primary data records. [2025-10-09T22:36:26.373408] [INFO ] [MAIN ] Derivative Progress: 362/1690 symbols completed. CHH took 1.1s. Estimated remaining: 8m 40s. Rate: 153.1 symbols/min [2025-10-09T22:36:26.381192] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:26.502209] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1807 records). [2025-10-09T22:36:26.507614] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-09T22:36:26.521901] [INFO ] [MAIN ] Derivative Progress: 363/1690 symbols completed. CHPT took 1.3s. Estimated remaining: 8m 39s. Rate: 153.4 symbols/min [2025-10-09T22:36:26.527414] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:26.774514] [DEBUG] [LOCAL ] CIA: Loaded 16925 existing records from primary storage. [2025-10-09T22:36:26.775051] [INFO ] [MAIN ] CIA: Loaded 16925 primary data records. [2025-10-09T22:36:26.917478] [DEBUG] [LOCAL ] CHWY: Loaded 54043 existing records from primary storage. [2025-10-09T22:36:26.928195] [INFO ] [MAIN ] CHWY: Loaded 54043 primary data records. [2025-10-09T22:36:27.433840] [DEBUG] [MAIN ] CHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:27.434869] [INFO ] [MAIN ] CHT: Generated 1807 derivative records from 19652 primary records. [2025-10-09T22:36:27.435012] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-09T22:36:27.456043] [DEBUG] [LOCAL ] CHT: Derivative data saved (1807 records). [2025-10-09T22:36:27.456572] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-09T22:36:27.459260] [INFO ] [MAIN ] Derivative Progress: 364/1690 symbols completed. CHT took 1.2s. Estimated remaining: 8m 41s. Rate: 152.8 symbols/min [2025-10-09T22:36:27.459489] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:27.480094] [DEBUG] [MAIN ] CIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:27.480887] [INFO ] [MAIN ] CIA: Generated 1807 derivative records from 16925 primary records. [2025-10-09T22:36:27.481162] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-09T22:36:27.521067] [DEBUG] [MAIN ] CHWY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:27.522324] [INFO ] [MAIN ] CHWY: Generated 1807 derivative records from 54043 primary records. [2025-10-09T22:36:27.522683] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-09T22:36:27.533706] [DEBUG] [LOCAL ] CIA: Derivative data saved (1807 records). [2025-10-09T22:36:27.534052] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-09T22:36:27.545127] [INFO ] [MAIN ] Derivative Progress: 365/1690 symbols completed. CIA took 1.0s. Estimated remaining: 8m 39s. Rate: 153.1 symbols/min [2025-10-09T22:36:27.549996] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:27.551777] [DEBUG] [LOCAL ] CIB: Loaded 30800 existing records from primary storage. [2025-10-09T22:36:27.554323] [INFO ] [MAIN ] CIB: Loaded 30800 primary data records. [2025-10-09T22:36:27.636521] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1807 records). [2025-10-09T22:36:27.636428] [DEBUG] [LOCAL ] CIF: Loaded 4108 existing records from primary storage. [2025-10-09T22:36:27.647059] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-09T22:36:27.641850] [INFO ] [MAIN ] CIF: Loaded 4108 primary data records. [2025-10-09T22:36:27.655939] [INFO ] [MAIN ] Derivative Progress: 366/1690 symbols completed. CHWY took 1.3s. Estimated remaining: 8m 38s. Rate: 153.4 symbols/min [2025-10-09T22:36:27.735172] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:28.210259] [DEBUG] [LOCAL ] CIG: Loaded 44200 existing records from primary storage. [2025-10-09T22:36:28.211247] [INFO ] [MAIN ] CIG: Loaded 44200 primary data records. [2025-10-09T22:36:28.333944] [DEBUG] [MAIN ] CIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:28.348195] [INFO ] [MAIN ] CIB: Generated 1807 derivative records from 30800 primary records. [2025-10-09T22:36:28.353765] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-09T22:36:28.435087] [DEBUG] [MAIN ] CIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:28.463029] [INFO ] [MAIN ] CIF: Generated 1807 derivative records from 4108 primary records. [2025-10-09T22:36:28.463459] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-09T22:36:28.588917] [DEBUG] [LOCAL ] CIB: Derivative data saved (1807 records). [2025-10-09T22:36:28.589439] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-09T22:36:28.591731] [INFO ] [MAIN ] Derivative Progress: 367/1690 symbols completed. CIB took 1.1s. Estimated remaining: 8m 39s. Rate: 152.9 symbols/min [2025-10-09T22:36:28.601958] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:28.607193] [DEBUG] [LOCAL ] CIF: Derivative data saved (1807 records). [2025-10-09T22:36:28.607992] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-09T22:36:28.610790] [INFO ] [MAIN ] Derivative Progress: 368/1690 symbols completed. CIF took 1.1s. Estimated remaining: 8m 38s. Rate: 153.3 symbols/min [2025-10-09T22:36:28.611380] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:28.627711] [DEBUG] [LOCAL ] CII: Loaded 15402 existing records from primary storage. [2025-10-09T22:36:28.627851] [INFO ] [MAIN ] CII: Loaded 15402 primary data records. [2025-10-09T22:36:28.768122] [DEBUG] [MAIN ] CIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:28.901826] [INFO ] [MAIN ] CIG: Generated 1807 derivative records from 44200 primary records. [2025-10-09T22:36:29.006565] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-09T22:36:29.008824] [DEBUG] [LOCAL ] CIM: Loaded 37987 existing records from primary storage. [2025-10-09T22:36:29.016702] [INFO ] [MAIN ] CIM: Loaded 37987 primary data records. [2025-10-09T22:36:29.124073] [DEBUG] [LOCAL ] CIG: Derivative data saved (1807 records). [2025-10-09T22:36:29.135480] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-09T22:36:29.156557] [INFO ] [MAIN ] Derivative Progress: 369/1690 symbols completed. CIG took 1.4s. Estimated remaining: 8m 38s. Rate: 153.1 symbols/min [2025-10-09T22:36:29.184174] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:29.382089] [DEBUG] [MAIN ] CII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:29.390274] [DEBUG] [LOCAL ] CINT: Loaded 19687 existing records from primary storage. [2025-10-09T22:36:29.391203] [INFO ] [MAIN ] CII: Generated 1807 derivative records from 15402 primary records. [2025-10-09T22:36:29.391312] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-09T22:36:29.391791] [INFO ] [MAIN ] CINT: Loaded 19687 primary data records. [2025-10-09T22:36:29.531636] [DEBUG] [LOCAL ] CII: Derivative data saved (1807 records). [2025-10-09T22:36:29.537169] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-09T22:36:29.544950] [INFO ] [MAIN ] Derivative Progress: 370/1690 symbols completed. CII took 0.9s. Estimated remaining: 8m 37s. Rate: 153.1 symbols/min [2025-10-09T22:36:29.550247] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:29.757556] [DEBUG] [MAIN ] CIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:29.758601] [INFO ] [MAIN ] CIM: Generated 1807 derivative records from 37987 primary records. [2025-10-09T22:36:29.759423] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-09T22:36:29.785146] [DEBUG] [LOCAL ] CIO: Loaded 20663 existing records from primary storage. [2025-10-09T22:36:29.786241] [INFO ] [MAIN ] CIO: Loaded 20663 primary data records. [2025-10-09T22:36:29.866534] [DEBUG] [LOCAL ] CIM: Derivative data saved (1807 records). [2025-10-09T22:36:29.883372] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-09T22:36:29.886028] [INFO ] [MAIN ] Derivative Progress: 371/1690 symbols completed. CIM took 1.3s. Estimated remaining: 8m 37s. Rate: 153.2 symbols/min [2025-10-09T22:36:29.907741] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:30.121365] [DEBUG] [MAIN ] CINT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:30.123673] [INFO ] [MAIN ] CINT: Generated 1807 derivative records from 19687 primary records. [2025-10-09T22:36:30.124385] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-09T22:36:30.140908] [DEBUG] [LOCAL ] CINT: Derivative data saved (1807 records). [2025-10-09T22:36:30.141481] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-09T22:36:30.144386] [INFO ] [MAIN ] Derivative Progress: 372/1690 symbols completed. CINT took 1.0s. Estimated remaining: 8m 36s. Rate: 153.3 symbols/min [2025-10-09T22:36:30.144683] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:30.179331] [DEBUG] [MAIN ] CIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:30.180347] [INFO ] [MAIN ] CIO: Generated 1807 derivative records from 20663 primary records. [2025-10-09T22:36:30.194847] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-09T22:36:30.196858] [DEBUG] [LOCAL ] CIVI: Loaded 53005 existing records from primary storage. [2025-10-09T22:36:30.197313] [INFO ] [MAIN ] CIVI: Loaded 53005 primary data records. [2025-10-09T22:36:30.316630] [DEBUG] [LOCAL ] CIO: Derivative data saved (1807 records). [2025-10-09T22:36:30.327906] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-09T22:36:30.360457] [INFO ] [MAIN ] Derivative Progress: 373/1690 symbols completed. CIO took 0.8s. Estimated remaining: 8m 35s. Rate: 153.5 symbols/min [2025-10-09T22:36:30.542960] [DEBUG] [LOCAL ] CL: Loaded 54038 existing records from primary storage. [2025-10-09T22:36:30.543200] [INFO ] [MAIN ] CL: Loaded 54038 primary data records. [2025-10-09T22:36:30.916731] [DEBUG] [MAIN ] CIVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:30.917548] [INFO ] [MAIN ] CIVI: Generated 1807 derivative records from 53005 primary records. [2025-10-09T22:36:30.918115] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-09T22:36:30.936153] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1807 records). [2025-10-09T22:36:30.936335] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-09T22:36:30.940431] [INFO ] [MAIN ] Derivative Progress: 374/1690 symbols completed. CIVI took 1.0s. Estimated remaining: 8m 35s. Rate: 153.3 symbols/min [2025-10-09T22:36:30.956185] [DEBUG] [MAIN ] CL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:30.956840] [INFO ] [MAIN ] CL: Generated 1807 derivative records from 54038 primary records. [2025-10-09T22:36:30.956902] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-09T22:36:30.972705] [DEBUG] [LOCAL ] CL: Derivative data saved (1807 records). [2025-10-09T22:36:30.972776] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-09T22:36:30.975065] [INFO ] [MAIN ] Derivative Progress: 375/1690 symbols completed. CL took 0.8s. Estimated remaining: 8m 33s. Rate: 153.7 symbols/min [2025-10-09T22:36:30.975544] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:30.975614] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:30.975477] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:30.993044] [DEBUG] [LOCAL ] CLCO: Loaded 12916 existing records from primary storage. [2025-10-09T22:36:30.993363] [INFO ] [MAIN ] CLCO: Loaded 12916 primary data records. [2025-10-09T22:36:31.122111] [DEBUG] [LOCAL ] CLDT: Loaded 25582 existing records from primary storage. [2025-10-09T22:36:31.128183] [INFO ] [MAIN ] CLDT: Loaded 25582 primary data records. [2025-10-09T22:36:31.379901] [DEBUG] [LOCAL ] CLB: Loaded 33260 existing records from primary storage. [2025-10-09T22:36:31.414824] [INFO ] [MAIN ] CLB: Loaded 33260 primary data records. [2025-10-09T22:36:31.996570] [DEBUG] [MAIN ] CLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:31.998320] [INFO ] [MAIN ] CLCO: Generated 1807 derivative records from 12916 primary records. [2025-10-09T22:36:31.998619] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-09T22:36:32.021246] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1807 records). [2025-10-09T22:36:32.021571] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-09T22:36:32.024171] [INFO ] [MAIN ] Derivative Progress: 376/1690 symbols completed. CLCO took 1.0s. Estimated remaining: 8m 35s. Rate: 153.0 symbols/min [2025-10-09T22:36:32.037392] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:32.037844] [DEBUG] [MAIN ] CLDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:32.040389] [INFO ] [MAIN ] CLDT: Generated 1807 derivative records from 25582 primary records. [2025-10-09T22:36:32.041425] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-09T22:36:32.070319] [DEBUG] [MAIN ] CLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:32.072366] [INFO ] [MAIN ] CLB: Generated 1807 derivative records from 33260 primary records. [2025-10-09T22:36:32.073639] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1807 records). [2025-10-09T22:36:32.073834] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-09T22:36:32.074033] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-09T22:36:32.076922] [INFO ] [MAIN ] Derivative Progress: 377/1690 symbols completed. CLDT took 1.1s. Estimated remaining: 8m 34s. Rate: 153.3 symbols/min [2025-10-09T22:36:32.077410] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:32.097568] [DEBUG] [LOCAL ] CLB: Derivative data saved (1807 records). [2025-10-09T22:36:32.097949] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-09T22:36:32.101066] [INFO ] [MAIN ] Derivative Progress: 378/1690 symbols completed. CLB took 1.1s. Estimated remaining: 8m 32s. Rate: 153.7 symbols/min [2025-10-09T22:36:32.101368] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:32.133311] [DEBUG] [LOCAL ] CLPR: Loaded 10621 existing records from primary storage. [2025-10-09T22:36:32.133445] [INFO ] [MAIN ] CLPR: Loaded 10621 primary data records. [2025-10-09T22:36:32.267029] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-09T22:36:32.267573] [INFO ] [MAIN ] CLF: Loaded 54131 primary data records. [2025-10-09T22:36:32.295184] [DEBUG] [LOCAL ] CLH: Loaded 27839 existing records from primary storage. [2025-10-09T22:36:32.330154] [INFO ] [MAIN ] CLH: Loaded 27839 primary data records. [2025-10-09T22:36:33.182317] [DEBUG] [MAIN ] CLPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:33.183544] [INFO ] [MAIN ] CLPR: Generated 1807 derivative records from 10621 primary records. [2025-10-09T22:36:33.184088] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-09T22:36:33.207020] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1807 records). [2025-10-09T22:36:33.207244] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-09T22:36:33.209620] [INFO ] [MAIN ] Derivative Progress: 379/1690 symbols completed. CLPR took 1.1s. Estimated remaining: 8m 34s. Rate: 153.0 symbols/min [2025-10-09T22:36:33.210426] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:33.229602] [DEBUG] [MAIN ] CLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:33.243365] [INFO ] [MAIN ] CLF: Generated 1807 derivative records from 54131 primary records. [2025-10-09T22:36:33.243805] [DEBUG] [MAIN ] CLH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:33.243983] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-09T22:36:33.245820] [INFO ] [MAIN ] CLH: Generated 1807 derivative records from 27839 primary records. [2025-10-09T22:36:33.254503] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-09T22:36:33.262432] [DEBUG] [LOCAL ] CLF: Derivative data saved (1807 records). [2025-10-09T22:36:33.262813] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-09T22:36:33.265628] [INFO ] [MAIN ] Derivative Progress: 380/1690 symbols completed. CLF took 1.2s. Estimated remaining: 8m 33s. Rate: 153.3 symbols/min [2025-10-09T22:36:33.274901] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:33.284991] [DEBUG] [LOCAL ] CLH: Derivative data saved (1807 records). [2025-10-09T22:36:33.285153] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-09T22:36:33.288160] [INFO ] [MAIN ] Derivative Progress: 381/1690 symbols completed. CLH took 1.2s. Estimated remaining: 8m 31s. Rate: 153.7 symbols/min [2025-10-09T22:36:33.288511] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:33.340326] [DEBUG] [LOCAL ] CLS: Loaded 53980 existing records from primary storage. [2025-10-09T22:36:33.340701] [INFO ] [MAIN ] CLS: Loaded 53980 primary data records. [2025-10-09T22:36:33.338919] [DEBUG] [LOCAL ] CLW: Loaded 21847 existing records from primary storage. [2025-10-09T22:36:33.340931] [INFO ] [MAIN ] CLW: Loaded 21847 primary data records. [2025-10-09T22:36:33.649625] [DEBUG] [LOCAL ] CLVT: Loaded 52362 existing records from primary storage. [2025-10-09T22:36:33.701027] [INFO ] [MAIN ] CLVT: Loaded 52362 primary data records. [2025-10-09T22:36:34.322702] [DEBUG] [MAIN ] CLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:34.323792] [INFO ] [MAIN ] CLS: Generated 1807 derivative records from 53980 primary records. [2025-10-09T22:36:34.336420] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-09T22:36:34.346138] [DEBUG] [MAIN ] CLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:34.353127] [INFO ] [MAIN ] CLW: Generated 1807 derivative records from 21847 primary records. [2025-10-09T22:36:34.353376] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-09T22:36:34.369786] [DEBUG] [LOCAL ] CLS: Derivative data saved (1807 records). [2025-10-09T22:36:34.373198] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-09T22:36:34.374199] [DEBUG] [LOCAL ] CLW: Derivative data saved (1807 records). [2025-10-09T22:36:34.376447] [INFO ] [MAIN ] Derivative Progress: 382/1690 symbols completed. CLS took 1.2s. Estimated remaining: 8m 33s. Rate: 153.0 symbols/min [2025-10-09T22:36:34.376576] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-09T22:36:34.379711] [INFO ] [MAIN ] Derivative Progress: 383/1690 symbols completed. CLW took 1.1s. Estimated remaining: 8m 31s. Rate: 153.4 symbols/min [2025-10-09T22:36:34.379591] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:34.380341] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:34.403108] [DEBUG] [MAIN ] CLVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:34.404246] [INFO ] [MAIN ] CLVT: Generated 1807 derivative records from 52362 primary records. [2025-10-09T22:36:34.404480] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-09T22:36:34.428754] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1807 records). [2025-10-09T22:36:34.428894] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-09T22:36:34.432269] [INFO ] [MAIN ] Derivative Progress: 384/1690 symbols completed. CLVT took 1.2s. Estimated remaining: 8m 30s. Rate: 153.7 symbols/min [2025-10-09T22:36:34.432551] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:34.478876] [DEBUG] [LOCAL ] CMBT: Loaded 25145 existing records from primary storage. [2025-10-09T22:36:34.479117] [INFO ] [MAIN ] CMBT: Loaded 25145 primary data records. [2025-10-09T22:36:34.557639] [DEBUG] [LOCAL ] CLX: Loaded 51973 existing records from primary storage. [2025-10-09T22:36:34.597220] [DEBUG] [LOCAL ] CM: Loaded 49101 existing records from primary storage. [2025-10-09T22:36:34.603035] [INFO ] [MAIN ] CLX: Loaded 51973 primary data records. [2025-10-09T22:36:34.603117] [INFO ] [MAIN ] CM: Loaded 49101 primary data records. [2025-10-09T22:36:35.506566] [DEBUG] [MAIN ] CMBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:35.507740] [INFO ] [MAIN ] CMBT: Generated 1807 derivative records from 25145 primary records. [2025-10-09T22:36:35.508080] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-09T22:36:35.535537] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1807 records). [2025-10-09T22:36:35.541467] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-09T22:36:35.545002] [INFO ] [MAIN ] Derivative Progress: 385/1690 symbols completed. CMBT took 1.1s. Estimated remaining: 8m 32s. Rate: 153.0 symbols/min [2025-10-09T22:36:35.545663] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:35.546010] [DEBUG] [MAIN ] CLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:35.547274] [INFO ] [MAIN ] CLX: Generated 1807 derivative records from 51973 primary records. [2025-10-09T22:36:35.560432] [DEBUG] [MAIN ] CM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:35.560789] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-09T22:36:35.561532] [INFO ] [MAIN ] CM: Generated 1807 derivative records from 49101 primary records. [2025-10-09T22:36:35.562727] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-09T22:36:35.592732] [DEBUG] [LOCAL ] CMCM: Loaded 4766 existing records from primary storage. [2025-10-09T22:36:35.593168] [DEBUG] [LOCAL ] CLX: Derivative data saved (1807 records). [2025-10-09T22:36:35.596320] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-09T22:36:35.596238] [INFO ] [MAIN ] CMCM: Loaded 4766 primary data records. [2025-10-09T22:36:35.599224] [INFO ] [MAIN ] Derivative Progress: 386/1690 symbols completed. CLX took 1.2s. Estimated remaining: 8m 30s. Rate: 153.3 symbols/min [2025-10-09T22:36:35.604883] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:35.710367] [DEBUG] [LOCAL ] CM: Derivative data saved (1807 records). [2025-10-09T22:36:35.716141] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-09T22:36:35.729704] [INFO ] [MAIN ] Derivative Progress: 387/1690 symbols completed. CM took 1.3s. Estimated remaining: 8m 29s. Rate: 153.6 symbols/min [2025-10-09T22:36:35.740202] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:35.958860] [DEBUG] [LOCAL ] CMG: Loaded 54111 existing records from primary storage. [2025-10-09T22:36:35.960360] [INFO ] [MAIN ] CMG: Loaded 54111 primary data records. [2025-10-09T22:36:36.062144] [DEBUG] [MAIN ] CMCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:36.073923] [INFO ] [MAIN ] CMCM: Generated 1807 derivative records from 4766 primary records. [2025-10-09T22:36:36.068029] [DEBUG] [LOCAL ] CMI: Loaded 41934 existing records from primary storage. [2025-10-09T22:36:36.074111] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-09T22:36:36.074198] [INFO ] [MAIN ] CMI: Loaded 41934 primary data records. [2025-10-09T22:36:36.263514] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1807 records). [2025-10-09T22:36:36.465255] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-09T22:36:36.499812] [INFO ] [MAIN ] Derivative Progress: 388/1690 symbols completed. CMCM took 1.0s. Estimated remaining: 8m 30s. Rate: 153.2 symbols/min [2025-10-09T22:36:36.645194] [DEBUG] [MAIN ] CMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:36.646021] [INFO ] [MAIN ] CMG: Generated 1807 derivative records from 54111 primary records. [2025-10-09T22:36:36.646168] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-09T22:36:36.664846] [DEBUG] [LOCAL ] CMG: Derivative data saved (1807 records). [2025-10-09T22:36:36.665032] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-09T22:36:36.667173] [INFO ] [MAIN ] Derivative Progress: 389/1690 symbols completed. CMG took 1.1s. Estimated remaining: 8m 29s. Rate: 153.4 symbols/min [2025-10-09T22:36:36.680203] [DEBUG] [MAIN ] CMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:36.680799] [INFO ] [MAIN ] CMI: Generated 1807 derivative records from 41934 primary records. [2025-10-09T22:36:36.680861] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-09T22:36:36.696493] [DEBUG] [LOCAL ] CMI: Derivative data saved (1807 records). [2025-10-09T22:36:36.696556] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-09T22:36:36.698620] [INFO ] [MAIN ] Derivative Progress: 390/1690 symbols completed. CMI took 1.0s. Estimated remaining: 8m 27s. Rate: 153.8 symbols/min [2025-10-09T22:36:36.699057] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:36.699156] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:36.699437] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:36.773747] [DEBUG] [LOCAL ] CMRE: Loaded 35870 existing records from primary storage. [2025-10-09T22:36:36.774388] [DEBUG] [LOCAL ] CMP: Loaded 36351 existing records from primary storage. [2025-10-09T22:36:36.774496] [INFO ] [MAIN ] CMRE: Loaded 35870 primary data records. [2025-10-09T22:36:36.774808] [INFO ] [MAIN ] CMP: Loaded 36351 primary data records. [2025-10-09T22:36:36.813007] [DEBUG] [LOCAL ] CMPO: Loaded 39261 existing records from primary storage. [2025-10-09T22:36:36.813151] [INFO ] [MAIN ] CMPO: Loaded 39261 primary data records. [2025-10-09T22:36:37.744891] [DEBUG] [MAIN ] CMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:37.745970] [INFO ] [MAIN ] CMRE: Generated 1807 derivative records from 35870 primary records. [2025-10-09T22:36:37.746430] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-09T22:36:37.767023] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1807 records). [2025-10-09T22:36:37.767256] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-09T22:36:37.769840] [INFO ] [MAIN ] Derivative Progress: 391/1690 symbols completed. CMRE took 1.1s. Estimated remaining: 8m 29s. Rate: 153.1 symbols/min [2025-10-09T22:36:37.770020] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:37.785205] [DEBUG] [MAIN ] CMPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:37.786131] [INFO ] [MAIN ] CMPO: Generated 1807 derivative records from 39261 primary records. [2025-10-09T22:36:37.786307] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-09T22:36:37.800588] [DEBUG] [MAIN ] CMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:37.809947] [INFO ] [MAIN ] CMP: Generated 1807 derivative records from 36351 primary records. [2025-10-09T22:36:37.814086] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-09T22:36:37.819195] [DEBUG] [LOCAL ] CMSC: Loaded 5017 existing records from primary storage. [2025-10-09T22:36:37.819803] [INFO ] [MAIN ] CMSC: Loaded 5017 primary data records. [2025-10-09T22:36:37.908425] [DEBUG] [LOCAL ] CMP: Derivative data saved (1807 records). [2025-10-09T22:36:37.914055] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-09T22:36:37.929635] [INFO ] [MAIN ] Derivative Progress: 392/1690 symbols completed. CMP took 1.2s. Estimated remaining: 8m 28s. Rate: 153.3 symbols/min [2025-10-09T22:36:37.930587] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:37.943915] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1807 records). [2025-10-09T22:36:37.954590] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-09T22:36:37.957623] [INFO ] [MAIN ] Derivative Progress: 393/1690 symbols completed. CMPO took 1.3s. Estimated remaining: 8m 26s. Rate: 153.7 symbols/min [2025-10-09T22:36:37.958282] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:38.165026] [DEBUG] [LOCAL ] CMSD: Loaded 8044 existing records from primary storage. [2025-10-09T22:36:38.165354] [INFO ] [MAIN ] CMSD: Loaded 8044 primary data records. [2025-10-09T22:36:38.499717] [DEBUG] [LOCAL ] CMTG: Loaded 36441 existing records from primary storage. [2025-10-09T22:36:38.513728] [INFO ] [MAIN ] CMTG: Loaded 36441 primary data records. [2025-10-09T22:36:38.891272] [DEBUG] [MAIN ] CMSC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:38.892297] [INFO ] [MAIN ] CMSC: Generated 1807 derivative records from 5017 primary records. [2025-10-09T22:36:38.892569] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-09T22:36:38.917971] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1807 records). [2025-10-09T22:36:38.918280] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-09T22:36:38.920916] [INFO ] [MAIN ] Derivative Progress: 394/1690 symbols completed. CMSC took 1.2s. Estimated remaining: 8m 28s. Rate: 153.1 symbols/min [2025-10-09T22:36:38.929261] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:38.935092] [DEBUG] [MAIN ] CMSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:38.937247] [INFO ] [MAIN ] CMSD: Generated 1807 derivative records from 8044 primary records. [2025-10-09T22:36:38.937365] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-09T22:36:38.956538] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1807 records). [2025-10-09T22:36:38.957014] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-09T22:36:38.959604] [INFO ] [MAIN ] Derivative Progress: 395/1690 symbols completed. CMSD took 1.0s. Estimated remaining: 8m 26s. Rate: 153.5 symbols/min [2025-10-09T22:36:38.959963] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:38.964478] [DEBUG] [LOCAL ] CMU: Loaded 6361 existing records from primary storage. [2025-10-09T22:36:38.965245] [INFO ] [MAIN ] CMU: Loaded 6361 primary data records. [2025-10-09T22:36:39.123472] [DEBUG] [MAIN ] CMTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:39.141557] [INFO ] [MAIN ] CMTG: Generated 1807 derivative records from 36441 primary records. [2025-10-09T22:36:39.147671] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-09T22:36:39.210441] [DEBUG] [LOCAL ] CNA: Loaded 33082 existing records from primary storage. [2025-10-09T22:36:39.241563] [INFO ] [MAIN ] CNA: Loaded 33082 primary data records. [2025-10-09T22:36:39.460730] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1807 records). [2025-10-09T22:36:39.485258] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-09T22:36:39.500280] [INFO ] [MAIN ] Derivative Progress: 396/1690 symbols completed. CMTG took 1.5s. Estimated remaining: 8m 26s. Rate: 153.3 symbols/min [2025-10-09T22:36:39.501281] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:39.739188] [DEBUG] [MAIN ] CMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:39.740475] [INFO ] [MAIN ] CMU: Generated 1807 derivative records from 6361 primary records. [2025-10-09T22:36:39.740800] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-09T22:36:39.771300] [DEBUG] [LOCAL ] CMU: Derivative data saved (1807 records). [2025-10-09T22:36:39.772180] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-09T22:36:39.774343] [INFO ] [MAIN ] Derivative Progress: 397/1690 symbols completed. CMU took 0.8s. Estimated remaining: 8m 26s. Rate: 153.5 symbols/min [2025-10-09T22:36:39.774744] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:39.793980] [DEBUG] [LOCAL ] CNC: Loaded 54145 existing records from primary storage. [2025-10-09T22:36:39.801917] [INFO ] [MAIN ] CNC: Loaded 54145 primary data records. [2025-10-09T22:36:39.818921] [DEBUG] [MAIN ] CNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:39.882519] [INFO ] [MAIN ] CNA: Generated 1807 derivative records from 33082 primary records. [2025-10-09T22:36:39.909761] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-09T22:36:39.946566] [DEBUG] [LOCAL ] CNF: Loaded 10597 existing records from primary storage. [2025-10-09T22:36:39.946713] [INFO ] [MAIN ] CNF: Loaded 10597 primary data records. [2025-10-09T22:36:40.314230] [DEBUG] [LOCAL ] CNA: Derivative data saved (1807 records). [2025-10-09T22:36:40.346249] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-09T22:36:40.349578] [INFO ] [MAIN ] Derivative Progress: 398/1690 symbols completed. CNA took 1.4s. Estimated remaining: 8m 26s. Rate: 153.3 symbols/min [2025-10-09T22:36:40.457089] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:40.492689] [DEBUG] [MAIN ] CNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:40.493485] [INFO ] [MAIN ] CNC: Generated 1807 derivative records from 54145 primary records. [2025-10-09T22:36:40.493634] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-09T22:36:40.539132] [DEBUG] [LOCAL ] CNC: Derivative data saved (1807 records). [2025-10-09T22:36:40.542065] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-09T22:36:40.544546] [INFO ] [MAIN ] Derivative Progress: 399/1690 symbols completed. CNC took 1.0s. Estimated remaining: 8m 25s. Rate: 153.5 symbols/min [2025-10-09T22:36:40.545006] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:40.558856] [DEBUG] [MAIN ] CNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:40.559619] [INFO ] [MAIN ] CNF: Generated 1807 derivative records from 10597 primary records. [2025-10-09T22:36:40.559761] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-09T22:36:40.596186] [DEBUG] [LOCAL ] CNF: Derivative data saved (1807 records). [2025-10-09T22:36:40.596707] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-09T22:36:40.600597] [INFO ] [MAIN ] Derivative Progress: 400/1690 symbols completed. CNF took 0.8s. Estimated remaining: 8m 23s. Rate: 153.8 symbols/min [2025-10-09T22:36:40.601095] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:40.629989] [DEBUG] [LOCAL ] CNH: Loaded 53941 existing records from primary storage. [2025-10-09T22:36:40.645437] [INFO ] [MAIN ] CNH: Loaded 53941 primary data records. [2025-10-09T22:36:40.780524] [DEBUG] [LOCAL ] CNI: Loaded 52058 existing records from primary storage. [2025-10-09T22:36:40.809976] [INFO ] [MAIN ] CNI: Loaded 52058 primary data records. [2025-10-09T22:36:41.119499] [DEBUG] [LOCAL ] CNM: Loaded 51430 existing records from primary storage. [2025-10-09T22:36:41.124909] [INFO ] [MAIN ] CNM: Loaded 51430 primary data records. [2025-10-09T22:36:42.048613] [DEBUG] [MAIN ] CNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:42.049593] [INFO ] [MAIN ] CNH: Generated 1807 derivative records from 53941 primary records. [2025-10-09T22:36:42.050776] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-09T22:36:42.071516] [DEBUG] [LOCAL ] CNH: Derivative data saved (1807 records). [2025-10-09T22:36:42.072418] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-09T22:36:42.074880] [INFO ] [MAIN ] Derivative Progress: 401/1690 symbols completed. CNH took 1.6s. Estimated remaining: 8m 26s. Rate: 152.7 symbols/min [2025-10-09T22:36:42.075415] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:42.088872] [DEBUG] [MAIN ] CNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:42.089773] [INFO ] [MAIN ] CNI: Generated 1807 derivative records from 52058 primary records. [2025-10-09T22:36:42.089978] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-09T22:36:42.123171] [DEBUG] [MAIN ] CNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:42.122871] [DEBUG] [LOCAL ] CNI: Derivative data saved (1807 records). [2025-10-09T22:36:42.123987] [INFO ] [MAIN ] CNM: Generated 1807 derivative records from 51430 primary records. [2025-10-09T22:36:42.124090] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-09T22:36:42.126901] [INFO ] [MAIN ] Derivative Progress: 402/1690 symbols completed. CNI took 1.6s. Estimated remaining: 8m 25s. Rate: 153.1 symbols/min [2025-10-09T22:36:42.124178] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-09T22:36:42.127138] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:42.153236] [DEBUG] [LOCAL ] CNM: Derivative data saved (1807 records). [2025-10-09T22:36:42.153468] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-09T22:36:42.157920] [INFO ] [MAIN ] Derivative Progress: 403/1690 symbols completed. CNM took 1.6s. Estimated remaining: 8m 23s. Rate: 153.4 symbols/min [2025-10-09T22:36:42.173708] [DEBUG] [LOCAL ] CNMD: Loaded 32304 existing records from primary storage. [2025-10-09T22:36:42.174035] [INFO ] [MAIN ] CNMD: Loaded 32304 primary data records. [2025-10-09T22:36:42.387099] [DEBUG] [LOCAL ] CNNE: Loaded 36507 existing records from primary storage. [2025-10-09T22:36:42.502714] [INFO ] [MAIN ] CNNE: Loaded 36507 primary data records. [2025-10-09T22:36:42.840424] [DEBUG] [MAIN ] CNMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:42.841839] [INFO ] [MAIN ] CNMD: Generated 1807 derivative records from 32304 primary records. [2025-10-09T22:36:42.842111] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-09T22:36:42.860149] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1807 records). [2025-10-09T22:36:42.860551] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-09T22:36:42.863222] [INFO ] [MAIN ] Derivative Progress: 404/1690 symbols completed. CNMD took 0.8s. Estimated remaining: 8m 24s. Rate: 153.1 symbols/min [2025-10-09T22:36:42.881425] [DEBUG] [MAIN ] CNNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:42.882179] [INFO ] [MAIN ] CNNE: Generated 1807 derivative records from 36507 primary records. [2025-10-09T22:36:42.882245] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-09T22:36:42.899887] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1807 records). [2025-10-09T22:36:42.899964] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-09T22:36:42.904144] [INFO ] [MAIN ] Derivative Progress: 405/1690 symbols completed. CNNE took 0.8s. Estimated remaining: 8m 22s. Rate: 153.5 symbols/min [2025-10-09T22:36:42.904765] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:42.904634] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:42.905362] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:42.961440] [DEBUG] [LOCAL ] CNO: Loaded 41137 existing records from primary storage. [2025-10-09T22:36:42.961621] [INFO ] [MAIN ] CNO: Loaded 41137 primary data records. [2025-10-09T22:36:43.113683] [DEBUG] [LOCAL ] CNP: Loaded 53863 existing records from primary storage. [2025-10-09T22:36:43.120370] [INFO ] [MAIN ] CNP: Loaded 53863 primary data records. [2025-10-09T22:36:43.137148] [DEBUG] [LOCAL ] CNQ: Loaded 53967 existing records from primary storage. [2025-10-09T22:36:43.164183] [INFO ] [MAIN ] CNQ: Loaded 53967 primary data records. [2025-10-09T22:36:44.005073] [DEBUG] [MAIN ] CNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:44.006059] [INFO ] [MAIN ] CNO: Generated 1807 derivative records from 41137 primary records. [2025-10-09T22:36:44.007530] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-09T22:36:44.026023] [DEBUG] [LOCAL ] CNO: Derivative data saved (1807 records). [2025-10-09T22:36:44.027942] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-09T22:36:44.030854] [INFO ] [MAIN ] Derivative Progress: 406/1690 symbols completed. CNO took 1.1s. Estimated remaining: 8m 24s. Rate: 152.7 symbols/min [2025-10-09T22:36:44.031509] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:44.045101] [DEBUG] [MAIN ] CNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:44.045826] [INFO ] [MAIN ] CNP: Generated 1807 derivative records from 53863 primary records. [2025-10-09T22:36:44.046011] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-09T22:36:44.082803] [DEBUG] [MAIN ] CNQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:44.084165] [INFO ] [MAIN ] CNQ: Generated 1807 derivative records from 53967 primary records. [2025-10-09T22:36:44.084329] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-09T22:36:44.109421] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1807 records). [2025-10-09T22:36:44.108678] [DEBUG] [LOCAL ] CNS: Loaded 20993 existing records from primary storage. [2025-10-09T22:36:44.109549] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-09T22:36:44.113688] [INFO ] [MAIN ] Derivative Progress: 407/1690 symbols completed. CNQ took 1.2s. Estimated remaining: 8m 23s. Rate: 153.0 symbols/min [2025-10-09T22:36:44.113850] [INFO ] [MAIN ] CNS: Loaded 20993 primary data records. [2025-10-09T22:36:44.114242] [DEBUG] [LOCAL ] CNP: Derivative data saved (1807 records). [2025-10-09T22:36:44.114584] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-09T22:36:44.150120] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:44.168338] [INFO ] [MAIN ] Derivative Progress: 408/1690 symbols completed. CNP took 1.2s. Estimated remaining: 8m 22s. Rate: 153.4 symbols/min [2025-10-09T22:36:44.178740] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:44.491470] [DEBUG] [LOCAL ] CODI: Loaded 40992 existing records from primary storage. [2025-10-09T22:36:44.489675] [DEBUG] [LOCAL ] CNX: Loaded 51694 existing records from primary storage. [2025-10-09T22:36:44.492152] [INFO ] [MAIN ] CNX: Loaded 51694 primary data records. [2025-10-09T22:36:44.492073] [INFO ] [MAIN ] CODI: Loaded 40992 primary data records. [2025-10-09T22:36:45.112478] [DEBUG] [MAIN ] CNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:45.113442] [INFO ] [MAIN ] CNS: Generated 1807 derivative records from 20993 primary records. [2025-10-09T22:36:45.114207] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-09T22:36:45.133819] [DEBUG] [LOCAL ] CNS: Derivative data saved (1807 records). [2025-10-09T22:36:45.134124] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-09T22:36:45.136489] [INFO ] [MAIN ] Derivative Progress: 409/1690 symbols completed. CNS took 1.1s. Estimated remaining: 8m 23s. Rate: 152.8 symbols/min [2025-10-09T22:36:45.136977] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:45.165728] [DEBUG] [MAIN ] CODI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:45.166775] [INFO ] [MAIN ] CODI: Generated 1807 derivative records from 40992 primary records. [2025-10-09T22:36:45.166907] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-09T22:36:45.182314] [DEBUG] [MAIN ] CNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:45.194114] [INFO ] [MAIN ] CNX: Generated 1807 derivative records from 51694 primary records. [2025-10-09T22:36:45.194460] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-09T22:36:45.212277] [DEBUG] [LOCAL ] CNX: Derivative data saved (1807 records). [2025-10-09T22:36:45.212484] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-09T22:36:45.215635] [INFO ] [MAIN ] Derivative Progress: 410/1690 symbols completed. CNX took 1.1s. Estimated remaining: 8m 22s. Rate: 153.1 symbols/min [2025-10-09T22:36:45.216144] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:45.218883] [DEBUG] [LOCAL ] CODI: Derivative data saved (1807 records). [2025-10-09T22:36:45.232960] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-09T22:36:45.236553] [INFO ] [MAIN ] Derivative Progress: 411/1690 symbols completed. CODI took 1.1s. Estimated remaining: 8m 20s. Rate: 153.5 symbols/min [2025-10-09T22:36:45.236765] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:45.259431] [DEBUG] [LOCAL ] COF: Loaded 54002 existing records from primary storage. [2025-10-09T22:36:45.259786] [INFO ] [MAIN ] COF: Loaded 54002 primary data records. [2025-10-09T22:36:45.474807] [DEBUG] [LOCAL ] COHR: Loaded 53761 existing records from primary storage. [2025-10-09T22:36:45.599829] [INFO ] [MAIN ] COHR: Loaded 53761 primary data records. [2025-10-09T22:36:45.762548] [DEBUG] [LOCAL ] COLD: Loaded 52638 existing records from primary storage. [2025-10-09T22:36:45.766245] [INFO ] [MAIN ] COLD: Loaded 52638 primary data records. [2025-10-09T22:36:46.289479] [DEBUG] [MAIN ] COF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:46.291378] [INFO ] [MAIN ] COF: Generated 1807 derivative records from 54002 primary records. [2025-10-09T22:36:46.291960] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-09T22:36:46.315094] [DEBUG] [LOCAL ] COF: Derivative data saved (1807 records). [2025-10-09T22:36:46.315391] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-09T22:36:46.330720] [INFO ] [MAIN ] Derivative Progress: 412/1690 symbols completed. COF took 1.2s. Estimated remaining: 8m 22s. Rate: 152.8 symbols/min [2025-10-09T22:36:46.331428] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:46.331059] [DEBUG] [MAIN ] COHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:46.332711] [INFO ] [MAIN ] COHR: Generated 1807 derivative records from 53761 primary records. [2025-10-09T22:36:46.332805] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-09T22:36:46.363769] [DEBUG] [LOCAL ] COHR: Derivative data saved (1807 records). [2025-10-09T22:36:46.364076] [DEBUG] [MAIN ] COLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:46.364188] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-09T22:36:46.367511] [INFO ] [MAIN ] Derivative Progress: 413/1690 symbols completed. COHR took 1.2s. Estimated remaining: 8m 20s. Rate: 153.1 symbols/min [2025-10-09T22:36:46.364870] [INFO ] [MAIN ] COLD: Generated 1807 derivative records from 52638 primary records. [2025-10-09T22:36:46.367829] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-09T22:36:46.367721] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:46.384863] [DEBUG] [LOCAL ] COLD: Derivative data saved (1807 records). [2025-10-09T22:36:46.385146] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-09T22:36:46.389391] [INFO ] [MAIN ] Derivative Progress: 414/1690 symbols completed. COLD took 1.2s. Estimated remaining: 8m 19s. Rate: 153.5 symbols/min [2025-10-09T22:36:46.389576] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:46.440252] [DEBUG] [LOCAL ] COMP: Loaded 53792 existing records from primary storage. [2025-10-09T22:36:46.440527] [INFO ] [MAIN ] COMP: Loaded 53792 primary data records. [2025-10-09T22:36:46.530271] [DEBUG] [LOCAL ] COOK: Loaded 24658 existing records from primary storage. [2025-10-09T22:36:46.535787] [INFO ] [MAIN ] COOK: Loaded 24658 primary data records. [2025-10-09T22:36:46.576013] [DEBUG] [LOCAL ] CON: Loaded 39099 existing records from primary storage. [2025-10-09T22:36:46.598826] [INFO ] [MAIN ] CON: Loaded 39099 primary data records. [2025-10-09T22:36:47.461634] [DEBUG] [MAIN ] COMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:47.462921] [INFO ] [MAIN ] COMP: Generated 1807 derivative records from 53792 primary records. [2025-10-09T22:36:47.463036] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-09T22:36:47.498037] [DEBUG] [LOCAL ] COMP: Derivative data saved (1807 records). [2025-10-09T22:36:47.494895] [DEBUG] [MAIN ] CON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:47.501053] [INFO ] [MAIN ] CON: Generated 1807 derivative records from 39099 primary records. [2025-10-09T22:36:47.499375] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-09T22:36:47.501164] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-09T22:36:47.503861] [INFO ] [MAIN ] Derivative Progress: 415/1690 symbols completed. COMP took 1.2s. Estimated remaining: 8m 21s. Rate: 152.8 symbols/min [2025-10-09T22:36:47.504939] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:47.533049] [DEBUG] [MAIN ] COOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:47.536023] [DEBUG] [LOCAL ] CON: Derivative data saved (1807 records). [2025-10-09T22:36:47.536317] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-09T22:36:47.537238] [INFO ] [MAIN ] COOK: Generated 1807 derivative records from 24658 primary records. [2025-10-09T22:36:47.540049] [INFO ] [MAIN ] Derivative Progress: 416/1690 symbols completed. CON took 1.2s. Estimated remaining: 8m 19s. Rate: 153.1 symbols/min [2025-10-09T22:36:47.540288] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:47.540398] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-09T22:36:47.559775] [DEBUG] [LOCAL ] COOK: Derivative data saved (1807 records). [2025-10-09T22:36:47.560012] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-09T22:36:47.563819] [INFO ] [MAIN ] Derivative Progress: 417/1690 symbols completed. COOK took 1.2s. Estimated remaining: 8m 18s. Rate: 153.5 symbols/min [2025-10-09T22:36:47.564083] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:47.650461] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-09T22:36:47.651408] [INFO ] [MAIN ] COP: Loaded 54117 primary data records. [2025-10-09T22:36:47.651312] [DEBUG] [LOCAL ] COR: Loaded 47111 existing records from primary storage. [2025-10-09T22:36:47.682980] [INFO ] [MAIN ] COR: Loaded 47111 primary data records. [2025-10-09T22:36:47.848175] [DEBUG] [LOCAL ] COTY: Loaded 53632 existing records from primary storage. [2025-10-09T22:36:47.874264] [INFO ] [MAIN ] COTY: Loaded 53632 primary data records. [2025-10-09T22:36:48.644396] [DEBUG] [MAIN ] COP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:48.645464] [INFO ] [MAIN ] COP: Generated 1807 derivative records from 54117 primary records. [2025-10-09T22:36:48.645707] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-09T22:36:48.670325] [DEBUG] [LOCAL ] COP: Derivative data saved (1807 records). [2025-10-09T22:36:48.684436] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-09T22:36:48.687275] [INFO ] [MAIN ] Derivative Progress: 418/1690 symbols completed. COP took 1.2s. Estimated remaining: 8m 19s. Rate: 152.8 symbols/min [2025-10-09T22:36:48.688487] [DEBUG] [MAIN ] COR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:48.701797] [INFO ] [MAIN ] COR: Generated 1807 derivative records from 47111 primary records. [2025-10-09T22:36:48.702021] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-09T22:36:48.702553] [DEBUG] [MAIN ] COTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:48.703590] [INFO ] [MAIN ] COTY: Generated 1807 derivative records from 53632 primary records. [2025-10-09T22:36:48.703724] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-09T22:36:48.736128] [DEBUG] [LOCAL ] COR: Derivative data saved (1807 records). [2025-10-09T22:36:48.737567] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-09T22:36:48.740010] [INFO ] [MAIN ] Derivative Progress: 419/1690 symbols completed. COR took 1.2s. Estimated remaining: 8m 18s. Rate: 153.1 symbols/min [2025-10-09T22:36:48.742863] [DEBUG] [LOCAL ] COTY: Derivative data saved (1807 records). [2025-10-09T22:36:48.742990] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-09T22:36:48.746505] [INFO ] [MAIN ] Derivative Progress: 420/1690 symbols completed. COTY took 1.2s. Estimated remaining: 8m 17s. Rate: 153.5 symbols/min [2025-10-09T22:36:48.747488] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:48.747405] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:48.747263] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:48.810042] [DEBUG] [LOCAL ] CPA: Loaded 28446 existing records from primary storage. [2025-10-09T22:36:48.810237] [INFO ] [MAIN ] CPA: Loaded 28446 primary data records. [2025-10-09T22:36:48.957297] [DEBUG] [LOCAL ] COUR: Loaded 49416 existing records from primary storage. [2025-10-09T22:36:48.974934] [INFO ] [MAIN ] COUR: Loaded 49416 primary data records. [2025-10-09T22:36:48.974754] [DEBUG] [LOCAL ] CP: Loaded 53653 existing records from primary storage. [2025-10-09T22:36:49.008795] [INFO ] [MAIN ] CP: Loaded 53653 primary data records. [2025-10-09T22:36:49.939756] [DEBUG] [MAIN ] CPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:49.941555] [INFO ] [MAIN ] CPA: Generated 1807 derivative records from 28446 primary records. [2025-10-09T22:36:49.942109] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-09T22:36:49.961783] [DEBUG] [LOCAL ] CPA: Derivative data saved (1807 records). [2025-10-09T22:36:49.963123] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-09T22:36:49.965437] [INFO ] [MAIN ] Derivative Progress: 421/1690 symbols completed. CPA took 1.2s. Estimated remaining: 8m 19s. Rate: 152.7 symbols/min [2025-10-09T22:36:49.967203] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:49.983322] [DEBUG] [MAIN ] CP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:49.984346] [INFO ] [MAIN ] CP: Generated 1807 derivative records from 53653 primary records. [2025-10-09T22:36:49.984621] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-09T22:36:50.002941] [DEBUG] [MAIN ] COUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:50.003868] [INFO ] [MAIN ] COUR: Generated 1807 derivative records from 49416 primary records. [2025-10-09T22:36:50.011618] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-09T22:36:50.040800] [DEBUG] [LOCAL ] COUR: Derivative data saved (1807 records). [2025-10-09T22:36:50.044233] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-09T22:36:50.044327] [DEBUG] [LOCAL ] CP: Derivative data saved (1807 records). [2025-10-09T22:36:50.054911] [INFO ] [MAIN ] Derivative Progress: 422/1690 symbols completed. COUR took 1.3s. Estimated remaining: 8m 17s. Rate: 153.0 symbols/min [2025-10-09T22:36:50.055208] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:50.055063] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-09T22:36:50.059383] [INFO ] [MAIN ] Derivative Progress: 423/1690 symbols completed. CP took 1.3s. Estimated remaining: 8m 16s. Rate: 153.3 symbols/min [2025-10-09T22:36:50.059773] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:50.073549] [DEBUG] [LOCAL ] CPAY: Loaded 30592 existing records from primary storage. [2025-10-09T22:36:50.073731] [INFO ] [MAIN ] CPAY: Loaded 30592 primary data records. [2025-10-09T22:36:50.207014] [DEBUG] [LOCAL ] CPK: Loaded 13753 existing records from primary storage. [2025-10-09T22:36:50.207261] [INFO ] [MAIN ] CPK: Loaded 13753 primary data records. [2025-10-09T22:36:50.206626] [DEBUG] [LOCAL ] CPF: Loaded 15320 existing records from primary storage. [2025-10-09T22:36:50.212599] [INFO ] [MAIN ] CPF: Loaded 15320 primary data records. [2025-10-09T22:36:51.099252] [DEBUG] [MAIN ] CPAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:51.099918] [DEBUG] [MAIN ] CPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:51.100905] [INFO ] [MAIN ] CPAY: Generated 1807 derivative records from 30592 primary records. [2025-10-09T22:36:51.101237] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-09T22:36:51.102008] [INFO ] [MAIN ] CPF: Generated 1807 derivative records from 15320 primary records. [2025-10-09T22:36:51.119234] [DEBUG] [MAIN ] CPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:51.126477] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-09T22:36:51.128980] [INFO ] [MAIN ] CPK: Generated 1807 derivative records from 13753 primary records. [2025-10-09T22:36:51.134085] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-09T22:36:51.149845] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1807 records). [2025-10-09T22:36:51.157519] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-09T22:36:51.160516] [INFO ] [MAIN ] Derivative Progress: 424/1690 symbols completed. CPAY took 1.2s. Estimated remaining: 8m 17s. Rate: 152.7 symbols/min [2025-10-09T22:36:51.162254] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:51.172311] [DEBUG] [LOCAL ] CPK: Derivative data saved (1807 records). [2025-10-09T22:36:51.172792] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-09T22:36:51.175799] [INFO ] [MAIN ] Derivative Progress: 425/1690 symbols completed. CPK took 1.1s. Estimated remaining: 8m 16s. Rate: 153.0 symbols/min [2025-10-09T22:36:51.176210] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:51.179052] [DEBUG] [LOCAL ] CPF: Derivative data saved (1807 records). [2025-10-09T22:36:51.179391] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-09T22:36:51.183588] [INFO ] [MAIN ] Derivative Progress: 426/1690 symbols completed. CPF took 1.1s. Estimated remaining: 8m 14s. Rate: 153.4 symbols/min [2025-10-09T22:36:51.184004] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:51.208043] [DEBUG] [LOCAL ] CPS: Loaded 25661 existing records from primary storage. [2025-10-09T22:36:51.208240] [INFO ] [MAIN ] CPS: Loaded 25661 primary data records. [2025-10-09T22:36:51.405099] [DEBUG] [LOCAL ] CPNG: Loaded 54060 existing records from primary storage. [2025-10-09T22:36:51.439406] [INFO ] [MAIN ] CPNG: Loaded 54060 primary data records. [2025-10-09T22:36:51.578423] [DEBUG] [LOCAL ] CPT: Loaded 44728 existing records from primary storage. [2025-10-09T22:36:51.589100] [INFO ] [MAIN ] CPT: Loaded 44728 primary data records. [2025-10-09T22:36:52.212054] [DEBUG] [MAIN ] CPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:52.213800] [INFO ] [MAIN ] CPS: Generated 1807 derivative records from 25661 primary records. [2025-10-09T22:36:52.213970] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-09T22:36:52.233433] [DEBUG] [LOCAL ] CPS: Derivative data saved (1807 records). [2025-10-09T22:36:52.233687] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-09T22:36:52.235984] [INFO ] [MAIN ] Derivative Progress: 427/1690 symbols completed. CPS took 1.1s. Estimated remaining: 8m 16s. Rate: 152.8 symbols/min [2025-10-09T22:36:52.236328] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:52.264116] [DEBUG] [MAIN ] CPNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:52.265211] [INFO ] [MAIN ] CPNG: Generated 1807 derivative records from 54060 primary records. [2025-10-09T22:36:52.277837] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-09T22:36:52.278854] [DEBUG] [MAIN ] CPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:52.280308] [INFO ] [MAIN ] CPT: Generated 1807 derivative records from 44728 primary records. [2025-10-09T22:36:52.293362] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-09T22:36:52.298025] [DEBUG] [LOCAL ] CQP: Loaded 19005 existing records from primary storage. [2025-10-09T22:36:52.299126] [INFO ] [MAIN ] CQP: Loaded 19005 primary data records. [2025-10-09T22:36:52.322100] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1807 records). [2025-10-09T22:36:52.350742] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-09T22:36:52.365091] [INFO ] [MAIN ] Derivative Progress: 428/1690 symbols completed. CPNG took 1.2s. Estimated remaining: 8m 15s. Rate: 153.0 symbols/min [2025-10-09T22:36:52.366660] [DEBUG] [LOCAL ] CPT: Derivative data saved (1807 records). [2025-10-09T22:36:52.366808] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:52.387780] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-09T22:36:52.409194] [INFO ] [MAIN ] Derivative Progress: 429/1690 symbols completed. CPT took 1.2s. Estimated remaining: 8m 13s. Rate: 153.3 symbols/min [2025-10-09T22:36:52.414811] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:52.636148] [DEBUG] [LOCAL ] CRBD: Loaded 9076 existing records from primary storage. [2025-10-09T22:36:52.636297] [INFO ] [MAIN ] CRBD: Loaded 9076 primary data records. [2025-10-09T22:36:52.725454] [DEBUG] [LOCAL ] CR: Loaded 24272 existing records from primary storage. [2025-10-09T22:36:52.731290] [INFO ] [MAIN ] CR: Loaded 24272 primary data records. [2025-10-09T22:36:53.295478] [DEBUG] [MAIN ] CQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:53.297339] [INFO ] [MAIN ] CQP: Generated 1807 derivative records from 19005 primary records. [2025-10-09T22:36:53.298008] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-09T22:36:53.315991] [DEBUG] [LOCAL ] CQP: Derivative data saved (1807 records). [2025-10-09T22:36:53.316839] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-09T22:36:53.319329] [INFO ] [MAIN ] Derivative Progress: 430/1690 symbols completed. CQP took 1.1s. Estimated remaining: 8m 15s. Rate: 152.9 symbols/min [2025-10-09T22:36:53.319688] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:53.336980] [DEBUG] [MAIN ] CRBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:53.337727] [INFO ] [MAIN ] CRBD: Generated 1807 derivative records from 9076 primary records. [2025-10-09T22:36:53.337951] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-09T22:36:53.356421] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1807 records). [2025-10-09T22:36:53.356639] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-09T22:36:53.360134] [INFO ] [MAIN ] Derivative Progress: 431/1690 symbols completed. CRBD took 0.9s. Estimated remaining: 8m 13s. Rate: 153.2 symbols/min [2025-10-09T22:36:53.373402] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:53.373957] [DEBUG] [MAIN ] CR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:53.374956] [INFO ] [MAIN ] CR: Generated 1807 derivative records from 24272 primary records. [2025-10-09T22:36:53.375074] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-09T22:36:53.393960] [DEBUG] [LOCAL ] CR: Derivative data saved (1807 records). [2025-10-09T22:36:53.407542] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-09T22:36:53.411378] [INFO ] [MAIN ] Derivative Progress: 432/1690 symbols completed. CR took 1.0s. Estimated remaining: 8m 12s. Rate: 153.5 symbols/min [2025-10-09T22:36:53.411845] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:53.433876] [DEBUG] [LOCAL ] CRBG: Loaded 52836 existing records from primary storage. [2025-10-09T22:36:53.434283] [INFO ] [MAIN ] CRBG: Loaded 52836 primary data records. [2025-10-09T22:36:53.576040] [DEBUG] [LOCAL ] CRC: Loaded 44150 existing records from primary storage. [2025-10-09T22:36:53.595923] [INFO ] [MAIN ] CRC: Loaded 44150 primary data records. [2025-10-09T22:36:53.935539] [DEBUG] [LOCAL ] CRGY: Loaded 52852 existing records from primary storage. [2025-10-09T22:36:53.945396] [INFO ] [MAIN ] CRGY: Loaded 52852 primary data records. [2025-10-09T22:36:54.514773] [DEBUG] [MAIN ] CRBG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:54.515917] [INFO ] [MAIN ] CRBG: Generated 1807 derivative records from 52836 primary records. [2025-10-09T22:36:54.516725] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-09T22:36:54.537213] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1807 records). [2025-10-09T22:36:54.537462] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-09T22:36:54.539904] [INFO ] [MAIN ] Derivative Progress: 433/1690 symbols completed. CRBG took 1.2s. Estimated remaining: 8m 13s. Rate: 152.8 symbols/min [2025-10-09T22:36:54.560369] [DEBUG] [MAIN ] CRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:54.561450] [INFO ] [MAIN ] CRC: Generated 1807 derivative records from 44150 primary records. [2025-10-09T22:36:54.561689] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-09T22:36:54.579696] [DEBUG] [LOCAL ] CRC: Derivative data saved (1807 records). [2025-10-09T22:36:54.579911] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-09T22:36:54.582931] [INFO ] [MAIN ] Derivative Progress: 434/1690 symbols completed. CRC took 1.2s. Estimated remaining: 8m 12s. Rate: 153.1 symbols/min [2025-10-09T22:36:54.598413] [DEBUG] [MAIN ] CRGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:54.599148] [INFO ] [MAIN ] CRGY: Generated 1807 derivative records from 52852 primary records. [2025-10-09T22:36:54.599213] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-09T22:36:54.615347] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1807 records). [2025-10-09T22:36:54.615407] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-09T22:36:54.621105] [INFO ] [MAIN ] Derivative Progress: 435/1690 symbols completed. CRGY took 1.2s. Estimated remaining: 8m 11s. Rate: 153.5 symbols/min [2025-10-09T22:36:54.621695] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:54.621595] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:54.621968] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:54.700779] [DEBUG] [LOCAL ] CRH: Loaded 53841 existing records from primary storage. [2025-10-09T22:36:54.700952] [INFO ] [MAIN ] CRH: Loaded 53841 primary data records. [2025-10-09T22:36:54.819354] [DEBUG] [LOCAL ] CRK: Loaded 52593 existing records from primary storage. [2025-10-09T22:36:54.837229] [INFO ] [MAIN ] CRK: Loaded 52593 primary data records. [2025-10-09T22:36:54.887185] [DEBUG] [LOCAL ] CRI: Loaded 50079 existing records from primary storage. [2025-10-09T22:36:54.945309] [INFO ] [MAIN ] CRI: Loaded 50079 primary data records. [2025-10-09T22:36:55.717505] [DEBUG] [MAIN ] CRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:55.720676] [INFO ] [MAIN ] CRH: Generated 1807 derivative records from 53841 primary records. [2025-10-09T22:36:55.721205] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-09T22:36:55.752570] [DEBUG] [MAIN ] CRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:55.754715] [DEBUG] [LOCAL ] CRH: Derivative data saved (1807 records). [2025-10-09T22:36:55.755743] [INFO ] [MAIN ] CRK: Generated 1807 derivative records from 52593 primary records. [2025-10-09T22:36:55.755899] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-09T22:36:55.756066] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-09T22:36:55.758508] [INFO ] [MAIN ] Derivative Progress: 436/1690 symbols completed. CRH took 1.1s. Estimated remaining: 8m 12s. Rate: 152.8 symbols/min [2025-10-09T22:36:55.759945] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:55.781355] [DEBUG] [LOCAL ] CRK: Derivative data saved (1807 records). [2025-10-09T22:36:55.781667] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-09T22:36:55.784628] [INFO ] [MAIN ] Derivative Progress: 437/1690 symbols completed. CRK took 1.2s. Estimated remaining: 8m 11s. Rate: 153.1 symbols/min [2025-10-09T22:36:55.784832] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:55.799856] [DEBUG] [MAIN ] CRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:55.800974] [INFO ] [MAIN ] CRI: Generated 1807 derivative records from 50079 primary records. [2025-10-09T22:36:55.801116] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-09T22:36:55.818423] [DEBUG] [LOCAL ] CRI: Derivative data saved (1807 records). [2025-10-09T22:36:55.818811] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-09T22:36:55.822709] [INFO ] [MAIN ] Derivative Progress: 438/1690 symbols completed. CRI took 1.2s. Estimated remaining: 8m 10s. Rate: 153.4 symbols/min [2025-10-09T22:36:55.823037] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:55.877109] [DEBUG] [LOCAL ] CRL: Loaded 43158 existing records from primary storage. [2025-10-09T22:36:55.877512] [INFO ] [MAIN ] CRL: Loaded 43158 primary data records. [2025-10-09T22:36:56.029559] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-09T22:36:56.055866] [INFO ] [MAIN ] CRM: Loaded 54160 primary data records. [2025-10-09T22:36:56.090513] [DEBUG] [LOCAL ] CRS: Loaded 43462 existing records from primary storage. [2025-10-09T22:36:56.238802] [INFO ] [MAIN ] CRS: Loaded 43462 primary data records. [2025-10-09T22:36:56.962002] [DEBUG] [MAIN ] CRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:56.963183] [INFO ] [MAIN ] CRL: Generated 1807 derivative records from 43158 primary records. [2025-10-09T22:36:56.964124] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-09T22:36:56.986925] [DEBUG] [LOCAL ] CRL: Derivative data saved (1807 records). [2025-10-09T22:36:56.989287] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-09T22:36:56.991829] [INFO ] [MAIN ] Derivative Progress: 439/1690 symbols completed. CRL took 1.2s. Estimated remaining: 8m 11s. Rate: 152.7 symbols/min [2025-10-09T22:36:56.993476] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:57.009262] [DEBUG] [MAIN ] CRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:57.010341] [INFO ] [MAIN ] CRM: Generated 1807 derivative records from 54160 primary records. [2025-10-09T22:36:57.010448] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-09T22:36:57.020099] [DEBUG] [LOCAL ] CRT: Loaded 4999 existing records from primary storage. [2025-10-09T22:36:57.029177] [INFO ] [MAIN ] CRT: Loaded 4999 primary data records. [2025-10-09T22:36:57.103256] [DEBUG] [LOCAL ] CRM: Derivative data saved (1807 records). [2025-10-09T22:36:57.136206] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-09T22:36:57.147842] [DEBUG] [MAIN ] CRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:57.150597] [INFO ] [MAIN ] Derivative Progress: 440/1690 symbols completed. CRM took 1.4s. Estimated remaining: 8m 10s. Rate: 153.0 symbols/min [2025-10-09T22:36:57.173081] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:57.174609] [INFO ] [MAIN ] CRS: Generated 1807 derivative records from 43462 primary records. [2025-10-09T22:36:57.191638] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-09T22:36:57.396444] [DEBUG] [LOCAL ] CRS: Derivative data saved (1807 records). [2025-10-09T22:36:57.396839] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-09T22:36:57.400981] [INFO ] [MAIN ] Derivative Progress: 441/1690 symbols completed. CRS took 1.6s. Estimated remaining: 8m 10s. Rate: 153.1 symbols/min [2025-10-09T22:36:57.401500] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:57.432028] [DEBUG] [LOCAL ] CSAN: Loaded 42377 existing records from primary storage. [2025-10-09T22:36:57.433156] [INFO ] [MAIN ] CSAN: Loaded 42377 primary data records. [2025-10-09T22:36:57.524102] [DEBUG] [MAIN ] CRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:57.530806] [INFO ] [MAIN ] CRT: Generated 1807 derivative records from 4999 primary records. [2025-10-09T22:36:57.538335] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-09T22:36:57.590968] [DEBUG] [LOCAL ] CSL: Loaded 31693 existing records from primary storage. [2025-10-09T22:36:57.640713] [INFO ] [MAIN ] CSL: Loaded 31693 primary data records. [2025-10-09T22:36:57.678154] [DEBUG] [LOCAL ] CRT: Derivative data saved (1807 records). [2025-10-09T22:36:57.824855] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-09T22:36:57.827023] [INFO ] [MAIN ] Derivative Progress: 442/1690 symbols completed. CRT took 0.8s. Estimated remaining: 8m 9s. Rate: 153.0 symbols/min [2025-10-09T22:36:57.828137] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:57.944713] [DEBUG] [LOCAL ] CSR: Loaded 13088 existing records from primary storage. [2025-10-09T22:36:57.984193] [INFO ] [MAIN ] CSR: Loaded 13088 primary data records. [2025-10-09T22:36:58.515905] [DEBUG] [MAIN ] CSAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:58.517870] [INFO ] [MAIN ] CSAN: Generated 1807 derivative records from 42377 primary records. [2025-10-09T22:36:58.518184] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-09T22:36:58.557123] [DEBUG] [MAIN ] CSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:58.559199] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1807 records). [2025-10-09T22:36:58.558927] [INFO ] [MAIN ] CSL: Generated 1807 derivative records from 31693 primary records. [2025-10-09T22:36:58.559579] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-09T22:36:58.559525] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-09T22:36:58.562581] [INFO ] [MAIN ] Derivative Progress: 443/1690 symbols completed. CSAN took 1.4s. Estimated remaining: 8m 10s. Rate: 152.7 symbols/min [2025-10-09T22:36:58.564255] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:58.585168] [DEBUG] [LOCAL ] CSL: Derivative data saved (1807 records). [2025-10-09T22:36:58.598236] [DEBUG] [MAIN ] CSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:58.598344] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-09T22:36:58.599366] [INFO ] [MAIN ] CSR: Generated 1807 derivative records from 13088 primary records. [2025-10-09T22:36:58.602520] [INFO ] [MAIN ] Derivative Progress: 444/1690 symbols completed. CSL took 1.2s. Estimated remaining: 8m 8s. Rate: 153.1 symbols/min [2025-10-09T22:36:58.602775] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-09T22:36:58.603153] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:58.621968] [DEBUG] [LOCAL ] CSR: Derivative data saved (1807 records). [2025-10-09T22:36:58.622431] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-09T22:36:58.626374] [INFO ] [MAIN ] Derivative Progress: 445/1690 symbols completed. CSR took 0.8s. Estimated remaining: 8m 7s. Rate: 153.4 symbols/min [2025-10-09T22:36:58.626616] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:58.653350] [DEBUG] [LOCAL ] CSV: Loaded 12804 existing records from primary storage. [2025-10-09T22:36:58.653757] [INFO ] [MAIN ] CSV: Loaded 12804 primary data records. [2025-10-09T22:36:58.712925] [DEBUG] [LOCAL ] CTBB: Loaded 7084 existing records from primary storage. [2025-10-09T22:36:58.735382] [INFO ] [MAIN ] CTBB: Loaded 7084 primary data records. [2025-10-09T22:36:58.849989] [DEBUG] [LOCAL ] CSTM: Loaded 47875 existing records from primary storage. [2025-10-09T22:36:58.875948] [INFO ] [MAIN ] CSTM: Loaded 47875 primary data records. [2025-10-09T22:36:59.666210] [DEBUG] [MAIN ] CSV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:59.680304] [INFO ] [MAIN ] CSV: Generated 1807 derivative records from 12804 primary records. [2025-10-09T22:36:59.682122] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-09T22:36:59.700143] [DEBUG] [MAIN ] CTBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:59.707873] [INFO ] [MAIN ] CTBB: Generated 1807 derivative records from 7084 primary records. [2025-10-09T22:36:59.708146] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-09T22:36:59.713129] [DEBUG] [MAIN ] CSTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:36:59.724622] [INFO ] [MAIN ] CSTM: Generated 1807 derivative records from 47875 primary records. [2025-10-09T22:36:59.728441] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-09T22:36:59.728334] [DEBUG] [LOCAL ] CSV: Derivative data saved (1807 records). [2025-10-09T22:36:59.730446] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-09T22:36:59.732490] [INFO ] [MAIN ] Derivative Progress: 446/1690 symbols completed. CSV took 1.1s. Estimated remaining: 8m 9s. Rate: 152.8 symbols/min [2025-10-09T22:36:59.733208] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:59.753927] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1807 records). [2025-10-09T22:36:59.755965] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-09T22:36:59.759862] [INFO ] [MAIN ] Derivative Progress: 447/1690 symbols completed. CSTM took 1.2s. Estimated remaining: 8m 7s. Rate: 153.1 symbols/min [2025-10-09T22:36:59.760659] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:36:59.760359] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1807 records). [2025-10-09T22:36:59.761402] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-09T22:36:59.767773] [INFO ] [MAIN ] Derivative Progress: 448/1690 symbols completed. CTBB took 1.1s. Estimated remaining: 8m 6s. Rate: 153.4 symbols/min [2025-10-09T22:36:59.768750] [DEBUG] [LOCAL ] CTDD: Loaded 5834 existing records from primary storage. [2025-10-09T22:36:59.769244] [INFO ] [MAIN ] CTDD: Loaded 5834 primary data records. [2025-10-09T22:36:59.954606] [DEBUG] [LOCAL ] CTO: Loaded 28051 existing records from primary storage. [2025-10-09T22:36:59.971144] [INFO ] [MAIN ] CTO: Loaded 28051 primary data records. [2025-10-09T22:37:00.458666] [DEBUG] [MAIN ] CTDD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:37:00.460674] [INFO ] [MAIN ] CTDD: Generated 1806 derivative records from 5834 primary records. [2025-10-09T22:37:00.460836] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-09T22:37:00.477365] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1806 records). [2025-10-09T22:37:00.478427] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-09T22:37:00.480735] [INFO ] [MAIN ] Derivative Progress: 449/1690 symbols completed. CTDD took 0.7s. Estimated remaining: 8m 6s. Rate: 153.1 symbols/min [2025-10-09T22:37:00.495443] [DEBUG] [MAIN ] CTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:00.496053] [INFO ] [MAIN ] CTO: Generated 1807 derivative records from 28051 primary records. [2025-10-09T22:37:00.496115] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-09T22:37:00.511630] [DEBUG] [LOCAL ] CTO: Derivative data saved (1807 records). [2025-10-09T22:37:00.511726] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-09T22:37:00.514349] [INFO ] [MAIN ] Derivative Progress: 450/1690 symbols completed. CTO took 0.8s. Estimated remaining: 8m 5s. Rate: 153.4 symbols/min [2025-10-09T22:37:00.515206] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:00.515095] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:00.515459] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:00.539035] [DEBUG] [LOCAL ] CTS: Loaded 19505 existing records from primary storage. [2025-10-09T22:37:00.539272] [INFO ] [MAIN ] CTS: Loaded 19505 primary data records. [2025-10-09T22:37:00.902479] [DEBUG] [LOCAL ] CTVA: Loaded 53653 existing records from primary storage. [2025-10-09T22:37:00.903446] [DEBUG] [LOCAL ] CTRA: Loaded 54036 existing records from primary storage. [2025-10-09T22:37:00.903798] [INFO ] [MAIN ] CTVA: Loaded 53653 primary data records. [2025-10-09T22:37:00.904027] [INFO ] [MAIN ] CTRA: Loaded 54036 primary data records. [2025-10-09T22:37:01.566560] [DEBUG] [MAIN ] CTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:01.567977] [INFO ] [MAIN ] CTS: Generated 1807 derivative records from 19505 primary records. [2025-10-09T22:37:01.568343] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-09T22:37:01.586276] [DEBUG] [LOCAL ] CTS: Derivative data saved (1807 records). [2025-10-09T22:37:01.586900] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-09T22:37:01.589767] [INFO ] [MAIN ] Derivative Progress: 451/1690 symbols completed. CTS took 1.1s. Estimated remaining: 8m 6s. Rate: 152.8 symbols/min [2025-10-09T22:37:01.590056] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:01.607675] [DEBUG] [MAIN ] CTVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:01.608535] [INFO ] [MAIN ] CTVA: Generated 1807 derivative records from 53653 primary records. [2025-10-09T22:37:01.608679] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-09T22:37:01.638217] [DEBUG] [MAIN ] CTRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:01.639501] [INFO ] [MAIN ] CTRA: Generated 1807 derivative records from 54036 primary records. [2025-10-09T22:37:01.639860] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-09T22:37:01.656529] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1807 records). [2025-10-09T22:37:01.656928] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-09T22:37:01.659812] [INFO ] [MAIN ] Derivative Progress: 452/1690 symbols completed. CTVA took 1.1s. Estimated remaining: 8m 5s. Rate: 153.1 symbols/min [2025-10-09T22:37:01.659996] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:01.664540] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1807 records). [2025-10-09T22:37:01.664856] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-09T22:37:01.668830] [INFO ] [MAIN ] Derivative Progress: 453/1690 symbols completed. CTRA took 1.2s. Estimated remaining: 8m 4s. Rate: 153.5 symbols/min [2025-10-09T22:37:01.682836] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:01.695877] [DEBUG] [LOCAL ] CULP: Loaded 2897 existing records from primary storage. [2025-10-09T22:37:01.696123] [INFO ] [MAIN ] CULP: Loaded 2897 primary data records. [2025-10-09T22:37:01.823935] [DEBUG] [LOCAL ] CUBI: Loaded 27184 existing records from primary storage. [2025-10-09T22:37:01.830948] [DEBUG] [LOCAL ] CUBE: Loaded 51139 existing records from primary storage. [2025-10-09T22:37:01.836231] [INFO ] [MAIN ] CUBI: Loaded 27184 primary data records. [2025-10-09T22:37:01.846797] [INFO ] [MAIN ] CUBE: Loaded 51139 primary data records. [2025-10-09T22:37:02.779259] [DEBUG] [MAIN ] CULP: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-09T22:37:02.781071] [INFO ] [MAIN ] CULP: Generated 1804 derivative records from 2897 primary records. [2025-10-09T22:37:02.781303] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-09T22:37:02.797556] [DEBUG] [LOCAL ] CULP: Derivative data saved (1804 records). [2025-10-09T22:37:02.798065] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-09T22:37:02.800327] [INFO ] [MAIN ] Derivative Progress: 454/1690 symbols completed. CULP took 1.1s. Estimated remaining: 8m 5s. Rate: 152.8 symbols/min [2025-10-09T22:37:02.800898] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:02.818710] [DEBUG] [MAIN ] CUBE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:02.819555] [INFO ] [MAIN ] CUBE: Generated 1807 derivative records from 51139 primary records. [2025-10-09T22:37:02.820638] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-09T22:37:02.851948] [DEBUG] [MAIN ] CUBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:02.860532] [INFO ] [MAIN ] CUBI: Generated 1807 derivative records from 27184 primary records. [2025-10-09T22:37:02.860892] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1807 records). [2025-10-09T22:37:02.861063] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-09T22:37:02.861185] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-09T22:37:02.864210] [INFO ] [MAIN ] Derivative Progress: 455/1690 symbols completed. CUBE took 1.3s. Estimated remaining: 8m 4s. Rate: 153.1 symbols/min [2025-10-09T22:37:02.865363] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:02.890619] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1807 records). [2025-10-09T22:37:02.891206] [DEBUG] [LOCAL ] CURV: Loaded 27028 existing records from primary storage. [2025-10-09T22:37:02.891420] [INFO ] [MAIN ] CURV: Loaded 27028 primary data records. [2025-10-09T22:37:02.891661] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-09T22:37:02.900530] [INFO ] [MAIN ] Derivative Progress: 456/1690 symbols completed. CUBI took 1.2s. Estimated remaining: 8m 3s. Rate: 153.4 symbols/min [2025-10-09T22:37:02.927853] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:03.225944] [DEBUG] [LOCAL ] CUZ: Loaded 49781 existing records from primary storage. [2025-10-09T22:37:03.238925] [INFO ] [MAIN ] CUZ: Loaded 49781 primary data records. [2025-10-09T22:37:03.386838] [DEBUG] [LOCAL ] CVE: Loaded 53949 existing records from primary storage. [2025-10-09T22:37:03.438668] [INFO ] [MAIN ] CVE: Loaded 53949 primary data records. [2025-10-09T22:37:03.891595] [DEBUG] [MAIN ] CURV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:03.892926] [INFO ] [MAIN ] CURV: Generated 1807 derivative records from 27028 primary records. [2025-10-09T22:37:03.893306] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-09T22:37:03.930038] [DEBUG] [MAIN ] CUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:03.929715] [DEBUG] [LOCAL ] CURV: Derivative data saved (1807 records). [2025-10-09T22:37:03.930915] [INFO ] [MAIN ] CUZ: Generated 1807 derivative records from 49781 primary records. [2025-10-09T22:37:03.930181] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-09T22:37:03.933943] [INFO ] [MAIN ] Derivative Progress: 457/1690 symbols completed. CURV took 1.1s. Estimated remaining: 8m 4s. Rate: 152.9 symbols/min [2025-10-09T22:37:03.934223] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:03.934102] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-09T22:37:03.954681] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1807 records). [2025-10-09T22:37:03.954994] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-09T22:37:03.957704] [INFO ] [MAIN ] Derivative Progress: 458/1690 symbols completed. CUZ took 1.1s. Estimated remaining: 8m 3s. Rate: 153.2 symbols/min [2025-10-09T22:37:03.957964] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:03.975681] [DEBUG] [MAIN ] CVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:03.976492] [INFO ] [MAIN ] CVE: Generated 1807 derivative records from 53949 primary records. [2025-10-09T22:37:03.976927] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-09T22:37:04.003855] [DEBUG] [LOCAL ] CVE: Derivative data saved (1807 records). [2025-10-09T22:37:04.002397] [DEBUG] [LOCAL ] CVLG: Loaded 15601 existing records from primary storage. [2025-10-09T22:37:04.004091] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-09T22:37:04.004174] [INFO ] [MAIN ] CVLG: Loaded 15601 primary data records. [2025-10-09T22:37:04.013963] [INFO ] [MAIN ] Derivative Progress: 459/1690 symbols completed. CVE took 1.1s. Estimated remaining: 8m 1s. Rate: 153.5 symbols/min [2025-10-09T22:37:04.046724] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:04.370450] [DEBUG] [LOCAL ] CVNA: Loaded 53280 existing records from primary storage. [2025-10-09T22:37:04.371239] [INFO ] [MAIN ] CVNA: Loaded 53280 primary data records. [2025-10-09T22:37:04.570757] [DEBUG] [LOCAL ] CVS: Loaded 54084 existing records from primary storage. [2025-10-09T22:37:04.708265] [INFO ] [MAIN ] CVS: Loaded 54084 primary data records. [2025-10-09T22:37:04.849986] [DEBUG] [MAIN ] CVLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:04.928111] [INFO ] [MAIN ] CVLG: Generated 1807 derivative records from 15601 primary records. [2025-10-09T22:37:05.048477] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-09T22:37:05.086754] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1807 records). [2025-10-09T22:37:05.087336] [DEBUG] [MAIN ] CVNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:05.088315] [INFO ] [MAIN ] CVNA: Generated 1807 derivative records from 53280 primary records. [2025-10-09T22:37:05.086954] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-09T22:37:05.088488] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-09T22:37:05.091189] [INFO ] [MAIN ] Derivative Progress: 460/1690 symbols completed. CVLG took 1.2s. Estimated remaining: 8m 3s. Rate: 152.9 symbols/min [2025-10-09T22:37:05.091454] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:05.114295] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1807 records). [2025-10-09T22:37:05.117022] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-09T22:37:05.120297] [INFO ] [MAIN ] Derivative Progress: 461/1690 symbols completed. CVNA took 1.2s. Estimated remaining: 8m 1s. Rate: 153.2 symbols/min [2025-10-09T22:37:05.120761] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:05.139494] [DEBUG] [MAIN ] CVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:05.142052] [INFO ] [MAIN ] CVS: Generated 1807 derivative records from 54084 primary records. [2025-10-09T22:37:05.142119] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-09T22:37:05.179467] [DEBUG] [LOCAL ] CVS: Derivative data saved (1807 records). [2025-10-09T22:37:05.179685] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-09T22:37:05.183739] [INFO ] [MAIN ] Derivative Progress: 462/1690 symbols completed. CVS took 1.1s. Estimated remaining: 8m 0s. Rate: 153.5 symbols/min [2025-10-09T22:37:05.184270] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:05.194563] [DEBUG] [LOCAL ] CW: Loaded 22352 existing records from primary storage. [2025-10-09T22:37:05.207829] [INFO ] [MAIN ] CW: Loaded 22352 primary data records. [2025-10-09T22:37:05.246449] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-09T22:37:05.279277] [INFO ] [MAIN ] CVX: Loaded 54150 primary data records. [2025-10-09T22:37:05.846975] [DEBUG] [LOCAL ] CWAN: Loaded 52841 existing records from primary storage. [2025-10-09T22:37:05.848053] [INFO ] [MAIN ] CWAN: Loaded 52841 primary data records. [2025-10-09T22:37:06.221239] [DEBUG] [MAIN ] CW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:06.222782] [INFO ] [MAIN ] CW: Generated 1807 derivative records from 22352 primary records. [2025-10-09T22:37:06.223168] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-09T22:37:06.243895] [DEBUG] [LOCAL ] CW: Derivative data saved (1807 records). [2025-10-09T22:37:06.256154] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-09T22:37:06.258840] [INFO ] [MAIN ] Derivative Progress: 463/1690 symbols completed. CW took 1.1s. Estimated remaining: 8m 2s. Rate: 152.9 symbols/min [2025-10-09T22:37:06.259212] [DEBUG] [MAIN ] CVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:06.260089] [INFO ] [MAIN ] CVX: Generated 1807 derivative records from 54150 primary records. [2025-10-09T22:37:06.260189] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-09T22:37:06.279248] [DEBUG] [LOCAL ] CVX: Derivative data saved (1807 records). [2025-10-09T22:37:06.280068] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-09T22:37:06.283782] [INFO ] [MAIN ] Derivative Progress: 464/1690 symbols completed. CVX took 1.2s. Estimated remaining: 8m 0s. Rate: 153.2 symbols/min [2025-10-09T22:37:06.297093] [DEBUG] [MAIN ] CWAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:06.301623] [INFO ] [MAIN ] CWAN: Generated 1807 derivative records from 52841 primary records. [2025-10-09T22:37:06.301713] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-09T22:37:06.317253] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1807 records). [2025-10-09T22:37:06.317318] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-09T22:37:06.321201] [INFO ] [MAIN ] Derivative Progress: 465/1690 symbols completed. CWAN took 1.1s. Estimated remaining: 7m 59s. Rate: 153.5 symbols/min [2025-10-09T22:37:06.321565] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:06.321704] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:06.321775] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:06.368557] [DEBUG] [LOCAL ] CWT: Loaded 28221 existing records from primary storage. [2025-10-09T22:37:06.368755] [INFO ] [MAIN ] CWT: Loaded 28221 primary data records. [2025-10-09T22:37:06.512317] [DEBUG] [LOCAL ] CWK: Loaded 49798 existing records from primary storage. [2025-10-09T22:37:06.528341] [INFO ] [MAIN ] CWK: Loaded 49798 primary data records. [2025-10-09T22:37:06.573175] [DEBUG] [LOCAL ] CWH: Loaded 51673 existing records from primary storage. [2025-10-09T22:37:06.735521] [INFO ] [MAIN ] CWH: Loaded 51673 primary data records. [2025-10-09T22:37:07.340775] [DEBUG] [MAIN ] CWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:07.342754] [INFO ] [MAIN ] CWT: Generated 1807 derivative records from 28221 primary records. [2025-10-09T22:37:07.342953] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-09T22:37:07.363299] [DEBUG] [LOCAL ] CWT: Derivative data saved (1807 records). [2025-10-09T22:37:07.363541] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-09T22:37:07.365796] [INFO ] [MAIN ] Derivative Progress: 466/1690 symbols completed. CWT took 1.0s. Estimated remaining: 8m 0s. Rate: 152.9 symbols/min [2025-10-09T22:37:07.366053] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:07.380141] [DEBUG] [MAIN ] CWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:07.380950] [INFO ] [MAIN ] CWK: Generated 1807 derivative records from 49798 primary records. [2025-10-09T22:37:07.381107] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-09T22:37:07.415269] [DEBUG] [LOCAL ] CWK: Derivative data saved (1807 records). [2025-10-09T22:37:07.415861] [DEBUG] [MAIN ] CWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:07.416174] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-09T22:37:07.416901] [INFO ] [MAIN ] CWH: Generated 1807 derivative records from 51673 primary records. [2025-10-09T22:37:07.417003] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-09T22:37:07.420665] [INFO ] [MAIN ] Derivative Progress: 467/1690 symbols completed. CWK took 1.1s. Estimated remaining: 7m 59s. Rate: 153.2 symbols/min [2025-10-09T22:37:07.420867] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:07.451612] [DEBUG] [LOCAL ] CWH: Derivative data saved (1807 records). [2025-10-09T22:37:07.454778] [DEBUG] [LOCAL ] CXE: Loaded 6217 existing records from primary storage. [2025-10-09T22:37:07.454919] [INFO ] [MAIN ] CXE: Loaded 6217 primary data records. [2025-10-09T22:37:07.466148] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-09T22:37:07.488570] [INFO ] [MAIN ] Derivative Progress: 468/1690 symbols completed. CWH took 1.2s. Estimated remaining: 7m 58s. Rate: 153.5 symbols/min [2025-10-09T22:37:07.493879] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:07.593485] [DEBUG] [LOCAL ] CX: Loaded 53201 existing records from primary storage. [2025-10-09T22:37:07.598906] [DEBUG] [LOCAL ] CXH: Loaded 4438 existing records from primary storage. [2025-10-09T22:37:07.630982] [INFO ] [MAIN ] CX: Loaded 53201 primary data records. [2025-10-09T22:37:07.638123] [INFO ] [MAIN ] CXH: Loaded 4438 primary data records. [2025-10-09T22:37:08.448388] [DEBUG] [MAIN ] CXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:08.449606] [INFO ] [MAIN ] CXE: Generated 1807 derivative records from 6217 primary records. [2025-10-09T22:37:08.449839] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-09T22:37:08.467991] [DEBUG] [LOCAL ] CXE: Derivative data saved (1807 records). [2025-10-09T22:37:08.480194] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-09T22:37:08.482418] [INFO ] [MAIN ] Derivative Progress: 469/1690 symbols completed. CXE took 1.1s. Estimated remaining: 7m 59s. Rate: 153.0 symbols/min [2025-10-09T22:37:08.482967] [DEBUG] [MAIN ] CX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:08.483057] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:08.484025] [INFO ] [MAIN ] CX: Generated 1807 derivative records from 53201 primary records. [2025-10-09T22:37:08.485182] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-09T22:37:08.515670] [DEBUG] [MAIN ] CXH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:08.516729] [DEBUG] [LOCAL ] CX: Derivative data saved (1807 records). [2025-10-09T22:37:08.517001] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-09T22:37:08.517888] [INFO ] [MAIN ] CXH: Generated 1807 derivative records from 4438 primary records. [2025-10-09T22:37:08.521261] [INFO ] [MAIN ] Derivative Progress: 470/1690 symbols completed. CX took 1.2s. Estimated remaining: 7m 58s. Rate: 153.3 symbols/min [2025-10-09T22:37:08.521408] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-09T22:37:08.522019] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:08.537172] [DEBUG] [LOCAL ] CXH: Derivative data saved (1807 records). [2025-10-09T22:37:08.537385] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-09T22:37:08.540611] [INFO ] [MAIN ] Derivative Progress: 471/1690 symbols completed. CXH took 1.0s. Estimated remaining: 7m 56s. Rate: 153.6 symbols/min [2025-10-09T22:37:08.551760] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:08.587167] [DEBUG] [LOCAL ] CXM: Loaded 47926 existing records from primary storage. [2025-10-09T22:37:08.587820] [DEBUG] [LOCAL ] CXT: Loaded 31255 existing records from primary storage. [2025-10-09T22:37:08.587919] [INFO ] [MAIN ] CXT: Loaded 31255 primary data records. [2025-10-09T22:37:08.588003] [INFO ] [MAIN ] CXM: Loaded 47926 primary data records. [2025-10-09T22:37:08.885662] [DEBUG] [LOCAL ] CXW: Loaded 44278 existing records from primary storage. [2025-10-09T22:37:09.016793] [INFO ] [MAIN ] CXW: Loaded 44278 primary data records. [2025-10-09T22:37:09.542523] [DEBUG] [MAIN ] CXM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:09.549184] [DEBUG] [MAIN ] CXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:09.548334] [INFO ] [MAIN ] CXM: Generated 1807 derivative records from 47926 primary records. [2025-10-09T22:37:09.550162] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-09T22:37:09.550081] [INFO ] [MAIN ] CXT: Generated 1807 derivative records from 31255 primary records. [2025-10-09T22:37:09.550770] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-09T22:37:09.581716] [DEBUG] [LOCAL ] CXT: Derivative data saved (1807 records). [2025-10-09T22:37:09.582553] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-09T22:37:09.585188] [INFO ] [MAIN ] Derivative Progress: 472/1690 symbols completed. CXT took 1.1s. Estimated remaining: 7m 57s. Rate: 153.0 symbols/min [2025-10-09T22:37:09.585361] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:09.587987] [DEBUG] [LOCAL ] CXM: Derivative data saved (1807 records). [2025-10-09T22:37:09.588172] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-09T22:37:09.591299] [INFO ] [MAIN ] Derivative Progress: 473/1690 symbols completed. CXM took 1.1s. Estimated remaining: 7m 56s. Rate: 153.4 symbols/min [2025-10-09T22:37:09.591553] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:09.607734] [DEBUG] [MAIN ] CXW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:09.608453] [INFO ] [MAIN ] CXW: Generated 1807 derivative records from 44278 primary records. [2025-10-09T22:37:09.608614] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-09T22:37:09.624893] [DEBUG] [LOCAL ] CXW: Derivative data saved (1807 records). [2025-10-09T22:37:09.624986] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-09T22:37:09.629737] [INFO ] [MAIN ] Derivative Progress: 474/1690 symbols completed. CXW took 1.1s. Estimated remaining: 7m 55s. Rate: 153.7 symbols/min [2025-10-09T22:37:09.629975] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:09.654599] [DEBUG] [LOCAL ] DAC: Loaded 12658 existing records from primary storage. [2025-10-09T22:37:09.654751] [INFO ] [MAIN ] DAC: Loaded 12658 primary data records. [2025-10-09T22:37:09.772841] [DEBUG] [LOCAL ] CYH: Loaded 47995 existing records from primary storage. [2025-10-09T22:37:09.783590] [INFO ] [MAIN ] CYH: Loaded 47995 primary data records. [2025-10-09T22:37:09.870929] [DEBUG] [LOCAL ] D: Loaded 54037 existing records from primary storage. [2025-10-09T22:37:09.924505] [INFO ] [MAIN ] D: Loaded 54037 primary data records. [2025-10-09T22:37:10.680572] [DEBUG] [MAIN ] DAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:10.681934] [INFO ] [MAIN ] DAC: Generated 1807 derivative records from 12658 primary records. [2025-10-09T22:37:10.682382] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-09T22:37:10.700818] [DEBUG] [LOCAL ] DAC: Derivative data saved (1807 records). [2025-10-09T22:37:10.700954] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-09T22:37:10.703118] [INFO ] [MAIN ] Derivative Progress: 475/1690 symbols completed. DAC took 1.1s. Estimated remaining: 7m 56s. Rate: 153.1 symbols/min [2025-10-09T22:37:10.703377] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:10.721874] [DEBUG] [MAIN ] CYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:10.722998] [INFO ] [MAIN ] CYH: Generated 1807 derivative records from 47995 primary records. [2025-10-09T22:37:10.723245] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-09T22:37:10.744402] [DEBUG] [LOCAL ] CYH: Derivative data saved (1807 records). [2025-10-09T22:37:10.744665] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-09T22:37:10.748255] [INFO ] [MAIN ] Derivative Progress: 476/1690 symbols completed. CYH took 1.2s. Estimated remaining: 7m 55s. Rate: 153.4 symbols/min [2025-10-09T22:37:10.761158] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:10.762043] [DEBUG] [MAIN ] D: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:10.762613] [INFO ] [MAIN ] D: Generated 1807 derivative records from 54037 primary records. [2025-10-09T22:37:10.762710] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-09T22:37:10.797755] [DEBUG] [LOCAL ] D: Derivative data saved (1807 records). [2025-10-09T22:37:10.797930] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-09T22:37:10.801399] [INFO ] [MAIN ] Derivative Progress: 477/1690 symbols completed. D took 1.2s. Estimated remaining: 7m 54s. Rate: 153.7 symbols/min [2025-10-09T22:37:10.801866] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:10.819872] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-09T22:37:10.820159] [INFO ] [MAIN ] DAL: Loaded 54143 primary data records. [2025-10-09T22:37:10.951860] [DEBUG] [LOCAL ] DAO: Loaded 20161 existing records from primary storage. [2025-10-09T22:37:10.975153] [INFO ] [MAIN ] DAO: Loaded 20161 primary data records. [2025-10-09T22:37:11.032632] [DEBUG] [LOCAL ] DAN: Loaded 49495 existing records from primary storage. [2025-10-09T22:37:11.086408] [INFO ] [MAIN ] DAN: Loaded 49495 primary data records. [2025-10-09T22:37:11.802580] [DEBUG] [MAIN ] DAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:11.803574] [INFO ] [MAIN ] DAL: Generated 1807 derivative records from 54143 primary records. [2025-10-09T22:37:11.804260] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-09T22:37:11.835918] [DEBUG] [MAIN ] DAO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:11.838989] [INFO ] [MAIN ] DAO: Generated 1807 derivative records from 20161 primary records. [2025-10-09T22:37:11.839313] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-09T22:37:11.841449] [DEBUG] [LOCAL ] DAL: Derivative data saved (1807 records). [2025-10-09T22:37:11.848626] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-09T22:37:11.850941] [INFO ] [MAIN ] Derivative Progress: 478/1690 symbols completed. DAL took 1.1s. Estimated remaining: 7m 55s. Rate: 153.1 symbols/min [2025-10-09T22:37:11.871797] [DEBUG] [LOCAL ] DAO: Derivative data saved (1807 records). [2025-10-09T22:37:11.870988] [DEBUG] [MAIN ] DAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:11.872785] [INFO ] [MAIN ] DAN: Generated 1807 derivative records from 49495 primary records. [2025-10-09T22:37:11.871963] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-09T22:37:11.876255] [INFO ] [MAIN ] Derivative Progress: 479/1690 symbols completed. DAO took 1.1s. Estimated remaining: 7m 54s. Rate: 153.4 symbols/min [2025-10-09T22:37:11.876489] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-09T22:37:11.893728] [DEBUG] [LOCAL ] DAN: Derivative data saved (1807 records). [2025-10-09T22:37:11.893880] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-09T22:37:11.897695] [INFO ] [MAIN ] Derivative Progress: 480/1690 symbols completed. DAN took 1.1s. Estimated remaining: 7m 52s. Rate: 153.7 symbols/min [2025-10-09T22:37:11.898357] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:11.898187] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:11.898290] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:12.015609] [DEBUG] [LOCAL ] DAR: Loaded 52249 existing records from primary storage. [2025-10-09T22:37:12.016238] [DEBUG] [LOCAL ] DAVA: Loaded 41762 existing records from primary storage. [2025-10-09T22:37:12.016544] [INFO ] [MAIN ] DAVA: Loaded 41762 primary data records. [2025-10-09T22:37:12.016446] [INFO ] [MAIN ] DAR: Loaded 52249 primary data records. [2025-10-09T22:37:12.053494] [DEBUG] [LOCAL ] DAY: Loaded 49556 existing records from primary storage. [2025-10-09T22:37:12.075044] [INFO ] [MAIN ] DAY: Loaded 49556 primary data records. [2025-10-09T22:37:12.990621] [DEBUG] [MAIN ] DAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:12.993880] [INFO ] [MAIN ] DAR: Generated 1807 derivative records from 52249 primary records. [2025-10-09T22:37:12.995793] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-09T22:37:13.025153] [DEBUG] [MAIN ] DAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:13.036007] [INFO ] [MAIN ] DAY: Generated 1807 derivative records from 49556 primary records. [2025-10-09T22:37:13.038848] [DEBUG] [LOCAL ] DAR: Derivative data saved (1807 records). [2025-10-09T22:37:13.039089] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-09T22:37:13.039613] [DEBUG] [MAIN ] DAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:13.041174] [INFO ] [MAIN ] DAVA: Generated 1807 derivative records from 41762 primary records. [2025-10-09T22:37:13.041302] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-09T22:37:13.041626] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-09T22:37:13.053613] [INFO ] [MAIN ] Derivative Progress: 481/1690 symbols completed. DAR took 1.2s. Estimated remaining: 7m 54s. Rate: 153.1 symbols/min [2025-10-09T22:37:13.057615] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:13.075092] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1807 records). [2025-10-09T22:37:13.075679] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-09T22:37:13.078620] [INFO ] [MAIN ] Derivative Progress: 482/1690 symbols completed. DAVA took 1.2s. Estimated remaining: 7m 53s. Rate: 153.4 symbols/min [2025-10-09T22:37:13.079150] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:13.081999] [DEBUG] [LOCAL ] DAY: Derivative data saved (1807 records). [2025-10-09T22:37:13.082098] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-09T22:37:13.085964] [INFO ] [MAIN ] Derivative Progress: 483/1690 symbols completed. DAY took 1.2s. Estimated remaining: 7m 51s. Rate: 153.7 symbols/min [2025-10-09T22:37:13.086433] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:13.149846] [DEBUG] [LOCAL ] DB: Loaded 52889 existing records from primary storage. [2025-10-09T22:37:13.149994] [INFO ] [MAIN ] DB: Loaded 52889 primary data records. [2025-10-09T22:37:13.265506] [DEBUG] [LOCAL ] DBI: Loaded 44574 existing records from primary storage. [2025-10-09T22:37:13.280452] [INFO ] [MAIN ] DBI: Loaded 44574 primary data records. [2025-10-09T22:37:13.436612] [DEBUG] [LOCAL ] DBRG: Loaded 50140 existing records from primary storage. [2025-10-09T22:37:13.458522] [INFO ] [MAIN ] DBRG: Loaded 50140 primary data records. [2025-10-09T22:37:14.210659] [DEBUG] [MAIN ] DBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:14.210260] [DEBUG] [MAIN ] DB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:14.212206] [INFO ] [MAIN ] DBI: Generated 1807 derivative records from 44574 primary records. [2025-10-09T22:37:14.213097] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-09T22:37:14.222192] [INFO ] [MAIN ] DB: Generated 1807 derivative records from 52889 primary records. [2025-10-09T22:37:14.222306] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-09T22:37:14.246740] [DEBUG] [LOCAL ] DBI: Derivative data saved (1807 records). [2025-10-09T22:37:14.249810] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-09T22:37:14.253156] [INFO ] [MAIN ] Derivative Progress: 484/1690 symbols completed. DBI took 1.2s. Estimated remaining: 7m 53s. Rate: 153.1 symbols/min [2025-10-09T22:37:14.260932] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:14.267356] [DEBUG] [MAIN ] DBRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:14.268984] [DEBUG] [LOCAL ] DB: Derivative data saved (1807 records). [2025-10-09T22:37:14.269818] [INFO ] [MAIN ] DBRG: Generated 1807 derivative records from 50140 primary records. [2025-10-09T22:37:14.270113] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-09T22:37:14.270173] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-09T22:37:14.272663] [INFO ] [MAIN ] Derivative Progress: 485/1690 symbols completed. DB took 1.2s. Estimated remaining: 7m 51s. Rate: 153.4 symbols/min [2025-10-09T22:37:14.272964] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:14.289576] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1807 records). [2025-10-09T22:37:14.289832] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-09T22:37:14.293583] [INFO ] [MAIN ] Derivative Progress: 486/1690 symbols completed. DBRG took 1.2s. Estimated remaining: 7m 50s. Rate: 153.7 symbols/min [2025-10-09T22:37:14.293826] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:14.315772] [DEBUG] [LOCAL ] DCO: Loaded 14031 existing records from primary storage. [2025-10-09T22:37:14.315952] [INFO ] [MAIN ] DCO: Loaded 14031 primary data records. [2025-10-09T22:37:14.466339] [DEBUG] [LOCAL ] DCI: Loaded 37295 existing records from primary storage. [2025-10-09T22:37:14.482870] [INFO ] [MAIN ] DCI: Loaded 37295 primary data records. [2025-10-09T22:37:14.800321] [DEBUG] [LOCAL ] DD: Loaded 53236 existing records from primary storage. [2025-10-09T22:37:14.819423] [INFO ] [MAIN ] DD: Loaded 53236 primary data records. [2025-10-09T22:37:15.306216] [DEBUG] [MAIN ] DCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:15.307130] [INFO ] [MAIN ] DCO: Generated 1807 derivative records from 14031 primary records. [2025-10-09T22:37:15.307560] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-09T22:37:15.342015] [DEBUG] [LOCAL ] DCO: Derivative data saved (1807 records). [2025-10-09T22:37:15.342826] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-09T22:37:15.343852] [DEBUG] [MAIN ] DCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:15.346997] [INFO ] [MAIN ] DCI: Generated 1807 derivative records from 37295 primary records. [2025-10-09T22:37:15.346238] [INFO ] [MAIN ] Derivative Progress: 487/1690 symbols completed. DCO took 1.1s. Estimated remaining: 7m 51s. Rate: 153.1 symbols/min [2025-10-09T22:37:15.347105] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-09T22:37:15.348082] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:15.374151] [DEBUG] [MAIN ] DD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:37:15.376912] [DEBUG] [LOCAL ] DCI: Derivative data saved (1807 records). [2025-10-09T22:37:15.377014] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-09T22:37:15.379878] [INFO ] [MAIN ] Derivative Progress: 488/1690 symbols completed. DCI took 1.1s. Estimated remaining: 7m 50s. Rate: 153.4 symbols/min [2025-10-09T22:37:15.375960] [INFO ] [MAIN ] DD: Generated 1806 derivative records from 53236 primary records. [2025-10-09T22:37:15.379999] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-09T22:37:15.381095] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:15.397765] [DEBUG] [LOCAL ] DD: Derivative data saved (1806 records). [2025-10-09T22:37:15.398078] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-09T22:37:15.401534] [INFO ] [MAIN ] Derivative Progress: 489/1690 symbols completed. DD took 1.1s. Estimated remaining: 7m 49s. Rate: 153.7 symbols/min [2025-10-09T22:37:15.401756] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:15.438416] [DEBUG] [LOCAL ] DDS: Loaded 12885 existing records from primary storage. [2025-10-09T22:37:15.461995] [INFO ] [MAIN ] DDS: Loaded 12885 primary data records. [2025-10-09T22:37:15.462728] [DEBUG] [LOCAL ] DDL: Loaded 37060 existing records from primary storage. [2025-10-09T22:37:15.463871] [DEBUG] [LOCAL ] DDD: Loaded 51305 existing records from primary storage. [2025-10-09T22:37:15.464051] [INFO ] [MAIN ] DDL: Loaded 37060 primary data records. [2025-10-09T22:37:15.463987] [INFO ] [MAIN ] DDD: Loaded 51305 primary data records. [2025-10-09T22:37:16.485494] [DEBUG] [MAIN ] DDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:16.498564] [INFO ] [MAIN ] DDD: Generated 1807 derivative records from 51305 primary records. [2025-10-09T22:37:16.498817] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-09T22:37:16.499301] [DEBUG] [MAIN ] DDS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:37:16.508239] [INFO ] [MAIN ] DDS: Generated 1806 derivative records from 12885 primary records. [2025-10-09T22:37:16.524267] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-09T22:37:16.527730] [DEBUG] [MAIN ] DDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:16.530675] [DEBUG] [LOCAL ] DDD: Derivative data saved (1807 records). [2025-10-09T22:37:16.529038] [INFO ] [MAIN ] DDL: Generated 1807 derivative records from 37060 primary records. [2025-10-09T22:37:16.538962] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-09T22:37:16.539603] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-09T22:37:16.544516] [INFO ] [MAIN ] Derivative Progress: 490/1690 symbols completed. DDD took 1.2s. Estimated remaining: 7m 50s. Rate: 153.1 symbols/min [2025-10-09T22:37:16.544903] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:16.566275] [DEBUG] [LOCAL ] DDS: Derivative data saved (1806 records). [2025-10-09T22:37:16.565044] [DEBUG] [LOCAL ] DDL: Derivative data saved (1807 records). [2025-10-09T22:37:16.566513] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-09T22:37:16.566604] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-09T22:37:16.569943] [INFO ] [MAIN ] Derivative Progress: 491/1690 symbols completed. DDS took 1.2s. Estimated remaining: 7m 49s. Rate: 153.4 symbols/min [2025-10-09T22:37:16.575740] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:16.576117] [INFO ] [MAIN ] Derivative Progress: 492/1690 symbols completed. DDL took 1.2s. Estimated remaining: 7m 48s. Rate: 153.7 symbols/min [2025-10-09T22:37:16.576056] [DEBUG] [LOCAL ] DDT: Loaded 2096 existing records from primary storage. [2025-10-09T22:37:16.576435] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:16.576547] [INFO ] [MAIN ] DDT: Loaded 2096 primary data records. [2025-10-09T22:37:16.888008] [DEBUG] [LOCAL ] DEC: Loaded 30645 existing records from primary storage. [2025-10-09T22:37:16.893452] [INFO ] [MAIN ] DEC: Loaded 30645 primary data records. [2025-10-09T22:37:17.004188] [DEBUG] [LOCAL ] DE: Loaded 47889 existing records from primary storage. [2025-10-09T22:37:17.020598] [INFO ] [MAIN ] DE: Loaded 47889 primary data records. [2025-10-09T22:37:17.579554] [DEBUG] [MAIN ] DDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:17.582165] [INFO ] [MAIN ] DDT: Generated 1807 derivative records from 2096 primary records. [2025-10-09T22:37:17.582834] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-09T22:37:17.601431] [DEBUG] [LOCAL ] DDT: Derivative data saved (1807 records). [2025-10-09T22:37:17.602351] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-09T22:37:17.605471] [INFO ] [MAIN ] Derivative Progress: 493/1690 symbols completed. DDT took 1.1s. Estimated remaining: 7m 49s. Rate: 153.2 symbols/min [2025-10-09T22:37:17.625402] [DEBUG] [MAIN ] DEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:17.626603] [INFO ] [MAIN ] DEC: Generated 1807 derivative records from 30645 primary records. [2025-10-09T22:37:17.626725] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-09T22:37:17.657027] [DEBUG] [MAIN ] DE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:17.658932] [INFO ] [MAIN ] DE: Generated 1807 derivative records from 47889 primary records. [2025-10-09T22:37:17.659197] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-09T22:37:17.676141] [DEBUG] [LOCAL ] DEC: Derivative data saved (1807 records). [2025-10-09T22:37:17.677324] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-09T22:37:17.680223] [INFO ] [MAIN ] Derivative Progress: 494/1690 symbols completed. DEC took 1.1s. Estimated remaining: 7m 48s. Rate: 153.5 symbols/min [2025-10-09T22:37:17.683142] [DEBUG] [LOCAL ] DE: Derivative data saved (1807 records). [2025-10-09T22:37:17.683299] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-09T22:37:17.687086] [INFO ] [MAIN ] Derivative Progress: 495/1690 symbols completed. DE took 1.1s. Estimated remaining: 7m 46s. Rate: 153.8 symbols/min [2025-10-09T22:37:17.687682] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:17.687608] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:17.687782] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:17.703895] [DEBUG] [LOCAL ] DFP: Loaded 11365 existing records from primary storage. [2025-10-09T22:37:17.704115] [INFO ] [MAIN ] DFP: Loaded 11365 primary data records. [2025-10-09T22:37:18.042406] [DEBUG] [LOCAL ] DEO: Loaded 49498 existing records from primary storage. [2025-10-09T22:37:18.057926] [INFO ] [MAIN ] DEO: Loaded 49498 primary data records. [2025-10-09T22:37:18.111530] [DEBUG] [LOCAL ] DELL: Loaded 54126 existing records from primary storage. [2025-10-09T22:37:18.144831] [INFO ] [MAIN ] DELL: Loaded 54126 primary data records. [2025-10-09T22:37:18.766625] [DEBUG] [MAIN ] DFP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:18.768119] [INFO ] [MAIN ] DFP: Generated 1807 derivative records from 11365 primary records. [2025-10-09T22:37:18.768495] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-09T22:37:18.788971] [DEBUG] [LOCAL ] DFP: Derivative data saved (1807 records). [2025-10-09T22:37:18.797761] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-09T22:37:18.806162] [INFO ] [MAIN ] Derivative Progress: 496/1690 symbols completed. DFP took 1.1s. Estimated remaining: 7m 48s. Rate: 153.2 symbols/min [2025-10-09T22:37:18.806461] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:18.807288] [DEBUG] [MAIN ] DEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:18.808616] [INFO ] [MAIN ] DEO: Generated 1807 derivative records from 49498 primary records. [2025-10-09T22:37:18.810576] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-09T22:37:18.837144] [DEBUG] [MAIN ] DELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:18.839784] [INFO ] [MAIN ] DELL: Generated 1807 derivative records from 54126 primary records. [2025-10-09T22:37:18.840384] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-09T22:37:18.860235] [DEBUG] [LOCAL ] DEO: Derivative data saved (1807 records). [2025-10-09T22:37:18.864395] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-09T22:37:18.866394] [INFO ] [MAIN ] Derivative Progress: 497/1690 symbols completed. DEO took 1.2s. Estimated remaining: 7m 46s. Rate: 153.5 symbols/min [2025-10-09T22:37:18.867012] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:18.872182] [DEBUG] [LOCAL ] DELL: Derivative data saved (1807 records). [2025-10-09T22:37:18.872273] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-09T22:37:18.876312] [INFO ] [MAIN ] Derivative Progress: 498/1690 symbols completed. DELL took 1.2s. Estimated remaining: 7m 45s. Rate: 153.8 symbols/min [2025-10-09T22:37:18.876636] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:18.907800] [DEBUG] [LOCAL ] DHF: Loaded 21395 existing records from primary storage. [2025-10-09T22:37:18.908889] [INFO ] [MAIN ] DHF: Loaded 21395 primary data records. [2025-10-09T22:37:19.020419] [DEBUG] [LOCAL ] DG: Loaded 53670 existing records from primary storage. [2025-10-09T22:37:19.020700] [INFO ] [MAIN ] DG: Loaded 53670 primary data records. [2025-10-09T22:37:19.229405] [DEBUG] [LOCAL ] DHR: Loaded 53763 existing records from primary storage. [2025-10-09T22:37:19.262078] [INFO ] [MAIN ] DHR: Loaded 53763 primary data records. [2025-10-09T22:37:19.915594] [DEBUG] [MAIN ] DHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:19.916549] [INFO ] [MAIN ] DHF: Generated 1807 derivative records from 21395 primary records. [2025-10-09T22:37:19.917106] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-09T22:37:19.930529] [DEBUG] [MAIN ] DG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:19.938681] [INFO ] [MAIN ] DG: Generated 1807 derivative records from 53670 primary records. [2025-10-09T22:37:19.940820] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-09T22:37:19.956468] [DEBUG] [LOCAL ] DHF: Derivative data saved (1807 records). [2025-10-09T22:37:19.957539] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-09T22:37:19.962358] [INFO ] [MAIN ] Derivative Progress: 499/1690 symbols completed. DHF took 1.1s. Estimated remaining: 7m 46s. Rate: 153.2 symbols/min [2025-10-09T22:37:19.962765] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:19.971889] [DEBUG] [LOCAL ] DG: Derivative data saved (1807 records). [2025-10-09T22:37:19.972079] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-09T22:37:19.975811] [INFO ] [MAIN ] Derivative Progress: 500/1690 symbols completed. DG took 1.2s. Estimated remaining: 7m 45s. Rate: 153.5 symbols/min [2025-10-09T22:37:19.976071] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:19.989409] [DEBUG] [MAIN ] DHR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:37:19.990052] [INFO ] [MAIN ] DHR: Generated 1806 derivative records from 53763 primary records. [2025-10-09T22:37:19.990166] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-09T22:37:20.011243] [DEBUG] [LOCAL ] DHR: Derivative data saved (1806 records). [2025-10-09T22:37:20.011436] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-09T22:37:20.015066] [INFO ] [MAIN ] Derivative Progress: 501/1690 symbols completed. DHR took 1.1s. Estimated remaining: 7m 44s. Rate: 153.8 symbols/min [2025-10-09T22:37:20.015412] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:20.031334] [DEBUG] [LOCAL ] DHX: Loaded 13158 existing records from primary storage. [2025-10-09T22:37:20.031505] [INFO ] [MAIN ] DHX: Loaded 13158 primary data records. [2025-10-09T22:37:20.145169] [DEBUG] [LOCAL ] DIAX: Loaded 13228 existing records from primary storage. [2025-10-09T22:37:20.159845] [INFO ] [MAIN ] DIAX: Loaded 13228 primary data records. [2025-10-09T22:37:20.203176] [DEBUG] [LOCAL ] DHT: Loaded 48239 existing records from primary storage. [2025-10-09T22:37:20.242711] [INFO ] [MAIN ] DHT: Loaded 48239 primary data records. [2025-10-09T22:37:21.077530] [DEBUG] [MAIN ] DHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:21.079006] [INFO ] [MAIN ] DHX: Generated 1807 derivative records from 13158 primary records. [2025-10-09T22:37:21.079252] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-09T22:37:21.112613] [DEBUG] [MAIN ] DHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:21.113889] [INFO ] [MAIN ] DHT: Generated 1807 derivative records from 48239 primary records. [2025-10-09T22:37:21.114818] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-09T22:37:21.122132] [DEBUG] [LOCAL ] DHX: Derivative data saved (1807 records). [2025-10-09T22:37:21.138525] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-09T22:37:21.141542] [INFO ] [MAIN ] Derivative Progress: 502/1690 symbols completed. DHX took 1.2s. Estimated remaining: 7m 45s. Rate: 153.2 symbols/min [2025-10-09T22:37:21.141763] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:21.146867] [DEBUG] [MAIN ] DIAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:21.148252] [INFO ] [MAIN ] DIAX: Generated 1807 derivative records from 13228 primary records. [2025-10-09T22:37:21.148983] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-09T22:37:21.164892] [DEBUG] [LOCAL ] DHT: Derivative data saved (1807 records). [2025-10-09T22:37:21.165008] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-09T22:37:21.168870] [INFO ] [MAIN ] Derivative Progress: 503/1690 symbols completed. DHT took 1.2s. Estimated remaining: 7m 44s. Rate: 153.5 symbols/min [2025-10-09T22:37:21.169594] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:21.177049] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1807 records). [2025-10-09T22:37:21.177323] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-09T22:37:21.181457] [INFO ] [MAIN ] Derivative Progress: 504/1690 symbols completed. DIAX took 1.2s. Estimated remaining: 7m 43s. Rate: 153.8 symbols/min [2025-10-09T22:37:21.181925] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:21.243606] [DEBUG] [LOCAL ] DINO: Loaded 53271 existing records from primary storage. [2025-10-09T22:37:21.244502] [INFO ] [MAIN ] DINO: Loaded 53271 primary data records. [2025-10-09T22:37:21.307767] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-10-09T22:37:21.334673] [INFO ] [MAIN ] DIS: Loaded 54178 primary data records. [2025-10-09T22:37:21.582374] [DEBUG] [LOCAL ] DK: Loaded 49695 existing records from primary storage. [2025-10-09T22:37:21.744177] [INFO ] [MAIN ] DK: Loaded 49695 primary data records. [2025-10-09T22:37:22.296555] [DEBUG] [MAIN ] DINO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:22.302538] [DEBUG] [MAIN ] DIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:22.303284] [INFO ] [MAIN ] DIS: Generated 1807 derivative records from 54178 primary records. [2025-10-09T22:37:22.302394] [INFO ] [MAIN ] DINO: Generated 1807 derivative records from 53271 primary records. [2025-10-09T22:37:22.303779] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-09T22:37:22.303620] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-09T22:37:22.343053] [DEBUG] [LOCAL ] DIS: Derivative data saved (1807 records). [2025-10-09T22:37:22.343627] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-09T22:37:22.348223] [INFO ] [MAIN ] Derivative Progress: 505/1690 symbols completed. DIS took 1.2s. Estimated remaining: 7m 44s. Rate: 153.2 symbols/min [2025-10-09T22:37:22.348575] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:22.349734] [DEBUG] [LOCAL ] DINO: Derivative data saved (1807 records). [2025-10-09T22:37:22.350736] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-09T22:37:22.353505] [INFO ] [MAIN ] Derivative Progress: 506/1690 symbols completed. DINO took 1.2s. Estimated remaining: 7m 43s. Rate: 153.5 symbols/min [2025-10-09T22:37:22.354048] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:22.378898] [DEBUG] [MAIN ] DK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:22.386325] [INFO ] [MAIN ] DK: Generated 1807 derivative records from 49695 primary records. [2025-10-09T22:37:22.386887] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-09T22:37:22.386665] [DEBUG] [LOCAL ] DKL: Loaded 18052 existing records from primary storage. [2025-10-09T22:37:22.387002] [INFO ] [MAIN ] DKL: Loaded 18052 primary data records. [2025-10-09T22:37:22.594498] [DEBUG] [LOCAL ] DK: Derivative data saved (1807 records). [2025-10-09T22:37:22.730745] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-09T22:37:22.736936] [INFO ] [MAIN ] Derivative Progress: 507/1690 symbols completed. DK took 1.6s. Estimated remaining: 7m 42s. Rate: 153.5 symbols/min [2025-10-09T22:37:22.750739] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:22.751891] [DEBUG] [LOCAL ] DKS: Loaded 50059 existing records from primary storage. [2025-10-09T22:37:22.752558] [INFO ] [MAIN ] DKS: Loaded 50059 primary data records. [2025-10-09T22:37:23.081431] [DEBUG] [LOCAL ] DLB: Loaded 32314 existing records from primary storage. [2025-10-09T22:37:23.082497] [INFO ] [MAIN ] DLB: Loaded 32314 primary data records. [2025-10-09T22:37:23.248523] [DEBUG] [MAIN ] DKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:23.285929] [INFO ] [MAIN ] DKL: Generated 1807 derivative records from 18052 primary records. [2025-10-09T22:37:23.341857] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-09T22:37:23.431390] [DEBUG] [LOCAL ] DKL: Derivative data saved (1807 records). [2025-10-09T22:37:23.431823] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-09T22:37:23.434352] [INFO ] [MAIN ] Derivative Progress: 508/1690 symbols completed. DKL took 1.1s. Estimated remaining: 7m 43s. Rate: 153.3 symbols/min [2025-10-09T22:37:23.452313] [DEBUG] [MAIN ] DKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:23.453275] [INFO ] [MAIN ] DKS: Generated 1807 derivative records from 50059 primary records. [2025-10-09T22:37:23.453478] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-09T22:37:23.473693] [DEBUG] [LOCAL ] DKS: Derivative data saved (1807 records). [2025-10-09T22:37:23.473844] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-09T22:37:23.477327] [INFO ] [MAIN ] Derivative Progress: 509/1690 symbols completed. DKS took 1.1s. Estimated remaining: 7m 42s. Rate: 153.5 symbols/min [2025-10-09T22:37:23.489906] [DEBUG] [MAIN ] DLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:23.490455] [INFO ] [MAIN ] DLB: Generated 1807 derivative records from 32314 primary records. [2025-10-09T22:37:23.490514] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-09T22:37:23.505776] [DEBUG] [LOCAL ] DLB: Derivative data saved (1807 records). [2025-10-09T22:37:23.505865] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-09T22:37:23.509357] [INFO ] [MAIN ] Derivative Progress: 510/1690 symbols completed. DLB took 0.8s. Estimated remaining: 7m 40s. Rate: 153.8 symbols/min [2025-10-09T22:37:23.509763] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:23.509818] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:23.510025] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:23.541812] [DEBUG] [LOCAL ] DLY: Loaded 20448 existing records from primary storage. [2025-10-09T22:37:23.541940] [INFO ] [MAIN ] DLY: Loaded 20448 primary data records. [2025-10-09T22:37:23.654819] [DEBUG] [LOCAL ] DLX: Loaded 28604 existing records from primary storage. [2025-10-09T22:37:23.667723] [INFO ] [MAIN ] DLX: Loaded 28604 primary data records. [2025-10-09T22:37:23.995785] [DEBUG] [LOCAL ] DLR: Loaded 51205 existing records from primary storage. [2025-10-09T22:37:23.999352] [INFO ] [MAIN ] DLR: Loaded 51205 primary data records. [2025-10-09T22:37:24.618444] [DEBUG] [MAIN ] DLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:24.619826] [INFO ] [MAIN ] DLY: Generated 1807 derivative records from 20448 primary records. [2025-10-09T22:37:24.620810] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-09T22:37:24.654237] [DEBUG] [MAIN ] DLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:24.656232] [INFO ] [MAIN ] DLX: Generated 1807 derivative records from 28604 primary records. [2025-10-09T22:37:24.656382] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-09T22:37:24.682551] [DEBUG] [LOCAL ] DLX: Derivative data saved (1807 records). [2025-10-09T22:37:24.681324] [DEBUG] [LOCAL ] DLY: Derivative data saved (1807 records). [2025-10-09T22:37:24.682856] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-09T22:37:24.682789] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-09T22:37:24.686545] [INFO ] [MAIN ] Derivative Progress: 511/1690 symbols completed. DLX took 1.2s. Estimated remaining: 7m 42s. Rate: 153.2 symbols/min [2025-10-09T22:37:24.689911] [INFO ] [MAIN ] Derivative Progress: 512/1690 symbols completed. DLY took 1.2s. Estimated remaining: 7m 40s. Rate: 153.5 symbols/min [2025-10-09T22:37:24.690038] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:24.689816] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:24.708588] [DEBUG] [MAIN ] DLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:24.712187] [INFO ] [MAIN ] DLR: Generated 1807 derivative records from 51205 primary records. [2025-10-09T22:37:24.712403] [DEBUG] [LOCAL ] DMA: Loaded 4708 existing records from primary storage. [2025-10-09T22:37:24.712562] [INFO ] [MAIN ] DMA: Loaded 4708 primary data records. [2025-10-09T22:37:24.712671] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-09T22:37:24.795854] [DEBUG] [LOCAL ] DMB: Loaded 10302 existing records from primary storage. [2025-10-09T22:37:24.825245] [INFO ] [MAIN ] DMB: Loaded 10302 primary data records. [2025-10-09T22:37:24.858970] [DEBUG] [LOCAL ] DLR: Derivative data saved (1807 records). [2025-10-09T22:37:24.921568] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-09T22:37:24.949915] [INFO ] [MAIN ] Derivative Progress: 513/1690 symbols completed. DLR took 1.4s. Estimated remaining: 7m 40s. Rate: 153.6 symbols/min [2025-10-09T22:37:24.966189] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:25.188060] [DEBUG] [LOCAL ] DMO: Loaded 10036 existing records from primary storage. [2025-10-09T22:37:25.240424] [INFO ] [MAIN ] DMO: Loaded 10036 primary data records. [2025-10-09T22:37:25.689376] [DEBUG] [MAIN ] DMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:25.690371] [INFO ] [MAIN ] DMA: Generated 1807 derivative records from 4708 primary records. [2025-10-09T22:37:25.690706] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-09T22:37:25.708626] [DEBUG] [LOCAL ] DMA: Derivative data saved (1807 records). [2025-10-09T22:37:25.709350] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-09T22:37:25.712050] [INFO ] [MAIN ] Derivative Progress: 514/1690 symbols completed. DMA took 1.0s. Estimated remaining: 7m 40s. Rate: 153.3 symbols/min [2025-10-09T22:37:25.713157] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:25.728735] [DEBUG] [MAIN ] DMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:25.729568] [INFO ] [MAIN ] DMB: Generated 1807 derivative records from 10302 primary records. [2025-10-09T22:37:25.729686] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-09T22:37:25.747207] [DEBUG] [LOCAL ] DMB: Derivative data saved (1807 records). [2025-10-09T22:37:25.748470] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-09T22:37:25.758016] [INFO ] [MAIN ] Derivative Progress: 515/1690 symbols completed. DMB took 1.1s. Estimated remaining: 7m 39s. Rate: 153.6 symbols/min [2025-10-09T22:37:25.758386] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:25.772287] [DEBUG] [MAIN ] DMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:25.773027] [INFO ] [MAIN ] DMO: Generated 1807 derivative records from 10036 primary records. [2025-10-09T22:37:25.773194] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-09T22:37:25.799398] [DEBUG] [LOCAL ] DMO: Derivative data saved (1807 records). [2025-10-09T22:37:25.799622] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-09T22:37:25.803431] [INFO ] [MAIN ] Derivative Progress: 516/1690 symbols completed. DMO took 0.8s. Estimated remaining: 7m 38s. Rate: 153.8 symbols/min [2025-10-09T22:37:25.803773] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:25.826313] [DEBUG] [LOCAL ] DNA: Loaded 48858 existing records from primary storage. [2025-10-09T22:37:25.826659] [INFO ] [MAIN ] DNA: Loaded 48858 primary data records. [2025-10-09T22:37:26.054913] [DEBUG] [LOCAL ] DNOW: Loaded 43943 existing records from primary storage. [2025-10-09T22:37:26.164177] [INFO ] [MAIN ] DNOW: Loaded 43943 primary data records. [2025-10-09T22:37:26.190945] [DEBUG] [LOCAL ] DNP: Loaded 33468 existing records from primary storage. [2025-10-09T22:37:26.211465] [INFO ] [MAIN ] DNP: Loaded 33468 primary data records. [2025-10-09T22:37:26.892446] [DEBUG] [MAIN ] DNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:26.894759] [INFO ] [MAIN ] DNA: Generated 1807 derivative records from 48858 primary records. [2025-10-09T22:37:26.895574] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-09T22:37:26.918438] [DEBUG] [LOCAL ] DNA: Derivative data saved (1807 records). [2025-10-09T22:37:26.919441] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-09T22:37:26.922309] [INFO ] [MAIN ] Derivative Progress: 517/1690 symbols completed. DNA took 1.2s. Estimated remaining: 7m 39s. Rate: 153.3 symbols/min [2025-10-09T22:37:26.922894] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:26.951902] [DEBUG] [MAIN ] DNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:26.970668] [INFO ] [MAIN ] DNP: Generated 1807 derivative records from 33468 primary records. [2025-10-09T22:37:26.971332] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-09T22:37:26.971592] [DEBUG] [MAIN ] DNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:26.973372] [INFO ] [MAIN ] DNOW: Generated 1807 derivative records from 43943 primary records. [2025-10-09T22:37:26.973921] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-09T22:37:27.028420] [DEBUG] [LOCAL ] DNP: Derivative data saved (1807 records). [2025-10-09T22:37:27.029481] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-09T22:37:27.034143] [INFO ] [MAIN ] Derivative Progress: 518/1690 symbols completed. DNP took 1.2s. Estimated remaining: 7m 38s. Rate: 153.5 symbols/min [2025-10-09T22:37:27.035200] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:27.036707] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1807 records). [2025-10-09T22:37:27.037784] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-09T22:37:27.041753] [INFO ] [MAIN ] Derivative Progress: 519/1690 symbols completed. DNOW took 1.3s. Estimated remaining: 7m 37s. Rate: 153.8 symbols/min [2025-10-09T22:37:27.059108] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:27.061267] [DEBUG] [LOCAL ] DOC: Loaded 53937 existing records from primary storage. [2025-10-09T22:37:27.061634] [INFO ] [MAIN ] DOC: Loaded 53937 primary data records. [2025-10-09T22:37:27.424340] [DEBUG] [LOCAL ] DOCN: Loaded 51170 existing records from primary storage. [2025-10-09T22:37:27.426667] [INFO ] [MAIN ] DOCN: Loaded 51170 primary data records. [2025-10-09T22:37:27.496976] [DEBUG] [LOCAL ] DOCS: Loaded 51323 existing records from primary storage. [2025-10-09T22:37:27.559436] [INFO ] [MAIN ] DOCS: Loaded 51323 primary data records. [2025-10-09T22:37:27.989864] [DEBUG] [MAIN ] DOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:28.114833] [INFO ] [MAIN ] DOC: Generated 1807 derivative records from 53937 primary records. [2025-10-09T22:37:28.115271] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-09T22:37:28.142060] [DEBUG] [LOCAL ] DOC: Derivative data saved (1807 records). [2025-10-09T22:37:28.142515] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-09T22:37:28.145811] [INFO ] [MAIN ] Derivative Progress: 520/1690 symbols completed. DOC took 1.2s. Estimated remaining: 7m 38s. Rate: 153.2 symbols/min [2025-10-09T22:37:28.146268] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:28.160720] [DEBUG] [MAIN ] DOCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:28.161832] [INFO ] [MAIN ] DOCN: Generated 1807 derivative records from 51170 primary records. [2025-10-09T22:37:28.162060] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-09T22:37:28.181576] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1807 records). [2025-10-09T22:37:28.181700] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-09T22:37:28.184085] [INFO ] [MAIN ] Derivative Progress: 521/1690 symbols completed. DOCN took 1.1s. Estimated remaining: 7m 37s. Rate: 153.5 symbols/min [2025-10-09T22:37:28.196469] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:28.197358] [DEBUG] [MAIN ] DOCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:28.198470] [INFO ] [MAIN ] DOCS: Generated 1807 derivative records from 51323 primary records. [2025-10-09T22:37:28.198542] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-09T22:37:28.215113] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1807 records). [2025-10-09T22:37:28.215256] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-09T22:37:28.219163] [INFO ] [MAIN ] Derivative Progress: 522/1690 symbols completed. DOCS took 1.2s. Estimated remaining: 7m 36s. Rate: 153.8 symbols/min [2025-10-09T22:37:28.219576] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:28.261960] [DEBUG] [LOCAL ] DOLE: Loaded 39185 existing records from primary storage. [2025-10-09T22:37:28.262249] [INFO ] [MAIN ] DOLE: Loaded 39185 primary data records. [2025-10-09T22:37:28.342576] [DEBUG] [LOCAL ] DOUG: Loaded 34675 existing records from primary storage. [2025-10-09T22:37:28.366066] [INFO ] [MAIN ] DOUG: Loaded 34675 primary data records. [2025-10-09T22:37:28.577276] [DEBUG] [LOCAL ] DOV: Loaded 45846 existing records from primary storage. [2025-10-09T22:37:28.667168] [INFO ] [MAIN ] DOV: Loaded 45846 primary data records. [2025-10-09T22:37:29.297925] [DEBUG] [MAIN ] DOUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:29.299798] [INFO ] [MAIN ] DOUG: Generated 1807 derivative records from 34675 primary records. [2025-10-09T22:37:29.298584] [DEBUG] [MAIN ] DOLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:29.299951] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-09T22:37:29.300811] [INFO ] [MAIN ] DOLE: Generated 1807 derivative records from 39185 primary records. [2025-10-09T22:37:29.303255] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-09T22:37:29.344848] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1807 records). [2025-10-09T22:37:29.346418] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-09T22:37:29.349277] [INFO ] [MAIN ] Derivative Progress: 523/1690 symbols completed. DOLE took 1.2s. Estimated remaining: 7m 37s. Rate: 153.2 symbols/min [2025-10-09T22:37:29.351023] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1807 records). [2025-10-09T22:37:29.363990] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-09T22:37:29.367412] [INFO ] [MAIN ] Derivative Progress: 524/1690 symbols completed. DOUG took 1.2s. Estimated remaining: 7m 36s. Rate: 153.5 symbols/min [2025-10-09T22:37:29.363911] [DEBUG] [MAIN ] DOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:29.368290] [INFO ] [MAIN ] DOV: Generated 1807 derivative records from 45846 primary records. [2025-10-09T22:37:29.368376] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-09T22:37:29.384080] [DEBUG] [LOCAL ] DOV: Derivative data saved (1807 records). [2025-10-09T22:37:29.384150] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-09T22:37:29.388149] [INFO ] [MAIN ] Derivative Progress: 525/1690 symbols completed. DOV took 1.2s. Estimated remaining: 7m 35s. Rate: 153.8 symbols/min [2025-10-09T22:37:29.388703] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:29.388854] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:29.389464] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:29.407220] [DEBUG] [LOCAL ] DPG: Loaded 13621 existing records from primary storage. [2025-10-09T22:37:29.407362] [INFO ] [MAIN ] DPG: Loaded 13621 primary data records. [2025-10-09T22:37:29.627838] [DEBUG] [LOCAL ] DQ: Loaded 43865 existing records from primary storage. [2025-10-09T22:37:29.750246] [INFO ] [MAIN ] DQ: Loaded 43865 primary data records. [2025-10-09T22:37:29.838983] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-09T22:37:29.856039] [INFO ] [MAIN ] DOW: Loaded 54123 primary data records. [2025-10-09T22:37:30.472046] [DEBUG] [MAIN ] DPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:30.474040] [INFO ] [MAIN ] DPG: Generated 1807 derivative records from 13621 primary records. [2025-10-09T22:37:30.474463] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-09T22:37:30.492462] [DEBUG] [LOCAL ] DPG: Derivative data saved (1807 records). [2025-10-09T22:37:30.493022] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-09T22:37:30.496039] [INFO ] [MAIN ] Derivative Progress: 526/1690 symbols completed. DPG took 1.1s. Estimated remaining: 7m 36s. Rate: 153.2 symbols/min [2025-10-09T22:37:30.496357] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:30.529064] [DEBUG] [MAIN ] DQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:30.530338] [INFO ] [MAIN ] DQ: Generated 1807 derivative records from 43865 primary records. [2025-10-09T22:37:30.530708] [DEBUG] [MAIN ] DOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:30.531709] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-09T22:37:30.531618] [INFO ] [MAIN ] DOW: Generated 1807 derivative records from 54123 primary records. [2025-10-09T22:37:30.532857] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-09T22:37:30.573989] [DEBUG] [LOCAL ] DQ: Derivative data saved (1807 records). [2025-10-09T22:37:30.574352] [DEBUG] [LOCAL ] DOW: Derivative data saved (1807 records). [2025-10-09T22:37:30.574535] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-09T22:37:30.588791] [INFO ] [MAIN ] Derivative Progress: 527/1690 symbols completed. DOW took 1.2s. Estimated remaining: 7m 35s. Rate: 153.5 symbols/min [2025-10-09T22:37:30.589976] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-09T22:37:30.590170] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:30.592835] [INFO ] [MAIN ] Derivative Progress: 528/1690 symbols completed. DQ took 1.2s. Estimated remaining: 7m 33s. Rate: 153.8 symbols/min [2025-10-09T22:37:30.594026] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:30.593553] [DEBUG] [LOCAL ] DRD: Loaded 37578 existing records from primary storage. [2025-10-09T22:37:30.594679] [INFO ] [MAIN ] DRD: Loaded 37578 primary data records. [2025-10-09T22:37:30.719942] [DEBUG] [LOCAL ] DRLL: Loaded 9351 existing records from primary storage. [2025-10-09T22:37:30.730428] [INFO ] [MAIN ] DRLL: Loaded 9351 primary data records. [2025-10-09T22:37:31.245414] [DEBUG] [LOCAL ] DRH: Loaded 50811 existing records from primary storage. [2025-10-09T22:37:31.246565] [INFO ] [MAIN ] DRH: Loaded 50811 primary data records. [2025-10-09T22:37:31.586376] [DEBUG] [MAIN ] DRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:31.591219] [INFO ] [MAIN ] DRD: Generated 1807 derivative records from 37578 primary records. [2025-10-09T22:37:31.591856] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-09T22:37:31.624091] [DEBUG] [MAIN ] DRLL: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:37:31.626365] [INFO ] [MAIN ] DRLL: Generated 1806 derivative records from 9351 primary records. [2025-10-09T22:37:31.626465] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-09T22:37:31.631162] [DEBUG] [LOCAL ] DRD: Derivative data saved (1807 records). [2025-10-09T22:37:31.632369] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-09T22:37:31.642077] [INFO ] [MAIN ] Derivative Progress: 529/1690 symbols completed. DRD took 1.1s. Estimated remaining: 7m 35s. Rate: 153.3 symbols/min [2025-10-09T22:37:31.647154] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:31.654079] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1806 records). [2025-10-09T22:37:31.654311] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-09T22:37:31.657727] [INFO ] [MAIN ] Derivative Progress: 530/1690 symbols completed. DRLL took 1.1s. Estimated remaining: 7m 33s. Rate: 153.5 symbols/min [2025-10-09T22:37:31.657992] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:31.676809] [DEBUG] [MAIN ] DRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:31.677613] [INFO ] [MAIN ] DRH: Generated 1807 derivative records from 50811 primary records. [2025-10-09T22:37:31.682065] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-09T22:37:31.707819] [DEBUG] [LOCAL ] DSM: Loaded 14667 existing records from primary storage. [2025-10-09T22:37:31.708698] [INFO ] [MAIN ] DSM: Loaded 14667 primary data records. [2025-10-09T22:37:31.753235] [DEBUG] [LOCAL ] DSL: Loaded 28765 existing records from primary storage. [2025-10-09T22:37:31.766964] [INFO ] [MAIN ] DSL: Loaded 28765 primary data records. [2025-10-09T22:37:31.856203] [DEBUG] [LOCAL ] DRH: Derivative data saved (1807 records). [2025-10-09T22:37:31.878933] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-09T22:37:31.917516] [INFO ] [MAIN ] Derivative Progress: 531/1690 symbols completed. DRH took 1.3s. Estimated remaining: 7m 33s. Rate: 153.6 symbols/min [2025-10-09T22:37:31.951013] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:32.090169] [DEBUG] [LOCAL ] DSMC: Loaded 1848 existing records from primary storage. [2025-10-09T22:37:32.344919] [INFO ] [MAIN ] DSMC: Loaded 1848 primary data records. [2025-10-09T22:37:32.773954] [DEBUG] [MAIN ] DSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:32.773698] [DEBUG] [MAIN ] DSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:32.775123] [INFO ] [MAIN ] DSM: Generated 1807 derivative records from 14667 primary records. [2025-10-09T22:37:32.775928] [INFO ] [MAIN ] DSL: Generated 1807 derivative records from 28765 primary records. [2025-10-09T22:37:32.776038] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-09T22:37:32.776907] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-09T22:37:32.804038] [DEBUG] [LOCAL ] DSM: Derivative data saved (1807 records). [2025-10-09T22:37:32.811105] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-09T22:37:32.813445] [INFO ] [MAIN ] Derivative Progress: 532/1690 symbols completed. DSM took 1.2s. Estimated remaining: 7m 33s. Rate: 153.3 symbols/min [2025-10-09T22:37:32.810832] [DEBUG] [LOCAL ] DSL: Derivative data saved (1807 records). [2025-10-09T22:37:32.813703] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-09T22:37:32.816964] [INFO ] [MAIN ] Derivative Progress: 533/1690 symbols completed. DSL took 1.2s. Estimated remaining: 7m 32s. Rate: 153.6 symbols/min [2025-10-09T22:37:32.817448] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:32.816805] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:32.835418] [DEBUG] [MAIN ] DSMC: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-09T22:37:32.836205] [INFO ] [MAIN ] DSMC: Generated 1804 derivative records from 1848 primary records. [2025-10-09T22:37:32.836284] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-09T22:37:32.861813] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1804 records). [2025-10-09T22:37:32.862095] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-09T22:37:32.866234] [INFO ] [MAIN ] Derivative Progress: 534/1690 symbols completed. DSMC took 0.9s. Estimated remaining: 7m 31s. Rate: 153.8 symbols/min [2025-10-09T22:37:32.866443] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:32.886601] [DEBUG] [LOCAL ] DSU: Loaded 23027 existing records from primary storage. [2025-10-09T22:37:32.886834] [INFO ] [MAIN ] DSU: Loaded 23027 primary data records. [2025-10-09T22:37:32.887518] [DEBUG] [LOCAL ] DSX: Loaded 24199 existing records from primary storage. [2025-10-09T22:37:32.913829] [INFO ] [MAIN ] DSX: Loaded 24199 primary data records. [2025-10-09T22:37:33.552826] [DEBUG] [LOCAL ] DT: Loaded 53326 existing records from primary storage. [2025-10-09T22:37:33.564865] [INFO ] [MAIN ] DT: Loaded 53326 primary data records. [2025-10-09T22:37:34.016321] [DEBUG] [MAIN ] DSU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:34.023710] [INFO ] [MAIN ] DSU: Generated 1807 derivative records from 23027 primary records. [2025-10-09T22:37:34.024460] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-09T22:37:34.043136] [DEBUG] [MAIN ] DSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:34.053989] [INFO ] [MAIN ] DSX: Generated 1807 derivative records from 24199 primary records. [2025-10-09T22:37:34.056606] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-09T22:37:34.071823] [DEBUG] [LOCAL ] DSU: Derivative data saved (1807 records). [2025-10-09T22:37:34.072559] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-09T22:37:34.090762] [INFO ] [MAIN ] Derivative Progress: 535/1690 symbols completed. DSU took 1.3s. Estimated remaining: 7m 32s. Rate: 153.2 symbols/min [2025-10-09T22:37:34.091561] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:34.099403] [DEBUG] [LOCAL ] DSX: Derivative data saved (1807 records). [2025-10-09T22:37:34.100163] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-09T22:37:34.104118] [INFO ] [MAIN ] Derivative Progress: 536/1690 symbols completed. DSX took 1.3s. Estimated remaining: 7m 31s. Rate: 153.5 symbols/min [2025-10-09T22:37:34.105003] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:34.116810] [DEBUG] [LOCAL ] DTB: Loaded 5053 existing records from primary storage. [2025-10-09T22:37:34.118901] [INFO ] [MAIN ] DTB: Loaded 5053 primary data records. [2025-10-09T22:37:34.201127] [DEBUG] [LOCAL ] DTG: Loaded 5881 existing records from primary storage. [2025-10-09T22:37:34.245820] [DEBUG] [MAIN ] DT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:34.246081] [INFO ] [MAIN ] DTG: Loaded 5881 primary data records. [2025-10-09T22:37:34.269475] [INFO ] [MAIN ] DT: Generated 1807 derivative records from 53326 primary records. [2025-10-09T22:37:34.314588] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-09T22:37:34.676222] [DEBUG] [LOCAL ] DT: Derivative data saved (1807 records). [2025-10-09T22:37:35.007196] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-09T22:37:35.010292] [INFO ] [MAIN ] Derivative Progress: 537/1690 symbols completed. DT took 2.1s. Estimated remaining: 7m 32s. Rate: 153.1 symbols/min [2025-10-09T22:37:35.010671] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:35.021232] [DEBUG] [LOCAL ] DTW: Loaded 4922 existing records from primary storage. [2025-10-09T22:37:35.021617] [INFO ] [MAIN ] DTW: Loaded 4922 primary data records. [2025-10-09T22:37:35.357529] [DEBUG] [MAIN ] DTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:35.358513] [INFO ] [MAIN ] DTB: Generated 1807 derivative records from 5053 primary records. [2025-10-09T22:37:35.359576] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-09T22:37:35.387988] [DEBUG] [MAIN ] DTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:35.389178] [INFO ] [MAIN ] DTG: Generated 1807 derivative records from 5881 primary records. [2025-10-09T22:37:35.390811] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-09T22:37:35.391500] [DEBUG] [LOCAL ] DTB: Derivative data saved (1807 records). [2025-10-09T22:37:35.392457] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-09T22:37:35.401957] [INFO ] [MAIN ] Derivative Progress: 538/1690 symbols completed. DTB took 1.3s. Estimated remaining: 7m 31s. Rate: 153.1 symbols/min [2025-10-09T22:37:35.412168] [DEBUG] [LOCAL ] DTG: Derivative data saved (1807 records). [2025-10-09T22:37:35.412545] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-09T22:37:35.415914] [INFO ] [MAIN ] Derivative Progress: 539/1690 symbols completed. DTG took 1.3s. Estimated remaining: 7m 30s. Rate: 153.4 symbols/min [2025-10-09T22:37:35.432184] [DEBUG] [MAIN ] DTW: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:37:35.432820] [INFO ] [MAIN ] DTW: Generated 1806 derivative records from 4922 primary records. [2025-10-09T22:37:35.432881] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-09T22:37:35.448002] [DEBUG] [LOCAL ] DTW: Derivative data saved (1806 records). [2025-10-09T22:37:35.448062] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-09T22:37:35.450881] [INFO ] [MAIN ] Derivative Progress: 540/1690 symbols completed. DTW took 0.4s. Estimated remaining: 7m 29s. Rate: 153.6 symbols/min [2025-10-09T22:37:35.451398] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:35.451497] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:35.451289] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:35.460503] [DEBUG] [LOCAL ] DUKB: Loaded 6397 existing records from primary storage. [2025-10-09T22:37:35.460701] [INFO ] [MAIN ] DUKB: Loaded 6397 primary data records. [2025-10-09T22:37:35.807591] [DEBUG] [LOCAL ] DUK: Loaded 53830 existing records from primary storage. [2025-10-09T22:37:35.821262] [INFO ] [MAIN ] DUK: Loaded 53830 primary data records. [2025-10-09T22:37:35.843142] [DEBUG] [LOCAL ] DV: Loaded 51658 existing records from primary storage. [2025-10-09T22:37:35.878249] [INFO ] [MAIN ] DV: Loaded 51658 primary data records. [2025-10-09T22:37:36.264371] [DEBUG] [MAIN ] DUKB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:37:36.445422] [INFO ] [MAIN ] DUKB: Generated 1806 derivative records from 6397 primary records. [2025-10-09T22:37:36.446530] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-09T22:37:36.466673] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1806 records). [2025-10-09T22:37:36.467969] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-09T22:37:36.471389] [INFO ] [MAIN ] Derivative Progress: 541/1690 symbols completed. DUKB took 1.0s. Estimated remaining: 7m 30s. Rate: 153.2 symbols/min [2025-10-09T22:37:36.472071] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:36.499574] [DEBUG] [MAIN ] DUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:36.501461] [INFO ] [MAIN ] DUK: Generated 1807 derivative records from 53830 primary records. [2025-10-09T22:37:36.501582] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-09T22:37:36.537240] [DEBUG] [MAIN ] DV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:36.538360] [INFO ] [MAIN ] DV: Generated 1807 derivative records from 51658 primary records. [2025-10-09T22:37:36.538986] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-09T22:37:36.561692] [DEBUG] [LOCAL ] DUK: Derivative data saved (1807 records). [2025-10-09T22:37:36.562271] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-09T22:37:36.562603] [DEBUG] [LOCAL ] DV: Derivative data saved (1807 records). [2025-10-09T22:37:36.576974] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-09T22:37:36.576634] [INFO ] [MAIN ] Derivative Progress: 542/1690 symbols completed. DUK took 1.1s. Estimated remaining: 7m 29s. Rate: 153.4 symbols/min [2025-10-09T22:37:36.580752] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:36.581994] [DEBUG] [LOCAL ] DVA: Loaded 41299 existing records from primary storage. [2025-10-09T22:37:36.581006] [INFO ] [MAIN ] Derivative Progress: 543/1690 symbols completed. DV took 1.1s. Estimated remaining: 7m 28s. Rate: 153.7 symbols/min [2025-10-09T22:37:36.582371] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:36.582503] [INFO ] [MAIN ] DVA: Loaded 41299 primary data records. [2025-10-09T22:37:36.979770] [DEBUG] [LOCAL ] DX: Loaded 52858 existing records from primary storage. [2025-10-09T22:37:36.980411] [INFO ] [MAIN ] DX: Loaded 52858 primary data records. [2025-10-09T22:37:37.072435] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-09T22:37:37.096229] [INFO ] [MAIN ] DVN: Loaded 54089 primary data records. [2025-10-09T22:37:37.402081] [DEBUG] [MAIN ] DVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:37.417791] [INFO ] [MAIN ] DVA: Generated 1807 derivative records from 41299 primary records. [2025-10-09T22:37:37.434428] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-09T22:37:37.664947] [DEBUG] [LOCAL ] DVA: Derivative data saved (1807 records). [2025-10-09T22:37:37.666018] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-09T22:37:37.668675] [INFO ] [MAIN ] Derivative Progress: 544/1690 symbols completed. DVA took 1.2s. Estimated remaining: 7m 29s. Rate: 153.2 symbols/min [2025-10-09T22:37:37.669397] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:37.691886] [DEBUG] [MAIN ] DX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:37.692578] [INFO ] [MAIN ] DX: Generated 1807 derivative records from 52858 primary records. [2025-10-09T22:37:37.692763] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-09T22:37:37.724205] [DEBUG] [LOCAL ] DX: Derivative data saved (1807 records). [2025-10-09T22:37:37.724433] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-09T22:37:37.726699] [INFO ] [MAIN ] Derivative Progress: 545/1690 symbols completed. DX took 1.1s. Estimated remaining: 7m 28s. Rate: 153.4 symbols/min [2025-10-09T22:37:37.727107] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:37.745416] [DEBUG] [MAIN ] DVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:37.746554] [INFO ] [MAIN ] DVN: Generated 1807 derivative records from 54089 primary records. [2025-10-09T22:37:37.757368] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-09T22:37:37.758995] [DEBUG] [LOCAL ] DXYZ: Loaded 37365 existing records from primary storage. [2025-10-09T22:37:37.759517] [INFO ] [MAIN ] DXYZ: Loaded 37365 primary data records. [2025-10-09T22:37:37.896838] [DEBUG] [LOCAL ] DVN: Derivative data saved (1807 records). [2025-10-09T22:37:37.903377] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-09T22:37:37.906990] [INFO ] [MAIN ] Derivative Progress: 546/1690 symbols completed. DVN took 1.3s. Estimated remaining: 7m 27s. Rate: 153.5 symbols/min [2025-10-09T22:37:37.918244] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:37.912979] [DEBUG] [LOCAL ] DY: Loaded 28668 existing records from primary storage. [2025-10-09T22:37:37.943887] [INFO ] [MAIN ] DY: Loaded 28668 primary data records. [2025-10-09T22:37:38.418085] [DEBUG] [LOCAL ] E: Loaded 33374 existing records from primary storage. [2025-10-09T22:37:38.418826] [INFO ] [MAIN ] E: Loaded 33374 primary data records. [2025-10-09T22:37:38.749056] [DEBUG] [MAIN ] DXYZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:38.750850] [INFO ] [MAIN ] DXYZ: Generated 1807 derivative records from 37365 primary records. [2025-10-09T22:37:38.751188] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-09T22:37:38.773433] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1807 records). [2025-10-09T22:37:38.775336] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-09T22:37:38.777523] [INFO ] [MAIN ] Derivative Progress: 547/1690 symbols completed. DXYZ took 1.1s. Estimated remaining: 7m 28s. Rate: 153.2 symbols/min [2025-10-09T22:37:38.778056] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:38.795548] [DEBUG] [MAIN ] DY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:38.796943] [INFO ] [MAIN ] DY: Generated 1807 derivative records from 28668 primary records. [2025-10-09T22:37:38.797223] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-09T22:37:38.816495] [DEBUG] [LOCAL ] DY: Derivative data saved (1807 records). [2025-10-09T22:37:38.816822] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-09T22:37:38.820944] [INFO ] [MAIN ] Derivative Progress: 548/1690 symbols completed. DY took 1.1s. Estimated remaining: 7m 27s. Rate: 153.4 symbols/min [2025-10-09T22:37:38.824114] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:38.848215] [DEBUG] [MAIN ] E: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:38.849182] [INFO ] [MAIN ] E: Generated 1807 derivative records from 33374 primary records. [2025-10-09T22:37:38.849529] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-09T22:37:38.870829] [DEBUG] [LOCAL ] EAI: Loaded 4026 existing records from primary storage. [2025-10-09T22:37:38.883183] [INFO ] [MAIN ] EAI: Loaded 4026 primary data records. [2025-10-09T22:37:38.867612] [DEBUG] [LOCAL ] E: Derivative data saved (1807 records). [2025-10-09T22:37:38.884427] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-09T22:37:38.911671] [INFO ] [MAIN ] Derivative Progress: 549/1690 symbols completed. E took 1.0s. Estimated remaining: 7m 26s. Rate: 153.7 symbols/min [2025-10-09T22:37:38.928957] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:38.930498] [DEBUG] [LOCAL ] EAF: Loaded 42401 existing records from primary storage. [2025-10-09T22:37:38.958108] [INFO ] [MAIN ] EAF: Loaded 42401 primary data records. [2025-10-09T22:37:39.474017] [DEBUG] [LOCAL ] EARN: Loaded 29315 existing records from primary storage. [2025-10-09T22:37:39.555292] [INFO ] [MAIN ] EARN: Loaded 29315 primary data records. [2025-10-09T22:37:39.962014] [DEBUG] [MAIN ] EAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:39.976557] [DEBUG] [MAIN ] EAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:39.977614] [INFO ] [MAIN ] EAI: Generated 1807 derivative records from 4026 primary records. [2025-10-09T22:37:39.979111] [INFO ] [MAIN ] EAF: Generated 1807 derivative records from 42401 primary records. [2025-10-09T22:37:39.978254] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-09T22:37:39.979617] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-09T22:37:40.014816] [DEBUG] [LOCAL ] EAF: Derivative data saved (1807 records). [2025-10-09T22:37:40.016180] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-09T22:37:40.021727] [INFO ] [MAIN ] Derivative Progress: 550/1690 symbols completed. EAF took 1.2s. Estimated remaining: 7m 27s. Rate: 153.2 symbols/min [2025-10-09T22:37:40.023158] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:40.022960] [DEBUG] [LOCAL ] EAI: Derivative data saved (1807 records). [2025-10-09T22:37:40.024163] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-09T22:37:40.026468] [INFO ] [MAIN ] Derivative Progress: 551/1690 symbols completed. EAI took 1.2s. Estimated remaining: 7m 25s. Rate: 153.4 symbols/min [2025-10-09T22:37:40.026756] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:40.045223] [DEBUG] [MAIN ] EARN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:40.046240] [INFO ] [MAIN ] EARN: Generated 1807 derivative records from 29315 primary records. [2025-10-09T22:37:40.046342] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-09T22:37:40.063501] [DEBUG] [LOCAL ] EARN: Derivative data saved (1807 records). [2025-10-09T22:37:40.063732] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-09T22:37:40.067155] [INFO ] [MAIN ] Derivative Progress: 552/1690 symbols completed. EARN took 1.1s. Estimated remaining: 7m 24s. Rate: 153.7 symbols/min [2025-10-09T22:37:40.076635] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:40.102755] [DEBUG] [LOCAL ] EB: Loaded 37092 existing records from primary storage. [2025-10-09T22:37:40.103047] [INFO ] [MAIN ] EB: Loaded 37092 primary data records. [2025-10-09T22:37:40.230036] [DEBUG] [LOCAL ] EBF: Loaded 19184 existing records from primary storage. [2025-10-09T22:37:40.230310] [INFO ] [MAIN ] EBF: Loaded 19184 primary data records. [2025-10-09T22:37:40.262266] [DEBUG] [LOCAL ] EAT: Loaded 50205 existing records from primary storage. [2025-10-09T22:37:40.333959] [INFO ] [MAIN ] EAT: Loaded 50205 primary data records. [2025-10-09T22:37:41.148284] [DEBUG] [MAIN ] EB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:41.162993] [INFO ] [MAIN ] EB: Generated 1807 derivative records from 37092 primary records. [2025-10-09T22:37:41.163772] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-09T22:37:41.163704] [DEBUG] [MAIN ] EBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:41.173877] [INFO ] [MAIN ] EBF: Generated 1807 derivative records from 19184 primary records. [2025-10-09T22:37:41.182178] [DEBUG] [LOCAL ] EB: Derivative data saved (1807 records). [2025-10-09T22:37:41.180691] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-09T22:37:41.195866] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-09T22:37:41.207828] [INFO ] [MAIN ] Derivative Progress: 553/1690 symbols completed. EB took 1.2s. Estimated remaining: 7m 25s. Rate: 153.1 symbols/min [2025-10-09T22:37:41.212558] [DEBUG] [MAIN ] EAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:41.213423] [INFO ] [MAIN ] EAT: Generated 1807 derivative records from 50205 primary records. [2025-10-09T22:37:41.216515] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-09T22:37:41.218348] [DEBUG] [LOCAL ] EBF: Derivative data saved (1807 records). [2025-10-09T22:37:41.218912] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-09T22:37:41.221012] [INFO ] [MAIN ] Derivative Progress: 554/1690 symbols completed. EBF took 1.1s. Estimated remaining: 7m 24s. Rate: 153.4 symbols/min [2025-10-09T22:37:41.239265] [DEBUG] [LOCAL ] EAT: Derivative data saved (1807 records). [2025-10-09T22:37:41.239341] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-09T22:37:41.243093] [INFO ] [MAIN ] Derivative Progress: 555/1690 symbols completed. EAT took 1.2s. Estimated remaining: 7m 23s. Rate: 153.7 symbols/min [2025-10-09T22:37:41.243596] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:41.243685] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:41.243872] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:41.290894] [DEBUG] [LOCAL ] ECAT: Loaded 29593 existing records from primary storage. [2025-10-09T22:37:41.291254] [INFO ] [MAIN ] ECAT: Loaded 29593 primary data records. [2025-10-09T22:37:41.430346] [DEBUG] [LOCAL ] EBR: Loaded 43463 existing records from primary storage. [2025-10-09T22:37:41.435614] [INFO ] [MAIN ] EBR: Loaded 43463 primary data records. [2025-10-09T22:37:41.461406] [DEBUG] [LOCAL ] EBS: Loaded 47100 existing records from primary storage. [2025-10-09T22:37:41.529977] [INFO ] [MAIN ] EBS: Loaded 47100 primary data records. [2025-10-09T22:37:42.294560] [DEBUG] [MAIN ] ECAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:42.297064] [INFO ] [MAIN ] ECAT: Generated 1807 derivative records from 29593 primary records. [2025-10-09T22:37:42.297370] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-09T22:37:42.327085] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1807 records). [2025-10-09T22:37:42.323978] [DEBUG] [MAIN ] EBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:42.327914] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-09T22:37:42.329279] [INFO ] [MAIN ] EBR: Generated 1807 derivative records from 43463 primary records. [2025-10-09T22:37:42.331560] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-09T22:37:42.331491] [INFO ] [MAIN ] Derivative Progress: 556/1690 symbols completed. ECAT took 1.1s. Estimated remaining: 7m 24s. Rate: 153.2 symbols/min [2025-10-09T22:37:42.332466] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:42.357590] [DEBUG] [MAIN ] EBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:42.359846] [INFO ] [MAIN ] EBS: Generated 1807 derivative records from 47100 primary records. [2025-10-09T22:37:42.360941] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-09T22:37:42.362555] [DEBUG] [LOCAL ] EBR: Derivative data saved (1807 records). [2025-10-09T22:37:42.363045] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-09T22:37:42.365924] [INFO ] [MAIN ] Derivative Progress: 557/1690 symbols completed. EBR took 1.1s. Estimated remaining: 7m 23s. Rate: 153.4 symbols/min [2025-10-09T22:37:42.373479] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:42.382824] [DEBUG] [LOCAL ] EBS: Derivative data saved (1807 records). [2025-10-09T22:37:42.383096] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-09T22:37:42.386426] [INFO ] [MAIN ] Derivative Progress: 558/1690 symbols completed. EBS took 1.1s. Estimated remaining: 7m 22s. Rate: 153.7 symbols/min [2025-10-09T22:37:42.396962] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:42.400423] [DEBUG] [LOCAL ] ECCU: Loaded 2264 existing records from primary storage. [2025-10-09T22:37:42.400788] [INFO ] [MAIN ] ECCU: Loaded 2264 primary data records. [2025-10-09T22:37:42.537894] [DEBUG] [LOCAL ] ECC: Loaded 43399 existing records from primary storage. [2025-10-09T22:37:42.543540] [INFO ] [MAIN ] ECC: Loaded 43399 primary data records. [2025-10-09T22:37:42.917686] [DEBUG] [LOCAL ] ECL: Loaded 46987 existing records from primary storage. [2025-10-09T22:37:42.947480] [INFO ] [MAIN ] ECL: Loaded 46987 primary data records. [2025-10-09T22:37:43.459372] [DEBUG] [MAIN ] ECCU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:43.460388] [INFO ] [MAIN ] ECCU: Generated 1807 derivative records from 2264 primary records. [2025-10-09T22:37:43.460479] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-09T22:37:43.478164] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1807 records). [2025-10-09T22:37:43.485987] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-09T22:37:43.491339] [DEBUG] [MAIN ] ECC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:43.493629] [INFO ] [MAIN ] Derivative Progress: 559/1690 symbols completed. ECCU took 1.1s. Estimated remaining: 7m 23s. Rate: 153.2 symbols/min [2025-10-09T22:37:43.494418] [INFO ] [MAIN ] ECC: Generated 1807 derivative records from 43399 primary records. [2025-10-09T22:37:43.494735] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-09T22:37:43.494826] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:43.511737] [DEBUG] [LOCAL ] ECC: Derivative data saved (1807 records). [2025-10-09T22:37:43.512678] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-09T22:37:43.514829] [INFO ] [MAIN ] Derivative Progress: 560/1690 symbols completed. ECC took 1.2s. Estimated remaining: 7m 22s. Rate: 153.4 symbols/min [2025-10-09T22:37:43.515017] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:43.530200] [DEBUG] [MAIN ] ECL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:43.530998] [INFO ] [MAIN ] ECL: Generated 1807 derivative records from 46987 primary records. [2025-10-09T22:37:43.535423] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-09T22:37:43.557423] [DEBUG] [LOCAL ] ECL: Derivative data saved (1807 records). [2025-10-09T22:37:43.558246] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-09T22:37:43.561882] [INFO ] [MAIN ] Derivative Progress: 561/1690 symbols completed. ECL took 1.2s. Estimated remaining: 7m 21s. Rate: 153.7 symbols/min [2025-10-09T22:37:43.562478] [DEBUG] [LOCAL ] ECO: Loaded 18474 existing records from primary storage. [2025-10-09T22:37:43.562786] [INFO ] [MAIN ] ECO: Loaded 18474 primary data records. [2025-10-09T22:37:43.562708] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:43.888991] [DEBUG] [LOCAL ] ECVT: Loaded 43520 existing records from primary storage. [2025-10-09T22:37:43.889328] [INFO ] [MAIN ] ECVT: Loaded 43520 primary data records. [2025-10-09T22:37:44.030449] [DEBUG] [LOCAL ] ED: Loaded 53094 existing records from primary storage. [2025-10-09T22:37:44.073856] [INFO ] [MAIN ] ED: Loaded 53094 primary data records. [2025-10-09T22:37:44.550212] [DEBUG] [MAIN ] ECO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:44.551050] [INFO ] [MAIN ] ECO: Generated 1807 derivative records from 18474 primary records. [2025-10-09T22:37:44.551257] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-09T22:37:44.569462] [DEBUG] [LOCAL ] ECO: Derivative data saved (1807 records). [2025-10-09T22:37:44.570157] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-09T22:37:44.572685] [INFO ] [MAIN ] Derivative Progress: 562/1690 symbols completed. ECO took 1.1s. Estimated remaining: 7m 22s. Rate: 153.3 symbols/min [2025-10-09T22:37:44.572874] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:44.592129] [DEBUG] [MAIN ] ECVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:44.592859] [INFO ] [MAIN ] ECVT: Generated 1807 derivative records from 43520 primary records. [2025-10-09T22:37:44.593038] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-09T22:37:44.616669] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1807 records). [2025-10-09T22:37:44.616914] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-09T22:37:44.619399] [INFO ] [MAIN ] Derivative Progress: 563/1690 symbols completed. ECVT took 1.1s. Estimated remaining: 7m 21s. Rate: 153.5 symbols/min [2025-10-09T22:37:44.619559] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:44.631421] [DEBUG] [LOCAL ] EDD: Loaded 27133 existing records from primary storage. [2025-10-09T22:37:44.639177] [INFO ] [MAIN ] EDD: Loaded 27133 primary data records. [2025-10-09T22:37:44.655355] [DEBUG] [MAIN ] ED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:44.722696] [INFO ] [MAIN ] ED: Generated 1807 derivative records from 53094 primary records. [2025-10-09T22:37:44.723027] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-09T22:37:44.737786] [DEBUG] [LOCAL ] EDF: Loaded 13313 existing records from primary storage. [2025-10-09T22:37:44.750973] [INFO ] [MAIN ] EDF: Loaded 13313 primary data records. [2025-10-09T22:37:44.936669] [DEBUG] [LOCAL ] ED: Derivative data saved (1807 records). [2025-10-09T22:37:44.947217] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-09T22:37:44.950846] [INFO ] [MAIN ] Derivative Progress: 564/1690 symbols completed. ED took 1.4s. Estimated remaining: 7m 20s. Rate: 153.5 symbols/min [2025-10-09T22:37:44.956221] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:45.305819] [DEBUG] [LOCAL ] EDN: Loaded 18533 existing records from primary storage. [2025-10-09T22:37:45.306105] [INFO ] [MAIN ] EDN: Loaded 18533 primary data records. [2025-10-09T22:37:45.617360] [DEBUG] [MAIN ] EDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:45.628114] [INFO ] [MAIN ] EDD: Generated 1807 derivative records from 27133 primary records. [2025-10-09T22:37:45.628269] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-09T22:37:45.658914] [DEBUG] [LOCAL ] EDD: Derivative data saved (1807 records). [2025-10-09T22:37:45.664255] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-09T22:37:45.667112] [INFO ] [MAIN ] Derivative Progress: 565/1690 symbols completed. EDD took 1.1s. Estimated remaining: 7m 20s. Rate: 153.3 symbols/min [2025-10-09T22:37:45.668056] [DEBUG] [MAIN ] EDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:45.667507] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:45.669358] [INFO ] [MAIN ] EDF: Generated 1807 derivative records from 13313 primary records. [2025-10-09T22:37:45.670165] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-09T22:37:45.690677] [DEBUG] [LOCAL ] EDF: Derivative data saved (1807 records). [2025-10-09T22:37:45.690886] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-09T22:37:45.694332] [INFO ] [MAIN ] Derivative Progress: 566/1690 symbols completed. EDF took 1.1s. Estimated remaining: 7m 19s. Rate: 153.6 symbols/min [2025-10-09T22:37:45.695101] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:45.714367] [DEBUG] [MAIN ] EDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:45.715168] [INFO ] [MAIN ] EDN: Generated 1807 derivative records from 18533 primary records. [2025-10-09T22:37:45.715258] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-09T22:37:45.741686] [DEBUG] [LOCAL ] EDN: Derivative data saved (1807 records). [2025-10-09T22:37:45.741966] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-09T22:37:45.745491] [INFO ] [MAIN ] Derivative Progress: 567/1690 symbols completed. EDN took 0.8s. Estimated remaining: 7m 18s. Rate: 153.8 symbols/min [2025-10-09T22:37:45.745846] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:45.776395] [DEBUG] [LOCAL ] EDU: Loaded 45177 existing records from primary storage. [2025-10-09T22:37:45.776701] [INFO ] [MAIN ] EDU: Loaded 45177 primary data records. [2025-10-09T22:37:45.848864] [DEBUG] [LOCAL ] EEX: Loaded 10865 existing records from primary storage. [2025-10-09T22:37:45.880500] [INFO ] [MAIN ] EEX: Loaded 10865 primary data records. [2025-10-09T22:37:45.869990] [DEBUG] [LOCAL ] EE: Loaded 33129 existing records from primary storage. [2025-10-09T22:37:45.926509] [INFO ] [MAIN ] EE: Loaded 33129 primary data records. [2025-10-09T22:37:46.753738] [DEBUG] [MAIN ] EDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:46.754884] [INFO ] [MAIN ] EDU: Generated 1807 derivative records from 45177 primary records. [2025-10-09T22:37:46.755236] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-09T22:37:46.775059] [DEBUG] [LOCAL ] EDU: Derivative data saved (1807 records). [2025-10-09T22:37:46.777936] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-09T22:37:46.780842] [INFO ] [MAIN ] Derivative Progress: 568/1690 symbols completed. EDU took 1.1s. Estimated remaining: 7m 19s. Rate: 153.4 symbols/min [2025-10-09T22:37:46.795349] [DEBUG] [MAIN ] EEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:46.796279] [INFO ] [MAIN ] EEX: Generated 1807 derivative records from 10865 primary records. [2025-10-09T22:37:46.808285] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-09T22:37:46.809269] [DEBUG] [MAIN ] EE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:46.810508] [INFO ] [MAIN ] EE: Generated 1807 derivative records from 33129 primary records. [2025-10-09T22:37:46.810597] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-09T22:37:46.840442] [DEBUG] [LOCAL ] EEX: Derivative data saved (1807 records). [2025-10-09T22:37:46.841426] [DEBUG] [LOCAL ] EE: Derivative data saved (1807 records). [2025-10-09T22:37:46.841522] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-09T22:37:46.841618] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-09T22:37:46.844704] [INFO ] [MAIN ] Derivative Progress: 569/1690 symbols completed. EE took 1.1s. Estimated remaining: 7m 18s. Rate: 153.6 symbols/min [2025-10-09T22:37:46.848685] [INFO ] [MAIN ] Derivative Progress: 570/1690 symbols completed. EEX took 1.1s. Estimated remaining: 7m 17s. Rate: 153.8 symbols/min [2025-10-09T22:37:46.849178] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:46.849279] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:46.849112] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:46.866930] [DEBUG] [LOCAL ] EFT: Loaded 13215 existing records from primary storage. [2025-10-09T22:37:46.867132] [INFO ] [MAIN ] EFT: Loaded 13215 primary data records. [2025-10-09T22:37:46.980403] [DEBUG] [LOCAL ] EFR: Loaded 15071 existing records from primary storage. [2025-10-09T22:37:46.991318] [INFO ] [MAIN ] EFR: Loaded 15071 primary data records. [2025-10-09T22:37:47.421521] [DEBUG] [LOCAL ] EFX: Loaded 44924 existing records from primary storage. [2025-10-09T22:37:47.454436] [INFO ] [MAIN ] EFX: Loaded 44924 primary data records. [2025-10-09T22:37:47.895578] [DEBUG] [MAIN ] EFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:47.897016] [INFO ] [MAIN ] EFT: Generated 1807 derivative records from 13215 primary records. [2025-10-09T22:37:47.897326] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-09T22:37:47.918910] [DEBUG] [LOCAL ] EFT: Derivative data saved (1807 records). [2025-10-09T22:37:47.919152] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-09T22:37:47.921422] [INFO ] [MAIN ] Derivative Progress: 571/1690 symbols completed. EFT took 1.1s. Estimated remaining: 7m 18s. Rate: 153.4 symbols/min [2025-10-09T22:37:47.921787] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:47.936113] [DEBUG] [MAIN ] EFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:47.937532] [INFO ] [MAIN ] EFR: Generated 1807 derivative records from 15071 primary records. [2025-10-09T22:37:47.937916] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-09T22:37:47.958394] [DEBUG] [LOCAL ] EFR: Derivative data saved (1807 records). [2025-10-09T22:37:47.958487] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-09T22:37:47.961449] [INFO ] [MAIN ] Derivative Progress: 572/1690 symbols completed. EFR took 1.1s. Estimated remaining: 7m 17s. Rate: 153.6 symbols/min [2025-10-09T22:37:47.961913] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:47.984113] [DEBUG] [MAIN ] EFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:47.984878] [INFO ] [MAIN ] EFX: Generated 1807 derivative records from 44924 primary records. [2025-10-09T22:37:47.985488] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-09T22:37:47.995000] [DEBUG] [LOCAL ] EFXT: Loaded 29630 existing records from primary storage. [2025-10-09T22:37:47.995117] [INFO ] [MAIN ] EFXT: Loaded 29630 primary data records. [2025-10-09T22:37:48.126946] [DEBUG] [LOCAL ] EFX: Derivative data saved (1807 records). [2025-10-09T22:37:48.156235] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-09T22:37:48.192914] [INFO ] [MAIN ] Derivative Progress: 573/1690 symbols completed. EFX took 1.3s. Estimated remaining: 7m 16s. Rate: 153.7 symbols/min [2025-10-09T22:37:48.193691] [DEBUG] [LOCAL ] EG: Loaded 28013 existing records from primary storage. [2025-10-09T22:37:48.279627] [INFO ] [MAIN ] EG: Loaded 28013 primary data records. [2025-10-09T22:37:48.279500] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:48.703726] [DEBUG] [MAIN ] EFXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:48.705563] [DEBUG] [LOCAL ] EGO: Loaded 52063 existing records from primary storage. [2025-10-09T22:37:48.705923] [INFO ] [MAIN ] EGO: Loaded 52063 primary data records. [2025-10-09T22:37:48.705852] [INFO ] [MAIN ] EFXT: Generated 1807 derivative records from 29630 primary records. [2025-10-09T22:37:48.706367] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-09T22:37:48.812455] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1807 records). [2025-10-09T22:37:48.818949] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-09T22:37:48.832010] [INFO ] [MAIN ] Derivative Progress: 574/1690 symbols completed. EFXT took 0.9s. Estimated remaining: 7m 16s. Rate: 153.6 symbols/min [2025-10-09T22:37:48.853797] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:49.082454] [DEBUG] [MAIN ] EG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:49.083240] [INFO ] [MAIN ] EG: Generated 1807 derivative records from 28013 primary records. [2025-10-09T22:37:49.083377] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-09T22:37:49.112302] [DEBUG] [LOCAL ] EG: Derivative data saved (1807 records). [2025-10-09T22:37:49.112539] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-09T22:37:49.115547] [INFO ] [MAIN ] Derivative Progress: 575/1690 symbols completed. EG took 1.2s. Estimated remaining: 7m 15s. Rate: 153.6 symbols/min [2025-10-09T22:37:49.116945] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:49.128613] [DEBUG] [LOCAL ] EGP: Loaded 30837 existing records from primary storage. [2025-10-09T22:37:49.129138] [INFO ] [MAIN ] EGP: Loaded 30837 primary data records. [2025-10-09T22:37:49.267603] [DEBUG] [MAIN ] EGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:49.310707] [INFO ] [MAIN ] EGO: Generated 1807 derivative records from 52063 primary records. [2025-10-09T22:37:49.336198] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-09T22:37:49.486892] [DEBUG] [LOCAL ] EGY: Loaded 42030 existing records from primary storage. [2025-10-09T22:37:49.487331] [INFO ] [MAIN ] EGY: Loaded 42030 primary data records. [2025-10-09T22:37:49.484502] [DEBUG] [LOCAL ] EGO: Derivative data saved (1807 records). [2025-10-09T22:37:49.488100] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-09T22:37:49.511058] [INFO ] [MAIN ] Derivative Progress: 576/1690 symbols completed. EGO took 1.2s. Estimated remaining: 7m 15s. Rate: 153.6 symbols/min [2025-10-09T22:37:49.534400] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:49.827882] [DEBUG] [LOCAL ] EHAB: Loaded 29479 existing records from primary storage. [2025-10-09T22:37:49.833036] [INFO ] [MAIN ] EHAB: Loaded 29479 primary data records. [2025-10-09T22:37:49.833909] [DEBUG] [MAIN ] EGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:49.857215] [INFO ] [MAIN ] EGP: Generated 1807 derivative records from 30837 primary records. [2025-10-09T22:37:49.867668] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-09T22:37:49.939587] [DEBUG] [LOCAL ] EGP: Derivative data saved (1807 records). [2025-10-09T22:37:49.958250] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-09T22:37:49.964838] [INFO ] [MAIN ] Derivative Progress: 577/1690 symbols completed. EGP took 1.1s. Estimated remaining: 7m 15s. Rate: 153.6 symbols/min [2025-10-09T22:37:49.965021] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:50.184269] [DEBUG] [MAIN ] EGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:50.185170] [INFO ] [MAIN ] EGY: Generated 1807 derivative records from 42030 primary records. [2025-10-09T22:37:50.185904] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-09T22:37:50.218680] [DEBUG] [LOCAL ] EGY: Derivative data saved (1807 records). [2025-10-09T22:37:50.219097] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-09T22:37:50.221952] [INFO ] [MAIN ] Derivative Progress: 578/1690 symbols completed. EGY took 1.1s. Estimated remaining: 7m 14s. Rate: 153.7 symbols/min [2025-10-09T22:37:50.223467] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:50.236602] [DEBUG] [LOCAL ] EHC: Loaded 41416 existing records from primary storage. [2025-10-09T22:37:50.236914] [INFO ] [MAIN ] EHC: Loaded 41416 primary data records. [2025-10-09T22:37:50.353437] [DEBUG] [LOCAL ] EHI: Loaded 10769 existing records from primary storage. [2025-10-09T22:37:50.365065] [INFO ] [MAIN ] EHI: Loaded 10769 primary data records. [2025-10-09T22:37:50.496501] [DEBUG] [MAIN ] EHAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:50.505861] [INFO ] [MAIN ] EHAB: Generated 1807 derivative records from 29479 primary records. [2025-10-09T22:37:50.651422] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-09T22:37:50.779529] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1807 records). [2025-10-09T22:37:50.786604] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-09T22:37:50.808198] [INFO ] [MAIN ] Derivative Progress: 579/1690 symbols completed. EHAB took 1.3s. Estimated remaining: 7m 14s. Rate: 153.5 symbols/min [2025-10-09T22:37:50.815836] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:50.985464] [DEBUG] [MAIN ] EHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:50.986056] [DEBUG] [LOCAL ] EIC: Loaded 23193 existing records from primary storage. [2025-10-09T22:37:50.986170] [INFO ] [MAIN ] EIC: Loaded 23193 primary data records. [2025-10-09T22:37:50.998110] [INFO ] [MAIN ] EHC: Generated 1807 derivative records from 41416 primary records. [2025-10-09T22:37:51.018578] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-09T22:37:51.197219] [DEBUG] [LOCAL ] EHC: Derivative data saved (1807 records). [2025-10-09T22:37:51.210778] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-09T22:37:51.212867] [INFO ] [MAIN ] Derivative Progress: 580/1690 symbols completed. EHC took 1.2s. Estimated remaining: 7m 14s. Rate: 153.5 symbols/min [2025-10-09T22:37:51.213889] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:51.388809] [DEBUG] [MAIN ] EHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:51.389881] [INFO ] [MAIN ] EHI: Generated 1807 derivative records from 10769 primary records. [2025-10-09T22:37:51.390178] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-09T22:37:51.415240] [DEBUG] [LOCAL ] EHI: Derivative data saved (1807 records). [2025-10-09T22:37:51.421931] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-09T22:37:51.426072] [INFO ] [MAIN ] Derivative Progress: 581/1690 symbols completed. EHI took 1.2s. Estimated remaining: 7m 13s. Rate: 153.7 symbols/min [2025-10-09T22:37:51.426517] [DEBUG] [LOCAL ] EIG: Loaded 20377 existing records from primary storage. [2025-10-09T22:37:51.427273] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:51.427165] [INFO ] [MAIN ] EIG: Loaded 20377 primary data records. [2025-10-09T22:37:51.641113] [DEBUG] [MAIN ] EIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:51.641912] [INFO ] [MAIN ] EIC: Generated 1807 derivative records from 23193 primary records. [2025-10-09T22:37:51.642016] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-09T22:37:51.794177] [DEBUG] [LOCAL ] EIC: Derivative data saved (1807 records). [2025-10-09T22:37:51.794939] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-09T22:37:51.812724] [INFO ] [MAIN ] Derivative Progress: 582/1690 symbols completed. EIC took 1.0s. Estimated remaining: 7m 13s. Rate: 153.7 symbols/min [2025-10-09T22:37:51.813450] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:51.816967] [DEBUG] [LOCAL ] EL: Loaded 53760 existing records from primary storage. [2025-10-09T22:37:51.818337] [INFO ] [MAIN ] EL: Loaded 53760 primary data records. [2025-10-09T22:37:52.149601] [DEBUG] [MAIN ] EIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:52.164278] [INFO ] [MAIN ] EIG: Generated 1807 derivative records from 20377 primary records. [2025-10-09T22:37:52.166050] [DEBUG] [LOCAL ] ELAN: Loaded 53679 existing records from primary storage. [2025-10-09T22:37:52.166177] [INFO ] [MAIN ] ELAN: Loaded 53679 primary data records. [2025-10-09T22:37:52.164893] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-09T22:37:52.284762] [DEBUG] [LOCAL ] EIG: Derivative data saved (1807 records). [2025-10-09T22:37:52.285150] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-09T22:37:52.288177] [INFO ] [MAIN ] Derivative Progress: 583/1690 symbols completed. EIG took 1.1s. Estimated remaining: 7m 12s. Rate: 153.6 symbols/min [2025-10-09T22:37:52.499493] [DEBUG] [MAIN ] EL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:52.500329] [INFO ] [MAIN ] EL: Generated 1807 derivative records from 53760 primary records. [2025-10-09T22:37:52.500665] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-09T22:37:52.518136] [DEBUG] [LOCAL ] EL: Derivative data saved (1807 records). [2025-10-09T22:37:52.518359] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-09T22:37:52.521748] [INFO ] [MAIN ] Derivative Progress: 584/1690 symbols completed. EL took 1.1s. Estimated remaining: 7m 12s. Rate: 153.7 symbols/min [2025-10-09T22:37:52.535791] [DEBUG] [MAIN ] ELAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:52.536306] [INFO ] [MAIN ] ELAN: Generated 1807 derivative records from 53679 primary records. [2025-10-09T22:37:52.536364] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-09T22:37:52.551443] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1807 records). [2025-10-09T22:37:52.551500] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-09T22:37:52.554074] [INFO ] [MAIN ] Derivative Progress: 585/1690 symbols completed. ELAN took 0.7s. Estimated remaining: 7m 11s. Rate: 153.9 symbols/min [2025-10-09T22:37:52.554638] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:52.554736] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:52.554886] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:52.562490] [DEBUG] [LOCAL ] ELC: Loaded 3524 existing records from primary storage. [2025-10-09T22:37:52.562733] [INFO ] [MAIN ] ELC: Loaded 3524 primary data records. [2025-10-09T22:37:52.898501] [DEBUG] [LOCAL ] ELME: Loaded 39587 existing records from primary storage. [2025-10-09T22:37:52.899063] [INFO ] [MAIN ] ELME: Loaded 39587 primary data records. [2025-10-09T22:37:53.040060] [DEBUG] [LOCAL ] ELF: Loaded 52403 existing records from primary storage. [2025-10-09T22:37:53.068774] [INFO ] [MAIN ] ELF: Loaded 52403 primary data records. [2025-10-09T22:37:53.419897] [DEBUG] [MAIN ] ELC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:53.454833] [INFO ] [MAIN ] ELC: Generated 1807 derivative records from 3524 primary records. [2025-10-09T22:37:53.521243] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-09T22:37:53.594287] [DEBUG] [LOCAL ] ELC: Derivative data saved (1807 records). [2025-10-09T22:37:53.594816] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-09T22:37:53.597376] [INFO ] [MAIN ] Derivative Progress: 586/1690 symbols completed. ELC took 1.0s. Estimated remaining: 7m 12s. Rate: 153.5 symbols/min [2025-10-09T22:37:53.597531] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:53.615112] [DEBUG] [MAIN ] ELME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:53.616026] [INFO ] [MAIN ] ELME: Generated 1807 derivative records from 39587 primary records. [2025-10-09T22:37:53.616200] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-09T22:37:53.650742] [DEBUG] [LOCAL ] ELME: Derivative data saved (1807 records). [2025-10-09T22:37:53.655788] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-09T22:37:53.656102] [DEBUG] [MAIN ] ELF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:53.658467] [INFO ] [MAIN ] Derivative Progress: 587/1690 symbols completed. ELME took 1.1s. Estimated remaining: 7m 11s. Rate: 153.7 symbols/min [2025-10-09T22:37:53.659992] [INFO ] [MAIN ] ELF: Generated 1807 derivative records from 52403 primary records. [2025-10-09T22:37:53.660099] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-09T22:37:53.659055] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:53.680678] [DEBUG] [LOCAL ] ELP: Loaded 25781 existing records from primary storage. [2025-10-09T22:37:53.684087] [INFO ] [MAIN ] ELP: Loaded 25781 primary data records. [2025-10-09T22:37:53.685018] [DEBUG] [LOCAL ] ELF: Derivative data saved (1807 records). [2025-10-09T22:37:53.685175] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-09T22:37:53.700617] [INFO ] [MAIN ] Derivative Progress: 588/1690 symbols completed. ELF took 1.1s. Estimated remaining: 7m 9s. Rate: 154.0 symbols/min [2025-10-09T22:37:53.725466] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:54.028417] [DEBUG] [LOCAL ] ELS: Loaded 50144 existing records from primary storage. [2025-10-09T22:37:54.029037] [INFO ] [MAIN ] ELS: Loaded 50144 primary data records. [2025-10-09T22:37:54.174369] [DEBUG] [LOCAL ] ELV: Loaded 50963 existing records from primary storage. [2025-10-09T22:37:54.202184] [INFO ] [MAIN ] ELV: Loaded 50963 primary data records. [2025-10-09T22:37:54.660773] [DEBUG] [MAIN ] ELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:54.670821] [INFO ] [MAIN ] ELP: Generated 1807 derivative records from 25781 primary records. [2025-10-09T22:37:54.671197] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-09T22:37:54.693964] [DEBUG] [LOCAL ] ELP: Derivative data saved (1807 records). [2025-10-09T22:37:54.695846] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-09T22:37:54.699025] [INFO ] [MAIN ] Derivative Progress: 589/1690 symbols completed. ELP took 1.1s. Estimated remaining: 7m 10s. Rate: 153.6 symbols/min [2025-10-09T22:37:54.699481] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:54.713386] [DEBUG] [MAIN ] ELS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:54.714166] [INFO ] [MAIN ] ELS: Generated 1807 derivative records from 50144 primary records. [2025-10-09T22:37:54.714440] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-09T22:37:54.731216] [DEBUG] [LOCAL ] ELS: Derivative data saved (1807 records). [2025-10-09T22:37:54.738174] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-09T22:37:54.740253] [INFO ] [MAIN ] Derivative Progress: 590/1690 symbols completed. ELS took 1.1s. Estimated remaining: 7m 9s. Rate: 153.8 symbols/min [2025-10-09T22:37:54.740521] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:54.756446] [DEBUG] [MAIN ] ELV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:54.765732] [DEBUG] [LOCAL ] EMD: Loaded 21300 existing records from primary storage. [2025-10-09T22:37:54.765314] [INFO ] [MAIN ] ELV: Generated 1807 derivative records from 50963 primary records. [2025-10-09T22:37:54.765860] [INFO ] [MAIN ] EMD: Loaded 21300 primary data records. [2025-10-09T22:37:54.765925] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-09T22:37:54.943382] [DEBUG] [LOCAL ] ELV: Derivative data saved (1807 records). [2025-10-09T22:37:54.968068] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-09T22:37:55.149528] [INFO ] [MAIN ] Derivative Progress: 591/1690 symbols completed. ELV took 1.4s. Estimated remaining: 7m 9s. Rate: 153.8 symbols/min [2025-10-09T22:37:55.145878] [DEBUG] [LOCAL ] EME: Loaded 31359 existing records from primary storage. [2025-10-09T22:37:55.149860] [INFO ] [MAIN ] EME: Loaded 31359 primary data records. [2025-10-09T22:37:55.149772] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:55.248348] [DEBUG] [LOCAL ] EMF: Loaded 3301 existing records from primary storage. [2025-10-09T22:37:55.258963] [INFO ] [MAIN ] EMF: Loaded 3301 primary data records. [2025-10-09T22:37:55.776849] [DEBUG] [MAIN ] EMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:55.778237] [INFO ] [MAIN ] EMD: Generated 1807 derivative records from 21300 primary records. [2025-10-09T22:37:55.778753] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-09T22:37:55.798450] [DEBUG] [LOCAL ] EMD: Derivative data saved (1807 records). [2025-10-09T22:37:55.799045] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-09T22:37:55.801301] [INFO ] [MAIN ] Derivative Progress: 592/1690 symbols completed. EMD took 1.1s. Estimated remaining: 7m 9s. Rate: 153.6 symbols/min [2025-10-09T22:37:55.801804] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:55.819129] [DEBUG] [MAIN ] EME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:55.819848] [INFO ] [MAIN ] EME: Generated 1807 derivative records from 31359 primary records. [2025-10-09T22:37:55.819927] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-09T22:37:55.838516] [DEBUG] [LOCAL ] EME: Derivative data saved (1807 records). [2025-10-09T22:37:55.851114] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-09T22:37:55.853690] [INFO ] [MAIN ] Derivative Progress: 593/1690 symbols completed. EME took 1.1s. Estimated remaining: 7m 8s. Rate: 153.8 symbols/min [2025-10-09T22:37:55.854087] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:55.853964] [DEBUG] [MAIN ] EMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:55.857617] [INFO ] [MAIN ] EMF: Generated 1807 derivative records from 3301 primary records. [2025-10-09T22:37:55.857871] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-09T22:37:55.889022] [DEBUG] [LOCAL ] EMF: Derivative data saved (1807 records). [2025-10-09T22:37:55.894819] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-09T22:37:55.897898] [INFO ] [MAIN ] Derivative Progress: 594/1690 symbols completed. EMF took 0.7s. Estimated remaining: 7m 7s. Rate: 154.1 symbols/min [2025-10-09T22:37:55.894690] [DEBUG] [LOCAL ] EMO: Loaded 13052 existing records from primary storage. [2025-10-09T22:37:55.898090] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:55.910865] [INFO ] [MAIN ] EMO: Loaded 13052 primary data records. [2025-10-09T22:37:55.967114] [DEBUG] [LOCAL ] EMN: Loaded 50972 existing records from primary storage. [2025-10-09T22:37:55.976519] [INFO ] [MAIN ] EMN: Loaded 50972 primary data records. [2025-10-09T22:37:56.053277] [DEBUG] [LOCAL ] EMP: Loaded 3098 existing records from primary storage. [2025-10-09T22:37:56.098971] [INFO ] [MAIN ] EMP: Loaded 3098 primary data records. [2025-10-09T22:37:56.915082] [DEBUG] [MAIN ] EMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:56.915942] [INFO ] [MAIN ] EMO: Generated 1807 derivative records from 13052 primary records. [2025-10-09T22:37:56.916308] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-09T22:37:56.947846] [DEBUG] [MAIN ] EMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:56.957005] [INFO ] [MAIN ] EMN: Generated 1807 derivative records from 50972 primary records. [2025-10-09T22:37:56.963145] [DEBUG] [MAIN ] EMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:56.962142] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-09T22:37:56.963235] [DEBUG] [LOCAL ] EMO: Derivative data saved (1807 records). [2025-10-09T22:37:56.963822] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-09T22:37:56.964676] [INFO ] [MAIN ] EMP: Generated 1807 derivative records from 3098 primary records. [2025-10-09T22:37:56.966900] [INFO ] [MAIN ] Derivative Progress: 595/1690 symbols completed. EMO took 1.1s. Estimated remaining: 7m 8s. Rate: 153.6 symbols/min [2025-10-09T22:37:56.967202] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-09T22:37:56.967287] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:56.997672] [DEBUG] [LOCAL ] EMN: Derivative data saved (1807 records). [2025-10-09T22:37:56.998262] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-09T22:37:56.998006] [DEBUG] [LOCAL ] EMP: Derivative data saved (1807 records). [2025-10-09T22:37:57.001078] [INFO ] [MAIN ] Derivative Progress: 596/1690 symbols completed. EMN took 1.2s. Estimated remaining: 7m 7s. Rate: 153.8 symbols/min [2025-10-09T22:37:57.001563] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:57.001779] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-09T22:37:57.005291] [INFO ] [MAIN ] Derivative Progress: 597/1690 symbols completed. EMP took 1.1s. Estimated remaining: 7m 6s. Rate: 154.1 symbols/min [2025-10-09T22:37:57.005678] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:57.012464] [DEBUG] [LOCAL ] ENFY: Loaded 3256 existing records from primary storage. [2025-10-09T22:37:57.012693] [INFO ] [MAIN ] ENFY: Loaded 3256 primary data records. [2025-10-09T22:37:57.369442] [DEBUG] [LOCAL ] EMR: Loaded 53610 existing records from primary storage. [2025-10-09T22:37:57.370552] [INFO ] [MAIN ] EMR: Loaded 53610 primary data records. [2025-10-09T22:37:57.474995] [DEBUG] [LOCAL ] ENB: Loaded 53900 existing records from primary storage. [2025-10-09T22:37:57.491586] [INFO ] [MAIN ] ENB: Loaded 53900 primary data records. [2025-10-09T22:37:58.021555] [DEBUG] [MAIN ] ENFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:58.022630] [INFO ] [MAIN ] ENFY: Generated 1807 derivative records from 3256 primary records. [2025-10-09T22:37:58.022879] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-10-09T22:37:58.040560] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1807 records). [2025-10-09T22:37:58.041776] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-10-09T22:37:58.045893] [INFO ] [MAIN ] Derivative Progress: 598/1690 symbols completed. ENFY took 1.0s. Estimated remaining: 7m 6s. Rate: 153.7 symbols/min [2025-10-09T22:37:58.059556] [DEBUG] [MAIN ] EMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:58.060318] [INFO ] [MAIN ] EMR: Generated 1807 derivative records from 53610 primary records. [2025-10-09T22:37:58.060458] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-09T22:37:58.082859] [DEBUG] [MAIN ] ENB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:58.087198] [INFO ] [MAIN ] ENB: Generated 1807 derivative records from 53900 primary records. [2025-10-09T22:37:58.087901] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-09T22:37:58.103343] [DEBUG] [LOCAL ] EMR: Derivative data saved (1807 records). [2025-10-09T22:37:58.103431] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-09T22:37:58.105409] [INFO ] [MAIN ] Derivative Progress: 599/1690 symbols completed. EMR took 1.1s. Estimated remaining: 7m 5s. Rate: 153.9 symbols/min [2025-10-09T22:37:58.111372] [DEBUG] [LOCAL ] ENB: Derivative data saved (1807 records). [2025-10-09T22:37:58.111438] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-09T22:37:58.115152] [INFO ] [MAIN ] Derivative Progress: 600/1690 symbols completed. ENB took 1.1s. Estimated remaining: 7m 4s. Rate: 154.1 symbols/min [2025-10-09T22:37:58.115674] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:58.115774] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:58.115813] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:58.121832] [DEBUG] [LOCAL ] ENO: Loaded 1899 existing records from primary storage. [2025-10-09T22:37:58.122102] [INFO ] [MAIN ] ENO: Loaded 1899 primary data records. [2025-10-09T22:37:58.452012] [DEBUG] [LOCAL ] ENIC: Loaded 36571 existing records from primary storage. [2025-10-09T22:37:58.453245] [INFO ] [MAIN ] ENIC: Loaded 36571 primary data records. [2025-10-09T22:37:58.542383] [DEBUG] [LOCAL ] ENOV: Loaded 45067 existing records from primary storage. [2025-10-09T22:37:58.570681] [INFO ] [MAIN ] ENOV: Loaded 45067 primary data records. [2025-10-09T22:37:59.136879] [DEBUG] [MAIN ] ENO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:59.138717] [INFO ] [MAIN ] ENO: Generated 1807 derivative records from 1899 primary records. [2025-10-09T22:37:59.139523] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-09T22:37:59.157195] [DEBUG] [LOCAL ] ENO: Derivative data saved (1807 records). [2025-10-09T22:37:59.159261] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-09T22:37:59.161596] [INFO ] [MAIN ] Derivative Progress: 601/1690 symbols completed. ENO took 1.0s. Estimated remaining: 7m 5s. Rate: 153.7 symbols/min [2025-10-09T22:37:59.162549] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:59.184546] [DEBUG] [MAIN ] ENIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:59.188528] [INFO ] [MAIN ] ENIC: Generated 1807 derivative records from 36571 primary records. [2025-10-09T22:37:59.188713] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-09T22:37:59.219272] [DEBUG] [MAIN ] ENOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:37:59.221015] [INFO ] [MAIN ] ENOV: Generated 1807 derivative records from 45067 primary records. [2025-10-09T22:37:59.221419] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-09T22:37:59.252433] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1807 records). [2025-10-09T22:37:59.252281] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1807 records). [2025-10-09T22:37:59.252701] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-09T22:37:59.256357] [INFO ] [MAIN ] Derivative Progress: 602/1690 symbols completed. ENOV took 1.1s. Estimated remaining: 7m 4s. Rate: 153.9 symbols/min [2025-10-09T22:37:59.256547] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-09T22:37:59.260256] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:59.260853] [INFO ] [MAIN ] Derivative Progress: 603/1690 symbols completed. ENIC took 1.1s. Estimated remaining: 7m 3s. Rate: 154.1 symbols/min [2025-10-09T22:37:59.261224] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:37:59.277080] [DEBUG] [LOCAL ] ENR: Loaded 43536 existing records from primary storage. [2025-10-09T22:37:59.277399] [INFO ] [MAIN ] ENR: Loaded 43536 primary data records. [2025-10-09T22:37:59.502180] [DEBUG] [LOCAL ] ENVA: Loaded 25478 existing records from primary storage. [2025-10-09T22:37:59.602871] [INFO ] [MAIN ] ENVA: Loaded 25478 primary data records. [2025-10-09T22:37:59.470913] [DEBUG] [LOCAL ] ENS: Loaded 29440 existing records from primary storage. [2025-10-09T22:37:59.642254] [INFO ] [MAIN ] ENS: Loaded 29440 primary data records. [2025-10-09T22:38:00.246053] [DEBUG] [MAIN ] ENR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:00.247604] [INFO ] [MAIN ] ENR: Generated 1807 derivative records from 43536 primary records. [2025-10-09T22:38:00.248164] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-09T22:38:00.283424] [DEBUG] [LOCAL ] ENR: Derivative data saved (1807 records). [2025-10-09T22:38:00.284919] [DEBUG] [MAIN ] ENVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:00.285714] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-09T22:38:00.286631] [INFO ] [MAIN ] ENVA: Generated 1807 derivative records from 25478 primary records. [2025-10-09T22:38:00.289242] [INFO ] [MAIN ] Derivative Progress: 604/1690 symbols completed. ENR took 1.1s. Estimated remaining: 7m 4s. Rate: 153.7 symbols/min [2025-10-09T22:38:00.289601] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:00.289840] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-09T22:38:00.303581] [DEBUG] [MAIN ] ENS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:00.304532] [INFO ] [MAIN ] ENS: Generated 1807 derivative records from 29440 primary records. [2025-10-09T22:38:00.311826] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-09T22:38:00.342198] [DEBUG] [LOCAL ] EOD: Loaded 14933 existing records from primary storage. [2025-10-09T22:38:00.343778] [INFO ] [MAIN ] EOD: Loaded 14933 primary data records. [2025-10-09T22:38:00.345169] [DEBUG] [LOCAL ] ENS: Derivative data saved (1807 records). [2025-10-09T22:38:00.356594] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-09T22:38:00.369017] [INFO ] [MAIN ] Derivative Progress: 605/1690 symbols completed. ENS took 1.1s. Estimated remaining: 7m 3s. Rate: 153.9 symbols/min [2025-10-09T22:38:00.379432] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1807 records). [2025-10-09T22:38:00.391481] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-09T22:38:00.379372] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:00.420568] [INFO ] [MAIN ] Derivative Progress: 606/1690 symbols completed. ENVA took 1.2s. Estimated remaining: 7m 2s. Rate: 154.2 symbols/min [2025-10-09T22:38:00.421004] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:00.645533] [DEBUG] [LOCAL ] EOI: Loaded 10887 existing records from primary storage. [2025-10-09T22:38:00.659784] [INFO ] [MAIN ] EOI: Loaded 10887 primary data records. [2025-10-09T22:38:01.068405] [DEBUG] [LOCAL ] EOG: Loaded 53734 existing records from primary storage. [2025-10-09T22:38:01.068923] [INFO ] [MAIN ] EOG: Loaded 53734 primary data records. [2025-10-09T22:38:01.248702] [DEBUG] [MAIN ] EOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:01.270133] [INFO ] [MAIN ] EOD: Generated 1807 derivative records from 14933 primary records. [2025-10-09T22:38:01.285515] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-09T22:38:01.444447] [DEBUG] [MAIN ] EOI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:01.445266] [INFO ] [MAIN ] EOI: Generated 1807 derivative records from 10887 primary records. [2025-10-09T22:38:01.444146] [DEBUG] [LOCAL ] EOD: Derivative data saved (1807 records). [2025-10-09T22:38:01.445394] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-09T22:38:01.445852] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-09T22:38:01.449072] [INFO ] [MAIN ] Derivative Progress: 607/1690 symbols completed. EOD took 1.2s. Estimated remaining: 7m 3s. Rate: 153.7 symbols/min [2025-10-09T22:38:01.450044] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:01.468017] [DEBUG] [LOCAL ] EOI: Derivative data saved (1807 records). [2025-10-09T22:38:01.468479] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-09T22:38:01.472146] [INFO ] [MAIN ] Derivative Progress: 608/1690 symbols completed. EOI took 1.1s. Estimated remaining: 7m 2s. Rate: 154.0 symbols/min [2025-10-09T22:38:01.477023] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:01.491822] [DEBUG] [MAIN ] EOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:01.498682] [INFO ] [MAIN ] EOG: Generated 1807 derivative records from 53734 primary records. [2025-10-09T22:38:01.499044] [DEBUG] [LOCAL ] EOS: Loaded 15505 existing records from primary storage. [2025-10-09T22:38:01.501449] [INFO ] [MAIN ] EOS: Loaded 15505 primary data records. [2025-10-09T22:38:01.522124] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-09T22:38:01.572838] [DEBUG] [LOCAL ] EOT: Loaded 6841 existing records from primary storage. [2025-10-09T22:38:01.585060] [INFO ] [MAIN ] EOT: Loaded 6841 primary data records. [2025-10-09T22:38:01.833886] [DEBUG] [LOCAL ] EOG: Derivative data saved (1807 records). [2025-10-09T22:38:01.942536] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-09T22:38:01.981681] [INFO ] [MAIN ] Derivative Progress: 609/1690 symbols completed. EOG took 1.6s. Estimated remaining: 7m 1s. Rate: 153.9 symbols/min [2025-10-09T22:38:02.001880] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:02.222102] [DEBUG] [LOCAL ] EPAC: Loaded 26880 existing records from primary storage. [2025-10-09T22:38:02.223405] [DEBUG] [MAIN ] EOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:02.223535] [INFO ] [MAIN ] EPAC: Loaded 26880 primary data records. [2025-10-09T22:38:02.225377] [INFO ] [MAIN ] EOS: Generated 1807 derivative records from 15505 primary records. [2025-10-09T22:38:02.230721] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-09T22:38:02.383055] [DEBUG] [MAIN ] EOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:02.390245] [INFO ] [MAIN ] EOT: Generated 1807 derivative records from 6841 primary records. [2025-10-09T22:38:02.391149] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-09T22:38:02.427096] [DEBUG] [LOCAL ] EOS: Derivative data saved (1807 records). [2025-10-09T22:38:02.449154] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-09T22:38:02.462933] [INFO ] [MAIN ] Derivative Progress: 610/1690 symbols completed. EOS took 1.0s. Estimated remaining: 7m 1s. Rate: 153.8 symbols/min [2025-10-09T22:38:02.463681] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:02.482128] [DEBUG] [LOCAL ] EOT: Derivative data saved (1807 records). [2025-10-09T22:38:02.507547] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-09T22:38:02.629982] [INFO ] [MAIN ] Derivative Progress: 611/1690 symbols completed. EOT took 1.2s. Estimated remaining: 7m 0s. Rate: 154.0 symbols/min [2025-10-09T22:38:02.641978] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:02.688068] [DEBUG] [LOCAL ] EPC: Loaded 40043 existing records from primary storage. [2025-10-09T22:38:02.696434] [INFO ] [MAIN ] EPC: Loaded 40043 primary data records. [2025-10-09T22:38:02.702141] [DEBUG] [MAIN ] EPAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:02.726314] [INFO ] [MAIN ] EPAC: Generated 1807 derivative records from 26880 primary records. [2025-10-09T22:38:02.743445] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-09T22:38:02.871139] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1807 records). [2025-10-09T22:38:02.892278] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-09T22:38:02.895821] [INFO ] [MAIN ] Derivative Progress: 612/1690 symbols completed. EPAC took 0.9s. Estimated remaining: 6m 60s. Rate: 154.1 symbols/min [2025-10-09T22:38:02.897314] [DEBUG] [LOCAL ] EPD: Loaded 54001 existing records from primary storage. [2025-10-09T22:38:02.896079] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:02.902839] [INFO ] [MAIN ] EPD: Loaded 54001 primary data records. [2025-10-09T22:38:03.507488] [DEBUG] [LOCAL ] EPR: Loaded 44256 existing records from primary storage. [2025-10-09T22:38:03.509254] [INFO ] [MAIN ] EPR: Loaded 44256 primary data records. [2025-10-09T22:38:03.709712] [DEBUG] [MAIN ] EPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:03.740628] [INFO ] [MAIN ] EPC: Generated 1807 derivative records from 40043 primary records. [2025-10-09T22:38:03.748799] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-09T22:38:03.906785] [DEBUG] [LOCAL ] EPC: Derivative data saved (1807 records). [2025-10-09T22:38:03.907188] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-09T22:38:03.910882] [INFO ] [MAIN ] Derivative Progress: 613/1690 symbols completed. EPC took 1.4s. Estimated remaining: 7m 1s. Rate: 153.7 symbols/min [2025-10-09T22:38:03.926152] [DEBUG] [MAIN ] EPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:03.928219] [INFO ] [MAIN ] EPD: Generated 1807 derivative records from 54001 primary records. [2025-10-09T22:38:03.928318] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-09T22:38:03.946507] [DEBUG] [LOCAL ] EPD: Derivative data saved (1807 records). [2025-10-09T22:38:03.946770] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-09T22:38:03.950532] [INFO ] [MAIN ] Derivative Progress: 614/1690 symbols completed. EPD took 1.3s. Estimated remaining: 6m 60s. Rate: 153.9 symbols/min [2025-10-09T22:38:03.967466] [DEBUG] [MAIN ] EPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:03.968189] [INFO ] [MAIN ] EPR: Generated 1807 derivative records from 44256 primary records. [2025-10-09T22:38:03.968253] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-09T22:38:03.984525] [DEBUG] [LOCAL ] EPR: Derivative data saved (1807 records). [2025-10-09T22:38:03.984607] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-09T22:38:03.987829] [INFO ] [MAIN ] Derivative Progress: 615/1690 symbols completed. EPR took 1.1s. Estimated remaining: 6m 59s. Rate: 154.1 symbols/min [2025-10-09T22:38:03.988508] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:03.988602] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:03.989476] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:04.009344] [DEBUG] [LOCAL ] EQBK: Loaded 11036 existing records from primary storage. [2025-10-09T22:38:04.009577] [INFO ] [MAIN ] EQBK: Loaded 11036 primary data records. [2025-10-09T22:38:04.394554] [DEBUG] [LOCAL ] EPRT: Loaded 48787 existing records from primary storage. [2025-10-09T22:38:04.410972] [DEBUG] [LOCAL ] EQH: Loaded 53036 existing records from primary storage. [2025-10-09T22:38:04.411964] [INFO ] [MAIN ] EPRT: Loaded 48787 primary data records. [2025-10-09T22:38:04.412100] [INFO ] [MAIN ] EQH: Loaded 53036 primary data records. [2025-10-09T22:38:05.062043] [DEBUG] [MAIN ] EQBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:05.063367] [INFO ] [MAIN ] EQBK: Generated 1807 derivative records from 11036 primary records. [2025-10-09T22:38:05.063628] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-09T22:38:05.083624] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1807 records). [2025-10-09T22:38:05.084230] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-09T22:38:05.087345] [INFO ] [MAIN ] Derivative Progress: 616/1690 symbols completed. EQBK took 1.1s. Estimated remaining: 6m 59s. Rate: 153.7 symbols/min [2025-10-09T22:38:05.087857] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:05.105502] [DEBUG] [MAIN ] EQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:05.106418] [INFO ] [MAIN ] EQH: Generated 1807 derivative records from 53036 primary records. [2025-10-09T22:38:05.106716] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-09T22:38:05.137507] [DEBUG] [LOCAL ] EQH: Derivative data saved (1807 records). [2025-10-09T22:38:05.144257] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-09T22:38:05.147203] [INFO ] [MAIN ] Derivative Progress: 617/1690 symbols completed. EQH took 1.2s. Estimated remaining: 6m 58s. Rate: 153.9 symbols/min [2025-10-09T22:38:05.144550] [DEBUG] [MAIN ] EPRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:05.147612] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:05.148743] [INFO ] [MAIN ] EPRT: Generated 1807 derivative records from 48787 primary records. [2025-10-09T22:38:05.149222] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-09T22:38:05.182408] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1807 records). [2025-10-09T22:38:05.182543] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-09T22:38:05.185087] [INFO ] [MAIN ] Derivative Progress: 618/1690 symbols completed. EPRT took 1.2s. Estimated remaining: 6m 57s. Rate: 154.1 symbols/min [2025-10-09T22:38:05.185267] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:05.206288] [DEBUG] [LOCAL ] EQNR: Loaded 53406 existing records from primary storage. [2025-10-09T22:38:05.207421] [INFO ] [MAIN ] EQNR: Loaded 53406 primary data records. [2025-10-09T22:38:05.601453] [DEBUG] [LOCAL ] EQR: Loaded 51995 existing records from primary storage. [2025-10-09T22:38:05.616294] [INFO ] [MAIN ] EQR: Loaded 51995 primary data records. [2025-10-09T22:38:05.698521] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-10-09T22:38:05.713990] [INFO ] [MAIN ] EQT: Loaded 54072 primary data records. [2025-10-09T22:38:06.305384] [DEBUG] [MAIN ] EQNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:06.306926] [INFO ] [MAIN ] EQNR: Generated 1807 derivative records from 53406 primary records. [2025-10-09T22:38:06.307504] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-09T22:38:06.327766] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1807 records). [2025-10-09T22:38:06.328273] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-09T22:38:06.331891] [INFO ] [MAIN ] Derivative Progress: 619/1690 symbols completed. EQNR took 1.2s. Estimated remaining: 6m 58s. Rate: 153.6 symbols/min [2025-10-09T22:38:06.332677] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:06.342953] [DEBUG] [LOCAL ] EQV: Loaded 2713 existing records from primary storage. [2025-10-09T22:38:06.343283] [INFO ] [MAIN ] EQV: Loaded 2713 primary data records. [2025-10-09T22:38:06.412235] [DEBUG] [MAIN ] EQR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:06.428218] [INFO ] [MAIN ] EQR: Generated 1807 derivative records from 51995 primary records. [2025-10-09T22:38:06.428340] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-09T22:38:06.483770] [DEBUG] [LOCAL ] EQR: Derivative data saved (1807 records). [2025-10-09T22:38:06.541242] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-09T22:38:06.545301] [INFO ] [MAIN ] Derivative Progress: 620/1690 symbols completed. EQR took 1.4s. Estimated remaining: 6m 58s. Rate: 153.7 symbols/min [2025-10-09T22:38:06.567939] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:06.586987] [DEBUG] [MAIN ] EQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:06.706297] [INFO ] [MAIN ] EQT: Generated 1807 derivative records from 54072 primary records. [2025-10-09T22:38:06.706716] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-09T22:38:06.729696] [DEBUG] [LOCAL ] EQT: Derivative data saved (1807 records). [2025-10-09T22:38:06.729834] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-09T22:38:06.734101] [INFO ] [MAIN ] Derivative Progress: 621/1690 symbols completed. EQT took 1.5s. Estimated remaining: 6m 57s. Rate: 153.8 symbols/min [2025-10-09T22:38:06.734619] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:06.768355] [DEBUG] [MAIN ] EQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:06.769249] [INFO ] [MAIN ] EQV: Generated 1807 derivative records from 2713 primary records. [2025-10-09T22:38:06.781883] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-09T22:38:06.786260] [DEBUG] [LOCAL ] ERJ: Loaded 50781 existing records from primary storage. [2025-10-09T22:38:06.792504] [INFO ] [MAIN ] ERJ: Loaded 50781 primary data records. [2025-10-09T22:38:06.822308] [DEBUG] [LOCAL ] EQV: Derivative data saved (1807 records). [2025-10-09T22:38:06.854004] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-09T22:38:06.884626] [INFO ] [MAIN ] Derivative Progress: 622/1690 symbols completed. EQV took 0.6s. Estimated remaining: 6m 56s. Rate: 154.0 symbols/min [2025-10-09T22:38:06.926899] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:06.942355] [DEBUG] [LOCAL ] ERO: Loaded 41893 existing records from primary storage. [2025-10-09T22:38:06.953132] [INFO ] [MAIN ] ERO: Loaded 41893 primary data records. [2025-10-09T22:38:07.535856] [DEBUG] [LOCAL ] ES: Loaded 53014 existing records from primary storage. [2025-10-09T22:38:07.534372] [DEBUG] [MAIN ] ERJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:07.536333] [INFO ] [MAIN ] ES: Loaded 53014 primary data records. [2025-10-09T22:38:07.537290] [INFO ] [MAIN ] ERJ: Generated 1807 derivative records from 50781 primary records. [2025-10-09T22:38:07.537523] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-09T22:38:07.654261] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1807 records). [2025-10-09T22:38:07.658279] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-09T22:38:07.666782] [INFO ] [MAIN ] Derivative Progress: 623/1690 symbols completed. ERJ took 1.1s. Estimated remaining: 6m 56s. Rate: 153.8 symbols/min [2025-10-09T22:38:07.672157] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:07.722804] [DEBUG] [MAIN ] ERO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:07.753022] [INFO ] [MAIN ] ERO: Generated 1807 derivative records from 41893 primary records. [2025-10-09T22:38:07.753180] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-09T22:38:07.891977] [DEBUG] [LOCAL ] ERO: Derivative data saved (1807 records). [2025-10-09T22:38:07.892444] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-09T22:38:07.895564] [INFO ] [MAIN ] Derivative Progress: 624/1690 symbols completed. ERO took 1.2s. Estimated remaining: 6m 56s. Rate: 153.9 symbols/min [2025-10-09T22:38:07.896436] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:07.906342] [DEBUG] [LOCAL ] ESAB: Loaded 26259 existing records from primary storage. [2025-10-09T22:38:07.906881] [INFO ] [MAIN ] ESAB: Loaded 26259 primary data records. [2025-10-09T22:38:08.098888] [DEBUG] [LOCAL ] ESE: Loaded 16664 existing records from primary storage. [2025-10-09T22:38:08.105566] [INFO ] [MAIN ] ESE: Loaded 16664 primary data records. [2025-10-09T22:38:08.329727] [DEBUG] [MAIN ] ES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:08.344503] [INFO ] [MAIN ] ES: Generated 1807 derivative records from 53014 primary records. [2025-10-09T22:38:08.348062] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-09T22:38:08.566448] [DEBUG] [LOCAL ] ES: Derivative data saved (1807 records). [2025-10-09T22:38:08.568393] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-09T22:38:08.574749] [INFO ] [MAIN ] Derivative Progress: 625/1690 symbols completed. ES took 1.6s. Estimated remaining: 6m 56s. Rate: 153.7 symbols/min [2025-10-09T22:38:08.575288] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:08.591529] [DEBUG] [MAIN ] ESAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:08.592790] [INFO ] [MAIN ] ESAB: Generated 1807 derivative records from 26259 primary records. [2025-10-09T22:38:08.593046] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-09T22:38:08.613257] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1807 records). [2025-10-09T22:38:08.613982] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-09T22:38:08.617106] [INFO ] [MAIN ] Derivative Progress: 626/1690 symbols completed. ESAB took 0.9s. Estimated remaining: 6m 55s. Rate: 153.9 symbols/min [2025-10-09T22:38:08.617451] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:08.656453] [DEBUG] [MAIN ] ESE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:08.657193] [INFO ] [MAIN ] ESE: Generated 1807 derivative records from 16664 primary records. [2025-10-09T22:38:08.657301] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-09T22:38:08.692594] [DEBUG] [LOCAL ] ESE: Derivative data saved (1807 records). [2025-10-09T22:38:08.693013] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-09T22:38:08.693969] [DEBUG] [LOCAL ] ESI: Loaded 51049 existing records from primary storage. [2025-10-09T22:38:08.694116] [INFO ] [MAIN ] ESI: Loaded 51049 primary data records. [2025-10-09T22:38:08.697889] [INFO ] [MAIN ] Derivative Progress: 627/1690 symbols completed. ESE took 0.8s. Estimated remaining: 6m 54s. Rate: 154.1 symbols/min [2025-10-09T22:38:08.698355] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:08.823506] [DEBUG] [LOCAL ] ESNT: Loaded 38557 existing records from primary storage. [2025-10-09T22:38:08.827961] [INFO ] [MAIN ] ESNT: Loaded 38557 primary data records. [2025-10-09T22:38:09.211264] [DEBUG] [LOCAL ] ESRT: Loaded 46673 existing records from primary storage. [2025-10-09T22:38:09.278683] [INFO ] [MAIN ] ESRT: Loaded 46673 primary data records. [2025-10-09T22:38:09.749118] [DEBUG] [MAIN ] ESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:09.750444] [INFO ] [MAIN ] ESI: Generated 1807 derivative records from 51049 primary records. [2025-10-09T22:38:09.750791] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-09T22:38:09.770984] [DEBUG] [LOCAL ] ESI: Derivative data saved (1807 records). [2025-10-09T22:38:09.771922] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-09T22:38:09.774493] [INFO ] [MAIN ] Derivative Progress: 628/1690 symbols completed. ESI took 1.2s. Estimated remaining: 6m 55s. Rate: 153.7 symbols/min [2025-10-09T22:38:09.789277] [DEBUG] [MAIN ] ESNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:09.789906] [INFO ] [MAIN ] ESNT: Generated 1807 derivative records from 38557 primary records. [2025-10-09T22:38:09.790170] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-09T22:38:09.806462] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1807 records). [2025-10-09T22:38:09.806683] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-09T22:38:09.809277] [INFO ] [MAIN ] Derivative Progress: 629/1690 symbols completed. ESNT took 1.2s. Estimated remaining: 6m 54s. Rate: 153.9 symbols/min [2025-10-09T22:38:09.824081] [DEBUG] [MAIN ] ESRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:09.824592] [INFO ] [MAIN ] ESRT: Generated 1807 derivative records from 46673 primary records. [2025-10-09T22:38:09.824676] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-09T22:38:09.839360] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1807 records). [2025-10-09T22:38:09.839419] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-09T22:38:09.841942] [INFO ] [MAIN ] Derivative Progress: 630/1690 symbols completed. ESRT took 1.1s. Estimated remaining: 6m 53s. Rate: 154.1 symbols/min [2025-10-09T22:38:09.842330] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:09.842423] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:09.842543] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:09.888916] [DEBUG] [LOCAL ] ESS: Loaded 29941 existing records from primary storage. [2025-10-09T22:38:09.889100] [INFO ] [MAIN ] ESS: Loaded 29941 primary data records. [2025-10-09T22:38:10.078690] [DEBUG] [LOCAL ] ESTC: Loaded 50479 existing records from primary storage. [2025-10-09T22:38:10.230637] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-09T22:38:10.229401] [INFO ] [MAIN ] ESTC: Loaded 50479 primary data records. [2025-10-09T22:38:10.231057] [INFO ] [MAIN ] ET: Loaded 54179 primary data records. [2025-10-09T22:38:10.882992] [DEBUG] [MAIN ] ESS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:10.884447] [INFO ] [MAIN ] ESS: Generated 1807 derivative records from 29941 primary records. [2025-10-09T22:38:10.884763] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-09T22:38:10.903797] [DEBUG] [LOCAL ] ESS: Derivative data saved (1807 records). [2025-10-09T22:38:10.904219] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-09T22:38:10.907052] [INFO ] [MAIN ] Derivative Progress: 631/1690 symbols completed. ESS took 1.1s. Estimated remaining: 6m 53s. Rate: 153.7 symbols/min [2025-10-09T22:38:10.907309] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:10.939581] [DEBUG] [MAIN ] ET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:10.939871] [DEBUG] [MAIN ] ESTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:10.941298] [INFO ] [MAIN ] ET: Generated 1807 derivative records from 54179 primary records. [2025-10-09T22:38:10.941423] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-09T22:38:10.940622] [INFO ] [MAIN ] ESTC: Generated 1807 derivative records from 50479 primary records. [2025-10-09T22:38:10.942592] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-09T22:38:10.969631] [DEBUG] [LOCAL ] ET: Derivative data saved (1807 records). [2025-10-09T22:38:10.970730] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-09T22:38:10.975796] [INFO ] [MAIN ] Derivative Progress: 632/1690 symbols completed. ET took 1.1s. Estimated remaining: 6m 53s. Rate: 153.9 symbols/min [2025-10-09T22:38:10.978363] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:10.983527] [DEBUG] [LOCAL ] ETB: Loaded 12264 existing records from primary storage. [2025-10-09T22:38:10.984938] [INFO ] [MAIN ] ETB: Loaded 12264 primary data records. [2025-10-09T22:38:10.986448] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1807 records). [2025-10-09T22:38:10.997834] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-09T22:38:11.025218] [INFO ] [MAIN ] Derivative Progress: 633/1690 symbols completed. ESTC took 1.2s. Estimated remaining: 6m 52s. Rate: 154.1 symbols/min [2025-10-09T22:38:11.060087] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:11.315825] [DEBUG] [LOCAL ] ETD: Loaded 27570 existing records from primary storage. [2025-10-09T22:38:11.316016] [INFO ] [MAIN ] ETD: Loaded 27570 primary data records. [2025-10-09T22:38:11.345270] [DEBUG] [LOCAL ] ETG: Loaded 16668 existing records from primary storage. [2025-10-09T22:38:11.369495] [INFO ] [MAIN ] ETG: Loaded 16668 primary data records. [2025-10-09T22:38:12.037918] [DEBUG] [MAIN ] ETB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:12.039715] [INFO ] [MAIN ] ETB: Generated 1807 derivative records from 12264 primary records. [2025-10-09T22:38:12.040162] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-09T22:38:12.061227] [DEBUG] [LOCAL ] ETB: Derivative data saved (1807 records). [2025-10-09T22:38:12.061807] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-09T22:38:12.064619] [INFO ] [MAIN ] Derivative Progress: 634/1690 symbols completed. ETB took 1.2s. Estimated remaining: 6m 52s. Rate: 153.7 symbols/min [2025-10-09T22:38:12.065173] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:12.083909] [DEBUG] [MAIN ] ETD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:12.087246] [INFO ] [MAIN ] ETD: Generated 1807 derivative records from 27570 primary records. [2025-10-09T22:38:12.087333] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-09T22:38:12.124425] [DEBUG] [MAIN ] ETG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:12.126161] [DEBUG] [LOCAL ] ETJ: Loaded 17098 existing records from primary storage. [2025-10-09T22:38:12.128171] [INFO ] [MAIN ] ETG: Generated 1807 derivative records from 16668 primary records. [2025-10-09T22:38:12.127174] [INFO ] [MAIN ] ETJ: Loaded 17098 primary data records. [2025-10-09T22:38:12.128630] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-09T22:38:12.220828] [DEBUG] [LOCAL ] ETG: Derivative data saved (1807 records). [2025-10-09T22:38:12.214894] [DEBUG] [LOCAL ] ETD: Derivative data saved (1807 records). [2025-10-09T22:38:12.232999] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-09T22:38:12.232905] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-09T22:38:12.240765] [INFO ] [MAIN ] Derivative Progress: 635/1690 symbols completed. ETG took 1.2s. Estimated remaining: 6m 52s. Rate: 153.8 symbols/min [2025-10-09T22:38:12.249331] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:12.256405] [INFO ] [MAIN ] Derivative Progress: 636/1690 symbols completed. ETD took 1.3s. Estimated remaining: 6m 51s. Rate: 154.1 symbols/min [2025-10-09T22:38:12.260500] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:12.458545] [DEBUG] [LOCAL ] ETO: Loaded 6884 existing records from primary storage. [2025-10-09T22:38:12.472345] [INFO ] [MAIN ] ETO: Loaded 6884 primary data records. [2025-10-09T22:38:12.815371] [DEBUG] [LOCAL ] ETN: Loaded 53075 existing records from primary storage. [2025-10-09T22:38:12.815931] [INFO ] [MAIN ] ETN: Loaded 53075 primary data records. [2025-10-09T22:38:12.942884] [DEBUG] [MAIN ] ETJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:12.959317] [INFO ] [MAIN ] ETJ: Generated 1807 derivative records from 17098 primary records. [2025-10-09T22:38:12.959470] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-09T22:38:13.157624] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1807 records). [2025-10-09T22:38:13.157794] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-09T22:38:13.160208] [INFO ] [MAIN ] Derivative Progress: 637/1690 symbols completed. ETJ took 1.1s. Estimated remaining: 6m 51s. Rate: 153.7 symbols/min [2025-10-09T22:38:13.160513] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:13.188144] [DEBUG] [MAIN ] ETO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:13.189888] [INFO ] [MAIN ] ETO: Generated 1807 derivative records from 6884 primary records. [2025-10-09T22:38:13.190011] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-09T22:38:13.221530] [DEBUG] [LOCAL ] ETO: Derivative data saved (1807 records). [2025-10-09T22:38:13.227676] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-09T22:38:13.227450] [DEBUG] [MAIN ] ETN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:13.230569] [INFO ] [MAIN ] Derivative Progress: 638/1690 symbols completed. ETO took 1.0s. Estimated remaining: 6m 50s. Rate: 153.9 symbols/min [2025-10-09T22:38:13.231073] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:13.232233] [INFO ] [MAIN ] ETN: Generated 1807 derivative records from 53075 primary records. [2025-10-09T22:38:13.232553] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-09T22:38:13.265787] [DEBUG] [LOCAL ] ETN: Derivative data saved (1807 records). [2025-10-09T22:38:13.266065] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-09T22:38:13.268416] [INFO ] [MAIN ] Derivative Progress: 639/1690 symbols completed. ETN took 1.0s. Estimated remaining: 6m 49s. Rate: 154.1 symbols/min [2025-10-09T22:38:13.268860] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:13.295089] [DEBUG] [LOCAL ] ETR: Loaded 53610 existing records from primary storage. [2025-10-09T22:38:13.295381] [INFO ] [MAIN ] ETR: Loaded 53610 primary data records. [2025-10-09T22:38:13.352433] [DEBUG] [LOCAL ] ETX: Loaded 5243 existing records from primary storage. [2025-10-09T22:38:13.380283] [DEBUG] [LOCAL ] ETW: Loaded 25618 existing records from primary storage. [2025-10-09T22:38:13.387867] [INFO ] [MAIN ] ETX: Loaded 5243 primary data records. [2025-10-09T22:38:13.393228] [INFO ] [MAIN ] ETW: Loaded 25618 primary data records. [2025-10-09T22:38:14.294017] [DEBUG] [MAIN ] ETR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:14.294985] [INFO ] [MAIN ] ETR: Generated 1807 derivative records from 53610 primary records. [2025-10-09T22:38:14.295188] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-09T22:38:14.343419] [DEBUG] [MAIN ] ETX: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:38:14.343064] [DEBUG] [MAIN ] ETW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:14.344290] [INFO ] [MAIN ] ETX: Generated 1805 derivative records from 5243 primary records. [2025-10-09T22:38:14.345446] [INFO ] [MAIN ] ETW: Generated 1807 derivative records from 25618 primary records. [2025-10-09T22:38:14.345958] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-09T22:38:14.345825] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-09T22:38:14.364151] [DEBUG] [LOCAL ] ETR: Derivative data saved (1807 records). [2025-10-09T22:38:14.365557] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-09T22:38:14.380751] [DEBUG] [LOCAL ] ETW: Derivative data saved (1807 records). [2025-10-09T22:38:14.380030] [INFO ] [MAIN ] Derivative Progress: 640/1690 symbols completed. ETR took 1.2s. Estimated remaining: 6m 50s. Rate: 153.7 symbols/min [2025-10-09T22:38:14.383174] [DEBUG] [LOCAL ] ETX: Derivative data saved (1805 records). [2025-10-09T22:38:14.383473] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-09T22:38:14.386538] [INFO ] [MAIN ] Derivative Progress: 641/1690 symbols completed. ETW took 1.2s. Estimated remaining: 6m 49s. Rate: 153.9 symbols/min [2025-10-09T22:38:14.383286] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:14.386805] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:14.383618] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-09T22:38:14.389836] [INFO ] [MAIN ] Derivative Progress: 642/1690 symbols completed. ETX took 1.1s. Estimated remaining: 6m 48s. Rate: 154.2 symbols/min [2025-10-09T22:38:14.389985] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:14.423696] [DEBUG] [LOCAL ] EVC: Loaded 18310 existing records from primary storage. [2025-10-09T22:38:14.430180] [INFO ] [MAIN ] EVC: Loaded 18310 primary data records. [2025-10-09T22:38:14.452588] [DEBUG] [LOCAL ] ETY: Loaded 23191 existing records from primary storage. [2025-10-09T22:38:14.474728] [INFO ] [MAIN ] ETY: Loaded 23191 primary data records. [2025-10-09T22:38:14.522099] [DEBUG] [LOCAL ] EVEX: Loaded 31707 existing records from primary storage. [2025-10-09T22:38:14.533172] [INFO ] [MAIN ] EVEX: Loaded 31707 primary data records. [2025-10-09T22:38:15.495380] [DEBUG] [MAIN ] EVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:15.496538] [INFO ] [MAIN ] EVC: Generated 1807 derivative records from 18310 primary records. [2025-10-09T22:38:15.509880] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-09T22:38:15.511191] [DEBUG] [MAIN ] ETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:15.512857] [INFO ] [MAIN ] ETY: Generated 1807 derivative records from 23191 primary records. [2025-10-09T22:38:15.520755] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-09T22:38:15.559098] [DEBUG] [MAIN ] EVEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:15.561136] [INFO ] [MAIN ] EVEX: Generated 1807 derivative records from 31707 primary records. [2025-10-09T22:38:15.562248] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-09T22:38:15.562596] [DEBUG] [LOCAL ] EVC: Derivative data saved (1807 records). [2025-10-09T22:38:15.564408] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-09T22:38:15.566800] [INFO ] [MAIN ] Derivative Progress: 643/1690 symbols completed. EVC took 1.2s. Estimated remaining: 6m 49s. Rate: 153.7 symbols/min [2025-10-09T22:38:15.568154] [DEBUG] [LOCAL ] ETY: Derivative data saved (1807 records). [2025-10-09T22:38:15.576541] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-09T22:38:15.582027] [INFO ] [MAIN ] Derivative Progress: 644/1690 symbols completed. ETY took 1.2s. Estimated remaining: 6m 48s. Rate: 153.9 symbols/min [2025-10-09T22:38:15.586235] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1807 records). [2025-10-09T22:38:15.586309] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-09T22:38:15.589033] [INFO ] [MAIN ] Derivative Progress: 645/1690 symbols completed. EVEX took 1.2s. Estimated remaining: 6m 47s. Rate: 154.2 symbols/min [2025-10-09T22:38:15.589623] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:15.589722] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:15.590048] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:15.603527] [DEBUG] [LOCAL ] EVG: Loaded 6026 existing records from primary storage. [2025-10-09T22:38:15.603747] [INFO ] [MAIN ] EVG: Loaded 6026 primary data records. [2025-10-09T22:38:15.654600] [DEBUG] [LOCAL ] EVF: Loaded 9843 existing records from primary storage. [2025-10-09T22:38:15.671511] [INFO ] [MAIN ] EVF: Loaded 9843 primary data records. [2025-10-09T22:38:16.251158] [DEBUG] [LOCAL ] EVH: Loaded 49927 existing records from primary storage. [2025-10-09T22:38:16.251986] [INFO ] [MAIN ] EVH: Loaded 49927 primary data records. [2025-10-09T22:38:16.611268] [DEBUG] [MAIN ] EVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:16.611880] [DEBUG] [MAIN ] EVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:16.612800] [INFO ] [MAIN ] EVF: Generated 1807 derivative records from 9843 primary records. [2025-10-09T22:38:16.613884] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-09T22:38:16.615478] [INFO ] [MAIN ] EVG: Generated 1807 derivative records from 6026 primary records. [2025-10-09T22:38:16.615787] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-09T22:38:16.649293] [DEBUG] [LOCAL ] EVF: Derivative data saved (1807 records). [2025-10-09T22:38:16.649941] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-09T22:38:16.654067] [INFO ] [MAIN ] Derivative Progress: 646/1690 symbols completed. EVF took 1.1s. Estimated remaining: 6m 47s. Rate: 153.7 symbols/min [2025-10-09T22:38:16.655943] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:16.656869] [DEBUG] [LOCAL ] EVG: Derivative data saved (1807 records). [2025-10-09T22:38:16.660056] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-09T22:38:16.662371] [INFO ] [MAIN ] Derivative Progress: 647/1690 symbols completed. EVG took 1.1s. Estimated remaining: 6m 46s. Rate: 154.0 symbols/min [2025-10-09T22:38:16.662689] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:16.676696] [DEBUG] [MAIN ] EVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:16.677521] [INFO ] [MAIN ] EVH: Generated 1807 derivative records from 49927 primary records. [2025-10-09T22:38:16.677624] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-09T22:38:16.697922] [DEBUG] [LOCAL ] EVH: Derivative data saved (1807 records). [2025-10-09T22:38:16.698138] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-09T22:38:16.700773] [INFO ] [MAIN ] Derivative Progress: 648/1690 symbols completed. EVH took 1.1s. Estimated remaining: 6m 45s. Rate: 154.2 symbols/min [2025-10-09T22:38:16.700994] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:16.708142] [DEBUG] [LOCAL ] EVN: Loaded 11172 existing records from primary storage. [2025-10-09T22:38:16.708509] [INFO ] [MAIN ] EVN: Loaded 11172 primary data records. [2025-10-09T22:38:16.852671] [DEBUG] [LOCAL ] EVR: Loaded 34827 existing records from primary storage. [2025-10-09T22:38:16.869239] [DEBUG] [LOCAL ] EVT: Loaded 16976 existing records from primary storage. [2025-10-09T22:38:16.874524] [INFO ] [MAIN ] EVR: Loaded 34827 primary data records. [2025-10-09T22:38:16.896065] [INFO ] [MAIN ] EVT: Loaded 16976 primary data records. [2025-10-09T22:38:17.778299] [DEBUG] [MAIN ] EVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:17.780225] [INFO ] [MAIN ] EVN: Generated 1807 derivative records from 11172 primary records. [2025-10-09T22:38:17.781344] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-09T22:38:17.813990] [DEBUG] [LOCAL ] EVN: Derivative data saved (1807 records). [2025-10-09T22:38:17.813453] [DEBUG] [MAIN ] EVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:17.815090] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-09T22:38:17.815022] [INFO ] [MAIN ] EVT: Generated 1807 derivative records from 16976 primary records. [2025-10-09T22:38:17.817278] [INFO ] [MAIN ] Derivative Progress: 649/1690 symbols completed. EVN took 1.2s. Estimated remaining: 6m 46s. Rate: 153.7 symbols/min [2025-10-09T22:38:17.817566] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-09T22:38:17.823137] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:17.848071] [DEBUG] [MAIN ] EVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:17.850427] [DEBUG] [LOCAL ] EVT: Derivative data saved (1807 records). [2025-10-09T22:38:17.851675] [INFO ] [MAIN ] EVR: Generated 1807 derivative records from 34827 primary records. [2025-10-09T22:38:17.851791] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-09T22:38:17.851870] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-09T22:38:17.855329] [INFO ] [MAIN ] Derivative Progress: 650/1690 symbols completed. EVT took 1.2s. Estimated remaining: 6m 45s. Rate: 154.0 symbols/min [2025-10-09T22:38:17.855846] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:17.885856] [DEBUG] [LOCAL ] EVR: Derivative data saved (1807 records). [2025-10-09T22:38:17.886062] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-09T22:38:17.892827] [INFO ] [MAIN ] Derivative Progress: 651/1690 symbols completed. EVR took 1.2s. Estimated remaining: 6m 44s. Rate: 154.2 symbols/min [2025-10-09T22:38:17.892975] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:17.904445] [DEBUG] [LOCAL ] EVTC: Loaded 26578 existing records from primary storage. [2025-10-09T22:38:17.904599] [INFO ] [MAIN ] EVTC: Loaded 26578 primary data records. [2025-10-09T22:38:18.084709] [DEBUG] [LOCAL ] EVTR: Loaded 24504 existing records from primary storage. [2025-10-09T22:38:18.227177] [DEBUG] [LOCAL ] EVTL: Loaded 39616 existing records from primary storage. [2025-10-09T22:38:18.240826] [INFO ] [MAIN ] EVTL: Loaded 39616 primary data records. [2025-10-09T22:38:18.123726] [INFO ] [MAIN ] EVTR: Loaded 24504 primary data records. [2025-10-09T22:38:18.928110] [DEBUG] [MAIN ] EVTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:18.930849] [INFO ] [MAIN ] EVTC: Generated 1807 derivative records from 26578 primary records. [2025-10-09T22:38:18.931108] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-09T22:38:18.948894] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1807 records). [2025-10-09T22:38:18.950084] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-09T22:38:18.952432] [INFO ] [MAIN ] Derivative Progress: 652/1690 symbols completed. EVTC took 1.1s. Estimated remaining: 6m 45s. Rate: 153.8 symbols/min [2025-10-09T22:38:18.952718] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:18.969806] [DEBUG] [MAIN ] EVTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:18.970502] [INFO ] [MAIN ] EVTL: Generated 1807 derivative records from 39616 primary records. [2025-10-09T22:38:18.970633] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-09T22:38:19.002214] [DEBUG] [MAIN ] EVTR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:38:19.003002] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1807 records). [2025-10-09T22:38:19.003678] [INFO ] [MAIN ] EVTR: Generated 1806 derivative records from 24504 primary records. [2025-10-09T22:38:19.003813] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-09T22:38:19.003963] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-09T22:38:19.007012] [INFO ] [MAIN ] Derivative Progress: 653/1690 symbols completed. EVTL took 1.2s. Estimated remaining: 6m 44s. Rate: 154.0 symbols/min [2025-10-09T22:38:19.008116] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:19.038321] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1806 records). [2025-10-09T22:38:19.038560] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-09T22:38:19.041300] [INFO ] [MAIN ] Derivative Progress: 654/1690 symbols completed. EVTR took 1.1s. Estimated remaining: 6m 43s. Rate: 154.2 symbols/min [2025-10-09T22:38:19.041541] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:19.072020] [DEBUG] [LOCAL ] EW: Loaded 53791 existing records from primary storage. [2025-10-09T22:38:19.072182] [INFO ] [MAIN ] EW: Loaded 53791 primary data records. [2025-10-09T22:38:19.190552] [DEBUG] [LOCAL ] EXG: Loaded 34445 existing records from primary storage. [2025-10-09T22:38:19.206423] [INFO ] [MAIN ] EXG: Loaded 34445 primary data records. [2025-10-09T22:38:19.592445] [DEBUG] [LOCAL ] EXK: Loaded 53532 existing records from primary storage. [2025-10-09T22:38:19.659829] [INFO ] [MAIN ] EXK: Loaded 53532 primary data records. [2025-10-09T22:38:20.106942] [DEBUG] [MAIN ] EW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:20.108291] [INFO ] [MAIN ] EW: Generated 1807 derivative records from 53791 primary records. [2025-10-09T22:38:20.108467] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-09T22:38:20.142098] [DEBUG] [MAIN ] EXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:20.143770] [INFO ] [MAIN ] EXG: Generated 1807 derivative records from 34445 primary records. [2025-10-09T22:38:20.143871] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-09T22:38:20.142993] [DEBUG] [LOCAL ] EW: Derivative data saved (1807 records). [2025-10-09T22:38:20.144050] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-09T22:38:20.147511] [INFO ] [MAIN ] Derivative Progress: 655/1690 symbols completed. EW took 1.2s. Estimated remaining: 6m 44s. Rate: 153.8 symbols/min [2025-10-09T22:38:20.154980] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:20.166596] [DEBUG] [LOCAL ] EXG: Derivative data saved (1807 records). [2025-10-09T22:38:20.166801] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-09T22:38:20.169616] [INFO ] [MAIN ] Derivative Progress: 656/1690 symbols completed. EXG took 1.2s. Estimated remaining: 6m 43s. Rate: 154.0 symbols/min [2025-10-09T22:38:20.170054] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:20.183164] [DEBUG] [MAIN ] EXK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:20.183830] [INFO ] [MAIN ] EXK: Generated 1807 derivative records from 53532 primary records. [2025-10-09T22:38:20.183908] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-09T22:38:20.208981] [DEBUG] [LOCAL ] EXK: Derivative data saved (1807 records). [2025-10-09T22:38:20.209158] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-09T22:38:20.211975] [INFO ] [MAIN ] Derivative Progress: 657/1690 symbols completed. EXK took 1.2s. Estimated remaining: 6m 42s. Rate: 154.2 symbols/min [2025-10-09T22:38:20.212118] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:20.225607] [DEBUG] [LOCAL ] EXP: Loaded 29811 existing records from primary storage. [2025-10-09T22:38:20.225770] [INFO ] [MAIN ] EXP: Loaded 29811 primary data records. [2025-10-09T22:38:20.552882] [DEBUG] [LOCAL ] EXPD: Loaded 48219 existing records from primary storage. [2025-10-09T22:38:20.565537] [INFO ] [MAIN ] EXPD: Loaded 48219 primary data records. [2025-10-09T22:38:20.686326] [DEBUG] [LOCAL ] EXR: Loaded 45561 existing records from primary storage. [2025-10-09T22:38:20.702903] [INFO ] [MAIN ] EXR: Loaded 45561 primary data records. [2025-10-09T22:38:21.212105] [DEBUG] [MAIN ] EXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:21.214101] [INFO ] [MAIN ] EXP: Generated 1807 derivative records from 29811 primary records. [2025-10-09T22:38:21.214316] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-09T22:38:21.232588] [DEBUG] [LOCAL ] EXP: Derivative data saved (1807 records). [2025-10-09T22:38:21.233058] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-09T22:38:21.237528] [INFO ] [MAIN ] Derivative Progress: 658/1690 symbols completed. EXP took 1.1s. Estimated remaining: 6m 43s. Rate: 153.8 symbols/min [2025-10-09T22:38:21.255507] [DEBUG] [MAIN ] EXPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:21.256297] [INFO ] [MAIN ] EXPD: Generated 1807 derivative records from 48219 primary records. [2025-10-09T22:38:21.256441] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-09T22:38:21.287113] [DEBUG] [MAIN ] EXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:21.287505] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1807 records). [2025-10-09T22:38:21.288226] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-09T22:38:21.288168] [INFO ] [MAIN ] EXR: Generated 1807 derivative records from 45561 primary records. [2025-10-09T22:38:21.290586] [INFO ] [MAIN ] Derivative Progress: 659/1690 symbols completed. EXPD took 1.1s. Estimated remaining: 6m 42s. Rate: 154.0 symbols/min [2025-10-09T22:38:21.288322] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-09T22:38:21.306793] [DEBUG] [LOCAL ] EXR: Derivative data saved (1807 records). [2025-10-09T22:38:21.306853] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-09T22:38:21.310531] [INFO ] [MAIN ] Derivative Progress: 660/1690 symbols completed. EXR took 1.1s. Estimated remaining: 6m 41s. Rate: 154.2 symbols/min [2025-10-09T22:38:21.310987] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:21.310918] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:21.311117] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:21.385766] [DEBUG] [LOCAL ] FAF: Loaded 41815 existing records from primary storage. [2025-10-09T22:38:21.386103] [INFO ] [MAIN ] FAF: Loaded 41815 primary data records. [2025-10-09T22:38:21.538560] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-09T22:38:21.549419] [DEBUG] [LOCAL ] FBIN: Loaded 50714 existing records from primary storage. [2025-10-09T22:38:21.543486] [INFO ] [MAIN ] F: Loaded 54210 primary data records. [2025-10-09T22:38:21.560393] [INFO ] [MAIN ] FBIN: Loaded 50714 primary data records. [2025-10-09T22:38:22.413472] [DEBUG] [MAIN ] FAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:22.414232] [INFO ] [MAIN ] FAF: Generated 1807 derivative records from 41815 primary records. [2025-10-09T22:38:22.414414] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-09T22:38:22.458444] [DEBUG] [MAIN ] F: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:22.459383] [INFO ] [MAIN ] F: Generated 1807 derivative records from 54210 primary records. [2025-10-09T22:38:22.458190] [DEBUG] [MAIN ] FBIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:22.460366] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-09T22:38:22.462455] [INFO ] [MAIN ] FBIN: Generated 1807 derivative records from 50714 primary records. [2025-10-09T22:38:22.462906] [DEBUG] [LOCAL ] FAF: Derivative data saved (1807 records). [2025-10-09T22:38:22.470473] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-09T22:38:22.473881] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-09T22:38:22.476048] [INFO ] [MAIN ] Derivative Progress: 661/1690 symbols completed. FAF took 1.2s. Estimated remaining: 6m 42s. Rate: 153.8 symbols/min [2025-10-09T22:38:22.476439] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:22.495665] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1807 records). [2025-10-09T22:38:22.495956] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-09T22:38:22.500239] [INFO ] [MAIN ] Derivative Progress: 662/1690 symbols completed. FBIN took 1.2s. Estimated remaining: 6m 41s. Rate: 154.0 symbols/min [2025-10-09T22:38:22.500713] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:22.502158] [DEBUG] [LOCAL ] F: Derivative data saved (1807 records). [2025-10-09T22:38:22.502225] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-09T22:38:22.505108] [INFO ] [MAIN ] Derivative Progress: 663/1690 symbols completed. F took 1.2s. Estimated remaining: 6m 40s. Rate: 154.2 symbols/min [2025-10-09T22:38:22.505714] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:22.526034] [DEBUG] [LOCAL ] FBK: Loaded 26942 existing records from primary storage. [2025-10-09T22:38:22.526171] [INFO ] [MAIN ] FBK: Loaded 26942 primary data records. [2025-10-09T22:38:22.737337] [DEBUG] [LOCAL ] FBRT: Loaded 35372 existing records from primary storage. [2025-10-09T22:38:22.766747] [INFO ] [MAIN ] FBRT: Loaded 35372 primary data records. [2025-10-09T22:38:22.792186] [DEBUG] [LOCAL ] FBP: Loaded 46095 existing records from primary storage. [2025-10-09T22:38:22.906237] [INFO ] [MAIN ] FBP: Loaded 46095 primary data records. [2025-10-09T22:38:23.614524] [DEBUG] [MAIN ] FBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:23.617015] [INFO ] [MAIN ] FBK: Generated 1807 derivative records from 26942 primary records. [2025-10-09T22:38:23.617682] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-09T22:38:23.636831] [DEBUG] [LOCAL ] FBK: Derivative data saved (1807 records). [2025-10-09T22:38:23.639062] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-09T22:38:23.641215] [INFO ] [MAIN ] Derivative Progress: 664/1690 symbols completed. FBK took 1.2s. Estimated remaining: 6m 40s. Rate: 153.8 symbols/min [2025-10-09T22:38:23.641419] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:23.674772] [DEBUG] [MAIN ] FBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:23.688810] [INFO ] [MAIN ] FBRT: Generated 1807 derivative records from 35372 primary records. [2025-10-09T22:38:23.675267] [DEBUG] [LOCAL ] FC: Loaded 15218 existing records from primary storage. [2025-10-09T22:38:23.689128] [INFO ] [MAIN ] FC: Loaded 15218 primary data records. [2025-10-09T22:38:23.689029] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-09T22:38:23.701424] [DEBUG] [MAIN ] FBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:23.712829] [INFO ] [MAIN ] FBP: Generated 1807 derivative records from 46095 primary records. [2025-10-09T22:38:23.723521] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-09T22:38:23.801454] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1807 records). [2025-10-09T22:38:23.833410] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-09T22:38:23.853695] [INFO ] [MAIN ] Derivative Progress: 665/1690 symbols completed. FBRT took 1.3s. Estimated remaining: 6m 40s. Rate: 153.9 symbols/min [2025-10-09T22:38:23.897261] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:23.897939] [DEBUG] [LOCAL ] FBP: Derivative data saved (1807 records). [2025-10-09T22:38:24.019839] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-09T22:38:24.052301] [INFO ] [MAIN ] Derivative Progress: 666/1690 symbols completed. FBP took 1.6s. Estimated remaining: 6m 39s. Rate: 154.0 symbols/min [2025-10-09T22:38:24.053383] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:24.097273] [DEBUG] [MAIN ] FC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:24.105872] [INFO ] [MAIN ] FC: Generated 1807 derivative records from 15218 primary records. [2025-10-09T22:38:24.105985] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-09T22:38:24.106557] [DEBUG] [LOCAL ] FCN: Loaded 26164 existing records from primary storage. [2025-10-09T22:38:24.107625] [INFO ] [MAIN ] FCN: Loaded 26164 primary data records. [2025-10-09T22:38:24.189471] [DEBUG] [LOCAL ] FCF: Loaded 39430 existing records from primary storage. [2025-10-09T22:38:24.199728] [INFO ] [MAIN ] FCF: Loaded 39430 primary data records. [2025-10-09T22:38:24.387007] [DEBUG] [LOCAL ] FC: Derivative data saved (1807 records). [2025-10-09T22:38:24.437029] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-09T22:38:24.621912] [INFO ] [MAIN ] Derivative Progress: 667/1690 symbols completed. FC took 1.0s. Estimated remaining: 6m 39s. Rate: 153.9 symbols/min [2025-10-09T22:38:24.740075] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:24.794165] [DEBUG] [MAIN ] FCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:24.796571] [INFO ] [MAIN ] FCN: Generated 1807 derivative records from 26164 primary records. [2025-10-09T22:38:24.797843] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-09T22:38:24.829788] [DEBUG] [LOCAL ] FCPT: Loaded 37591 existing records from primary storage. [2025-10-09T22:38:24.830011] [INFO ] [MAIN ] FCPT: Loaded 37591 primary data records. [2025-10-09T22:38:24.830459] [DEBUG] [MAIN ] FCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:24.856077] [INFO ] [MAIN ] FCF: Generated 1807 derivative records from 39430 primary records. [2025-10-09T22:38:24.872567] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-09T22:38:24.976080] [DEBUG] [LOCAL ] FCN: Derivative data saved (1807 records). [2025-10-09T22:38:24.986951] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-09T22:38:25.004155] [INFO ] [MAIN ] Derivative Progress: 668/1690 symbols completed. FCN took 1.0s. Estimated remaining: 6m 38s. Rate: 153.9 symbols/min [2025-10-09T22:38:25.031765] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:25.157696] [DEBUG] [LOCAL ] FCF: Derivative data saved (1807 records). [2025-10-09T22:38:25.172631] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-09T22:38:25.176035] [INFO ] [MAIN ] Derivative Progress: 669/1690 symbols completed. FCF took 1.3s. Estimated remaining: 6m 38s. Rate: 154.0 symbols/min [2025-10-09T22:38:25.176342] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:25.190962] [DEBUG] [LOCAL ] FCT: Loaded 14880 existing records from primary storage. [2025-10-09T22:38:25.191523] [INFO ] [MAIN ] FCT: Loaded 14880 primary data records. [2025-10-09T22:38:25.574077] [DEBUG] [MAIN ] FCPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:25.575628] [INFO ] [MAIN ] FCPT: Generated 1807 derivative records from 37591 primary records. [2025-10-09T22:38:25.588810] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-09T22:38:25.605099] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-10-09T22:38:25.606572] [INFO ] [MAIN ] FCX: Loaded 54090 primary data records. [2025-10-09T22:38:25.695961] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1807 records). [2025-10-09T22:38:25.696225] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-09T22:38:25.698618] [INFO ] [MAIN ] Derivative Progress: 670/1690 symbols completed. FCPT took 1.0s. Estimated remaining: 6m 38s. Rate: 153.9 symbols/min [2025-10-09T22:38:25.716802] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:25.985275] [DEBUG] [MAIN ] FCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:26.002502] [INFO ] [MAIN ] FCT: Generated 1807 derivative records from 14880 primary records. [2025-10-09T22:38:26.004203] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-09T22:38:26.004064] [DEBUG] [LOCAL ] FDP: Loaded 30266 existing records from primary storage. [2025-10-09T22:38:26.005163] [INFO ] [MAIN ] FDP: Loaded 30266 primary data records. [2025-10-09T22:38:26.174980] [DEBUG] [LOCAL ] FCT: Derivative data saved (1807 records). [2025-10-09T22:38:26.198327] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-09T22:38:26.238807] [INFO ] [MAIN ] Derivative Progress: 671/1690 symbols completed. FCT took 1.2s. Estimated remaining: 6m 37s. Rate: 153.8 symbols/min [2025-10-09T22:38:26.289299] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:26.500316] [DEBUG] [MAIN ] FCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:26.501468] [INFO ] [MAIN ] FCX: Generated 1807 derivative records from 54090 primary records. [2025-10-09T22:38:26.502507] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-09T22:38:26.547443] [DEBUG] [LOCAL ] FCX: Derivative data saved (1807 records). [2025-10-09T22:38:26.550065] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-09T22:38:26.567974] [INFO ] [MAIN ] Derivative Progress: 672/1690 symbols completed. FCX took 1.4s. Estimated remaining: 6m 37s. Rate: 153.9 symbols/min [2025-10-09T22:38:26.570834] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:26.572569] [DEBUG] [LOCAL ] FDS: Loaded 27281 existing records from primary storage. [2025-10-09T22:38:26.575093] [INFO ] [MAIN ] FDS: Loaded 27281 primary data records. [2025-10-09T22:38:26.819971] [DEBUG] [MAIN ] FDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:26.855709] [INFO ] [MAIN ] FDP: Generated 1807 derivative records from 30266 primary records. [2025-10-09T22:38:26.894962] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-09T22:38:27.123518] [DEBUG] [LOCAL ] FDX: Loaded 51817 existing records from primary storage. [2025-10-09T22:38:27.123967] [INFO ] [MAIN ] FDX: Loaded 51817 primary data records. [2025-10-09T22:38:27.121264] [DEBUG] [LOCAL ] FDP: Derivative data saved (1807 records). [2025-10-09T22:38:27.124230] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-09T22:38:27.133210] [INFO ] [MAIN ] Derivative Progress: 673/1690 symbols completed. FDP took 1.4s. Estimated remaining: 6m 37s. Rate: 153.8 symbols/min [2025-10-09T22:38:27.485087] [DEBUG] [MAIN ] FDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:27.486522] [INFO ] [MAIN ] FDS: Generated 1807 derivative records from 27281 primary records. [2025-10-09T22:38:27.486782] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-09T22:38:27.504360] [DEBUG] [LOCAL ] FDS: Derivative data saved (1807 records). [2025-10-09T22:38:27.504716] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-09T22:38:27.507821] [INFO ] [MAIN ] Derivative Progress: 674/1690 symbols completed. FDS took 1.2s. Estimated remaining: 6m 36s. Rate: 153.8 symbols/min [2025-10-09T22:38:27.523302] [DEBUG] [MAIN ] FDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:27.524092] [INFO ] [MAIN ] FDX: Generated 1807 derivative records from 51817 primary records. [2025-10-09T22:38:27.524157] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-09T22:38:27.540331] [DEBUG] [LOCAL ] FDX: Derivative data saved (1807 records). [2025-10-09T22:38:27.540403] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-09T22:38:27.543822] [INFO ] [MAIN ] Derivative Progress: 675/1690 symbols completed. FDX took 1.0s. Estimated remaining: 6m 35s. Rate: 154.0 symbols/min [2025-10-09T22:38:27.544447] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:27.544557] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:27.544698] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:27.562673] [DEBUG] [LOCAL ] FET: Loaded 12879 existing records from primary storage. [2025-10-09T22:38:27.562870] [INFO ] [MAIN ] FET: Loaded 12879 primary data records. [2025-10-09T22:38:27.926220] [DEBUG] [LOCAL ] FE: Loaded 53823 existing records from primary storage. [2025-10-09T22:38:27.926801] [INFO ] [MAIN ] FE: Loaded 53823 primary data records. [2025-10-09T22:38:27.928831] [DEBUG] [LOCAL ] FERG: Loaded 49116 existing records from primary storage. [2025-10-09T22:38:27.962769] [INFO ] [MAIN ] FERG: Loaded 49116 primary data records. [2025-10-09T22:38:28.593130] [DEBUG] [MAIN ] FET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:28.659476] [INFO ] [MAIN ] FET: Generated 1807 derivative records from 12879 primary records. [2025-10-09T22:38:28.659765] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-09T22:38:28.687231] [DEBUG] [LOCAL ] FET: Derivative data saved (1807 records). [2025-10-09T22:38:28.687832] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-09T22:38:28.690437] [INFO ] [MAIN ] Derivative Progress: 676/1690 symbols completed. FET took 1.1s. Estimated remaining: 6m 36s. Rate: 153.6 symbols/min [2025-10-09T22:38:28.692540] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:28.710941] [DEBUG] [MAIN ] FE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:28.712144] [INFO ] [MAIN ] FE: Generated 1807 derivative records from 53823 primary records. [2025-10-09T22:38:28.712476] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-09T22:38:28.743089] [DEBUG] [LOCAL ] FE: Derivative data saved (1807 records). [2025-10-09T22:38:28.751309] [DEBUG] [LOCAL ] FF: Loaded 24629 existing records from primary storage. [2025-10-09T22:38:28.751430] [INFO ] [MAIN ] FF: Loaded 24629 primary data records. [2025-10-09T22:38:28.750860] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-09T22:38:28.754389] [INFO ] [MAIN ] Derivative Progress: 677/1690 symbols completed. FE took 1.2s. Estimated remaining: 6m 35s. Rate: 153.7 symbols/min [2025-10-09T22:38:28.756463] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:28.858192] [DEBUG] [MAIN ] FERG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:28.900006] [DEBUG] [LOCAL ] FFA: Loaded 6118 existing records from primary storage. [2025-10-09T22:38:28.905913] [INFO ] [MAIN ] FERG: Generated 1807 derivative records from 49116 primary records. [2025-10-09T22:38:28.937345] [INFO ] [MAIN ] FFA: Loaded 6118 primary data records. [2025-10-09T22:38:28.984417] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-09T22:38:29.202139] [DEBUG] [LOCAL ] FERG: Derivative data saved (1807 records). [2025-10-09T22:38:29.208568] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-09T22:38:29.217896] [INFO ] [MAIN ] Derivative Progress: 678/1690 symbols completed. FERG took 1.7s. Estimated remaining: 6m 35s. Rate: 153.7 symbols/min [2025-10-09T22:38:29.224493] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:29.423054] [DEBUG] [LOCAL ] FFC: Loaded 16860 existing records from primary storage. [2025-10-09T22:38:29.423393] [INFO ] [MAIN ] FFC: Loaded 16860 primary data records. [2025-10-09T22:38:29.614026] [DEBUG] [MAIN ] FF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:29.751823] [INFO ] [MAIN ] FF: Generated 1807 derivative records from 24629 primary records. [2025-10-09T22:38:29.762512] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-09T22:38:29.791639] [DEBUG] [MAIN ] FFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:29.794766] [INFO ] [MAIN ] FFA: Generated 1807 derivative records from 6118 primary records. [2025-10-09T22:38:29.794940] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-09T22:38:29.793828] [DEBUG] [LOCAL ] FF: Derivative data saved (1807 records). [2025-10-09T22:38:29.796039] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-09T22:38:29.798744] [INFO ] [MAIN ] Derivative Progress: 679/1690 symbols completed. FF took 1.1s. Estimated remaining: 6m 35s. Rate: 153.6 symbols/min [2025-10-09T22:38:29.799289] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:29.821390] [DEBUG] [LOCAL ] FFA: Derivative data saved (1807 records). [2025-10-09T22:38:29.821579] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-09T22:38:29.824220] [INFO ] [MAIN ] Derivative Progress: 680/1690 symbols completed. FFA took 1.1s. Estimated remaining: 6m 34s. Rate: 153.8 symbols/min [2025-10-09T22:38:29.824472] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:29.846099] [DEBUG] [MAIN ] FFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:29.861386] [INFO ] [MAIN ] FFC: Generated 1807 derivative records from 16860 primary records. [2025-10-09T22:38:29.861583] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-09T22:38:29.890149] [DEBUG] [LOCAL ] FFC: Derivative data saved (1807 records). [2025-10-09T22:38:29.896980] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-09T22:38:29.898276] [DEBUG] [LOCAL ] FG: Loaded 22863 existing records from primary storage. [2025-10-09T22:38:29.897885] [DEBUG] [LOCAL ] FFWM: Loaded 36030 existing records from primary storage. [2025-10-09T22:38:29.902173] [INFO ] [MAIN ] Derivative Progress: 681/1690 symbols completed. FFC took 0.7s. Estimated remaining: 6m 33s. Rate: 154.0 symbols/min [2025-10-09T22:38:29.902728] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:29.902578] [INFO ] [MAIN ] FFWM: Loaded 36030 primary data records. [2025-10-09T22:38:29.902363] [INFO ] [MAIN ] FG: Loaded 22863 primary data records. [2025-10-09T22:38:30.055525] [DEBUG] [LOCAL ] FGN: Loaded 3810 existing records from primary storage. [2025-10-09T22:38:30.117526] [INFO ] [MAIN ] FGN: Loaded 3810 primary data records. [2025-10-09T22:38:30.915271] [DEBUG] [MAIN ] FG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:38:30.917226] [INFO ] [MAIN ] FG: Generated 1806 derivative records from 22863 primary records. [2025-10-09T22:38:30.918466] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-09T22:38:30.945342] [DEBUG] [MAIN ] FFWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:30.946285] [INFO ] [MAIN ] FFWM: Generated 1807 derivative records from 36030 primary records. [2025-10-09T22:38:30.947410] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-09T22:38:30.957611] [DEBUG] [LOCAL ] FG: Derivative data saved (1806 records). [2025-10-09T22:38:30.961301] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-09T22:38:30.963678] [INFO ] [MAIN ] Derivative Progress: 682/1690 symbols completed. FG took 1.1s. Estimated remaining: 6m 34s. Rate: 153.6 symbols/min [2025-10-09T22:38:30.965253] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:30.968974] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1807 records). [2025-10-09T22:38:30.969075] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-09T22:38:30.971909] [INFO ] [MAIN ] Derivative Progress: 683/1690 symbols completed. FFWM took 1.2s. Estimated remaining: 6m 33s. Rate: 153.8 symbols/min [2025-10-09T22:38:30.972998] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:30.990371] [DEBUG] [MAIN ] FGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:30.991320] [INFO ] [MAIN ] FGN: Generated 1807 derivative records from 3810 primary records. [2025-10-09T22:38:30.991529] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-09T22:38:31.009335] [DEBUG] [LOCAL ] FGN: Derivative data saved (1807 records). [2025-10-09T22:38:31.019561] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-09T22:38:31.023700] [INFO ] [MAIN ] Derivative Progress: 684/1690 symbols completed. FGN took 1.1s. Estimated remaining: 6m 32s. Rate: 154.0 symbols/min [2025-10-09T22:38:31.023989] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:31.051786] [DEBUG] [LOCAL ] FHI: Loaded 40145 existing records from primary storage. [2025-10-09T22:38:31.051961] [INFO ] [MAIN ] FHI: Loaded 40145 primary data records. [2025-10-09T22:38:31.190192] [DEBUG] [LOCAL ] FHN: Loaded 53763 existing records from primary storage. [2025-10-09T22:38:31.373854] [INFO ] [MAIN ] FHN: Loaded 53763 primary data records. [2025-10-09T22:38:31.510749] [DEBUG] [LOCAL ] FI: Loaded 53923 existing records from primary storage. [2025-10-09T22:38:31.551387] [INFO ] [MAIN ] FI: Loaded 53923 primary data records. [2025-10-09T22:38:32.067245] [DEBUG] [MAIN ] FHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:32.068768] [INFO ] [MAIN ] FHI: Generated 1807 derivative records from 40145 primary records. [2025-10-09T22:38:32.068978] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-09T22:38:32.102980] [DEBUG] [MAIN ] FHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:32.103442] [DEBUG] [LOCAL ] FHI: Derivative data saved (1807 records). [2025-10-09T22:38:32.104220] [INFO ] [MAIN ] FHN: Generated 1807 derivative records from 53763 primary records. [2025-10-09T22:38:32.104361] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-09T22:38:32.104306] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-09T22:38:32.107617] [INFO ] [MAIN ] Derivative Progress: 685/1690 symbols completed. FHI took 1.1s. Estimated remaining: 6m 33s. Rate: 153.6 symbols/min [2025-10-09T22:38:32.107998] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:32.125347] [DEBUG] [LOCAL ] FHN: Derivative data saved (1807 records). [2025-10-09T22:38:32.125561] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-09T22:38:32.129275] [INFO ] [MAIN ] Derivative Progress: 686/1690 symbols completed. FHN took 1.2s. Estimated remaining: 6m 32s. Rate: 153.8 symbols/min [2025-10-09T22:38:32.130275] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:32.144171] [DEBUG] [MAIN ] FI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:32.144897] [INFO ] [MAIN ] FI: Generated 1807 derivative records from 53923 primary records. [2025-10-09T22:38:32.150297] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-09T22:38:32.173500] [DEBUG] [LOCAL ] FI: Derivative data saved (1807 records). [2025-10-09T22:38:32.174720] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-09T22:38:32.175091] [DEBUG] [LOCAL ] FICO: Loaded 21632 existing records from primary storage. [2025-10-09T22:38:32.178421] [INFO ] [MAIN ] Derivative Progress: 687/1690 symbols completed. FI took 1.2s. Estimated remaining: 6m 31s. Rate: 154.0 symbols/min [2025-10-09T22:38:32.178558] [INFO ] [MAIN ] FICO: Loaded 21632 primary data records. [2025-10-09T22:38:32.178965] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:32.512018] [DEBUG] [LOCAL ] FIGS: Loaded 49061 existing records from primary storage. [2025-10-09T22:38:32.512209] [INFO ] [MAIN ] FIGS: Loaded 49061 primary data records. [2025-10-09T22:38:32.601290] [DEBUG] [LOCAL ] FIHL: Loaded 39903 existing records from primary storage. [2025-10-09T22:38:32.618180] [INFO ] [MAIN ] FIHL: Loaded 39903 primary data records. [2025-10-09T22:38:33.157560] [DEBUG] [MAIN ] FICO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:33.158777] [INFO ] [MAIN ] FICO: Generated 1807 derivative records from 21632 primary records. [2025-10-09T22:38:33.159381] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-09T22:38:33.179978] [DEBUG] [LOCAL ] FICO: Derivative data saved (1807 records). [2025-10-09T22:38:33.180378] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-09T22:38:33.182980] [INFO ] [MAIN ] Derivative Progress: 688/1690 symbols completed. FICO took 1.1s. Estimated remaining: 6m 31s. Rate: 153.7 symbols/min [2025-10-09T22:38:33.203088] [DEBUG] [MAIN ] FIGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:33.215890] [INFO ] [MAIN ] FIGS: Generated 1807 derivative records from 49061 primary records. [2025-10-09T22:38:33.216126] [DEBUG] [MAIN ] FIHL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:33.216207] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-09T22:38:33.217128] [INFO ] [MAIN ] FIHL: Generated 1807 derivative records from 39903 primary records. [2025-10-09T22:38:33.217440] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-09T22:38:33.246670] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1807 records). [2025-10-09T22:38:33.246959] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-09T22:38:33.250343] [INFO ] [MAIN ] Derivative Progress: 689/1690 symbols completed. FIHL took 1.1s. Estimated remaining: 6m 30s. Rate: 153.9 symbols/min [2025-10-09T22:38:33.251972] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1807 records). [2025-10-09T22:38:33.252038] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-09T22:38:33.254264] [INFO ] [MAIN ] Derivative Progress: 690/1690 symbols completed. FIGS took 1.1s. Estimated remaining: 6m 29s. Rate: 154.1 symbols/min [2025-10-09T22:38:33.254788] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:33.254732] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:33.254953] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:33.267222] [DEBUG] [LOCAL ] FINS: Loaded 8357 existing records from primary storage. [2025-10-09T22:38:33.267448] [INFO ] [MAIN ] FINS: Loaded 8357 primary data records. [2025-10-09T22:38:33.600831] [DEBUG] [LOCAL ] FINV: Loaded 45581 existing records from primary storage. [2025-10-09T22:38:33.601080] [INFO ] [MAIN ] FINV: Loaded 45581 primary data records. [2025-10-09T22:38:33.742518] [DEBUG] [LOCAL ] FIS: Loaded 53737 existing records from primary storage. [2025-10-09T22:38:33.767431] [INFO ] [MAIN ] FIS: Loaded 53737 primary data records. [2025-10-09T22:38:34.276060] [DEBUG] [MAIN ] FINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:34.277001] [INFO ] [MAIN ] FINS: Generated 1807 derivative records from 8357 primary records. [2025-10-09T22:38:34.277181] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-09T22:38:34.294808] [DEBUG] [LOCAL ] FINS: Derivative data saved (1807 records). [2025-10-09T22:38:34.295499] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-09T22:38:34.297520] [INFO ] [MAIN ] Derivative Progress: 691/1690 symbols completed. FINS took 1.0s. Estimated remaining: 6m 30s. Rate: 153.7 symbols/min [2025-10-09T22:38:34.297832] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:34.317227] [DEBUG] [MAIN ] FINV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:34.318172] [INFO ] [MAIN ] FINV: Generated 1807 derivative records from 45581 primary records. [2025-10-09T22:38:34.318549] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-09T22:38:34.347255] [DEBUG] [LOCAL ] FINV: Derivative data saved (1807 records). [2025-10-09T22:38:34.347506] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-09T22:38:34.350059] [INFO ] [MAIN ] Derivative Progress: 692/1690 symbols completed. FINV took 1.1s. Estimated remaining: 6m 29s. Rate: 153.9 symbols/min [2025-10-09T22:38:34.350375] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:34.372921] [DEBUG] [LOCAL ] FIX: Loaded 29455 existing records from primary storage. [2025-10-09T22:38:34.372442] [DEBUG] [MAIN ] FIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:34.373846] [INFO ] [MAIN ] FIS: Generated 1807 derivative records from 53737 primary records. [2025-10-09T22:38:34.373913] [INFO ] [MAIN ] FIX: Loaded 29455 primary data records. [2025-10-09T22:38:34.385168] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-09T22:38:34.459006] [DEBUG] [LOCAL ] FIS: Derivative data saved (1807 records). [2025-10-09T22:38:34.492026] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-09T22:38:34.498356] [INFO ] [MAIN ] Derivative Progress: 693/1690 symbols completed. FIS took 1.2s. Estimated remaining: 6m 28s. Rate: 154.0 symbols/min [2025-10-09T22:38:34.491930] [DEBUG] [LOCAL ] FLC: Loaded 5406 existing records from primary storage. [2025-10-09T22:38:34.498620] [INFO ] [MAIN ] FLC: Loaded 5406 primary data records. [2025-10-09T22:38:34.498768] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:35.049810] [DEBUG] [LOCAL ] FLG: Loaded 53704 existing records from primary storage. [2025-10-09T22:38:35.050840] [INFO ] [MAIN ] FLG: Loaded 53704 primary data records. [2025-10-09T22:38:35.241892] [DEBUG] [MAIN ] FIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:35.365028] [INFO ] [MAIN ] FIX: Generated 1807 derivative records from 29455 primary records. [2025-10-09T22:38:35.380145] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-09T22:38:35.417111] [DEBUG] [LOCAL ] FIX: Derivative data saved (1807 records). [2025-10-09T22:38:35.417346] [DEBUG] [MAIN ] FLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:35.418406] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-09T22:38:35.418315] [INFO ] [MAIN ] FLC: Generated 1807 derivative records from 5406 primary records. [2025-10-09T22:38:35.418636] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-09T22:38:35.421170] [INFO ] [MAIN ] Derivative Progress: 694/1690 symbols completed. FIX took 1.1s. Estimated remaining: 6m 29s. Rate: 153.7 symbols/min [2025-10-09T22:38:35.421605] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:35.442883] [DEBUG] [LOCAL ] FLC: Derivative data saved (1807 records). [2025-10-09T22:38:35.443281] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-09T22:38:35.445815] [INFO ] [MAIN ] Derivative Progress: 695/1690 symbols completed. FLC took 1.1s. Estimated remaining: 6m 28s. Rate: 153.9 symbols/min [2025-10-09T22:38:35.446325] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:35.482740] [DEBUG] [MAIN ] FLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:35.484488] [INFO ] [MAIN ] FLG: Generated 1807 derivative records from 53704 primary records. [2025-10-09T22:38:35.494690] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-09T22:38:35.498079] [DEBUG] [LOCAL ] FLNG: Loaded 33806 existing records from primary storage. [2025-10-09T22:38:35.505854] [INFO ] [MAIN ] FLNG: Loaded 33806 primary data records. [2025-10-09T22:38:35.545277] [DEBUG] [LOCAL ] FLG: Derivative data saved (1807 records). [2025-10-09T22:38:35.572525] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-09T22:38:35.596564] [INFO ] [MAIN ] Derivative Progress: 696/1690 symbols completed. FLG took 1.1s. Estimated remaining: 6m 27s. Rate: 154.1 symbols/min [2025-10-09T22:38:35.615099] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:35.684990] [DEBUG] [LOCAL ] FLO: Loaded 52335 existing records from primary storage. [2025-10-09T22:38:35.685175] [INFO ] [MAIN ] FLO: Loaded 52335 primary data records. [2025-10-09T22:38:36.236455] [DEBUG] [LOCAL ] FLR: Loaded 53555 existing records from primary storage. [2025-10-09T22:38:36.238890] [INFO ] [MAIN ] FLR: Loaded 53555 primary data records. [2025-10-09T22:38:36.435706] [DEBUG] [MAIN ] FLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:36.440379] [INFO ] [MAIN ] FLNG: Generated 1807 derivative records from 33806 primary records. [2025-10-09T22:38:36.547255] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-09T22:38:36.595597] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1807 records). [2025-10-09T22:38:36.596695] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-09T22:38:36.598939] [INFO ] [MAIN ] Derivative Progress: 697/1690 symbols completed. FLNG took 1.2s. Estimated remaining: 6m 28s. Rate: 153.7 symbols/min [2025-10-09T22:38:36.599110] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:36.599870] [DEBUG] [MAIN ] FLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:36.601757] [INFO ] [MAIN ] FLO: Generated 1807 derivative records from 52335 primary records. [2025-10-09T22:38:36.603119] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-09T22:38:36.631958] [DEBUG] [LOCAL ] FLO: Derivative data saved (1807 records). [2025-10-09T22:38:36.632231] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-09T22:38:36.635243] [INFO ] [MAIN ] Derivative Progress: 698/1690 symbols completed. FLO took 1.2s. Estimated remaining: 6m 27s. Rate: 153.9 symbols/min [2025-10-09T22:38:36.635594] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:36.655181] [DEBUG] [MAIN ] FLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:36.656148] [INFO ] [MAIN ] FLR: Generated 1807 derivative records from 53555 primary records. [2025-10-09T22:38:36.656306] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-09T22:38:36.688984] [DEBUG] [LOCAL ] FLR: Derivative data saved (1807 records). [2025-10-09T22:38:36.689187] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-09T22:38:36.692261] [INFO ] [MAIN ] Derivative Progress: 699/1690 symbols completed. FLR took 1.1s. Estimated remaining: 6m 26s. Rate: 154.1 symbols/min [2025-10-09T22:38:36.692487] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:36.723218] [DEBUG] [LOCAL ] FLS: Loaded 50642 existing records from primary storage. [2025-10-09T22:38:36.723462] [INFO ] [MAIN ] FLS: Loaded 50642 primary data records. [2025-10-09T22:38:36.855892] [DEBUG] [LOCAL ] FLXR: Loaded 20932 existing records from primary storage. [2025-10-09T22:38:36.856379] [INFO ] [MAIN ] FLXR: Loaded 20932 primary data records. [2025-10-09T22:38:36.872920] [DEBUG] [LOCAL ] FLUT: Loaded 51157 existing records from primary storage. [2025-10-09T22:38:36.943681] [INFO ] [MAIN ] FLUT: Loaded 51157 primary data records. [2025-10-09T22:38:37.697025] [DEBUG] [MAIN ] FLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:37.697959] [INFO ] [MAIN ] FLS: Generated 1807 derivative records from 50642 primary records. [2025-10-09T22:38:37.698295] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-09T22:38:37.726020] [DEBUG] [LOCAL ] FLS: Derivative data saved (1807 records). [2025-10-09T22:38:37.731858] [DEBUG] [MAIN ] FLXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:37.731321] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-09T22:38:37.734099] [INFO ] [MAIN ] Derivative Progress: 700/1690 symbols completed. FLS took 1.1s. Estimated remaining: 6m 26s. Rate: 153.7 symbols/min [2025-10-09T22:38:37.735153] [INFO ] [MAIN ] FLXR: Generated 1807 derivative records from 20932 primary records. [2025-10-09T22:38:37.734242] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:37.735955] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-09T22:38:37.768500] [DEBUG] [MAIN ] FLUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:37.770271] [INFO ] [MAIN ] FLUT: Generated 1807 derivative records from 51157 primary records. [2025-10-09T22:38:37.770843] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1807 records). [2025-10-09T22:38:37.770947] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-09T22:38:37.771169] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-09T22:38:37.774471] [INFO ] [MAIN ] Derivative Progress: 701/1690 symbols completed. FLXR took 1.1s. Estimated remaining: 6m 25s. Rate: 153.9 symbols/min [2025-10-09T22:38:37.783883] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:37.807111] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1807 records). [2025-10-09T22:38:37.808445] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-09T22:38:37.812522] [INFO ] [MAIN ] Derivative Progress: 702/1690 symbols completed. FLUT took 1.2s. Estimated remaining: 6m 25s. Rate: 154.1 symbols/min [2025-10-09T22:38:37.813005] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:37.818725] [DEBUG] [LOCAL ] FMN: Loaded 5363 existing records from primary storage. [2025-10-09T22:38:37.818954] [INFO ] [MAIN ] FMN: Loaded 5363 primary data records. [2025-10-09T22:38:37.888401] [DEBUG] [LOCAL ] FMC: Loaded 52191 existing records from primary storage. [2025-10-09T22:38:37.913936] [INFO ] [MAIN ] FMC: Loaded 52191 primary data records. [2025-10-09T22:38:38.236259] [DEBUG] [LOCAL ] FMS: Loaded 30246 existing records from primary storage. [2025-10-09T22:38:38.286253] [INFO ] [MAIN ] FMS: Loaded 30246 primary data records. [2025-10-09T22:38:38.810172] [DEBUG] [MAIN ] FMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:38.811190] [INFO ] [MAIN ] FMN: Generated 1807 derivative records from 5363 primary records. [2025-10-09T22:38:38.813283] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-09T22:38:38.830895] [DEBUG] [LOCAL ] FMN: Derivative data saved (1807 records). [2025-10-09T22:38:38.831404] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-09T22:38:38.846719] [INFO ] [MAIN ] Derivative Progress: 703/1690 symbols completed. FMN took 1.1s. Estimated remaining: 6m 25s. Rate: 153.8 symbols/min [2025-10-09T22:38:38.847249] [DEBUG] [MAIN ] FMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:38.848276] [INFO ] [MAIN ] FMC: Generated 1807 derivative records from 52191 primary records. [2025-10-09T22:38:38.848466] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-09T22:38:38.884119] [DEBUG] [LOCAL ] FMC: Derivative data saved (1807 records). [2025-10-09T22:38:38.884874] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-09T22:38:38.887870] [INFO ] [MAIN ] Derivative Progress: 704/1690 symbols completed. FMC took 1.2s. Estimated remaining: 6m 24s. Rate: 154.0 symbols/min [2025-10-09T22:38:38.885208] [DEBUG] [MAIN ] FMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:38.888756] [INFO ] [MAIN ] FMS: Generated 1807 derivative records from 30246 primary records. [2025-10-09T22:38:38.888826] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-09T22:38:38.905115] [DEBUG] [LOCAL ] FMS: Derivative data saved (1807 records). [2025-10-09T22:38:38.905185] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-09T22:38:38.908076] [INFO ] [MAIN ] Derivative Progress: 705/1690 symbols completed. FMS took 1.1s. Estimated remaining: 6m 23s. Rate: 154.2 symbols/min [2025-10-09T22:38:38.908741] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:38.908612] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:38.909440] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:38.914131] [DEBUG] [LOCAL ] FMY: Loaded 1393 existing records from primary storage. [2025-10-09T22:38:38.914389] [INFO ] [MAIN ] FMY: Loaded 1393 primary data records. [2025-10-09T22:38:39.241056] [DEBUG] [LOCAL ] FN: Loaded 38337 existing records from primary storage. [2025-10-09T22:38:39.242841] [INFO ] [MAIN ] FN: Loaded 38337 primary data records. [2025-10-09T22:38:39.285776] [DEBUG] [LOCAL ] FMX: Loaded 40806 existing records from primary storage. [2025-10-09T22:38:39.291576] [INFO ] [MAIN ] FMX: Loaded 40806 primary data records. [2025-10-09T22:38:39.923354] [DEBUG] [MAIN ] FMY: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:38:39.924332] [INFO ] [MAIN ] FMY: Generated 1805 derivative records from 1393 primary records. [2025-10-09T22:38:39.924435] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-09T22:38:39.942774] [DEBUG] [LOCAL ] FMY: Derivative data saved (1805 records). [2025-10-09T22:38:39.943480] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-09T22:38:39.946304] [INFO ] [MAIN ] Derivative Progress: 706/1690 symbols completed. FMY took 1.0s. Estimated remaining: 6m 24s. Rate: 153.8 symbols/min [2025-10-09T22:38:39.946621] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:39.967976] [DEBUG] [MAIN ] FN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:39.968985] [INFO ] [MAIN ] FN: Generated 1807 derivative records from 38337 primary records. [2025-10-09T22:38:39.969248] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-09T22:38:40.001472] [DEBUG] [MAIN ] FMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:40.002184] [DEBUG] [LOCAL ] FN: Derivative data saved (1807 records). [2025-10-09T22:38:40.003010] [INFO ] [MAIN ] FMX: Generated 1807 derivative records from 40806 primary records. [2025-10-09T22:38:40.003207] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-09T22:38:40.003275] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-09T22:38:40.006273] [INFO ] [MAIN ] Derivative Progress: 707/1690 symbols completed. FN took 1.1s. Estimated remaining: 6m 23s. Rate: 154.0 symbols/min [2025-10-09T22:38:40.019942] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:40.036333] [DEBUG] [LOCAL ] FMX: Derivative data saved (1807 records). [2025-10-09T22:38:40.036447] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-09T22:38:40.039273] [INFO ] [MAIN ] Derivative Progress: 708/1690 symbols completed. FMX took 1.1s. Estimated remaining: 6m 22s. Rate: 154.2 symbols/min [2025-10-09T22:38:40.039524] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:40.056962] [DEBUG] [LOCAL ] FNB: Loaded 52919 existing records from primary storage. [2025-10-09T22:38:40.057301] [INFO ] [MAIN ] FNB: Loaded 52919 primary data records. [2025-10-09T22:38:40.403348] [DEBUG] [LOCAL ] FND: Loaded 52495 existing records from primary storage. [2025-10-09T22:38:40.403726] [INFO ] [MAIN ] FND: Loaded 52495 primary data records. [2025-10-09T22:38:40.524788] [DEBUG] [LOCAL ] FNF: Loaded 49306 existing records from primary storage. [2025-10-09T22:38:40.526009] [INFO ] [MAIN ] FNF: Loaded 49306 primary data records. [2025-10-09T22:38:41.074395] [DEBUG] [MAIN ] FNB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:41.075373] [INFO ] [MAIN ] FNB: Generated 1807 derivative records from 52919 primary records. [2025-10-09T22:38:41.075868] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-09T22:38:41.094639] [DEBUG] [LOCAL ] FNB: Derivative data saved (1807 records). [2025-10-09T22:38:41.095191] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-09T22:38:41.098456] [INFO ] [MAIN ] Derivative Progress: 709/1690 symbols completed. FNB took 1.2s. Estimated remaining: 6m 23s. Rate: 153.8 symbols/min [2025-10-09T22:38:41.098984] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:41.120314] [DEBUG] [MAIN ] FND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:41.121354] [INFO ] [MAIN ] FND: Generated 1807 derivative records from 52495 primary records. [2025-10-09T22:38:41.121954] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-09T22:38:41.143895] [DEBUG] [LOCAL ] FND: Derivative data saved (1807 records). [2025-10-09T22:38:41.169090] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-09T22:38:41.169499] [DEBUG] [MAIN ] FNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:41.170427] [INFO ] [MAIN ] FNF: Generated 1807 derivative records from 49306 primary records. [2025-10-09T22:38:41.173386] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-09T22:38:41.173083] [INFO ] [MAIN ] Derivative Progress: 710/1690 symbols completed. FND took 1.2s. Estimated remaining: 6m 22s. Rate: 154.0 symbols/min [2025-10-09T22:38:41.174419] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:41.189830] [DEBUG] [LOCAL ] FNF: Derivative data saved (1807 records). [2025-10-09T22:38:41.190205] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-09T22:38:41.193484] [INFO ] [MAIN ] Derivative Progress: 711/1690 symbols completed. FNF took 1.2s. Estimated remaining: 6m 21s. Rate: 154.2 symbols/min [2025-10-09T22:38:41.193905] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:41.211918] [DEBUG] [LOCAL ] FNV: Loaded 46540 existing records from primary storage. [2025-10-09T22:38:41.214004] [INFO ] [MAIN ] FNV: Loaded 46540 primary data records. [2025-10-09T22:38:41.274195] [DEBUG] [LOCAL ] FOF: Loaded 8601 existing records from primary storage. [2025-10-09T22:38:41.303589] [INFO ] [MAIN ] FOF: Loaded 8601 primary data records. [2025-10-09T22:38:41.374771] [DEBUG] [LOCAL ] FOR: Loaded 19850 existing records from primary storage. [2025-10-09T22:38:41.393695] [INFO ] [MAIN ] FOR: Loaded 19850 primary data records. [2025-10-09T22:38:42.329211] [DEBUG] [MAIN ] FNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:42.330931] [INFO ] [MAIN ] FNV: Generated 1807 derivative records from 46540 primary records. [2025-10-09T22:38:42.331370] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-09T22:38:42.371487] [DEBUG] [LOCAL ] FNV: Derivative data saved (1807 records). [2025-10-09T22:38:42.372486] [DEBUG] [MAIN ] FOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:42.387700] [INFO ] [MAIN ] FOF: Generated 1807 derivative records from 8601 primary records. [2025-10-09T22:38:42.388141] [DEBUG] [MAIN ] FOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:42.388375] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-09T22:38:42.389538] [INFO ] [MAIN ] FOR: Generated 1807 derivative records from 19850 primary records. [2025-10-09T22:38:42.389716] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-09T22:38:42.372682] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-09T22:38:42.394343] [INFO ] [MAIN ] Derivative Progress: 712/1690 symbols completed. FNV took 1.3s. Estimated remaining: 6m 22s. Rate: 153.8 symbols/min [2025-10-09T22:38:42.402478] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:42.426004] [DEBUG] [LOCAL ] FOF: Derivative data saved (1807 records). [2025-10-09T22:38:42.426132] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-09T22:38:42.431529] [INFO ] [MAIN ] Derivative Progress: 713/1690 symbols completed. FOF took 1.3s. Estimated remaining: 6m 21s. Rate: 153.9 symbols/min [2025-10-09T22:38:42.431829] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:42.434218] [DEBUG] [LOCAL ] FOR: Derivative data saved (1807 records). [2025-10-09T22:38:42.434546] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-09T22:38:42.438341] [INFO ] [MAIN ] Derivative Progress: 714/1690 symbols completed. FOR took 1.2s. Estimated remaining: 6m 20s. Rate: 154.2 symbols/min [2025-10-09T22:38:42.438889] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:42.479945] [DEBUG] [LOCAL ] FPF: Loaded 18750 existing records from primary storage. [2025-10-09T22:38:42.480210] [INFO ] [MAIN ] FPF: Loaded 18750 primary data records. [2025-10-09T22:38:42.556417] [DEBUG] [LOCAL ] FPH: Loaded 19427 existing records from primary storage. [2025-10-09T22:38:42.569704] [INFO ] [MAIN ] FPH: Loaded 19427 primary data records. [2025-10-09T22:38:42.793179] [DEBUG] [LOCAL ] FOUR: Loaded 49959 existing records from primary storage. [2025-10-09T22:38:42.793369] [INFO ] [MAIN ] FOUR: Loaded 49959 primary data records. [2025-10-09T22:38:43.421140] [DEBUG] [MAIN ] FPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:43.423348] [INFO ] [MAIN ] FPF: Generated 1807 derivative records from 18750 primary records. [2025-10-09T22:38:43.423449] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-09T22:38:43.451486] [DEBUG] [MAIN ] FPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:43.452865] [INFO ] [MAIN ] FPH: Generated 1807 derivative records from 19427 primary records. [2025-10-09T22:38:43.452111] [DEBUG] [LOCAL ] FPF: Derivative data saved (1807 records). [2025-10-09T22:38:43.453045] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-09T22:38:43.455190] [INFO ] [MAIN ] Derivative Progress: 715/1690 symbols completed. FPF took 1.0s. Estimated remaining: 6m 20s. Rate: 153.8 symbols/min [2025-10-09T22:38:43.453001] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-09T22:38:43.455398] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:43.486546] [DEBUG] [LOCAL ] FPH: Derivative data saved (1807 records). [2025-10-09T22:38:43.486858] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-09T22:38:43.489664] [INFO ] [MAIN ] Derivative Progress: 716/1690 symbols completed. FPH took 1.1s. Estimated remaining: 6m 19s. Rate: 154.0 symbols/min [2025-10-09T22:38:43.489864] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:43.490609] [DEBUG] [MAIN ] FOUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:43.491401] [INFO ] [MAIN ] FOUR: Generated 1807 derivative records from 49959 primary records. [2025-10-09T22:38:43.491536] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-09T22:38:43.516268] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1807 records). [2025-10-09T22:38:43.516400] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-09T22:38:43.519152] [INFO ] [MAIN ] Derivative Progress: 717/1690 symbols completed. FOUR took 1.1s. Estimated remaining: 6m 19s. Rate: 154.2 symbols/min [2025-10-09T22:38:43.519501] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:43.530418] [DEBUG] [LOCAL ] FPI: Loaded 31242 existing records from primary storage. [2025-10-09T22:38:43.530623] [INFO ] [MAIN ] FPI: Loaded 31242 primary data records. [2025-10-09T22:38:43.650815] [DEBUG] [LOCAL ] FRA: Loaded 14632 existing records from primary storage. [2025-10-09T22:38:43.661760] [INFO ] [MAIN ] FRA: Loaded 14632 primary data records. [2025-10-09T22:38:43.814821] [DEBUG] [LOCAL ] FR: Loaded 46701 existing records from primary storage. [2025-10-09T22:38:43.942010] [INFO ] [MAIN ] FR: Loaded 46701 primary data records. [2025-10-09T22:38:44.549378] [DEBUG] [MAIN ] FPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:44.550343] [INFO ] [MAIN ] FPI: Generated 1807 derivative records from 31242 primary records. [2025-10-09T22:38:44.550850] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-09T22:38:44.571780] [DEBUG] [LOCAL ] FPI: Derivative data saved (1807 records). [2025-10-09T22:38:44.572204] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-09T22:38:44.574878] [INFO ] [MAIN ] Derivative Progress: 718/1690 symbols completed. FPI took 1.1s. Estimated remaining: 6m 19s. Rate: 153.8 symbols/min [2025-10-09T22:38:44.587991] [DEBUG] [MAIN ] FRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:44.588625] [INFO ] [MAIN ] FRA: Generated 1807 derivative records from 14632 primary records. [2025-10-09T22:38:44.588810] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-09T22:38:44.615637] [DEBUG] [MAIN ] FR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:44.616738] [INFO ] [MAIN ] FR: Generated 1807 derivative records from 46701 primary records. [2025-10-09T22:38:44.617219] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-09T22:38:44.632835] [DEBUG] [LOCAL ] FRA: Derivative data saved (1807 records). [2025-10-09T22:38:44.634094] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-09T22:38:44.637025] [INFO ] [MAIN ] Derivative Progress: 719/1690 symbols completed. FRA took 1.1s. Estimated remaining: 6m 18s. Rate: 154.0 symbols/min [2025-10-09T22:38:44.638165] [DEBUG] [LOCAL ] FR: Derivative data saved (1807 records). [2025-10-09T22:38:44.638403] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-09T22:38:44.641256] [INFO ] [MAIN ] Derivative Progress: 720/1690 symbols completed. FR took 1.2s. Estimated remaining: 6m 17s. Rate: 154.2 symbols/min [2025-10-09T22:38:44.641670] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:44.641777] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:44.642078] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:44.676427] [DEBUG] [LOCAL ] FRGE: Loaded 16985 existing records from primary storage. [2025-10-09T22:38:44.676582] [INFO ] [MAIN ] FRGE: Loaded 16985 primary data records. [2025-10-09T22:38:44.816311] [DEBUG] [LOCAL ] FRT: Loaded 42147 existing records from primary storage. [2025-10-09T22:38:44.829300] [INFO ] [MAIN ] FRT: Loaded 42147 primary data records. [2025-10-09T22:38:44.946888] [DEBUG] [LOCAL ] FRO: Loaded 52062 existing records from primary storage. [2025-10-09T22:38:44.961449] [INFO ] [MAIN ] FRO: Loaded 52062 primary data records. [2025-10-09T22:38:45.695923] [DEBUG] [MAIN ] FRGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:45.697060] [INFO ] [MAIN ] FRGE: Generated 1807 derivative records from 16985 primary records. [2025-10-09T22:38:45.697415] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-09T22:38:45.718239] [DEBUG] [MAIN ] FRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:45.722937] [INFO ] [MAIN ] FRT: Generated 1807 derivative records from 42147 primary records. [2025-10-09T22:38:45.723685] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-09T22:38:45.744410] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1807 records). [2025-10-09T22:38:45.753538] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-09T22:38:45.753449] [DEBUG] [LOCAL ] FRT: Derivative data saved (1807 records). [2025-10-09T22:38:45.755716] [INFO ] [MAIN ] Derivative Progress: 721/1690 symbols completed. FRGE took 1.1s. Estimated remaining: 6m 18s. Rate: 153.8 symbols/min [2025-10-09T22:38:45.753689] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-09T22:38:45.760593] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:45.761085] [DEBUG] [MAIN ] FRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:45.763915] [INFO ] [MAIN ] Derivative Progress: 722/1690 symbols completed. FRT took 1.1s. Estimated remaining: 6m 17s. Rate: 154.0 symbols/min [2025-10-09T22:38:45.765370] [INFO ] [MAIN ] FRO: Generated 1807 derivative records from 52062 primary records. [2025-10-09T22:38:45.764624] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:45.765502] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-09T22:38:45.782942] [DEBUG] [LOCAL ] FRO: Derivative data saved (1807 records). [2025-10-09T22:38:45.783134] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-09T22:38:45.786203] [INFO ] [MAIN ] Derivative Progress: 723/1690 symbols completed. FRO took 1.1s. Estimated remaining: 6m 16s. Rate: 154.2 symbols/min [2025-10-09T22:38:45.786398] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:45.826060] [DEBUG] [LOCAL ] FSCO: Loaded 38325 existing records from primary storage. [2025-10-09T22:38:45.826199] [INFO ] [MAIN ] FSCO: Loaded 38325 primary data records. [2025-10-09T22:38:45.954415] [DEBUG] [LOCAL ] FSK: Loaded 49791 existing records from primary storage. [2025-10-09T22:38:45.954674] [INFO ] [MAIN ] FSK: Loaded 49791 primary data records. [2025-10-09T22:38:46.314431] [DEBUG] [LOCAL ] FSLY: Loaded 51612 existing records from primary storage. [2025-10-09T22:38:46.325678] [INFO ] [MAIN ] FSLY: Loaded 51612 primary data records. [2025-10-09T22:38:46.815919] [DEBUG] [MAIN ] FSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:46.816881] [INFO ] [MAIN ] FSCO: Generated 1807 derivative records from 38325 primary records. [2025-10-09T22:38:46.818853] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-09T22:38:46.845185] [DEBUG] [MAIN ] FSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:46.849764] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1807 records). [2025-10-09T22:38:46.850631] [INFO ] [MAIN ] FSK: Generated 1807 derivative records from 49791 primary records. [2025-10-09T22:38:46.850993] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-09T22:38:46.851050] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-09T22:38:46.853401] [INFO ] [MAIN ] Derivative Progress: 724/1690 symbols completed. FSCO took 1.1s. Estimated remaining: 6m 17s. Rate: 153.9 symbols/min [2025-10-09T22:38:46.854507] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:46.872130] [DEBUG] [LOCAL ] FSK: Derivative data saved (1807 records). [2025-10-09T22:38:46.873291] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-09T22:38:46.877090] [INFO ] [MAIN ] Derivative Progress: 725/1690 symbols completed. FSK took 1.1s. Estimated remaining: 6m 16s. Rate: 154.1 symbols/min [2025-10-09T22:38:46.878106] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:46.893257] [DEBUG] [MAIN ] FSLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:46.894541] [INFO ] [MAIN ] FSLY: Generated 1807 derivative records from 51612 primary records. [2025-10-09T22:38:46.895794] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-09T22:38:46.925798] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1807 records). [2025-10-09T22:38:46.925940] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-09T22:38:46.928746] [INFO ] [MAIN ] Derivative Progress: 726/1690 symbols completed. FSLY took 1.1s. Estimated remaining: 6m 15s. Rate: 154.3 symbols/min [2025-10-09T22:38:46.929157] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:46.954834] [DEBUG] [LOCAL ] FSM: Loaded 53686 existing records from primary storage. [2025-10-09T22:38:46.956550] [INFO ] [MAIN ] FSM: Loaded 53686 primary data records. [2025-10-09T22:38:47.032774] [DEBUG] [LOCAL ] FT: Loaded 6755 existing records from primary storage. [2025-10-09T22:38:47.067288] [INFO ] [MAIN ] FT: Loaded 6755 primary data records. [2025-10-09T22:38:47.071079] [DEBUG] [LOCAL ] FSS: Loaded 34059 existing records from primary storage. [2025-10-09T22:38:47.107033] [INFO ] [MAIN ] FSS: Loaded 34059 primary data records. [2025-10-09T22:38:47.883812] [DEBUG] [MAIN ] FSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:47.884790] [INFO ] [MAIN ] FSM: Generated 1807 derivative records from 53686 primary records. [2025-10-09T22:38:47.885125] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-09T22:38:47.928814] [DEBUG] [MAIN ] FT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:47.931058] [INFO ] [MAIN ] FT: Generated 1807 derivative records from 6755 primary records. [2025-10-09T22:38:47.931161] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-09T22:38:47.930353] [DEBUG] [LOCAL ] FSM: Derivative data saved (1807 records). [2025-10-09T22:38:47.931836] [DEBUG] [MAIN ] FSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:47.932332] [INFO ] [MAIN ] FSS: Generated 1807 derivative records from 34059 primary records. [2025-10-09T22:38:47.932680] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-09T22:38:47.933582] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-09T22:38:47.951552] [INFO ] [MAIN ] Derivative Progress: 727/1690 symbols completed. FSM took 1.1s. Estimated remaining: 6m 15s. Rate: 153.9 symbols/min [2025-10-09T22:38:47.953015] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:47.967219] [DEBUG] [LOCAL ] FT: Derivative data saved (1807 records). [2025-10-09T22:38:47.967306] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-09T22:38:47.970058] [INFO ] [MAIN ] Derivative Progress: 728/1690 symbols completed. FT took 1.0s. Estimated remaining: 6m 15s. Rate: 154.1 symbols/min [2025-10-09T22:38:47.973434] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:47.980858] [DEBUG] [LOCAL ] FTHY: Loaded 12386 existing records from primary storage. [2025-10-09T22:38:47.982160] [DEBUG] [LOCAL ] FSS: Derivative data saved (1807 records). [2025-10-09T22:38:47.982225] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-09T22:38:47.981471] [INFO ] [MAIN ] FTHY: Loaded 12386 primary data records. [2025-10-09T22:38:47.985137] [INFO ] [MAIN ] Derivative Progress: 729/1690 symbols completed. FSS took 1.1s. Estimated remaining: 6m 14s. Rate: 154.3 symbols/min [2025-10-09T22:38:47.997022] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:48.341413] [DEBUG] [LOCAL ] FTK: Loaded 32796 existing records from primary storage. [2025-10-09T22:38:48.357032] [INFO ] [MAIN ] FTK: Loaded 32796 primary data records. [2025-10-09T22:38:48.370813] [DEBUG] [LOCAL ] FTI: Loaded 53681 existing records from primary storage. [2025-10-09T22:38:48.376757] [INFO ] [MAIN ] FTI: Loaded 53681 primary data records. [2025-10-09T22:38:49.003691] [DEBUG] [MAIN ] FTHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:49.005576] [INFO ] [MAIN ] FTHY: Generated 1807 derivative records from 12386 primary records. [2025-10-09T22:38:49.005843] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-09T22:38:49.030911] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1807 records). [2025-10-09T22:38:49.031250] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-09T22:38:49.033590] [INFO ] [MAIN ] Derivative Progress: 730/1690 symbols completed. FTHY took 1.1s. Estimated remaining: 6m 14s. Rate: 154.0 symbols/min [2025-10-09T22:38:49.033878] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:49.051773] [DEBUG] [MAIN ] FTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:49.053769] [INFO ] [MAIN ] FTK: Generated 1807 derivative records from 32796 primary records. [2025-10-09T22:38:49.054031] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-09T22:38:49.074558] [DEBUG] [MAIN ] FTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:49.079343] [INFO ] [MAIN ] FTI: Generated 1807 derivative records from 53681 primary records. [2025-10-09T22:38:49.083523] [DEBUG] [LOCAL ] FTK: Derivative data saved (1807 records). [2025-10-09T22:38:49.083798] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-09T22:38:49.083589] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-09T22:38:49.087045] [INFO ] [MAIN ] Derivative Progress: 731/1690 symbols completed. FTK took 1.1s. Estimated remaining: 6m 13s. Rate: 154.1 symbols/min [2025-10-09T22:38:49.087220] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:49.103860] [DEBUG] [LOCAL ] FTI: Derivative data saved (1807 records). [2025-10-09T22:38:49.114505] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-09T22:38:49.117625] [INFO ] [MAIN ] Derivative Progress: 732/1690 symbols completed. FTI took 1.1s. Estimated remaining: 6m 12s. Rate: 154.3 symbols/min [2025-10-09T22:38:49.117891] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:49.122315] [DEBUG] [LOCAL ] FTWO: Loaded 1903 existing records from primary storage. [2025-10-09T22:38:49.122461] [INFO ] [MAIN ] FTWO: Loaded 1903 primary data records. [2025-10-09T22:38:49.219907] [DEBUG] [LOCAL ] FTS: Loaded 42723 existing records from primary storage. [2025-10-09T22:38:49.257258] [INFO ] [MAIN ] FTS: Loaded 42723 primary data records. [2025-10-09T22:38:49.583216] [DEBUG] [LOCAL ] FTV: Loaded 53377 existing records from primary storage. [2025-10-09T22:38:49.590306] [INFO ] [MAIN ] FTV: Loaded 53377 primary data records. [2025-10-09T22:38:50.173505] [DEBUG] [MAIN ] FTWO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:38:50.175230] [INFO ] [MAIN ] FTWO: Generated 1806 derivative records from 1903 primary records. [2025-10-09T22:38:50.175382] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-09T22:38:50.194020] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1806 records). [2025-10-09T22:38:50.194253] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-09T22:38:50.196699] [INFO ] [MAIN ] Derivative Progress: 733/1690 symbols completed. FTWO took 1.1s. Estimated remaining: 6m 13s. Rate: 154.0 symbols/min [2025-10-09T22:38:50.211028] [DEBUG] [MAIN ] FTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:50.212030] [INFO ] [MAIN ] FTS: Generated 1807 derivative records from 42723 primary records. [2025-10-09T22:38:50.212320] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-09T22:38:50.242286] [DEBUG] [MAIN ] FTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:50.243829] [INFO ] [MAIN ] FTV: Generated 1807 derivative records from 53377 primary records. [2025-10-09T22:38:50.244170] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-09T22:38:50.253856] [DEBUG] [LOCAL ] FTS: Derivative data saved (1807 records). [2025-10-09T22:38:50.258822] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-09T22:38:50.262190] [INFO ] [MAIN ] Derivative Progress: 734/1690 symbols completed. FTS took 1.2s. Estimated remaining: 6m 12s. Rate: 154.1 symbols/min [2025-10-09T22:38:50.265618] [DEBUG] [LOCAL ] FTV: Derivative data saved (1807 records). [2025-10-09T22:38:50.265846] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-09T22:38:50.268719] [INFO ] [MAIN ] Derivative Progress: 735/1690 symbols completed. FTV took 1.2s. Estimated remaining: 6m 11s. Rate: 154.3 symbols/min [2025-10-09T22:38:50.269286] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:50.269351] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:50.269193] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:50.322812] [DEBUG] [LOCAL ] FUL: Loaded 33056 existing records from primary storage. [2025-10-09T22:38:50.337612] [INFO ] [MAIN ] FUL: Loaded 33056 primary data records. [2025-10-09T22:38:50.475629] [DEBUG] [LOCAL ] FUBO: Loaded 54095 existing records from primary storage. [2025-10-09T22:38:50.486161] [INFO ] [MAIN ] FUBO: Loaded 54095 primary data records. [2025-10-09T22:38:50.497612] [DEBUG] [LOCAL ] FUN: Loaded 52165 existing records from primary storage. [2025-10-09T22:38:50.531888] [INFO ] [MAIN ] FUN: Loaded 52165 primary data records. [2025-10-09T22:38:51.345634] [DEBUG] [MAIN ] FUL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:51.346858] [INFO ] [MAIN ] FUL: Generated 1807 derivative records from 33056 primary records. [2025-10-09T22:38:51.347159] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-09T22:38:51.379727] [DEBUG] [MAIN ] FUBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:51.385230] [INFO ] [MAIN ] FUBO: Generated 1807 derivative records from 54095 primary records. [2025-10-09T22:38:51.383393] [DEBUG] [LOCAL ] FUL: Derivative data saved (1807 records). [2025-10-09T22:38:51.385697] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-09T22:38:51.393402] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-09T22:38:51.400378] [INFO ] [MAIN ] Derivative Progress: 736/1690 symbols completed. FUL took 1.1s. Estimated remaining: 6m 12s. Rate: 153.9 symbols/min [2025-10-09T22:38:51.400789] [DEBUG] [MAIN ] FUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:51.402554] [INFO ] [MAIN ] FUN: Generated 1807 derivative records from 52165 primary records. [2025-10-09T22:38:51.403188] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-09T22:38:51.402727] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:51.432267] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1807 records). [2025-10-09T22:38:51.436004] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-09T22:38:51.440525] [INFO ] [MAIN ] Derivative Progress: 737/1690 symbols completed. FUBO took 1.2s. Estimated remaining: 6m 11s. Rate: 154.1 symbols/min [2025-10-09T22:38:51.440866] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:51.436780] [DEBUG] [LOCAL ] FUN: Derivative data saved (1807 records). [2025-10-09T22:38:51.441480] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-09T22:38:51.445624] [INFO ] [MAIN ] Derivative Progress: 738/1690 symbols completed. FUN took 1.2s. Estimated remaining: 6m 10s. Rate: 154.3 symbols/min [2025-10-09T22:38:51.445903] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:51.449501] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-10-09T22:38:51.449753] [INFO ] [MAIN ] FXED: Loaded 1259 primary data records. [2025-10-09T22:38:51.667891] [DEBUG] [LOCAL ] FVRR: Loaded 40524 existing records from primary storage. [2025-10-09T22:38:51.783763] [INFO ] [MAIN ] FVRR: Loaded 40524 primary data records. [2025-10-09T22:38:51.895794] [DEBUG] [LOCAL ] G: Loaded 50363 existing records from primary storage. [2025-10-09T22:38:51.907879] [INFO ] [MAIN ] G: Loaded 50363 primary data records. [2025-10-09T22:38:52.358250] [DEBUG] [MAIN ] FXED: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:38:52.469059] [INFO ] [MAIN ] FXED: Generated 1805 derivative records from 1259 primary records. [2025-10-09T22:38:52.479490] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-09T22:38:52.496211] [DEBUG] [LOCAL ] FXED: Derivative data saved (1805 records). [2025-10-09T22:38:52.496440] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-09T22:38:52.499011] [INFO ] [MAIN ] Derivative Progress: 739/1690 symbols completed. FXED took 1.1s. Estimated remaining: 6m 11s. Rate: 154.0 symbols/min [2025-10-09T22:38:52.499956] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:52.522609] [DEBUG] [MAIN ] FVRR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:52.531156] [INFO ] [MAIN ] FVRR: Generated 1807 derivative records from 40524 primary records. [2025-10-09T22:38:52.531462] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-09T22:38:52.556676] [DEBUG] [LOCAL ] GAB: Loaded 27889 existing records from primary storage. [2025-10-09T22:38:52.557600] [INFO ] [MAIN ] GAB: Loaded 27889 primary data records. [2025-10-09T22:38:52.618844] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1807 records). [2025-10-09T22:38:52.619189] [DEBUG] [MAIN ] G: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:52.644206] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-09T22:38:52.644122] [INFO ] [MAIN ] G: Generated 1807 derivative records from 50363 primary records. [2025-10-09T22:38:52.664199] [INFO ] [MAIN ] Derivative Progress: 740/1690 symbols completed. FVRR took 1.3s. Estimated remaining: 6m 10s. Rate: 154.1 symbols/min [2025-10-09T22:38:52.675441] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-09T22:38:52.687271] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:52.911407] [DEBUG] [LOCAL ] GAM: Loaded 4058 existing records from primary storage. [2025-10-09T22:38:52.912291] [INFO ] [MAIN ] GAM: Loaded 4058 primary data records. [2025-10-09T22:38:52.960277] [DEBUG] [LOCAL ] G: Derivative data saved (1807 records). [2025-10-09T22:38:52.989090] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-09T22:38:53.013944] [INFO ] [MAIN ] Derivative Progress: 741/1690 symbols completed. G took 1.6s. Estimated remaining: 6m 9s. Rate: 154.1 symbols/min [2025-10-09T22:38:53.014727] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:53.268173] [DEBUG] [MAIN ] GAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:53.269077] [INFO ] [MAIN ] GAB: Generated 1807 derivative records from 27889 primary records. [2025-10-09T22:38:53.269199] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-09T22:38:53.286720] [DEBUG] [LOCAL ] GAB: Derivative data saved (1807 records). [2025-10-09T22:38:53.287047] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-09T22:38:53.290547] [INFO ] [MAIN ] Derivative Progress: 742/1690 symbols completed. GAB took 0.8s. Estimated remaining: 6m 9s. Rate: 154.2 symbols/min [2025-10-09T22:38:53.290898] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:53.307181] [DEBUG] [LOCAL ] GAP: Loaded 54042 existing records from primary storage. [2025-10-09T22:38:53.307678] [INFO ] [MAIN ] GAP: Loaded 54042 primary data records. [2025-10-09T22:38:53.436256] [DEBUG] [LOCAL ] GATX: Loaded 18233 existing records from primary storage. [2025-10-09T22:38:53.451551] [INFO ] [MAIN ] GATX: Loaded 18233 primary data records. [2025-10-09T22:38:53.456999] [DEBUG] [MAIN ] GAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:53.536789] [INFO ] [MAIN ] GAM: Generated 1807 derivative records from 4058 primary records. [2025-10-09T22:38:53.600363] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-09T22:38:53.969743] [DEBUG] [LOCAL ] GAM: Derivative data saved (1807 records). [2025-10-09T22:38:53.970416] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-09T22:38:53.973991] [INFO ] [MAIN ] Derivative Progress: 743/1690 symbols completed. GAM took 1.3s. Estimated remaining: 6m 9s. Rate: 154.0 symbols/min [2025-10-09T22:38:53.974904] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:54.000163] [DEBUG] [LOCAL ] GBAB: Loaded 13099 existing records from primary storage. [2025-10-09T22:38:54.000995] [INFO ] [MAIN ] GBAB: Loaded 13099 primary data records. [2025-10-09T22:38:54.144142] [DEBUG] [MAIN ] GATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:54.244290] [INFO ] [MAIN ] GATX: Generated 1807 derivative records from 18233 primary records. [2025-10-09T22:38:54.244730] [DEBUG] [MAIN ] GAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:54.250630] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-09T22:38:54.250554] [INFO ] [MAIN ] GAP: Generated 1807 derivative records from 54042 primary records. [2025-10-09T22:38:54.274852] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-09T22:38:54.350418] [DEBUG] [LOCAL ] GAP: Derivative data saved (1807 records). [2025-10-09T22:38:54.465422] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-09T22:38:54.484949] [INFO ] [MAIN ] Derivative Progress: 744/1690 symbols completed. GAP took 1.5s. Estimated remaining: 6m 9s. Rate: 154.0 symbols/min [2025-10-09T22:38:54.485082] [DEBUG] [LOCAL ] GATX: Derivative data saved (1807 records). [2025-10-09T22:38:54.485194] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-09T22:38:54.489444] [INFO ] [MAIN ] Derivative Progress: 745/1690 symbols completed. GATX took 1.2s. Estimated remaining: 6m 8s. Rate: 154.2 symbols/min [2025-10-09T22:38:54.486399] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:54.489676] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:54.540133] [DEBUG] [MAIN ] GBAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:54.541118] [INFO ] [MAIN ] GBAB: Generated 1807 derivative records from 13099 primary records. [2025-10-09T22:38:54.541284] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-09T22:38:54.578300] [DEBUG] [LOCAL ] GBCI: Loaded 40822 existing records from primary storage. [2025-10-09T22:38:54.579135] [INFO ] [MAIN ] GBCI: Loaded 40822 primary data records. [2025-10-09T22:38:54.580114] [DEBUG] [LOCAL ] GBTG: Loaded 40278 existing records from primary storage. [2025-10-09T22:38:54.581111] [INFO ] [MAIN ] GBTG: Loaded 40278 primary data records. [2025-10-09T22:38:54.792401] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1807 records). [2025-10-09T22:38:54.822569] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-09T22:38:54.891340] [INFO ] [MAIN ] Derivative Progress: 746/1690 symbols completed. GBAB took 0.9s. Estimated remaining: 6m 7s. Rate: 154.2 symbols/min [2025-10-09T22:38:54.939747] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:55.227592] [DEBUG] [MAIN ] GBCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:55.235997] [INFO ] [MAIN ] GBCI: Generated 1807 derivative records from 40822 primary records. [2025-10-09T22:38:55.240699] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-09T22:38:55.241285] [DEBUG] [MAIN ] GBTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:55.242406] [INFO ] [MAIN ] GBTG: Generated 1807 derivative records from 40278 primary records. [2025-10-09T22:38:55.243896] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-09T22:38:55.280049] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1807 records). [2025-10-09T22:38:55.281447] [DEBUG] [LOCAL ] GBX: Loaded 29325 existing records from primary storage. [2025-10-09T22:38:55.282252] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-09T22:38:55.283595] [INFO ] [MAIN ] GBX: Loaded 29325 primary data records. [2025-10-09T22:38:55.286293] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1807 records). [2025-10-09T22:38:55.289551] [INFO ] [MAIN ] Derivative Progress: 747/1690 symbols completed. GBCI took 0.8s. Estimated remaining: 6m 7s. Rate: 154.2 symbols/min [2025-10-09T22:38:55.295083] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-09T22:38:55.314389] [INFO ] [MAIN ] Derivative Progress: 748/1690 symbols completed. GBTG took 0.8s. Estimated remaining: 6m 6s. Rate: 154.4 symbols/min [2025-10-09T22:38:55.304412] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:55.644570] [DEBUG] [LOCAL ] GCI: Loaded 44365 existing records from primary storage. [2025-10-09T22:38:55.644811] [INFO ] [MAIN ] GCI: Loaded 44365 primary data records. [2025-10-09T22:38:55.990126] [DEBUG] [MAIN ] GBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:55.991454] [INFO ] [MAIN ] GBX: Generated 1807 derivative records from 29325 primary records. [2025-10-09T22:38:55.991692] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-09T22:38:56.011432] [DEBUG] [LOCAL ] GBX: Derivative data saved (1807 records). [2025-10-09T22:38:56.011500] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-09T22:38:56.013756] [INFO ] [MAIN ] Derivative Progress: 749/1690 symbols completed. GBX took 1.1s. Estimated remaining: 6m 6s. Rate: 154.2 symbols/min [2025-10-09T22:38:56.030477] [DEBUG] [MAIN ] GCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:56.031116] [INFO ] [MAIN ] GCI: Generated 1807 derivative records from 44365 primary records. [2025-10-09T22:38:56.031176] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-09T22:38:56.046757] [DEBUG] [LOCAL ] GCI: Derivative data saved (1807 records). [2025-10-09T22:38:56.046816] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-09T22:38:56.049454] [INFO ] [MAIN ] Derivative Progress: 750/1690 symbols completed. GCI took 0.7s. Estimated remaining: 6m 5s. Rate: 154.4 symbols/min [2025-10-09T22:38:56.050169] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:56.050106] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:56.050810] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:56.068264] [DEBUG] [LOCAL ] GCV: Loaded 7653 existing records from primary storage. [2025-10-09T22:38:56.068594] [INFO ] [MAIN ] GCV: Loaded 7653 primary data records. [2025-10-09T22:38:56.192057] [DEBUG] [LOCAL ] GCTS: Loaded 20474 existing records from primary storage. [2025-10-09T22:38:56.200028] [DEBUG] [LOCAL ] GCO: Loaded 24160 existing records from primary storage. [2025-10-09T22:38:56.199676] [INFO ] [MAIN ] GCTS: Loaded 20474 primary data records. [2025-10-09T22:38:56.200187] [INFO ] [MAIN ] GCO: Loaded 24160 primary data records. [2025-10-09T22:38:57.143971] [DEBUG] [MAIN ] GCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:57.146638] [INFO ] [MAIN ] GCV: Generated 1807 derivative records from 7653 primary records. [2025-10-09T22:38:57.147122] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-09T22:38:57.171293] [DEBUG] [MAIN ] GCTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:57.175564] [INFO ] [MAIN ] GCTS: Generated 1807 derivative records from 20474 primary records. [2025-10-09T22:38:57.178684] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-09T22:38:57.181963] [DEBUG] [LOCAL ] GCV: Derivative data saved (1807 records). [2025-10-09T22:38:57.182468] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-09T22:38:57.185886] [INFO ] [MAIN ] Derivative Progress: 751/1690 symbols completed. GCV took 1.1s. Estimated remaining: 6m 6s. Rate: 154.0 symbols/min [2025-10-09T22:38:57.186104] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:57.218994] [DEBUG] [MAIN ] GCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:57.220593] [INFO ] [MAIN ] GCO: Generated 1807 derivative records from 24160 primary records. [2025-10-09T22:38:57.221344] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-09T22:38:57.223957] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1807 records). [2025-10-09T22:38:57.224708] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-09T22:38:57.234885] [INFO ] [MAIN ] Derivative Progress: 752/1690 symbols completed. GCTS took 1.2s. Estimated remaining: 6m 5s. Rate: 154.2 symbols/min [2025-10-09T22:38:57.236528] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:57.246255] [DEBUG] [LOCAL ] GCO: Derivative data saved (1807 records). [2025-10-09T22:38:57.246452] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-09T22:38:57.249756] [INFO ] [MAIN ] Derivative Progress: 753/1690 symbols completed. GCO took 1.2s. Estimated remaining: 6m 4s. Rate: 154.4 symbols/min [2025-10-09T22:38:57.250091] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:57.275528] [DEBUG] [LOCAL ] GDIV: Loaded 3625 existing records from primary storage. [2025-10-09T22:38:57.275953] [INFO ] [MAIN ] GDIV: Loaded 3625 primary data records. [2025-10-09T22:38:57.425343] [DEBUG] [LOCAL ] GD: Loaded 47158 existing records from primary storage. [2025-10-09T22:38:57.447256] [INFO ] [MAIN ] GD: Loaded 47158 primary data records. [2025-10-09T22:38:57.567685] [DEBUG] [LOCAL ] GDDY: Loaded 50152 existing records from primary storage. [2025-10-09T22:38:57.695130] [INFO ] [MAIN ] GDDY: Loaded 50152 primary data records. [2025-10-09T22:38:58.387036] [DEBUG] [MAIN ] GDIV: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-10-09T22:38:58.388589] [INFO ] [MAIN ] GDIV: Generated 1804 derivative records from 3625 primary records. [2025-10-09T22:38:58.389009] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-09T22:38:58.407885] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1804 records). [2025-10-09T22:38:58.408301] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-09T22:38:58.410910] [INFO ] [MAIN ] Derivative Progress: 754/1690 symbols completed. GDIV took 1.2s. Estimated remaining: 6m 5s. Rate: 153.9 symbols/min [2025-10-09T22:38:58.411500] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:58.417013] [DEBUG] [LOCAL ] GDL: Loaded 2566 existing records from primary storage. [2025-10-09T22:38:58.417464] [INFO ] [MAIN ] GDL: Loaded 2566 primary data records. [2025-10-09T22:38:58.538242] [DEBUG] [MAIN ] GD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:58.568186] [INFO ] [MAIN ] GD: Generated 1807 derivative records from 47158 primary records. [2025-10-09T22:38:58.605690] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-09T22:38:58.628842] [DEBUG] [MAIN ] GDDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:58.744688] [INFO ] [MAIN ] GDDY: Generated 1807 derivative records from 50152 primary records. [2025-10-09T22:38:58.745889] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-09T22:38:58.782367] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1807 records). [2025-10-09T22:38:58.783149] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-09T22:38:58.783371] [DEBUG] [LOCAL ] GD: Derivative data saved (1807 records). [2025-10-09T22:38:58.787965] [INFO ] [MAIN ] Derivative Progress: 755/1690 symbols completed. GDDY took 1.6s. Estimated remaining: 6m 4s. Rate: 154.0 symbols/min [2025-10-09T22:38:58.788479] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:58.788373] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-09T22:38:58.791381] [INFO ] [MAIN ] Derivative Progress: 756/1690 symbols completed. GD took 1.6s. Estimated remaining: 6m 4s. Rate: 154.2 symbols/min [2025-10-09T22:38:58.792043] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:58.813468] [DEBUG] [MAIN ] GDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:58.816970] [DEBUG] [LOCAL ] GDO: Loaded 5961 existing records from primary storage. [2025-10-09T22:38:58.818022] [INFO ] [MAIN ] GDO: Loaded 5961 primary data records. [2025-10-09T22:38:58.817894] [INFO ] [MAIN ] GDL: Generated 1807 derivative records from 2566 primary records. [2025-10-09T22:38:58.854868] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-09T22:38:58.959815] [DEBUG] [LOCAL ] GDL: Derivative data saved (1807 records). [2025-10-09T22:38:58.960852] [DEBUG] [LOCAL ] GDOT: Loaded 38054 existing records from primary storage. [2025-10-09T22:38:58.971425] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-09T22:38:59.006586] [INFO ] [MAIN ] GDOT: Loaded 38054 primary data records. [2025-10-09T22:38:59.010197] [INFO ] [MAIN ] Derivative Progress: 757/1690 symbols completed. GDL took 0.6s. Estimated remaining: 6m 3s. Rate: 154.2 symbols/min [2025-10-09T22:38:59.080803] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:59.481217] [DEBUG] [LOCAL ] GDV: Loaded 19701 existing records from primary storage. [2025-10-09T22:38:59.481521] [INFO ] [MAIN ] GDV: Loaded 19701 primary data records. [2025-10-09T22:38:59.813327] [DEBUG] [MAIN ] GDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:59.815029] [INFO ] [MAIN ] GDO: Generated 1807 derivative records from 5961 primary records. [2025-10-09T22:38:59.815560] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-09T22:38:59.834332] [DEBUG] [LOCAL ] GDO: Derivative data saved (1807 records). [2025-10-09T22:38:59.835608] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-09T22:38:59.839929] [INFO ] [MAIN ] Derivative Progress: 758/1690 symbols completed. GDO took 1.1s. Estimated remaining: 6m 3s. Rate: 154.0 symbols/min [2025-10-09T22:38:59.840283] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:59.855416] [DEBUG] [MAIN ] GDOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:59.856411] [INFO ] [MAIN ] GDOT: Generated 1807 derivative records from 38054 primary records. [2025-10-09T22:38:59.856845] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-09T22:38:59.875415] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1807 records). [2025-10-09T22:38:59.875801] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-09T22:38:59.879929] [INFO ] [MAIN ] Derivative Progress: 759/1690 symbols completed. GDOT took 1.1s. Estimated remaining: 6m 2s. Rate: 154.2 symbols/min [2025-10-09T22:38:59.881784] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:59.898785] [DEBUG] [MAIN ] GDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:38:59.899719] [INFO ] [MAIN ] GDV: Generated 1807 derivative records from 19701 primary records. [2025-10-09T22:38:59.899837] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-09T22:38:59.920388] [DEBUG] [LOCAL ] GDV: Derivative data saved (1807 records). [2025-10-09T22:38:59.920553] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-09T22:38:59.929393] [INFO ] [MAIN ] Derivative Progress: 760/1690 symbols completed. GDV took 0.8s. Estimated remaining: 6m 1s. Rate: 154.4 symbols/min [2025-10-09T22:38:59.929686] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:38:59.953501] [DEBUG] [LOCAL ] GEF: Loaded 20821 existing records from primary storage. [2025-10-09T22:38:59.953689] [INFO ] [MAIN ] GEF: Loaded 20821 primary data records. [2025-10-09T22:39:00.080487] [DEBUG] [LOCAL ] GE: Loaded 54096 existing records from primary storage. [2025-10-09T22:39:00.107536] [INFO ] [MAIN ] GE: Loaded 54096 primary data records. [2025-10-09T22:39:00.252100] [DEBUG] [LOCAL ] GEL: Loaded 32514 existing records from primary storage. [2025-10-09T22:39:00.308751] [INFO ] [MAIN ] GEL: Loaded 32514 primary data records. [2025-10-09T22:39:00.997931] [DEBUG] [MAIN ] GEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:01.000034] [INFO ] [MAIN ] GEF: Generated 1807 derivative records from 20821 primary records. [2025-10-09T22:39:01.000225] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-09T22:39:01.014733] [DEBUG] [MAIN ] GE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:01.024180] [INFO ] [MAIN ] GE: Generated 1807 derivative records from 54096 primary records. [2025-10-09T22:39:01.029434] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-09T22:39:01.031932] [DEBUG] [LOCAL ] GEF: Derivative data saved (1807 records). [2025-10-09T22:39:01.032367] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-09T22:39:01.034768] [INFO ] [MAIN ] Derivative Progress: 761/1690 symbols completed. GEF took 1.2s. Estimated remaining: 6m 2s. Rate: 154.0 symbols/min [2025-10-09T22:39:01.045035] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:01.065579] [DEBUG] [MAIN ] GEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:01.066988] [INFO ] [MAIN ] GEL: Generated 1807 derivative records from 32514 primary records. [2025-10-09T22:39:01.067393] [DEBUG] [LOCAL ] GE: Derivative data saved (1807 records). [2025-10-09T22:39:01.067547] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-09T22:39:01.067683] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-09T22:39:01.071360] [INFO ] [MAIN ] Derivative Progress: 762/1690 symbols completed. GE took 1.2s. Estimated remaining: 6m 1s. Rate: 154.2 symbols/min [2025-10-09T22:39:01.072404] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:01.090269] [DEBUG] [LOCAL ] GEL: Derivative data saved (1807 records). [2025-10-09T22:39:01.090403] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-09T22:39:01.093197] [INFO ] [MAIN ] Derivative Progress: 763/1690 symbols completed. GEL took 1.2s. Estimated remaining: 6m 0s. Rate: 154.4 symbols/min [2025-10-09T22:39:01.149054] [DEBUG] [LOCAL ] GENI: Loaded 53328 existing records from primary storage. [2025-10-09T22:39:01.163254] [INFO ] [MAIN ] GENI: Loaded 53328 primary data records. [2025-10-09T22:39:01.206738] [DEBUG] [LOCAL ] GEO: Loaded 52261 existing records from primary storage. [2025-10-09T22:39:01.232832] [INFO ] [MAIN ] GEO: Loaded 52261 primary data records. [2025-10-09T22:39:01.809556] [DEBUG] [MAIN ] GEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:01.810743] [INFO ] [MAIN ] GEO: Generated 1807 derivative records from 52261 primary records. [2025-10-09T22:39:01.811822] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-09T22:39:01.840350] [DEBUG] [MAIN ] GENI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:01.842064] [INFO ] [MAIN ] GENI: Generated 1807 derivative records from 53328 primary records. [2025-10-09T22:39:01.844906] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-09T22:39:01.844828] [DEBUG] [LOCAL ] GEO: Derivative data saved (1807 records). [2025-10-09T22:39:01.845567] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-09T22:39:01.849261] [INFO ] [MAIN ] Derivative Progress: 764/1690 symbols completed. GEO took 0.8s. Estimated remaining: 6m 0s. Rate: 154.2 symbols/min [2025-10-09T22:39:01.865510] [DEBUG] [LOCAL ] GENI: Derivative data saved (1807 records). [2025-10-09T22:39:01.865739] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-09T22:39:01.867810] [INFO ] [MAIN ] Derivative Progress: 765/1690 symbols completed. GENI took 0.8s. Estimated remaining: 5m 60s. Rate: 154.4 symbols/min [2025-10-09T22:39:01.868305] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:01.868240] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:01.868454] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:01.927960] [DEBUG] [LOCAL ] GETY: Loaded 35597 existing records from primary storage. [2025-10-09T22:39:01.928305] [INFO ] [MAIN ] GETY: Loaded 35597 primary data records. [2025-10-09T22:39:01.981109] [DEBUG] [LOCAL ] GES: Loaded 38897 existing records from primary storage. [2025-10-09T22:39:02.001735] [INFO ] [MAIN ] GES: Loaded 38897 primary data records. [2025-10-09T22:39:02.087239] [DEBUG] [LOCAL ] GEV: Loaded 53394 existing records from primary storage. [2025-10-09T22:39:02.157319] [INFO ] [MAIN ] GEV: Loaded 53394 primary data records. [2025-10-09T22:39:03.018050] [DEBUG] [MAIN ] GETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:03.019997] [INFO ] [MAIN ] GETY: Generated 1807 derivative records from 35597 primary records. [2025-10-09T22:39:03.020299] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-09T22:39:03.041695] [DEBUG] [LOCAL ] GETY: Derivative data saved (1807 records). [2025-10-09T22:39:03.043413] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-09T22:39:03.053809] [INFO ] [MAIN ] Derivative Progress: 766/1690 symbols completed. GETY took 1.2s. Estimated remaining: 6m 0s. Rate: 154.0 symbols/min [2025-10-09T22:39:03.061834] [DEBUG] [MAIN ] GES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:03.062786] [INFO ] [MAIN ] GES: Generated 1807 derivative records from 38897 primary records. [2025-10-09T22:39:03.070819] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-09T22:39:03.079907] [DEBUG] [MAIN ] GEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:03.080602] [INFO ] [MAIN ] GEV: Generated 1807 derivative records from 53394 primary records. [2025-10-09T22:39:03.080813] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-09T22:39:03.080740] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:03.114143] [DEBUG] [LOCAL ] GEV: Derivative data saved (1807 records). [2025-10-09T22:39:03.117614] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-09T22:39:03.117319] [DEBUG] [LOCAL ] GES: Derivative data saved (1807 records). [2025-10-09T22:39:03.123965] [INFO ] [MAIN ] Derivative Progress: 767/1690 symbols completed. GEV took 1.3s. Estimated remaining: 5m 59s. Rate: 154.1 symbols/min [2025-10-09T22:39:03.124388] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-09T22:39:03.127537] [DEBUG] [LOCAL ] GF: Loaded 2790 existing records from primary storage. [2025-10-09T22:39:03.127302] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:03.130893] [INFO ] [MAIN ] Derivative Progress: 768/1690 symbols completed. GES took 1.3s. Estimated remaining: 5m 58s. Rate: 154.3 symbols/min [2025-10-09T22:39:03.131173] [INFO ] [MAIN ] GF: Loaded 2790 primary data records. [2025-10-09T22:39:03.143774] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:03.462377] [DEBUG] [LOCAL ] GFF: Loaded 30371 existing records from primary storage. [2025-10-09T22:39:03.478074] [INFO ] [MAIN ] GFF: Loaded 30371 primary data records. [2025-10-09T22:39:03.638268] [DEBUG] [LOCAL ] GFI: Loaded 53488 existing records from primary storage. [2025-10-09T22:39:03.649266] [INFO ] [MAIN ] GFI: Loaded 53488 primary data records. [2025-10-09T22:39:03.935790] [DEBUG] [MAIN ] GF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:03.945237] [INFO ] [MAIN ] GF: Generated 1807 derivative records from 2790 primary records. [2025-10-09T22:39:03.950248] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-09T22:39:04.023011] [DEBUG] [LOCAL ] GF: Derivative data saved (1807 records). [2025-10-09T22:39:04.041627] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-09T22:39:04.169740] [INFO ] [MAIN ] Derivative Progress: 769/1690 symbols completed. GF took 1.1s. Estimated remaining: 5m 59s. Rate: 154.0 symbols/min [2025-10-09T22:39:04.170417] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:04.194420] [DEBUG] [MAIN ] GFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:04.195549] [INFO ] [MAIN ] GFF: Generated 1807 derivative records from 30371 primary records. [2025-10-09T22:39:04.195669] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-09T22:39:04.213565] [DEBUG] [LOCAL ] GFF: Derivative data saved (1807 records). [2025-10-09T22:39:04.213920] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-09T22:39:04.216878] [INFO ] [MAIN ] Derivative Progress: 770/1690 symbols completed. GFF took 1.1s. Estimated remaining: 5m 58s. Rate: 154.2 symbols/min [2025-10-09T22:39:04.217297] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:04.248131] [DEBUG] [MAIN ] GFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:04.249296] [INFO ] [MAIN ] GFI: Generated 1807 derivative records from 53488 primary records. [2025-10-09T22:39:04.249447] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-09T22:39:04.254674] [DEBUG] [LOCAL ] GFR: Loaded 7968 existing records from primary storage. [2025-10-09T22:39:04.263454] [INFO ] [MAIN ] GFR: Loaded 7968 primary data records. [2025-10-09T22:39:04.354932] [DEBUG] [LOCAL ] GFI: Derivative data saved (1807 records). [2025-10-09T22:39:04.379569] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-09T22:39:04.379429] [DEBUG] [LOCAL ] GFL: Loaded 48223 existing records from primary storage. [2025-10-09T22:39:04.390708] [INFO ] [MAIN ] GFL: Loaded 48223 primary data records. [2025-10-09T22:39:04.394592] [INFO ] [MAIN ] Derivative Progress: 771/1690 symbols completed. GFI took 1.3s. Estimated remaining: 5m 57s. Rate: 154.3 symbols/min [2025-10-09T22:39:04.411000] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:04.961164] [DEBUG] [LOCAL ] GGB: Loaded 51552 existing records from primary storage. [2025-10-09T22:39:04.963169] [INFO ] [MAIN ] GGB: Loaded 51552 primary data records. [2025-10-09T22:39:05.071451] [DEBUG] [MAIN ] GFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:05.080577] [INFO ] [MAIN ] GFR: Generated 1807 derivative records from 7968 primary records. [2025-10-09T22:39:05.081430] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-09T22:39:05.165031] [DEBUG] [MAIN ] GFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:05.188413] [INFO ] [MAIN ] GFL: Generated 1807 derivative records from 48223 primary records. [2025-10-09T22:39:05.312026] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-09T22:39:05.316140] [DEBUG] [LOCAL ] GFR: Derivative data saved (1807 records). [2025-10-09T22:39:05.316501] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-09T22:39:05.320055] [INFO ] [MAIN ] Derivative Progress: 772/1690 symbols completed. GFR took 1.1s. Estimated remaining: 5m 58s. Rate: 154.0 symbols/min [2025-10-09T22:39:05.320604] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:05.339131] [DEBUG] [LOCAL ] GFL: Derivative data saved (1807 records). [2025-10-09T22:39:05.339470] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-09T22:39:05.342677] [INFO ] [MAIN ] Derivative Progress: 773/1690 symbols completed. GFL took 1.2s. Estimated remaining: 5m 57s. Rate: 154.2 symbols/min [2025-10-09T22:39:05.343064] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:05.360740] [DEBUG] [LOCAL ] GGT: Loaded 14247 existing records from primary storage. [2025-10-09T22:39:05.361287] [INFO ] [MAIN ] GGT: Loaded 14247 primary data records. [2025-10-09T22:39:05.505250] [DEBUG] [MAIN ] GGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:05.518312] [INFO ] [MAIN ] GGB: Generated 1807 derivative records from 51552 primary records. [2025-10-09T22:39:05.506550] [DEBUG] [LOCAL ] GGG: Loaded 41084 existing records from primary storage. [2025-10-09T22:39:05.528739] [INFO ] [MAIN ] GGG: Loaded 41084 primary data records. [2025-10-09T22:39:05.547344] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-09T22:39:05.826428] [DEBUG] [LOCAL ] GGB: Derivative data saved (1807 records). [2025-10-09T22:39:05.827719] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-09T22:39:05.835635] [INFO ] [MAIN ] Derivative Progress: 774/1690 symbols completed. GGB took 1.4s. Estimated remaining: 5m 57s. Rate: 154.1 symbols/min [2025-10-09T22:39:05.856944] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:06.026795] [DEBUG] [LOCAL ] GGZ: Loaded 2437 existing records from primary storage. [2025-10-09T22:39:06.026993] [INFO ] [MAIN ] GGZ: Loaded 2437 primary data records. [2025-10-09T22:39:06.241638] [DEBUG] [MAIN ] GGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:06.380184] [INFO ] [MAIN ] GGT: Generated 1807 derivative records from 14247 primary records. [2025-10-09T22:39:06.418316] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-09T22:39:06.451128] [DEBUG] [LOCAL ] GGT: Derivative data saved (1807 records). [2025-10-09T22:39:06.452024] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-09T22:39:06.455111] [INFO ] [MAIN ] Derivative Progress: 775/1690 symbols completed. GGT took 1.1s. Estimated remaining: 5m 56s. Rate: 154.0 symbols/min [2025-10-09T22:39:06.452711] [DEBUG] [MAIN ] GGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:06.456138] [INFO ] [MAIN ] GGG: Generated 1807 derivative records from 41084 primary records. [2025-10-09T22:39:06.456322] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:06.457665] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-09T22:39:06.480824] [DEBUG] [LOCAL ] GHC: Loaded 2863 existing records from primary storage. [2025-10-09T22:39:06.478533] [DEBUG] [LOCAL ] GGG: Derivative data saved (1807 records). [2025-10-09T22:39:06.481183] [INFO ] [MAIN ] GHC: Loaded 2863 primary data records. [2025-10-09T22:39:06.502028] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-09T22:39:06.520501] [INFO ] [MAIN ] Derivative Progress: 776/1690 symbols completed. GGG took 1.2s. Estimated remaining: 5m 56s. Rate: 154.2 symbols/min [2025-10-09T22:39:06.559542] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:06.644523] [DEBUG] [MAIN ] GGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:06.644210] [DEBUG] [LOCAL ] GHG: Loaded 3244 existing records from primary storage. [2025-10-09T22:39:06.682085] [INFO ] [MAIN ] GGZ: Generated 1807 derivative records from 2437 primary records. [2025-10-09T22:39:06.788416] [INFO ] [MAIN ] GHG: Loaded 3244 primary data records. [2025-10-09T22:39:06.796477] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-09T22:39:06.918826] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1807 records). [2025-10-09T22:39:06.922965] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-09T22:39:06.926153] [INFO ] [MAIN ] Derivative Progress: 777/1690 symbols completed. GGZ took 1.1s. Estimated remaining: 5m 55s. Rate: 154.2 symbols/min [2025-10-09T22:39:06.926358] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:07.127845] [DEBUG] [LOCAL ] GHI: Loaded 7248 existing records from primary storage. [2025-10-09T22:39:07.128305] [INFO ] [MAIN ] GHI: Loaded 7248 primary data records. [2025-10-09T22:39:07.266087] [DEBUG] [MAIN ] GHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:07.309258] [INFO ] [MAIN ] GHC: Generated 1807 derivative records from 2863 primary records. [2025-10-09T22:39:07.447065] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-09T22:39:07.464871] [DEBUG] [LOCAL ] GHC: Derivative data saved (1807 records). [2025-10-09T22:39:07.465896] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-09T22:39:07.468282] [INFO ] [MAIN ] Derivative Progress: 778/1690 symbols completed. GHC took 1.0s. Estimated remaining: 5m 55s. Rate: 154.1 symbols/min [2025-10-09T22:39:07.485678] [DEBUG] [MAIN ] GHG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:39:07.486387] [INFO ] [MAIN ] GHG: Generated 1806 derivative records from 3244 primary records. [2025-10-09T22:39:07.486669] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-09T22:39:07.501047] [DEBUG] [LOCAL ] GHG: Derivative data saved (1806 records). [2025-10-09T22:39:07.501127] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-09T22:39:07.503939] [INFO ] [MAIN ] Derivative Progress: 779/1690 symbols completed. GHG took 0.9s. Estimated remaining: 5m 54s. Rate: 154.3 symbols/min [2025-10-09T22:39:07.519227] [DEBUG] [MAIN ] GHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:07.519825] [INFO ] [MAIN ] GHI: Generated 1807 derivative records from 7248 primary records. [2025-10-09T22:39:07.519886] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-09T22:39:07.535223] [DEBUG] [LOCAL ] GHI: Derivative data saved (1807 records). [2025-10-09T22:39:07.535286] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-09T22:39:07.538296] [INFO ] [MAIN ] Derivative Progress: 780/1690 symbols completed. GHI took 0.6s. Estimated remaining: 5m 53s. Rate: 154.5 symbols/min [2025-10-09T22:39:07.538732] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:07.538830] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:07.538955] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:07.552759] [DEBUG] [LOCAL ] GHLD: Loaded 4231 existing records from primary storage. [2025-10-09T22:39:07.557606] [INFO ] [MAIN ] GHLD: Loaded 4231 primary data records. [2025-10-09T22:39:07.653776] [DEBUG] [LOCAL ] GHY: Loaded 21047 existing records from primary storage. [2025-10-09T22:39:07.641324] [DEBUG] [LOCAL ] GHM: Loaded 14304 existing records from primary storage. [2025-10-09T22:39:07.666466] [INFO ] [MAIN ] GHM: Loaded 14304 primary data records. [2025-10-09T22:39:07.666586] [INFO ] [MAIN ] GHY: Loaded 21047 primary data records. [2025-10-09T22:39:08.608055] [DEBUG] [MAIN ] GHLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:08.614323] [INFO ] [MAIN ] GHLD: Generated 1807 derivative records from 4231 primary records. [2025-10-09T22:39:08.614697] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-09T22:39:08.616952] [DEBUG] [MAIN ] GHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:08.625820] [INFO ] [MAIN ] GHY: Generated 1807 derivative records from 21047 primary records. [2025-10-09T22:39:08.626798] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-09T22:39:08.649030] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1807 records). [2025-10-09T22:39:08.665161] [DEBUG] [MAIN ] GHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:08.665298] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-09T22:39:08.659944] [DEBUG] [LOCAL ] GHY: Derivative data saved (1807 records). [2025-10-09T22:39:08.665542] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-09T22:39:08.669401] [INFO ] [MAIN ] GHM: Generated 1807 derivative records from 14304 primary records. [2025-10-09T22:39:08.668574] [INFO ] [MAIN ] Derivative Progress: 781/1690 symbols completed. GHLD took 1.1s. Estimated remaining: 5m 54s. Rate: 154.1 symbols/min [2025-10-09T22:39:08.669759] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:08.672706] [INFO ] [MAIN ] Derivative Progress: 782/1690 symbols completed. GHY took 1.1s. Estimated remaining: 5m 53s. Rate: 154.3 symbols/min [2025-10-09T22:39:08.673556] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:08.673614] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-09T22:39:08.692135] [DEBUG] [LOCAL ] GHM: Derivative data saved (1807 records). [2025-10-09T22:39:08.692321] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-09T22:39:08.695233] [INFO ] [MAIN ] Derivative Progress: 783/1690 symbols completed. GHM took 1.2s. Estimated remaining: 5m 52s. Rate: 154.5 symbols/min [2025-10-09T22:39:08.695490] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:08.706953] [DEBUG] [LOCAL ] GIC: Loaded 13510 existing records from primary storage. [2025-10-09T22:39:08.707114] [INFO ] [MAIN ] GIC: Loaded 13510 primary data records. [2025-10-09T22:39:08.928326] [DEBUG] [LOCAL ] GIB: Loaded 32024 existing records from primary storage. [2025-10-09T22:39:08.933507] [INFO ] [MAIN ] GIB: Loaded 32024 primary data records. [2025-10-09T22:39:09.117731] [DEBUG] [LOCAL ] GIL: Loaded 44027 existing records from primary storage. [2025-10-09T22:39:09.150314] [INFO ] [MAIN ] GIL: Loaded 44027 primary data records. [2025-10-09T22:39:09.781580] [DEBUG] [MAIN ] GIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:09.782818] [INFO ] [MAIN ] GIC: Generated 1807 derivative records from 13510 primary records. [2025-10-09T22:39:09.783802] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-09T22:39:09.803828] [DEBUG] [LOCAL ] GIC: Derivative data saved (1807 records). [2025-10-09T22:39:09.804121] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-09T22:39:09.807278] [INFO ] [MAIN ] Derivative Progress: 784/1690 symbols completed. GIC took 1.1s. Estimated remaining: 5m 53s. Rate: 154.1 symbols/min [2025-10-09T22:39:09.807489] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:09.830847] [DEBUG] [MAIN ] GIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:09.832183] [INFO ] [MAIN ] GIB: Generated 1807 derivative records from 32024 primary records. [2025-10-09T22:39:09.832409] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-09T22:39:09.860289] [DEBUG] [LOCAL ] GIB: Derivative data saved (1807 records). [2025-10-09T22:39:09.860593] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-09T22:39:09.863542] [INFO ] [MAIN ] Derivative Progress: 785/1690 symbols completed. GIB took 1.2s. Estimated remaining: 5m 52s. Rate: 154.3 symbols/min [2025-10-09T22:39:09.863763] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:09.877928] [DEBUG] [MAIN ] GIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:09.878688] [INFO ] [MAIN ] GIL: Generated 1807 derivative records from 44027 primary records. [2025-10-09T22:39:09.878965] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-09T22:39:09.911521] [DEBUG] [LOCAL ] GIL: Derivative data saved (1807 records). [2025-10-09T22:39:09.911622] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-09T22:39:09.914503] [INFO ] [MAIN ] Derivative Progress: 786/1690 symbols completed. GIL took 1.2s. Estimated remaining: 5m 51s. Rate: 154.4 symbols/min [2025-10-09T22:39:09.914982] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:09.933491] [DEBUG] [LOCAL ] GIS: Loaded 54062 existing records from primary storage. [2025-10-09T22:39:09.933987] [INFO ] [MAIN ] GIS: Loaded 54062 primary data records. [2025-10-09T22:39:10.084783] [DEBUG] [LOCAL ] GKOS: Loaded 42815 existing records from primary storage. [2025-10-09T22:39:10.099987] [INFO ] [MAIN ] GKOS: Loaded 42815 primary data records. [2025-10-09T22:39:10.397862] [DEBUG] [LOCAL ] GL: Loaded 38074 existing records from primary storage. [2025-10-09T22:39:10.403913] [INFO ] [MAIN ] GL: Loaded 38074 primary data records. [2025-10-09T22:39:10.972639] [DEBUG] [MAIN ] GIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:10.973699] [INFO ] [MAIN ] GIS: Generated 1807 derivative records from 54062 primary records. [2025-10-09T22:39:10.974146] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-09T22:39:10.991408] [DEBUG] [LOCAL ] GIS: Derivative data saved (1807 records). [2025-10-09T22:39:10.991828] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-09T22:39:10.994170] [INFO ] [MAIN ] Derivative Progress: 787/1690 symbols completed. GIS took 1.2s. Estimated remaining: 5m 52s. Rate: 154.1 symbols/min [2025-10-09T22:39:10.995559] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:11.014000] [DEBUG] [MAIN ] GKOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:11.014738] [INFO ] [MAIN ] GKOS: Generated 1807 derivative records from 42815 primary records. [2025-10-09T22:39:11.014962] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-09T22:39:11.045588] [DEBUG] [MAIN ] GL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:11.047204] [INFO ] [MAIN ] GL: Generated 1807 derivative records from 38074 primary records. [2025-10-09T22:39:11.047300] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-09T22:39:11.057207] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1807 records). [2025-10-09T22:39:11.067469] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-09T22:39:11.075874] [INFO ] [MAIN ] Derivative Progress: 788/1690 symbols completed. GKOS took 1.2s. Estimated remaining: 5m 51s. Rate: 154.2 symbols/min [2025-10-09T22:39:11.077242] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:11.079321] [DEBUG] [LOCAL ] GL: Derivative data saved (1807 records). [2025-10-09T22:39:11.079576] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-09T22:39:11.083381] [INFO ] [MAIN ] Derivative Progress: 789/1690 symbols completed. GL took 1.2s. Estimated remaining: 5m 50s. Rate: 154.4 symbols/min [2025-10-09T22:39:11.084596] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:11.098821] [DEBUG] [LOCAL ] GLOB: Loaded 48132 existing records from primary storage. [2025-10-09T22:39:11.100832] [INFO ] [MAIN ] GLOB: Loaded 48132 primary data records. [2025-10-09T22:39:11.161221] [DEBUG] [LOCAL ] GLP: Loaded 9309 existing records from primary storage. [2025-10-09T22:39:11.181473] [INFO ] [MAIN ] GLP: Loaded 9309 primary data records. [2025-10-09T22:39:11.731714] [DEBUG] [LOCAL ] GLW: Loaded 54026 existing records from primary storage. [2025-10-09T22:39:11.732573] [INFO ] [MAIN ] GLW: Loaded 54026 primary data records. [2025-10-09T22:39:12.049371] [DEBUG] [MAIN ] GLOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:12.050466] [INFO ] [MAIN ] GLOB: Generated 1807 derivative records from 48132 primary records. [2025-10-09T22:39:12.050674] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-09T22:39:12.070995] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1807 records). [2025-10-09T22:39:12.071298] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-09T22:39:12.084635] [DEBUG] [MAIN ] GLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:12.087111] [INFO ] [MAIN ] Derivative Progress: 790/1690 symbols completed. GLOB took 1.1s. Estimated remaining: 5m 50s. Rate: 154.1 symbols/min [2025-10-09T22:39:12.088178] [INFO ] [MAIN ] GLP: Generated 1807 derivative records from 9309 primary records. [2025-10-09T22:39:12.088450] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-09T22:39:12.087375] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:12.106603] [DEBUG] [LOCAL ] GLP: Derivative data saved (1807 records). [2025-10-09T22:39:12.108330] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-09T22:39:12.111249] [INFO ] [MAIN ] Derivative Progress: 791/1690 symbols completed. GLP took 1.0s. Estimated remaining: 5m 50s. Rate: 154.3 symbols/min [2025-10-09T22:39:12.111477] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:12.125626] [DEBUG] [MAIN ] GLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:12.126483] [INFO ] [MAIN ] GLW: Generated 1807 derivative records from 54026 primary records. [2025-10-09T22:39:12.126591] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-09T22:39:12.144306] [DEBUG] [LOCAL ] GLW: Derivative data saved (1807 records). [2025-10-09T22:39:12.144455] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-09T22:39:12.147486] [INFO ] [MAIN ] Derivative Progress: 792/1690 symbols completed. GLW took 1.1s. Estimated remaining: 5m 49s. Rate: 154.5 symbols/min [2025-10-09T22:39:12.147917] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:12.199753] [DEBUG] [LOCAL ] GM: Loaded 54119 existing records from primary storage. [2025-10-09T22:39:12.200428] [INFO ] [MAIN ] GM: Loaded 54119 primary data records. [2025-10-09T22:39:12.301228] [DEBUG] [LOCAL ] GME: Loaded 54173 existing records from primary storage. [2025-10-09T22:39:12.329154] [INFO ] [MAIN ] GME: Loaded 54173 primary data records. [2025-10-09T22:39:12.662830] [DEBUG] [LOCAL ] GMED: Loaded 48701 existing records from primary storage. [2025-10-09T22:39:12.666879] [INFO ] [MAIN ] GMED: Loaded 48701 primary data records. [2025-10-09T22:39:13.189027] [DEBUG] [MAIN ] GM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:13.190896] [INFO ] [MAIN ] GM: Generated 1807 derivative records from 54119 primary records. [2025-10-09T22:39:13.191678] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-09T22:39:13.222852] [DEBUG] [LOCAL ] GM: Derivative data saved (1807 records). [2025-10-09T22:39:13.223249] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-09T22:39:13.223188] [DEBUG] [MAIN ] GME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:13.225338] [INFO ] [MAIN ] Derivative Progress: 793/1690 symbols completed. GM took 1.1s. Estimated remaining: 5m 49s. Rate: 154.1 symbols/min [2025-10-09T22:39:13.226469] [INFO ] [MAIN ] GME: Generated 1807 derivative records from 54173 primary records. [2025-10-09T22:39:13.226692] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-09T22:39:13.242885] [DEBUG] [LOCAL ] GME: Derivative data saved (1807 records). [2025-10-09T22:39:13.243689] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-09T22:39:13.247509] [INFO ] [MAIN ] Derivative Progress: 794/1690 symbols completed. GME took 1.1s. Estimated remaining: 5m 48s. Rate: 154.3 symbols/min [2025-10-09T22:39:13.260826] [DEBUG] [MAIN ] GMED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:13.261359] [INFO ] [MAIN ] GMED: Generated 1807 derivative records from 48701 primary records. [2025-10-09T22:39:13.261415] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-09T22:39:13.276578] [DEBUG] [LOCAL ] GMED: Derivative data saved (1807 records). [2025-10-09T22:39:13.276636] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-09T22:39:13.279364] [INFO ] [MAIN ] Derivative Progress: 795/1690 symbols completed. GMED took 1.1s. Estimated remaining: 5m 48s. Rate: 154.5 symbols/min [2025-10-09T22:39:13.279796] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:13.279960] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:13.279889] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:13.301068] [DEBUG] [LOCAL ] GNE: Loaded 17962 existing records from primary storage. [2025-10-09T22:39:13.301226] [INFO ] [MAIN ] GNE: Loaded 17962 primary data records. [2025-10-09T22:39:13.515358] [DEBUG] [LOCAL ] GMRE: Loaded 37301 existing records from primary storage. [2025-10-09T22:39:13.536391] [INFO ] [MAIN ] GMRE: Loaded 37301 primary data records. [2025-10-09T22:39:13.651739] [DEBUG] [LOCAL ] GNK: Loaded 40519 existing records from primary storage. [2025-10-09T22:39:13.737282] [INFO ] [MAIN ] GNK: Loaded 40519 primary data records. [2025-10-09T22:39:14.358087] [DEBUG] [MAIN ] GNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:14.359384] [INFO ] [MAIN ] GNE: Generated 1807 derivative records from 17962 primary records. [2025-10-09T22:39:14.359567] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-09T22:39:14.378792] [DEBUG] [LOCAL ] GNE: Derivative data saved (1807 records). [2025-10-09T22:39:14.387220] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-09T22:39:14.389718] [INFO ] [MAIN ] Derivative Progress: 796/1690 symbols completed. GNE took 1.1s. Estimated remaining: 5m 48s. Rate: 154.1 symbols/min [2025-10-09T22:39:14.394692] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:14.396232] [DEBUG] [MAIN ] GMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:14.397156] [INFO ] [MAIN ] GMRE: Generated 1807 derivative records from 37301 primary records. [2025-10-09T22:39:14.397340] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-09T22:39:14.414032] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1807 records). [2025-10-09T22:39:14.414450] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-09T22:39:14.416835] [INFO ] [MAIN ] Derivative Progress: 797/1690 symbols completed. GMRE took 1.1s. Estimated remaining: 5m 47s. Rate: 154.3 symbols/min [2025-10-09T22:39:14.417013] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:14.435000] [DEBUG] [MAIN ] GNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:14.435787] [INFO ] [MAIN ] GNK: Generated 1807 derivative records from 40519 primary records. [2025-10-09T22:39:14.435911] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-09T22:39:14.468114] [DEBUG] [LOCAL ] GNK: Derivative data saved (1807 records). [2025-10-09T22:39:14.468526] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-09T22:39:14.471813] [INFO ] [MAIN ] Derivative Progress: 798/1690 symbols completed. GNK took 1.2s. Estimated remaining: 5m 46s. Rate: 154.5 symbols/min [2025-10-09T22:39:14.472285] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:14.501178] [DEBUG] [LOCAL ] GNL: Loaded 47094 existing records from primary storage. [2025-10-09T22:39:14.501407] [INFO ] [MAIN ] GNL: Loaded 47094 primary data records. [2025-10-09T22:39:14.549605] [DEBUG] [LOCAL ] GNT: Loaded 8376 existing records from primary storage. [2025-10-09T22:39:14.582285] [INFO ] [MAIN ] GNT: Loaded 8376 primary data records. [2025-10-09T22:39:14.663673] [DEBUG] [LOCAL ] GNRC: Loaded 45593 existing records from primary storage. [2025-10-09T22:39:14.716986] [INFO ] [MAIN ] GNRC: Loaded 45593 primary data records. [2025-10-09T22:39:15.472802] [DEBUG] [MAIN ] GNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:15.473864] [INFO ] [MAIN ] GNL: Generated 1807 derivative records from 47094 primary records. [2025-10-09T22:39:15.486525] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-09T22:39:15.487761] [DEBUG] [MAIN ] GNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:15.489125] [INFO ] [MAIN ] GNT: Generated 1807 derivative records from 8376 primary records. [2025-10-09T22:39:15.489349] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-09T22:39:15.518458] [DEBUG] [LOCAL ] GNL: Derivative data saved (1807 records). [2025-10-09T22:39:15.522864] [DEBUG] [LOCAL ] GNT: Derivative data saved (1807 records). [2025-10-09T22:39:15.522998] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-09T22:39:15.523120] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-09T22:39:15.526115] [INFO ] [MAIN ] Derivative Progress: 799/1690 symbols completed. GNL took 1.1s. Estimated remaining: 5m 47s. Rate: 154.2 symbols/min [2025-10-09T22:39:15.526325] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:15.529523] [INFO ] [MAIN ] Derivative Progress: 800/1690 symbols completed. GNT took 1.1s. Estimated remaining: 5m 46s. Rate: 154.3 symbols/min [2025-10-09T22:39:15.529871] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:15.543242] [DEBUG] [MAIN ] GNRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:15.544586] [INFO ] [MAIN ] GNRC: Generated 1807 derivative records from 45593 primary records. [2025-10-09T22:39:15.544696] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-09T22:39:15.561829] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1807 records). [2025-10-09T22:39:15.562010] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-09T22:39:15.565155] [INFO ] [MAIN ] Derivative Progress: 801/1690 symbols completed. GNRC took 1.1s. Estimated remaining: 5m 45s. Rate: 154.5 symbols/min [2025-10-09T22:39:15.565356] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:15.618951] [DEBUG] [LOCAL ] GOLF: Loaded 31223 existing records from primary storage. [2025-10-09T22:39:15.619140] [INFO ] [MAIN ] GOLF: Loaded 31223 primary data records. [2025-10-09T22:39:15.717441] [DEBUG] [LOCAL ] GOF: Loaded 42828 existing records from primary storage. [2025-10-09T22:39:15.753775] [INFO ] [MAIN ] GOF: Loaded 42828 primary data records. [2025-10-09T22:39:15.800680] [DEBUG] [LOCAL ] GNW: Loaded 51730 existing records from primary storage. [2025-10-09T22:39:15.893441] [INFO ] [MAIN ] GNW: Loaded 51730 primary data records. [2025-10-09T22:39:16.638526] [DEBUG] [MAIN ] GOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:16.639549] [INFO ] [MAIN ] GOLF: Generated 1807 derivative records from 31223 primary records. [2025-10-09T22:39:16.639931] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-09T22:39:16.659747] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1807 records). [2025-10-09T22:39:16.661130] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-09T22:39:16.663234] [INFO ] [MAIN ] Derivative Progress: 802/1690 symbols completed. GOLF took 1.1s. Estimated remaining: 5m 46s. Rate: 154.2 symbols/min [2025-10-09T22:39:16.663545] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:16.677507] [DEBUG] [MAIN ] GOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:16.679579] [INFO ] [MAIN ] GOF: Generated 1807 derivative records from 42828 primary records. [2025-10-09T22:39:16.680629] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-09T22:39:16.710137] [DEBUG] [MAIN ] GNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:16.714086] [INFO ] [MAIN ] GNW: Generated 1807 derivative records from 51730 primary records. [2025-10-09T22:39:16.714881] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-09T22:39:16.734368] [DEBUG] [LOCAL ] GOF: Derivative data saved (1807 records). [2025-10-09T22:39:16.736261] [DEBUG] [LOCAL ] GNW: Derivative data saved (1807 records). [2025-10-09T22:39:16.736396] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-09T22:39:16.740265] [INFO ] [MAIN ] Derivative Progress: 803/1690 symbols completed. GNW took 1.2s. Estimated remaining: 5m 45s. Rate: 154.3 symbols/min [2025-10-09T22:39:16.735796] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-09T22:39:16.740813] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:16.744517] [INFO ] [MAIN ] Derivative Progress: 804/1690 symbols completed. GOF took 1.2s. Estimated remaining: 5m 44s. Rate: 154.5 symbols/min [2025-10-09T22:39:16.745614] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:16.787615] [DEBUG] [LOCAL ] GOOS: Loaded 45117 existing records from primary storage. [2025-10-09T22:39:16.787982] [INFO ] [MAIN ] GOOS: Loaded 45117 primary data records. [2025-10-09T22:39:16.910008] [DEBUG] [LOCAL ] GOTU: Loaded 37996 existing records from primary storage. [2025-10-09T22:39:16.910545] [INFO ] [MAIN ] GOTU: Loaded 37996 primary data records. [2025-10-09T22:39:17.246304] [DEBUG] [LOCAL ] GPC: Loaded 46526 existing records from primary storage. [2025-10-09T22:39:17.262393] [INFO ] [MAIN ] GPC: Loaded 46526 primary data records. [2025-10-09T22:39:17.798299] [DEBUG] [MAIN ] GOOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:17.800694] [INFO ] [MAIN ] GOOS: Generated 1807 derivative records from 45117 primary records. [2025-10-09T22:39:17.800951] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-09T22:39:17.836837] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1807 records). [2025-10-09T22:39:17.838024] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-09T22:39:17.840583] [INFO ] [MAIN ] Derivative Progress: 805/1690 symbols completed. GOOS took 1.2s. Estimated remaining: 5m 44s. Rate: 154.2 symbols/min [2025-10-09T22:39:17.837874] [DEBUG] [MAIN ] GOTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:17.840964] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:17.843154] [INFO ] [MAIN ] GOTU: Generated 1807 derivative records from 37996 primary records. [2025-10-09T22:39:17.843513] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-09T22:39:17.890427] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1807 records). [2025-10-09T22:39:17.891629] [DEBUG] [LOCAL ] GPI: Loaded 14741 existing records from primary storage. [2025-10-09T22:39:17.892547] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-09T22:39:17.892750] [INFO ] [MAIN ] GPI: Loaded 14741 primary data records. [2025-10-09T22:39:17.892454] [DEBUG] [MAIN ] GPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:17.897077] [INFO ] [MAIN ] Derivative Progress: 806/1690 symbols completed. GOTU took 1.2s. Estimated remaining: 5m 44s. Rate: 154.3 symbols/min [2025-10-09T22:39:17.910781] [INFO ] [MAIN ] GPC: Generated 1807 derivative records from 46526 primary records. [2025-10-09T22:39:17.933358] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-09T22:39:17.933565] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:18.056742] [DEBUG] [LOCAL ] GPJA: Loaded 4288 existing records from primary storage. [2025-10-09T22:39:18.063511] [INFO ] [MAIN ] GPJA: Loaded 4288 primary data records. [2025-10-09T22:39:18.089193] [DEBUG] [LOCAL ] GPC: Derivative data saved (1807 records). [2025-10-09T22:39:18.120485] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-09T22:39:18.147392] [INFO ] [MAIN ] Derivative Progress: 807/1690 symbols completed. GPC took 1.4s. Estimated remaining: 5m 43s. Rate: 154.4 symbols/min [2025-10-09T22:39:18.180994] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:18.827857] [DEBUG] [LOCAL ] GPK: Loaded 53056 existing records from primary storage. [2025-10-09T22:39:18.828506] [INFO ] [MAIN ] GPK: Loaded 53056 primary data records. [2025-10-09T22:39:18.971127] [DEBUG] [MAIN ] GPI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:39:18.983273] [INFO ] [MAIN ] GPI: Generated 1806 derivative records from 14741 primary records. [2025-10-09T22:39:18.996002] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-09T22:39:19.168180] [DEBUG] [LOCAL ] GPI: Derivative data saved (1806 records). [2025-10-09T22:39:19.291417] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-09T22:39:19.311420] [INFO ] [MAIN ] Derivative Progress: 808/1690 symbols completed. GPI took 1.5s. Estimated remaining: 5m 44s. Rate: 154.0 symbols/min [2025-10-09T22:39:19.326039] [DEBUG] [MAIN ] GPJA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:39:19.327155] [INFO ] [MAIN ] GPJA: Generated 1806 derivative records from 4288 primary records. [2025-10-09T22:39:19.327394] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-09T22:39:19.349597] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1806 records). [2025-10-09T22:39:19.349791] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-09T22:39:19.353336] [INFO ] [MAIN ] Derivative Progress: 809/1690 symbols completed. GPJA took 1.4s. Estimated remaining: 5m 43s. Rate: 154.2 symbols/min [2025-10-09T22:39:19.372367] [DEBUG] [MAIN ] GPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:19.373023] [INFO ] [MAIN ] GPK: Generated 1807 derivative records from 53056 primary records. [2025-10-09T22:39:19.373085] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-09T22:39:19.388933] [DEBUG] [LOCAL ] GPK: Derivative data saved (1807 records). [2025-10-09T22:39:19.389071] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-09T22:39:19.392320] [INFO ] [MAIN ] Derivative Progress: 810/1690 symbols completed. GPK took 1.2s. Estimated remaining: 5m 42s. Rate: 154.4 symbols/min [2025-10-09T22:39:19.392902] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:19.393084] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:19.392968] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:19.425465] [DEBUG] [LOCAL ] GPOR: Loaded 23434 existing records from primary storage. [2025-10-09T22:39:19.433349] [INFO ] [MAIN ] GPOR: Loaded 23434 primary data records. [2025-10-09T22:39:19.434015] [DEBUG] [LOCAL ] GPMT: Loaded 26009 existing records from primary storage. [2025-10-09T22:39:19.466293] [INFO ] [MAIN ] GPMT: Loaded 26009 primary data records. [2025-10-09T22:39:19.698813] [DEBUG] [LOCAL ] GPN: Loaded 52403 existing records from primary storage. [2025-10-09T22:39:19.753470] [INFO ] [MAIN ] GPN: Loaded 52403 primary data records. [2025-10-09T22:39:20.389564] [DEBUG] [MAIN ] GPOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:20.390548] [INFO ] [MAIN ] GPOR: Generated 1807 derivative records from 23434 primary records. [2025-10-09T22:39:20.390772] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-09T22:39:20.421614] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1807 records). [2025-10-09T22:39:20.422799] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-09T22:39:20.426144] [INFO ] [MAIN ] Derivative Progress: 811/1690 symbols completed. GPOR took 1.0s. Estimated remaining: 5m 42s. Rate: 154.0 symbols/min [2025-10-09T22:39:20.426286] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:20.423798] [DEBUG] [MAIN ] GPMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:20.428333] [INFO ] [MAIN ] GPMT: Generated 1807 derivative records from 26009 primary records. [2025-10-09T22:39:20.428820] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-09T22:39:20.453762] [DEBUG] [MAIN ] GPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:20.459241] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1807 records). [2025-10-09T22:39:20.456572] [INFO ] [MAIN ] GPN: Generated 1807 derivative records from 52403 primary records. [2025-10-09T22:39:20.459449] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-09T22:39:20.459530] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-09T22:39:20.462124] [INFO ] [MAIN ] Derivative Progress: 812/1690 symbols completed. GPMT took 1.1s. Estimated remaining: 5m 42s. Rate: 154.2 symbols/min [2025-10-09T22:39:20.463038] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:20.492241] [DEBUG] [LOCAL ] GPN: Derivative data saved (1807 records). [2025-10-09T22:39:20.492390] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-09T22:39:20.496429] [INFO ] [MAIN ] Derivative Progress: 813/1690 symbols completed. GPN took 1.1s. Estimated remaining: 5m 41s. Rate: 154.4 symbols/min [2025-10-09T22:39:20.496884] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:20.516577] [DEBUG] [LOCAL ] GPRK: Loaded 39734 existing records from primary storage. [2025-10-09T22:39:20.516948] [INFO ] [MAIN ] GPRK: Loaded 39734 primary data records. [2025-10-09T22:39:20.639204] [DEBUG] [LOCAL ] GRC: Loaded 9268 existing records from primary storage. [2025-10-09T22:39:20.638929] [DEBUG] [LOCAL ] GRBK: Loaded 27216 existing records from primary storage. [2025-10-09T22:39:20.650020] [INFO ] [MAIN ] GRC: Loaded 9268 primary data records. [2025-10-09T22:39:20.686064] [INFO ] [MAIN ] GRBK: Loaded 27216 primary data records. [2025-10-09T22:39:21.504263] [DEBUG] [MAIN ] GPRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:21.505473] [INFO ] [MAIN ] GPRK: Generated 1807 derivative records from 39734 primary records. [2025-10-09T22:39:21.505850] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-09T22:39:21.519200] [DEBUG] [MAIN ] GRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:21.527415] [INFO ] [MAIN ] GRC: Generated 1807 derivative records from 9268 primary records. [2025-10-09T22:39:21.528859] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-09T22:39:21.535916] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1807 records). [2025-10-09T22:39:21.536088] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-09T22:39:21.538298] [INFO ] [MAIN ] Derivative Progress: 814/1690 symbols completed. GPRK took 1.1s. Estimated remaining: 5m 41s. Rate: 154.1 symbols/min [2025-10-09T22:39:21.539154] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:21.557946] [DEBUG] [LOCAL ] GRC: Derivative data saved (1807 records). [2025-10-09T22:39:21.558104] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-09T22:39:21.573742] [INFO ] [MAIN ] Derivative Progress: 815/1690 symbols completed. GRC took 1.1s. Estimated remaining: 5m 40s. Rate: 154.2 symbols/min [2025-10-09T22:39:21.573888] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:21.570892] [DEBUG] [MAIN ] GRBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:21.574911] [INFO ] [MAIN ] GRBK: Generated 1807 derivative records from 27216 primary records. [2025-10-09T22:39:21.575290] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-09T22:39:21.606039] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1807 records). [2025-10-09T22:39:21.606248] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-09T22:39:21.609524] [INFO ] [MAIN ] Derivative Progress: 816/1690 symbols completed. GRBK took 1.1s. Estimated remaining: 5m 40s. Rate: 154.4 symbols/min [2025-10-09T22:39:21.609731] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:21.611040] [DEBUG] [LOCAL ] GRDN: Loaded 21074 existing records from primary storage. [2025-10-09T22:39:21.611246] [INFO ] [MAIN ] GRDN: Loaded 21074 primary data records. [2025-10-09T22:39:21.931225] [DEBUG] [LOCAL ] GRMN: Loaded 40895 existing records from primary storage. [2025-10-09T22:39:21.945962] [INFO ] [MAIN ] GRMN: Loaded 40895 primary data records. [2025-10-09T22:39:22.066243] [DEBUG] [LOCAL ] GRND: Loaded 50333 existing records from primary storage. [2025-10-09T22:39:22.093049] [INFO ] [MAIN ] GRND: Loaded 50333 primary data records. [2025-10-09T22:39:22.619804] [DEBUG] [MAIN ] GRDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:22.628201] [INFO ] [MAIN ] GRDN: Generated 1807 derivative records from 21074 primary records. [2025-10-09T22:39:22.638320] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-09T22:39:22.661866] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1807 records). [2025-10-09T22:39:22.662839] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-09T22:39:22.666231] [INFO ] [MAIN ] Derivative Progress: 817/1690 symbols completed. GRDN took 1.1s. Estimated remaining: 5m 40s. Rate: 154.1 symbols/min [2025-10-09T22:39:22.666869] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:22.684588] [DEBUG] [MAIN ] GRMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:22.685534] [INFO ] [MAIN ] GRMN: Generated 1807 derivative records from 40895 primary records. [2025-10-09T22:39:22.685893] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-09T22:39:22.706324] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1807 records). [2025-10-09T22:39:22.714666] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-09T22:39:22.718123] [INFO ] [MAIN ] Derivative Progress: 818/1690 symbols completed. GRMN took 1.1s. Estimated remaining: 5m 39s. Rate: 154.3 symbols/min [2025-10-09T22:39:22.718558] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:22.731995] [DEBUG] [MAIN ] GRND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:22.732744] [INFO ] [MAIN ] GRND: Generated 1807 derivative records from 50333 primary records. [2025-10-09T22:39:22.733462] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-09T22:39:22.753589] [DEBUG] [LOCAL ] GRNT: Loaded 34158 existing records from primary storage. [2025-10-09T22:39:22.757324] [INFO ] [MAIN ] GRNT: Loaded 34158 primary data records. [2025-10-09T22:39:22.799838] [DEBUG] [LOCAL ] GROV: Loaded 8881 existing records from primary storage. [2025-10-09T22:39:22.829919] [INFO ] [MAIN ] GROV: Loaded 8881 primary data records. [2025-10-09T22:39:22.951815] [DEBUG] [LOCAL ] GRND: Derivative data saved (1807 records). [2025-10-09T22:39:23.063393] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-09T22:39:23.122262] [INFO ] [MAIN ] Derivative Progress: 819/1690 symbols completed. GRND took 1.5s. Estimated remaining: 5m 39s. Rate: 154.2 symbols/min [2025-10-09T22:39:23.235149] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:23.373770] [DEBUG] [LOCAL ] GRX: Loaded 4805 existing records from primary storage. [2025-10-09T22:39:23.374856] [INFO ] [MAIN ] GRX: Loaded 4805 primary data records. [2025-10-09T22:39:23.801114] [DEBUG] [MAIN ] GRNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:23.800326] [DEBUG] [MAIN ] GROV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:23.802274] [INFO ] [MAIN ] GROV: Generated 1807 derivative records from 8881 primary records. [2025-10-09T22:39:23.802954] [INFO ] [MAIN ] GRNT: Generated 1807 derivative records from 34158 primary records. [2025-10-09T22:39:23.803053] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-09T22:39:23.803113] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-09T22:39:23.831481] [DEBUG] [LOCAL ] GROV: Derivative data saved (1807 records). [2025-10-09T22:39:23.834935] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-09T22:39:23.838319] [INFO ] [MAIN ] Derivative Progress: 820/1690 symbols completed. GROV took 1.1s. Estimated remaining: 5m 39s. Rate: 154.1 symbols/min [2025-10-09T22:39:23.839985] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1807 records). [2025-10-09T22:39:23.840140] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-09T22:39:23.842598] [INFO ] [MAIN ] Derivative Progress: 821/1690 symbols completed. GRNT took 1.2s. Estimated remaining: 5m 38s. Rate: 154.3 symbols/min [2025-10-09T22:39:23.840247] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:23.843416] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:23.863409] [DEBUG] [MAIN ] GRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:23.864251] [INFO ] [MAIN ] GRX: Generated 1807 derivative records from 4805 primary records. [2025-10-09T22:39:23.864407] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-09T22:39:23.898195] [DEBUG] [LOCAL ] GRX: Derivative data saved (1807 records). [2025-10-09T22:39:23.898318] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-09T22:39:23.901984] [INFO ] [MAIN ] Derivative Progress: 822/1690 symbols completed. GRX took 0.7s. Estimated remaining: 5m 37s. Rate: 154.4 symbols/min [2025-10-09T22:39:23.902216] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:23.918674] [DEBUG] [LOCAL ] GSBD: Loaded 39733 existing records from primary storage. [2025-10-09T22:39:23.918906] [INFO ] [MAIN ] GSBD: Loaded 39733 primary data records. [2025-10-09T22:39:24.086555] [DEBUG] [LOCAL ] GS: Loaded 52147 existing records from primary storage. [2025-10-09T22:39:24.086948] [INFO ] [MAIN ] GS: Loaded 52147 primary data records. [2025-10-09T22:39:24.384958] [DEBUG] [LOCAL ] GSK: Loaded 53890 existing records from primary storage. [2025-10-09T22:39:24.396258] [INFO ] [MAIN ] GSK: Loaded 53890 primary data records. [2025-10-09T22:39:24.977626] [DEBUG] [MAIN ] GSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:24.979183] [INFO ] [MAIN ] GSBD: Generated 1807 derivative records from 39733 primary records. [2025-10-09T22:39:24.979440] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-09T22:39:24.999250] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1807 records). [2025-10-09T22:39:25.000546] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-09T22:39:25.003934] [INFO ] [MAIN ] Derivative Progress: 823/1690 symbols completed. GSBD took 1.2s. Estimated remaining: 5m 38s. Rate: 154.1 symbols/min [2025-10-09T22:39:25.019694] [DEBUG] [MAIN ] GS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:25.020441] [INFO ] [MAIN ] GS: Generated 1807 derivative records from 52147 primary records. [2025-10-09T22:39:25.020634] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-09T22:39:25.041617] [DEBUG] [LOCAL ] GS: Derivative data saved (1807 records). [2025-10-09T22:39:25.041795] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-09T22:39:25.044547] [INFO ] [MAIN ] Derivative Progress: 824/1690 symbols completed. GS took 1.2s. Estimated remaining: 5m 37s. Rate: 154.3 symbols/min [2025-10-09T22:39:25.057121] [DEBUG] [MAIN ] GSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:25.057710] [INFO ] [MAIN ] GSK: Generated 1807 derivative records from 53890 primary records. [2025-10-09T22:39:25.057770] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-09T22:39:25.072619] [DEBUG] [LOCAL ] GSK: Derivative data saved (1807 records). [2025-10-09T22:39:25.072704] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-09T22:39:25.075947] [INFO ] [MAIN ] Derivative Progress: 825/1690 symbols completed. GSK took 1.2s. Estimated remaining: 5m 36s. Rate: 154.4 symbols/min [2025-10-09T22:39:25.076504] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:25.076430] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:25.077032] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:25.124444] [DEBUG] [LOCAL ] GSL: Loaded 33451 existing records from primary storage. [2025-10-09T22:39:25.134979] [INFO ] [MAIN ] GSL: Loaded 33451 primary data records. [2025-10-09T22:39:25.264513] [DEBUG] [LOCAL ] GTLS: Loaded 43271 existing records from primary storage. [2025-10-09T22:39:25.287589] [DEBUG] [LOCAL ] GTES: Loaded 50804 existing records from primary storage. [2025-10-09T22:39:25.276573] [INFO ] [MAIN ] GTLS: Loaded 43271 primary data records. [2025-10-09T22:39:25.315685] [INFO ] [MAIN ] GTES: Loaded 50804 primary data records. [2025-10-09T22:39:26.079050] [DEBUG] [MAIN ] GSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:26.080557] [INFO ] [MAIN ] GSL: Generated 1807 derivative records from 33451 primary records. [2025-10-09T22:39:26.081032] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-09T22:39:26.100682] [DEBUG] [LOCAL ] GSL: Derivative data saved (1807 records). [2025-10-09T22:39:26.100905] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-09T22:39:26.103868] [INFO ] [MAIN ] Derivative Progress: 826/1690 symbols completed. GSL took 1.0s. Estimated remaining: 5m 36s. Rate: 154.1 symbols/min [2025-10-09T22:39:26.106784] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:26.123512] [DEBUG] [MAIN ] GTES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:26.137906] [DEBUG] [MAIN ] GTLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:26.138584] [INFO ] [MAIN ] GTLS: Generated 1807 derivative records from 43271 primary records. [2025-10-09T22:39:26.138693] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-09T22:39:26.137696] [INFO ] [MAIN ] GTES: Generated 1807 derivative records from 50804 primary records. [2025-10-09T22:39:26.138800] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-09T22:39:26.167729] [DEBUG] [LOCAL ] GTES: Derivative data saved (1807 records). [2025-10-09T22:39:26.168547] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-09T22:39:26.171674] [INFO ] [MAIN ] Derivative Progress: 827/1690 symbols completed. GTES took 1.1s. Estimated remaining: 5m 36s. Rate: 154.3 symbols/min [2025-10-09T22:39:26.172063] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:26.184666] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1807 records). [2025-10-09T22:39:26.184830] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-09T22:39:26.187703] [INFO ] [MAIN ] Derivative Progress: 828/1690 symbols completed. GTLS took 1.1s. Estimated remaining: 5m 35s. Rate: 154.5 symbols/min [2025-10-09T22:39:26.188050] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:26.205413] [DEBUG] [LOCAL ] GTN: Loaded 45558 existing records from primary storage. [2025-10-09T22:39:26.207999] [INFO ] [MAIN ] GTN: Loaded 45558 primary data records. [2025-10-09T22:39:26.293247] [DEBUG] [LOCAL ] GUG: Loaded 12290 existing records from primary storage. [2025-10-09T22:39:26.323723] [INFO ] [MAIN ] GUG: Loaded 12290 primary data records. [2025-10-09T22:39:26.373330] [DEBUG] [LOCAL ] GTY: Loaded 30428 existing records from primary storage. [2025-10-09T22:39:26.398396] [INFO ] [MAIN ] GTY: Loaded 30428 primary data records. [2025-10-09T22:39:27.296277] [DEBUG] [MAIN ] GTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:27.296924] [DEBUG] [MAIN ] GTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:27.298278] [INFO ] [MAIN ] GTY: Generated 1807 derivative records from 30428 primary records. [2025-10-09T22:39:27.298753] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-09T22:39:27.300664] [INFO ] [MAIN ] GTN: Generated 1807 derivative records from 45558 primary records. [2025-10-09T22:39:27.299088] [DEBUG] [MAIN ] GUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:27.301417] [INFO ] [MAIN ] GUG: Generated 1807 derivative records from 12290 primary records. [2025-10-09T22:39:27.301879] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-09T22:39:27.301523] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-09T22:39:27.347733] [DEBUG] [LOCAL ] GUG: Derivative data saved (1807 records). [2025-10-09T22:39:27.349145] [DEBUG] [LOCAL ] GTN: Derivative data saved (1807 records). [2025-10-09T22:39:27.349983] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-09T22:39:27.349872] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-09T22:39:27.354842] [INFO ] [MAIN ] Derivative Progress: 829/1690 symbols completed. GTN took 1.2s. Estimated remaining: 5m 35s. Rate: 154.1 symbols/min [2025-10-09T22:39:27.359435] [INFO ] [MAIN ] Derivative Progress: 830/1690 symbols completed. GUG took 1.2s. Estimated remaining: 5m 34s. Rate: 154.3 symbols/min [2025-10-09T22:39:27.359802] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:27.356334] [DEBUG] [LOCAL ] GTY: Derivative data saved (1807 records). [2025-10-09T22:39:27.356517] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:27.360221] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-09T22:39:27.364690] [INFO ] [MAIN ] Derivative Progress: 831/1690 symbols completed. GTY took 1.2s. Estimated remaining: 5m 34s. Rate: 154.5 symbols/min [2025-10-09T22:39:27.365094] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:27.381032] [DEBUG] [LOCAL ] GUT: Loaded 15593 existing records from primary storage. [2025-10-09T22:39:27.381236] [INFO ] [MAIN ] GUT: Loaded 15593 primary data records. [2025-10-09T22:39:27.505372] [DEBUG] [LOCAL ] GWH: Loaded 17262 existing records from primary storage. [2025-10-09T22:39:27.505562] [INFO ] [MAIN ] GWH: Loaded 17262 primary data records. [2025-10-09T22:39:27.679544] [DEBUG] [LOCAL ] GVA: Loaded 33049 existing records from primary storage. [2025-10-09T22:39:27.832984] [INFO ] [MAIN ] GVA: Loaded 33049 primary data records. [2025-10-09T22:39:28.472063] [DEBUG] [MAIN ] GUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:28.474421] [INFO ] [MAIN ] GUT: Generated 1807 derivative records from 15593 primary records. [2025-10-09T22:39:28.474870] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-09T22:39:28.513771] [DEBUG] [MAIN ] GWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:28.516294] [DEBUG] [LOCAL ] GUT: Derivative data saved (1807 records). [2025-10-09T22:39:28.517946] [INFO ] [MAIN ] GWH: Generated 1807 derivative records from 17262 primary records. [2025-10-09T22:39:28.518516] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-09T22:39:28.522000] [INFO ] [MAIN ] Derivative Progress: 832/1690 symbols completed. GUT took 1.2s. Estimated remaining: 5m 34s. Rate: 154.1 symbols/min [2025-10-09T22:39:28.518809] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-09T22:39:28.522442] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:28.545004] [DEBUG] [LOCAL ] GWH: Derivative data saved (1807 records). [2025-10-09T22:39:28.545443] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-09T22:39:28.557619] [INFO ] [MAIN ] Derivative Progress: 833/1690 symbols completed. GWH took 1.2s. Estimated remaining: 5m 33s. Rate: 154.3 symbols/min [2025-10-09T22:39:28.563417] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:28.563283] [DEBUG] [MAIN ] GVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:28.564632] [INFO ] [MAIN ] GVA: Generated 1807 derivative records from 33049 primary records. [2025-10-09T22:39:28.564732] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-09T22:39:28.587359] [DEBUG] [LOCAL ] GVA: Derivative data saved (1807 records). [2025-10-09T22:39:28.587870] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-09T22:39:28.591981] [INFO ] [MAIN ] Derivative Progress: 834/1690 symbols completed. GVA took 1.2s. Estimated remaining: 5m 33s. Rate: 154.4 symbols/min [2025-10-09T22:39:28.604295] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:28.621372] [DEBUG] [LOCAL ] GWW: Loaded 19575 existing records from primary storage. [2025-10-09T22:39:28.632989] [INFO ] [MAIN ] GWW: Loaded 19575 primary data records. [2025-10-09T22:39:28.657662] [DEBUG] [LOCAL ] GWRE: Loaded 40388 existing records from primary storage. [2025-10-09T22:39:28.691766] [INFO ] [MAIN ] GWRE: Loaded 40388 primary data records. [2025-10-09T22:39:28.947937] [DEBUG] [LOCAL ] GXO: Loaded 47389 existing records from primary storage. [2025-10-09T22:39:28.994031] [INFO ] [MAIN ] GXO: Loaded 47389 primary data records. [2025-10-09T22:39:29.697746] [DEBUG] [MAIN ] GWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:29.698091] [DEBUG] [MAIN ] GWRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:29.699183] [INFO ] [MAIN ] GWW: Generated 1807 derivative records from 19575 primary records. [2025-10-09T22:39:29.700397] [INFO ] [MAIN ] GWRE: Generated 1807 derivative records from 40388 primary records. [2025-10-09T22:39:29.700527] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-09T22:39:29.700714] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-09T22:39:29.734116] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1807 records). [2025-10-09T22:39:29.735665] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-09T22:39:29.738798] [INFO ] [MAIN ] Derivative Progress: 835/1690 symbols completed. GWRE took 1.2s. Estimated remaining: 5m 33s. Rate: 154.1 symbols/min [2025-10-09T22:39:29.739076] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:29.755183] [DEBUG] [MAIN ] GXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:29.756021] [INFO ] [MAIN ] GXO: Generated 1807 derivative records from 47389 primary records. [2025-10-09T22:39:29.756624] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-09T22:39:29.754849] [DEBUG] [LOCAL ] GWW: Derivative data saved (1807 records). [2025-10-09T22:39:29.757554] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-09T22:39:29.759960] [INFO ] [MAIN ] Derivative Progress: 836/1690 symbols completed. GWW took 1.2s. Estimated remaining: 5m 32s. Rate: 154.2 symbols/min [2025-10-09T22:39:29.760367] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:29.770970] [DEBUG] [LOCAL ] GYLD: Loaded 1552 existing records from primary storage. [2025-10-09T22:39:29.777476] [INFO ] [MAIN ] GYLD: Loaded 1552 primary data records. [2025-10-09T22:39:29.816661] [DEBUG] [LOCAL ] GXO: Derivative data saved (1807 records). [2025-10-09T22:39:29.835734] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-09T22:39:29.847450] [INFO ] [MAIN ] Derivative Progress: 837/1690 symbols completed. GXO took 1.2s. Estimated remaining: 5m 32s. Rate: 154.4 symbols/min [2025-10-09T22:39:29.859524] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:30.119791] [DEBUG] [LOCAL ] H: Loaded 44843 existing records from primary storage. [2025-10-09T22:39:30.120152] [INFO ] [MAIN ] H: Loaded 44843 primary data records. [2025-10-09T22:39:30.274757] [DEBUG] [LOCAL ] HAFN: Loaded 43476 existing records from primary storage. [2025-10-09T22:39:30.290272] [INFO ] [MAIN ] HAFN: Loaded 43476 primary data records. [2025-10-09T22:39:30.600681] [DEBUG] [MAIN ] GYLD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:39:30.616235] [INFO ] [MAIN ] GYLD: Generated 1806 derivative records from 1552 primary records. [2025-10-09T22:39:30.628328] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-09T22:39:30.712251] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1806 records). [2025-10-09T22:39:30.734459] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-09T22:39:30.851332] [INFO ] [MAIN ] Derivative Progress: 838/1690 symbols completed. GYLD took 1.1s. Estimated remaining: 5m 32s. Rate: 154.1 symbols/min [2025-10-09T22:39:30.884862] [DEBUG] [MAIN ] H: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:30.885786] [INFO ] [MAIN ] H: Generated 1807 derivative records from 44843 primary records. [2025-10-09T22:39:30.885876] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-09T22:39:30.904112] [DEBUG] [LOCAL ] H: Derivative data saved (1807 records). [2025-10-09T22:39:30.905683] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-09T22:39:30.911064] [INFO ] [MAIN ] Derivative Progress: 839/1690 symbols completed. H took 1.2s. Estimated remaining: 5m 31s. Rate: 154.2 symbols/min [2025-10-09T22:39:30.924110] [DEBUG] [MAIN ] HAFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:30.924762] [INFO ] [MAIN ] HAFN: Generated 1807 derivative records from 43476 primary records. [2025-10-09T22:39:30.924825] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-09T22:39:30.944104] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1807 records). [2025-10-09T22:39:30.944209] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-09T22:39:30.948269] [INFO ] [MAIN ] Derivative Progress: 840/1690 symbols completed. HAFN took 1.1s. Estimated remaining: 5m 30s. Rate: 154.4 symbols/min [2025-10-09T22:39:30.948763] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:30.948957] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:30.948843] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:31.024911] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-10-09T22:39:31.025181] [INFO ] [MAIN ] HAL: Loaded 54108 primary data records. [2025-10-09T22:39:31.152901] [DEBUG] [LOCAL ] HAYW: Loaded 49097 existing records from primary storage. [2025-10-09T22:39:31.154052] [INFO ] [MAIN ] HAYW: Loaded 49097 primary data records. [2025-10-09T22:39:31.154827] [DEBUG] [LOCAL ] HASI: Loaded 47632 existing records from primary storage. [2025-10-09T22:39:31.239230] [INFO ] [MAIN ] HASI: Loaded 47632 primary data records. [2025-10-09T22:39:32.031608] [DEBUG] [MAIN ] HAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:32.033688] [INFO ] [MAIN ] HAL: Generated 1807 derivative records from 54108 primary records. [2025-10-09T22:39:32.033895] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-09T22:39:32.053734] [DEBUG] [LOCAL ] HAL: Derivative data saved (1807 records). [2025-10-09T22:39:32.053965] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-09T22:39:32.055876] [INFO ] [MAIN ] Derivative Progress: 841/1690 symbols completed. HAL took 1.1s. Estimated remaining: 5m 31s. Rate: 154.1 symbols/min [2025-10-09T22:39:32.056125] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:32.072173] [DEBUG] [MAIN ] HAYW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:32.075958] [INFO ] [MAIN ] HAYW: Generated 1807 derivative records from 49097 primary records. [2025-10-09T22:39:32.076103] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-09T22:39:32.081947] [DEBUG] [LOCAL ] HBB: Loaded 6516 existing records from primary storage. [2025-10-09T22:39:32.090190] [INFO ] [MAIN ] HBB: Loaded 6516 primary data records. [2025-10-09T22:39:32.143570] [DEBUG] [MAIN ] HASI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:32.171740] [INFO ] [MAIN ] HASI: Generated 1807 derivative records from 47632 primary records. [2025-10-09T22:39:32.172072] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-09T22:39:32.239888] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1807 records). [2025-10-09T22:39:32.268114] [DEBUG] [LOCAL ] HASI: Derivative data saved (1807 records). [2025-10-09T22:39:32.253542] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-09T22:39:32.270921] [INFO ] [MAIN ] Derivative Progress: 842/1690 symbols completed. HAYW took 1.3s. Estimated remaining: 5m 30s. Rate: 154.2 symbols/min [2025-10-09T22:39:32.271150] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:32.271049] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-09T22:39:32.311335] [INFO ] [MAIN ] Derivative Progress: 843/1690 symbols completed. HASI took 1.4s. Estimated remaining: 5m 29s. Rate: 154.3 symbols/min [2025-10-09T22:39:32.314449] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:32.470473] [DEBUG] [MAIN ] HBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:32.471195] [INFO ] [MAIN ] HBB: Generated 1807 derivative records from 6516 primary records. [2025-10-09T22:39:32.471346] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-09T22:39:32.512511] [DEBUG] [LOCAL ] HBI: Loaded 53371 existing records from primary storage. [2025-10-09T22:39:32.513409] [INFO ] [MAIN ] HBI: Loaded 53371 primary data records. [2025-10-09T22:39:32.583457] [DEBUG] [LOCAL ] HBB: Derivative data saved (1807 records). [2025-10-09T22:39:32.598857] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-09T22:39:32.631698] [DEBUG] [LOCAL ] HBM: Loaded 53318 existing records from primary storage. [2025-10-09T22:39:32.633629] [INFO ] [MAIN ] Derivative Progress: 844/1690 symbols completed. HBB took 0.6s. Estimated remaining: 5m 29s. Rate: 154.3 symbols/min [2025-10-09T22:39:32.633802] [INFO ] [MAIN ] HBM: Loaded 53318 primary data records. [2025-10-09T22:39:32.633916] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:33.206552] [DEBUG] [LOCAL ] HCA: Loaded 47261 existing records from primary storage. [2025-10-09T22:39:33.207557] [INFO ] [MAIN ] HCA: Loaded 47261 primary data records. [2025-10-09T22:39:33.524890] [DEBUG] [MAIN ] HBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:33.534959] [INFO ] [MAIN ] HBI: Generated 1807 derivative records from 53371 primary records. [2025-10-09T22:39:33.535220] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-09T22:39:33.567463] [DEBUG] [MAIN ] HBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:33.569795] [INFO ] [MAIN ] HBM: Generated 1807 derivative records from 53318 primary records. [2025-10-09T22:39:33.570036] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-09T22:39:33.587528] [DEBUG] [LOCAL ] HBI: Derivative data saved (1807 records). [2025-10-09T22:39:33.588956] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-09T22:39:33.590788] [INFO ] [MAIN ] Derivative Progress: 845/1690 symbols completed. HBI took 1.3s. Estimated remaining: 5m 29s. Rate: 154.1 symbols/min [2025-10-09T22:39:33.591237] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:33.596157] [DEBUG] [LOCAL ] HBM: Derivative data saved (1807 records). [2025-10-09T22:39:33.596320] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-09T22:39:33.598620] [INFO ] [MAIN ] Derivative Progress: 846/1690 symbols completed. HBM took 1.3s. Estimated remaining: 5m 28s. Rate: 154.3 symbols/min [2025-10-09T22:39:33.599010] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:33.621583] [DEBUG] [MAIN ] HCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:33.622429] [INFO ] [MAIN ] HCA: Generated 1807 derivative records from 47261 primary records. [2025-10-09T22:39:33.622673] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-09T22:39:33.647272] [DEBUG] [LOCAL ] HCI: Loaded 14236 existing records from primary storage. [2025-10-09T22:39:33.650368] [INFO ] [MAIN ] HCI: Loaded 14236 primary data records. [2025-10-09T22:39:33.787943] [DEBUG] [LOCAL ] HCA: Derivative data saved (1807 records). [2025-10-09T22:39:33.788826] [DEBUG] [LOCAL ] HCC: Loaded 45604 existing records from primary storage. [2025-10-09T22:39:33.788941] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-09T22:39:33.789022] [INFO ] [MAIN ] HCC: Loaded 45604 primary data records. [2025-10-09T22:39:33.792159] [INFO ] [MAIN ] Derivative Progress: 847/1690 symbols completed. HCA took 1.2s. Estimated remaining: 5m 28s. Rate: 154.4 symbols/min [2025-10-09T22:39:33.809139] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:34.323092] [DEBUG] [MAIN ] HCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:34.337978] [INFO ] [MAIN ] HCI: Generated 1807 derivative records from 14236 primary records. [2025-10-09T22:39:34.338402] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-09T22:39:34.340254] [DEBUG] [LOCAL ] HD: Loaded 53881 existing records from primary storage. [2025-10-09T22:39:34.352586] [INFO ] [MAIN ] HD: Loaded 53881 primary data records. [2025-10-09T22:39:34.430559] [DEBUG] [MAIN ] HCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:34.459374] [INFO ] [MAIN ] HCC: Generated 1807 derivative records from 45604 primary records. [2025-10-09T22:39:34.465233] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-09T22:39:34.492673] [DEBUG] [LOCAL ] HCI: Derivative data saved (1807 records). [2025-10-09T22:39:34.502094] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-09T22:39:34.504336] [INFO ] [MAIN ] Derivative Progress: 848/1690 symbols completed. HCI took 0.9s. Estimated remaining: 5m 28s. Rate: 154.2 symbols/min [2025-10-09T22:39:34.504869] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:34.705621] [DEBUG] [LOCAL ] HCC: Derivative data saved (1807 records). [2025-10-09T22:39:34.705831] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-09T22:39:34.707925] [INFO ] [MAIN ] Derivative Progress: 849/1690 symbols completed. HCC took 1.1s. Estimated remaining: 5m 27s. Rate: 154.3 symbols/min [2025-10-09T22:39:34.708217] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:34.750207] [DEBUG] [MAIN ] HD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:34.751033] [INFO ] [MAIN ] HD: Generated 1807 derivative records from 53881 primary records. [2025-10-09T22:39:34.751154] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-09T22:39:34.791134] [DEBUG] [LOCAL ] HDB: Loaded 52326 existing records from primary storage. [2025-10-09T22:39:34.792046] [INFO ] [MAIN ] HDB: Loaded 52326 primary data records. [2025-10-09T22:39:34.877203] [DEBUG] [LOCAL ] HE: Loaded 49337 existing records from primary storage. [2025-10-09T22:39:34.900707] [INFO ] [MAIN ] HE: Loaded 49337 primary data records. [2025-10-09T22:39:34.877880] [DEBUG] [LOCAL ] HD: Derivative data saved (1807 records). [2025-10-09T22:39:34.908622] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-09T22:39:34.934535] [INFO ] [MAIN ] Derivative Progress: 850/1690 symbols completed. HD took 1.1s. Estimated remaining: 5m 27s. Rate: 154.4 symbols/min [2025-10-09T22:39:35.030193] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:35.509258] [DEBUG] [MAIN ] HDB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:35.520243] [INFO ] [MAIN ] HDB: Generated 1807 derivative records from 52326 primary records. [2025-10-09T22:39:35.521966] [DEBUG] [LOCAL ] HEI: Loaded 31775 existing records from primary storage. [2025-10-09T22:39:35.521347] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-09T22:39:35.534314] [INFO ] [MAIN ] HEI: Loaded 31775 primary data records. [2025-10-09T22:39:35.535735] [DEBUG] [MAIN ] HE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:35.562760] [INFO ] [MAIN ] HE: Generated 1807 derivative records from 49337 primary records. [2025-10-09T22:39:35.575893] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-09T22:39:35.643783] [DEBUG] [LOCAL ] HDB: Derivative data saved (1807 records). [2025-10-09T22:39:35.662138] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-09T22:39:35.676737] [INFO ] [MAIN ] Derivative Progress: 851/1690 symbols completed. HDB took 1.2s. Estimated remaining: 5m 26s. Rate: 154.2 symbols/min [2025-10-09T22:39:35.679616] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:35.707302] [DEBUG] [LOCAL ] HE: Derivative data saved (1807 records). [2025-10-09T22:39:35.725928] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-09T22:39:35.738460] [INFO ] [MAIN ] Derivative Progress: 852/1690 symbols completed. HE took 1.0s. Estimated remaining: 5m 26s. Rate: 154.4 symbols/min [2025-10-09T22:39:35.764457] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:35.891414] [DEBUG] [LOCAL ] HEQ: Loaded 6643 existing records from primary storage. [2025-10-09T22:39:35.891721] [INFO ] [MAIN ] HEQ: Loaded 6643 primary data records. [2025-10-09T22:39:36.223935] [DEBUG] [LOCAL ] HESM: Loaded 48669 existing records from primary storage. [2025-10-09T22:39:36.224356] [INFO ] [MAIN ] HESM: Loaded 48669 primary data records. [2025-10-09T22:39:36.353031] [DEBUG] [MAIN ] HEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:36.398275] [INFO ] [MAIN ] HEI: Generated 1807 derivative records from 31775 primary records. [2025-10-09T22:39:36.427724] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-09T22:39:36.576074] [DEBUG] [MAIN ] HEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:36.578312] [INFO ] [MAIN ] HEQ: Generated 1807 derivative records from 6643 primary records. [2025-10-09T22:39:36.578891] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-09T22:39:36.579917] [DEBUG] [LOCAL ] HEI: Derivative data saved (1807 records). [2025-10-09T22:39:36.581146] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-09T22:39:36.583603] [INFO ] [MAIN ] Derivative Progress: 853/1690 symbols completed. HEI took 1.6s. Estimated remaining: 5m 26s. Rate: 154.1 symbols/min [2025-10-09T22:39:36.598232] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1807 records). [2025-10-09T22:39:36.598392] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-09T22:39:36.600438] [INFO ] [MAIN ] Derivative Progress: 854/1690 symbols completed. HEQ took 0.9s. Estimated remaining: 5m 25s. Rate: 154.3 symbols/min [2025-10-09T22:39:36.619724] [DEBUG] [MAIN ] HESM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:36.620368] [INFO ] [MAIN ] HESM: Generated 1807 derivative records from 48669 primary records. [2025-10-09T22:39:36.620429] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-09T22:39:36.636016] [DEBUG] [LOCAL ] HESM: Derivative data saved (1807 records). [2025-10-09T22:39:36.636105] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-09T22:39:36.639271] [INFO ] [MAIN ] Derivative Progress: 855/1690 symbols completed. HESM took 0.9s. Estimated remaining: 5m 24s. Rate: 154.5 symbols/min [2025-10-09T22:39:36.639849] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:36.639997] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:36.640139] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:36.668025] [DEBUG] [LOCAL ] HGLB: Loaded 9747 existing records from primary storage. [2025-10-09T22:39:36.668416] [DEBUG] [LOCAL ] HGER: Loaded 14502 existing records from primary storage. [2025-10-09T22:39:36.668744] [INFO ] [MAIN ] HGLB: Loaded 9747 primary data records. [2025-10-09T22:39:36.668947] [INFO ] [MAIN ] HGER: Loaded 14502 primary data records. [2025-10-09T22:39:36.801087] [DEBUG] [LOCAL ] HFRO: Loaded 17557 existing records from primary storage. [2025-10-09T22:39:36.815140] [INFO ] [MAIN ] HFRO: Loaded 17557 primary data records. [2025-10-09T22:39:37.683745] [DEBUG] [MAIN ] HGLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:37.684538] [DEBUG] [MAIN ] HGER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:37.685282] [INFO ] [MAIN ] HGLB: Generated 1807 derivative records from 9747 primary records. [2025-10-09T22:39:37.686190] [INFO ] [MAIN ] HGER: Generated 1807 derivative records from 14502 primary records. [2025-10-09T22:39:37.686350] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-09T22:39:37.687380] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-09T22:39:37.717103] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1807 records). [2025-10-09T22:39:37.717734] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-09T22:39:37.729752] [INFO ] [MAIN ] Derivative Progress: 856/1690 symbols completed. HGLB took 1.1s. Estimated remaining: 5m 25s. Rate: 154.1 symbols/min [2025-10-09T22:39:37.736026] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:37.736465] [DEBUG] [MAIN ] HFRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:37.737766] [INFO ] [MAIN ] HFRO: Generated 1807 derivative records from 17557 primary records. [2025-10-09T22:39:37.738632] [DEBUG] [LOCAL ] HGER: Derivative data saved (1807 records). [2025-10-09T22:39:37.738821] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-09T22:39:37.739060] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-09T22:39:37.742355] [INFO ] [MAIN ] Derivative Progress: 857/1690 symbols completed. HGER took 1.1s. Estimated remaining: 5m 24s. Rate: 154.3 symbols/min [2025-10-09T22:39:37.742765] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:37.768189] [DEBUG] [LOCAL ] HGTY: Loaded 13314 existing records from primary storage. [2025-10-09T22:39:37.770430] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1807 records). [2025-10-09T22:39:37.770529] [INFO ] [MAIN ] HGTY: Loaded 13314 primary data records. [2025-10-09T22:39:37.784495] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-09T22:39:37.820025] [INFO ] [MAIN ] Derivative Progress: 858/1690 symbols completed. HFRO took 1.2s. Estimated remaining: 5m 23s. Rate: 154.5 symbols/min [2025-10-09T22:39:37.846898] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:38.095035] [DEBUG] [LOCAL ] HGV: Loaded 46691 existing records from primary storage. [2025-10-09T22:39:38.117451] [INFO ] [MAIN ] HGV: Loaded 46691 primary data records. [2025-10-09T22:39:38.218822] [DEBUG] [LOCAL ] HHH: Loaded 33138 existing records from primary storage. [2025-10-09T22:39:38.225259] [INFO ] [MAIN ] HHH: Loaded 33138 primary data records. [2025-10-09T22:39:38.770787] [DEBUG] [MAIN ] HGTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:38.771764] [INFO ] [MAIN ] HGTY: Generated 1807 derivative records from 13314 primary records. [2025-10-09T22:39:38.772285] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-09T22:39:38.792223] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1807 records). [2025-10-09T22:39:38.792511] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-09T22:39:38.794753] [INFO ] [MAIN ] Derivative Progress: 859/1690 symbols completed. HGTY took 1.1s. Estimated remaining: 5m 23s. Rate: 154.2 symbols/min [2025-10-09T22:39:38.795007] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:38.811708] [DEBUG] [MAIN ] HGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:38.813933] [INFO ] [MAIN ] HGV: Generated 1807 derivative records from 46691 primary records. [2025-10-09T22:39:38.814839] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-09T22:39:38.840092] [DEBUG] [MAIN ] HHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:38.843225] [INFO ] [MAIN ] HHH: Generated 1807 derivative records from 33138 primary records. [2025-10-09T22:39:38.843412] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-09T22:39:38.844983] [DEBUG] [LOCAL ] HGV: Derivative data saved (1807 records). [2025-10-09T22:39:38.845512] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-09T22:39:38.847619] [INFO ] [MAIN ] Derivative Progress: 860/1690 symbols completed. HGV took 1.1s. Estimated remaining: 5m 23s. Rate: 154.4 symbols/min [2025-10-09T22:39:38.867151] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:38.882741] [DEBUG] [LOCAL ] HHH: Derivative data saved (1807 records). [2025-10-09T22:39:38.882903] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-09T22:39:38.886206] [INFO ] [MAIN ] Derivative Progress: 861/1690 symbols completed. HHH took 1.0s. Estimated remaining: 5m 22s. Rate: 154.5 symbols/min [2025-10-09T22:39:38.887217] [DEBUG] [LOCAL ] HI: Loaded 35577 existing records from primary storage. [2025-10-09T22:39:38.887394] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:38.887519] [INFO ] [MAIN ] HI: Loaded 35577 primary data records. [2025-10-09T22:39:39.255482] [DEBUG] [LOCAL ] HII: Loaded 34262 existing records from primary storage. [2025-10-09T22:39:39.255685] [INFO ] [MAIN ] HII: Loaded 34262 primary data records. [2025-10-09T22:39:39.277884] [DEBUG] [LOCAL ] HIG: Loaded 51520 existing records from primary storage. [2025-10-09T22:39:39.293173] [INFO ] [MAIN ] HIG: Loaded 51520 primary data records. [2025-10-09T22:39:39.878789] [DEBUG] [MAIN ] HI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:39.880529] [INFO ] [MAIN ] HI: Generated 1807 derivative records from 35577 primary records. [2025-10-09T22:39:39.880985] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-09T22:39:39.900283] [DEBUG] [LOCAL ] HI: Derivative data saved (1807 records). [2025-10-09T22:39:39.900581] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-09T22:39:39.902881] [INFO ] [MAIN ] Derivative Progress: 862/1690 symbols completed. HI took 1.1s. Estimated remaining: 5m 22s. Rate: 154.2 symbols/min [2025-10-09T22:39:39.903211] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:39.920750] [DEBUG] [MAIN ] HII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:39.921563] [INFO ] [MAIN ] HII: Generated 1807 derivative records from 34262 primary records. [2025-10-09T22:39:39.921810] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-09T22:39:39.950258] [DEBUG] [MAIN ] HIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:39.951435] [INFO ] [MAIN ] HIG: Generated 1807 derivative records from 51520 primary records. [2025-10-09T22:39:39.951808] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-09T22:39:39.966533] [DEBUG] [LOCAL ] HII: Derivative data saved (1807 records). [2025-10-09T22:39:39.966878] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-09T22:39:39.970389] [INFO ] [MAIN ] Derivative Progress: 863/1690 symbols completed. HII took 1.1s. Estimated remaining: 5m 21s. Rate: 154.4 symbols/min [2025-10-09T22:39:39.970792] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:39.989573] [DEBUG] [LOCAL ] HIG: Derivative data saved (1807 records). [2025-10-09T22:39:39.989770] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-09T22:39:39.992873] [INFO ] [MAIN ] Derivative Progress: 864/1690 symbols completed. HIG took 1.1s. Estimated remaining: 5m 21s. Rate: 154.5 symbols/min [2025-10-09T22:39:39.993192] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:40.017386] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-10-09T22:39:40.017620] [INFO ] [MAIN ] HIMS: Loaded 54207 primary data records. [2025-10-09T22:39:40.085298] [DEBUG] [LOCAL ] HIO: Loaded 24258 existing records from primary storage. [2025-10-09T22:39:40.105715] [INFO ] [MAIN ] HIO: Loaded 24258 primary data records. [2025-10-09T22:39:40.163018] [DEBUG] [LOCAL ] HIPO: Loaded 22079 existing records from primary storage. [2025-10-09T22:39:40.208444] [INFO ] [MAIN ] HIPO: Loaded 22079 primary data records. [2025-10-09T22:39:41.009518] [DEBUG] [MAIN ] HIMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:41.011387] [INFO ] [MAIN ] HIMS: Generated 1807 derivative records from 54207 primary records. [2025-10-09T22:39:41.011628] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-09T22:39:41.029034] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1807 records). [2025-10-09T22:39:41.030450] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-09T22:39:41.032615] [INFO ] [MAIN ] Derivative Progress: 865/1690 symbols completed. HIMS took 1.1s. Estimated remaining: 5m 21s. Rate: 154.2 symbols/min [2025-10-09T22:39:41.033860] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:41.050289] [DEBUG] [MAIN ] HIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:41.051334] [INFO ] [MAIN ] HIO: Generated 1807 derivative records from 24258 primary records. [2025-10-09T22:39:41.051708] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-09T22:39:41.085701] [DEBUG] [LOCAL ] HIO: Derivative data saved (1807 records). [2025-10-09T22:39:41.085327] [DEBUG] [MAIN ] HIPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:41.086849] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-09T22:39:41.086750] [INFO ] [MAIN ] HIPO: Generated 1807 derivative records from 22079 primary records. [2025-10-09T22:39:41.086976] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-09T22:39:41.089685] [INFO ] [MAIN ] Derivative Progress: 866/1690 symbols completed. HIO took 1.1s. Estimated remaining: 5m 20s. Rate: 154.4 symbols/min [2025-10-09T22:39:41.101341] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:41.118322] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1807 records). [2025-10-09T22:39:41.118471] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-09T22:39:41.121850] [INFO ] [MAIN ] Derivative Progress: 867/1690 symbols completed. HIPO took 1.1s. Estimated remaining: 5m 19s. Rate: 154.6 symbols/min [2025-10-09T22:39:41.122102] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:41.137580] [DEBUG] [LOCAL ] HIW: Loaded 44796 existing records from primary storage. [2025-10-09T22:39:41.137756] [INFO ] [MAIN ] HIW: Loaded 44796 primary data records. [2025-10-09T22:39:41.289289] [DEBUG] [LOCAL ] HKD: Loaded 18664 existing records from primary storage. [2025-10-09T22:39:41.316163] [DEBUG] [LOCAL ] HIX: Loaded 20748 existing records from primary storage. [2025-10-09T22:39:41.337351] [INFO ] [MAIN ] HKD: Loaded 18664 primary data records. [2025-10-09T22:39:41.356389] [INFO ] [MAIN ] HIX: Loaded 20748 primary data records. [2025-10-09T22:39:42.220811] [DEBUG] [MAIN ] HIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:42.221942] [INFO ] [MAIN ] HIW: Generated 1807 derivative records from 44796 primary records. [2025-10-09T22:39:42.222307] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-09T22:39:42.258562] [DEBUG] [LOCAL ] HIW: Derivative data saved (1807 records). [2025-10-09T22:39:42.258780] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-09T22:39:42.266893] [INFO ] [MAIN ] Derivative Progress: 868/1690 symbols completed. HIW took 1.2s. Estimated remaining: 5m 20s. Rate: 154.2 symbols/min [2025-10-09T22:39:42.285383] [DEBUG] [MAIN ] HIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:42.286887] [INFO ] [MAIN ] HIX: Generated 1807 derivative records from 20748 primary records. [2025-10-09T22:39:42.285788] [DEBUG] [MAIN ] HKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:42.287966] [INFO ] [MAIN ] HKD: Generated 1807 derivative records from 18664 primary records. [2025-10-09T22:39:42.287053] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-09T22:39:42.288107] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-09T22:39:42.322029] [DEBUG] [LOCAL ] HKD: Derivative data saved (1807 records). [2025-10-09T22:39:42.322142] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-09T22:39:42.325207] [INFO ] [MAIN ] Derivative Progress: 869/1690 symbols completed. HKD took 1.2s. Estimated remaining: 5m 19s. Rate: 154.4 symbols/min [2025-10-09T22:39:42.328417] [DEBUG] [LOCAL ] HIX: Derivative data saved (1807 records). [2025-10-09T22:39:42.328503] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-09T22:39:42.331817] [INFO ] [MAIN ] Derivative Progress: 870/1690 symbols completed. HIX took 1.2s. Estimated remaining: 5m 18s. Rate: 154.5 symbols/min [2025-10-09T22:39:42.332282] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:42.332389] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:42.332560] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:42.400910] [DEBUG] [LOCAL ] HLI: Loaded 31088 existing records from primary storage. [2025-10-09T22:39:42.401190] [INFO ] [MAIN ] HLI: Loaded 31088 primary data records. [2025-10-09T22:39:42.543463] [DEBUG] [LOCAL ] HL: Loaded 54062 existing records from primary storage. [2025-10-09T22:39:42.536995] [DEBUG] [LOCAL ] HLF: Loaded 48765 existing records from primary storage. [2025-10-09T22:39:42.553955] [INFO ] [MAIN ] HL: Loaded 54062 primary data records. [2025-10-09T22:39:42.564476] [INFO ] [MAIN ] HLF: Loaded 48765 primary data records. [2025-10-09T22:39:43.410923] [DEBUG] [MAIN ] HLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:43.411778] [INFO ] [MAIN ] HLI: Generated 1807 derivative records from 31088 primary records. [2025-10-09T22:39:43.412134] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-09T22:39:43.460589] [DEBUG] [LOCAL ] HLI: Derivative data saved (1807 records). [2025-10-09T22:39:43.460776] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-09T22:39:43.455187] [DEBUG] [MAIN ] HLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:43.463043] [INFO ] [MAIN ] Derivative Progress: 871/1690 symbols completed. HLI took 1.1s. Estimated remaining: 5m 19s. Rate: 154.2 symbols/min [2025-10-09T22:39:43.464221] [INFO ] [MAIN ] HLF: Generated 1807 derivative records from 48765 primary records. [2025-10-09T22:39:43.464595] [DEBUG] [MAIN ] HL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:43.463472] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:43.465458] [INFO ] [MAIN ] HL: Generated 1807 derivative records from 54062 primary records. [2025-10-09T22:39:43.464694] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-09T22:39:43.466922] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-09T22:39:43.494112] [DEBUG] [LOCAL ] HLF: Derivative data saved (1807 records). [2025-10-09T22:39:43.497004] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-09T22:39:43.500131] [INFO ] [MAIN ] Derivative Progress: 872/1690 symbols completed. HLF took 1.2s. Estimated remaining: 5m 18s. Rate: 154.4 symbols/min [2025-10-09T22:39:43.500543] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:43.501955] [DEBUG] [LOCAL ] HL: Derivative data saved (1807 records). [2025-10-09T22:39:43.502316] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-09T22:39:43.505280] [INFO ] [MAIN ] Derivative Progress: 873/1690 symbols completed. HL took 1.2s. Estimated remaining: 5m 17s. Rate: 154.5 symbols/min [2025-10-09T22:39:43.505530] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:43.529597] [DEBUG] [LOCAL ] HLIO: Loaded 28060 existing records from primary storage. [2025-10-09T22:39:43.529916] [INFO ] [MAIN ] HLIO: Loaded 28060 primary data records. [2025-10-09T22:39:43.664298] [DEBUG] [LOCAL ] HLLY: Loaded 33723 existing records from primary storage. [2025-10-09T22:39:43.664687] [INFO ] [MAIN ] HLLY: Loaded 33723 primary data records. [2025-10-09T22:39:44.057393] [DEBUG] [LOCAL ] HLN: Loaded 53487 existing records from primary storage. [2025-10-09T22:39:44.068287] [INFO ] [MAIN ] HLN: Loaded 53487 primary data records. [2025-10-09T22:39:44.565611] [DEBUG] [MAIN ] HLIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:44.568260] [INFO ] [MAIN ] HLIO: Generated 1807 derivative records from 28060 primary records. [2025-10-09T22:39:44.568776] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-09T22:39:44.616240] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1807 records). [2025-10-09T22:39:44.617171] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-09T22:39:44.619780] [INFO ] [MAIN ] Derivative Progress: 874/1690 symbols completed. HLIO took 1.2s. Estimated remaining: 5m 18s. Rate: 154.2 symbols/min [2025-10-09T22:39:44.619976] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:44.616760] [DEBUG] [MAIN ] HLLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:44.621812] [INFO ] [MAIN ] HLLY: Generated 1807 derivative records from 33723 primary records. [2025-10-09T22:39:44.622381] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-09T22:39:44.658388] [DEBUG] [MAIN ] HLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:44.660215] [INFO ] [MAIN ] HLN: Generated 1807 derivative records from 53487 primary records. [2025-10-09T22:39:44.660371] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-09T22:39:44.680248] [DEBUG] [LOCAL ] HLN: Derivative data saved (1807 records). [2025-10-09T22:39:44.680451] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-09T22:39:44.683872] [INFO ] [MAIN ] Derivative Progress: 875/1690 symbols completed. HLN took 1.2s. Estimated remaining: 5m 17s. Rate: 154.3 symbols/min [2025-10-09T22:39:44.684490] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:44.687201] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1807 records). [2025-10-09T22:39:44.703099] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-09T22:39:44.709142] [INFO ] [MAIN ] Derivative Progress: 876/1690 symbols completed. HLLY took 1.2s. Estimated remaining: 5m 16s. Rate: 154.5 symbols/min [2025-10-09T22:39:44.709387] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:44.730307] [DEBUG] [LOCAL ] HLT: Loaded 50968 existing records from primary storage. [2025-10-09T22:39:44.730575] [INFO ] [MAIN ] HLT: Loaded 50968 primary data records. [2025-10-09T22:39:44.953192] [DEBUG] [LOCAL ] HLX: Loaded 47890 existing records from primary storage. [2025-10-09T22:39:44.954223] [INFO ] [MAIN ] HLX: Loaded 47890 primary data records. [2025-10-09T22:39:45.154720] [DEBUG] [LOCAL ] HMC: Loaded 46880 existing records from primary storage. [2025-10-09T22:39:45.179363] [INFO ] [MAIN ] HMC: Loaded 46880 primary data records. [2025-10-09T22:39:45.776401] [DEBUG] [MAIN ] HLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:45.778270] [INFO ] [MAIN ] HLT: Generated 1807 derivative records from 50968 primary records. [2025-10-09T22:39:45.778989] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-09T22:39:45.800297] [DEBUG] [LOCAL ] HLT: Derivative data saved (1807 records). [2025-10-09T22:39:45.800894] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-09T22:39:45.805604] [INFO ] [MAIN ] Derivative Progress: 877/1690 symbols completed. HLT took 1.2s. Estimated remaining: 5m 16s. Rate: 154.2 symbols/min [2025-10-09T22:39:45.806503] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:45.841767] [DEBUG] [MAIN ] HLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:45.843063] [INFO ] [MAIN ] HLX: Generated 1807 derivative records from 47890 primary records. [2025-10-09T22:39:45.842200] [DEBUG] [MAIN ] HMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:45.843170] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-09T22:39:45.844242] [INFO ] [MAIN ] HMC: Generated 1807 derivative records from 46880 primary records. [2025-10-09T22:39:45.851369] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-09T22:39:45.890757] [DEBUG] [LOCAL ] HMN: Loaded 23567 existing records from primary storage. [2025-10-09T22:39:45.886800] [DEBUG] [LOCAL ] HLX: Derivative data saved (1807 records). [2025-10-09T22:39:45.890902] [INFO ] [MAIN ] HMN: Loaded 23567 primary data records. [2025-10-09T22:39:45.891716] [DEBUG] [LOCAL ] HMC: Derivative data saved (1807 records). [2025-10-09T22:39:45.891959] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-09T22:39:45.906613] [INFO ] [MAIN ] Derivative Progress: 878/1690 symbols completed. HMC took 1.2s. Estimated remaining: 5m 16s. Rate: 154.3 symbols/min [2025-10-09T22:39:45.903367] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-09T22:39:45.930489] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:45.935770] [INFO ] [MAIN ] Derivative Progress: 879/1690 symbols completed. HLX took 1.2s. Estimated remaining: 5m 15s. Rate: 154.5 symbols/min [2025-10-09T22:39:45.962833] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:46.243286] [DEBUG] [LOCAL ] HNI: Loaded 29530 existing records from primary storage. [2025-10-09T22:39:46.244713] [INFO ] [MAIN ] HNI: Loaded 29530 primary data records. [2025-10-09T22:39:46.365550] [DEBUG] [LOCAL ] HMY: Loaded 53525 existing records from primary storage. [2025-10-09T22:39:46.376933] [INFO ] [MAIN ] HMY: Loaded 53525 primary data records. [2025-10-09T22:39:46.897620] [DEBUG] [MAIN ] HMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:46.898775] [INFO ] [MAIN ] HMN: Generated 1807 derivative records from 23567 primary records. [2025-10-09T22:39:46.898910] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-09T22:39:46.921362] [DEBUG] [LOCAL ] HMN: Derivative data saved (1807 records). [2025-10-09T22:39:46.922625] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-09T22:39:46.926320] [INFO ] [MAIN ] Derivative Progress: 880/1690 symbols completed. HMN took 1.1s. Estimated remaining: 5m 15s. Rate: 154.2 symbols/min [2025-10-09T22:39:46.926943] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:46.951826] [DEBUG] [MAIN ] HNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:46.952930] [INFO ] [MAIN ] HNI: Generated 1807 derivative records from 29530 primary records. [2025-10-09T22:39:46.953331] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-09T22:39:46.970565] [DEBUG] [LOCAL ] HNI: Derivative data saved (1807 records). [2025-10-09T22:39:46.974210] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-09T22:39:46.977607] [INFO ] [MAIN ] Derivative Progress: 881/1690 symbols completed. HNI took 1.0s. Estimated remaining: 5m 14s. Rate: 154.4 symbols/min [2025-10-09T22:39:46.978857] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:46.992489] [DEBUG] [MAIN ] HMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:46.993326] [INFO ] [MAIN ] HMY: Generated 1807 derivative records from 53525 primary records. [2025-10-09T22:39:46.993608] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-09T22:39:47.028307] [DEBUG] [LOCAL ] HMY: Derivative data saved (1807 records). [2025-10-09T22:39:47.029606] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-09T22:39:47.047348] [INFO ] [MAIN ] Derivative Progress: 882/1690 symbols completed. HMY took 1.1s. Estimated remaining: 5m 14s. Rate: 154.5 symbols/min [2025-10-09T22:39:47.047692] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:47.049136] [DEBUG] [LOCAL ] HOG: Loaded 51361 existing records from primary storage. [2025-10-09T22:39:47.049623] [INFO ] [MAIN ] HOG: Loaded 51361 primary data records. [2025-10-09T22:39:47.243871] [DEBUG] [LOCAL ] HOMB: Loaded 43753 existing records from primary storage. [2025-10-09T22:39:47.407347] [INFO ] [MAIN ] HOMB: Loaded 43753 primary data records. [2025-10-09T22:39:47.548837] [DEBUG] [LOCAL ] HOUS: Loaded 45220 existing records from primary storage. [2025-10-09T22:39:47.569963] [INFO ] [MAIN ] HOUS: Loaded 45220 primary data records. [2025-10-09T22:39:47.906367] [DEBUG] [MAIN ] HOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:47.927532] [INFO ] [MAIN ] HOG: Generated 1807 derivative records from 51361 primary records. [2025-10-09T22:39:47.967481] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-09T22:39:48.133256] [DEBUG] [LOCAL ] HOG: Derivative data saved (1807 records). [2025-10-09T22:39:48.133487] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-09T22:39:48.136635] [INFO ] [MAIN ] Derivative Progress: 883/1690 symbols completed. HOG took 1.2s. Estimated remaining: 5m 14s. Rate: 154.2 symbols/min [2025-10-09T22:39:48.151732] [DEBUG] [MAIN ] HOMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:48.152441] [INFO ] [MAIN ] HOMB: Generated 1807 derivative records from 43753 primary records. [2025-10-09T22:39:48.152614] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-09T22:39:48.169732] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1807 records). [2025-10-09T22:39:48.170810] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-09T22:39:48.174110] [INFO ] [MAIN ] Derivative Progress: 884/1690 symbols completed. HOMB took 1.2s. Estimated remaining: 5m 13s. Rate: 154.4 symbols/min [2025-10-09T22:39:48.189598] [DEBUG] [MAIN ] HOUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:48.190492] [INFO ] [MAIN ] HOUS: Generated 1807 derivative records from 45220 primary records. [2025-10-09T22:39:48.190571] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-09T22:39:48.208831] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1807 records). [2025-10-09T22:39:48.208957] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-09T22:39:48.212507] [INFO ] [MAIN ] Derivative Progress: 885/1690 symbols completed. HOUS took 1.2s. Estimated remaining: 5m 13s. Rate: 154.5 symbols/min [2025-10-09T22:39:48.213055] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:48.212958] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:48.213320] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:48.230198] [DEBUG] [LOCAL ] HOV: Loaded 14000 existing records from primary storage. [2025-10-09T22:39:48.230375] [INFO ] [MAIN ] HOV: Loaded 14000 primary data records. [2025-10-09T22:39:48.512683] [DEBUG] [LOCAL ] HP: Loaded 51959 existing records from primary storage. [2025-10-09T22:39:48.591236] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-10-09T22:39:48.599722] [INFO ] [MAIN ] HP: Loaded 51959 primary data records. [2025-10-09T22:39:48.600418] [INFO ] [MAIN ] HPE: Loaded 54087 primary data records. [2025-10-09T22:39:49.338759] [DEBUG] [MAIN ] HOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:49.340291] [INFO ] [MAIN ] HOV: Generated 1807 derivative records from 14000 primary records. [2025-10-09T22:39:49.340551] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-09T22:39:49.361272] [DEBUG] [LOCAL ] HOV: Derivative data saved (1807 records). [2025-10-09T22:39:49.362755] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-09T22:39:49.366391] [INFO ] [MAIN ] Derivative Progress: 886/1690 symbols completed. HOV took 1.2s. Estimated remaining: 5m 13s. Rate: 154.2 symbols/min [2025-10-09T22:39:49.367692] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:49.385110] [DEBUG] [MAIN ] HPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:49.388289] [INFO ] [MAIN ] HPE: Generated 1807 derivative records from 54087 primary records. [2025-10-09T22:39:49.390606] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-09T22:39:49.396519] [DEBUG] [LOCAL ] HPF: Loaded 7514 existing records from primary storage. [2025-10-09T22:39:49.397088] [INFO ] [MAIN ] HPF: Loaded 7514 primary data records. [2025-10-09T22:39:49.468595] [DEBUG] [MAIN ] HP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:49.493088] [INFO ] [MAIN ] HP: Generated 1807 derivative records from 51959 primary records. [2025-10-09T22:39:49.505476] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-09T22:39:49.536909] [DEBUG] [LOCAL ] HPE: Derivative data saved (1807 records). [2025-10-09T22:39:49.537364] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-09T22:39:49.567930] [INFO ] [MAIN ] Derivative Progress: 887/1690 symbols completed. HPE took 1.4s. Estimated remaining: 5m 12s. Rate: 154.3 symbols/min [2025-10-09T22:39:49.601360] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:49.615274] [DEBUG] [LOCAL ] HP: Derivative data saved (1807 records). [2025-10-09T22:39:49.637312] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-09T22:39:49.747250] [INFO ] [MAIN ] Derivative Progress: 888/1690 symbols completed. HP took 1.5s. Estimated remaining: 5m 12s. Rate: 154.3 symbols/min [2025-10-09T22:39:49.760570] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:49.776109] [DEBUG] [LOCAL ] HPI: Loaded 10659 existing records from primary storage. [2025-10-09T22:39:49.777854] [INFO ] [MAIN ] HPI: Loaded 10659 primary data records. [2025-10-09T22:39:50.139182] [DEBUG] [LOCAL ] HPP: Loaded 51424 existing records from primary storage. [2025-10-09T22:39:50.149522] [INFO ] [MAIN ] HPP: Loaded 51424 primary data records. [2025-10-09T22:39:50.178397] [DEBUG] [MAIN ] HPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:50.242831] [INFO ] [MAIN ] HPF: Generated 1807 derivative records from 7514 primary records. [2025-10-09T22:39:50.276902] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-09T22:39:50.379633] [DEBUG] [LOCAL ] HPF: Derivative data saved (1807 records). [2025-10-09T22:39:50.494513] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-09T22:39:50.497016] [INFO ] [MAIN ] Derivative Progress: 889/1690 symbols completed. HPF took 1.1s. Estimated remaining: 5m 12s. Rate: 154.2 symbols/min [2025-10-09T22:39:50.497474] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:50.516886] [DEBUG] [MAIN ] HPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:50.518081] [INFO ] [MAIN ] HPI: Generated 1807 derivative records from 10659 primary records. [2025-10-09T22:39:50.518752] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-09T22:39:50.539957] [DEBUG] [LOCAL ] HPI: Derivative data saved (1807 records). [2025-10-09T22:39:50.540602] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-09T22:39:50.543398] [INFO ] [MAIN ] Derivative Progress: 890/1690 symbols completed. HPI took 0.9s. Estimated remaining: 5m 11s. Rate: 154.3 symbols/min [2025-10-09T22:39:50.543619] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:50.579705] [DEBUG] [MAIN ] HPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:50.585364] [INFO ] [MAIN ] HPP: Generated 1807 derivative records from 51424 primary records. [2025-10-09T22:39:50.585693] [DEBUG] [LOCAL ] HPS: Loaded 10353 existing records from primary storage. [2025-10-09T22:39:50.585819] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-09T22:39:50.586086] [INFO ] [MAIN ] HPS: Loaded 10353 primary data records. [2025-10-09T22:39:50.703387] [DEBUG] [LOCAL ] HPP: Derivative data saved (1807 records). [2025-10-09T22:39:50.708853] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-09T22:39:50.716859] [INFO ] [MAIN ] Derivative Progress: 891/1690 symbols completed. HPP took 1.0s. Estimated remaining: 5m 10s. Rate: 154.4 symbols/min [2025-10-09T22:39:50.729912] [DEBUG] [LOCAL ] HPQ: Loaded 54058 existing records from primary storage. [2025-10-09T22:39:50.736028] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:50.751608] [INFO ] [MAIN ] HPQ: Loaded 54058 primary data records. [2025-10-09T22:39:51.283858] [DEBUG] [LOCAL ] HQH: Loaded 25751 existing records from primary storage. [2025-10-09T22:39:51.297506] [INFO ] [MAIN ] HQH: Loaded 25751 primary data records. [2025-10-09T22:39:51.540879] [DEBUG] [MAIN ] HPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:51.573351] [INFO ] [MAIN ] HPS: Generated 1807 derivative records from 10353 primary records. [2025-10-09T22:39:51.669159] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-09T22:39:51.704518] [DEBUG] [MAIN ] HPQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:51.706996] [DEBUG] [LOCAL ] HPS: Derivative data saved (1807 records). [2025-10-09T22:39:51.706145] [INFO ] [MAIN ] HPQ: Generated 1807 derivative records from 54058 primary records. [2025-10-09T22:39:51.707985] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-09T22:39:51.708061] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-09T22:39:51.711355] [INFO ] [MAIN ] Derivative Progress: 892/1690 symbols completed. HPS took 1.2s. Estimated remaining: 5m 11s. Rate: 154.2 symbols/min [2025-10-09T22:39:51.711702] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:51.728691] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1807 records). [2025-10-09T22:39:51.728826] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-09T22:39:51.731790] [INFO ] [MAIN ] Derivative Progress: 893/1690 symbols completed. HPQ took 1.2s. Estimated remaining: 5m 10s. Rate: 154.3 symbols/min [2025-10-09T22:39:51.732039] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:51.759908] [DEBUG] [MAIN ] HQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:51.761953] [INFO ] [MAIN ] HQH: Generated 1807 derivative records from 25751 primary records. [2025-10-09T22:39:51.761078] [DEBUG] [LOCAL ] HQL: Loaded 16859 existing records from primary storage. [2025-10-09T22:39:51.762150] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-09T22:39:51.762726] [INFO ] [MAIN ] HQL: Loaded 16859 primary data records. [2025-10-09T22:39:51.886237] [DEBUG] [LOCAL ] HQH: Derivative data saved (1807 records). [2025-10-09T22:39:51.886414] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-09T22:39:51.894746] [INFO ] [MAIN ] Derivative Progress: 894/1690 symbols completed. HQH took 1.2s. Estimated remaining: 5m 9s. Rate: 154.4 symbols/min [2025-10-09T22:39:51.910589] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:52.127256] [DEBUG] [LOCAL ] HR: Loaded 52363 existing records from primary storage. [2025-10-09T22:39:52.127830] [INFO ] [MAIN ] HR: Loaded 52363 primary data records. [2025-10-09T22:39:52.345805] [DEBUG] [LOCAL ] HRB: Loaded 48723 existing records from primary storage. [2025-10-09T22:39:52.457332] [INFO ] [MAIN ] HRB: Loaded 48723 primary data records. [2025-10-09T22:39:52.588697] [DEBUG] [MAIN ] HQL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:52.611839] [INFO ] [MAIN ] HQL: Generated 1807 derivative records from 16859 primary records. [2025-10-09T22:39:52.611984] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-09T22:39:52.662120] [DEBUG] [LOCAL ] HQL: Derivative data saved (1807 records). [2025-10-09T22:39:52.672882] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-09T22:39:52.681437] [INFO ] [MAIN ] Derivative Progress: 895/1690 symbols completed. HQL took 1.0s. Estimated remaining: 5m 9s. Rate: 154.3 symbols/min [2025-10-09T22:39:52.694836] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:52.887050] [DEBUG] [MAIN ] HR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:52.888194] [INFO ] [MAIN ] HR: Generated 1807 derivative records from 52363 primary records. [2025-10-09T22:39:52.888277] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-09T22:39:52.915337] [DEBUG] [LOCAL ] HR: Derivative data saved (1807 records). [2025-10-09T22:39:52.915619] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-09T22:39:52.918147] [INFO ] [MAIN ] Derivative Progress: 896/1690 symbols completed. HR took 1.2s. Estimated remaining: 5m 9s. Rate: 154.3 symbols/min [2025-10-09T22:39:52.919981] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:52.934516] [DEBUG] [LOCAL ] HRI: Loaded 32776 existing records from primary storage. [2025-10-09T22:39:52.934842] [INFO ] [MAIN ] HRI: Loaded 32776 primary data records. [2025-10-09T22:39:53.081614] [DEBUG] [MAIN ] HRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:53.118818] [INFO ] [MAIN ] HRB: Generated 1807 derivative records from 48723 primary records. [2025-10-09T22:39:53.134776] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-09T22:39:53.306807] [DEBUG] [LOCAL ] HRB: Derivative data saved (1807 records). [2025-10-09T22:39:53.307112] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-09T22:39:53.310356] [INFO ] [MAIN ] Derivative Progress: 897/1690 symbols completed. HRB took 1.4s. Estimated remaining: 5m 8s. Rate: 154.3 symbols/min [2025-10-09T22:39:53.311607] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:53.330217] [DEBUG] [LOCAL ] HRL: Loaded 53484 existing records from primary storage. [2025-10-09T22:39:53.331008] [INFO ] [MAIN ] HRL: Loaded 53484 primary data records. [2025-10-09T22:39:53.718459] [DEBUG] [LOCAL ] HRTG: Loaded 34091 existing records from primary storage. [2025-10-09T22:39:53.722712] [INFO ] [MAIN ] HRTG: Loaded 34091 primary data records. [2025-10-09T22:39:53.810869] [DEBUG] [MAIN ] HRI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:39:53.830866] [INFO ] [MAIN ] HRI: Generated 1806 derivative records from 32776 primary records. [2025-10-09T22:39:53.850763] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-09T22:39:53.906036] [DEBUG] [LOCAL ] HRI: Derivative data saved (1806 records). [2025-10-09T22:39:53.960233] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-09T22:39:53.964939] [INFO ] [MAIN ] Derivative Progress: 898/1690 symbols completed. HRI took 1.3s. Estimated remaining: 5m 8s. Rate: 154.2 symbols/min [2025-10-09T22:39:54.103454] [DEBUG] [MAIN ] HRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:54.104395] [INFO ] [MAIN ] HRL: Generated 1807 derivative records from 53484 primary records. [2025-10-09T22:39:54.104551] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-09T22:39:54.124937] [DEBUG] [LOCAL ] HRL: Derivative data saved (1807 records). [2025-10-09T22:39:54.125131] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-09T22:39:54.128224] [INFO ] [MAIN ] Derivative Progress: 899/1690 symbols completed. HRL took 1.2s. Estimated remaining: 5m 8s. Rate: 154.3 symbols/min [2025-10-09T22:39:54.150053] [DEBUG] [MAIN ] HRTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:54.150858] [INFO ] [MAIN ] HRTG: Generated 1807 derivative records from 34091 primary records. [2025-10-09T22:39:54.150927] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-09T22:39:54.168234] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1807 records). [2025-10-09T22:39:54.168307] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-09T22:39:54.171132] [INFO ] [MAIN ] Derivative Progress: 900/1690 symbols completed. HRTG took 0.9s. Estimated remaining: 5m 7s. Rate: 154.5 symbols/min [2025-10-09T22:39:54.171854] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:54.172043] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:54.172206] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:54.189209] [DEBUG] [LOCAL ] HSHP: Loaded 15090 existing records from primary storage. [2025-10-09T22:39:54.189511] [INFO ] [MAIN ] HSHP: Loaded 15090 primary data records. [2025-10-09T22:39:54.563750] [DEBUG] [LOCAL ] HSBC: Loaded 51335 existing records from primary storage. [2025-10-09T22:39:54.579728] [INFO ] [MAIN ] HSBC: Loaded 51335 primary data records. [2025-10-09T22:39:54.586458] [DEBUG] [LOCAL ] HSY: Loaded 50708 existing records from primary storage. [2025-10-09T22:39:54.599317] [INFO ] [MAIN ] HSY: Loaded 50708 primary data records. [2025-10-09T22:39:55.258075] [DEBUG] [MAIN ] HSHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:55.259873] [INFO ] [MAIN ] HSHP: Generated 1807 derivative records from 15090 primary records. [2025-10-09T22:39:55.260107] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-09T22:39:55.280412] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1807 records). [2025-10-09T22:39:55.280562] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-09T22:39:55.284093] [INFO ] [MAIN ] Derivative Progress: 901/1690 symbols completed. HSHP took 1.1s. Estimated remaining: 5m 7s. Rate: 154.1 symbols/min [2025-10-09T22:39:55.285047] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:55.306125] [DEBUG] [LOCAL ] HTD: Loaded 14048 existing records from primary storage. [2025-10-09T22:39:55.308138] [INFO ] [MAIN ] HTD: Loaded 14048 primary data records. [2025-10-09T22:39:55.369318] [DEBUG] [MAIN ] HSBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:55.410176] [INFO ] [MAIN ] HSBC: Generated 1807 derivative records from 51335 primary records. [2025-10-09T22:39:55.423112] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-09T22:39:55.436277] [DEBUG] [MAIN ] HSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:55.448778] [INFO ] [MAIN ] HSY: Generated 1807 derivative records from 50708 primary records. [2025-10-09T22:39:55.448897] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-09T22:39:55.486774] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1807 records). [2025-10-09T22:39:55.515147] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-09T22:39:55.564243] [INFO ] [MAIN ] Derivative Progress: 902/1690 symbols completed. HSBC took 1.4s. Estimated remaining: 5m 7s. Rate: 154.2 symbols/min [2025-10-09T22:39:55.712946] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:55.734141] [DEBUG] [LOCAL ] HSY: Derivative data saved (1807 records). [2025-10-09T22:39:55.735143] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-09T22:39:55.737996] [INFO ] [MAIN ] Derivative Progress: 903/1690 symbols completed. HSY took 1.6s. Estimated remaining: 5m 6s. Rate: 154.3 symbols/min [2025-10-09T22:39:55.738463] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:55.766845] [DEBUG] [MAIN ] HTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:55.767820] [INFO ] [MAIN ] HTD: Generated 1807 derivative records from 14048 primary records. [2025-10-09T22:39:55.767974] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-09T22:39:55.805607] [DEBUG] [LOCAL ] HTD: Derivative data saved (1807 records). [2025-10-09T22:39:55.806025] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-09T22:39:55.809720] [INFO ] [MAIN ] Derivative Progress: 904/1690 symbols completed. HTD took 0.5s. Estimated remaining: 5m 5s. Rate: 154.4 symbols/min [2025-10-09T22:39:55.809982] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:55.836978] [DEBUG] [LOCAL ] HUBB: Loaded 36829 existing records from primary storage. [2025-10-09T22:39:55.838141] [INFO ] [MAIN ] HUBB: Loaded 36829 primary data records. [2025-10-09T22:39:55.838002] [DEBUG] [LOCAL ] HTGC: Loaded 47851 existing records from primary storage. [2025-10-09T22:39:55.838637] [INFO ] [MAIN ] HTGC: Loaded 47851 primary data records. [2025-10-09T22:39:56.356042] [DEBUG] [LOCAL ] HUBS: Loaded 40004 existing records from primary storage. [2025-10-09T22:39:56.373103] [INFO ] [MAIN ] HUBS: Loaded 40004 primary data records. [2025-10-09T22:39:56.848589] [DEBUG] [MAIN ] HUBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:56.850459] [DEBUG] [MAIN ] HTGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:56.851566] [INFO ] [MAIN ] HUBB: Generated 1807 derivative records from 36829 primary records. [2025-10-09T22:39:56.852834] [INFO ] [MAIN ] HTGC: Generated 1807 derivative records from 47851 primary records. [2025-10-09T22:39:56.852938] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-09T22:39:56.851945] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-09T22:39:56.894283] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1807 records). [2025-10-09T22:39:56.897845] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1807 records). [2025-10-09T22:39:56.898452] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-09T22:39:56.898096] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-09T22:39:56.901073] [INFO ] [MAIN ] Derivative Progress: 905/1690 symbols completed. HTGC took 1.2s. Estimated remaining: 5m 6s. Rate: 154.1 symbols/min [2025-10-09T22:39:56.901230] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:56.904764] [INFO ] [MAIN ] Derivative Progress: 906/1690 symbols completed. HUBB took 1.2s. Estimated remaining: 5m 5s. Rate: 154.3 symbols/min [2025-10-09T22:39:56.906029] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:56.922837] [DEBUG] [MAIN ] HUBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:56.923506] [INFO ] [MAIN ] HUBS: Generated 1807 derivative records from 40004 primary records. [2025-10-09T22:39:56.923567] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-09T22:39:56.940943] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1807 records). [2025-10-09T22:39:56.941207] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-09T22:39:56.943811] [INFO ] [MAIN ] Derivative Progress: 907/1690 symbols completed. HUBS took 1.1s. Estimated remaining: 5m 4s. Rate: 154.4 symbols/min [2025-10-09T22:39:56.944127] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:56.991234] [DEBUG] [LOCAL ] HUM: Loaded 49359 existing records from primary storage. [2025-10-09T22:39:56.991470] [INFO ] [MAIN ] HUM: Loaded 49359 primary data records. [2025-10-09T22:39:57.139938] [DEBUG] [LOCAL ] HUN: Loaded 53591 existing records from primary storage. [2025-10-09T22:39:57.144907] [DEBUG] [LOCAL ] HUYA: Loaded 44268 existing records from primary storage. [2025-10-09T22:39:57.145378] [INFO ] [MAIN ] HUN: Loaded 53591 primary data records. [2025-10-09T22:39:57.145692] [INFO ] [MAIN ] HUYA: Loaded 44268 primary data records. [2025-10-09T22:39:58.033263] [DEBUG] [MAIN ] HUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:58.034439] [INFO ] [MAIN ] HUM: Generated 1807 derivative records from 49359 primary records. [2025-10-09T22:39:58.034544] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-09T22:39:58.056775] [DEBUG] [LOCAL ] HUM: Derivative data saved (1807 records). [2025-10-09T22:39:58.058564] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-09T22:39:58.069183] [INFO ] [MAIN ] Derivative Progress: 908/1690 symbols completed. HUM took 1.2s. Estimated remaining: 5m 4s. Rate: 154.1 symbols/min [2025-10-09T22:39:58.074175] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:58.088584] [DEBUG] [MAIN ] HUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:58.089164] [DEBUG] [MAIN ] HUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:58.090061] [INFO ] [MAIN ] HUYA: Generated 1807 derivative records from 44268 primary records. [2025-10-09T22:39:58.091346] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-09T22:39:58.091208] [INFO ] [MAIN ] HUN: Generated 1807 derivative records from 53591 primary records. [2025-10-09T22:39:58.091496] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-09T22:39:58.122106] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1807 records). [2025-10-09T22:39:58.125275] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-09T22:39:58.130285] [INFO ] [MAIN ] Derivative Progress: 909/1690 symbols completed. HUYA took 1.2s. Estimated remaining: 5m 4s. Rate: 154.2 symbols/min [2025-10-09T22:39:58.131594] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:58.133818] [DEBUG] [LOCAL ] HUN: Derivative data saved (1807 records). [2025-10-09T22:39:58.139419] [DEBUG] [LOCAL ] HVT: Loaded 15407 existing records from primary storage. [2025-10-09T22:39:58.139619] [INFO ] [MAIN ] HVT: Loaded 15407 primary data records. [2025-10-09T22:39:58.139688] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-09T22:39:58.153594] [INFO ] [MAIN ] Derivative Progress: 910/1690 symbols completed. HUN took 1.2s. Estimated remaining: 5m 3s. Rate: 154.4 symbols/min [2025-10-09T22:39:58.173462] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:58.501481] [DEBUG] [LOCAL ] HWM: Loaded 53247 existing records from primary storage. [2025-10-09T22:39:58.502057] [INFO ] [MAIN ] HWM: Loaded 53247 primary data records. [2025-10-09T22:39:58.508130] [DEBUG] [LOCAL ] HXL: Loaded 46202 existing records from primary storage. [2025-10-09T22:39:58.540375] [INFO ] [MAIN ] HXL: Loaded 46202 primary data records. [2025-10-09T22:39:58.784672] [DEBUG] [MAIN ] HVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:58.804957] [INFO ] [MAIN ] HVT: Generated 1807 derivative records from 15407 primary records. [2025-10-09T22:39:58.830478] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-09T22:39:59.141525] [DEBUG] [LOCAL ] HVT: Derivative data saved (1807 records). [2025-10-09T22:39:59.142361] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-09T22:39:59.145233] [INFO ] [MAIN ] Derivative Progress: 911/1690 symbols completed. HVT took 1.1s. Estimated remaining: 5m 3s. Rate: 154.1 symbols/min [2025-10-09T22:39:59.146472] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:59.161129] [DEBUG] [LOCAL ] HY: Loaded 10036 existing records from primary storage. [2025-10-09T22:39:59.161582] [INFO ] [MAIN ] HY: Loaded 10036 primary data records. [2025-10-09T22:39:59.339863] [DEBUG] [MAIN ] HWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:59.340176] [DEBUG] [MAIN ] HXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:59.348898] [INFO ] [MAIN ] HXL: Generated 1807 derivative records from 46202 primary records. [2025-10-09T22:39:59.348178] [INFO ] [MAIN ] HWM: Generated 1807 derivative records from 53247 primary records. [2025-10-09T22:39:59.475383] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-09T22:39:59.483505] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-09T22:39:59.512947] [DEBUG] [LOCAL ] HWM: Derivative data saved (1807 records). [2025-10-09T22:39:59.513822] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-09T22:39:59.516788] [INFO ] [MAIN ] Derivative Progress: 912/1690 symbols completed. HWM took 1.4s. Estimated remaining: 5m 3s. Rate: 154.2 symbols/min [2025-10-09T22:39:59.517331] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:59.524660] [DEBUG] [LOCAL ] HXL: Derivative data saved (1807 records). [2025-10-09T22:39:59.524908] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-09T22:39:59.527431] [INFO ] [MAIN ] Derivative Progress: 913/1690 symbols completed. HXL took 1.4s. Estimated remaining: 5m 2s. Rate: 154.3 symbols/min [2025-10-09T22:39:59.536966] [DEBUG] [LOCAL ] HYI: Loaded 9984 existing records from primary storage. [2025-10-09T22:39:59.537180] [INFO ] [MAIN ] HYI: Loaded 9984 primary data records. [2025-10-09T22:39:59.880961] [DEBUG] [MAIN ] HY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:59.890402] [INFO ] [MAIN ] HY: Generated 1807 derivative records from 10036 primary records. [2025-10-09T22:39:59.890507] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-09T22:39:59.908330] [DEBUG] [LOCAL ] HY: Derivative data saved (1807 records). [2025-10-09T22:39:59.908730] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-09T22:39:59.910813] [INFO ] [MAIN ] Derivative Progress: 914/1690 symbols completed. HY took 0.8s. Estimated remaining: 5m 2s. Rate: 154.3 symbols/min [2025-10-09T22:39:59.930405] [DEBUG] [MAIN ] HYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:39:59.931029] [INFO ] [MAIN ] HYI: Generated 1807 derivative records from 9984 primary records. [2025-10-09T22:39:59.931099] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-09T22:39:59.945926] [DEBUG] [LOCAL ] HYI: Derivative data saved (1807 records). [2025-10-09T22:39:59.945984] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-09T22:39:59.948323] [INFO ] [MAIN ] Derivative Progress: 915/1690 symbols completed. HYI took 0.4s. Estimated remaining: 5m 1s. Rate: 154.5 symbols/min [2025-10-09T22:39:59.948823] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:59.948929] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:59.948889] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:39:59.955764] [DEBUG] [LOCAL ] HYTR: Loaded 3138 existing records from primary storage. [2025-10-09T22:39:59.956008] [INFO ] [MAIN ] HYTR: Loaded 3138 primary data records. [2025-10-09T22:40:00.296005] [DEBUG] [LOCAL ] HYT: Loaded 33742 existing records from primary storage. [2025-10-09T22:40:00.298081] [INFO ] [MAIN ] HYT: Loaded 33742 primary data records. [2025-10-09T22:40:00.297921] [DEBUG] [LOCAL ] HZO: Loaded 29215 existing records from primary storage. [2025-10-09T22:40:00.303552] [INFO ] [MAIN ] HZO: Loaded 29215 primary data records. [2025-10-09T22:40:00.956241] [DEBUG] [MAIN ] HYTR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:40:00.957225] [INFO ] [MAIN ] HYTR: Generated 1806 derivative records from 3138 primary records. [2025-10-09T22:40:00.957438] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-09T22:40:00.976329] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1806 records). [2025-10-09T22:40:00.976501] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-09T22:40:00.978615] [INFO ] [MAIN ] Derivative Progress: 916/1690 symbols completed. HYTR took 1.0s. Estimated remaining: 5m 1s. Rate: 154.2 symbols/min [2025-10-09T22:40:00.979360] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:00.991407] [DEBUG] [LOCAL ] IAE: Loaded 6203 existing records from primary storage. [2025-10-09T22:40:00.993265] [INFO ] [MAIN ] IAE: Loaded 6203 primary data records. [2025-10-09T22:40:01.075397] [DEBUG] [MAIN ] HZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:01.119520] [DEBUG] [MAIN ] HYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:01.120331] [INFO ] [MAIN ] HZO: Generated 1807 derivative records from 29215 primary records. [2025-10-09T22:40:01.124775] [INFO ] [MAIN ] HYT: Generated 1807 derivative records from 33742 primary records. [2025-10-09T22:40:01.124923] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-09T22:40:01.135689] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-09T22:40:01.233604] [DEBUG] [LOCAL ] HZO: Derivative data saved (1807 records). [2025-10-09T22:40:01.233929] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-09T22:40:01.354689] [INFO ] [MAIN ] Derivative Progress: 917/1690 symbols completed. HZO took 1.4s. Estimated remaining: 5m 1s. Rate: 154.2 symbols/min [2025-10-09T22:40:01.363470] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:01.374702] [DEBUG] [LOCAL ] HYT: Derivative data saved (1807 records). [2025-10-09T22:40:01.375497] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-09T22:40:01.378459] [INFO ] [MAIN ] Derivative Progress: 918/1690 symbols completed. HYT took 1.4s. Estimated remaining: 5m 0s. Rate: 154.4 symbols/min [2025-10-09T22:40:01.378937] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:01.404327] [DEBUG] [MAIN ] IAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:01.405041] [INFO ] [MAIN ] IAE: Generated 1807 derivative records from 6203 primary records. [2025-10-09T22:40:01.405144] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-09T22:40:01.434983] [DEBUG] [LOCAL ] IAE: Derivative data saved (1807 records). [2025-10-09T22:40:01.435124] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-09T22:40:01.438564] [INFO ] [MAIN ] Derivative Progress: 919/1690 symbols completed. IAE took 0.5s. Estimated remaining: 4m 59s. Rate: 154.5 symbols/min [2025-10-09T22:40:01.439009] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:01.479730] [DEBUG] [LOCAL ] IAG: Loaded 53863 existing records from primary storage. [2025-10-09T22:40:01.479966] [INFO ] [MAIN ] IAG: Loaded 53863 primary data records. [2025-10-09T22:40:01.610562] [DEBUG] [LOCAL ] IBM: Loaded 54021 existing records from primary storage. [2025-10-09T22:40:01.623068] [INFO ] [MAIN ] IBM: Loaded 54021 primary data records. [2025-10-09T22:40:01.772292] [DEBUG] [LOCAL ] IBN: Loaded 53246 existing records from primary storage. [2025-10-09T22:40:01.790109] [INFO ] [MAIN ] IBN: Loaded 53246 primary data records. [2025-10-09T22:40:02.625572] [DEBUG] [MAIN ] IAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:02.628011] [INFO ] [MAIN ] IAG: Generated 1807 derivative records from 53863 primary records. [2025-10-09T22:40:02.628291] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-09T22:40:02.645305] [DEBUG] [MAIN ] IBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:02.646316] [INFO ] [MAIN ] IBM: Generated 1807 derivative records from 54021 primary records. [2025-10-09T22:40:02.646592] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-09T22:40:02.682505] [DEBUG] [LOCAL ] IAG: Derivative data saved (1807 records). [2025-10-09T22:40:02.684163] [DEBUG] [LOCAL ] IBM: Derivative data saved (1807 records). [2025-10-09T22:40:02.684267] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-09T22:40:02.683831] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-09T22:40:02.687099] [INFO ] [MAIN ] Derivative Progress: 920/1690 symbols completed. IBM took 1.3s. Estimated remaining: 4m 60s. Rate: 154.1 symbols/min [2025-10-09T22:40:02.689515] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:02.689625] [INFO ] [MAIN ] Derivative Progress: 921/1690 symbols completed. IAG took 1.3s. Estimated remaining: 4m 59s. Rate: 154.3 symbols/min [2025-10-09T22:40:02.690287] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:02.703893] [DEBUG] [MAIN ] IBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:02.704558] [INFO ] [MAIN ] IBN: Generated 1807 derivative records from 53246 primary records. [2025-10-09T22:40:02.704694] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-09T22:40:02.722386] [DEBUG] [LOCAL ] IBN: Derivative data saved (1807 records). [2025-10-09T22:40:02.722681] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-09T22:40:02.725365] [INFO ] [MAIN ] Derivative Progress: 922/1690 symbols completed. IBN took 1.3s. Estimated remaining: 4m 58s. Rate: 154.4 symbols/min [2025-10-09T22:40:02.725724] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:02.769077] [DEBUG] [LOCAL ] IBP: Loaded 29034 existing records from primary storage. [2025-10-09T22:40:02.769254] [INFO ] [MAIN ] IBP: Loaded 29034 primary data records. [2025-10-09T22:40:02.781126] [DEBUG] [LOCAL ] IBTA: Loaded 37355 existing records from primary storage. [2025-10-09T22:40:02.803079] [INFO ] [MAIN ] IBTA: Loaded 37355 primary data records. [2025-10-09T22:40:03.185040] [DEBUG] [LOCAL ] ICE: Loaded 53402 existing records from primary storage. [2025-10-09T22:40:03.296391] [INFO ] [MAIN ] ICE: Loaded 53402 primary data records. [2025-10-09T22:40:03.837738] [DEBUG] [MAIN ] IBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:03.837173] [DEBUG] [MAIN ] IBTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:03.838596] [INFO ] [MAIN ] IBTA: Generated 1807 derivative records from 37355 primary records. [2025-10-09T22:40:03.838891] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-09T22:40:03.840194] [INFO ] [MAIN ] IBP: Generated 1807 derivative records from 29034 primary records. [2025-10-09T22:40:03.840937] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-09T22:40:03.870445] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1807 records). [2025-10-09T22:40:03.871484] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-09T22:40:03.874367] [INFO ] [MAIN ] Derivative Progress: 923/1690 symbols completed. IBTA took 1.2s. Estimated remaining: 4m 59s. Rate: 154.1 symbols/min [2025-10-09T22:40:03.875468] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:03.883412] [DEBUG] [LOCAL ] IBP: Derivative data saved (1807 records). [2025-10-09T22:40:03.883906] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-09T22:40:03.886087] [INFO ] [MAIN ] Derivative Progress: 924/1690 symbols completed. IBP took 1.2s. Estimated remaining: 4m 58s. Rate: 154.3 symbols/min [2025-10-09T22:40:03.886434] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:03.900452] [DEBUG] [MAIN ] ICE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:03.901202] [INFO ] [MAIN ] ICE: Generated 1807 derivative records from 53402 primary records. [2025-10-09T22:40:03.901454] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-09T22:40:03.918729] [DEBUG] [LOCAL ] ICE: Derivative data saved (1807 records). [2025-10-09T22:40:03.918954] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-09T22:40:03.921533] [INFO ] [MAIN ] Derivative Progress: 925/1690 symbols completed. ICE took 1.2s. Estimated remaining: 4m 57s. Rate: 154.4 symbols/min [2025-10-09T22:40:03.931705] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:03.957868] [DEBUG] [LOCAL ] ICL: Loaded 38682 existing records from primary storage. [2025-10-09T22:40:03.958155] [INFO ] [MAIN ] ICL: Loaded 38682 primary data records. [2025-10-09T22:40:04.008479] [DEBUG] [LOCAL ] IDE: Loaded 8984 existing records from primary storage. [2025-10-09T22:40:04.052564] [INFO ] [MAIN ] IDE: Loaded 8984 primary data records. [2025-10-09T22:40:04.073701] [DEBUG] [LOCAL ] IDA: Loaded 32825 existing records from primary storage. [2025-10-09T22:40:04.117751] [INFO ] [MAIN ] IDA: Loaded 32825 primary data records. [2025-10-09T22:40:04.958749] [DEBUG] [MAIN ] ICL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:04.959834] [INFO ] [MAIN ] ICL: Generated 1807 derivative records from 38682 primary records. [2025-10-09T22:40:04.960025] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-09T22:40:04.988284] [DEBUG] [MAIN ] IDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:04.989594] [INFO ] [MAIN ] IDE: Generated 1807 derivative records from 8984 primary records. [2025-10-09T22:40:04.990436] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-09T22:40:05.005001] [DEBUG] [MAIN ] IDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:05.018401] [INFO ] [MAIN ] IDA: Generated 1807 derivative records from 32825 primary records. [2025-10-09T22:40:05.020070] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-09T22:40:05.022253] [DEBUG] [LOCAL ] ICL: Derivative data saved (1807 records). [2025-10-09T22:40:05.025621] [DEBUG] [LOCAL ] IDE: Derivative data saved (1807 records). [2025-10-09T22:40:05.024869] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-09T22:40:05.028016] [INFO ] [MAIN ] Derivative Progress: 926/1690 symbols completed. ICL took 1.2s. Estimated remaining: 4m 57s. Rate: 154.1 symbols/min [2025-10-09T22:40:05.028173] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-09T22:40:05.035720] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:05.039630] [INFO ] [MAIN ] Derivative Progress: 927/1690 symbols completed. IDE took 1.1s. Estimated remaining: 4m 57s. Rate: 154.3 symbols/min [2025-10-09T22:40:05.042610] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:05.051060] [DEBUG] [LOCAL ] IDA: Derivative data saved (1807 records). [2025-10-09T22:40:05.051281] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-09T22:40:05.054041] [INFO ] [MAIN ] Derivative Progress: 928/1690 symbols completed. IDA took 1.2s. Estimated remaining: 4m 56s. Rate: 154.4 symbols/min [2025-10-09T22:40:05.070196] [DEBUG] [LOCAL ] IDT: Loaded 18343 existing records from primary storage. [2025-10-09T22:40:05.070332] [INFO ] [MAIN ] IDT: Loaded 18343 primary data records. [2025-10-09T22:40:05.262340] [DEBUG] [LOCAL ] IEX: Loaded 38578 existing records from primary storage. [2025-10-09T22:40:05.283416] [INFO ] [MAIN ] IEX: Loaded 38578 primary data records. [2025-10-09T22:40:05.727065] [DEBUG] [MAIN ] IDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:05.727888] [INFO ] [MAIN ] IDT: Generated 1807 derivative records from 18343 primary records. [2025-10-09T22:40:05.728201] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-09T22:40:05.759400] [DEBUG] [MAIN ] IEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:05.760724] [INFO ] [MAIN ] IEX: Generated 1807 derivative records from 38578 primary records. [2025-10-09T22:40:05.761365] [DEBUG] [LOCAL ] IDT: Derivative data saved (1807 records). [2025-10-09T22:40:05.761562] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-09T22:40:05.761454] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-09T22:40:05.763895] [INFO ] [MAIN ] Derivative Progress: 929/1690 symbols completed. IDT took 0.7s. Estimated remaining: 4m 56s. Rate: 154.3 symbols/min [2025-10-09T22:40:05.780800] [DEBUG] [LOCAL ] IEX: Derivative data saved (1807 records). [2025-10-09T22:40:05.780911] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-09T22:40:05.783590] [INFO ] [MAIN ] Derivative Progress: 930/1690 symbols completed. IEX took 0.7s. Estimated remaining: 4m 55s. Rate: 154.5 symbols/min [2025-10-09T22:40:05.784328] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:05.784256] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:05.784497] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:05.813946] [DEBUG] [LOCAL ] IFN: Loaded 18452 existing records from primary storage. [2025-10-09T22:40:05.814159] [INFO ] [MAIN ] IFN: Loaded 18452 primary data records. [2025-10-09T22:40:05.877979] [DEBUG] [LOCAL ] IFS: Loaded 23061 existing records from primary storage. [2025-10-09T22:40:05.903504] [INFO ] [MAIN ] IFS: Loaded 23061 primary data records. [2025-10-09T22:40:06.153832] [DEBUG] [LOCAL ] IFF: Loaded 51422 existing records from primary storage. [2025-10-09T22:40:06.267501] [INFO ] [MAIN ] IFF: Loaded 51422 primary data records. [2025-10-09T22:40:06.823005] [DEBUG] [MAIN ] IFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:06.824030] [INFO ] [MAIN ] IFN: Generated 1807 derivative records from 18452 primary records. [2025-10-09T22:40:06.824143] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-09T22:40:06.856720] [DEBUG] [MAIN ] IFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:06.858171] [INFO ] [MAIN ] IFS: Generated 1807 derivative records from 23061 primary records. [2025-10-09T22:40:06.858986] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-09T22:40:06.858918] [DEBUG] [LOCAL ] IFN: Derivative data saved (1807 records). [2025-10-09T22:40:06.859394] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-09T22:40:06.861972] [INFO ] [MAIN ] Derivative Progress: 931/1690 symbols completed. IFN took 1.1s. Estimated remaining: 4m 55s. Rate: 154.2 symbols/min [2025-10-09T22:40:06.862250] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:06.896856] [DEBUG] [LOCAL ] IGA: Loaded 10089 existing records from primary storage. [2025-10-09T22:40:06.902325] [DEBUG] [LOCAL ] IFS: Derivative data saved (1807 records). [2025-10-09T22:40:06.902402] [INFO ] [MAIN ] IGA: Loaded 10089 primary data records. [2025-10-09T22:40:06.902879] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-09T22:40:06.917222] [INFO ] [MAIN ] Derivative Progress: 932/1690 symbols completed. IFS took 1.1s. Estimated remaining: 4m 55s. Rate: 154.3 symbols/min [2025-10-09T22:40:06.927332] [DEBUG] [MAIN ] IFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:06.951946] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:06.939038] [INFO ] [MAIN ] IFF: Generated 1807 derivative records from 51422 primary records. [2025-10-09T22:40:06.984423] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-09T22:40:07.107389] [DEBUG] [LOCAL ] IFF: Derivative data saved (1807 records). [2025-10-09T22:40:07.112155] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-09T22:40:07.114959] [INFO ] [MAIN ] Derivative Progress: 933/1690 symbols completed. IFF took 1.3s. Estimated remaining: 4m 54s. Rate: 154.4 symbols/min [2025-10-09T22:40:07.220205] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:07.237308] [DEBUG] [LOCAL ] IGD: Loaded 19396 existing records from primary storage. [2025-10-09T22:40:07.237397] [INFO ] [MAIN ] IGD: Loaded 19396 primary data records. [2025-10-09T22:40:07.312178] [DEBUG] [LOCAL ] IGI: Loaded 3844 existing records from primary storage. [2025-10-09T22:40:07.319460] [INFO ] [MAIN ] IGI: Loaded 3844 primary data records. [2025-10-09T22:40:07.830063] [DEBUG] [MAIN ] IGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:07.919121] [INFO ] [MAIN ] IGA: Generated 1807 derivative records from 10089 primary records. [2025-10-09T22:40:07.920173] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-09T22:40:07.941383] [DEBUG] [LOCAL ] IGA: Derivative data saved (1807 records). [2025-10-09T22:40:07.941963] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-09T22:40:07.944315] [INFO ] [MAIN ] Derivative Progress: 934/1690 symbols completed. IGA took 1.1s. Estimated remaining: 4m 54s. Rate: 154.2 symbols/min [2025-10-09T22:40:07.945285] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:07.966348] [DEBUG] [MAIN ] IGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:07.967214] [INFO ] [MAIN ] IGD: Generated 1807 derivative records from 19396 primary records. [2025-10-09T22:40:07.967337] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-09T22:40:08.012983] [DEBUG] [MAIN ] IGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:08.014047] [DEBUG] [LOCAL ] IGD: Derivative data saved (1807 records). [2025-10-09T22:40:08.023710] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-09T22:40:08.026703] [INFO ] [MAIN ] Derivative Progress: 935/1690 symbols completed. IGD took 1.1s. Estimated remaining: 4m 54s. Rate: 154.3 symbols/min [2025-10-09T22:40:08.027299] [DEBUG] [LOCAL ] IGR: Loaded 30591 existing records from primary storage. [2025-10-09T22:40:08.027498] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:08.028511] [INFO ] [MAIN ] IGR: Loaded 30591 primary data records. [2025-10-09T22:40:08.028377] [INFO ] [MAIN ] IGI: Generated 1807 derivative records from 3844 primary records. [2025-10-09T22:40:08.028775] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-09T22:40:08.161139] [DEBUG] [LOCAL ] IGI: Derivative data saved (1807 records). [2025-10-09T22:40:08.161442] [DEBUG] [LOCAL ] IH: Loaded 2870 existing records from primary storage. [2025-10-09T22:40:08.166817] [INFO ] [MAIN ] IH: Loaded 2870 primary data records. [2025-10-09T22:40:08.161603] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-09T22:40:08.185222] [INFO ] [MAIN ] Derivative Progress: 936/1690 symbols completed. IGI took 1.0s. Estimated remaining: 4m 53s. Rate: 154.4 symbols/min [2025-10-09T22:40:08.190584] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:08.483981] [DEBUG] [LOCAL ] IHD: Loaded 7145 existing records from primary storage. [2025-10-09T22:40:08.505881] [INFO ] [MAIN ] IHD: Loaded 7145 primary data records. [2025-10-09T22:40:09.019822] [DEBUG] [MAIN ] IGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:09.021390] [INFO ] [MAIN ] IGR: Generated 1807 derivative records from 30591 primary records. [2025-10-09T22:40:09.021544] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-09T22:40:09.040668] [DEBUG] [LOCAL ] IGR: Derivative data saved (1807 records). [2025-10-09T22:40:09.042867] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-09T22:40:09.045723] [INFO ] [MAIN ] Derivative Progress: 937/1690 symbols completed. IGR took 1.1s. Estimated remaining: 4m 53s. Rate: 154.2 symbols/min [2025-10-09T22:40:09.046299] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:09.061082] [DEBUG] [MAIN ] IH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:09.062061] [INFO ] [MAIN ] IH: Generated 1807 derivative records from 2870 primary records. [2025-10-09T22:40:09.063919] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-09T22:40:09.091328] [DEBUG] [MAIN ] IHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:09.093295] [INFO ] [MAIN ] IHD: Generated 1807 derivative records from 7145 primary records. [2025-10-09T22:40:09.094423] [DEBUG] [LOCAL ] IH: Derivative data saved (1807 records). [2025-10-09T22:40:09.094031] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-09T22:40:09.094975] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-09T22:40:09.104154] [INFO ] [MAIN ] Derivative Progress: 938/1690 symbols completed. IH took 1.1s. Estimated remaining: 4m 52s. Rate: 154.4 symbols/min [2025-10-09T22:40:09.115686] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:09.131174] [DEBUG] [LOCAL ] IHG: Loaded 24344 existing records from primary storage. [2025-10-09T22:40:09.131954] [INFO ] [MAIN ] IHG: Loaded 24344 primary data records. [2025-10-09T22:40:09.131759] [DEBUG] [LOCAL ] IHD: Derivative data saved (1807 records). [2025-10-09T22:40:09.132249] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-09T22:40:09.166338] [INFO ] [MAIN ] Derivative Progress: 939/1690 symbols completed. IHD took 1.0s. Estimated remaining: 4m 52s. Rate: 154.5 symbols/min [2025-10-09T22:40:09.201621] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:09.358456] [DEBUG] [LOCAL ] IIF: Loaded 5676 existing records from primary storage. [2025-10-09T22:40:09.473612] [DEBUG] [LOCAL ] IHS: Loaded 38498 existing records from primary storage. [2025-10-09T22:40:09.473906] [INFO ] [MAIN ] IIF: Loaded 5676 primary data records. [2025-10-09T22:40:09.482886] [INFO ] [MAIN ] IHS: Loaded 38498 primary data records. [2025-10-09T22:40:10.194013] [DEBUG] [MAIN ] IHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:10.195305] [INFO ] [MAIN ] IHG: Generated 1807 derivative records from 24344 primary records. [2025-10-09T22:40:10.195410] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-09T22:40:10.213951] [DEBUG] [LOCAL ] IHG: Derivative data saved (1807 records). [2025-10-09T22:40:10.214922] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-09T22:40:10.218313] [INFO ] [MAIN ] Derivative Progress: 940/1690 symbols completed. IHG took 1.2s. Estimated remaining: 4m 52s. Rate: 154.2 symbols/min [2025-10-09T22:40:10.218571] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:10.232961] [DEBUG] [MAIN ] IIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:10.233742] [INFO ] [MAIN ] IIF: Generated 1807 derivative records from 5676 primary records. [2025-10-09T22:40:10.233917] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-09T22:40:10.256114] [DEBUG] [LOCAL ] IIF: Derivative data saved (1807 records). [2025-10-09T22:40:10.263818] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-09T22:40:10.271731] [INFO ] [MAIN ] Derivative Progress: 941/1690 symbols completed. IIF took 1.1s. Estimated remaining: 4m 51s. Rate: 154.4 symbols/min [2025-10-09T22:40:10.272216] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:10.272034] [DEBUG] [MAIN ] IHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:10.278839] [DEBUG] [LOCAL ] IIM: Loaded 15957 existing records from primary storage. [2025-10-09T22:40:10.278548] [INFO ] [MAIN ] IHS: Generated 1807 derivative records from 38498 primary records. [2025-10-09T22:40:10.278943] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-09T22:40:10.279024] [INFO ] [MAIN ] IIM: Loaded 15957 primary data records. [2025-10-09T22:40:10.450351] [DEBUG] [LOCAL ] IHS: Derivative data saved (1807 records). [2025-10-09T22:40:10.457679] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-09T22:40:10.470366] [INFO ] [MAIN ] Derivative Progress: 942/1690 symbols completed. IHS took 1.4s. Estimated remaining: 4m 51s. Rate: 154.5 symbols/min [2025-10-09T22:40:10.490341] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:10.596463] [DEBUG] [LOCAL ] IIPR: Loaded 29611 existing records from primary storage. [2025-10-09T22:40:10.610250] [INFO ] [MAIN ] IIPR: Loaded 29611 primary data records. [2025-10-09T22:40:10.820846] [DEBUG] [LOCAL ] IMAX: Loaded 43236 existing records from primary storage. [2025-10-09T22:40:10.935082] [INFO ] [MAIN ] IMAX: Loaded 43236 primary data records. [2025-10-09T22:40:11.105611] [DEBUG] [MAIN ] IIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:11.241329] [INFO ] [MAIN ] IIM: Generated 1807 derivative records from 15957 primary records. [2025-10-09T22:40:11.250260] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-09T22:40:11.273572] [DEBUG] [LOCAL ] IIM: Derivative data saved (1807 records). [2025-10-09T22:40:11.286072] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-09T22:40:11.286861] [DEBUG] [MAIN ] IIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:11.289438] [INFO ] [MAIN ] Derivative Progress: 943/1690 symbols completed. IIM took 1.1s. Estimated remaining: 4m 51s. Rate: 154.3 symbols/min [2025-10-09T22:40:11.291414] [INFO ] [MAIN ] IIPR: Generated 1807 derivative records from 29611 primary records. [2025-10-09T22:40:11.291684] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-09T22:40:11.308485] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1807 records). [2025-10-09T22:40:11.308876] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-09T22:40:11.311557] [INFO ] [MAIN ] Derivative Progress: 944/1690 symbols completed. IIPR took 1.0s. Estimated remaining: 4m 50s. Rate: 154.4 symbols/min [2025-10-09T22:40:11.326286] [DEBUG] [MAIN ] IMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:11.326847] [INFO ] [MAIN ] IMAX: Generated 1807 derivative records from 43236 primary records. [2025-10-09T22:40:11.326907] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-09T22:40:11.342831] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1807 records). [2025-10-09T22:40:11.342889] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-09T22:40:11.345559] [INFO ] [MAIN ] Derivative Progress: 945/1690 symbols completed. IMAX took 0.9s. Estimated remaining: 4m 49s. Rate: 154.6 symbols/min [2025-10-09T22:40:11.346371] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:11.346321] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:11.346210] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:11.428677] [DEBUG] [LOCAL ] INFA: Loaded 49552 existing records from primary storage. [2025-10-09T22:40:11.429829] [INFO ] [MAIN ] INFA: Loaded 49552 primary data records. [2025-10-09T22:40:11.442307] [DEBUG] [LOCAL ] ING: Loaded 51085 existing records from primary storage. [2025-10-09T22:40:11.486195] [INFO ] [MAIN ] ING: Loaded 51085 primary data records. [2025-10-09T22:40:11.608196] [DEBUG] [LOCAL ] INFY: Loaded 53984 existing records from primary storage. [2025-10-09T22:40:11.633633] [INFO ] [MAIN ] INFY: Loaded 53984 primary data records. [2025-10-09T22:40:12.539875] [DEBUG] [MAIN ] INFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:12.544895] [INFO ] [MAIN ] INFA: Generated 1807 derivative records from 49552 primary records. [2025-10-09T22:40:12.545357] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-09T22:40:12.580963] [DEBUG] [MAIN ] ING: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:12.583196] [INFO ] [MAIN ] ING: Generated 1807 derivative records from 51085 primary records. [2025-10-09T22:40:12.599743] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-09T22:40:12.601707] [DEBUG] [MAIN ] INFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:12.602596] [INFO ] [MAIN ] INFY: Generated 1807 derivative records from 53984 primary records. [2025-10-09T22:40:12.604386] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-09T22:40:12.606776] [DEBUG] [LOCAL ] INFA: Derivative data saved (1807 records). [2025-10-09T22:40:12.617092] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-09T22:40:12.634578] [INFO ] [MAIN ] Derivative Progress: 946/1690 symbols completed. INFA took 1.3s. Estimated remaining: 4m 49s. Rate: 154.2 symbols/min [2025-10-09T22:40:12.634905] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:12.647864] [DEBUG] [LOCAL ] ING: Derivative data saved (1807 records). [2025-10-09T22:40:12.649131] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-09T22:40:12.652857] [INFO ] [MAIN ] Derivative Progress: 947/1690 symbols completed. ING took 1.3s. Estimated remaining: 4m 49s. Rate: 154.4 symbols/min [2025-10-09T22:40:12.653977] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:12.657851] [DEBUG] [LOCAL ] INFY: Derivative data saved (1807 records). [2025-10-09T22:40:12.657944] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-09T22:40:12.661828] [INFO ] [MAIN ] Derivative Progress: 948/1690 symbols completed. INFY took 1.3s. Estimated remaining: 4m 48s. Rate: 154.5 symbols/min [2025-10-09T22:40:12.662308] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:12.706769] [DEBUG] [LOCAL ] INGM: Loaded 28891 existing records from primary storage. [2025-10-09T22:40:12.707031] [INFO ] [MAIN ] INGM: Loaded 28891 primary data records. [2025-10-09T22:40:12.851611] [DEBUG] [LOCAL ] INGR: Loaded 33896 existing records from primary storage. [2025-10-09T22:40:12.900511] [INFO ] [MAIN ] INGR: Loaded 33896 primary data records. [2025-10-09T22:40:12.885090] [DEBUG] [LOCAL ] INN: Loaded 42044 existing records from primary storage. [2025-10-09T22:40:12.910370] [INFO ] [MAIN ] INN: Loaded 42044 primary data records. [2025-10-09T22:40:13.706142] [DEBUG] [MAIN ] INGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:13.707120] [INFO ] [MAIN ] INGM: Generated 1807 derivative records from 28891 primary records. [2025-10-09T22:40:13.707561] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-09T22:40:13.726789] [DEBUG] [LOCAL ] INGM: Derivative data saved (1807 records). [2025-10-09T22:40:13.726932] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-09T22:40:13.728801] [INFO ] [MAIN ] Derivative Progress: 949/1690 symbols completed. INGM took 1.1s. Estimated remaining: 4m 48s. Rate: 154.2 symbols/min [2025-10-09T22:40:13.729365] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:13.761472] [DEBUG] [MAIN ] INN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:13.761881] [DEBUG] [MAIN ] INGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:13.762627] [INFO ] [MAIN ] INGR: Generated 1807 derivative records from 33896 primary records. [2025-10-09T22:40:13.763300] [INFO ] [MAIN ] INN: Generated 1807 derivative records from 42044 primary records. [2025-10-09T22:40:13.763373] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-09T22:40:13.763458] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-09T22:40:13.801712] [DEBUG] [LOCAL ] INGR: Derivative data saved (1807 records). [2025-10-09T22:40:13.802958] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-09T22:40:13.806213] [INFO ] [MAIN ] Derivative Progress: 950/1690 symbols completed. INGR took 1.2s. Estimated remaining: 4m 48s. Rate: 154.4 symbols/min [2025-10-09T22:40:13.806699] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:13.807494] [DEBUG] [LOCAL ] INN: Derivative data saved (1807 records). [2025-10-09T22:40:13.807864] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-09T22:40:13.811052] [INFO ] [MAIN ] Derivative Progress: 951/1690 symbols completed. INN took 1.1s. Estimated remaining: 4m 47s. Rate: 154.5 symbols/min [2025-10-09T22:40:13.811948] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:13.823682] [DEBUG] [LOCAL ] INSP: Loaded 37994 existing records from primary storage. [2025-10-09T22:40:13.825040] [INFO ] [MAIN ] INSP: Loaded 37994 primary data records. [2025-10-09T22:40:14.193711] [DEBUG] [LOCAL ] INSW: Loaded 40038 existing records from primary storage. [2025-10-09T22:40:14.194408] [INFO ] [MAIN ] INSW: Loaded 40038 primary data records. [2025-10-09T22:40:14.195299] [DEBUG] [LOCAL ] INVH: Loaded 53549 existing records from primary storage. [2025-10-09T22:40:14.195461] [INFO ] [MAIN ] INVH: Loaded 53549 primary data records. [2025-10-09T22:40:14.812864] [DEBUG] [MAIN ] INSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:14.814615] [INFO ] [MAIN ] INSP: Generated 1807 derivative records from 37994 primary records. [2025-10-09T22:40:14.815280] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-09T22:40:14.834258] [DEBUG] [LOCAL ] INSP: Derivative data saved (1807 records). [2025-10-09T22:40:14.834598] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-09T22:40:14.838400] [INFO ] [MAIN ] Derivative Progress: 952/1690 symbols completed. INSP took 1.1s. Estimated remaining: 4m 47s. Rate: 154.3 symbols/min [2025-10-09T22:40:14.839422] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:14.860893] [DEBUG] [MAIN ] INVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:14.863527] [INFO ] [MAIN ] INVH: Generated 1807 derivative records from 53549 primary records. [2025-10-09T22:40:14.863921] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-09T22:40:14.896233] [DEBUG] [MAIN ] INSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:14.905792] [INFO ] [MAIN ] INSW: Generated 1807 derivative records from 40038 primary records. [2025-10-09T22:40:14.906421] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-09T22:40:14.908450] [DEBUG] [LOCAL ] INVX: Loaded 29349 existing records from primary storage. [2025-10-09T22:40:14.909022] [INFO ] [MAIN ] INVX: Loaded 29349 primary data records. [2025-10-09T22:40:15.005853] [DEBUG] [LOCAL ] INVH: Derivative data saved (1807 records). [2025-10-09T22:40:15.017239] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-09T22:40:15.027137] [INFO ] [MAIN ] Derivative Progress: 953/1690 symbols completed. INVH took 1.2s. Estimated remaining: 4m 47s. Rate: 154.3 symbols/min [2025-10-09T22:40:15.027553] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:15.044339] [DEBUG] [LOCAL ] INSW: Derivative data saved (1807 records). [2025-10-09T22:40:15.059993] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-09T22:40:15.109726] [INFO ] [MAIN ] Derivative Progress: 954/1690 symbols completed. INSW took 1.3s. Estimated remaining: 4m 46s. Rate: 154.5 symbols/min [2025-10-09T22:40:15.214576] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:15.274022] [DEBUG] [MAIN ] INVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:15.288559] [INFO ] [MAIN ] INVX: Generated 1807 derivative records from 29349 primary records. [2025-10-09T22:40:15.288770] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-09T22:40:15.290329] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-09T22:40:15.290665] [INFO ] [MAIN ] IONQ: Loaded 54178 primary data records. [2025-10-09T22:40:15.423061] [DEBUG] [LOCAL ] INVX: Derivative data saved (1807 records). [2025-10-09T22:40:15.447893] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-09T22:40:15.466071] [INFO ] [MAIN ] Derivative Progress: 955/1690 symbols completed. INVX took 0.6s. Estimated remaining: 4m 45s. Rate: 154.5 symbols/min [2025-10-09T22:40:15.497893] [DEBUG] [LOCAL ] IOT: Loaded 53862 existing records from primary storage. [2025-10-09T22:40:15.496788] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:15.498089] [INFO ] [MAIN ] IOT: Loaded 53862 primary data records. [2025-10-09T22:40:16.026258] [DEBUG] [MAIN ] IONQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:16.027331] [DEBUG] [LOCAL ] IP: Loaded 53701 existing records from primary storage. [2025-10-09T22:40:16.027547] [INFO ] [MAIN ] IP: Loaded 53701 primary data records. [2025-10-09T22:40:16.029384] [INFO ] [MAIN ] IONQ: Generated 1807 derivative records from 54178 primary records. [2025-10-09T22:40:16.060453] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-09T22:40:16.245902] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1807 records). [2025-10-09T22:40:16.246298] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-09T22:40:16.248992] [INFO ] [MAIN ] Derivative Progress: 956/1690 symbols completed. IONQ took 1.2s. Estimated remaining: 4m 45s. Rate: 154.3 symbols/min [2025-10-09T22:40:16.249578] [DEBUG] [MAIN ] IOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:16.355559] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:16.364871] [INFO ] [MAIN ] IOT: Generated 1807 derivative records from 53862 primary records. [2025-10-09T22:40:16.365923] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-09T22:40:16.386591] [DEBUG] [LOCAL ] IOT: Derivative data saved (1807 records). [2025-10-09T22:40:16.386822] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-09T22:40:16.390012] [INFO ] [MAIN ] Derivative Progress: 957/1690 symbols completed. IOT took 1.2s. Estimated remaining: 4m 45s. Rate: 154.4 symbols/min [2025-10-09T22:40:16.391356] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:16.417461] [DEBUG] [MAIN ] IP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:16.418427] [INFO ] [MAIN ] IP: Generated 1807 derivative records from 53701 primary records. [2025-10-09T22:40:16.418560] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-09T22:40:16.455520] [DEBUG] [LOCAL ] IPI: Loaded 21686 existing records from primary storage. [2025-10-09T22:40:16.458193] [INFO ] [MAIN ] IPI: Loaded 21686 primary data records. [2025-10-09T22:40:16.480242] [DEBUG] [LOCAL ] IP: Derivative data saved (1807 records). [2025-10-09T22:40:16.496502] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-09T22:40:16.526093] [INFO ] [MAIN ] Derivative Progress: 958/1690 symbols completed. IP took 1.0s. Estimated remaining: 4m 44s. Rate: 154.5 symbols/min [2025-10-09T22:40:16.578494] [DEBUG] [LOCAL ] IPG: Loaded 53718 existing records from primary storage. [2025-10-09T22:40:16.578937] [INFO ] [MAIN ] IPG: Loaded 53718 primary data records. [2025-10-09T22:40:17.104141] [DEBUG] [MAIN ] IPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:17.104942] [INFO ] [MAIN ] IPI: Generated 1807 derivative records from 21686 primary records. [2025-10-09T22:40:17.105118] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-09T22:40:17.135054] [DEBUG] [MAIN ] IPG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:40:17.136248] [INFO ] [MAIN ] IPG: Generated 1806 derivative records from 53718 primary records. [2025-10-09T22:40:17.136841] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-09T22:40:17.137908] [DEBUG] [LOCAL ] IPI: Derivative data saved (1807 records). [2025-10-09T22:40:17.138412] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-09T22:40:17.148043] [INFO ] [MAIN ] Derivative Progress: 959/1690 symbols completed. IPI took 0.8s. Estimated remaining: 4m 44s. Rate: 154.4 symbols/min [2025-10-09T22:40:17.156237] [DEBUG] [LOCAL ] IPG: Derivative data saved (1806 records). [2025-10-09T22:40:17.156333] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-09T22:40:17.158542] [INFO ] [MAIN ] Derivative Progress: 960/1690 symbols completed. IPG took 0.8s. Estimated remaining: 4m 43s. Rate: 154.6 symbols/min [2025-10-09T22:40:17.159019] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:17.159087] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:17.159319] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:17.179674] [DEBUG] [LOCAL ] IQI: Loaded 18049 existing records from primary storage. [2025-10-09T22:40:17.179919] [INFO ] [MAIN ] IQI: Loaded 18049 primary data records. [2025-10-09T22:40:17.525625] [DEBUG] [LOCAL ] IQV: Loaded 50443 existing records from primary storage. [2025-10-09T22:40:17.526025] [INFO ] [MAIN ] IQV: Loaded 50443 primary data records. [2025-10-09T22:40:17.613719] [DEBUG] [LOCAL ] IR: Loaded 53136 existing records from primary storage. [2025-10-09T22:40:17.631147] [INFO ] [MAIN ] IR: Loaded 53136 primary data records. [2025-10-09T22:40:18.246831] [DEBUG] [MAIN ] IQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:18.249432] [INFO ] [MAIN ] IQI: Generated 1807 derivative records from 18049 primary records. [2025-10-09T22:40:18.250254] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-09T22:40:18.270685] [DEBUG] [LOCAL ] IQI: Derivative data saved (1807 records). [2025-10-09T22:40:18.271294] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-09T22:40:18.273893] [INFO ] [MAIN ] Derivative Progress: 961/1690 symbols completed. IQI took 1.1s. Estimated remaining: 4m 44s. Rate: 154.3 symbols/min [2025-10-09T22:40:18.274888] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:18.294468] [DEBUG] [MAIN ] IQV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:40:18.295582] [INFO ] [MAIN ] IQV: Generated 1806 derivative records from 50443 primary records. [2025-10-09T22:40:18.295888] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-09T22:40:18.338834] [DEBUG] [LOCAL ] IQV: Derivative data saved (1806 records). [2025-10-09T22:40:18.340364] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-09T22:40:18.343539] [INFO ] [MAIN ] Derivative Progress: 962/1690 symbols completed. IQV took 1.2s. Estimated remaining: 4m 43s. Rate: 154.4 symbols/min [2025-10-09T22:40:18.343908] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:18.340188] [DEBUG] [MAIN ] IR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:18.345777] [INFO ] [MAIN ] IR: Generated 1807 derivative records from 53136 primary records. [2025-10-09T22:40:18.346436] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-09T22:40:18.392521] [DEBUG] [LOCAL ] IR: Derivative data saved (1807 records). [2025-10-09T22:40:18.407137] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-09T22:40:18.412102] [INFO ] [MAIN ] Derivative Progress: 963/1690 symbols completed. IR took 1.3s. Estimated remaining: 4m 42s. Rate: 154.5 symbols/min [2025-10-09T22:40:18.412450] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:18.408190] [DEBUG] [LOCAL ] IRM: Loaded 49607 existing records from primary storage. [2025-10-09T22:40:18.413853] [INFO ] [MAIN ] IRM: Loaded 49607 primary data records. [2025-10-09T22:40:18.467453] [DEBUG] [LOCAL ] IRS: Loaded 22729 existing records from primary storage. [2025-10-09T22:40:18.488473] [INFO ] [MAIN ] IRS: Loaded 22729 primary data records. [2025-10-09T22:40:19.099439] [DEBUG] [LOCAL ] IRT: Loaded 50811 existing records from primary storage. [2025-10-09T22:40:19.099871] [INFO ] [MAIN ] IRT: Loaded 50811 primary data records. [2025-10-09T22:40:19.418397] [DEBUG] [MAIN ] IRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:19.419756] [INFO ] [MAIN ] IRM: Generated 1807 derivative records from 49607 primary records. [2025-10-09T22:40:19.420405] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-09T22:40:19.457772] [DEBUG] [LOCAL ] IRM: Derivative data saved (1807 records). [2025-10-09T22:40:19.458272] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-09T22:40:19.461626] [INFO ] [MAIN ] Derivative Progress: 964/1690 symbols completed. IRM took 1.2s. Estimated remaining: 4m 42s. Rate: 154.3 symbols/min [2025-10-09T22:40:19.461913] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:19.458589] [DEBUG] [MAIN ] IRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:19.463595] [INFO ] [MAIN ] IRS: Generated 1807 derivative records from 22729 primary records. [2025-10-09T22:40:19.464354] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-09T22:40:19.485202] [DEBUG] [LOCAL ] IRS: Derivative data saved (1807 records). [2025-10-09T22:40:19.489854] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-09T22:40:19.500085] [INFO ] [MAIN ] Derivative Progress: 965/1690 symbols completed. IRS took 1.2s. Estimated remaining: 4m 42s. Rate: 154.4 symbols/min [2025-10-09T22:40:19.500340] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:19.505912] [DEBUG] [MAIN ] IRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:19.506779] [INFO ] [MAIN ] IRT: Generated 1807 derivative records from 50811 primary records. [2025-10-09T22:40:19.506910] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-09T22:40:19.522560] [DEBUG] [LOCAL ] ISD: Loaded 15962 existing records from primary storage. [2025-10-09T22:40:19.525604] [INFO ] [MAIN ] ISD: Loaded 15962 primary data records. [2025-10-09T22:40:19.574322] [DEBUG] [LOCAL ] IRT: Derivative data saved (1807 records). [2025-10-09T22:40:19.579595] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-09T22:40:19.600475] [INFO ] [MAIN ] Derivative Progress: 966/1690 symbols completed. IRT took 1.2s. Estimated remaining: 4m 41s. Rate: 154.5 symbols/min [2025-10-09T22:40:19.618686] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:19.879166] [DEBUG] [LOCAL ] IT: Loaded 42507 existing records from primary storage. [2025-10-09T22:40:19.879536] [INFO ] [MAIN ] IT: Loaded 42507 primary data records. [2025-10-09T22:40:19.970451] [DEBUG] [LOCAL ] ITGR: Loaded 31372 existing records from primary storage. [2025-10-09T22:40:19.987040] [INFO ] [MAIN ] ITGR: Loaded 31372 primary data records. [2025-10-09T22:40:20.447557] [DEBUG] [MAIN ] ISD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:20.563437] [INFO ] [MAIN ] ISD: Generated 1807 derivative records from 15962 primary records. [2025-10-09T22:40:20.564160] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-09T22:40:20.588125] [DEBUG] [LOCAL ] ISD: Derivative data saved (1807 records). [2025-10-09T22:40:20.588525] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-09T22:40:20.590548] [INFO ] [MAIN ] Derivative Progress: 967/1690 symbols completed. ISD took 1.1s. Estimated remaining: 4m 41s. Rate: 154.3 symbols/min [2025-10-09T22:40:20.590988] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:20.607945] [DEBUG] [MAIN ] IT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:40:20.608838] [INFO ] [MAIN ] IT: Generated 1806 derivative records from 42507 primary records. [2025-10-09T22:40:20.609101] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-09T22:40:20.627678] [DEBUG] [LOCAL ] IT: Derivative data saved (1806 records). [2025-10-09T22:40:20.628362] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-09T22:40:20.631615] [INFO ] [MAIN ] Derivative Progress: 968/1690 symbols completed. IT took 1.1s. Estimated remaining: 4m 41s. Rate: 154.4 symbols/min [2025-10-09T22:40:20.632098] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:20.645569] [DEBUG] [MAIN ] ITGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:20.646431] [INFO ] [MAIN ] ITGR: Generated 1807 derivative records from 31372 primary records. [2025-10-09T22:40:20.646770] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-09T22:40:20.682087] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1807 records). [2025-10-09T22:40:20.682260] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-09T22:40:20.681992] [DEBUG] [LOCAL ] ITT: Loaded 32802 existing records from primary storage. [2025-10-09T22:40:20.686348] [INFO ] [MAIN ] ITT: Loaded 32802 primary data records. [2025-10-09T22:40:20.686271] [INFO ] [MAIN ] Derivative Progress: 969/1690 symbols completed. ITGR took 1.1s. Estimated remaining: 4m 40s. Rate: 154.6 symbols/min [2025-10-09T22:40:20.686762] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:21.013954] [DEBUG] [LOCAL ] ITUB: Loaded 53698 existing records from primary storage. [2025-10-09T22:40:21.025295] [INFO ] [MAIN ] ITUB: Loaded 53698 primary data records. [2025-10-09T22:40:21.166401] [DEBUG] [LOCAL ] ITW: Loaded 46099 existing records from primary storage. [2025-10-09T22:40:21.177150] [INFO ] [MAIN ] ITW: Loaded 46099 primary data records. [2025-10-09T22:40:21.698620] [DEBUG] [MAIN ] ITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:21.703907] [INFO ] [MAIN ] ITT: Generated 1807 derivative records from 32802 primary records. [2025-10-09T22:40:21.704281] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-09T22:40:21.718706] [DEBUG] [MAIN ] ITUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:21.720004] [INFO ] [MAIN ] ITUB: Generated 1807 derivative records from 53698 primary records. [2025-10-09T22:40:21.720122] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-09T22:40:21.752815] [DEBUG] [LOCAL ] ITT: Derivative data saved (1807 records). [2025-10-09T22:40:21.754258] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1807 records). [2025-10-09T22:40:21.754953] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-09T22:40:21.754725] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-09T22:40:21.757057] [INFO ] [MAIN ] Derivative Progress: 970/1690 symbols completed. ITT took 1.2s. Estimated remaining: 4m 40s. Rate: 154.3 symbols/min [2025-10-09T22:40:21.757461] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:21.760981] [INFO ] [MAIN ] Derivative Progress: 971/1690 symbols completed. ITUB took 1.1s. Estimated remaining: 4m 39s. Rate: 154.4 symbols/min [2025-10-09T22:40:21.761347] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:21.781766] [DEBUG] [MAIN ] ITW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:21.782683] [INFO ] [MAIN ] ITW: Generated 1807 derivative records from 46099 primary records. [2025-10-09T22:40:21.782875] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-09T22:40:21.810471] [DEBUG] [LOCAL ] ITW: Derivative data saved (1807 records). [2025-10-09T22:40:21.810713] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-09T22:40:21.813556] [INFO ] [MAIN ] Derivative Progress: 972/1690 symbols completed. ITW took 1.1s. Estimated remaining: 4m 39s. Rate: 154.6 symbols/min [2025-10-09T22:40:21.813809] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:21.825593] [DEBUG] [LOCAL ] IVT: Loaded 31295 existing records from primary storage. [2025-10-09T22:40:21.836845] [INFO ] [MAIN ] IVT: Loaded 31295 primary data records. [2025-10-09T22:40:21.973061] [DEBUG] [LOCAL ] IVR: Loaded 48445 existing records from primary storage. [2025-10-09T22:40:21.989574] [INFO ] [MAIN ] IVR: Loaded 48445 primary data records. [2025-10-09T22:40:22.370712] [DEBUG] [LOCAL ] IVZ: Loaded 53491 existing records from primary storage. [2025-10-09T22:40:22.387519] [INFO ] [MAIN ] IVZ: Loaded 53491 primary data records. [2025-10-09T22:40:22.869463] [DEBUG] [MAIN ] IVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:22.870861] [INFO ] [MAIN ] IVT: Generated 1807 derivative records from 31295 primary records. [2025-10-09T22:40:22.871139] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-09T22:40:22.890756] [DEBUG] [LOCAL ] IVT: Derivative data saved (1807 records). [2025-10-09T22:40:22.890883] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-09T22:40:22.893137] [INFO ] [MAIN ] Derivative Progress: 973/1690 symbols completed. IVT took 1.1s. Estimated remaining: 4m 39s. Rate: 154.3 symbols/min [2025-10-09T22:40:22.910069] [DEBUG] [MAIN ] IVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:22.910846] [INFO ] [MAIN ] IVR: Generated 1807 derivative records from 48445 primary records. [2025-10-09T22:40:22.911023] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-09T22:40:22.944963] [DEBUG] [LOCAL ] IVR: Derivative data saved (1807 records). [2025-10-09T22:40:22.945678] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-09T22:40:22.945562] [DEBUG] [MAIN ] IVZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:22.949853] [INFO ] [MAIN ] Derivative Progress: 974/1690 symbols completed. IVR took 1.2s. Estimated remaining: 4m 38s. Rate: 154.4 symbols/min [2025-10-09T22:40:22.950755] [INFO ] [MAIN ] IVZ: Generated 1807 derivative records from 53491 primary records. [2025-10-09T22:40:22.950975] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-09T22:40:22.967338] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1807 records). [2025-10-09T22:40:22.967518] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-09T22:40:22.970513] [INFO ] [MAIN ] Derivative Progress: 975/1690 symbols completed. IVZ took 1.2s. Estimated remaining: 4m 38s. Rate: 154.6 symbols/min [2025-10-09T22:40:22.971016] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:22.971291] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:22.971226] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:22.996308] [DEBUG] [LOCAL ] IX: Loaded 22441 existing records from primary storage. [2025-10-09T22:40:22.996477] [INFO ] [MAIN ] IX: Loaded 22441 primary data records. [2025-10-09T22:40:23.223036] [DEBUG] [LOCAL ] JBGS: Loaded 42466 existing records from primary storage. [2025-10-09T22:40:23.227931] [DEBUG] [LOCAL ] J: Loaded 40500 existing records from primary storage. [2025-10-09T22:40:23.228251] [INFO ] [MAIN ] JBGS: Loaded 42466 primary data records. [2025-10-09T22:40:23.328247] [INFO ] [MAIN ] J: Loaded 40500 primary data records. [2025-10-09T22:40:24.040114] [DEBUG] [MAIN ] IX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:24.041031] [INFO ] [MAIN ] IX: Generated 1807 derivative records from 22441 primary records. [2025-10-09T22:40:24.041511] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-09T22:40:24.059490] [DEBUG] [LOCAL ] IX: Derivative data saved (1807 records). [2025-10-09T22:40:24.059842] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-09T22:40:24.062063] [INFO ] [MAIN ] Derivative Progress: 976/1690 symbols completed. IX took 1.1s. Estimated remaining: 4m 38s. Rate: 154.3 symbols/min [2025-10-09T22:40:24.062230] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:24.093135] [DEBUG] [MAIN ] J: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:24.092892] [DEBUG] [MAIN ] JBGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:24.093920] [INFO ] [MAIN ] J: Generated 1807 derivative records from 40500 primary records. [2025-10-09T22:40:24.094499] [INFO ] [MAIN ] JBGS: Generated 1807 derivative records from 42466 primary records. [2025-10-09T22:40:24.094658] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-09T22:40:24.094740] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-09T22:40:24.125888] [DEBUG] [LOCAL ] J: Derivative data saved (1807 records). [2025-10-09T22:40:24.127076] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-09T22:40:24.130044] [INFO ] [MAIN ] Derivative Progress: 977/1690 symbols completed. J took 1.2s. Estimated remaining: 4m 37s. Rate: 154.4 symbols/min [2025-10-09T22:40:24.127157] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1807 records). [2025-10-09T22:40:24.130377] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:24.130280] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-09T22:40:24.133407] [INFO ] [MAIN ] Derivative Progress: 978/1690 symbols completed. JBGS took 1.2s. Estimated remaining: 4m 36s. Rate: 154.6 symbols/min [2025-10-09T22:40:24.133568] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:24.171625] [DEBUG] [LOCAL ] JBI: Loaded 43587 existing records from primary storage. [2025-10-09T22:40:24.171873] [INFO ] [MAIN ] JBI: Loaded 43587 primary data records. [2025-10-09T22:40:24.248858] [DEBUG] [LOCAL ] JBND: Loaded 26753 existing records from primary storage. [2025-10-09T22:40:24.270134] [INFO ] [MAIN ] JBND: Loaded 26753 primary data records. [2025-10-09T22:40:24.619060] [DEBUG] [LOCAL ] JBL: Loaded 48733 existing records from primary storage. [2025-10-09T22:40:24.625017] [INFO ] [MAIN ] JBL: Loaded 48733 primary data records. [2025-10-09T22:40:25.185931] [DEBUG] [MAIN ] JBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:25.187637] [INFO ] [MAIN ] JBI: Generated 1807 derivative records from 43587 primary records. [2025-10-09T22:40:25.188206] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-09T22:40:25.224085] [DEBUG] [MAIN ] JBND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:25.225121] [INFO ] [MAIN ] JBND: Generated 1807 derivative records from 26753 primary records. [2025-10-09T22:40:25.225337] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-09T22:40:25.223575] [DEBUG] [LOCAL ] JBI: Derivative data saved (1807 records). [2025-10-09T22:40:25.226688] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-09T22:40:25.229704] [INFO ] [MAIN ] Derivative Progress: 979/1690 symbols completed. JBI took 1.2s. Estimated remaining: 4m 36s. Rate: 154.3 symbols/min [2025-10-09T22:40:25.237850] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:25.254145] [DEBUG] [LOCAL ] JBND: Derivative data saved (1807 records). [2025-10-09T22:40:25.262032] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-09T22:40:25.269205] [INFO ] [MAIN ] Derivative Progress: 980/1690 symbols completed. JBND took 1.1s. Estimated remaining: 4m 36s. Rate: 154.4 symbols/min [2025-10-09T22:40:25.274008] [DEBUG] [LOCAL ] JCE: Loaded 7225 existing records from primary storage. [2025-10-09T22:40:25.274497] [INFO ] [MAIN ] JCE: Loaded 7225 primary data records. [2025-10-09T22:40:25.274688] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:25.274342] [DEBUG] [MAIN ] JBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:25.281142] [INFO ] [MAIN ] JBL: Generated 1807 derivative records from 48733 primary records. [2025-10-09T22:40:25.289143] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-09T22:40:25.421587] [DEBUG] [LOCAL ] JBL: Derivative data saved (1807 records). [2025-10-09T22:40:25.432905] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-09T22:40:25.447406] [INFO ] [MAIN ] Derivative Progress: 981/1690 symbols completed. JBL took 1.3s. Estimated remaining: 4m 35s. Rate: 154.5 symbols/min [2025-10-09T22:40:25.452867] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:25.690370] [DEBUG] [LOCAL ] JCI: Loaded 53928 existing records from primary storage. [2025-10-09T22:40:25.691072] [INFO ] [MAIN ] JCI: Loaded 53928 primary data records. [2025-10-09T22:40:26.073873] [DEBUG] [LOCAL ] JEF: Loaded 50519 existing records from primary storage. [2025-10-09T22:40:26.074171] [INFO ] [MAIN ] JEF: Loaded 50519 primary data records. [2025-10-09T22:40:26.193172] [DEBUG] [MAIN ] JCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:26.204923] [INFO ] [MAIN ] JCE: Generated 1807 derivative records from 7225 primary records. [2025-10-09T22:40:26.210247] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-09T22:40:26.400662] [DEBUG] [LOCAL ] JCE: Derivative data saved (1807 records). [2025-10-09T22:40:26.410864] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-09T22:40:26.413441] [INFO ] [MAIN ] Derivative Progress: 982/1690 symbols completed. JCE took 1.2s. Estimated remaining: 4m 35s. Rate: 154.3 symbols/min [2025-10-09T22:40:26.418852] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:26.433344] [DEBUG] [MAIN ] JCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:26.434541] [INFO ] [MAIN ] JCI: Generated 1807 derivative records from 53928 primary records. [2025-10-09T22:40:26.434773] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-09T22:40:26.454519] [DEBUG] [LOCAL ] JCI: Derivative data saved (1807 records). [2025-10-09T22:40:26.454819] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-09T22:40:26.457605] [INFO ] [MAIN ] Derivative Progress: 983/1690 symbols completed. JCI took 1.2s. Estimated remaining: 4m 35s. Rate: 154.4 symbols/min [2025-10-09T22:40:26.457927] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:26.493846] [DEBUG] [LOCAL ] JEQ: Loaded 8743 existing records from primary storage. [2025-10-09T22:40:26.494459] [INFO ] [MAIN ] JEQ: Loaded 8743 primary data records. [2025-10-09T22:40:26.494390] [DEBUG] [MAIN ] JEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:26.495225] [INFO ] [MAIN ] JEF: Generated 1807 derivative records from 50519 primary records. [2025-10-09T22:40:26.495337] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-09T22:40:26.628287] [DEBUG] [LOCAL ] JELD: Loaded 46434 existing records from primary storage. [2025-10-09T22:40:26.634044] [INFO ] [MAIN ] JELD: Loaded 46434 primary data records. [2025-10-09T22:40:26.950084] [DEBUG] [LOCAL ] JEF: Derivative data saved (1807 records). [2025-10-09T22:40:26.956150] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-09T22:40:26.982225] [INFO ] [MAIN ] Derivative Progress: 984/1690 symbols completed. JEF took 1.5s. Estimated remaining: 4m 34s. Rate: 154.4 symbols/min [2025-10-09T22:40:27.024340] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:27.300920] [DEBUG] [MAIN ] JEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:27.302736] [INFO ] [MAIN ] JEQ: Generated 1807 derivative records from 8743 primary records. [2025-10-09T22:40:27.307082] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-10-09T22:40:27.306470] [DEBUG] [LOCAL ] JFR: Loaded 31188 existing records from primary storage. [2025-10-09T22:40:27.307279] [INFO ] [MAIN ] JFR: Loaded 31188 primary data records. [2025-10-09T22:40:27.375169] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1807 records). [2025-10-09T22:40:27.376077] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-10-09T22:40:27.379978] [INFO ] [MAIN ] Derivative Progress: 985/1690 symbols completed. JEQ took 0.9s. Estimated remaining: 4m 34s. Rate: 154.4 symbols/min [2025-10-09T22:40:27.398069] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:27.452034] [DEBUG] [MAIN ] JELD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:27.480978] [INFO ] [MAIN ] JELD: Generated 1807 derivative records from 46434 primary records. [2025-10-09T22:40:27.486592] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-09T22:40:27.554045] [DEBUG] [LOCAL ] JELD: Derivative data saved (1807 records). [2025-10-09T22:40:27.554292] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-09T22:40:27.559618] [INFO ] [MAIN ] Derivative Progress: 986/1690 symbols completed. JELD took 1.1s. Estimated remaining: 4m 33s. Rate: 154.5 symbols/min [2025-10-09T22:40:27.591981] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:27.594469] [DEBUG] [LOCAL ] JGH: Loaded 11697 existing records from primary storage. [2025-10-09T22:40:27.604730] [INFO ] [MAIN ] JGH: Loaded 11697 primary data records. [2025-10-09T22:40:28.188691] [DEBUG] [LOCAL ] JHG: Loaded 47922 existing records from primary storage. [2025-10-09T22:40:28.321032] [INFO ] [MAIN ] JHG: Loaded 47922 primary data records. [2025-10-09T22:40:28.714608] [DEBUG] [MAIN ] JFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:28.719131] [INFO ] [MAIN ] JFR: Generated 1807 derivative records from 31188 primary records. [2025-10-09T22:40:28.719414] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-09T22:40:28.735449] [DEBUG] [MAIN ] JGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:28.744914] [INFO ] [MAIN ] JGH: Generated 1807 derivative records from 11697 primary records. [2025-10-09T22:40:28.748025] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-09T22:40:28.764896] [DEBUG] [LOCAL ] JFR: Derivative data saved (1807 records). [2025-10-09T22:40:28.767984] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-09T22:40:28.768530] [DEBUG] [LOCAL ] JGH: Derivative data saved (1807 records). [2025-10-09T22:40:28.768625] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-09T22:40:28.772475] [INFO ] [MAIN ] Derivative Progress: 987/1690 symbols completed. JGH took 1.4s. Estimated remaining: 4m 34s. Rate: 154.1 symbols/min [2025-10-09T22:40:28.774834] [INFO ] [MAIN ] Derivative Progress: 988/1690 symbols completed. JFR took 1.8s. Estimated remaining: 4m 33s. Rate: 154.3 symbols/min [2025-10-09T22:40:28.774769] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:28.782320] [DEBUG] [LOCAL ] JHI: Loaded 3850 existing records from primary storage. [2025-10-09T22:40:28.782676] [INFO ] [MAIN ] JHI: Loaded 3850 primary data records. [2025-10-09T22:40:28.914293] [DEBUG] [MAIN ] JHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:28.944128] [INFO ] [MAIN ] JHG: Generated 1807 derivative records from 47922 primary records. [2025-10-09T22:40:28.953397] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-09T22:40:29.121345] [DEBUG] [LOCAL ] JHG: Derivative data saved (1807 records). [2025-10-09T22:40:29.121489] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-09T22:40:29.124671] [INFO ] [MAIN ] Derivative Progress: 989/1690 symbols completed. JHG took 1.5s. Estimated remaining: 4m 33s. Rate: 154.3 symbols/min [2025-10-09T22:40:29.147468] [DEBUG] [MAIN ] JHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:29.148170] [INFO ] [MAIN ] JHI: Generated 1807 derivative records from 3850 primary records. [2025-10-09T22:40:29.148234] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-09T22:40:29.163002] [DEBUG] [LOCAL ] JHI: Derivative data saved (1807 records). [2025-10-09T22:40:29.163086] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-09T22:40:29.165242] [INFO ] [MAIN ] Derivative Progress: 990/1690 symbols completed. JHI took 0.4s. Estimated remaining: 4m 32s. Rate: 154.4 symbols/min [2025-10-09T22:40:29.165838] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:29.165761] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:29.165928] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:29.172579] [DEBUG] [LOCAL ] JHS: Loaded 2942 existing records from primary storage. [2025-10-09T22:40:29.172899] [INFO ] [MAIN ] JHS: Loaded 2942 primary data records. [2025-10-09T22:40:29.288204] [DEBUG] [LOCAL ] JILL: Loaded 16360 existing records from primary storage. [2025-10-09T22:40:29.288426] [INFO ] [MAIN ] JILL: Loaded 16360 primary data records. [2025-10-09T22:40:29.750269] [DEBUG] [LOCAL ] JHX: Loaded 53541 existing records from primary storage. [2025-10-09T22:40:29.864296] [INFO ] [MAIN ] JHX: Loaded 53541 primary data records. [2025-10-09T22:40:30.212683] [DEBUG] [MAIN ] JHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:30.216397] [INFO ] [MAIN ] JHS: Generated 1807 derivative records from 2942 primary records. [2025-10-09T22:40:30.216506] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-09T22:40:30.247127] [DEBUG] [LOCAL ] JHS: Derivative data saved (1807 records). [2025-10-09T22:40:30.247445] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-09T22:40:30.250237] [INFO ] [MAIN ] Derivative Progress: 991/1690 symbols completed. JHS took 1.1s. Estimated remaining: 4m 32s. Rate: 154.2 symbols/min [2025-10-09T22:40:30.247026] [DEBUG] [MAIN ] JILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:30.251571] [INFO ] [MAIN ] JILL: Generated 1807 derivative records from 16360 primary records. [2025-10-09T22:40:30.250689] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:30.251817] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-09T22:40:30.269831] [DEBUG] [LOCAL ] JILL: Derivative data saved (1807 records). [2025-10-09T22:40:30.270189] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-09T22:40:30.273470] [INFO ] [MAIN ] Derivative Progress: 992/1690 symbols completed. JILL took 1.1s. Estimated remaining: 4m 31s. Rate: 154.3 symbols/min [2025-10-09T22:40:30.273755] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:30.291369] [DEBUG] [MAIN ] JHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:30.292208] [INFO ] [MAIN ] JHX: Generated 1807 derivative records from 53541 primary records. [2025-10-09T22:40:30.292271] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-09T22:40:30.309941] [DEBUG] [LOCAL ] JHX: Derivative data saved (1807 records). [2025-10-09T22:40:30.310184] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-09T22:40:30.312998] [INFO ] [MAIN ] Derivative Progress: 993/1690 symbols completed. JHX took 1.1s. Estimated remaining: 4m 31s. Rate: 154.4 symbols/min [2025-10-09T22:40:30.329777] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:30.336003] [DEBUG] [LOCAL ] JLS: Loaded 4181 existing records from primary storage. [2025-10-09T22:40:30.336177] [INFO ] [MAIN ] JLS: Loaded 4181 primary data records. [2025-10-09T22:40:30.381559] [DEBUG] [LOCAL ] JLL: Loaded 31654 existing records from primary storage. [2025-10-09T22:40:30.417932] [INFO ] [MAIN ] JLL: Loaded 31654 primary data records. [2025-10-09T22:40:30.450947] [DEBUG] [LOCAL ] JKS: Loaded 40155 existing records from primary storage. [2025-10-09T22:40:30.456362] [INFO ] [MAIN ] JKS: Loaded 40155 primary data records. [2025-10-09T22:40:31.395117] [DEBUG] [MAIN ] JLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:31.396006] [INFO ] [MAIN ] JLS: Generated 1807 derivative records from 4181 primary records. [2025-10-09T22:40:31.396180] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-09T22:40:31.412331] [DEBUG] [LOCAL ] JLS: Derivative data saved (1807 records). [2025-10-09T22:40:31.412667] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-09T22:40:31.414878] [INFO ] [MAIN ] Derivative Progress: 994/1690 symbols completed. JLS took 1.1s. Estimated remaining: 4m 31s. Rate: 154.2 symbols/min [2025-10-09T22:40:31.415032] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:31.445878] [DEBUG] [MAIN ] JLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:31.446189] [DEBUG] [MAIN ] JKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:31.447586] [INFO ] [MAIN ] JLL: Generated 1807 derivative records from 31654 primary records. [2025-10-09T22:40:31.446972] [INFO ] [MAIN ] JKS: Generated 1807 derivative records from 40155 primary records. [2025-10-09T22:40:31.447795] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-09T22:40:31.447851] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-09T22:40:31.477797] [DEBUG] [LOCAL ] JKS: Derivative data saved (1807 records). [2025-10-09T22:40:31.478545] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-09T22:40:31.494809] [INFO ] [MAIN ] Derivative Progress: 995/1690 symbols completed. JKS took 1.2s. Estimated remaining: 4m 30s. Rate: 154.3 symbols/min [2025-10-09T22:40:31.496006] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:31.497111] [DEBUG] [LOCAL ] JLL: Derivative data saved (1807 records). [2025-10-09T22:40:31.497181] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-09T22:40:31.500287] [INFO ] [MAIN ] Derivative Progress: 996/1690 symbols completed. JLL took 1.2s. Estimated remaining: 4m 30s. Rate: 154.4 symbols/min [2025-10-09T22:40:31.500585] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:31.518414] [DEBUG] [LOCAL ] JMIA: Loaded 51233 existing records from primary storage. [2025-10-09T22:40:31.518604] [INFO ] [MAIN ] JMIA: Loaded 51233 primary data records. [2025-10-09T22:40:31.886038] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-09T22:40:31.886257] [INFO ] [MAIN ] JNJ: Loaded 54143 primary data records. [2025-10-09T22:40:31.887614] [DEBUG] [LOCAL ] JOBY: Loaded 54191 existing records from primary storage. [2025-10-09T22:40:31.910425] [INFO ] [MAIN ] JOBY: Loaded 54191 primary data records. [2025-10-09T22:40:32.578743] [DEBUG] [MAIN ] JMIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:32.580288] [INFO ] [MAIN ] JMIA: Generated 1807 derivative records from 51233 primary records. [2025-10-09T22:40:32.581738] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-09T22:40:32.600250] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1807 records). [2025-10-09T22:40:32.601010] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-09T22:40:32.604119] [INFO ] [MAIN ] Derivative Progress: 997/1690 symbols completed. JMIA took 1.2s. Estimated remaining: 4m 30s. Rate: 154.2 symbols/min [2025-10-09T22:40:32.604704] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:32.624074] [DEBUG] [MAIN ] JNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:32.624840] [INFO ] [MAIN ] JNJ: Generated 1807 derivative records from 54143 primary records. [2025-10-09T22:40:32.625034] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-09T22:40:32.650976] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1807 records). [2025-10-09T22:40:32.671934] [DEBUG] [LOCAL ] JOE: Loaded 24061 existing records from primary storage. [2025-10-09T22:40:32.672276] [DEBUG] [MAIN ] JOBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:32.658569] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-09T22:40:32.674980] [INFO ] [MAIN ] Derivative Progress: 998/1690 symbols completed. JNJ took 1.2s. Estimated remaining: 4m 29s. Rate: 154.3 symbols/min [2025-10-09T22:40:32.675114] [INFO ] [MAIN ] JOE: Loaded 24061 primary data records. [2025-10-09T22:40:32.675256] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:32.681502] [INFO ] [MAIN ] JOBY: Generated 1807 derivative records from 54191 primary records. [2025-10-09T22:40:32.681913] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-09T22:40:32.822081] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1807 records). [2025-10-09T22:40:32.821985] [DEBUG] [LOCAL ] JOF: Loaded 6915 existing records from primary storage. [2025-10-09T22:40:32.830196] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-09T22:40:32.833755] [INFO ] [MAIN ] Derivative Progress: 999/1690 symbols completed. JOBY took 1.3s. Estimated remaining: 4m 29s. Rate: 154.4 symbols/min [2025-10-09T22:40:32.837244] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:32.837531] [INFO ] [MAIN ] JOF: Loaded 6915 primary data records. [2025-10-09T22:40:33.394742] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-09T22:40:33.395201] [INFO ] [MAIN ] JPM: Loaded 54184 primary data records. [2025-10-09T22:40:33.393528] [DEBUG] [MAIN ] JOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:33.396050] [INFO ] [MAIN ] JOE: Generated 1807 derivative records from 24061 primary records. [2025-10-09T22:40:33.396230] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-09T22:40:33.519906] [DEBUG] [LOCAL ] JOE: Derivative data saved (1807 records). [2025-10-09T22:40:33.532359] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-09T22:40:33.545248] [INFO ] [MAIN ] Derivative Progress: 1000/1690 symbols completed. JOE took 0.9s. Estimated remaining: 4m 28s. Rate: 154.2 symbols/min [2025-10-09T22:40:33.545450] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:33.700014] [DEBUG] [MAIN ] JOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:33.728820] [INFO ] [MAIN ] JOF: Generated 1807 derivative records from 6915 primary records. [2025-10-09T22:40:33.729084] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-09T22:40:33.746111] [DEBUG] [LOCAL ] JOF: Derivative data saved (1807 records). [2025-10-09T22:40:33.746523] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-09T22:40:33.749254] [INFO ] [MAIN ] Derivative Progress: 1001/1690 symbols completed. JOF took 1.1s. Estimated remaining: 4m 28s. Rate: 154.3 symbols/min [2025-10-09T22:40:33.750175] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:33.794971] [DEBUG] [MAIN ] JPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:33.794496] [DEBUG] [LOCAL ] JRI: Loaded 15351 existing records from primary storage. [2025-10-09T22:40:33.796171] [INFO ] [MAIN ] JPM: Generated 1807 derivative records from 54184 primary records. [2025-10-09T22:40:33.806267] [INFO ] [MAIN ] JRI: Loaded 15351 primary data records. [2025-10-09T22:40:33.806572] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-09T22:40:33.836683] [DEBUG] [LOCAL ] JQC: Loaded 34386 existing records from primary storage. [2025-10-09T22:40:33.871026] [INFO ] [MAIN ] JQC: Loaded 34386 primary data records. [2025-10-09T22:40:34.263722] [DEBUG] [LOCAL ] JPM: Derivative data saved (1807 records). [2025-10-09T22:40:34.282877] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-09T22:40:34.290573] [INFO ] [MAIN ] Derivative Progress: 1002/1690 symbols completed. JPM took 1.5s. Estimated remaining: 4m 28s. Rate: 154.3 symbols/min [2025-10-09T22:40:34.323612] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:34.463780] [DEBUG] [LOCAL ] JRS: Loaded 11656 existing records from primary storage. [2025-10-09T22:40:34.464089] [INFO ] [MAIN ] JRS: Loaded 11656 primary data records. [2025-10-09T22:40:34.594546] [DEBUG] [MAIN ] JRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:34.606746] [INFO ] [MAIN ] JRI: Generated 1807 derivative records from 15351 primary records. [2025-10-09T22:40:34.655434] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-09T22:40:34.876978] [DEBUG] [MAIN ] JQC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:34.877531] [DEBUG] [LOCAL ] JRI: Derivative data saved (1807 records). [2025-10-09T22:40:34.878978] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-09T22:40:34.881345] [INFO ] [MAIN ] Derivative Progress: 1003/1690 symbols completed. JRI took 1.1s. Estimated remaining: 4m 27s. Rate: 154.2 symbols/min [2025-10-09T22:40:34.878811] [INFO ] [MAIN ] JQC: Generated 1807 derivative records from 34386 primary records. [2025-10-09T22:40:34.882242] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-09T22:40:34.900405] [DEBUG] [LOCAL ] JQC: Derivative data saved (1807 records). [2025-10-09T22:40:34.900728] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-09T22:40:34.902799] [INFO ] [MAIN ] Derivative Progress: 1004/1690 symbols completed. JQC took 1.4s. Estimated remaining: 4m 27s. Rate: 154.3 symbols/min [2025-10-09T22:40:34.920683] [DEBUG] [MAIN ] JRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:34.921437] [INFO ] [MAIN ] JRS: Generated 1807 derivative records from 11656 primary records. [2025-10-09T22:40:34.921499] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-09T22:40:34.937166] [DEBUG] [LOCAL ] JRS: Derivative data saved (1807 records). [2025-10-09T22:40:34.937299] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-09T22:40:34.941027] [INFO ] [MAIN ] Derivative Progress: 1005/1690 symbols completed. JRS took 0.6s. Estimated remaining: 4m 26s. Rate: 154.5 symbols/min [2025-10-09T22:40:34.941788] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:34.941927] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:34.942250] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:34.958340] [DEBUG] [LOCAL ] KAI: Loaded 13436 existing records from primary storage. [2025-10-09T22:40:34.959102] [INFO ] [MAIN ] KAI: Loaded 13436 primary data records. [2025-10-09T22:40:35.151687] [DEBUG] [LOCAL ] JXN: Loaded 45365 existing records from primary storage. [2025-10-09T22:40:35.197759] [INFO ] [MAIN ] JXN: Loaded 45365 primary data records. [2025-10-09T22:40:35.217776] [DEBUG] [LOCAL ] K: Loaded 50465 existing records from primary storage. [2025-10-09T22:40:35.288946] [INFO ] [MAIN ] K: Loaded 50465 primary data records. [2025-10-09T22:40:36.039088] [DEBUG] [MAIN ] KAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:36.040770] [INFO ] [MAIN ] KAI: Generated 1807 derivative records from 13436 primary records. [2025-10-09T22:40:36.041159] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-09T22:40:36.061886] [DEBUG] [LOCAL ] KAI: Derivative data saved (1807 records). [2025-10-09T22:40:36.062046] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-09T22:40:36.064299] [INFO ] [MAIN ] Derivative Progress: 1006/1690 symbols completed. KAI took 1.1s. Estimated remaining: 4m 26s. Rate: 154.2 symbols/min [2025-10-09T22:40:36.066226] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:36.083377] [DEBUG] [MAIN ] JXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:36.084310] [INFO ] [MAIN ] JXN: Generated 1807 derivative records from 45365 primary records. [2025-10-09T22:40:36.084608] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-09T22:40:36.104785] [DEBUG] [LOCAL ] JXN: Derivative data saved (1807 records). [2025-10-09T22:40:36.105169] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-09T22:40:36.120837] [INFO ] [MAIN ] Derivative Progress: 1007/1690 symbols completed. JXN took 1.2s. Estimated remaining: 4m 26s. Rate: 154.3 symbols/min [2025-10-09T22:40:36.121306] [DEBUG] [MAIN ] K: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:36.121600] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:36.122369] [INFO ] [MAIN ] K: Generated 1807 derivative records from 50465 primary records. [2025-10-09T22:40:36.122727] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-09T22:40:36.154196] [DEBUG] [LOCAL ] K: Derivative data saved (1807 records). [2025-10-09T22:40:36.154519] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-09T22:40:36.181425] [INFO ] [MAIN ] Derivative Progress: 1008/1690 symbols completed. K took 1.2s. Estimated remaining: 4m 25s. Rate: 154.4 symbols/min [2025-10-09T22:40:36.183736] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:36.185218] [DEBUG] [LOCAL ] KAR: Loaded 40359 existing records from primary storage. [2025-10-09T22:40:36.185698] [INFO ] [MAIN ] KAR: Loaded 40359 primary data records. [2025-10-09T22:40:36.240719] [DEBUG] [LOCAL ] KB: Loaded 23768 existing records from primary storage. [2025-10-09T22:40:36.261343] [INFO ] [MAIN ] KB: Loaded 23768 primary data records. [2025-10-09T22:40:36.425639] [DEBUG] [LOCAL ] KBDC: Loaded 21910 existing records from primary storage. [2025-10-09T22:40:36.486691] [INFO ] [MAIN ] KBDC: Loaded 21910 primary data records. [2025-10-09T22:40:37.228194] [DEBUG] [MAIN ] KAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:37.230382] [INFO ] [MAIN ] KAR: Generated 1807 derivative records from 40359 primary records. [2025-10-09T22:40:37.230722] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-09T22:40:37.258523] [DEBUG] [LOCAL ] KAR: Derivative data saved (1807 records). [2025-10-09T22:40:37.273498] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-09T22:40:37.277674] [INFO ] [MAIN ] Derivative Progress: 1009/1690 symbols completed. KAR took 1.2s. Estimated remaining: 4m 25s. Rate: 154.2 symbols/min [2025-10-09T22:40:37.274487] [DEBUG] [MAIN ] KB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:37.278164] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:37.279600] [INFO ] [MAIN ] KB: Generated 1807 derivative records from 23768 primary records. [2025-10-09T22:40:37.279754] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-09T22:40:37.299974] [DEBUG] [LOCAL ] KB: Derivative data saved (1807 records). [2025-10-09T22:40:37.300105] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-09T22:40:37.302792] [INFO ] [MAIN ] Derivative Progress: 1010/1690 symbols completed. KB took 1.2s. Estimated remaining: 4m 24s. Rate: 154.3 symbols/min [2025-10-09T22:40:37.305052] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:37.319016] [DEBUG] [MAIN ] KBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:37.319898] [INFO ] [MAIN ] KBDC: Generated 1807 derivative records from 21910 primary records. [2025-10-09T22:40:37.320236] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-09T22:40:37.337249] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1807 records). [2025-10-09T22:40:37.337358] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-09T22:40:37.340381] [INFO ] [MAIN ] Derivative Progress: 1011/1690 symbols completed. KBDC took 1.2s. Estimated remaining: 4m 24s. Rate: 154.4 symbols/min [2025-10-09T22:40:37.340568] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:37.395349] [DEBUG] [LOCAL ] KBH: Loaded 49233 existing records from primary storage. [2025-10-09T22:40:37.396132] [INFO ] [MAIN ] KBH: Loaded 49233 primary data records. [2025-10-09T22:40:37.463874] [DEBUG] [LOCAL ] KBR: Loaded 48203 existing records from primary storage. [2025-10-09T22:40:37.508547] [INFO ] [MAIN ] KBR: Loaded 48203 primary data records. [2025-10-09T22:40:37.687904] [DEBUG] [LOCAL ] KD: Loaded 52707 existing records from primary storage. [2025-10-09T22:40:37.730867] [INFO ] [MAIN ] KD: Loaded 52707 primary data records. [2025-10-09T22:40:38.396054] [DEBUG] [MAIN ] KBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:38.397472] [INFO ] [MAIN ] KBH: Generated 1807 derivative records from 49233 primary records. [2025-10-09T22:40:38.397874] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-09T22:40:38.419178] [DEBUG] [LOCAL ] KBH: Derivative data saved (1807 records). [2025-10-09T22:40:38.419502] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-09T22:40:38.421672] [INFO ] [MAIN ] Derivative Progress: 1012/1690 symbols completed. KBH took 1.1s. Estimated remaining: 4m 24s. Rate: 154.2 symbols/min [2025-10-09T22:40:38.429914] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:38.436143] [DEBUG] [MAIN ] KBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:38.437254] [INFO ] [MAIN ] KBR: Generated 1807 derivative records from 48203 primary records. [2025-10-09T22:40:38.437543] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-09T22:40:38.479191] [DEBUG] [LOCAL ] KBR: Derivative data saved (1807 records). [2025-10-09T22:40:38.479690] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-09T22:40:38.482588] [INFO ] [MAIN ] Derivative Progress: 1013/1690 symbols completed. KBR took 1.2s. Estimated remaining: 4m 23s. Rate: 154.3 symbols/min [2025-10-09T22:40:38.482937] [DEBUG] [MAIN ] KD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:38.484206] [DEBUG] [LOCAL ] KEN: Loaded 4702 existing records from primary storage. [2025-10-09T22:40:38.483942] [INFO ] [MAIN ] KD: Generated 1807 derivative records from 52707 primary records. [2025-10-09T22:40:38.484522] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-09T22:40:38.484602] [INFO ] [MAIN ] KEN: Loaded 4702 primary data records. [2025-10-09T22:40:38.484332] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:38.599986] [DEBUG] [LOCAL ] KD: Derivative data saved (1807 records). [2025-10-09T22:40:38.603563] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-09T22:40:38.606445] [INFO ] [MAIN ] Derivative Progress: 1014/1690 symbols completed. KD took 1.3s. Estimated remaining: 4m 23s. Rate: 154.4 symbols/min [2025-10-09T22:40:38.617141] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:38.854168] [DEBUG] [LOCAL ] KEP: Loaded 31601 existing records from primary storage. [2025-10-09T22:40:38.854833] [INFO ] [MAIN ] KEP: Loaded 31601 primary data records. [2025-10-09T22:40:39.173388] [DEBUG] [LOCAL ] KEX: Loaded 38809 existing records from primary storage. [2025-10-09T22:40:39.182755] [INFO ] [MAIN ] KEX: Loaded 38809 primary data records. [2025-10-09T22:40:39.478051] [DEBUG] [MAIN ] KEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:39.499888] [INFO ] [MAIN ] KEN: Generated 1807 derivative records from 4702 primary records. [2025-10-09T22:40:39.500332] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-09T22:40:39.519214] [DEBUG] [LOCAL ] KEN: Derivative data saved (1807 records). [2025-10-09T22:40:39.519775] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-09T22:40:39.521875] [INFO ] [MAIN ] Derivative Progress: 1015/1690 symbols completed. KEN took 1.1s. Estimated remaining: 4m 23s. Rate: 154.2 symbols/min [2025-10-09T22:40:39.522133] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:39.535943] [DEBUG] [MAIN ] KEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:39.536695] [INFO ] [MAIN ] KEP: Generated 1807 derivative records from 31601 primary records. [2025-10-09T22:40:39.536833] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-09T22:40:39.554335] [DEBUG] [LOCAL ] KEP: Derivative data saved (1807 records). [2025-10-09T22:40:39.554441] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-09T22:40:39.557343] [INFO ] [MAIN ] Derivative Progress: 1016/1690 symbols completed. KEP took 1.1s. Estimated remaining: 4m 22s. Rate: 154.3 symbols/min [2025-10-09T22:40:39.557857] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:39.563316] [DEBUG] [LOCAL ] KF: Loaded 2381 existing records from primary storage. [2025-10-09T22:40:39.565152] [INFO ] [MAIN ] KF: Loaded 2381 primary data records. [2025-10-09T22:40:39.677639] [DEBUG] [MAIN ] KEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:39.688879] [INFO ] [MAIN ] KEX: Generated 1807 derivative records from 38809 primary records. [2025-10-09T22:40:39.699749] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-09T22:40:39.917149] [DEBUG] [LOCAL ] KEYS: Loaded 43424 existing records from primary storage. [2025-10-09T22:40:39.932294] [INFO ] [MAIN ] KEYS: Loaded 43424 primary data records. [2025-10-09T22:40:39.932201] [DEBUG] [LOCAL ] KEX: Derivative data saved (1807 records). [2025-10-09T22:40:39.944402] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-09T22:40:39.973559] [INFO ] [MAIN ] Derivative Progress: 1017/1690 symbols completed. KEX took 1.4s. Estimated remaining: 4m 22s. Rate: 154.3 symbols/min [2025-10-09T22:40:39.992545] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:40.250267] [DEBUG] [LOCAL ] KFRC: Loaded 20191 existing records from primary storage. [2025-10-09T22:40:40.250692] [INFO ] [MAIN ] KFRC: Loaded 20191 primary data records. [2025-10-09T22:40:40.459446] [DEBUG] [MAIN ] KF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:40.649545] [INFO ] [MAIN ] KF: Generated 1807 derivative records from 2381 primary records. [2025-10-09T22:40:40.650261] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-09T22:40:40.665391] [DEBUG] [LOCAL ] KF: Derivative data saved (1807 records). [2025-10-09T22:40:40.666534] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-09T22:40:40.670105] [INFO ] [MAIN ] Derivative Progress: 1018/1690 symbols completed. KF took 1.1s. Estimated remaining: 4m 21s. Rate: 154.2 symbols/min [2025-10-09T22:40:40.685477] [DEBUG] [MAIN ] KEYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:40.686960] [INFO ] [MAIN ] KEYS: Generated 1807 derivative records from 43424 primary records. [2025-10-09T22:40:40.687245] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-09T22:40:40.703678] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1807 records). [2025-10-09T22:40:40.703833] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-09T22:40:40.706462] [INFO ] [MAIN ] Derivative Progress: 1019/1690 symbols completed. KEYS took 1.2s. Estimated remaining: 4m 21s. Rate: 154.3 symbols/min [2025-10-09T22:40:40.721890] [DEBUG] [MAIN ] KFRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:40.722428] [INFO ] [MAIN ] KFRC: Generated 1807 derivative records from 20191 primary records. [2025-10-09T22:40:40.722485] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-09T22:40:40.737409] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1807 records). [2025-10-09T22:40:40.737467] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-09T22:40:40.740310] [INFO ] [MAIN ] Derivative Progress: 1020/1690 symbols completed. KFRC took 0.7s. Estimated remaining: 4m 20s. Rate: 154.5 symbols/min [2025-10-09T22:40:40.741046] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:40.740985] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:40.741473] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:40.752149] [DEBUG] [LOCAL ] KFS: Loaded 8608 existing records from primary storage. [2025-10-09T22:40:40.752298] [INFO ] [MAIN ] KFS: Loaded 8608 primary data records. [2025-10-09T22:40:40.921835] [DEBUG] [LOCAL ] KFY: Loaded 30040 existing records from primary storage. [2025-10-09T22:40:40.971880] [INFO ] [MAIN ] KFY: Loaded 30040 primary data records. [2025-10-09T22:40:41.209478] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-10-09T22:40:41.225134] [INFO ] [MAIN ] KGC: Loaded 54089 primary data records. [2025-10-09T22:40:41.722015] [DEBUG] [MAIN ] KFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:41.722954] [INFO ] [MAIN ] KFS: Generated 1807 derivative records from 8608 primary records. [2025-10-09T22:40:41.723186] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-09T22:40:41.741064] [DEBUG] [LOCAL ] KFS: Derivative data saved (1807 records). [2025-10-09T22:40:41.741390] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-09T22:40:41.743713] [INFO ] [MAIN ] Derivative Progress: 1021/1690 symbols completed. KFS took 1.0s. Estimated remaining: 4m 20s. Rate: 154.2 symbols/min [2025-10-09T22:40:41.745352] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:41.765392] [DEBUG] [MAIN ] KFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:41.766297] [INFO ] [MAIN ] KFY: Generated 1807 derivative records from 30040 primary records. [2025-10-09T22:40:41.766666] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-09T22:40:41.786937] [DEBUG] [LOCAL ] KFY: Derivative data saved (1807 records). [2025-10-09T22:40:41.787172] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-09T22:40:41.789997] [INFO ] [MAIN ] Derivative Progress: 1022/1690 symbols completed. KFY took 1.0s. Estimated remaining: 4m 20s. Rate: 154.4 symbols/min [2025-10-09T22:40:41.798068] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:41.804093] [DEBUG] [MAIN ] KGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:41.805316] [INFO ] [MAIN ] KGC: Generated 1807 derivative records from 54089 primary records. [2025-10-09T22:40:41.805577] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-09T22:40:41.834932] [DEBUG] [LOCAL ] KGC: Derivative data saved (1807 records). [2025-10-09T22:40:41.835615] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-09T22:40:41.839494] [INFO ] [MAIN ] Derivative Progress: 1023/1690 symbols completed. KGC took 1.1s. Estimated remaining: 4m 19s. Rate: 154.5 symbols/min [2025-10-09T22:40:41.851179] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:41.854429] [DEBUG] [LOCAL ] KGS: Loaded 46271 existing records from primary storage. [2025-10-09T22:40:41.854728] [INFO ] [MAIN ] KGS: Loaded 46271 primary data records. [2025-10-09T22:40:42.179698] [DEBUG] [LOCAL ] KIO: Loaded 21605 existing records from primary storage. [2025-10-09T22:40:42.193382] [INFO ] [MAIN ] KIO: Loaded 21605 primary data records. [2025-10-09T22:40:42.206220] [DEBUG] [LOCAL ] KIM: Loaded 53373 existing records from primary storage. [2025-10-09T22:40:42.237633] [INFO ] [MAIN ] KIM: Loaded 53373 primary data records. [2025-10-09T22:40:42.861995] [DEBUG] [MAIN ] KGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:42.864166] [INFO ] [MAIN ] KGS: Generated 1807 derivative records from 46271 primary records. [2025-10-09T22:40:42.865757] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-09T22:40:42.893785] [DEBUG] [LOCAL ] KGS: Derivative data saved (1807 records). [2025-10-09T22:40:42.894143] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-09T22:40:42.896531] [INFO ] [MAIN ] Derivative Progress: 1024/1690 symbols completed. KGS took 1.2s. Estimated remaining: 4m 19s. Rate: 154.2 symbols/min [2025-10-09T22:40:42.896886] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:42.914607] [DEBUG] [MAIN ] KIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:42.915754] [INFO ] [MAIN ] KIM: Generated 1807 derivative records from 53373 primary records. [2025-10-09T22:40:42.915832] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-09T22:40:42.946508] [DEBUG] [MAIN ] KIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:42.949467] [DEBUG] [LOCAL ] KIM: Derivative data saved (1807 records). [2025-10-09T22:40:42.950453] [INFO ] [MAIN ] KIO: Generated 1807 derivative records from 21605 primary records. [2025-10-09T22:40:42.950551] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-09T22:40:42.950623] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-09T22:40:42.953628] [INFO ] [MAIN ] Derivative Progress: 1025/1690 symbols completed. KIM took 1.2s. Estimated remaining: 4m 18s. Rate: 154.4 symbols/min [2025-10-09T22:40:42.954408] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:42.978232] [DEBUG] [LOCAL ] KKRS: Loaded 5747 existing records from primary storage. [2025-10-09T22:40:42.974967] [DEBUG] [LOCAL ] KIO: Derivative data saved (1807 records). [2025-10-09T22:40:42.978372] [INFO ] [MAIN ] KKRS: Loaded 5747 primary data records. [2025-10-09T22:40:42.978447] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-09T22:40:43.038224] [INFO ] [MAIN ] Derivative Progress: 1026/1690 symbols completed. KIO took 1.2s. Estimated remaining: 4m 18s. Rate: 154.5 symbols/min [2025-10-09T22:40:43.078896] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:43.142166] [DEBUG] [LOCAL ] KKR: Loaded 53892 existing records from primary storage. [2025-10-09T22:40:43.169140] [INFO ] [MAIN ] KKR: Loaded 53892 primary data records. [2025-10-09T22:40:43.520623] [DEBUG] [LOCAL ] KLC: Loaded 37008 existing records from primary storage. [2025-10-09T22:40:43.521017] [INFO ] [MAIN ] KLC: Loaded 37008 primary data records. [2025-10-09T22:40:43.994824] [DEBUG] [MAIN ] KKRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:43.996905] [INFO ] [MAIN ] KKRS: Generated 1807 derivative records from 5747 primary records. [2025-10-09T22:40:43.997637] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-09T22:40:44.030811] [DEBUG] [MAIN ] KKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:44.032300] [INFO ] [MAIN ] KKR: Generated 1807 derivative records from 53892 primary records. [2025-10-09T22:40:44.032785] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-09T22:40:44.033271] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1807 records). [2025-10-09T22:40:44.034446] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-09T22:40:44.045278] [INFO ] [MAIN ] Derivative Progress: 1027/1690 symbols completed. KKRS took 1.1s. Estimated remaining: 4m 18s. Rate: 154.2 symbols/min [2025-10-09T22:40:44.048230] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:44.052619] [DEBUG] [LOCAL ] KKR: Derivative data saved (1807 records). [2025-10-09T22:40:44.052881] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-09T22:40:44.055708] [INFO ] [MAIN ] Derivative Progress: 1028/1690 symbols completed. KKR took 1.2s. Estimated remaining: 4m 17s. Rate: 154.4 symbols/min [2025-10-09T22:40:44.055894] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:44.072342] [DEBUG] [LOCAL ] KMPB: Loaded 3842 existing records from primary storage. [2025-10-09T22:40:44.077162] [INFO ] [MAIN ] KMPB: Loaded 3842 primary data records. [2025-10-09T22:40:44.098384] [DEBUG] [MAIN ] KLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:44.122165] [INFO ] [MAIN ] KLC: Generated 1807 derivative records from 37008 primary records. [2025-10-09T22:40:44.149013] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-09T22:40:44.418969] [DEBUG] [LOCAL ] KLC: Derivative data saved (1807 records). [2025-10-09T22:40:44.435087] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-09T22:40:44.440821] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-09T22:40:44.438447] [INFO ] [MAIN ] Derivative Progress: 1029/1690 symbols completed. KLC took 1.4s. Estimated remaining: 4m 17s. Rate: 154.4 symbols/min [2025-10-09T22:40:44.441222] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:44.441318] [INFO ] [MAIN ] KMI: Loaded 54083 primary data records. [2025-10-09T22:40:44.838623] [DEBUG] [LOCAL ] KMPR: Loaded 39672 existing records from primary storage. [2025-10-09T22:40:44.845069] [INFO ] [MAIN ] KMPR: Loaded 39672 primary data records. [2025-10-09T22:40:44.904541] [DEBUG] [MAIN ] KMPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:44.935065] [INFO ] [MAIN ] KMPB: Generated 1807 derivative records from 3842 primary records. [2025-10-09T22:40:44.948612] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-09T22:40:45.113529] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1807 records). [2025-10-09T22:40:45.192575] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-09T22:40:45.194981] [INFO ] [MAIN ] Derivative Progress: 1030/1690 symbols completed. KMPB took 1.1s. Estimated remaining: 4m 17s. Rate: 154.3 symbols/min [2025-10-09T22:40:45.195338] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:45.210004] [DEBUG] [MAIN ] KMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:45.212218] [INFO ] [MAIN ] KMI: Generated 1807 derivative records from 54083 primary records. [2025-10-09T22:40:45.212585] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-09T22:40:45.236380] [DEBUG] [LOCAL ] KMI: Derivative data saved (1807 records). [2025-10-09T22:40:45.236578] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-09T22:40:45.239268] [INFO ] [MAIN ] Derivative Progress: 1031/1690 symbols completed. KMI took 1.2s. Estimated remaining: 4m 16s. Rate: 154.4 symbols/min [2025-10-09T22:40:45.239578] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:45.268804] [DEBUG] [MAIN ] KMPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:45.269605] [INFO ] [MAIN ] KMPR: Generated 1807 derivative records from 39672 primary records. [2025-10-09T22:40:45.269785] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-09T22:40:45.299285] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1807 records). [2025-10-09T22:40:45.299546] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-09T22:40:45.302388] [INFO ] [MAIN ] Derivative Progress: 1032/1690 symbols completed. KMPR took 0.9s. Estimated remaining: 4m 16s. Rate: 154.5 symbols/min [2025-10-09T22:40:45.310272] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:45.311737] [DEBUG] [LOCAL ] KMT: Loaded 43222 existing records from primary storage. [2025-10-09T22:40:45.312245] [INFO ] [MAIN ] KMT: Loaded 43222 primary data records. [2025-10-09T22:40:45.434086] [DEBUG] [LOCAL ] KN: Loaded 38814 existing records from primary storage. [2025-10-09T22:40:45.440068] [INFO ] [MAIN ] KN: Loaded 38814 primary data records. [2025-10-09T22:40:45.773437] [DEBUG] [LOCAL ] KNF: Loaded 36539 existing records from primary storage. [2025-10-09T22:40:45.794967] [INFO ] [MAIN ] KNF: Loaded 36539 primary data records. [2025-10-09T22:40:46.301520] [DEBUG] [MAIN ] KMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:46.302766] [INFO ] [MAIN ] KMT: Generated 1807 derivative records from 43222 primary records. [2025-10-09T22:40:46.303873] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-09T22:40:46.334587] [DEBUG] [MAIN ] KN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:46.336006] [INFO ] [MAIN ] KN: Generated 1807 derivative records from 38814 primary records. [2025-10-09T22:40:46.336240] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-09T22:40:46.354486] [DEBUG] [LOCAL ] KMT: Derivative data saved (1807 records). [2025-10-09T22:40:46.356108] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-09T22:40:46.359382] [INFO ] [MAIN ] Derivative Progress: 1033/1690 symbols completed. KMT took 1.2s. Estimated remaining: 4m 16s. Rate: 154.3 symbols/min [2025-10-09T22:40:46.356040] [DEBUG] [LOCAL ] KN: Derivative data saved (1807 records). [2025-10-09T22:40:46.359621] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-09T22:40:46.363310] [INFO ] [MAIN ] Derivative Progress: 1034/1690 symbols completed. KN took 1.1s. Estimated remaining: 4m 15s. Rate: 154.4 symbols/min [2025-10-09T22:40:46.376169] [DEBUG] [MAIN ] KNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:46.376799] [INFO ] [MAIN ] KNF: Generated 1807 derivative records from 36539 primary records. [2025-10-09T22:40:46.376862] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-09T22:40:46.392357] [DEBUG] [LOCAL ] KNF: Derivative data saved (1807 records). [2025-10-09T22:40:46.392444] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-09T22:40:46.395014] [INFO ] [MAIN ] Derivative Progress: 1035/1690 symbols completed. KNF took 1.1s. Estimated remaining: 4m 14s. Rate: 154.5 symbols/min [2025-10-09T22:40:46.395434] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:46.395666] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:46.395606] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:46.408186] [DEBUG] [LOCAL ] KNOP: Loaded 10559 existing records from primary storage. [2025-10-09T22:40:46.408332] [INFO ] [MAIN ] KNOP: Loaded 10559 primary data records. [2025-10-09T22:40:46.536785] [DEBUG] [LOCAL ] KNSL: Loaded 18524 existing records from primary storage. [2025-10-09T22:40:46.563742] [INFO ] [MAIN ] KNSL: Loaded 18524 primary data records. [2025-10-09T22:40:46.898945] [DEBUG] [LOCAL ] KNTK: Loaded 46944 existing records from primary storage. [2025-10-09T22:40:46.899610] [INFO ] [MAIN ] KNTK: Loaded 46944 primary data records. [2025-10-09T22:40:47.465901] [DEBUG] [MAIN ] KNOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:47.467107] [INFO ] [MAIN ] KNOP: Generated 1807 derivative records from 10559 primary records. [2025-10-09T22:40:47.479449] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-09T22:40:47.482523] [DEBUG] [MAIN ] KNSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:47.490502] [INFO ] [MAIN ] KNSL: Generated 1807 derivative records from 18524 primary records. [2025-10-09T22:40:47.490812] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-09T22:40:47.509071] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1807 records). [2025-10-09T22:40:47.512996] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-09T22:40:47.515178] [INFO ] [MAIN ] Derivative Progress: 1036/1690 symbols completed. KNOP took 1.1s. Estimated remaining: 4m 14s. Rate: 154.3 symbols/min [2025-10-09T22:40:47.516291] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:47.520094] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1807 records). [2025-10-09T22:40:47.520898] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-09T22:40:47.524744] [INFO ] [MAIN ] Derivative Progress: 1037/1690 symbols completed. KNSL took 1.1s. Estimated remaining: 4m 14s. Rate: 154.4 symbols/min [2025-10-09T22:40:47.526800] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:47.540558] [DEBUG] [MAIN ] KNTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:47.541303] [INFO ] [MAIN ] KNTK: Generated 1807 derivative records from 46944 primary records. [2025-10-09T22:40:47.541439] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-09T22:40:47.558270] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1807 records). [2025-10-09T22:40:47.558382] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-09T22:40:47.561940] [INFO ] [MAIN ] Derivative Progress: 1038/1690 symbols completed. KNTK took 1.2s. Estimated remaining: 4m 13s. Rate: 154.5 symbols/min [2025-10-09T22:40:47.562191] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:47.604226] [DEBUG] [LOCAL ] KODK: Loaded 43771 existing records from primary storage. [2025-10-09T22:40:47.611959] [INFO ] [MAIN ] KODK: Loaded 43771 primary data records. [2025-10-09T22:40:47.682050] [DEBUG] [LOCAL ] KNX: Loaded 52986 existing records from primary storage. [2025-10-09T22:40:47.716547] [INFO ] [MAIN ] KNX: Loaded 52986 primary data records. [2025-10-09T22:40:47.757450] [DEBUG] [LOCAL ] KOF: Loaded 26683 existing records from primary storage. [2025-10-09T22:40:47.776973] [INFO ] [MAIN ] KOF: Loaded 26683 primary data records. [2025-10-09T22:40:48.611828] [DEBUG] [MAIN ] KODK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:48.628592] [INFO ] [MAIN ] KODK: Generated 1807 derivative records from 43771 primary records. [2025-10-09T22:40:48.628830] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-09T22:40:48.627705] [DEBUG] [MAIN ] KNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:48.630237] [INFO ] [MAIN ] KNX: Generated 1807 derivative records from 52986 primary records. [2025-10-09T22:40:48.631479] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-09T22:40:48.663529] [DEBUG] [LOCAL ] KODK: Derivative data saved (1807 records). [2025-10-09T22:40:48.664529] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-09T22:40:48.666861] [INFO ] [MAIN ] Derivative Progress: 1039/1690 symbols completed. KODK took 1.1s. Estimated remaining: 4m 13s. Rate: 154.3 symbols/min [2025-10-09T22:40:48.667191] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:48.675182] [DEBUG] [LOCAL ] KNX: Derivative data saved (1807 records). [2025-10-09T22:40:48.675538] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-09T22:40:48.678953] [INFO ] [MAIN ] Derivative Progress: 1040/1690 symbols completed. KNX took 1.2s. Estimated remaining: 4m 13s. Rate: 154.4 symbols/min [2025-10-09T22:40:48.679423] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:48.692933] [DEBUG] [MAIN ] KOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:48.693801] [INFO ] [MAIN ] KOF: Generated 1807 derivative records from 26683 primary records. [2025-10-09T22:40:48.694043] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-09T22:40:48.710985] [DEBUG] [LOCAL ] KORE: Loaded 2137 existing records from primary storage. [2025-10-09T22:40:48.718791] [INFO ] [MAIN ] KORE: Loaded 2137 primary data records. [2025-10-09T22:40:48.718689] [DEBUG] [LOCAL ] KOF: Derivative data saved (1807 records). [2025-10-09T22:40:48.725019] [DEBUG] [LOCAL ] KOP: Loaded 17572 existing records from primary storage. [2025-10-09T22:40:48.725142] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-09T22:40:48.728248] [INFO ] [MAIN ] Derivative Progress: 1041/1690 symbols completed. KOF took 1.2s. Estimated remaining: 4m 12s. Rate: 154.5 symbols/min [2025-10-09T22:40:48.725249] [INFO ] [MAIN ] KOP: Loaded 17572 primary data records. [2025-10-09T22:40:48.739688] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:49.420825] [DEBUG] [LOCAL ] KOS: Loaded 53462 existing records from primary storage. [2025-10-09T22:40:49.421132] [INFO ] [MAIN ] KOS: Loaded 53462 primary data records. [2025-10-09T22:40:49.762356] [DEBUG] [MAIN ] KORE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:49.776551] [INFO ] [MAIN ] KORE: Generated 1807 derivative records from 2137 primary records. [2025-10-09T22:40:49.776759] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-09T22:40:49.777046] [DEBUG] [MAIN ] KOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:49.777733] [INFO ] [MAIN ] KOP: Generated 1807 derivative records from 17572 primary records. [2025-10-09T22:40:49.777892] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-09T22:40:49.815125] [DEBUG] [LOCAL ] KOP: Derivative data saved (1807 records). [2025-10-09T22:40:49.815265] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-09T22:40:49.818062] [INFO ] [MAIN ] Derivative Progress: 1042/1690 symbols completed. KOP took 1.2s. Estimated remaining: 4m 12s. Rate: 154.3 symbols/min [2025-10-09T22:40:49.814870] [DEBUG] [LOCAL ] KORE: Derivative data saved (1807 records). [2025-10-09T22:40:49.818345] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-09T22:40:49.821053] [INFO ] [MAIN ] Derivative Progress: 1043/1690 symbols completed. KORE took 1.1s. Estimated remaining: 4m 11s. Rate: 154.4 symbols/min [2025-10-09T22:40:49.820966] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:49.821337] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:49.839627] [DEBUG] [MAIN ] KOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:49.840410] [INFO ] [MAIN ] KOS: Generated 1807 derivative records from 53462 primary records. [2025-10-09T22:40:49.840536] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-09T22:40:49.857074] [DEBUG] [LOCAL ] KOS: Derivative data saved (1807 records). [2025-10-09T22:40:49.857141] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-09T22:40:49.860440] [INFO ] [MAIN ] Derivative Progress: 1044/1690 symbols completed. KOS took 1.1s. Estimated remaining: 4m 11s. Rate: 154.5 symbols/min [2025-10-09T22:40:49.860580] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:49.933678] [DEBUG] [LOCAL ] KREF: Loaded 38087 existing records from primary storage. [2025-10-09T22:40:49.935057] [DEBUG] [LOCAL ] KRC: Loaded 48686 existing records from primary storage. [2025-10-09T22:40:49.935783] [INFO ] [MAIN ] KREF: Loaded 38087 primary data records. [2025-10-09T22:40:49.935969] [INFO ] [MAIN ] KRC: Loaded 48686 primary data records. [2025-10-09T22:40:50.088859] [DEBUG] [LOCAL ] KR: Loaded 54071 existing records from primary storage. [2025-10-09T22:40:50.123054] [INFO ] [MAIN ] KR: Loaded 54071 primary data records. [2025-10-09T22:40:50.945256] [DEBUG] [MAIN ] KREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:50.951086] [INFO ] [MAIN ] KREF: Generated 1807 derivative records from 38087 primary records. [2025-10-09T22:40:50.951556] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-09T22:40:50.952091] [DEBUG] [MAIN ] KRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:50.953785] [INFO ] [MAIN ] KRC: Generated 1807 derivative records from 48686 primary records. [2025-10-09T22:40:50.962218] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-09T22:40:51.001605] [DEBUG] [MAIN ] KR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:51.004484] [DEBUG] [LOCAL ] KREF: Derivative data saved (1807 records). [2025-10-09T22:40:51.004100] [INFO ] [MAIN ] KR: Generated 1807 derivative records from 54071 primary records. [2025-10-09T22:40:51.004680] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-09T22:40:51.008393] [INFO ] [MAIN ] Derivative Progress: 1045/1690 symbols completed. KREF took 1.1s. Estimated remaining: 4m 11s. Rate: 154.3 symbols/min [2025-10-09T22:40:51.008815] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:51.008873] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-09T22:40:51.024227] [DEBUG] [LOCAL ] KRC: Derivative data saved (1807 records). [2025-10-09T22:40:51.025310] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-09T22:40:51.028876] [INFO ] [MAIN ] Derivative Progress: 1046/1690 symbols completed. KRC took 1.2s. Estimated remaining: 4m 10s. Rate: 154.4 symbols/min [2025-10-09T22:40:51.029604] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:51.034961] [DEBUG] [LOCAL ] KR: Derivative data saved (1807 records). [2025-10-09T22:40:51.035097] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-09T22:40:51.038867] [INFO ] [MAIN ] Derivative Progress: 1047/1690 symbols completed. KR took 1.2s. Estimated remaining: 4m 10s. Rate: 154.5 symbols/min [2025-10-09T22:40:51.039144] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:51.062350] [DEBUG] [LOCAL ] KRO: Loaded 26410 existing records from primary storage. [2025-10-09T22:40:51.062559] [INFO ] [MAIN ] KRO: Loaded 26410 primary data records. [2025-10-09T22:40:51.224740] [DEBUG] [LOCAL ] KRG: Loaded 49521 existing records from primary storage. [2025-10-09T22:40:51.262177] [INFO ] [MAIN ] KRG: Loaded 49521 primary data records. [2025-10-09T22:40:51.316761] [DEBUG] [LOCAL ] KRP: Loaded 36952 existing records from primary storage. [2025-10-09T22:40:51.340589] [INFO ] [MAIN ] KRP: Loaded 36952 primary data records. [2025-10-09T22:40:52.045608] [DEBUG] [MAIN ] KRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:52.046571] [INFO ] [MAIN ] KRO: Generated 1807 derivative records from 26410 primary records. [2025-10-09T22:40:52.046770] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-09T22:40:52.065468] [DEBUG] [LOCAL ] KRO: Derivative data saved (1807 records). [2025-10-09T22:40:52.067175] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-09T22:40:52.069394] [INFO ] [MAIN ] Derivative Progress: 1048/1690 symbols completed. KRO took 1.0s. Estimated remaining: 4m 10s. Rate: 154.3 symbols/min [2025-10-09T22:40:52.085486] [DEBUG] [MAIN ] KRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:52.086360] [INFO ] [MAIN ] KRP: Generated 1807 derivative records from 36952 primary records. [2025-10-09T22:40:52.100127] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-09T22:40:52.101558] [DEBUG] [MAIN ] KRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:52.102705] [INFO ] [MAIN ] KRG: Generated 1807 derivative records from 49521 primary records. [2025-10-09T22:40:52.110210] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-09T22:40:52.118597] [DEBUG] [LOCAL ] KRP: Derivative data saved (1807 records). [2025-10-09T22:40:52.119106] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-09T22:40:52.122755] [INFO ] [MAIN ] Derivative Progress: 1049/1690 symbols completed. KRP took 1.1s. Estimated remaining: 4m 9s. Rate: 154.4 symbols/min [2025-10-09T22:40:52.138546] [DEBUG] [LOCAL ] KRG: Derivative data saved (1807 records). [2025-10-09T22:40:52.138626] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-09T22:40:52.142858] [INFO ] [MAIN ] Derivative Progress: 1050/1690 symbols completed. KRG took 1.1s. Estimated remaining: 4m 8s. Rate: 154.6 symbols/min [2025-10-09T22:40:52.143555] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:52.143944] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:52.143492] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:52.213931] [DEBUG] [LOCAL ] KTB: Loaded 40852 existing records from primary storage. [2025-10-09T22:40:52.228878] [INFO ] [MAIN ] KTB: Loaded 40852 primary data records. [2025-10-09T22:40:52.310748] [DEBUG] [LOCAL ] KT: Loaded 45849 existing records from primary storage. [2025-10-09T22:40:52.278081] [DEBUG] [LOCAL ] KSS: Loaded 53986 existing records from primary storage. [2025-10-09T22:40:52.317112] [INFO ] [MAIN ] KT: Loaded 45849 primary data records. [2025-10-09T22:40:52.327465] [INFO ] [MAIN ] KSS: Loaded 53986 primary data records. [2025-10-09T22:40:53.303811] [DEBUG] [MAIN ] KTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:53.304790] [INFO ] [MAIN ] KTB: Generated 1807 derivative records from 40852 primary records. [2025-10-09T22:40:53.305011] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-09T22:40:53.325260] [DEBUG] [LOCAL ] KTB: Derivative data saved (1807 records). [2025-10-09T22:40:53.327141] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-09T22:40:53.330190] [INFO ] [MAIN ] Derivative Progress: 1051/1690 symbols completed. KTB took 1.2s. Estimated remaining: 4m 9s. Rate: 154.3 symbols/min [2025-10-09T22:40:53.330354] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:53.348714] [DEBUG] [MAIN ] KSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:53.362781] [INFO ] [MAIN ] KSS: Generated 1807 derivative records from 53986 primary records. [2025-10-09T22:40:53.366792] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-09T22:40:53.367299] [DEBUG] [MAIN ] KT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:53.377211] [INFO ] [MAIN ] KT: Generated 1807 derivative records from 45849 primary records. [2025-10-09T22:40:53.386226] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-09T22:40:53.389414] [DEBUG] [LOCAL ] KTF: Loaded 12113 existing records from primary storage. [2025-10-09T22:40:53.391458] [INFO ] [MAIN ] KTF: Loaded 12113 primary data records. [2025-10-09T22:40:53.421490] [DEBUG] [LOCAL ] KSS: Derivative data saved (1807 records). [2025-10-09T22:40:53.437026] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-09T22:40:53.464285] [INFO ] [MAIN ] Derivative Progress: 1052/1690 symbols completed. KSS took 1.3s. Estimated remaining: 4m 8s. Rate: 154.4 symbols/min [2025-10-09T22:40:53.485635] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:53.534575] [DEBUG] [LOCAL ] KT: Derivative data saved (1807 records). [2025-10-09T22:40:53.545323] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-09T22:40:53.579700] [INFO ] [MAIN ] Derivative Progress: 1053/1690 symbols completed. KT took 1.4s. Estimated remaining: 4m 7s. Rate: 154.5 symbols/min [2025-10-09T22:40:53.598021] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:53.745633] [DEBUG] [MAIN ] KTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:53.746503] [INFO ] [MAIN ] KTF: Generated 1807 derivative records from 12113 primary records. [2025-10-09T22:40:53.746612] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-09T22:40:53.790954] [DEBUG] [LOCAL ] KTF: Derivative data saved (1807 records). [2025-10-09T22:40:53.791087] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-09T22:40:53.793130] [INFO ] [MAIN ] Derivative Progress: 1054/1690 symbols completed. KTF took 0.5s. Estimated remaining: 4m 7s. Rate: 154.5 symbols/min [2025-10-09T22:40:53.793372] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:53.810801] [DEBUG] [LOCAL ] KVYO: Loaded 50818 existing records from primary storage. [2025-10-09T22:40:53.826821] [INFO ] [MAIN ] KVYO: Loaded 50818 primary data records. [2025-10-09T22:40:53.839399] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-09T22:40:53.849293] [INFO ] [MAIN ] KVUE: Loaded 54057 primary data records. [2025-10-09T22:40:54.185115] [DEBUG] [LOCAL ] KW: Loaded 40664 existing records from primary storage. [2025-10-09T22:40:54.347976] [INFO ] [MAIN ] KW: Loaded 40664 primary data records. [2025-10-09T22:40:54.942668] [DEBUG] [MAIN ] KVYO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:54.944531] [INFO ] [MAIN ] KVYO: Generated 1807 derivative records from 50818 primary records. [2025-10-09T22:40:54.953207] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-09T22:40:54.960306] [DEBUG] [MAIN ] KVUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:54.961438] [INFO ] [MAIN ] KVUE: Generated 1807 derivative records from 54057 primary records. [2025-10-09T22:40:54.961897] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-09T22:40:54.994842] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1807 records). [2025-10-09T22:40:54.996470] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1807 records). [2025-10-09T22:40:54.996673] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-09T22:40:54.996846] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-09T22:40:54.999276] [INFO ] [MAIN ] Derivative Progress: 1055/1690 symbols completed. KVUE took 1.5s. Estimated remaining: 4m 7s. Rate: 154.2 symbols/min [2025-10-09T22:40:55.001810] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:55.002875] [INFO ] [MAIN ] Derivative Progress: 1056/1690 symbols completed. KVYO took 1.4s. Estimated remaining: 4m 6s. Rate: 154.4 symbols/min [2025-10-09T22:40:55.003019] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:55.021209] [DEBUG] [MAIN ] KW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:55.022321] [INFO ] [MAIN ] KW: Generated 1807 derivative records from 40664 primary records. [2025-10-09T22:40:55.022471] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-09T22:40:55.053490] [DEBUG] [LOCAL ] KW: Derivative data saved (1807 records). [2025-10-09T22:40:55.061752] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-09T22:40:55.068006] [DEBUG] [LOCAL ] KWR: Loaded 16328 existing records from primary storage. [2025-10-09T22:40:55.068109] [INFO ] [MAIN ] KWR: Loaded 16328 primary data records. [2025-10-09T22:40:55.065569] [INFO ] [MAIN ] Derivative Progress: 1057/1690 symbols completed. KW took 1.3s. Estimated remaining: 4m 6s. Rate: 154.5 symbols/min [2025-10-09T22:40:55.074562] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:55.174373] [DEBUG] [LOCAL ] KYN: Loaded 30315 existing records from primary storage. [2025-10-09T22:40:55.180963] [INFO ] [MAIN ] KYN: Loaded 30315 primary data records. [2025-10-09T22:40:55.528986] [DEBUG] [LOCAL ] L: Loaded 41365 existing records from primary storage. [2025-10-09T22:40:55.536119] [INFO ] [MAIN ] L: Loaded 41365 primary data records. [2025-10-09T22:40:56.091351] [DEBUG] [MAIN ] KWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:56.093495] [INFO ] [MAIN ] KWR: Generated 1807 derivative records from 16328 primary records. [2025-10-09T22:40:56.094096] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-09T22:40:56.114562] [DEBUG] [LOCAL ] KWR: Derivative data saved (1807 records). [2025-10-09T22:40:56.115382] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-09T22:40:56.118818] [INFO ] [MAIN ] Derivative Progress: 1058/1690 symbols completed. KWR took 1.1s. Estimated remaining: 4m 6s. Rate: 154.2 symbols/min [2025-10-09T22:40:56.119342] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:56.137232] [DEBUG] [MAIN ] KYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:56.139986] [INFO ] [MAIN ] KYN: Generated 1807 derivative records from 30315 primary records. [2025-10-09T22:40:56.140418] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-09T22:40:56.162614] [DEBUG] [LOCAL ] KYN: Derivative data saved (1807 records). [2025-10-09T22:40:56.162864] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-09T22:40:56.165450] [INFO ] [MAIN ] Derivative Progress: 1059/1690 symbols completed. KYN took 1.2s. Estimated remaining: 4m 5s. Rate: 154.4 symbols/min [2025-10-09T22:40:56.165594] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:56.199477] [DEBUG] [MAIN ] L: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:56.200600] [INFO ] [MAIN ] L: Generated 1807 derivative records from 41365 primary records. [2025-10-09T22:40:56.200811] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-09T22:40:56.238563] [DEBUG] [LOCAL ] L: Derivative data saved (1807 records). [2025-10-09T22:40:56.238801] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-09T22:40:56.242426] [INFO ] [MAIN ] Derivative Progress: 1060/1690 symbols completed. L took 1.2s. Estimated remaining: 4m 5s. Rate: 154.5 symbols/min [2025-10-09T22:40:56.242724] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:56.244080] [DEBUG] [LOCAL ] LAC: Loaded 52833 existing records from primary storage. [2025-10-09T22:40:56.254625] [INFO ] [MAIN ] LAC: Loaded 52833 primary data records. [2025-10-09T22:40:56.267454] [DEBUG] [LOCAL ] LAD: Loaded 23719 existing records from primary storage. [2025-10-09T22:40:56.321829] [INFO ] [MAIN ] LAD: Loaded 23719 primary data records. [2025-10-09T22:40:56.773722] [DEBUG] [LOCAL ] LADR: Loaded 39462 existing records from primary storage. [2025-10-09T22:40:56.890767] [INFO ] [MAIN ] LADR: Loaded 39462 primary data records. [2025-10-09T22:40:57.354413] [DEBUG] [MAIN ] LAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:57.355587] [INFO ] [MAIN ] LAC: Generated 1807 derivative records from 52833 primary records. [2025-10-09T22:40:57.356734] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-09T22:40:57.384418] [DEBUG] [MAIN ] LAD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:40:57.386363] [INFO ] [MAIN ] LAD: Generated 1806 derivative records from 23719 primary records. [2025-10-09T22:40:57.386477] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-09T22:40:57.408914] [DEBUG] [LOCAL ] LAC: Derivative data saved (1807 records). [2025-10-09T22:40:57.407918] [DEBUG] [LOCAL ] LAD: Derivative data saved (1806 records). [2025-10-09T22:40:57.409283] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-09T22:40:57.411611] [INFO ] [MAIN ] Derivative Progress: 1061/1690 symbols completed. LAC took 1.3s. Estimated remaining: 4m 5s. Rate: 154.2 symbols/min [2025-10-09T22:40:57.409468] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-09T22:40:57.411797] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:57.415014] [INFO ] [MAIN ] Derivative Progress: 1062/1690 symbols completed. LAD took 1.2s. Estimated remaining: 4m 4s. Rate: 154.3 symbols/min [2025-10-09T22:40:57.415345] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:57.420785] [DEBUG] [LOCAL ] LANV: Loaded 2790 existing records from primary storage. [2025-10-09T22:40:57.421252] [INFO ] [MAIN ] LANV: Loaded 2790 primary data records. [2025-10-09T22:40:57.548108] [DEBUG] [LOCAL ] LAW: Loaded 14351 existing records from primary storage. [2025-10-09T22:40:57.558559] [INFO ] [MAIN ] LAW: Loaded 14351 primary data records. [2025-10-09T22:40:57.686534] [DEBUG] [MAIN ] LADR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:57.839716] [INFO ] [MAIN ] LADR: Generated 1807 derivative records from 39462 primary records. [2025-10-09T22:40:57.863472] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-09T22:40:58.095006] [DEBUG] [LOCAL ] LADR: Derivative data saved (1807 records). [2025-10-09T22:40:58.096904] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-09T22:40:58.100612] [INFO ] [MAIN ] Derivative Progress: 1063/1690 symbols completed. LADR took 1.9s. Estimated remaining: 4m 4s. Rate: 154.2 symbols/min [2025-10-09T22:40:58.123035] [DEBUG] [MAIN ] LANV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:40:58.123966] [INFO ] [MAIN ] LANV: Generated 1805 derivative records from 2790 primary records. [2025-10-09T22:40:58.124318] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-09T22:40:58.141544] [DEBUG] [LOCAL ] LANV: Derivative data saved (1805 records). [2025-10-09T22:40:58.143424] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-09T22:40:58.145767] [INFO ] [MAIN ] Derivative Progress: 1064/1690 symbols completed. LANV took 0.7s. Estimated remaining: 4m 3s. Rate: 154.4 symbols/min [2025-10-09T22:40:58.158494] [DEBUG] [MAIN ] LAW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:58.159147] [INFO ] [MAIN ] LAW: Generated 1807 derivative records from 14351 primary records. [2025-10-09T22:40:58.159209] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-09T22:40:58.173794] [DEBUG] [LOCAL ] LAW: Derivative data saved (1807 records). [2025-10-09T22:40:58.173852] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-09T22:40:58.176984] [INFO ] [MAIN ] Derivative Progress: 1065/1690 symbols completed. LAW took 0.8s. Estimated remaining: 4m 3s. Rate: 154.5 symbols/min [2025-10-09T22:40:58.177685] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:58.177538] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:58.177788] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:58.214017] [DEBUG] [LOCAL ] LB: Loaded 37931 existing records from primary storage. [2025-10-09T22:40:58.237766] [INFO ] [MAIN ] LB: Loaded 37931 primary data records. [2025-10-09T22:40:58.369296] [DEBUG] [LOCAL ] LAZ: Loaded 45066 existing records from primary storage. [2025-10-09T22:40:58.380888] [DEBUG] [LOCAL ] LBRT: Loaded 53323 existing records from primary storage. [2025-10-09T22:40:58.386098] [INFO ] [MAIN ] LBRT: Loaded 53323 primary data records. [2025-10-09T22:40:58.410818] [INFO ] [MAIN ] LAZ: Loaded 45066 primary data records. [2025-10-09T22:40:59.242879] [DEBUG] [MAIN ] LB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:59.244677] [INFO ] [MAIN ] LB: Generated 1807 derivative records from 37931 primary records. [2025-10-09T22:40:59.244900] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-09T22:40:59.263531] [DEBUG] [LOCAL ] LB: Derivative data saved (1807 records). [2025-10-09T22:40:59.263804] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-09T22:40:59.265717] [INFO ] [MAIN ] Derivative Progress: 1066/1690 symbols completed. LB took 1.1s. Estimated remaining: 4m 3s. Rate: 154.2 symbols/min [2025-10-09T22:40:59.266302] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:59.283670] [DEBUG] [MAIN ] LBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:59.284353] [INFO ] [MAIN ] LBRT: Generated 1807 derivative records from 53323 primary records. [2025-10-09T22:40:59.284529] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-09T22:40:59.304513] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1807 records). [2025-10-09T22:40:59.316973] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-09T22:40:59.319980] [INFO ] [MAIN ] Derivative Progress: 1067/1690 symbols completed. LBRT took 1.1s. Estimated remaining: 4m 2s. Rate: 154.3 symbols/min [2025-10-09T22:40:59.317411] [DEBUG] [MAIN ] LAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:40:59.320144] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:59.321132] [INFO ] [MAIN ] LAZ: Generated 1807 derivative records from 45066 primary records. [2025-10-09T22:40:59.321529] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-09T22:40:59.348452] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1807 records). [2025-10-09T22:40:59.348583] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-09T22:40:59.351521] [INFO ] [MAIN ] Derivative Progress: 1068/1690 symbols completed. LAZ took 1.2s. Estimated remaining: 4m 2s. Rate: 154.5 symbols/min [2025-10-09T22:40:59.351772] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:40:59.376969] [DEBUG] [LOCAL ] LC: Loaded 48313 existing records from primary storage. [2025-10-09T22:40:59.377224] [INFO ] [MAIN ] LC: Loaded 48313 primary data records. [2025-10-09T22:40:59.463541] [DEBUG] [LOCAL ] LCII: Loaded 27795 existing records from primary storage. [2025-10-09T22:40:59.488569] [INFO ] [MAIN ] LCII: Loaded 27795 primary data records. [2025-10-09T22:40:59.820544] [DEBUG] [LOCAL ] LDI: Loaded 44871 existing records from primary storage. [2025-10-09T22:40:59.858513] [INFO ] [MAIN ] LDI: Loaded 44871 primary data records. [2025-10-09T22:41:00.333044] [DEBUG] [MAIN ] LC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:00.333930] [INFO ] [MAIN ] LC: Generated 1807 derivative records from 48313 primary records. [2025-10-09T22:41:00.334559] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-09T22:41:00.357627] [DEBUG] [LOCAL ] LC: Derivative data saved (1807 records). [2025-10-09T22:41:00.358209] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-09T22:41:00.373304] [INFO ] [MAIN ] Derivative Progress: 1069/1690 symbols completed. LC took 1.1s. Estimated remaining: 4m 2s. Rate: 154.2 symbols/min [2025-10-09T22:41:00.374229] [DEBUG] [MAIN ] LCII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:00.373852] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:00.375550] [INFO ] [MAIN ] LCII: Generated 1807 derivative records from 27795 primary records. [2025-10-09T22:41:00.375677] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-09T22:41:00.393947] [DEBUG] [LOCAL ] LCII: Derivative data saved (1807 records). [2025-10-09T22:41:00.394241] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-09T22:41:00.396784] [INFO ] [MAIN ] Derivative Progress: 1070/1690 symbols completed. LCII took 1.1s. Estimated remaining: 4m 1s. Rate: 154.4 symbols/min [2025-10-09T22:41:00.397174] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:00.413886] [DEBUG] [MAIN ] LDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:00.414708] [INFO ] [MAIN ] LDI: Generated 1807 derivative records from 44871 primary records. [2025-10-09T22:41:00.414775] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-09T22:41:00.438283] [DEBUG] [LOCAL ] LDP: Loaded 13016 existing records from primary storage. [2025-10-09T22:41:00.439162] [INFO ] [MAIN ] LDP: Loaded 13016 primary data records. [2025-10-09T22:41:00.531268] [DEBUG] [LOCAL ] LDI: Derivative data saved (1807 records). [2025-10-09T22:41:00.552639] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-09T22:41:00.555439] [INFO ] [MAIN ] Derivative Progress: 1071/1690 symbols completed. LDI took 1.2s. Estimated remaining: 4m 0s. Rate: 154.5 symbols/min [2025-10-09T22:41:00.556184] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:00.643751] [DEBUG] [LOCAL ] LDOS: Loaded 45603 existing records from primary storage. [2025-10-09T22:41:00.649387] [INFO ] [MAIN ] LDOS: Loaded 45603 primary data records. [2025-10-09T22:41:01.163244] [DEBUG] [LOCAL ] LEA: Loaded 41878 existing records from primary storage. [2025-10-09T22:41:01.164218] [INFO ] [MAIN ] LEA: Loaded 41878 primary data records. [2025-10-09T22:41:01.299305] [DEBUG] [MAIN ] LDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:01.315729] [INFO ] [MAIN ] LDP: Generated 1807 derivative records from 13016 primary records. [2025-10-09T22:41:01.316007] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-09T22:41:01.504189] [DEBUG] [LOCAL ] LDP: Derivative data saved (1807 records). [2025-10-09T22:41:01.506815] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-09T22:41:01.510080] [INFO ] [MAIN ] Derivative Progress: 1072/1690 symbols completed. LDP took 1.1s. Estimated remaining: 4m 0s. Rate: 154.3 symbols/min [2025-10-09T22:41:01.510427] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:01.524933] [DEBUG] [MAIN ] LDOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:01.526190] [INFO ] [MAIN ] LDOS: Generated 1807 derivative records from 45603 primary records. [2025-10-09T22:41:01.526511] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-09T22:41:01.546292] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1807 records). [2025-10-09T22:41:01.546516] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-09T22:41:01.551188] [INFO ] [MAIN ] Derivative Progress: 1073/1690 symbols completed. LDOS took 1.2s. Estimated remaining: 3m 60s. Rate: 154.4 symbols/min [2025-10-09T22:41:01.552205] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:01.566559] [DEBUG] [MAIN ] LEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:01.567305] [INFO ] [MAIN ] LEA: Generated 1807 derivative records from 41878 primary records. [2025-10-09T22:41:01.567415] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-09T22:41:01.583925] [DEBUG] [LOCAL ] LEA: Derivative data saved (1807 records). [2025-10-09T22:41:01.584005] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-09T22:41:01.586382] [INFO ] [MAIN ] Derivative Progress: 1074/1690 symbols completed. LEA took 1.0s. Estimated remaining: 3m 59s. Rate: 154.5 symbols/min [2025-10-09T22:41:01.586564] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:01.615784] [DEBUG] [LOCAL ] LEO: Loaded 17020 existing records from primary storage. [2025-10-09T22:41:01.616842] [INFO ] [MAIN ] LEO: Loaded 17020 primary data records. [2025-10-09T22:41:01.674973] [DEBUG] [LOCAL ] LEG: Loaded 50535 existing records from primary storage. [2025-10-09T22:41:01.708509] [INFO ] [MAIN ] LEG: Loaded 50535 primary data records. [2025-10-09T22:41:01.882309] [DEBUG] [LOCAL ] LEN: Loaded 53560 existing records from primary storage. [2025-10-09T22:41:01.915397] [INFO ] [MAIN ] LEN: Loaded 53560 primary data records. [2025-10-09T22:41:02.611134] [DEBUG] [MAIN ] LEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:02.612308] [INFO ] [MAIN ] LEO: Generated 1807 derivative records from 17020 primary records. [2025-10-09T22:41:02.612634] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-09T22:41:02.640261] [DEBUG] [LOCAL ] LEO: Derivative data saved (1807 records). [2025-10-09T22:41:02.645597] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-09T22:41:02.647996] [INFO ] [MAIN ] Derivative Progress: 1075/1690 symbols completed. LEO took 1.1s. Estimated remaining: 3m 59s. Rate: 154.3 symbols/min [2025-10-09T22:41:02.648540] [DEBUG] [MAIN ] LEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:02.649811] [INFO ] [MAIN ] LEG: Generated 1807 derivative records from 50535 primary records. [2025-10-09T22:41:02.650722] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-09T22:41:02.648844] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:02.680454] [DEBUG] [MAIN ] LEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:02.683029] [DEBUG] [LOCAL ] LEG: Derivative data saved (1807 records). [2025-10-09T22:41:02.682801] [INFO ] [MAIN ] LEN: Generated 1807 derivative records from 53560 primary records. [2025-10-09T22:41:02.683170] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-09T22:41:02.685898] [INFO ] [MAIN ] Derivative Progress: 1076/1690 symbols completed. LEG took 1.2s. Estimated remaining: 3m 59s. Rate: 154.4 symbols/min [2025-10-09T22:41:02.683267] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-09T22:41:02.686145] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:02.704411] [DEBUG] [LOCAL ] LEN: Derivative data saved (1807 records). [2025-10-09T22:41:02.704672] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-09T22:41:02.716198] [INFO ] [MAIN ] Derivative Progress: 1077/1690 symbols completed. LEN took 1.2s. Estimated remaining: 3m 58s. Rate: 154.5 symbols/min [2025-10-09T22:41:02.716546] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:02.725723] [DEBUG] [LOCAL ] LFT: Loaded 18493 existing records from primary storage. [2025-10-09T22:41:02.725918] [INFO ] [MAIN ] LFT: Loaded 18493 primary data records. [2025-10-09T22:41:03.065626] [DEBUG] [LOCAL ] LEVI: Loaded 52062 existing records from primary storage. [2025-10-09T22:41:03.066790] [INFO ] [MAIN ] LEVI: Loaded 52062 primary data records. [2025-10-09T22:41:03.156562] [DEBUG] [LOCAL ] LH: Loaded 37996 existing records from primary storage. [2025-10-09T22:41:03.174981] [INFO ] [MAIN ] LH: Loaded 37996 primary data records. [2025-10-09T22:41:03.748185] [DEBUG] [MAIN ] LFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:03.749464] [INFO ] [MAIN ] LFT: Generated 1807 derivative records from 18493 primary records. [2025-10-09T22:41:03.750420] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-09T22:41:03.769632] [DEBUG] [LOCAL ] LFT: Derivative data saved (1807 records). [2025-10-09T22:41:03.770507] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-09T22:41:03.773897] [INFO ] [MAIN ] Derivative Progress: 1078/1690 symbols completed. LFT took 1.1s. Estimated remaining: 3m 58s. Rate: 154.3 symbols/min [2025-10-09T22:41:03.790814] [DEBUG] [MAIN ] LEVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:03.791494] [INFO ] [MAIN ] LEVI: Generated 1807 derivative records from 52062 primary records. [2025-10-09T22:41:03.791689] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-09T22:41:03.808444] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1807 records). [2025-10-09T22:41:03.808753] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-09T22:41:03.811332] [INFO ] [MAIN ] Derivative Progress: 1079/1690 symbols completed. LEVI took 1.2s. Estimated remaining: 3m 57s. Rate: 154.4 symbols/min [2025-10-09T22:41:03.826317] [DEBUG] [MAIN ] LH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:03.826977] [INFO ] [MAIN ] LH: Generated 1807 derivative records from 37996 primary records. [2025-10-09T22:41:03.827038] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-09T22:41:03.843179] [DEBUG] [LOCAL ] LH: Derivative data saved (1807 records). [2025-10-09T22:41:03.843292] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-09T22:41:03.846423] [INFO ] [MAIN ] Derivative Progress: 1080/1690 symbols completed. LH took 1.1s. Estimated remaining: 3m 57s. Rate: 154.5 symbols/min [2025-10-09T22:41:03.847047] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:03.846969] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:03.847344] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:03.887139] [DEBUG] [LOCAL ] LII: Loaded 28203 existing records from primary storage. [2025-10-09T22:41:03.897480] [INFO ] [MAIN ] LII: Loaded 28203 primary data records. [2025-10-09T22:41:04.017526] [DEBUG] [LOCAL ] LHX: Loaded 48939 existing records from primary storage. [2025-10-09T22:41:04.018220] [INFO ] [MAIN ] LHX: Loaded 48939 primary data records. [2025-10-09T22:41:04.174853] [DEBUG] [LOCAL ] LION: Loaded 45809 existing records from primary storage. [2025-10-09T22:41:04.321191] [INFO ] [MAIN ] LION: Loaded 45809 primary data records. [2025-10-09T22:41:04.877179] [DEBUG] [MAIN ] LII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:04.878088] [INFO ] [MAIN ] LII: Generated 1807 derivative records from 28203 primary records. [2025-10-09T22:41:04.878633] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-09T22:41:04.901795] [DEBUG] [LOCAL ] LII: Derivative data saved (1807 records). [2025-10-09T22:41:04.902716] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-09T22:41:04.905044] [INFO ] [MAIN ] Derivative Progress: 1081/1690 symbols completed. LII took 1.1s. Estimated remaining: 3m 57s. Rate: 154.3 symbols/min [2025-10-09T22:41:04.905375] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:04.921952] [DEBUG] [MAIN ] LHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:04.925586] [DEBUG] [LOCAL ] LITB: Loaded 4269 existing records from primary storage. [2025-10-09T22:41:04.926292] [INFO ] [MAIN ] LHX: Generated 1807 derivative records from 48939 primary records. [2025-10-09T22:41:04.925725] [INFO ] [MAIN ] LITB: Loaded 4269 primary data records. [2025-10-09T22:41:04.926423] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-09T22:41:05.019612] [DEBUG] [MAIN ] LION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:05.049263] [INFO ] [MAIN ] LION: Generated 1807 derivative records from 45809 primary records. [2025-10-09T22:41:05.053325] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-09T22:41:05.053276] [DEBUG] [LOCAL ] LHX: Derivative data saved (1807 records). [2025-10-09T22:41:05.057165] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-09T22:41:05.060460] [INFO ] [MAIN ] Derivative Progress: 1082/1690 symbols completed. LHX took 1.2s. Estimated remaining: 3m 56s. Rate: 154.4 symbols/min [2025-10-09T22:41:05.077845] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:05.307262] [DEBUG] [LOCAL ] LION: Derivative data saved (1807 records). [2025-10-09T22:41:05.307487] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-09T22:41:05.310248] [INFO ] [MAIN ] Derivative Progress: 1083/1690 symbols completed. LION took 1.5s. Estimated remaining: 3m 56s. Rate: 154.4 symbols/min [2025-10-09T22:41:05.310538] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:05.350441] [DEBUG] [MAIN ] LITB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:05.351206] [INFO ] [MAIN ] LITB: Generated 1807 derivative records from 4269 primary records. [2025-10-09T22:41:05.351379] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-09T22:41:05.365495] [DEBUG] [LOCAL ] LITB: Derivative data saved (1807 records). [2025-10-09T22:41:05.365606] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-09T22:41:05.367767] [INFO ] [MAIN ] Derivative Progress: 1084/1690 symbols completed. LITB took 0.5s. Estimated remaining: 3m 55s. Rate: 154.6 symbols/min [2025-10-09T22:41:05.367931] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:05.398777] [DEBUG] [LOCAL ] LLY: Loaded 53664 existing records from primary storage. [2025-10-09T22:41:05.399016] [INFO ] [MAIN ] LLY: Loaded 53664 primary data records. [2025-10-09T22:41:05.532082] [DEBUG] [LOCAL ] LMND: Loaded 52371 existing records from primary storage. [2025-10-09T22:41:05.543470] [INFO ] [MAIN ] LMND: Loaded 52371 primary data records. [2025-10-09T22:41:05.881927] [DEBUG] [LOCAL ] LMT: Loaded 50089 existing records from primary storage. [2025-10-09T22:41:05.910464] [INFO ] [MAIN ] LMT: Loaded 50089 primary data records. [2025-10-09T22:41:06.378214] [DEBUG] [MAIN ] LLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:06.380119] [INFO ] [MAIN ] LLY: Generated 1807 derivative records from 53664 primary records. [2025-10-09T22:41:06.382404] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-09T22:41:06.412830] [DEBUG] [LOCAL ] LLY: Derivative data saved (1807 records). [2025-10-09T22:41:06.413156] [DEBUG] [MAIN ] LMND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:06.413502] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-09T22:41:06.414451] [INFO ] [MAIN ] LMND: Generated 1807 derivative records from 52371 primary records. [2025-10-09T22:41:06.414698] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-09T22:41:06.416901] [INFO ] [MAIN ] Derivative Progress: 1085/1690 symbols completed. LLY took 1.3s. Estimated remaining: 3m 55s. Rate: 154.3 symbols/min [2025-10-09T22:41:06.417808] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:06.438095] [DEBUG] [LOCAL ] LMND: Derivative data saved (1807 records). [2025-10-09T22:41:06.445811] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-09T22:41:06.451028] [DEBUG] [MAIN ] LMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:06.454450] [INFO ] [MAIN ] LMT: Generated 1807 derivative records from 50089 primary records. [2025-10-09T22:41:06.454606] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-09T22:41:06.453674] [INFO ] [MAIN ] Derivative Progress: 1086/1690 symbols completed. LMND took 1.1s. Estimated remaining: 3m 55s. Rate: 154.4 symbols/min [2025-10-09T22:41:06.455371] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:06.475809] [DEBUG] [LOCAL ] LND: Loaded 4996 existing records from primary storage. [2025-10-09T22:41:06.477114] [INFO ] [MAIN ] LND: Loaded 4996 primary data records. [2025-10-09T22:41:06.477251] [DEBUG] [LOCAL ] LMT: Derivative data saved (1807 records). [2025-10-09T22:41:06.489026] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-09T22:41:06.501850] [INFO ] [MAIN ] Derivative Progress: 1087/1690 symbols completed. LMT took 1.1s. Estimated remaining: 3m 54s. Rate: 154.6 symbols/min [2025-10-09T22:41:06.525865] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:06.648414] [DEBUG] [LOCAL ] LNC: Loaded 51968 existing records from primary storage. [2025-10-09T22:41:06.688518] [INFO ] [MAIN ] LNC: Loaded 51968 primary data records. [2025-10-09T22:41:07.045162] [DEBUG] [LOCAL ] LNG: Loaded 51690 existing records from primary storage. [2025-10-09T22:41:07.045606] [INFO ] [MAIN ] LNG: Loaded 51690 primary data records. [2025-10-09T22:41:07.502032] [DEBUG] [MAIN ] LND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:07.532825] [INFO ] [MAIN ] LND: Generated 1807 derivative records from 4996 primary records. [2025-10-09T22:41:07.533192] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-09T22:41:07.550845] [DEBUG] [LOCAL ] LND: Derivative data saved (1807 records). [2025-10-09T22:41:07.551861] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-09T22:41:07.554350] [INFO ] [MAIN ] Derivative Progress: 1088/1690 symbols completed. LND took 1.1s. Estimated remaining: 3m 54s. Rate: 154.3 symbols/min [2025-10-09T22:41:07.554856] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:07.577622] [DEBUG] [MAIN ] LNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:07.578727] [INFO ] [MAIN ] LNC: Generated 1807 derivative records from 51968 primary records. [2025-10-09T22:41:07.579039] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-09T22:41:07.585309] [DEBUG] [LOCAL ] LNN: Loaded 11354 existing records from primary storage. [2025-10-09T22:41:07.585531] [INFO ] [MAIN ] LNN: Loaded 11354 primary data records. [2025-10-09T22:41:07.643789] [DEBUG] [LOCAL ] LNC: Derivative data saved (1807 records). [2025-10-09T22:41:07.665045] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-09T22:41:07.697325] [INFO ] [MAIN ] Derivative Progress: 1089/1690 symbols completed. LNC took 1.3s. Estimated remaining: 3m 54s. Rate: 154.4 symbols/min [2025-10-09T22:41:07.708311] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:07.732721] [DEBUG] [MAIN ] LNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:07.743920] [INFO ] [MAIN ] LNG: Generated 1807 derivative records from 51690 primary records. [2025-10-09T22:41:07.749160] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-09T22:41:07.938460] [DEBUG] [LOCAL ] LNG: Derivative data saved (1807 records). [2025-10-09T22:41:07.938833] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-09T22:41:07.941993] [INFO ] [MAIN ] Derivative Progress: 1090/1690 symbols completed. LNG took 1.4s. Estimated remaining: 3m 53s. Rate: 154.5 symbols/min [2025-10-09T22:41:07.942857] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:07.981688] [DEBUG] [LOCAL ] LOAR: Loaded 42335 existing records from primary storage. [2025-10-09T22:41:07.982368] [INFO ] [MAIN ] LOAR: Loaded 42335 primary data records. [2025-10-09T22:41:08.022310] [DEBUG] [LOCAL ] LOB: Loaded 27349 existing records from primary storage. [2025-10-09T22:41:08.061803] [INFO ] [MAIN ] LOB: Loaded 27349 primary data records. [2025-10-09T22:41:08.251431] [DEBUG] [MAIN ] LNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:08.291175] [INFO ] [MAIN ] LNN: Generated 1807 derivative records from 11354 primary records. [2025-10-09T22:41:08.291337] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-09T22:41:08.620531] [DEBUG] [LOCAL ] LNN: Derivative data saved (1807 records). [2025-10-09T22:41:08.621277] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-09T22:41:08.623765] [INFO ] [MAIN ] Derivative Progress: 1091/1690 symbols completed. LNN took 1.1s. Estimated remaining: 3m 53s. Rate: 154.4 symbols/min [2025-10-09T22:41:08.627076] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:08.634469] [DEBUG] [LOCAL ] LOCL: Loaded 3651 existing records from primary storage. [2025-10-09T22:41:08.635056] [INFO ] [MAIN ] LOCL: Loaded 3651 primary data records. [2025-10-09T22:41:08.779022] [DEBUG] [MAIN ] LOAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:08.784995] [INFO ] [MAIN ] LOAR: Generated 1807 derivative records from 42335 primary records. [2025-10-09T22:41:08.799713] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-09T22:41:08.963618] [DEBUG] [MAIN ] LOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:08.972089] [INFO ] [MAIN ] LOB: Generated 1807 derivative records from 27349 primary records. [2025-10-09T22:41:08.972203] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-09T22:41:08.990217] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1807 records). [2025-10-09T22:41:08.995722] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-09T22:41:08.998961] [INFO ] [MAIN ] Derivative Progress: 1092/1690 symbols completed. LOAR took 1.3s. Estimated remaining: 3m 52s. Rate: 154.4 symbols/min [2025-10-09T22:41:09.002309] [DEBUG] [LOCAL ] LOB: Derivative data saved (1807 records). [2025-10-09T22:41:09.002704] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-09T22:41:09.000472] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:09.005795] [INFO ] [MAIN ] Derivative Progress: 1093/1690 symbols completed. LOB took 1.1s. Estimated remaining: 3m 52s. Rate: 154.5 symbols/min [2025-10-09T22:41:09.026036] [DEBUG] [MAIN ] LOCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:09.026682] [INFO ] [MAIN ] LOCL: Generated 1807 derivative records from 3651 primary records. [2025-10-09T22:41:09.026822] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-09T22:41:09.049557] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1807 records). [2025-10-09T22:41:09.049620] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-09T22:41:09.052011] [INFO ] [MAIN ] Derivative Progress: 1094/1690 symbols completed. LOCL took 0.4s. Estimated remaining: 3m 51s. Rate: 154.6 symbols/min [2025-10-09T22:41:09.063959] [DEBUG] [LOCAL ] LOMA: Loaded 32538 existing records from primary storage. [2025-10-09T22:41:09.064100] [INFO ] [MAIN ] LOMA: Loaded 32538 primary data records. [2025-10-09T22:41:09.419808] [DEBUG] [MAIN ] LOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:09.420434] [INFO ] [MAIN ] LOMA: Generated 1807 derivative records from 32538 primary records. [2025-10-09T22:41:09.420495] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-09T22:41:09.436155] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1807 records). [2025-10-09T22:41:09.436214] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-09T22:41:09.438505] [INFO ] [MAIN ] Derivative Progress: 1095/1690 symbols completed. LOMA took 0.4s. Estimated remaining: 3m 51s. Rate: 154.6 symbols/min [2025-10-09T22:41:09.439161] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:09.439105] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:09.439272] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:09.475286] [DEBUG] [LOCAL ] LPL: Loaded 27712 existing records from primary storage. [2025-10-09T22:41:09.475562] [INFO ] [MAIN ] LPL: Loaded 27712 primary data records. [2025-10-09T22:41:09.612444] [DEBUG] [LOCAL ] LPG: Loaded 39911 existing records from primary storage. [2025-10-09T22:41:09.623060] [INFO ] [MAIN ] LPG: Loaded 39911 primary data records. [2025-10-09T22:41:09.734548] [DEBUG] [LOCAL ] LOW: Loaded 53366 existing records from primary storage. [2025-10-09T22:41:09.849092] [INFO ] [MAIN ] LOW: Loaded 53366 primary data records. [2025-10-09T22:41:10.483689] [DEBUG] [MAIN ] LPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:10.484506] [INFO ] [MAIN ] LPL: Generated 1807 derivative records from 27712 primary records. [2025-10-09T22:41:10.485702] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-09T22:41:10.503556] [DEBUG] [LOCAL ] LPL: Derivative data saved (1807 records). [2025-10-09T22:41:10.503784] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-09T22:41:10.505677] [INFO ] [MAIN ] Derivative Progress: 1096/1690 symbols completed. LPL took 1.1s. Estimated remaining: 3m 51s. Rate: 154.4 symbols/min [2025-10-09T22:41:10.505974] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:10.525409] [DEBUG] [MAIN ] LPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:10.533831] [INFO ] [MAIN ] LPG: Generated 1807 derivative records from 39911 primary records. [2025-10-09T22:41:10.534009] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-09T22:41:10.547196] [DEBUG] [MAIN ] LOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:10.551947] [INFO ] [MAIN ] LOW: Generated 1807 derivative records from 53366 primary records. [2025-10-09T22:41:10.552372] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-09T22:41:10.568397] [DEBUG] [LOCAL ] LPG: Derivative data saved (1807 records). [2025-10-09T22:41:10.580811] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-09T22:41:10.586377] [INFO ] [MAIN ] Derivative Progress: 1097/1690 symbols completed. LPG took 1.1s. Estimated remaining: 3m 50s. Rate: 154.5 symbols/min [2025-10-09T22:41:10.587284] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:10.588314] [DEBUG] [LOCAL ] LOW: Derivative data saved (1807 records). [2025-10-09T22:41:10.588823] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-09T22:41:10.592101] [INFO ] [MAIN ] Derivative Progress: 1098/1690 symbols completed. LOW took 1.2s. Estimated remaining: 3m 50s. Rate: 154.6 symbols/min [2025-10-09T22:41:10.592469] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:10.608366] [DEBUG] [LOCAL ] LPX: Loaded 40167 existing records from primary storage. [2025-10-09T22:41:10.608551] [INFO ] [MAIN ] LPX: Loaded 40167 primary data records. [2025-10-09T22:41:10.940772] [DEBUG] [LOCAL ] LSPD: Loaded 43111 existing records from primary storage. [2025-10-09T22:41:10.951987] [INFO ] [MAIN ] LSPD: Loaded 43111 primary data records. [2025-10-09T22:41:10.952731] [DEBUG] [LOCAL ] LRN: Loaded 39921 existing records from primary storage. [2025-10-09T22:41:10.952883] [INFO ] [MAIN ] LRN: Loaded 39921 primary data records. [2025-10-09T22:41:11.654618] [DEBUG] [MAIN ] LPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:11.656572] [INFO ] [MAIN ] LPX: Generated 1807 derivative records from 40167 primary records. [2025-10-09T22:41:11.656906] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-09T22:41:11.675117] [DEBUG] [LOCAL ] LPX: Derivative data saved (1807 records). [2025-10-09T22:41:11.676611] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-09T22:41:11.679779] [INFO ] [MAIN ] Derivative Progress: 1099/1690 symbols completed. LPX took 1.2s. Estimated remaining: 3m 50s. Rate: 154.4 symbols/min [2025-10-09T22:41:11.680078] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:11.697235] [DEBUG] [MAIN ] LSPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:11.699134] [INFO ] [MAIN ] LSPD: Generated 1807 derivative records from 43111 primary records. [2025-10-09T22:41:11.700130] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-09T22:41:11.725697] [DEBUG] [MAIN ] LRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:11.730292] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1807 records). [2025-10-09T22:41:11.731376] [INFO ] [MAIN ] LRN: Generated 1807 derivative records from 39921 primary records. [2025-10-09T22:41:11.744706] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-09T22:41:11.744237] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-09T22:41:11.748855] [INFO ] [MAIN ] Derivative Progress: 1100/1690 symbols completed. LSPD took 1.2s. Estimated remaining: 3m 49s. Rate: 154.5 symbols/min [2025-10-09T22:41:11.749546] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:11.776302] [DEBUG] [LOCAL ] LTC: Loaded 30454 existing records from primary storage. [2025-10-09T22:41:11.775736] [DEBUG] [LOCAL ] LRN: Derivative data saved (1807 records). [2025-10-09T22:41:11.776530] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-09T22:41:11.776608] [INFO ] [MAIN ] LTC: Loaded 30454 primary data records. [2025-10-09T22:41:11.779677] [INFO ] [MAIN ] Derivative Progress: 1101/1690 symbols completed. LRN took 1.2s. Estimated remaining: 3m 49s. Rate: 154.6 symbols/min [2025-10-09T22:41:11.780111] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:12.117310] [DEBUG] [LOCAL ] LTM: Loaded 38258 existing records from primary storage. [2025-10-09T22:41:12.117719] [INFO ] [MAIN ] LTM: Loaded 38258 primary data records. [2025-10-09T22:41:12.244229] [DEBUG] [LOCAL ] LTH: Loaded 52105 existing records from primary storage. [2025-10-09T22:41:12.244543] [INFO ] [MAIN ] LTH: Loaded 52105 primary data records. [2025-10-09T22:41:12.670626] [DEBUG] [MAIN ] LTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:12.790360] [INFO ] [MAIN ] LTC: Generated 1807 derivative records from 30454 primary records. [2025-10-09T22:41:12.791170] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-09T22:41:12.814059] [DEBUG] [LOCAL ] LTC: Derivative data saved (1807 records). [2025-10-09T22:41:12.815490] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-09T22:41:12.818246] [INFO ] [MAIN ] Derivative Progress: 1102/1690 symbols completed. LTC took 1.1s. Estimated remaining: 3m 49s. Rate: 154.4 symbols/min [2025-10-09T22:41:12.818766] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:12.837128] [DEBUG] [MAIN ] LTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:12.838002] [INFO ] [MAIN ] LTM: Generated 1807 derivative records from 38258 primary records. [2025-10-09T22:41:12.838132] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-09T22:41:12.858804] [DEBUG] [LOCAL ] LTM: Derivative data saved (1807 records). [2025-10-09T22:41:12.866538] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-09T22:41:12.868917] [INFO ] [MAIN ] Derivative Progress: 1103/1690 symbols completed. LTM took 1.1s. Estimated remaining: 3m 48s. Rate: 154.5 symbols/min [2025-10-09T22:41:12.873353] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:12.874456] [DEBUG] [MAIN ] LTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:12.886566] [INFO ] [MAIN ] LTH: Generated 1807 derivative records from 52105 primary records. [2025-10-09T22:41:12.886788] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-09T22:41:12.903849] [DEBUG] [LOCAL ] LTH: Derivative data saved (1807 records). [2025-10-09T22:41:12.904056] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-09T22:41:12.924459] [INFO ] [MAIN ] Derivative Progress: 1104/1690 symbols completed. LTH took 1.2s. Estimated remaining: 3m 47s. Rate: 154.6 symbols/min [2025-10-09T22:41:12.925837] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:12.927362] [DEBUG] [LOCAL ] LU: Loaded 49350 existing records from primary storage. [2025-10-09T22:41:12.927692] [INFO ] [MAIN ] LU: Loaded 49350 primary data records. [2025-10-09T22:41:13.002699] [DEBUG] [LOCAL ] LUCK: Loaded 24525 existing records from primary storage. [2025-10-09T22:41:13.015422] [INFO ] [MAIN ] LUCK: Loaded 24525 primary data records. [2025-10-09T22:41:13.480227] [DEBUG] [LOCAL ] LUMN: Loaded 54030 existing records from primary storage. [2025-10-09T22:41:13.612297] [INFO ] [MAIN ] LUMN: Loaded 54030 primary data records. [2025-10-09T22:41:13.955273] [DEBUG] [MAIN ] LU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:13.956514] [INFO ] [MAIN ] LU: Generated 1807 derivative records from 49350 primary records. [2025-10-09T22:41:13.956630] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-09T22:41:13.990741] [DEBUG] [MAIN ] LUCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:13.993075] [INFO ] [MAIN ] LUCK: Generated 1807 derivative records from 24525 primary records. [2025-10-09T22:41:13.992252] [DEBUG] [LOCAL ] LU: Derivative data saved (1807 records). [2025-10-09T22:41:13.993283] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-09T22:41:13.993373] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-09T22:41:13.996063] [INFO ] [MAIN ] Derivative Progress: 1105/1690 symbols completed. LU took 1.2s. Estimated remaining: 3m 47s. Rate: 154.4 symbols/min [2025-10-09T22:41:13.996512] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:14.015601] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1807 records). [2025-10-09T22:41:14.018500] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-09T22:41:14.021271] [INFO ] [MAIN ] Derivative Progress: 1106/1690 symbols completed. LUCK took 1.1s. Estimated remaining: 3m 47s. Rate: 154.5 symbols/min [2025-10-09T22:41:14.021458] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:14.035913] [DEBUG] [MAIN ] LUMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:14.036713] [INFO ] [MAIN ] LUMN: Generated 1807 derivative records from 54030 primary records. [2025-10-09T22:41:14.036873] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-09T22:41:14.058371] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1807 records). [2025-10-09T22:41:14.072117] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-09T22:41:14.075217] [INFO ] [MAIN ] Derivative Progress: 1107/1690 symbols completed. LUMN took 1.1s. Estimated remaining: 3m 46s. Rate: 154.6 symbols/min [2025-10-09T22:41:14.077772] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:14.116273] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-10-09T22:41:14.116565] [INFO ] [MAIN ] LUV: Loaded 54079 primary data records. [2025-10-09T22:41:14.187532] [DEBUG] [LOCAL ] LVWR: Loaded 18268 existing records from primary storage. [2025-10-09T22:41:14.222857] [INFO ] [MAIN ] LVWR: Loaded 18268 primary data records. [2025-10-09T22:41:14.297041] [DEBUG] [LOCAL ] LVS: Loaded 53959 existing records from primary storage. [2025-10-09T22:41:14.361717] [INFO ] [MAIN ] LVS: Loaded 53959 primary data records. [2025-10-09T22:41:15.166112] [DEBUG] [MAIN ] LUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:15.167174] [INFO ] [MAIN ] LUV: Generated 1807 derivative records from 54079 primary records. [2025-10-09T22:41:15.167352] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-09T22:41:15.200095] [DEBUG] [MAIN ] LVWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:15.201989] [INFO ] [MAIN ] LVWR: Generated 1807 derivative records from 18268 primary records. [2025-10-09T22:41:15.203063] [DEBUG] [LOCAL ] LUV: Derivative data saved (1807 records). [2025-10-09T22:41:15.203115] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-09T22:41:15.203970] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-09T22:41:15.213495] [INFO ] [MAIN ] Derivative Progress: 1108/1690 symbols completed. LUV took 1.2s. Estimated remaining: 3m 46s. Rate: 154.4 symbols/min [2025-10-09T22:41:15.223315] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1807 records). [2025-10-09T22:41:15.236878] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-09T22:41:15.239484] [INFO ] [MAIN ] Derivative Progress: 1109/1690 symbols completed. LVWR took 1.2s. Estimated remaining: 3m 46s. Rate: 154.5 symbols/min [2025-10-09T22:41:15.236798] [DEBUG] [MAIN ] LVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:15.240440] [INFO ] [MAIN ] LVS: Generated 1807 derivative records from 53959 primary records. [2025-10-09T22:41:15.240564] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-09T22:41:15.256278] [DEBUG] [LOCAL ] LVS: Derivative data saved (1807 records). [2025-10-09T22:41:15.256361] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-09T22:41:15.260241] [INFO ] [MAIN ] Derivative Progress: 1110/1690 symbols completed. LVS took 1.2s. Estimated remaining: 3m 45s. Rate: 154.6 symbols/min [2025-10-09T22:41:15.260705] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:15.260767] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:15.260887] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:15.280804] [DEBUG] [LOCAL ] LXFR: Loaded 16823 existing records from primary storage. [2025-10-09T22:41:15.281037] [INFO ] [MAIN ] LXFR: Loaded 16823 primary data records. [2025-10-09T22:41:15.635116] [DEBUG] [LOCAL ] LXP: Loaded 51100 existing records from primary storage. [2025-10-09T22:41:15.636328] [DEBUG] [LOCAL ] LW: Loaded 51599 existing records from primary storage. [2025-10-09T22:41:15.636533] [INFO ] [MAIN ] LW: Loaded 51599 primary data records. [2025-10-09T22:41:15.635348] [INFO ] [MAIN ] LXP: Loaded 51100 primary data records. [2025-10-09T22:41:16.255771] [DEBUG] [MAIN ] LXFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:16.258495] [INFO ] [MAIN ] LXFR: Generated 1807 derivative records from 16823 primary records. [2025-10-09T22:41:16.259305] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-09T22:41:16.295791] [DEBUG] [MAIN ] LW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:16.298226] [INFO ] [MAIN ] LW: Generated 1807 derivative records from 51599 primary records. [2025-10-09T22:41:16.299390] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-09T22:41:16.312017] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1807 records). [2025-10-09T22:41:16.313221] [DEBUG] [MAIN ] LXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:16.312976] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-09T22:41:16.325953] [INFO ] [MAIN ] Derivative Progress: 1111/1690 symbols completed. LXFR took 1.1s. Estimated remaining: 3m 45s. Rate: 154.4 symbols/min [2025-10-09T22:41:16.326318] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:16.327362] [INFO ] [MAIN ] LXP: Generated 1807 derivative records from 51100 primary records. [2025-10-09T22:41:16.327466] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-09T22:41:16.346091] [DEBUG] [LOCAL ] LW: Derivative data saved (1807 records). [2025-10-09T22:41:16.346483] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-09T22:41:16.350479] [INFO ] [MAIN ] Derivative Progress: 1112/1690 symbols completed. LW took 1.1s. Estimated remaining: 3m 44s. Rate: 154.5 symbols/min [2025-10-09T22:41:16.351541] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:16.360955] [DEBUG] [LOCAL ] LXP: Derivative data saved (1807 records). [2025-10-09T22:41:16.361189] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-09T22:41:16.364431] [INFO ] [MAIN ] Derivative Progress: 1113/1690 symbols completed. LXP took 1.1s. Estimated remaining: 3m 44s. Rate: 154.6 symbols/min [2025-10-09T22:41:16.364821] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:16.377814] [DEBUG] [LOCAL ] LXU: Loaded 32021 existing records from primary storage. [2025-10-09T22:41:16.378016] [INFO ] [MAIN ] LXU: Loaded 32021 primary data records. [2025-10-09T22:41:16.730389] [DEBUG] [LOCAL ] LYG: Loaded 53160 existing records from primary storage. [2025-10-09T22:41:16.732785] [INFO ] [MAIN ] LYG: Loaded 53160 primary data records. [2025-10-09T22:41:16.745713] [DEBUG] [LOCAL ] LYB: Loaded 53999 existing records from primary storage. [2025-10-09T22:41:16.798263] [INFO ] [MAIN ] LYB: Loaded 53999 primary data records. [2025-10-09T22:41:17.403790] [DEBUG] [MAIN ] LXU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:17.405245] [INFO ] [MAIN ] LXU: Generated 1807 derivative records from 32021 primary records. [2025-10-09T22:41:17.405666] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-09T22:41:17.428368] [DEBUG] [LOCAL ] LXU: Derivative data saved (1807 records). [2025-10-09T22:41:17.428830] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-09T22:41:17.431859] [INFO ] [MAIN ] Derivative Progress: 1114/1690 symbols completed. LXU took 1.1s. Estimated remaining: 3m 44s. Rate: 154.4 symbols/min [2025-10-09T22:41:17.432350] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:17.446063] [DEBUG] [MAIN ] LYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:17.447229] [INFO ] [MAIN ] LYG: Generated 1807 derivative records from 53160 primary records. [2025-10-09T22:41:17.447530] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-09T22:41:17.478478] [DEBUG] [MAIN ] LYB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:17.480231] [INFO ] [MAIN ] LYB: Generated 1807 derivative records from 53999 primary records. [2025-10-09T22:41:17.480573] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-09T22:41:17.481815] [DEBUG] [LOCAL ] LYG: Derivative data saved (1807 records). [2025-10-09T22:41:17.489417] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-09T22:41:17.498139] [INFO ] [MAIN ] Derivative Progress: 1115/1690 symbols completed. LYG took 1.1s. Estimated remaining: 3m 43s. Rate: 154.5 symbols/min [2025-10-09T22:41:17.499095] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:17.501488] [DEBUG] [LOCAL ] LYB: Derivative data saved (1807 records). [2025-10-09T22:41:17.501869] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-09T22:41:17.505477] [INFO ] [MAIN ] Derivative Progress: 1116/1690 symbols completed. LYB took 1.2s. Estimated remaining: 3m 43s. Rate: 154.7 symbols/min [2025-10-09T22:41:17.505812] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:17.536803] [DEBUG] [LOCAL ] LZM: Loaded 14501 existing records from primary storage. [2025-10-09T22:41:17.537038] [INFO ] [MAIN ] LZM: Loaded 14501 primary data records. [2025-10-09T22:41:17.665867] [DEBUG] [LOCAL ] LYV: Loaded 51511 existing records from primary storage. [2025-10-09T22:41:17.674799] [INFO ] [MAIN ] LYV: Loaded 51511 primary data records. [2025-10-09T22:41:17.702550] [DEBUG] [LOCAL ] LZB: Loaded 35263 existing records from primary storage. [2025-10-09T22:41:17.733768] [INFO ] [MAIN ] LZB: Loaded 35263 primary data records. [2025-10-09T22:41:18.490073] [DEBUG] [MAIN ] LZM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:18.491341] [INFO ] [MAIN ] LZM: Generated 1807 derivative records from 14501 primary records. [2025-10-09T22:41:18.491712] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-09T22:41:18.510386] [DEBUG] [LOCAL ] LZM: Derivative data saved (1807 records). [2025-10-09T22:41:18.510631] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-09T22:41:18.512761] [INFO ] [MAIN ] Derivative Progress: 1117/1690 symbols completed. LZM took 1.0s. Estimated remaining: 3m 43s. Rate: 154.4 symbols/min [2025-10-09T22:41:18.513049] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:18.534994] [DEBUG] [MAIN ] LZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:18.548665] [DEBUG] [MAIN ] LYV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:18.549270] [INFO ] [MAIN ] LYV: Generated 1807 derivative records from 51511 primary records. [2025-10-09T22:41:18.552285] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-09T22:41:18.548382] [INFO ] [MAIN ] LZB: Generated 1807 derivative records from 35263 primary records. [2025-10-09T22:41:18.553040] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-09T22:41:18.581612] [DEBUG] [LOCAL ] LZB: Derivative data saved (1807 records). [2025-10-09T22:41:18.582133] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-09T22:41:18.584860] [INFO ] [MAIN ] Derivative Progress: 1118/1690 symbols completed. LZB took 1.1s. Estimated remaining: 3m 42s. Rate: 154.5 symbols/min [2025-10-09T22:41:18.585312] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:18.588618] [DEBUG] [LOCAL ] LYV: Derivative data saved (1807 records). [2025-10-09T22:41:18.588748] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-09T22:41:18.591700] [INFO ] [MAIN ] Derivative Progress: 1119/1690 symbols completed. LYV took 1.2s. Estimated remaining: 3m 41s. Rate: 154.7 symbols/min [2025-10-09T22:41:18.591986] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:18.634970] [DEBUG] [LOCAL ] M: Loaded 53930 existing records from primary storage. [2025-10-09T22:41:18.635143] [INFO ] [MAIN ] M: Loaded 53930 primary data records. [2025-10-09T22:41:18.804811] [DEBUG] [LOCAL ] MAA: Loaded 42937 existing records from primary storage. [2025-10-09T22:41:18.871876] [INFO ] [MAIN ] MAA: Loaded 42937 primary data records. [2025-10-09T22:41:18.988322] [DEBUG] [LOCAL ] MA: Loaded 52878 existing records from primary storage. [2025-10-09T22:41:19.001249] [INFO ] [MAIN ] MA: Loaded 52878 primary data records. [2025-10-09T22:41:19.888362] [DEBUG] [MAIN ] M: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:19.909216] [INFO ] [MAIN ] M: Generated 1807 derivative records from 53930 primary records. [2025-10-09T22:41:19.910809] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-09T22:41:19.951835] [DEBUG] [LOCAL ] M: Derivative data saved (1807 records). [2025-10-09T22:41:19.953518] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-09T22:41:19.956766] [INFO ] [MAIN ] Derivative Progress: 1120/1690 symbols completed. M took 1.4s. Estimated remaining: 3m 42s. Rate: 154.3 symbols/min [2025-10-09T22:41:19.957737] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:19.980634] [DEBUG] [MAIN ] MAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:19.982064] [INFO ] [MAIN ] MAA: Generated 1807 derivative records from 42937 primary records. [2025-10-09T22:41:19.982429] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-09T22:41:20.011117] [DEBUG] [LOCAL ] MAA: Derivative data saved (1807 records). [2025-10-09T22:41:20.012281] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-09T22:41:20.016579] [INFO ] [MAIN ] Derivative Progress: 1121/1690 symbols completed. MAA took 1.4s. Estimated remaining: 3m 41s. Rate: 154.5 symbols/min [2025-10-09T22:41:20.017239] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:20.031862] [DEBUG] [MAIN ] MA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:20.032798] [INFO ] [MAIN ] MA: Generated 1807 derivative records from 52878 primary records. [2025-10-09T22:41:20.032996] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-09T22:41:20.064939] [DEBUG] [LOCAL ] MA: Derivative data saved (1807 records). [2025-10-09T22:41:20.065170] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-09T22:41:20.068801] [INFO ] [MAIN ] Derivative Progress: 1122/1690 symbols completed. MA took 1.5s. Estimated remaining: 3m 40s. Rate: 154.6 symbols/min [2025-10-09T22:41:20.069225] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:20.107185] [DEBUG] [LOCAL ] MAC: Loaded 49954 existing records from primary storage. [2025-10-09T22:41:20.107671] [INFO ] [MAIN ] MAC: Loaded 49954 primary data records. [2025-10-09T22:41:20.240236] [DEBUG] [LOCAL ] MAGN: Loaded 35945 existing records from primary storage. [2025-10-09T22:41:20.250781] [INFO ] [MAIN ] MAGN: Loaded 35945 primary data records. [2025-10-09T22:41:20.498905] [DEBUG] [LOCAL ] MAIN: Loaded 41726 existing records from primary storage. [2025-10-09T22:41:20.499141] [INFO ] [MAIN ] MAIN: Loaded 41726 primary data records. [2025-10-09T22:41:21.138223] [DEBUG] [MAIN ] MAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:21.139317] [INFO ] [MAIN ] MAC: Generated 1807 derivative records from 49954 primary records. [2025-10-09T22:41:21.146807] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-09T22:41:21.152668] [DEBUG] [MAIN ] MAGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:21.161168] [INFO ] [MAIN ] MAGN: Generated 1807 derivative records from 35945 primary records. [2025-10-09T22:41:21.161279] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-09T22:41:21.170305] [DEBUG] [LOCAL ] MAC: Derivative data saved (1807 records). [2025-10-09T22:41:21.177705] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-09T22:41:21.179839] [INFO ] [MAIN ] Derivative Progress: 1123/1690 symbols completed. MAC took 1.2s. Estimated remaining: 3m 40s. Rate: 154.3 symbols/min [2025-10-09T22:41:21.190133] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1807 records). [2025-10-09T22:41:21.190332] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-09T22:41:21.193782] [INFO ] [MAIN ] Derivative Progress: 1124/1690 symbols completed. MAGN took 1.2s. Estimated remaining: 3m 40s. Rate: 154.4 symbols/min [2025-10-09T22:41:21.206319] [DEBUG] [MAIN ] MAIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:21.206908] [INFO ] [MAIN ] MAIN: Generated 1807 derivative records from 41726 primary records. [2025-10-09T22:41:21.206968] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-09T22:41:21.222595] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1807 records). [2025-10-09T22:41:21.222680] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-09T22:41:21.226576] [INFO ] [MAIN ] Derivative Progress: 1125/1690 symbols completed. MAIN took 1.2s. Estimated remaining: 3m 39s. Rate: 154.6 symbols/min [2025-10-09T22:41:21.226947] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:21.227048] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:21.227121] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:21.267149] [DEBUG] [LOCAL ] MANU: Loaded 26944 existing records from primary storage. [2025-10-09T22:41:21.267432] [INFO ] [MAIN ] MANU: Loaded 26944 primary data records. [2025-10-09T22:41:21.396447] [DEBUG] [LOCAL ] MAN: Loaded 43985 existing records from primary storage. [2025-10-09T22:41:21.402294] [INFO ] [MAIN ] MAN: Loaded 43985 primary data records. [2025-10-09T22:41:21.515271] [DEBUG] [LOCAL ] MAS: Loaded 52645 existing records from primary storage. [2025-10-09T22:41:21.697186] [INFO ] [MAIN ] MAS: Loaded 52645 primary data records. [2025-10-09T22:41:22.253293] [DEBUG] [MAIN ] MANU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:22.254194] [INFO ] [MAIN ] MANU: Generated 1807 derivative records from 26944 primary records. [2025-10-09T22:41:22.254392] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-09T22:41:22.272530] [DEBUG] [LOCAL ] MANU: Derivative data saved (1807 records). [2025-10-09T22:41:22.273479] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-09T22:41:22.276056] [INFO ] [MAIN ] Derivative Progress: 1126/1690 symbols completed. MANU took 1.0s. Estimated remaining: 3m 39s. Rate: 154.3 symbols/min [2025-10-09T22:41:22.276274] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:22.293304] [DEBUG] [MAIN ] MAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:22.294942] [INFO ] [MAIN ] MAN: Generated 1807 derivative records from 43985 primary records. [2025-10-09T22:41:22.295007] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-09T22:41:22.327361] [DEBUG] [MAIN ] MAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:22.330451] [INFO ] [MAIN ] MAS: Generated 1807 derivative records from 52645 primary records. [2025-10-09T22:41:22.330533] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-09T22:41:22.343384] [DEBUG] [LOCAL ] MAN: Derivative data saved (1807 records). [2025-10-09T22:41:22.344360] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-09T22:41:22.347313] [INFO ] [MAIN ] Derivative Progress: 1127/1690 symbols completed. MAN took 1.1s. Estimated remaining: 3m 39s. Rate: 154.5 symbols/min [2025-10-09T22:41:22.350484] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:22.363597] [DEBUG] [LOCAL ] MAS: Derivative data saved (1807 records). [2025-10-09T22:41:22.363767] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-09T22:41:22.367083] [INFO ] [MAIN ] Derivative Progress: 1128/1690 symbols completed. MAS took 1.1s. Estimated remaining: 3m 38s. Rate: 154.6 symbols/min [2025-10-09T22:41:22.367687] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:22.384186] [DEBUG] [LOCAL ] MATV: Loaded 36134 existing records from primary storage. [2025-10-09T22:41:22.384370] [INFO ] [MAIN ] MATV: Loaded 36134 primary data records. [2025-10-09T22:41:22.510198] [DEBUG] [LOCAL ] MAX: Loaded 31210 existing records from primary storage. [2025-10-09T22:41:22.516247] [INFO ] [MAIN ] MAX: Loaded 31210 primary data records. [2025-10-09T22:41:22.828473] [DEBUG] [LOCAL ] MATX: Loaded 31582 existing records from primary storage. [2025-10-09T22:41:22.839965] [INFO ] [MAIN ] MATX: Loaded 31582 primary data records. [2025-10-09T22:41:23.356745] [DEBUG] [MAIN ] MATV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:41:23.358036] [INFO ] [MAIN ] MATV: Generated 1806 derivative records from 36134 primary records. [2025-10-09T22:41:23.358128] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-09T22:41:23.376117] [DEBUG] [LOCAL ] MATV: Derivative data saved (1806 records). [2025-10-09T22:41:23.377098] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-09T22:41:23.380319] [INFO ] [MAIN ] Derivative Progress: 1129/1690 symbols completed. MATV took 1.1s. Estimated remaining: 3m 38s. Rate: 154.4 symbols/min [2025-10-09T22:41:23.380599] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:23.395619] [DEBUG] [MAIN ] MAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:23.396787] [INFO ] [MAIN ] MAX: Generated 1807 derivative records from 31210 primary records. [2025-10-09T22:41:23.396961] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-09T22:41:23.415992] [DEBUG] [LOCAL ] MAX: Derivative data saved (1807 records). [2025-10-09T22:41:23.417023] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-09T22:41:23.421722] [INFO ] [MAIN ] Derivative Progress: 1130/1690 symbols completed. MAX took 1.1s. Estimated remaining: 3m 37s. Rate: 154.5 symbols/min [2025-10-09T22:41:23.422037] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:23.436050] [DEBUG] [MAIN ] MATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:23.436808] [INFO ] [MAIN ] MATX: Generated 1807 derivative records from 31582 primary records. [2025-10-09T22:41:23.436898] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-09T22:41:23.467970] [DEBUG] [LOCAL ] MATX: Derivative data saved (1807 records). [2025-10-09T22:41:23.468147] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-09T22:41:23.471577] [INFO ] [MAIN ] Derivative Progress: 1131/1690 symbols completed. MATX took 1.1s. Estimated remaining: 3m 37s. Rate: 154.6 symbols/min [2025-10-09T22:41:23.472434] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:23.492694] [DEBUG] [LOCAL ] MBI: Loaded 24418 existing records from primary storage. [2025-10-09T22:41:23.493948] [INFO ] [MAIN ] MBI: Loaded 24418 primary data records. [2025-10-09T22:41:23.526267] [DEBUG] [LOCAL ] MBC: Loaded 43932 existing records from primary storage. [2025-10-09T22:41:23.538773] [INFO ] [MAIN ] MBC: Loaded 43932 primary data records. [2025-10-09T22:41:24.173073] [DEBUG] [LOCAL ] MC: Loaded 44235 existing records from primary storage. [2025-10-09T22:41:24.173412] [INFO ] [MAIN ] MC: Loaded 44235 primary data records. [2025-10-09T22:41:24.504632] [DEBUG] [MAIN ] MBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:24.506153] [INFO ] [MAIN ] MBI: Generated 1807 derivative records from 24418 primary records. [2025-10-09T22:41:24.506705] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-09T22:41:24.525350] [DEBUG] [LOCAL ] MBI: Derivative data saved (1807 records). [2025-10-09T22:41:24.526221] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-09T22:41:24.528360] [INFO ] [MAIN ] Derivative Progress: 1132/1690 symbols completed. MBI took 1.1s. Estimated remaining: 3m 37s. Rate: 154.4 symbols/min [2025-10-09T22:41:24.529834] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:24.544799] [DEBUG] [MAIN ] MBC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:41:24.545812] [INFO ] [MAIN ] MBC: Generated 1806 derivative records from 43932 primary records. [2025-10-09T22:41:24.545934] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-09T22:41:24.571145] [DEBUG] [LOCAL ] MBC: Derivative data saved (1806 records). [2025-10-09T22:41:24.571323] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-09T22:41:24.571590] [DEBUG] [LOCAL ] MCB: Loaded 11314 existing records from primary storage. [2025-10-09T22:41:24.574322] [INFO ] [MAIN ] Derivative Progress: 1133/1690 symbols completed. MBC took 1.2s. Estimated remaining: 3m 36s. Rate: 154.5 symbols/min [2025-10-09T22:41:24.574446] [INFO ] [MAIN ] MCB: Loaded 11314 primary data records. [2025-10-09T22:41:24.574599] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:24.685002] [DEBUG] [MAIN ] MC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:24.702394] [INFO ] [MAIN ] MC: Generated 1807 derivative records from 44235 primary records. [2025-10-09T22:41:24.701445] [DEBUG] [LOCAL ] MCI: Loaded 6510 existing records from primary storage. [2025-10-09T22:41:24.702955] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-09T22:41:24.702540] [INFO ] [MAIN ] MCI: Loaded 6510 primary data records. [2025-10-09T22:41:24.851128] [DEBUG] [LOCAL ] MC: Derivative data saved (1807 records). [2025-10-09T22:41:24.877737] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-09T22:41:25.043953] [INFO ] [MAIN ] Derivative Progress: 1134/1690 symbols completed. MC took 1.6s. Estimated remaining: 3m 36s. Rate: 154.5 symbols/min [2025-10-09T22:41:25.050841] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:25.291541] [DEBUG] [MAIN ] MCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:25.292504] [INFO ] [MAIN ] MCB: Generated 1807 derivative records from 11314 primary records. [2025-10-09T22:41:25.292806] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-09T22:41:25.320307] [DEBUG] [LOCAL ] MCB: Derivative data saved (1807 records). [2025-10-09T22:41:25.344951] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-09T22:41:25.347244] [DEBUG] [LOCAL ] MCK: Loaded 39077 existing records from primary storage. [2025-10-09T22:41:25.350205] [INFO ] [MAIN ] MCK: Loaded 39077 primary data records. [2025-10-09T22:41:25.350023] [DEBUG] [MAIN ] MCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:25.351202] [INFO ] [MAIN ] MCI: Generated 1807 derivative records from 6510 primary records. [2025-10-09T22:41:25.349495] [INFO ] [MAIN ] Derivative Progress: 1135/1690 symbols completed. MCB took 0.8s. Estimated remaining: 3m 36s. Rate: 154.5 symbols/min [2025-10-09T22:41:25.364148] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-09T22:41:25.405820] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:25.493983] [DEBUG] [LOCAL ] MCI: Derivative data saved (1807 records). [2025-10-09T22:41:25.514077] [DEBUG] [LOCAL ] MCN: Loaded 8218 existing records from primary storage. [2025-10-09T22:41:25.524633] [INFO ] [MAIN ] MCN: Loaded 8218 primary data records. [2025-10-09T22:41:25.513738] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-09T22:41:25.584013] [INFO ] [MAIN ] Derivative Progress: 1136/1690 symbols completed. MCI took 1.0s. Estimated remaining: 3m 35s. Rate: 154.5 symbols/min [2025-10-09T22:41:25.626461] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:26.086506] [DEBUG] [LOCAL ] MCO: Loaded 39546 existing records from primary storage. [2025-10-09T22:41:26.086745] [INFO ] [MAIN ] MCO: Loaded 39546 primary data records. [2025-10-09T22:41:26.197930] [DEBUG] [MAIN ] MCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:26.210050] [INFO ] [MAIN ] MCK: Generated 1807 derivative records from 39077 primary records. [2025-10-09T22:41:26.216056] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-09T22:41:26.434809] [DEBUG] [LOCAL ] MCK: Derivative data saved (1807 records). [2025-10-09T22:41:26.448797] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-09T22:41:26.448578] [DEBUG] [MAIN ] MCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:26.451320] [INFO ] [MAIN ] Derivative Progress: 1137/1690 symbols completed. MCK took 1.4s. Estimated remaining: 3m 35s. Rate: 154.4 symbols/min [2025-10-09T22:41:26.451670] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:26.452601] [INFO ] [MAIN ] MCN: Generated 1807 derivative records from 8218 primary records. [2025-10-09T22:41:26.454069] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-09T22:41:26.481375] [DEBUG] [LOCAL ] MCN: Derivative data saved (1807 records). [2025-10-09T22:41:26.481547] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-09T22:41:26.479308] [DEBUG] [LOCAL ] MCR: Loaded 8949 existing records from primary storage. [2025-10-09T22:41:26.481809] [INFO ] [MAIN ] MCR: Loaded 8949 primary data records. [2025-10-09T22:41:26.490767] [INFO ] [MAIN ] Derivative Progress: 1138/1690 symbols completed. MCN took 1.1s. Estimated remaining: 3m 34s. Rate: 154.5 symbols/min [2025-10-09T22:41:26.815234] [DEBUG] [MAIN ] MCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:26.816035] [INFO ] [MAIN ] MCO: Generated 1807 derivative records from 39546 primary records. [2025-10-09T22:41:26.816561] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-09T22:41:26.834250] [DEBUG] [LOCAL ] MCO: Derivative data saved (1807 records). [2025-10-09T22:41:26.834463] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-09T22:41:26.837700] [INFO ] [MAIN ] Derivative Progress: 1139/1690 symbols completed. MCO took 1.2s. Estimated remaining: 3m 34s. Rate: 154.5 symbols/min [2025-10-09T22:41:26.857719] [DEBUG] [MAIN ] MCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:26.858354] [INFO ] [MAIN ] MCR: Generated 1807 derivative records from 8949 primary records. [2025-10-09T22:41:26.858414] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-09T22:41:26.875039] [DEBUG] [LOCAL ] MCR: Derivative data saved (1807 records). [2025-10-09T22:41:26.875255] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-09T22:41:26.878427] [INFO ] [MAIN ] Derivative Progress: 1140/1690 symbols completed. MCR took 0.4s. Estimated remaining: 3m 33s. Rate: 154.6 symbols/min [2025-10-09T22:41:26.879365] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:26.879268] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:26.879819] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:26.919956] [DEBUG] [LOCAL ] MCY: Loaded 24125 existing records from primary storage. [2025-10-09T22:41:26.920214] [INFO ] [MAIN ] MCY: Loaded 24125 primary data records. [2025-10-09T22:41:26.919274] [DEBUG] [LOCAL ] MCS: Loaded 21106 existing records from primary storage. [2025-10-09T22:41:26.920471] [INFO ] [MAIN ] MCS: Loaded 21106 primary data records. [2025-10-09T22:41:27.117408] [DEBUG] [LOCAL ] MD: Loaded 38768 existing records from primary storage. [2025-10-09T22:41:27.156698] [INFO ] [MAIN ] MD: Loaded 38768 primary data records. [2025-10-09T22:41:28.055565] [DEBUG] [MAIN ] MCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:28.062924] [DEBUG] [MAIN ] MCY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:28.062419] [INFO ] [MAIN ] MCS: Generated 1807 derivative records from 21106 primary records. [2025-10-09T22:41:28.063523] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-09T22:41:28.064437] [INFO ] [MAIN ] MCY: Generated 1807 derivative records from 24125 primary records. [2025-10-09T22:41:28.064625] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-09T22:41:28.101687] [DEBUG] [LOCAL ] MCY: Derivative data saved (1807 records). [2025-10-09T22:41:28.105530] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-09T22:41:28.110881] [INFO ] [MAIN ] Derivative Progress: 1141/1690 symbols completed. MCY took 1.2s. Estimated remaining: 3m 33s. Rate: 154.3 symbols/min [2025-10-09T22:41:28.106896] [DEBUG] [LOCAL ] MCS: Derivative data saved (1807 records). [2025-10-09T22:41:28.116668] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:28.117022] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-09T22:41:28.126528] [DEBUG] [MAIN ] MD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:28.127325] [INFO ] [MAIN ] MD: Generated 1807 derivative records from 38768 primary records. [2025-10-09T22:41:28.127502] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-09T22:41:28.129998] [INFO ] [MAIN ] Derivative Progress: 1142/1690 symbols completed. MCS took 1.3s. Estimated remaining: 3m 33s. Rate: 154.5 symbols/min [2025-10-09T22:41:28.131155] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:28.151027] [DEBUG] [LOCAL ] MDST: Loaded 5842 existing records from primary storage. [2025-10-09T22:41:28.152054] [INFO ] [MAIN ] MDST: Loaded 5842 primary data records. [2025-10-09T22:41:28.261266] [DEBUG] [LOCAL ] MD: Derivative data saved (1807 records). [2025-10-09T22:41:28.276407] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-09T22:41:28.285500] [INFO ] [MAIN ] Derivative Progress: 1143/1690 symbols completed. MD took 1.4s. Estimated remaining: 3m 32s. Rate: 154.6 symbols/min [2025-10-09T22:41:28.296663] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:28.531285] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-10-09T22:41:28.531943] [INFO ] [MAIN ] MDT: Loaded 54068 primary data records. [2025-10-09T22:41:28.893477] [DEBUG] [LOCAL ] MDU: Loaded 48351 existing records from primary storage. [2025-10-09T22:41:28.899238] [DEBUG] [MAIN ] MDST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:28.910488] [INFO ] [MAIN ] MDST: Generated 1807 derivative records from 5842 primary records. [2025-10-09T22:41:28.910868] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-09T22:41:28.911180] [INFO ] [MAIN ] MDU: Loaded 48351 primary data records. [2025-10-09T22:41:29.054763] [DEBUG] [LOCAL ] MDST: Derivative data saved (1807 records). [2025-10-09T22:41:29.071457] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-09T22:41:29.080723] [INFO ] [MAIN ] Derivative Progress: 1144/1690 symbols completed. MDST took 1.0s. Estimated remaining: 3m 32s. Rate: 154.4 symbols/min [2025-10-09T22:41:29.106720] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:29.275801] [DEBUG] [LOCAL ] MDV: Loaded 8589 existing records from primary storage. [2025-10-09T22:41:29.276311] [INFO ] [MAIN ] MDV: Loaded 8589 primary data records. [2025-10-09T22:41:29.409395] [DEBUG] [MAIN ] MDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:29.415351] [INFO ] [MAIN ] MDT: Generated 1807 derivative records from 54068 primary records. [2025-10-09T22:41:29.416162] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-09T22:41:29.499857] [DEBUG] [LOCAL ] MDT: Derivative data saved (1807 records). [2025-10-09T22:41:29.524591] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-09T22:41:29.528178] [INFO ] [MAIN ] Derivative Progress: 1145/1690 symbols completed. MDT took 1.4s. Estimated remaining: 3m 32s. Rate: 154.4 symbols/min [2025-10-09T22:41:29.716765] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:29.751532] [DEBUG] [MAIN ] MDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:29.752590] [INFO ] [MAIN ] MDU: Generated 1807 derivative records from 48351 primary records. [2025-10-09T22:41:29.757419] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-09T22:41:29.779040] [DEBUG] [LOCAL ] MDU: Derivative data saved (1807 records). [2025-10-09T22:41:29.779882] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-09T22:41:29.790925] [INFO ] [MAIN ] Derivative Progress: 1146/1690 symbols completed. MDU took 1.5s. Estimated remaining: 3m 31s. Rate: 154.4 symbols/min [2025-10-09T22:41:29.792164] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:29.793134] [DEBUG] [LOCAL ] MEC: Loaded 16410 existing records from primary storage. [2025-10-09T22:41:29.793953] [INFO ] [MAIN ] MEC: Loaded 16410 primary data records. [2025-10-09T22:41:29.941570] [DEBUG] [MAIN ] MDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:30.005089] [DEBUG] [LOCAL ] MED: Loaded 21505 existing records from primary storage. [2025-10-09T22:41:30.006443] [INFO ] [MAIN ] MDV: Generated 1807 derivative records from 8589 primary records. [2025-10-09T22:41:30.023796] [INFO ] [MAIN ] MED: Loaded 21505 primary data records. [2025-10-09T22:41:30.024010] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-09T22:41:30.271775] [DEBUG] [LOCAL ] MDV: Derivative data saved (1807 records). [2025-10-09T22:41:30.279270] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-09T22:41:30.302300] [INFO ] [MAIN ] Derivative Progress: 1147/1690 symbols completed. MDV took 1.2s. Estimated remaining: 3m 31s. Rate: 154.4 symbols/min [2025-10-09T22:41:30.309409] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:30.550990] [DEBUG] [LOCAL ] MEG: Loaded 31669 existing records from primary storage. [2025-10-09T22:41:30.551393] [INFO ] [MAIN ] MEG: Loaded 31669 primary data records. [2025-10-09T22:41:30.576222] [DEBUG] [MAIN ] MEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:30.620834] [INFO ] [MAIN ] MEC: Generated 1807 derivative records from 16410 primary records. [2025-10-09T22:41:30.641105] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-09T22:41:30.896102] [DEBUG] [LOCAL ] MEC: Derivative data saved (1807 records). [2025-10-09T22:41:30.896768] [DEBUG] [MAIN ] MED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:30.897617] [INFO ] [MAIN ] MED: Generated 1807 derivative records from 21505 primary records. [2025-10-09T22:41:30.896830] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-09T22:41:30.900592] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-09T22:41:30.900480] [INFO ] [MAIN ] Derivative Progress: 1148/1690 symbols completed. MEC took 1.2s. Estimated remaining: 3m 31s. Rate: 154.3 symbols/min [2025-10-09T22:41:30.902766] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:30.919934] [DEBUG] [LOCAL ] MED: Derivative data saved (1807 records). [2025-10-09T22:41:30.920218] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-09T22:41:30.922786] [INFO ] [MAIN ] Derivative Progress: 1149/1690 symbols completed. MED took 1.1s. Estimated remaining: 3m 30s. Rate: 154.4 symbols/min [2025-10-09T22:41:30.923169] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:30.945219] [DEBUG] [LOCAL ] MEGI: Loaded 20095 existing records from primary storage. [2025-10-09T22:41:30.945572] [INFO ] [MAIN ] MEGI: Loaded 20095 primary data records. [2025-10-09T22:41:31.011949] [DEBUG] [MAIN ] MEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:31.027911] [INFO ] [MAIN ] MEG: Generated 1807 derivative records from 31669 primary records. [2025-10-09T22:41:31.067521] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-09T22:41:31.097676] [DEBUG] [LOCAL ] MEI: Loaded 32020 existing records from primary storage. [2025-10-09T22:41:31.103313] [INFO ] [MAIN ] MEI: Loaded 32020 primary data records. [2025-10-09T22:41:31.238776] [DEBUG] [LOCAL ] MEG: Derivative data saved (1807 records). [2025-10-09T22:41:31.308895] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-09T22:41:31.433752] [INFO ] [MAIN ] Derivative Progress: 1150/1690 symbols completed. MEG took 1.1s. Estimated remaining: 3m 30s. Rate: 154.4 symbols/min [2025-10-09T22:41:31.457425] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:31.655894] [DEBUG] [MAIN ] MEGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:31.656872] [INFO ] [MAIN ] MEGI: Generated 1807 derivative records from 20095 primary records. [2025-10-09T22:41:31.656969] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-09T22:41:31.706353] [DEBUG] [LOCAL ] MET: Loaded 53712 existing records from primary storage. [2025-10-09T22:41:31.718959] [INFO ] [MAIN ] MET: Loaded 53712 primary data records. [2025-10-09T22:41:31.719454] [DEBUG] [MAIN ] MEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:31.718868] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1807 records). [2025-10-09T22:41:31.761479] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-09T22:41:31.773779] [INFO ] [MAIN ] MEI: Generated 1807 derivative records from 32020 primary records. [2025-10-09T22:41:31.776106] [INFO ] [MAIN ] Derivative Progress: 1151/1690 symbols completed. MEGI took 0.9s. Estimated remaining: 3m 29s. Rate: 154.4 symbols/min [2025-10-09T22:41:31.776226] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-09T22:41:31.776309] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:31.899504] [DEBUG] [LOCAL ] MEI: Derivative data saved (1807 records). [2025-10-09T22:41:31.935381] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-09T22:41:32.092444] [INFO ] [MAIN ] Derivative Progress: 1152/1690 symbols completed. MEI took 1.1s. Estimated remaining: 3m 29s. Rate: 154.4 symbols/min [2025-10-09T22:41:32.102243] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:32.121524] [DEBUG] [LOCAL ] MFAN: Loaded 4401 existing records from primary storage. [2025-10-09T22:41:32.122037] [INFO ] [MAIN ] MFAN: Loaded 4401 primary data records. [2025-10-09T22:41:32.251013] [DEBUG] [LOCAL ] MFA: Loaded 46023 existing records from primary storage. [2025-10-09T22:41:32.267043] [INFO ] [MAIN ] MFA: Loaded 46023 primary data records. [2025-10-09T22:41:32.623480] [DEBUG] [MAIN ] MET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:32.660492] [INFO ] [MAIN ] MET: Generated 1807 derivative records from 53712 primary records. [2025-10-09T22:41:32.692702] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-09T22:41:32.846146] [DEBUG] [LOCAL ] MET: Derivative data saved (1807 records). [2025-10-09T22:41:32.847513] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-09T22:41:32.850360] [INFO ] [MAIN ] Derivative Progress: 1153/1690 symbols completed. MET took 1.4s. Estimated remaining: 3m 29s. Rate: 154.3 symbols/min [2025-10-09T22:41:32.876544] [DEBUG] [MAIN ] MFAN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:41:32.878049] [INFO ] [MAIN ] MFAN: Generated 1806 derivative records from 4401 primary records. [2025-10-09T22:41:32.878317] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-09T22:41:32.901065] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1806 records). [2025-10-09T22:41:32.901357] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-09T22:41:32.903818] [INFO ] [MAIN ] Derivative Progress: 1154/1690 symbols completed. MFAN took 0.8s. Estimated remaining: 3m 28s. Rate: 154.4 symbols/min [2025-10-09T22:41:32.917750] [DEBUG] [MAIN ] MFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:32.918679] [INFO ] [MAIN ] MFA: Generated 1807 derivative records from 46023 primary records. [2025-10-09T22:41:32.918750] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-09T22:41:32.935592] [DEBUG] [LOCAL ] MFA: Derivative data saved (1807 records). [2025-10-09T22:41:32.935730] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-09T22:41:32.939177] [INFO ] [MAIN ] Derivative Progress: 1155/1690 symbols completed. MFA took 1.2s. Estimated remaining: 3m 28s. Rate: 154.6 symbols/min [2025-10-09T22:41:32.939880] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:32.939993] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:32.940193] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:32.948908] [DEBUG] [LOCAL ] MFAO: Loaded 3989 existing records from primary storage. [2025-10-09T22:41:32.948993] [INFO ] [MAIN ] MFAO: Loaded 3989 primary data records. [2025-10-09T22:41:33.080826] [DEBUG] [LOCAL ] MFM: Loaded 14939 existing records from primary storage. [2025-10-09T22:41:33.081625] [INFO ] [MAIN ] MFM: Loaded 14939 primary data records. [2025-10-09T22:41:33.431180] [DEBUG] [LOCAL ] MFC: Loaded 51462 existing records from primary storage. [2025-10-09T22:41:33.442578] [INFO ] [MAIN ] MFC: Loaded 51462 primary data records. [2025-10-09T22:41:34.040193] [DEBUG] [MAIN ] MFAO: Filtered 6966 bins outside market hours, 7765 incomplete bins [2025-10-09T22:41:34.041484] [INFO ] [MAIN ] MFAO: Generated 1801 derivative records from 3989 primary records. [2025-10-09T22:41:34.043060] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-09T22:41:34.060109] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1801 records). [2025-10-09T22:41:34.060464] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-09T22:41:34.062894] [INFO ] [MAIN ] Derivative Progress: 1156/1690 symbols completed. MFAO took 1.1s. Estimated remaining: 3m 28s. Rate: 154.3 symbols/min [2025-10-09T22:41:34.063073] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:34.082359] [DEBUG] [MAIN ] MFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:34.083209] [INFO ] [MAIN ] MFM: Generated 1807 derivative records from 14939 primary records. [2025-10-09T22:41:34.083377] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-09T22:41:34.106301] [DEBUG] [MAIN ] MFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:34.112302] [INFO ] [MAIN ] MFC: Generated 1807 derivative records from 51462 primary records. [2025-10-09T22:41:34.112788] [DEBUG] [LOCAL ] MFSG: Loaded 5647 existing records from primary storage. [2025-10-09T22:41:34.116791] [INFO ] [MAIN ] MFSG: Loaded 5647 primary data records. [2025-10-09T22:41:34.115954] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-09T22:41:34.116737] [DEBUG] [LOCAL ] MFM: Derivative data saved (1807 records). [2025-10-09T22:41:34.147419] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-09T22:41:34.155060] [INFO ] [MAIN ] Derivative Progress: 1157/1690 symbols completed. MFM took 1.2s. Estimated remaining: 3m 27s. Rate: 154.4 symbols/min [2025-10-09T22:41:34.155216] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:34.235612] [DEBUG] [LOCAL ] MFC: Derivative data saved (1807 records). [2025-10-09T22:41:34.235807] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-09T22:41:34.238602] [INFO ] [MAIN ] Derivative Progress: 1158/1690 symbols completed. MFC took 1.3s. Estimated remaining: 3m 27s. Rate: 154.5 symbols/min [2025-10-09T22:41:34.238964] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:34.305601] [DEBUG] [LOCAL ] MFSI: Loaded 11854 existing records from primary storage. [2025-10-09T22:41:34.326817] [INFO ] [MAIN ] MFSI: Loaded 11854 primary data records. [2025-10-09T22:41:34.435735] [DEBUG] [LOCAL ] MFSV: Loaded 2715 existing records from primary storage. [2025-10-09T22:41:34.469780] [INFO ] [MAIN ] MFSV: Loaded 2715 primary data records. [2025-10-09T22:41:35.079855] [DEBUG] [MAIN ] MFSG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:41:35.081953] [INFO ] [MAIN ] MFSG: Generated 1806 derivative records from 5647 primary records. [2025-10-09T22:41:35.082753] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-09T22:41:35.100924] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1806 records). [2025-10-09T22:41:35.101068] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-09T22:41:35.103671] [INFO ] [MAIN ] Derivative Progress: 1159/1690 symbols completed. MFSG took 1.0s. Estimated remaining: 3m 26s. Rate: 154.3 symbols/min [2025-10-09T22:41:35.103856] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:35.128841] [DEBUG] [MAIN ] MFSV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:41:35.129945] [INFO ] [MAIN ] MFSV: Generated 1805 derivative records from 2715 primary records. [2025-10-09T22:41:35.130137] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-09T22:41:35.149025] [DEBUG] [LOCAL ] MG: Loaded 16256 existing records from primary storage. [2025-10-09T22:41:35.159775] [DEBUG] [MAIN ] MFSI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:41:35.160504] [INFO ] [MAIN ] MFSI: Generated 1806 derivative records from 11854 primary records. [2025-10-09T22:41:35.155407] [INFO ] [MAIN ] MG: Loaded 16256 primary data records. [2025-10-09T22:41:35.164300] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-09T22:41:35.164370] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1805 records). [2025-10-09T22:41:35.194738] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-09T22:41:35.209310] [INFO ] [MAIN ] Derivative Progress: 1160/1690 symbols completed. MFSV took 1.0s. Estimated remaining: 3m 26s. Rate: 154.4 symbols/min [2025-10-09T22:41:35.221193] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:35.283936] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1806 records). [2025-10-09T22:41:35.284154] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-09T22:41:35.292516] [INFO ] [MAIN ] Derivative Progress: 1161/1690 symbols completed. MFSI took 1.1s. Estimated remaining: 3m 25s. Rate: 154.5 symbols/min [2025-10-09T22:41:35.292753] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:35.482873] [DEBUG] [LOCAL ] MGF: Loaded 4311 existing records from primary storage. [2025-10-09T22:41:35.483124] [INFO ] [MAIN ] MGF: Loaded 4311 primary data records. [2025-10-09T22:41:35.637076] [DEBUG] [LOCAL ] MGA: Loaded 51027 existing records from primary storage. [2025-10-09T22:41:35.655415] [INFO ] [MAIN ] MGA: Loaded 51027 primary data records. [2025-10-09T22:41:36.173991] [DEBUG] [MAIN ] MG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:36.176069] [INFO ] [MAIN ] MG: Generated 1807 derivative records from 16256 primary records. [2025-10-09T22:41:36.176502] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-09T22:41:36.198230] [DEBUG] [LOCAL ] MG: Derivative data saved (1807 records). [2025-10-09T22:41:36.198624] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-09T22:41:36.201306] [INFO ] [MAIN ] Derivative Progress: 1162/1690 symbols completed. MG took 1.1s. Estimated remaining: 3m 25s. Rate: 154.4 symbols/min [2025-10-09T22:41:36.201702] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:36.216025] [DEBUG] [MAIN ] MGF: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:41:36.217014] [INFO ] [MAIN ] MGF: Generated 1806 derivative records from 4311 primary records. [2025-10-09T22:41:36.217160] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-09T22:41:36.235149] [DEBUG] [LOCAL ] MGF: Derivative data saved (1806 records). [2025-10-09T22:41:36.235358] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-09T22:41:36.238431] [INFO ] [MAIN ] Derivative Progress: 1163/1690 symbols completed. MGF took 0.9s. Estimated remaining: 3m 25s. Rate: 154.5 symbols/min [2025-10-09T22:41:36.246182] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:36.255080] [DEBUG] [MAIN ] MGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:36.255998] [INFO ] [MAIN ] MGA: Generated 1807 derivative records from 51027 primary records. [2025-10-09T22:41:36.256191] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-09T22:41:36.274012] [DEBUG] [LOCAL ] MGA: Derivative data saved (1807 records). [2025-10-09T22:41:36.274224] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-09T22:41:36.276720] [INFO ] [MAIN ] Derivative Progress: 1164/1690 symbols completed. MGA took 1.1s. Estimated remaining: 3m 24s. Rate: 154.6 symbols/min [2025-10-09T22:41:36.280214] [DEBUG] [LOCAL ] MGR: Loaded 5676 existing records from primary storage. [2025-10-09T22:41:36.280381] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:36.280593] [INFO ] [MAIN ] MGR: Loaded 5676 primary data records. [2025-10-09T22:41:36.387236] [DEBUG] [LOCAL ] MGRB: Loaded 4084 existing records from primary storage. [2025-10-09T22:41:36.404402] [INFO ] [MAIN ] MGRB: Loaded 4084 primary data records. [2025-10-09T22:41:36.759986] [DEBUG] [LOCAL ] MGM: Loaded 53997 existing records from primary storage. [2025-10-09T22:41:36.789582] [INFO ] [MAIN ] MGM: Loaded 53997 primary data records. [2025-10-09T22:41:37.232867] [DEBUG] [MAIN ] MGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:37.233888] [INFO ] [MAIN ] MGR: Generated 1807 derivative records from 5676 primary records. [2025-10-09T22:41:37.234005] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-09T22:41:37.262802] [DEBUG] [MAIN ] MGRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:37.263952] [INFO ] [MAIN ] MGRB: Generated 1807 derivative records from 4084 primary records. [2025-10-09T22:41:37.264562] [DEBUG] [LOCAL ] MGR: Derivative data saved (1807 records). [2025-10-09T22:41:37.264771] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-09T22:41:37.264692] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-09T22:41:37.268205] [INFO ] [MAIN ] Derivative Progress: 1165/1690 symbols completed. MGR took 1.0s. Estimated remaining: 3m 24s. Rate: 154.4 symbols/min [2025-10-09T22:41:37.275048] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:37.283877] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1807 records). [2025-10-09T22:41:37.284270] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-09T22:41:37.286997] [INFO ] [MAIN ] Derivative Progress: 1166/1690 symbols completed. MGRB took 1.0s. Estimated remaining: 3m 23s. Rate: 154.5 symbols/min [2025-10-09T22:41:37.287184] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:37.292807] [DEBUG] [LOCAL ] MGRD: Loaded 2259 existing records from primary storage. [2025-10-09T22:41:37.294224] [INFO ] [MAIN ] MGRD: Loaded 2259 primary data records. [2025-10-09T22:41:37.378421] [DEBUG] [LOCAL ] MGRE: Loaded 6738 existing records from primary storage. [2025-10-09T22:41:37.384588] [INFO ] [MAIN ] MGRE: Loaded 6738 primary data records. [2025-10-09T22:41:37.379161] [DEBUG] [MAIN ] MGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:37.430470] [INFO ] [MAIN ] MGM: Generated 1807 derivative records from 53997 primary records. [2025-10-09T22:41:37.459374] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-09T22:41:37.614960] [DEBUG] [LOCAL ] MGM: Derivative data saved (1807 records). [2025-10-09T22:41:37.779519] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-09T22:41:37.819235] [INFO ] [MAIN ] Derivative Progress: 1167/1690 symbols completed. MGM took 1.6s. Estimated remaining: 3m 23s. Rate: 154.5 symbols/min [2025-10-09T22:41:37.828279] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:38.000627] [DEBUG] [MAIN ] MGRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:38.001670] [INFO ] [MAIN ] MGRD: Generated 1807 derivative records from 2259 primary records. [2025-10-09T22:41:38.001771] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-09T22:41:38.032431] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1807 records). [2025-10-09T22:41:38.058891] [DEBUG] [MAIN ] MGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:38.058578] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-09T22:41:38.059609] [INFO ] [MAIN ] MGRE: Generated 1807 derivative records from 6738 primary records. [2025-10-09T22:41:38.062895] [INFO ] [MAIN ] Derivative Progress: 1168/1690 symbols completed. MGRD took 0.8s. Estimated remaining: 3m 23s. Rate: 154.5 symbols/min [2025-10-09T22:41:38.063007] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-09T22:41:38.060513] [DEBUG] [LOCAL ] MGY: Loaded 52781 existing records from primary storage. [2025-10-09T22:41:38.063981] [INFO ] [MAIN ] MGY: Loaded 52781 primary data records. [2025-10-09T22:41:38.178169] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1807 records). [2025-10-09T22:41:38.178298] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-09T22:41:38.180804] [INFO ] [MAIN ] Derivative Progress: 1169/1690 symbols completed. MGRE took 0.9s. Estimated remaining: 3m 22s. Rate: 154.6 symbols/min [2025-10-09T22:41:38.385939] [DEBUG] [MAIN ] MGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:38.386594] [INFO ] [MAIN ] MGY: Generated 1807 derivative records from 52781 primary records. [2025-10-09T22:41:38.386683] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-09T22:41:38.402520] [DEBUG] [LOCAL ] MGY: Derivative data saved (1807 records). [2025-10-09T22:41:38.402593] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-09T22:41:38.405267] [INFO ] [MAIN ] Derivative Progress: 1170/1690 symbols completed. MGY took 0.6s. Estimated remaining: 3m 22s. Rate: 154.7 symbols/min [2025-10-09T22:41:38.405988] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:38.406086] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:38.406269] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:38.425129] [DEBUG] [LOCAL ] MHF: Loaded 8854 existing records from primary storage. [2025-10-09T22:41:38.425940] [INFO ] [MAIN ] MHF: Loaded 8854 primary data records. [2025-10-09T22:41:38.467964] [DEBUG] [LOCAL ] MHD: Loaded 12533 existing records from primary storage. [2025-10-09T22:41:38.486571] [INFO ] [MAIN ] MHD: Loaded 12533 primary data records. [2025-10-09T22:41:38.769132] [DEBUG] [LOCAL ] MHK: Loaded 42490 existing records from primary storage. [2025-10-09T22:41:38.900898] [INFO ] [MAIN ] MHK: Loaded 42490 primary data records. [2025-10-09T22:41:39.439350] [DEBUG] [MAIN ] MHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:39.440754] [INFO ] [MAIN ] MHF: Generated 1807 derivative records from 8854 primary records. [2025-10-09T22:41:39.439914] [DEBUG] [MAIN ] MHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:39.440855] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-09T22:41:39.442031] [INFO ] [MAIN ] MHD: Generated 1807 derivative records from 12533 primary records. [2025-10-09T22:41:39.442412] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-09T22:41:39.473985] [DEBUG] [LOCAL ] MHF: Derivative data saved (1807 records). [2025-10-09T22:41:39.474638] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-09T22:41:39.477456] [INFO ] [MAIN ] Derivative Progress: 1171/1690 symbols completed. MHF took 1.1s. Estimated remaining: 3m 22s. Rate: 154.4 symbols/min [2025-10-09T22:41:39.477739] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:39.479862] [DEBUG] [LOCAL ] MHD: Derivative data saved (1807 records). [2025-10-09T22:41:39.480049] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-09T22:41:39.490248] [INFO ] [MAIN ] Derivative Progress: 1172/1690 symbols completed. MHD took 1.1s. Estimated remaining: 3m 21s. Rate: 154.6 symbols/min [2025-10-09T22:41:39.497701] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:39.497399] [DEBUG] [MAIN ] MHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:39.498944] [INFO ] [MAIN ] MHK: Generated 1807 derivative records from 42490 primary records. [2025-10-09T22:41:39.499369] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-09T22:41:39.522619] [DEBUG] [LOCAL ] MHK: Derivative data saved (1807 records). [2025-10-09T22:41:39.522898] [DEBUG] [LOCAL ] MHN: Loaded 7623 existing records from primary storage. [2025-10-09T22:41:39.523136] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-09T22:41:39.525854] [INFO ] [MAIN ] Derivative Progress: 1173/1690 symbols completed. MHK took 1.1s. Estimated remaining: 3m 21s. Rate: 154.7 symbols/min [2025-10-09T22:41:39.525977] [INFO ] [MAIN ] MHN: Loaded 7623 primary data records. [2025-10-09T22:41:39.531387] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:39.658687] [DEBUG] [LOCAL ] MHO: Loaded 23931 existing records from primary storage. [2025-10-09T22:41:39.679720] [DEBUG] [LOCAL ] MIN: Loaded 13702 existing records from primary storage. [2025-10-09T22:41:39.685028] [INFO ] [MAIN ] MIN: Loaded 13702 primary data records. [2025-10-09T22:41:39.698792] [INFO ] [MAIN ] MHO: Loaded 23931 primary data records. [2025-10-09T22:41:40.516556] [DEBUG] [MAIN ] MHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:40.517586] [INFO ] [MAIN ] MHN: Generated 1807 derivative records from 7623 primary records. [2025-10-09T22:41:40.517980] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-09T22:41:40.533224] [DEBUG] [LOCAL ] MHN: Derivative data saved (1807 records). [2025-10-09T22:41:40.533404] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-09T22:41:40.536080] [INFO ] [MAIN ] Derivative Progress: 1174/1690 symbols completed. MHN took 1.1s. Estimated remaining: 3m 20s. Rate: 154.5 symbols/min [2025-10-09T22:41:40.537376] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:40.552755] [DEBUG] [MAIN ] MIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:40.554262] [INFO ] [MAIN ] MIN: Generated 1807 derivative records from 13702 primary records. [2025-10-09T22:41:40.555674] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-09T22:41:40.581769] [DEBUG] [MAIN ] MHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:40.584541] [DEBUG] [LOCAL ] MIN: Derivative data saved (1807 records). [2025-10-09T22:41:40.584722] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-09T22:41:40.584473] [INFO ] [MAIN ] MHO: Generated 1807 derivative records from 23931 primary records. [2025-10-09T22:41:40.584831] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-09T22:41:40.587374] [INFO ] [MAIN ] Derivative Progress: 1175/1690 symbols completed. MIN took 1.1s. Estimated remaining: 3m 20s. Rate: 154.6 symbols/min [2025-10-09T22:41:40.588300] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:40.605856] [DEBUG] [LOCAL ] MITP: Loaded 2367 existing records from primary storage. [2025-10-09T22:41:40.606382] [INFO ] [MAIN ] MITP: Loaded 2367 primary data records. [2025-10-09T22:41:40.623364] [DEBUG] [LOCAL ] MHO: Derivative data saved (1807 records). [2025-10-09T22:41:40.628677] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-09T22:41:40.646474] [INFO ] [MAIN ] Derivative Progress: 1176/1690 symbols completed. MHO took 1.1s. Estimated remaining: 3m 19s. Rate: 154.7 symbols/min [2025-10-09T22:41:40.699473] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:40.815476] [DEBUG] [LOCAL ] MIR: Loaded 51525 existing records from primary storage. [2025-10-09T22:41:40.838709] [INFO ] [MAIN ] MIR: Loaded 51525 primary data records. [2025-10-09T22:41:41.059813] [DEBUG] [LOCAL ] MITT: Loaded 22868 existing records from primary storage. [2025-10-09T22:41:41.069098] [INFO ] [MAIN ] MITT: Loaded 22868 primary data records. [2025-10-09T22:41:41.665681] [DEBUG] [MAIN ] MITP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:41:41.667030] [INFO ] [MAIN ] MITP: Generated 1806 derivative records from 2367 primary records. [2025-10-09T22:41:41.667359] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-09T22:41:41.683099] [DEBUG] [LOCAL ] MITP: Derivative data saved (1806 records). [2025-10-09T22:41:41.683742] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-09T22:41:41.686251] [INFO ] [MAIN ] Derivative Progress: 1177/1690 symbols completed. MITP took 1.1s. Estimated remaining: 3m 19s. Rate: 154.5 symbols/min [2025-10-09T22:41:41.686521] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:41.706783] [DEBUG] [MAIN ] MIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:41.707529] [INFO ] [MAIN ] MIR: Generated 1807 derivative records from 51525 primary records. [2025-10-09T22:41:41.707748] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-09T22:41:41.711600] [DEBUG] [LOCAL ] MIY: Loaded 6177 existing records from primary storage. [2025-10-09T22:41:41.711966] [INFO ] [MAIN ] MIY: Loaded 6177 primary data records. [2025-10-09T22:41:41.843430] [DEBUG] [MAIN ] MITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:41.843921] [DEBUG] [LOCAL ] MIR: Derivative data saved (1807 records). [2025-10-09T22:41:41.844282] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-09T22:41:41.855315] [INFO ] [MAIN ] MITT: Generated 1807 derivative records from 22868 primary records. [2025-10-09T22:41:41.862775] [INFO ] [MAIN ] Derivative Progress: 1178/1690 symbols completed. MIR took 1.3s. Estimated remaining: 3m 19s. Rate: 154.6 symbols/min [2025-10-09T22:41:41.862905] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-09T22:41:41.868127] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:42.056266] [DEBUG] [LOCAL ] MITT: Derivative data saved (1807 records). [2025-10-09T22:41:42.056540] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-09T22:41:42.059325] [INFO ] [MAIN ] Derivative Progress: 1179/1690 symbols completed. MITT took 1.4s. Estimated remaining: 3m 18s. Rate: 154.6 symbols/min [2025-10-09T22:41:42.059684] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:42.123189] [DEBUG] [MAIN ] MIY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:42.124584] [INFO ] [MAIN ] MIY: Generated 1807 derivative records from 6177 primary records. [2025-10-09T22:41:42.125160] [DEBUG] [LOCAL ] MKL: Loaded 34417 existing records from primary storage. [2025-10-09T22:41:42.125702] [INFO ] [MAIN ] MKL: Loaded 34417 primary data records. [2025-10-09T22:41:42.125376] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-09T22:41:42.184224] [DEBUG] [LOCAL ] MKC: Loaded 52908 existing records from primary storage. [2025-10-09T22:41:42.239018] [INFO ] [MAIN ] MKC: Loaded 52908 primary data records. [2025-10-09T22:41:42.279891] [DEBUG] [LOCAL ] MIY: Derivative data saved (1807 records). [2025-10-09T22:41:42.339289] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-09T22:41:42.401259] [INFO ] [MAIN ] Derivative Progress: 1180/1690 symbols completed. MIY took 0.7s. Estimated remaining: 3m 18s. Rate: 154.6 symbols/min [2025-10-09T22:41:42.452046] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:42.797081] [DEBUG] [MAIN ] MKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:42.799026] [INFO ] [MAIN ] MKL: Generated 1807 derivative records from 34417 primary records. [2025-10-09T22:41:42.799452] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-09T22:41:42.826249] [DEBUG] [LOCAL ] MKL: Derivative data saved (1807 records). [2025-10-09T22:41:42.826458] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-09T22:41:42.829877] [INFO ] [MAIN ] Derivative Progress: 1181/1690 symbols completed. MKL took 0.8s. Estimated remaining: 3m 18s. Rate: 154.6 symbols/min [2025-10-09T22:41:42.830489] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:42.845463] [DEBUG] [LOCAL ] MLI: Loaded 43753 existing records from primary storage. [2025-10-09T22:41:42.846481] [INFO ] [MAIN ] MLI: Loaded 43753 primary data records. [2025-10-09T22:41:42.913814] [DEBUG] [MAIN ] MKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:42.934906] [INFO ] [MAIN ] MKC: Generated 1807 derivative records from 52908 primary records. [2025-10-09T22:41:42.940271] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-09T22:41:43.079989] [DEBUG] [LOCAL ] MKC: Derivative data saved (1807 records). [2025-10-09T22:41:43.186071] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-09T22:41:43.201275] [INFO ] [MAIN ] Derivative Progress: 1182/1690 symbols completed. MKC took 1.3s. Estimated remaining: 3m 17s. Rate: 154.6 symbols/min [2025-10-09T22:41:43.204169] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:43.203942] [DEBUG] [LOCAL ] MLM: Loaded 29591 existing records from primary storage. [2025-10-09T22:41:43.204803] [INFO ] [MAIN ] MLM: Loaded 29591 primary data records. [2025-10-09T22:41:43.591436] [DEBUG] [LOCAL ] MLNK: Loaded 26036 existing records from primary storage. [2025-10-09T22:41:43.591751] [INFO ] [MAIN ] MLNK: Loaded 26036 primary data records. [2025-10-09T22:41:43.728890] [DEBUG] [MAIN ] MLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:43.757245] [INFO ] [MAIN ] MLI: Generated 1807 derivative records from 43753 primary records. [2025-10-09T22:41:43.781344] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-09T22:41:43.956114] [DEBUG] [LOCAL ] MLI: Derivative data saved (1807 records). [2025-10-09T22:41:43.956544] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-09T22:41:43.959326] [INFO ] [MAIN ] Derivative Progress: 1183/1690 symbols completed. MLI took 1.5s. Estimated remaining: 3m 17s. Rate: 154.5 symbols/min [2025-10-09T22:41:43.979087] [DEBUG] [MAIN ] MLM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:43.979946] [INFO ] [MAIN ] MLM: Generated 1807 derivative records from 29591 primary records. [2025-10-09T22:41:43.980054] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-09T22:41:43.999253] [DEBUG] [LOCAL ] MLM: Derivative data saved (1807 records). [2025-10-09T22:41:43.999597] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-09T22:41:44.003343] [INFO ] [MAIN ] Derivative Progress: 1184/1690 symbols completed. MLM took 1.2s. Estimated remaining: 3m 16s. Rate: 154.6 symbols/min [2025-10-09T22:41:44.019088] [DEBUG] [MAIN ] MLNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:44.019748] [INFO ] [MAIN ] MLNK: Generated 1807 derivative records from 26036 primary records. [2025-10-09T22:41:44.019810] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-09T22:41:44.035370] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1807 records). [2025-10-09T22:41:44.035428] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-09T22:41:44.038199] [INFO ] [MAIN ] Derivative Progress: 1185/1690 symbols completed. MLNK took 0.8s. Estimated remaining: 3m 16s. Rate: 154.7 symbols/min [2025-10-09T22:41:44.038635] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:44.038824] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:44.038733] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:44.049805] [DEBUG] [LOCAL ] MLP: Loaded 3019 existing records from primary storage. [2025-10-09T22:41:44.049940] [INFO ] [MAIN ] MLP: Loaded 3019 primary data records. [2025-10-09T22:41:44.139346] [DEBUG] [LOCAL ] MLR: Loaded 12506 existing records from primary storage. [2025-10-09T22:41:44.162085] [INFO ] [MAIN ] MLR: Loaded 12506 primary data records. [2025-10-09T22:41:44.689792] [DEBUG] [LOCAL ] MMC: Loaded 52256 existing records from primary storage. [2025-10-09T22:41:44.699122] [INFO ] [MAIN ] MMC: Loaded 52256 primary data records. [2025-10-09T22:41:45.073047] [DEBUG] [MAIN ] MLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:45.075177] [INFO ] [MAIN ] MLP: Generated 1807 derivative records from 3019 primary records. [2025-10-09T22:41:45.075522] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-09T22:41:45.097264] [DEBUG] [MAIN ] MLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:45.101525] [INFO ] [MAIN ] MLR: Generated 1807 derivative records from 12506 primary records. [2025-10-09T22:41:45.104835] [DEBUG] [LOCAL ] MLP: Derivative data saved (1807 records). [2025-10-09T22:41:45.104932] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-09T22:41:45.107786] [INFO ] [MAIN ] Derivative Progress: 1186/1690 symbols completed. MLP took 1.1s. Estimated remaining: 3m 16s. Rate: 154.5 symbols/min [2025-10-09T22:41:45.107911] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-09T22:41:45.108956] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:45.130436] [DEBUG] [LOCAL ] MLR: Derivative data saved (1807 records). [2025-10-09T22:41:45.135169] [DEBUG] [LOCAL ] MMD: Loaded 11288 existing records from primary storage. [2025-10-09T22:41:45.135334] [INFO ] [MAIN ] MMD: Loaded 11288 primary data records. [2025-10-09T22:41:45.135583] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-09T22:41:45.158753] [INFO ] [MAIN ] Derivative Progress: 1187/1690 symbols completed. MLR took 1.1s. Estimated remaining: 3m 15s. Rate: 154.6 symbols/min [2025-10-09T22:41:45.169218] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:45.295523] [DEBUG] [MAIN ] MMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:45.370149] [INFO ] [MAIN ] MMC: Generated 1807 derivative records from 52256 primary records. [2025-10-09T22:41:45.371017] [DEBUG] [LOCAL ] MMI: Loaded 15336 existing records from primary storage. [2025-10-09T22:41:45.493189] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-09T22:41:45.501702] [INFO ] [MAIN ] MMI: Loaded 15336 primary data records. [2025-10-09T22:41:45.669290] [DEBUG] [LOCAL ] MMC: Derivative data saved (1807 records). [2025-10-09T22:41:45.678706] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-09T22:41:45.706623] [INFO ] [MAIN ] Derivative Progress: 1188/1690 symbols completed. MMC took 1.7s. Estimated remaining: 3m 15s. Rate: 154.6 symbols/min [2025-10-09T22:41:45.866122] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:45.901159] [DEBUG] [MAIN ] MMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:45.902217] [INFO ] [MAIN ] MMD: Generated 1807 derivative records from 11288 primary records. [2025-10-09T22:41:45.902451] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-09T22:41:45.921490] [DEBUG] [LOCAL ] MMD: Derivative data saved (1807 records). [2025-10-09T22:41:45.921793] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-09T22:41:45.924487] [INFO ] [MAIN ] Derivative Progress: 1189/1690 symbols completed. MMD took 0.8s. Estimated remaining: 3m 14s. Rate: 154.6 symbols/min [2025-10-09T22:41:45.925855] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:45.942409] [DEBUG] [MAIN ] MMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:45.957122] [INFO ] [MAIN ] MMI: Generated 1807 derivative records from 15336 primary records. [2025-10-09T22:41:45.957359] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-09T22:41:45.978805] [DEBUG] [LOCAL ] MMI: Derivative data saved (1807 records). [2025-10-09T22:41:45.995759] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-09T22:41:45.998591] [INFO ] [MAIN ] Derivative Progress: 1190/1690 symbols completed. MMI took 0.8s. Estimated remaining: 3m 14s. Rate: 154.7 symbols/min [2025-10-09T22:41:46.008485] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:46.008131] [DEBUG] [LOCAL ] MMM: Loaded 53509 existing records from primary storage. [2025-10-09T22:41:46.009451] [INFO ] [MAIN ] MMM: Loaded 53509 primary data records. [2025-10-09T22:41:46.131034] [DEBUG] [LOCAL ] MMS: Loaded 34085 existing records from primary storage. [2025-10-09T22:41:46.141546] [INFO ] [MAIN ] MMS: Loaded 34085 primary data records. [2025-10-09T22:41:46.167720] [DEBUG] [LOCAL ] MMT: Loaded 10601 existing records from primary storage. [2025-10-09T22:41:46.187460] [INFO ] [MAIN ] MMT: Loaded 10601 primary data records. [2025-10-09T22:41:47.012991] [DEBUG] [MAIN ] MMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:47.014156] [INFO ] [MAIN ] MMM: Generated 1807 derivative records from 53509 primary records. [2025-10-09T22:41:47.014446] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-09T22:41:47.052286] [DEBUG] [MAIN ] MMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:47.053106] [INFO ] [MAIN ] MMT: Generated 1807 derivative records from 10601 primary records. [2025-10-09T22:41:47.051708] [DEBUG] [LOCAL ] MMM: Derivative data saved (1807 records). [2025-10-09T22:41:47.060893] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-09T22:41:47.053316] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-09T22:41:47.070201] [INFO ] [MAIN ] Derivative Progress: 1191/1690 symbols completed. MMM took 1.2s. Estimated remaining: 3m 14s. Rate: 154.5 symbols/min [2025-10-09T22:41:47.070687] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:47.067540] [DEBUG] [MAIN ] MMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:47.085836] [INFO ] [MAIN ] MMS: Generated 1807 derivative records from 34085 primary records. [2025-10-09T22:41:47.087240] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-09T22:41:47.089237] [DEBUG] [LOCAL ] MMT: Derivative data saved (1807 records). [2025-10-09T22:41:47.089773] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-09T22:41:47.099466] [INFO ] [MAIN ] Derivative Progress: 1192/1690 symbols completed. MMT took 1.1s. Estimated remaining: 3m 13s. Rate: 154.6 symbols/min [2025-10-09T22:41:47.104133] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:47.115341] [DEBUG] [LOCAL ] MMS: Derivative data saved (1807 records). [2025-10-09T22:41:47.115537] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-09T22:41:47.125407] [INFO ] [MAIN ] Derivative Progress: 1193/1690 symbols completed. MMS took 1.2s. Estimated remaining: 3m 13s. Rate: 154.7 symbols/min [2025-10-09T22:41:47.126288] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:47.125995] [DEBUG] [LOCAL ] MMU: Loaded 16913 existing records from primary storage. [2025-10-09T22:41:47.127026] [INFO ] [MAIN ] MMU: Loaded 16913 primary data records. [2025-10-09T22:41:47.294001] [DEBUG] [LOCAL ] MNR: Loaded 24748 existing records from primary storage. [2025-10-09T22:41:47.314360] [INFO ] [MAIN ] MNR: Loaded 24748 primary data records. [2025-10-09T22:41:47.636188] [DEBUG] [LOCAL ] MNSO: Loaded 44553 existing records from primary storage. [2025-10-09T22:41:47.661225] [INFO ] [MAIN ] MNSO: Loaded 44553 primary data records. [2025-10-09T22:41:48.207678] [DEBUG] [MAIN ] MMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:48.219532] [INFO ] [MAIN ] MMU: Generated 1807 derivative records from 16913 primary records. [2025-10-09T22:41:48.220748] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-09T22:41:48.240479] [DEBUG] [LOCAL ] MMU: Derivative data saved (1807 records). [2025-10-09T22:41:48.241783] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-09T22:41:48.244472] [INFO ] [MAIN ] Derivative Progress: 1194/1690 symbols completed. MMU took 1.2s. Estimated remaining: 3m 13s. Rate: 154.5 symbols/min [2025-10-09T22:41:48.245321] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:48.273483] [DEBUG] [MAIN ] MNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:48.275057] [INFO ] [MAIN ] MNR: Generated 1807 derivative records from 24748 primary records. [2025-10-09T22:41:48.275301] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-09T22:41:48.297946] [DEBUG] [LOCAL ] MNR: Derivative data saved (1807 records). [2025-10-09T22:41:48.310134] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-09T22:41:48.319716] [INFO ] [MAIN ] Derivative Progress: 1195/1690 symbols completed. MNR took 1.2s. Estimated remaining: 3m 12s. Rate: 154.6 symbols/min [2025-10-09T22:41:48.321076] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:48.321767] [DEBUG] [MAIN ] MNSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:48.323695] [INFO ] [MAIN ] MNSO: Generated 1807 derivative records from 44553 primary records. [2025-10-09T22:41:48.335823] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-09T22:41:48.368222] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1807 records). [2025-10-09T22:41:48.368407] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-09T22:41:48.372986] [INFO ] [MAIN ] Derivative Progress: 1196/1690 symbols completed. MNSO took 1.2s. Estimated remaining: 3m 12s. Rate: 154.7 symbols/min [2025-10-09T22:41:48.369364] [DEBUG] [LOCAL ] MOD: Loaded 45257 existing records from primary storage. [2025-10-09T22:41:48.373298] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:48.373694] [INFO ] [MAIN ] MOD: Loaded 45257 primary data records. [2025-10-09T22:41:48.766774] [DEBUG] [LOCAL ] MOH: Loaded 42442 existing records from primary storage. [2025-10-09T22:41:48.766931] [INFO ] [MAIN ] MOH: Loaded 42442 primary data records. [2025-10-09T22:41:48.790118] [DEBUG] [LOCAL ] MODG: Loaded 51924 existing records from primary storage. [2025-10-09T22:41:48.834762] [INFO ] [MAIN ] MODG: Loaded 51924 primary data records. [2025-10-09T22:41:49.410167] [DEBUG] [MAIN ] MOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:49.412270] [INFO ] [MAIN ] MOD: Generated 1807 derivative records from 45257 primary records. [2025-10-09T22:41:49.412829] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-09T22:41:49.449699] [DEBUG] [MAIN ] MOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:49.451395] [INFO ] [MAIN ] MOH: Generated 1807 derivative records from 42442 primary records. [2025-10-09T22:41:49.451826] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-09T22:41:49.469676] [DEBUG] [LOCAL ] MOD: Derivative data saved (1807 records). [2025-10-09T22:41:49.471160] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-09T22:41:49.475250] [INFO ] [MAIN ] Derivative Progress: 1197/1690 symbols completed. MOD took 1.2s. Estimated remaining: 3m 11s. Rate: 154.5 symbols/min [2025-10-09T22:41:49.476430] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:49.479179] [DEBUG] [LOCAL ] MOH: Derivative data saved (1807 records). [2025-10-09T22:41:49.479810] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-09T22:41:49.490030] [INFO ] [MAIN ] Derivative Progress: 1198/1690 symbols completed. MOH took 1.1s. Estimated remaining: 3m 11s. Rate: 154.6 symbols/min [2025-10-09T22:41:49.495671] [DEBUG] [MAIN ] MODG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:49.496381] [INFO ] [MAIN ] MODG: Generated 1807 derivative records from 51924 primary records. [2025-10-09T22:41:49.496483] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-09T22:41:49.512895] [DEBUG] [LOCAL ] MODG: Derivative data saved (1807 records). [2025-10-09T22:41:49.513038] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-09T22:41:49.516422] [INFO ] [MAIN ] Derivative Progress: 1199/1690 symbols completed. MODG took 1.2s. Estimated remaining: 3m 10s. Rate: 154.7 symbols/min [2025-10-09T22:41:49.559285] [DEBUG] [LOCAL ] MOS: Loaded 53894 existing records from primary storage. [2025-10-09T22:41:49.559409] [INFO ] [MAIN ] MOS: Loaded 53894 primary data records. [2025-10-09T22:41:49.908409] [DEBUG] [MAIN ] MOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:49.909068] [INFO ] [MAIN ] MOS: Generated 1807 derivative records from 53894 primary records. [2025-10-09T22:41:49.909131] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-09T22:41:49.925346] [DEBUG] [LOCAL ] MOS: Derivative data saved (1807 records). [2025-10-09T22:41:49.925411] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-09T22:41:49.927536] [INFO ] [MAIN ] Derivative Progress: 1200/1690 symbols completed. MOS took 0.5s. Estimated remaining: 3m 10s. Rate: 154.7 symbols/min [2025-10-09T22:41:49.928253] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:49.928426] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:49.928770] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:49.939610] [DEBUG] [LOCAL ] MPA: Loaded 5342 existing records from primary storage. [2025-10-09T22:41:49.944954] [INFO ] [MAIN ] MPA: Loaded 5342 primary data records. [2025-10-09T22:41:50.051808] [DEBUG] [LOCAL ] MOV: Loaded 21950 existing records from primary storage. [2025-10-09T22:41:50.067184] [INFO ] [MAIN ] MOV: Loaded 21950 primary data records. [2025-10-09T22:41:50.618257] [DEBUG] [LOCAL ] MP: Loaded 54081 existing records from primary storage. [2025-10-09T22:41:50.618975] [INFO ] [MAIN ] MP: Loaded 54081 primary data records. [2025-10-09T22:41:50.945271] [DEBUG] [MAIN ] MPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:50.946182] [INFO ] [MAIN ] MPA: Generated 1807 derivative records from 5342 primary records. [2025-10-09T22:41:50.958533] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-09T22:41:50.959023] [DEBUG] [MAIN ] MOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:50.959633] [INFO ] [MAIN ] MOV: Generated 1807 derivative records from 21950 primary records. [2025-10-09T22:41:50.959788] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-09T22:41:50.992184] [DEBUG] [LOCAL ] MOV: Derivative data saved (1807 records). [2025-10-09T22:41:50.993040] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-09T22:41:50.995579] [INFO ] [MAIN ] Derivative Progress: 1201/1690 symbols completed. MOV took 1.1s. Estimated remaining: 3m 10s. Rate: 154.5 symbols/min [2025-10-09T22:41:50.996466] [DEBUG] [LOCAL ] MPA: Derivative data saved (1807 records). [2025-10-09T22:41:50.996581] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:50.996819] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-09T22:41:50.999620] [INFO ] [MAIN ] Derivative Progress: 1202/1690 symbols completed. MPA took 1.1s. Estimated remaining: 3m 9s. Rate: 154.6 symbols/min [2025-10-09T22:41:51.000235] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:51.017023] [DEBUG] [MAIN ] MP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:51.017777] [INFO ] [MAIN ] MP: Generated 1807 derivative records from 54081 primary records. [2025-10-09T22:41:51.017894] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-09T22:41:51.048561] [DEBUG] [LOCAL ] MP: Derivative data saved (1807 records). [2025-10-09T22:41:51.048886] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-09T22:41:51.052427] [INFO ] [MAIN ] Derivative Progress: 1203/1690 symbols completed. MP took 1.1s. Estimated remaining: 3m 9s. Rate: 154.7 symbols/min [2025-10-09T22:41:51.052825] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:51.066736] [DEBUG] [LOCAL ] RYAM: Loaded 35363 existing records from primary storage. [2025-10-09T22:41:51.066930] [INFO ] [MAIN ] RYAM: Loaded 35363 primary data records. [2025-10-09T22:41:51.286825] [DEBUG] [LOCAL ] RYI: Loaded 21708 existing records from primary storage. [2025-10-09T22:41:51.283084] [DEBUG] [LOCAL ] RYAN: Loaded 45041 existing records from primary storage. [2025-10-09T22:41:51.308697] [INFO ] [MAIN ] RYI: Loaded 21708 primary data records. [2025-10-09T22:41:51.424798] [INFO ] [MAIN ] RYAN: Loaded 45041 primary data records. [2025-10-09T22:41:52.084699] [DEBUG] [MAIN ] RYAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:52.086675] [INFO ] [MAIN ] RYAM: Generated 1807 derivative records from 35363 primary records. [2025-10-09T22:41:52.087067] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-09T22:41:52.109426] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1807 records). [2025-10-09T22:41:52.109740] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-09T22:41:52.112201] [INFO ] [MAIN ] Derivative Progress: 1204/1690 symbols completed. RYAM took 1.1s. Estimated remaining: 3m 9s. Rate: 154.5 symbols/min [2025-10-09T22:41:52.112401] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:52.143853] [DEBUG] [MAIN ] RYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:52.144556] [DEBUG] [MAIN ] RYAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:52.145465] [INFO ] [MAIN ] RYI: Generated 1807 derivative records from 21708 primary records. [2025-10-09T22:41:52.146201] [INFO ] [MAIN ] RYAN: Generated 1807 derivative records from 45041 primary records. [2025-10-09T22:41:52.146421] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-09T22:41:52.146493] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-09T22:41:52.180771] [DEBUG] [LOCAL ] RYI: Derivative data saved (1807 records). [2025-10-09T22:41:52.181767] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-09T22:41:52.184620] [INFO ] [MAIN ] Derivative Progress: 1205/1690 symbols completed. RYI took 1.1s. Estimated remaining: 3m 8s. Rate: 154.6 symbols/min [2025-10-09T22:41:52.185692] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:52.187294] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1807 records). [2025-10-09T22:41:52.187392] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-09T22:41:52.190204] [INFO ] [MAIN ] Derivative Progress: 1206/1690 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 8s. Rate: 154.7 symbols/min [2025-10-09T22:41:52.200747] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:52.209323] [DEBUG] [LOCAL ] RZB: Loaded 6067 existing records from primary storage. [2025-10-09T22:41:52.211309] [INFO ] [MAIN ] RZB: Loaded 6067 primary data records. [2025-10-09T22:41:52.264607] [DEBUG] [LOCAL ] RYN: Loaded 45758 existing records from primary storage. [2025-10-09T22:41:52.295781] [DEBUG] [LOCAL ] RZC: Loaded 6815 existing records from primary storage. [2025-10-09T22:41:52.307860] [INFO ] [MAIN ] RZC: Loaded 6815 primary data records. [2025-10-09T22:41:52.318632] [INFO ] [MAIN ] RYN: Loaded 45758 primary data records. [2025-10-09T22:41:53.186061] [DEBUG] [MAIN ] RZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:53.187253] [INFO ] [MAIN ] RZB: Generated 1807 derivative records from 6067 primary records. [2025-10-09T22:41:53.189119] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-09T22:41:53.230511] [DEBUG] [MAIN ] RZC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:53.232192] [INFO ] [MAIN ] RZC: Generated 1807 derivative records from 6815 primary records. [2025-10-09T22:41:53.235266] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-09T22:41:53.235191] [DEBUG] [MAIN ] RYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:53.234849] [DEBUG] [LOCAL ] RZB: Derivative data saved (1807 records). [2025-10-09T22:41:53.236157] [INFO ] [MAIN ] RYN: Generated 1807 derivative records from 45758 primary records. [2025-10-09T22:41:53.236380] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-09T22:41:53.236315] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-09T22:41:53.240560] [INFO ] [MAIN ] Derivative Progress: 1207/1690 symbols completed. RZB took 1.1s. Estimated remaining: 3m 8s. Rate: 154.5 symbols/min [2025-10-09T22:41:53.240755] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:53.269387] [DEBUG] [LOCAL ] RZC: Derivative data saved (1807 records). [2025-10-09T22:41:53.270220] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-09T22:41:53.273353] [INFO ] [MAIN ] Derivative Progress: 1208/1690 symbols completed. RZC took 1.1s. Estimated remaining: 3m 7s. Rate: 154.6 symbols/min [2025-10-09T22:41:53.273797] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:53.276587] [DEBUG] [LOCAL ] RYN: Derivative data saved (1807 records). [2025-10-09T22:41:53.276687] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-09T22:41:53.279025] [INFO ] [MAIN ] Derivative Progress: 1209/1690 symbols completed. RYN took 1.2s. Estimated remaining: 3m 6s. Rate: 154.8 symbols/min [2025-10-09T22:41:53.279608] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:53.306554] [DEBUG] [LOCAL ] SABA: Loaded 9341 existing records from primary storage. [2025-10-09T22:41:53.306749] [INFO ] [MAIN ] SABA: Loaded 9341 primary data records. [2025-10-09T22:41:53.441223] [DEBUG] [LOCAL ] S: Loaded 53920 existing records from primary storage. [2025-10-09T22:41:53.441848] [INFO ] [MAIN ] S: Loaded 53920 primary data records. [2025-10-09T22:41:53.525242] [DEBUG] [LOCAL ] SA: Loaded 44266 existing records from primary storage. [2025-10-09T22:41:53.615093] [INFO ] [MAIN ] SA: Loaded 44266 primary data records. [2025-10-09T22:41:54.345874] [DEBUG] [MAIN ] SABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:54.347787] [INFO ] [MAIN ] SABA: Generated 1807 derivative records from 9341 primary records. [2025-10-09T22:41:54.347995] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-09T22:41:54.367428] [DEBUG] [LOCAL ] SABA: Derivative data saved (1807 records). [2025-10-09T22:41:54.370944] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-09T22:41:54.373725] [INFO ] [MAIN ] Derivative Progress: 1210/1690 symbols completed. SABA took 1.1s. Estimated remaining: 3m 6s. Rate: 154.5 symbols/min [2025-10-09T22:41:54.374278] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:54.388917] [DEBUG] [MAIN ] S: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:54.389760] [INFO ] [MAIN ] S: Generated 1807 derivative records from 53920 primary records. [2025-10-09T22:41:54.389949] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-09T22:41:54.410072] [DEBUG] [LOCAL ] S: Derivative data saved (1807 records). [2025-10-09T22:41:54.410592] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-09T22:41:54.420546] [INFO ] [MAIN ] Derivative Progress: 1211/1690 symbols completed. S took 1.2s. Estimated remaining: 3m 6s. Rate: 154.6 symbols/min [2025-10-09T22:41:54.425694] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:54.426056] [DEBUG] [MAIN ] SA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:54.427137] [INFO ] [MAIN ] SA: Generated 1807 derivative records from 44266 primary records. [2025-10-09T22:41:54.427262] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-09T22:41:54.453380] [DEBUG] [LOCAL ] SA: Derivative data saved (1807 records). [2025-10-09T22:41:54.453592] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-09T22:41:54.456146] [INFO ] [MAIN ] Derivative Progress: 1212/1690 symbols completed. SA took 1.2s. Estimated remaining: 3m 5s. Rate: 154.8 symbols/min [2025-10-09T22:41:54.456383] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:54.478525] [DEBUG] [LOCAL ] SAFE: Loaded 30510 existing records from primary storage. [2025-10-09T22:41:54.485684] [INFO ] [MAIN ] SAFE: Loaded 30510 primary data records. [2025-10-09T22:41:54.491465] [DEBUG] [LOCAL ] SAH: Loaded 21703 existing records from primary storage. [2025-10-09T22:41:54.525495] [INFO ] [MAIN ] SAH: Loaded 21703 primary data records. [2025-10-09T22:41:54.630103] [DEBUG] [LOCAL ] SAM: Loaded 21510 existing records from primary storage. [2025-10-09T22:41:54.652512] [INFO ] [MAIN ] SAM: Loaded 21510 primary data records. [2025-10-09T22:41:55.438142] [DEBUG] [MAIN ] SAFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:55.439391] [INFO ] [MAIN ] SAFE: Generated 1807 derivative records from 30510 primary records. [2025-10-09T22:41:55.440074] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-09T22:41:55.470872] [DEBUG] [MAIN ] SAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:55.473945] [INFO ] [MAIN ] SAH: Generated 1807 derivative records from 21703 primary records. [2025-10-09T22:41:55.474697] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-09T22:41:55.494415] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1807 records). [2025-10-09T22:41:55.502491] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-09T22:41:55.507865] [INFO ] [MAIN ] Derivative Progress: 1213/1690 symbols completed. SAFE took 1.1s. Estimated remaining: 3m 5s. Rate: 154.5 symbols/min [2025-10-09T22:41:55.508506] [DEBUG] [LOCAL ] SAH: Derivative data saved (1807 records). [2025-10-09T22:41:55.508719] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-09T22:41:55.511488] [INFO ] [MAIN ] Derivative Progress: 1214/1690 symbols completed. SAH took 1.1s. Estimated remaining: 3m 5s. Rate: 154.7 symbols/min [2025-10-09T22:41:55.511890] [DEBUG] [MAIN ] SAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:55.512937] [INFO ] [MAIN ] SAM: Generated 1807 derivative records from 21510 primary records. [2025-10-09T22:41:55.513021] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-09T22:41:55.528949] [DEBUG] [LOCAL ] SAM: Derivative data saved (1807 records). [2025-10-09T22:41:55.529022] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-09T22:41:55.531396] [INFO ] [MAIN ] Derivative Progress: 1215/1690 symbols completed. SAM took 1.1s. Estimated remaining: 3m 4s. Rate: 154.8 symbols/min [2025-10-09T22:41:55.531805] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:55.532593] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:55.532541] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:55.616122] [DEBUG] [LOCAL ] SAP: Loaded 50268 existing records from primary storage. [2025-10-09T22:41:55.616356] [INFO ] [MAIN ] SAP: Loaded 50268 primary data records. [2025-10-09T22:41:55.688422] [DEBUG] [LOCAL ] SAN: Loaded 53356 existing records from primary storage. [2025-10-09T22:41:55.708589] [INFO ] [MAIN ] SAN: Loaded 53356 primary data records. [2025-10-09T22:41:55.926304] [DEBUG] [LOCAL ] SAND: Loaded 52210 existing records from primary storage. [2025-10-09T22:41:55.984841] [INFO ] [MAIN ] SAND: Loaded 52210 primary data records. [2025-10-09T22:41:56.636116] [DEBUG] [MAIN ] SAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:56.639175] [INFO ] [MAIN ] SAP: Generated 1807 derivative records from 50268 primary records. [2025-10-09T22:41:56.638260] [DEBUG] [MAIN ] SAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:56.640147] [INFO ] [MAIN ] SAN: Generated 1807 derivative records from 53356 primary records. [2025-10-09T22:41:56.640369] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-09T22:41:56.640973] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-09T22:41:56.665414] [DEBUG] [LOCAL ] SAP: Derivative data saved (1807 records). [2025-10-09T22:41:56.665784] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-09T22:41:56.669368] [INFO ] [MAIN ] Derivative Progress: 1216/1690 symbols completed. SAP took 1.1s. Estimated remaining: 3m 4s. Rate: 154.5 symbols/min [2025-10-09T22:41:56.672962] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:56.688712] [DEBUG] [LOCAL ] SAN: Derivative data saved (1807 records). [2025-10-09T22:41:56.693827] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-09T22:41:56.694100] [DEBUG] [MAIN ] SAND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:56.697369] [INFO ] [MAIN ] Derivative Progress: 1217/1690 symbols completed. SAN took 1.2s. Estimated remaining: 3m 4s. Rate: 154.7 symbols/min [2025-10-09T22:41:56.694903] [INFO ] [MAIN ] SAND: Generated 1807 derivative records from 52210 primary records. [2025-10-09T22:41:56.697707] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:56.697544] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-09T22:41:56.723048] [DEBUG] [LOCAL ] SAR: Loaded 17116 existing records from primary storage. [2025-10-09T22:41:56.723508] [INFO ] [MAIN ] SAR: Loaded 17116 primary data records. [2025-10-09T22:41:56.790788] [DEBUG] [LOCAL ] SAND: Derivative data saved (1807 records). [2025-10-09T22:41:56.813081] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-09T22:41:56.822071] [INFO ] [MAIN ] Derivative Progress: 1218/1690 symbols completed. SAND took 1.3s. Estimated remaining: 3m 3s. Rate: 154.7 symbols/min [2025-10-09T22:41:56.833228] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:57.073171] [DEBUG] [LOCAL ] SARO: Loaded 48788 existing records from primary storage. [2025-10-09T22:41:57.074673] [INFO ] [MAIN ] SARO: Loaded 48788 primary data records. [2025-10-09T22:41:57.219172] [DEBUG] [LOCAL ] SB: Loaded 33254 existing records from primary storage. [2025-10-09T22:41:57.232058] [INFO ] [MAIN ] SB: Loaded 33254 primary data records. [2025-10-09T22:41:57.879749] [DEBUG] [MAIN ] SAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:57.880855] [INFO ] [MAIN ] SAR: Generated 1807 derivative records from 17116 primary records. [2025-10-09T22:41:57.882342] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-09T22:41:57.906871] [DEBUG] [LOCAL ] SAR: Derivative data saved (1807 records). [2025-10-09T22:41:57.920063] [DEBUG] [MAIN ] SARO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:57.920202] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-09T22:41:57.923475] [INFO ] [MAIN ] SARO: Generated 1807 derivative records from 48788 primary records. [2025-10-09T22:41:57.923708] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-09T22:41:57.922745] [INFO ] [MAIN ] Derivative Progress: 1219/1690 symbols completed. SAR took 1.2s. Estimated remaining: 3m 3s. Rate: 154.5 symbols/min [2025-10-09T22:41:57.924155] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:57.942717] [DEBUG] [LOCAL ] SARO: Derivative data saved (1807 records). [2025-10-09T22:41:57.944245] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-09T22:41:57.947315] [INFO ] [MAIN ] Derivative Progress: 1220/1690 symbols completed. SARO took 1.2s. Estimated remaining: 3m 2s. Rate: 154.6 symbols/min [2025-10-09T22:41:57.947732] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:57.961383] [DEBUG] [MAIN ] SB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:57.962152] [INFO ] [MAIN ] SB: Generated 1807 derivative records from 33254 primary records. [2025-10-09T22:41:57.962245] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-09T22:41:57.986329] [DEBUG] [LOCAL ] SBI: Loaded 7435 existing records from primary storage. [2025-10-09T22:41:57.987457] [INFO ] [MAIN ] SBI: Loaded 7435 primary data records. [2025-10-09T22:41:57.988514] [DEBUG] [LOCAL ] SB: Derivative data saved (1807 records). [2025-10-09T22:41:57.999744] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-09T22:41:58.012447] [INFO ] [MAIN ] Derivative Progress: 1221/1690 symbols completed. SB took 1.2s. Estimated remaining: 3m 2s. Rate: 154.7 symbols/min [2025-10-09T22:41:58.012923] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:58.179759] [DEBUG] [LOCAL ] SBH: Loaded 50164 existing records from primary storage. [2025-10-09T22:41:58.209807] [DEBUG] [LOCAL ] SBR: Loaded 7676 existing records from primary storage. [2025-10-09T22:41:58.209920] [INFO ] [MAIN ] SBR: Loaded 7676 primary data records. [2025-10-09T22:41:58.339062] [INFO ] [MAIN ] SBH: Loaded 50164 primary data records. [2025-10-09T22:41:58.993066] [DEBUG] [MAIN ] SBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:58.994235] [INFO ] [MAIN ] SBI: Generated 1807 derivative records from 7435 primary records. [2025-10-09T22:41:58.994341] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-09T22:41:59.015336] [DEBUG] [LOCAL ] SBI: Derivative data saved (1807 records). [2025-10-09T22:41:59.015731] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-09T22:41:59.018215] [INFO ] [MAIN ] Derivative Progress: 1222/1690 symbols completed. SBI took 1.1s. Estimated remaining: 3m 2s. Rate: 154.5 symbols/min [2025-10-09T22:41:59.018417] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:59.032842] [DEBUG] [MAIN ] SBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:59.033746] [INFO ] [MAIN ] SBR: Generated 1807 derivative records from 7676 primary records. [2025-10-09T22:41:59.034049] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-09T22:41:59.052860] [DEBUG] [LOCAL ] SBR: Derivative data saved (1807 records). [2025-10-09T22:41:59.053120] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-09T22:41:59.055952] [INFO ] [MAIN ] Derivative Progress: 1223/1690 symbols completed. SBR took 1.0s. Estimated remaining: 3m 1s. Rate: 154.6 symbols/min [2025-10-09T22:41:59.056202] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:59.070332] [DEBUG] [MAIN ] SBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:41:59.078695] [INFO ] [MAIN ] SBH: Generated 1807 derivative records from 50164 primary records. [2025-10-09T22:41:59.078901] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-09T22:41:59.101286] [DEBUG] [LOCAL ] SBH: Derivative data saved (1807 records). [2025-10-09T22:41:59.112510] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-09T22:41:59.116326] [INFO ] [MAIN ] Derivative Progress: 1224/1690 symbols completed. SBH took 1.2s. Estimated remaining: 3m 1s. Rate: 154.8 symbols/min [2025-10-09T22:41:59.116609] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:41:59.122993] [DEBUG] [LOCAL ] SBSI: Loaded 14889 existing records from primary storage. [2025-10-09T22:41:59.123610] [INFO ] [MAIN ] SBSI: Loaded 14889 primary data records. [2025-10-09T22:41:59.261462] [DEBUG] [LOCAL ] SBS: Loaded 49729 existing records from primary storage. [2025-10-09T22:41:59.277399] [INFO ] [MAIN ] SBS: Loaded 49729 primary data records. [2025-10-09T22:41:59.677952] [DEBUG] [LOCAL ] SBSW: Loaded 53469 existing records from primary storage. [2025-10-09T22:41:59.796110] [INFO ] [MAIN ] SBSW: Loaded 53469 primary data records. [2025-10-09T22:42:00.221426] [DEBUG] [MAIN ] SBSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:00.223493] [INFO ] [MAIN ] SBSI: Generated 1807 derivative records from 14889 primary records. [2025-10-09T22:42:00.223692] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-09T22:42:00.245918] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1807 records). [2025-10-09T22:42:00.254126] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-09T22:42:00.261870] [INFO ] [MAIN ] Derivative Progress: 1225/1690 symbols completed. SBSI took 1.2s. Estimated remaining: 3m 1s. Rate: 154.5 symbols/min [2025-10-09T22:42:00.263501] [DEBUG] [MAIN ] SBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:00.263613] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:00.265184] [INFO ] [MAIN ] SBS: Generated 1807 derivative records from 49729 primary records. [2025-10-09T22:42:00.265448] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-09T22:42:00.285201] [DEBUG] [LOCAL ] SBS: Derivative data saved (1807 records). [2025-10-09T22:42:00.285540] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-09T22:42:00.288787] [INFO ] [MAIN ] Derivative Progress: 1226/1690 symbols completed. SBS took 1.3s. Estimated remaining: 3m 0s. Rate: 154.6 symbols/min [2025-10-09T22:42:00.289096] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:00.307785] [DEBUG] [MAIN ] SBSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:00.308795] [INFO ] [MAIN ] SBSW: Generated 1807 derivative records from 53469 primary records. [2025-10-09T22:42:00.308869] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-09T22:42:00.335312] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1807 records). [2025-10-09T22:42:00.335775] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-09T22:42:00.339969] [INFO ] [MAIN ] Derivative Progress: 1227/1690 symbols completed. SBSW took 1.2s. Estimated remaining: 2m 60s. Rate: 154.7 symbols/min [2025-10-09T22:42:00.354372] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:00.361607] [DEBUG] [LOCAL ] SCD: Loaded 13118 existing records from primary storage. [2025-10-09T22:42:00.361808] [INFO ] [MAIN ] SCD: Loaded 13118 primary data records. [2025-10-09T22:42:00.494076] [DEBUG] [LOCAL ] SCCO: Loaded 49979 existing records from primary storage. [2025-10-09T22:42:00.494816] [INFO ] [MAIN ] SCCO: Loaded 49979 primary data records. [2025-10-09T22:42:01.044088] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-10-09T22:42:01.045019] [INFO ] [MAIN ] SCHW: Loaded 54075 primary data records. [2025-10-09T22:42:01.376027] [DEBUG] [MAIN ] SCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:01.377526] [INFO ] [MAIN ] SCD: Generated 1807 derivative records from 13118 primary records. [2025-10-09T22:42:01.377932] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-09T22:42:01.415197] [DEBUG] [MAIN ] SCCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:01.417390] [INFO ] [MAIN ] SCCO: Generated 1807 derivative records from 49979 primary records. [2025-10-09T22:42:01.418558] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-09T22:42:01.418478] [DEBUG] [LOCAL ] SCD: Derivative data saved (1807 records). [2025-10-09T22:42:01.419801] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-09T22:42:01.421973] [INFO ] [MAIN ] Derivative Progress: 1228/1690 symbols completed. SCD took 1.1s. Estimated remaining: 2m 59s. Rate: 154.5 symbols/min [2025-10-09T22:42:01.457823] [DEBUG] [MAIN ] SCHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:01.459324] [INFO ] [MAIN ] SCHW: Generated 1807 derivative records from 54075 primary records. [2025-10-09T22:42:01.459665] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-09T22:42:01.474106] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1807 records). [2025-10-09T22:42:01.474930] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-09T22:42:01.477927] [INFO ] [MAIN ] Derivative Progress: 1229/1690 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 59s. Rate: 154.6 symbols/min [2025-10-09T22:42:01.481659] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1807 records). [2025-10-09T22:42:01.481743] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-09T22:42:01.484085] [INFO ] [MAIN ] Derivative Progress: 1230/1690 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 58s. Rate: 154.7 symbols/min [2025-10-09T22:42:01.484814] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:01.484722] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:01.484594] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:01.509149] [DEBUG] [LOCAL ] SCL: Loaded 14919 existing records from primary storage. [2025-10-09T22:42:01.509308] [INFO ] [MAIN ] SCL: Loaded 14919 primary data records. [2025-10-09T22:42:01.597799] [DEBUG] [LOCAL ] SCM: Loaded 20128 existing records from primary storage. [2025-10-09T22:42:01.617857] [INFO ] [MAIN ] SCM: Loaded 20128 primary data records. [2025-10-09T22:42:01.927444] [DEBUG] [LOCAL ] SCI: Loaded 46874 existing records from primary storage. [2025-10-09T22:42:01.932900] [INFO ] [MAIN ] SCI: Loaded 46874 primary data records. [2025-10-09T22:42:02.639018] [DEBUG] [MAIN ] SCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:02.643705] [INFO ] [MAIN ] SCL: Generated 1807 derivative records from 14919 primary records. [2025-10-09T22:42:02.644502] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-09T22:42:02.674816] [DEBUG] [MAIN ] SCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:02.679414] [INFO ] [MAIN ] SCM: Generated 1807 derivative records from 20128 primary records. [2025-10-09T22:42:02.680761] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-09T22:42:02.705948] [DEBUG] [LOCAL ] SCL: Derivative data saved (1807 records). [2025-10-09T22:42:02.710294] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-09T22:42:02.705756] [DEBUG] [MAIN ] SCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:02.716774] [DEBUG] [LOCAL ] SCM: Derivative data saved (1807 records). [2025-10-09T22:42:02.716964] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-09T22:42:02.716549] [INFO ] [MAIN ] Derivative Progress: 1231/1690 symbols completed. SCL took 1.2s. Estimated remaining: 2m 58s. Rate: 154.5 symbols/min [2025-10-09T22:42:02.717951] [INFO ] [MAIN ] SCI: Generated 1807 derivative records from 46874 primary records. [2025-10-09T22:42:02.721159] [INFO ] [MAIN ] Derivative Progress: 1232/1690 symbols completed. SCM took 1.2s. Estimated remaining: 2m 58s. Rate: 154.6 symbols/min [2025-10-09T22:42:02.721105] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-09T22:42:02.721013] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:02.722299] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:02.740291] [DEBUG] [LOCAL ] SCI: Derivative data saved (1807 records). [2025-10-09T22:42:02.740487] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-09T22:42:02.743310] [INFO ] [MAIN ] Derivative Progress: 1233/1690 symbols completed. SCI took 1.3s. Estimated remaining: 2m 57s. Rate: 154.7 symbols/min [2025-10-09T22:42:02.743710] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:02.764259] [DEBUG] [LOCAL ] SDHC: Loaded 10432 existing records from primary storage. [2025-10-09T22:42:02.764539] [INFO ] [MAIN ] SDHC: Loaded 10432 primary data records. [2025-10-09T22:42:02.849265] [DEBUG] [LOCAL ] SD: Loaded 28932 existing records from primary storage. [2025-10-09T22:42:02.872246] [INFO ] [MAIN ] SD: Loaded 28932 primary data records. [2025-10-09T22:42:02.993256] [DEBUG] [LOCAL ] SCS: Loaded 43817 existing records from primary storage. [2025-10-09T22:42:03.063054] [INFO ] [MAIN ] SCS: Loaded 43817 primary data records. [2025-10-09T22:42:03.776081] [DEBUG] [MAIN ] SDHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:03.777699] [INFO ] [MAIN ] SDHC: Generated 1807 derivative records from 10432 primary records. [2025-10-09T22:42:03.778023] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-09T22:42:03.792275] [DEBUG] [MAIN ] SD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:03.804568] [INFO ] [MAIN ] SD: Generated 1807 derivative records from 28932 primary records. [2025-10-09T22:42:03.805497] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-09T22:42:03.826936] [DEBUG] [LOCAL ] SD: Derivative data saved (1807 records). [2025-10-09T22:42:03.827161] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-09T22:42:03.830680] [INFO ] [MAIN ] Derivative Progress: 1234/1690 symbols completed. SD took 1.1s. Estimated remaining: 2m 57s. Rate: 154.5 symbols/min [2025-10-09T22:42:03.845806] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1807 records). [2025-10-09T22:42:03.844709] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:03.846078] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-09T22:42:03.845067] [DEBUG] [MAIN ] SCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:03.847087] [INFO ] [MAIN ] SCS: Generated 1807 derivative records from 43817 primary records. [2025-10-09T22:42:03.847208] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-09T22:42:03.849497] [INFO ] [MAIN ] Derivative Progress: 1235/1690 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 57s. Rate: 154.6 symbols/min [2025-10-09T22:42:03.850929] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:03.876702] [DEBUG] [LOCAL ] SCS: Derivative data saved (1807 records). [2025-10-09T22:42:03.877021] [DEBUG] [LOCAL ] SDHY: Loaded 11007 existing records from primary storage. [2025-10-09T22:42:03.877378] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-09T22:42:03.877489] [INFO ] [MAIN ] SDHY: Loaded 11007 primary data records. [2025-10-09T22:42:03.880511] [INFO ] [MAIN ] Derivative Progress: 1236/1690 symbols completed. SCS took 1.2s. Estimated remaining: 2m 56s. Rate: 154.7 symbols/min [2025-10-09T22:42:03.892862] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:04.261333] [DEBUG] [LOCAL ] SDRL: Loaded 41781 existing records from primary storage. [2025-10-09T22:42:04.262157] [INFO ] [MAIN ] SDRL: Loaded 41781 primary data records. [2025-10-09T22:42:04.389123] [DEBUG] [LOCAL ] SE: Loaded 53720 existing records from primary storage. [2025-10-09T22:42:04.405414] [INFO ] [MAIN ] SE: Loaded 53720 primary data records. [2025-10-09T22:42:04.909943] [DEBUG] [MAIN ] SDHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:04.911075] [INFO ] [MAIN ] SDHY: Generated 1807 derivative records from 11007 primary records. [2025-10-09T22:42:04.911309] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-09T22:42:04.931796] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1807 records). [2025-10-09T22:42:04.931955] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-09T22:42:04.934501] [INFO ] [MAIN ] Derivative Progress: 1237/1690 symbols completed. SDHY took 1.1s. Estimated remaining: 2m 56s. Rate: 154.5 symbols/min [2025-10-09T22:42:04.934747] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:04.954783] [DEBUG] [MAIN ] SDRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:04.956088] [INFO ] [MAIN ] SDRL: Generated 1807 derivative records from 41781 primary records. [2025-10-09T22:42:04.956422] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-09T22:42:04.978881] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1807 records). [2025-10-09T22:42:04.979060] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-09T22:42:04.981187] [INFO ] [MAIN ] Derivative Progress: 1238/1690 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 55s. Rate: 154.6 symbols/min [2025-10-09T22:42:04.981433] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:04.995676] [DEBUG] [MAIN ] SE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:04.996802] [INFO ] [MAIN ] SE: Generated 1807 derivative records from 53720 primary records. [2025-10-09T22:42:05.007712] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-09T22:42:05.031744] [DEBUG] [LOCAL ] SEG: Loaded 13269 existing records from primary storage. [2025-10-09T22:42:05.032861] [INFO ] [MAIN ] SEG: Loaded 13269 primary data records. [2025-10-09T22:42:05.087508] [DEBUG] [LOCAL ] SEE: Loaded 48548 existing records from primary storage. [2025-10-09T22:42:05.121595] [DEBUG] [LOCAL ] SE: Derivative data saved (1807 records). [2025-10-09T22:42:05.133371] [INFO ] [MAIN ] SEE: Loaded 48548 primary data records. [2025-10-09T22:42:05.133496] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-09T22:42:05.210559] [INFO ] [MAIN ] Derivative Progress: 1239/1690 symbols completed. SE took 1.3s. Estimated remaining: 2m 55s. Rate: 154.7 symbols/min [2025-10-09T22:42:05.221068] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:05.704466] [DEBUG] [LOCAL ] SEI: Loaded 50147 existing records from primary storage. [2025-10-09T22:42:05.705308] [INFO ] [MAIN ] SEI: Loaded 50147 primary data records. [2025-10-09T22:42:05.838475] [DEBUG] [MAIN ] SEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:05.847208] [INFO ] [MAIN ] SEG: Generated 1807 derivative records from 13269 primary records. [2025-10-09T22:42:05.857338] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-09T22:42:05.874438] [DEBUG] [MAIN ] SEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:05.922824] [INFO ] [MAIN ] SEE: Generated 1807 derivative records from 48548 primary records. [2025-10-09T22:42:05.951967] [DEBUG] [LOCAL ] SEG: Derivative data saved (1807 records). [2025-10-09T22:42:05.952232] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-09T22:42:05.942856] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-09T22:42:05.954525] [INFO ] [MAIN ] Derivative Progress: 1240/1690 symbols completed. SEG took 1.0s. Estimated remaining: 2m 55s. Rate: 154.5 symbols/min [2025-10-09T22:42:06.059631] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:06.092632] [DEBUG] [LOCAL ] SEE: Derivative data saved (1807 records). [2025-10-09T22:42:06.093213] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-09T22:42:06.095822] [INFO ] [MAIN ] Derivative Progress: 1241/1690 symbols completed. SEE took 1.2s. Estimated remaining: 2m 54s. Rate: 154.6 symbols/min [2025-10-09T22:42:06.096066] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:06.129757] [DEBUG] [MAIN ] SEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:06.130384] [INFO ] [MAIN ] SEI: Generated 1807 derivative records from 50147 primary records. [2025-10-09T22:42:06.130444] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-09T22:42:06.167885] [DEBUG] [LOCAL ] SEM: Loaded 43265 existing records from primary storage. [2025-10-09T22:42:06.168837] [INFO ] [MAIN ] SEM: Loaded 43265 primary data records. [2025-10-09T22:42:06.168911] [DEBUG] [LOCAL ] SEI: Derivative data saved (1807 records). [2025-10-09T22:42:06.169068] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-09T22:42:06.171305] [INFO ] [MAIN ] Derivative Progress: 1242/1690 symbols completed. SEI took 1.0s. Estimated remaining: 2m 54s. Rate: 154.7 symbols/min [2025-10-09T22:42:06.192140] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:06.286256] [DEBUG] [LOCAL ] SEMR: Loaded 42098 existing records from primary storage. [2025-10-09T22:42:06.286508] [INFO ] [MAIN ] SEMR: Loaded 42098 primary data records. [2025-10-09T22:42:06.842797] [DEBUG] [LOCAL ] SES: Loaded 51959 existing records from primary storage. [2025-10-09T22:42:06.843549] [INFO ] [MAIN ] SES: Loaded 51959 primary data records. [2025-10-09T22:42:07.175233] [DEBUG] [MAIN ] SEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:07.176265] [INFO ] [MAIN ] SEM: Generated 1807 derivative records from 43265 primary records. [2025-10-09T22:42:07.176943] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-09T22:42:07.208206] [DEBUG] [MAIN ] SEMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:07.210179] [INFO ] [MAIN ] SEMR: Generated 1807 derivative records from 42098 primary records. [2025-10-09T22:42:07.210509] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-09T22:42:07.224743] [DEBUG] [LOCAL ] SEM: Derivative data saved (1807 records). [2025-10-09T22:42:07.225374] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-09T22:42:07.228175] [INFO ] [MAIN ] Derivative Progress: 1243/1690 symbols completed. SEM took 1.2s. Estimated remaining: 2m 54s. Rate: 154.5 symbols/min [2025-10-09T22:42:07.234880] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1807 records). [2025-10-09T22:42:07.235038] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-09T22:42:07.237444] [INFO ] [MAIN ] Derivative Progress: 1244/1690 symbols completed. SEMR took 1.1s. Estimated remaining: 2m 53s. Rate: 154.6 symbols/min [2025-10-09T22:42:07.250228] [DEBUG] [MAIN ] SES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:07.250890] [INFO ] [MAIN ] SES: Generated 1807 derivative records from 51959 primary records. [2025-10-09T22:42:07.250953] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-09T22:42:07.267392] [DEBUG] [LOCAL ] SES: Derivative data saved (1807 records). [2025-10-09T22:42:07.267463] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-09T22:42:07.269951] [INFO ] [MAIN ] Derivative Progress: 1245/1690 symbols completed. SES took 1.1s. Estimated remaining: 2m 53s. Rate: 154.7 symbols/min [2025-10-09T22:42:07.270581] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:07.270515] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:07.270710] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:07.278979] [DEBUG] [LOCAL ] SFB: Loaded 4217 existing records from primary storage. [2025-10-09T22:42:07.279245] [INFO ] [MAIN ] SFB: Loaded 4217 primary data records. [2025-10-09T22:42:07.400147] [DEBUG] [LOCAL ] SFBS: Loaded 21214 existing records from primary storage. [2025-10-09T22:42:07.416077] [INFO ] [MAIN ] SFBS: Loaded 21214 primary data records. [2025-10-09T22:42:07.708280] [DEBUG] [LOCAL ] SF: Loaded 41925 existing records from primary storage. [2025-10-09T22:42:07.709180] [INFO ] [MAIN ] SF: Loaded 41925 primary data records. [2025-10-09T22:42:08.301449] [DEBUG] [MAIN ] SFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:08.302786] [INFO ] [MAIN ] SFB: Generated 1807 derivative records from 4217 primary records. [2025-10-09T22:42:08.303182] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-09T22:42:08.333846] [DEBUG] [MAIN ] SFBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:08.335585] [INFO ] [MAIN ] SFBS: Generated 1807 derivative records from 21214 primary records. [2025-10-09T22:42:08.335902] [DEBUG] [LOCAL ] SFB: Derivative data saved (1807 records). [2025-10-09T22:42:08.336068] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-09T22:42:08.336268] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-09T22:42:08.339104] [INFO ] [MAIN ] Derivative Progress: 1246/1690 symbols completed. SFB took 1.1s. Estimated remaining: 2m 52s. Rate: 154.5 symbols/min [2025-10-09T22:42:08.339266] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:08.354869] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1807 records). [2025-10-09T22:42:08.355033] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-09T22:42:08.357261] [INFO ] [MAIN ] Derivative Progress: 1247/1690 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 52s. Rate: 154.6 symbols/min [2025-10-09T22:42:08.357611] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:08.374045] [DEBUG] [MAIN ] SF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:08.374947] [INFO ] [MAIN ] SF: Generated 1807 derivative records from 41925 primary records. [2025-10-09T22:42:08.375117] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-09T22:42:08.403498] [DEBUG] [LOCAL ] SF: Derivative data saved (1807 records). [2025-10-09T22:42:08.403686] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-09T22:42:08.406214] [INFO ] [MAIN ] Derivative Progress: 1248/1690 symbols completed. SF took 1.1s. Estimated remaining: 2m 51s. Rate: 154.8 symbols/min [2025-10-09T22:42:08.406538] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:08.435772] [DEBUG] [LOCAL ] SFL: Loaded 45526 existing records from primary storage. [2025-10-09T22:42:08.435929] [INFO ] [MAIN ] SFL: Loaded 45526 primary data records. [2025-10-09T22:42:08.570754] [DEBUG] [LOCAL ] SG: Loaded 53857 existing records from primary storage. [2025-10-09T22:42:08.584160] [INFO ] [MAIN ] SG: Loaded 53857 primary data records. [2025-10-09T22:42:08.905487] [DEBUG] [LOCAL ] SGHC: Loaded 46912 existing records from primary storage. [2025-10-09T22:42:08.923771] [INFO ] [MAIN ] SGHC: Loaded 46912 primary data records. [2025-10-09T22:42:09.461702] [DEBUG] [MAIN ] SFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:09.462952] [INFO ] [MAIN ] SFL: Generated 1807 derivative records from 45526 primary records. [2025-10-09T22:42:09.464177] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-09T22:42:09.493863] [DEBUG] [MAIN ] SG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:09.497511] [DEBUG] [LOCAL ] SFL: Derivative data saved (1807 records). [2025-10-09T22:42:09.498103] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-09T22:42:09.502840] [INFO ] [MAIN ] Derivative Progress: 1249/1690 symbols completed. SFL took 1.2s. Estimated remaining: 2m 51s. Rate: 154.5 symbols/min [2025-10-09T22:42:09.498973] [INFO ] [MAIN ] SG: Generated 1807 derivative records from 53857 primary records. [2025-10-09T22:42:09.503146] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-09T22:42:09.503627] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:09.522969] [DEBUG] [LOCAL ] SG: Derivative data saved (1807 records). [2025-10-09T22:42:09.526917] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-09T22:42:09.529340] [INFO ] [MAIN ] Derivative Progress: 1250/1690 symbols completed. SG took 1.2s. Estimated remaining: 2m 51s. Rate: 154.6 symbols/min [2025-10-09T22:42:09.545694] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:09.545962] [DEBUG] [LOCAL ] SGU: Loaded 6613 existing records from primary storage. [2025-10-09T22:42:09.546892] [INFO ] [MAIN ] SGU: Loaded 6613 primary data records. [2025-10-09T22:42:09.558449] [DEBUG] [MAIN ] SGHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:09.569215] [INFO ] [MAIN ] SGHC: Generated 1807 derivative records from 46912 primary records. [2025-10-09T22:42:09.592216] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-09T22:42:09.895805] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1807 records). [2025-10-09T22:42:09.897883] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-09T22:42:09.900708] [INFO ] [MAIN ] Derivative Progress: 1251/1690 symbols completed. SGHC took 1.5s. Estimated remaining: 2m 50s. Rate: 154.7 symbols/min [2025-10-09T22:42:09.900913] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:09.902705] [DEBUG] [LOCAL ] SHAK: Loaded 49174 existing records from primary storage. [2025-10-09T22:42:09.903061] [INFO ] [MAIN ] SHAK: Loaded 49174 primary data records. [2025-10-09T22:42:10.113467] [DEBUG] [LOCAL ] SHCO: Loaded 25606 existing records from primary storage. [2025-10-09T22:42:10.120378] [INFO ] [MAIN ] SHCO: Loaded 25606 primary data records. [2025-10-09T22:42:10.477515] [DEBUG] [MAIN ] SGU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:10.492943] [INFO ] [MAIN ] SGU: Generated 1807 derivative records from 6613 primary records. [2025-10-09T22:42:10.493044] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-09T22:42:10.638473] [DEBUG] [LOCAL ] SGU: Derivative data saved (1807 records). [2025-10-09T22:42:10.639329] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-09T22:42:10.642182] [INFO ] [MAIN ] Derivative Progress: 1252/1690 symbols completed. SGU took 1.1s. Estimated remaining: 2m 50s. Rate: 154.5 symbols/min [2025-10-09T22:42:10.642786] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:10.672630] [DEBUG] [MAIN ] SHAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:10.686330] [INFO ] [MAIN ] SHAK: Generated 1807 derivative records from 49174 primary records. [2025-10-09T22:42:10.686676] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-09T22:42:10.686990] [DEBUG] [MAIN ] SHCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:10.689205] [INFO ] [MAIN ] SHCO: Generated 1807 derivative records from 25606 primary records. [2025-10-09T22:42:10.689281] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-09T22:42:10.706316] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1807 records). [2025-10-09T22:42:10.706952] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-09T22:42:10.709317] [INFO ] [MAIN ] Derivative Progress: 1253/1690 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 50s. Rate: 154.6 symbols/min [2025-10-09T22:42:10.717777] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:10.726272] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1807 records). [2025-10-09T22:42:10.726507] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-09T22:42:10.729090] [INFO ] [MAIN ] Derivative Progress: 1254/1690 symbols completed. SHCO took 0.8s. Estimated remaining: 2m 49s. Rate: 154.8 symbols/min [2025-10-09T22:42:10.744293] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:10.773551] [DEBUG] [LOCAL ] SHEL: Loaded 54062 existing records from primary storage. [2025-10-09T22:42:10.773873] [INFO ] [MAIN ] SHEL: Loaded 54062 primary data records. [2025-10-09T22:42:10.854357] [DEBUG] [LOCAL ] SHG: Loaded 26539 existing records from primary storage. [2025-10-09T22:42:10.876664] [INFO ] [MAIN ] SHG: Loaded 26539 primary data records. [2025-10-09T22:42:11.237295] [DEBUG] [LOCAL ] SHO: Loaded 49918 existing records from primary storage. [2025-10-09T22:42:11.257258] [INFO ] [MAIN ] SHO: Loaded 49918 primary data records. [2025-10-09T22:42:11.791221] [DEBUG] [MAIN ] SHEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:11.794486] [INFO ] [MAIN ] SHEL: Generated 1807 derivative records from 54062 primary records. [2025-10-09T22:42:11.794637] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-09T22:42:11.825056] [DEBUG] [MAIN ] SHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:11.828715] [INFO ] [MAIN ] SHG: Generated 1807 derivative records from 26539 primary records. [2025-10-09T22:42:11.829070] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-09T22:42:11.833420] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1807 records). [2025-10-09T22:42:11.840864] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-09T22:42:11.847892] [INFO ] [MAIN ] Derivative Progress: 1255/1690 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 49s. Rate: 154.5 symbols/min [2025-10-09T22:42:11.849150] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:11.864985] [DEBUG] [MAIN ] SHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:11.866882] [INFO ] [MAIN ] SHO: Generated 1807 derivative records from 49918 primary records. [2025-10-09T22:42:11.867016] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-09T22:42:11.870038] [DEBUG] [LOCAL ] SHG: Derivative data saved (1807 records). [2025-10-09T22:42:11.877251] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-09T22:42:11.883052] [INFO ] [MAIN ] Derivative Progress: 1256/1690 symbols completed. SHG took 1.2s. Estimated remaining: 2m 48s. Rate: 154.6 symbols/min [2025-10-09T22:42:11.883201] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:11.890435] [DEBUG] [LOCAL ] SHO: Derivative data saved (1807 records). [2025-10-09T22:42:11.890551] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-09T22:42:11.893123] [INFO ] [MAIN ] Derivative Progress: 1257/1690 symbols completed. SHO took 1.1s. Estimated remaining: 2m 48s. Rate: 154.8 symbols/min [2025-10-09T22:42:11.889403] [DEBUG] [LOCAL ] SHOC: Loaded 3377 existing records from primary storage. [2025-10-09T22:42:11.893390] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:11.893537] [INFO ] [MAIN ] SHOC: Loaded 3377 primary data records. [2025-10-09T22:42:12.274697] [DEBUG] [LOCAL ] SID: Loaded 42901 existing records from primary storage. [2025-10-09T22:42:12.275010] [INFO ] [MAIN ] SID: Loaded 42901 primary data records. [2025-10-09T22:42:12.276752] [DEBUG] [LOCAL ] SHW: Loaded 50691 existing records from primary storage. [2025-10-09T22:42:12.317530] [INFO ] [MAIN ] SHW: Loaded 50691 primary data records. [2025-10-09T22:42:13.008929] [DEBUG] [MAIN ] SHOC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:42:13.058708] [INFO ] [MAIN ] SHOC: Generated 1806 derivative records from 3377 primary records. [2025-10-09T22:42:13.184128] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-09T22:42:13.225466] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1806 records). [2025-10-09T22:42:13.226683] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-09T22:42:13.230584] [INFO ] [MAIN ] Derivative Progress: 1258/1690 symbols completed. SHOC took 1.4s. Estimated remaining: 2m 48s. Rate: 154.5 symbols/min [2025-10-09T22:42:13.246545] [DEBUG] [MAIN ] SID: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:13.247501] [INFO ] [MAIN ] SID: Generated 1807 derivative records from 42901 primary records. [2025-10-09T22:42:13.247909] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-09T22:42:13.282810] [DEBUG] [MAIN ] SHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:13.284195] [DEBUG] [LOCAL ] SID: Derivative data saved (1807 records). [2025-10-09T22:42:13.285084] [INFO ] [MAIN ] SHW: Generated 1807 derivative records from 50691 primary records. [2025-10-09T22:42:13.285199] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-09T22:42:13.287164] [INFO ] [MAIN ] Derivative Progress: 1259/1690 symbols completed. SID took 1.4s. Estimated remaining: 2m 47s. Rate: 154.6 symbols/min [2025-10-09T22:42:13.287321] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-09T22:42:13.303717] [DEBUG] [LOCAL ] SHW: Derivative data saved (1807 records). [2025-10-09T22:42:13.303822] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-09T22:42:13.307012] [INFO ] [MAIN ] Derivative Progress: 1260/1690 symbols completed. SHW took 1.4s. Estimated remaining: 2m 47s. Rate: 154.7 symbols/min [2025-10-09T22:42:13.307696] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:13.307804] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:13.307916] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:13.354151] [DEBUG] [LOCAL ] SII: Loaded 23968 existing records from primary storage. [2025-10-09T22:42:13.354489] [INFO ] [MAIN ] SII: Loaded 23968 primary data records. [2025-10-09T22:42:13.489043] [DEBUG] [LOCAL ] SILA: Loaded 30772 existing records from primary storage. [2025-10-09T22:42:13.501482] [INFO ] [MAIN ] SILA: Loaded 30772 primary data records. [2025-10-09T22:42:13.668952] [DEBUG] [LOCAL ] SIG: Loaded 46129 existing records from primary storage. [2025-10-09T22:42:13.701109] [INFO ] [MAIN ] SIG: Loaded 46129 primary data records. [2025-10-09T22:42:14.359281] [DEBUG] [MAIN ] SII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:14.361962] [INFO ] [MAIN ] SII: Generated 1807 derivative records from 23968 primary records. [2025-10-09T22:42:14.362327] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-09T22:42:14.400246] [DEBUG] [MAIN ] SILA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:14.407639] [INFO ] [MAIN ] SILA: Generated 1807 derivative records from 30772 primary records. [2025-10-09T22:42:14.407797] [DEBUG] [MAIN ] SIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:14.407893] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-09T22:42:14.409608] [INFO ] [MAIN ] SIG: Generated 1807 derivative records from 46129 primary records. [2025-10-09T22:42:14.411542] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-09T22:42:14.412276] [DEBUG] [LOCAL ] SII: Derivative data saved (1807 records). [2025-10-09T22:42:14.420908] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-09T22:42:14.434433] [INFO ] [MAIN ] Derivative Progress: 1261/1690 symbols completed. SII took 1.1s. Estimated remaining: 2m 47s. Rate: 154.4 symbols/min [2025-10-09T22:42:14.443268] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:14.445328] [DEBUG] [LOCAL ] SIG: Derivative data saved (1807 records). [2025-10-09T22:42:14.446043] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-09T22:42:14.448905] [INFO ] [MAIN ] Derivative Progress: 1262/1690 symbols completed. SIG took 1.1s. Estimated remaining: 2m 46s. Rate: 154.6 symbols/min [2025-10-09T22:42:14.449155] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:14.452666] [DEBUG] [LOCAL ] SILA: Derivative data saved (1807 records). [2025-10-09T22:42:14.452795] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-09T22:42:14.455024] [INFO ] [MAIN ] Derivative Progress: 1263/1690 symbols completed. SILA took 1.1s. Estimated remaining: 2m 46s. Rate: 154.7 symbols/min [2025-10-09T22:42:14.455262] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:14.492272] [DEBUG] [LOCAL ] SITC: Loaded 41812 existing records from primary storage. [2025-10-09T22:42:14.495928] [INFO ] [MAIN ] SITC: Loaded 41812 primary data records. [2025-10-09T22:42:14.649055] [DEBUG] [LOCAL ] SITE: Loaded 35558 existing records from primary storage. [2025-10-09T22:42:14.672602] [INFO ] [MAIN ] SITE: Loaded 35558 primary data records. [2025-10-09T22:42:14.975462] [DEBUG] [LOCAL ] SJM: Loaded 50431 existing records from primary storage. [2025-10-09T22:42:14.980226] [INFO ] [MAIN ] SJM: Loaded 50431 primary data records. [2025-10-09T22:42:15.533562] [DEBUG] [MAIN ] SITC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:15.535849] [INFO ] [MAIN ] SITC: Generated 1807 derivative records from 41812 primary records. [2025-10-09T22:42:15.536563] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-09T22:42:15.556700] [DEBUG] [LOCAL ] SITC: Derivative data saved (1807 records). [2025-10-09T22:42:15.559289] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-09T22:42:15.562142] [INFO ] [MAIN ] Derivative Progress: 1264/1690 symbols completed. SITC took 1.1s. Estimated remaining: 2m 45s. Rate: 154.5 symbols/min [2025-10-09T22:42:15.562706] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:15.576549] [DEBUG] [MAIN ] SITE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:15.577913] [INFO ] [MAIN ] SITE: Generated 1807 derivative records from 35558 primary records. [2025-10-09T22:42:15.578130] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-09T22:42:15.620488] [DEBUG] [LOCAL ] SITE: Derivative data saved (1807 records). [2025-10-09T22:42:15.626227] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-09T22:42:15.626149] [DEBUG] [LOCAL ] SJT: Loaded 22638 existing records from primary storage. [2025-10-09T22:42:15.628685] [INFO ] [MAIN ] Derivative Progress: 1265/1690 symbols completed. SITE took 1.2s. Estimated remaining: 2m 45s. Rate: 154.6 symbols/min [2025-10-09T22:42:15.626495] [INFO ] [MAIN ] SJT: Loaded 22638 primary data records. [2025-10-09T22:42:15.660533] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:15.629100] [DEBUG] [MAIN ] SJM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:15.673900] [INFO ] [MAIN ] SJM: Generated 1807 derivative records from 50431 primary records. [2025-10-09T22:42:15.686741] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-09T22:42:15.961444] [DEBUG] [LOCAL ] SJM: Derivative data saved (1807 records). [2025-10-09T22:42:15.971728] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-09T22:42:15.975210] [INFO ] [MAIN ] Derivative Progress: 1266/1690 symbols completed. SJM took 1.5s. Estimated remaining: 2m 45s. Rate: 154.6 symbols/min [2025-10-09T22:42:15.975904] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:15.978740] [DEBUG] [LOCAL ] SKE: Loaded 36667 existing records from primary storage. [2025-10-09T22:42:15.979415] [INFO ] [MAIN ] SKE: Loaded 36667 primary data records. [2025-10-09T22:42:16.088809] [DEBUG] [LOCAL ] SKIL: Loaded 6584 existing records from primary storage. [2025-10-09T22:42:16.093204] [INFO ] [MAIN ] SKIL: Loaded 6584 primary data records. [2025-10-09T22:42:16.641998] [DEBUG] [MAIN ] SJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:16.675636] [INFO ] [MAIN ] SJT: Generated 1807 derivative records from 22638 primary records. [2025-10-09T22:42:16.676576] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-09T22:42:16.707519] [DEBUG] [LOCAL ] SJT: Derivative data saved (1807 records). [2025-10-09T22:42:16.707708] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-09T22:42:16.710050] [INFO ] [MAIN ] Derivative Progress: 1267/1690 symbols completed. SJT took 1.1s. Estimated remaining: 2m 44s. Rate: 154.5 symbols/min [2025-10-09T22:42:16.710394] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:16.724969] [DEBUG] [MAIN ] SKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:16.725713] [INFO ] [MAIN ] SKE: Generated 1807 derivative records from 36667 primary records. [2025-10-09T22:42:16.726119] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-09T22:42:16.749430] [DEBUG] [LOCAL ] SKLZ: Loaded 11644 existing records from primary storage. [2025-10-09T22:42:16.749842] [INFO ] [MAIN ] SKLZ: Loaded 11644 primary data records. [2025-10-09T22:42:16.806008] [DEBUG] [LOCAL ] SKE: Derivative data saved (1807 records). [2025-10-09T22:42:16.828600] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-09T22:42:16.836063] [INFO ] [MAIN ] Derivative Progress: 1268/1690 symbols completed. SKE took 1.2s. Estimated remaining: 2m 44s. Rate: 154.5 symbols/min [2025-10-09T22:42:16.849319] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:16.887029] [DEBUG] [MAIN ] SKIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:16.898906] [INFO ] [MAIN ] SKIL: Generated 1807 derivative records from 6584 primary records. [2025-10-09T22:42:16.899040] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-09T22:42:17.115310] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1807 records). [2025-10-09T22:42:17.116386] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-09T22:42:17.119238] [INFO ] [MAIN ] Derivative Progress: 1269/1690 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 43s. Rate: 154.6 symbols/min [2025-10-09T22:42:17.119847] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:17.133208] [DEBUG] [LOCAL ] SKM: Loaded 35216 existing records from primary storage. [2025-10-09T22:42:17.133420] [INFO ] [MAIN ] SKM: Loaded 35216 primary data records. [2025-10-09T22:42:17.475516] [DEBUG] [LOCAL ] SKT: Loaded 42715 existing records from primary storage. [2025-10-09T22:42:17.476124] [INFO ] [MAIN ] SKT: Loaded 42715 primary data records. [2025-10-09T22:42:17.476025] [DEBUG] [MAIN ] SKLZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:17.477104] [INFO ] [MAIN ] SKLZ: Generated 1807 derivative records from 11644 primary records. [2025-10-09T22:42:17.482349] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-09T22:42:17.662744] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1807 records). [2025-10-09T22:42:17.674283] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-09T22:42:17.676903] [INFO ] [MAIN ] Derivative Progress: 1270/1690 symbols completed. SKLZ took 1.0s. Estimated remaining: 2m 43s. Rate: 154.5 symbols/min [2025-10-09T22:42:17.698587] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:17.845929] [DEBUG] [MAIN ] SKM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:17.847553] [INFO ] [MAIN ] SKM: Generated 1807 derivative records from 35216 primary records. [2025-10-09T22:42:17.847850] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-09T22:42:17.892637] [DEBUG] [LOCAL ] SKY: Loaded 38321 existing records from primary storage. [2025-10-09T22:42:17.893993] [DEBUG] [LOCAL ] SKM: Derivative data saved (1807 records). [2025-10-09T22:42:17.894197] [INFO ] [MAIN ] SKY: Loaded 38321 primary data records. [2025-10-09T22:42:17.894618] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-09T22:42:17.931960] [INFO ] [MAIN ] Derivative Progress: 1271/1690 symbols completed. SKM took 1.1s. Estimated remaining: 2m 43s. Rate: 154.6 symbols/min [2025-10-09T22:42:17.942443] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:17.967364] [DEBUG] [MAIN ] SKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:17.990452] [INFO ] [MAIN ] SKT: Generated 1807 derivative records from 42715 primary records. [2025-10-09T22:42:17.995765] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-09T22:42:18.035957] [DEBUG] [LOCAL ] SKT: Derivative data saved (1807 records). [2025-10-09T22:42:18.050810] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-09T22:42:18.053105] [INFO ] [MAIN ] Derivative Progress: 1272/1690 symbols completed. SKT took 0.9s. Estimated remaining: 2m 42s. Rate: 154.6 symbols/min [2025-10-09T22:42:18.068810] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:18.131982] [DEBUG] [LOCAL ] SKYH: Loaded 16701 existing records from primary storage. [2025-10-09T22:42:18.132305] [INFO ] [MAIN ] SKYH: Loaded 16701 primary data records. [2025-10-09T22:42:18.654121] [DEBUG] [MAIN ] SKY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:18.655204] [INFO ] [MAIN ] SKY: Generated 1807 derivative records from 38321 primary records. [2025-10-09T22:42:18.656852] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-09T22:42:18.656258] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-10-09T22:42:18.657759] [INFO ] [MAIN ] SLB: Loaded 54087 primary data records. [2025-10-09T22:42:18.741935] [DEBUG] [LOCAL ] SKY: Derivative data saved (1807 records). [2025-10-09T22:42:18.747614] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-09T22:42:18.750239] [INFO ] [MAIN ] Derivative Progress: 1273/1690 symbols completed. SKY took 1.1s. Estimated remaining: 2m 42s. Rate: 154.6 symbols/min [2025-10-09T22:42:18.990261] [DEBUG] [MAIN ] SKYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:18.999859] [INFO ] [MAIN ] SKYH: Generated 1807 derivative records from 16701 primary records. [2025-10-09T22:42:18.999932] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-09T22:42:19.019541] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1807 records). [2025-10-09T22:42:19.019749] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-09T22:42:19.022067] [INFO ] [MAIN ] Derivative Progress: 1274/1690 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 41s. Rate: 154.6 symbols/min [2025-10-09T22:42:19.040856] [DEBUG] [MAIN ] SLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:19.041478] [INFO ] [MAIN ] SLB: Generated 1807 derivative records from 54087 primary records. [2025-10-09T22:42:19.041537] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-09T22:42:19.056936] [DEBUG] [LOCAL ] SLB: Derivative data saved (1807 records). [2025-10-09T22:42:19.056995] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-09T22:42:19.062721] [INFO ] [MAIN ] Derivative Progress: 1275/1690 symbols completed. SLB took 1.0s. Estimated remaining: 2m 41s. Rate: 154.7 symbols/min [2025-10-09T22:42:19.063597] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:19.064038] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:19.063837] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:19.159285] [DEBUG] [LOCAL ] SLGN: Loaded 40946 existing records from primary storage. [2025-10-09T22:42:19.160110] [INFO ] [MAIN ] SLGN: Loaded 40946 primary data records. [2025-10-09T22:42:19.166231] [DEBUG] [LOCAL ] SLF: Loaded 39021 existing records from primary storage. [2025-10-09T22:42:19.172862] [INFO ] [MAIN ] SLF: Loaded 39021 primary data records. [2025-10-09T22:42:19.312450] [DEBUG] [LOCAL ] SLG: Loaded 45493 existing records from primary storage. [2025-10-09T22:42:19.390944] [INFO ] [MAIN ] SLG: Loaded 45493 primary data records. [2025-10-09T22:42:20.184244] [DEBUG] [MAIN ] SLGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:20.187813] [INFO ] [MAIN ] SLGN: Generated 1807 derivative records from 40946 primary records. [2025-10-09T22:42:20.189524] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-09T22:42:20.216487] [DEBUG] [MAIN ] SLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:20.228576] [INFO ] [MAIN ] SLG: Generated 1807 derivative records from 45493 primary records. [2025-10-09T22:42:20.234413] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1807 records). [2025-10-09T22:42:20.228926] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-09T22:42:20.234746] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-09T22:42:20.237678] [INFO ] [MAIN ] Derivative Progress: 1276/1690 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 41s. Rate: 154.5 symbols/min [2025-10-09T22:42:20.235006] [DEBUG] [MAIN ] SLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:20.237832] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:20.238723] [INFO ] [MAIN ] SLF: Generated 1807 derivative records from 39021 primary records. [2025-10-09T22:42:20.239091] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-09T22:42:20.255756] [DEBUG] [LOCAL ] SLG: Derivative data saved (1807 records). [2025-10-09T22:42:20.263111] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-09T22:42:20.269279] [INFO ] [MAIN ] Derivative Progress: 1277/1690 symbols completed. SLG took 1.2s. Estimated remaining: 2m 40s. Rate: 154.6 symbols/min [2025-10-09T22:42:20.269750] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:20.277697] [DEBUG] [LOCAL ] SLF: Derivative data saved (1807 records). [2025-10-09T22:42:20.278187] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-09T22:42:20.280504] [INFO ] [MAIN ] Derivative Progress: 1278/1690 symbols completed. SLF took 1.2s. Estimated remaining: 2m 40s. Rate: 154.7 symbols/min [2025-10-09T22:42:20.280845] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:20.318353] [DEBUG] [LOCAL ] SLQT: Loaded 43804 existing records from primary storage. [2025-10-09T22:42:20.325163] [INFO ] [MAIN ] SLQT: Loaded 43804 primary data records. [2025-10-09T22:42:20.458917] [DEBUG] [LOCAL ] SLVM: Loaded 28054 existing records from primary storage. [2025-10-09T22:42:20.475892] [INFO ] [MAIN ] SLVM: Loaded 28054 primary data records. [2025-10-09T22:42:20.761906] [DEBUG] [LOCAL ] SM: Loaded 52703 existing records from primary storage. [2025-10-09T22:42:20.783949] [INFO ] [MAIN ] SM: Loaded 52703 primary data records. [2025-10-09T22:42:21.395007] [DEBUG] [MAIN ] SLQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:21.398055] [INFO ] [MAIN ] SLQT: Generated 1807 derivative records from 43804 primary records. [2025-10-09T22:42:21.398854] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-09T22:42:21.417592] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1807 records). [2025-10-09T22:42:21.418125] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-09T22:42:21.420680] [INFO ] [MAIN ] Derivative Progress: 1279/1690 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 40s. Rate: 154.4 symbols/min [2025-10-09T22:42:21.420863] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:21.448359] [DEBUG] [MAIN ] SLVM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:21.449520] [INFO ] [MAIN ] SLVM: Generated 1807 derivative records from 28054 primary records. [2025-10-09T22:42:21.449751] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-09T22:42:21.455157] [DEBUG] [LOCAL ] SMBK: Loaded 8215 existing records from primary storage. [2025-10-09T22:42:21.455625] [INFO ] [MAIN ] SMBK: Loaded 8215 primary data records. [2025-10-09T22:42:21.518419] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1807 records). [2025-10-09T22:42:21.530469] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-09T22:42:21.553031] [INFO ] [MAIN ] Derivative Progress: 1280/1690 symbols completed. SLVM took 1.3s. Estimated remaining: 2m 39s. Rate: 154.5 symbols/min [2025-10-09T22:42:21.558411] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:21.594390] [DEBUG] [MAIN ] SM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:21.601247] [INFO ] [MAIN ] SM: Generated 1807 derivative records from 52703 primary records. [2025-10-09T22:42:21.606521] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-09T22:42:21.705986] [DEBUG] [LOCAL ] SM: Derivative data saved (1807 records). [2025-10-09T22:42:21.833775] [DEBUG] [LOCAL ] SMC: Loaded 11351 existing records from primary storage. [2025-10-09T22:42:21.834271] [INFO ] [MAIN ] SMC: Loaded 11351 primary data records. [2025-10-09T22:42:21.834168] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-09T22:42:21.842622] [INFO ] [MAIN ] Derivative Progress: 1281/1690 symbols completed. SM took 1.6s. Estimated remaining: 2m 39s. Rate: 154.6 symbols/min [2025-10-09T22:42:21.870676] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:22.177745] [DEBUG] [MAIN ] SMBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:22.178687] [INFO ] [MAIN ] SMBK: Generated 1807 derivative records from 8215 primary records. [2025-10-09T22:42:22.178923] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-09T22:42:22.200731] [DEBUG] [LOCAL ] SMFG: Loaded 48531 existing records from primary storage. [2025-10-09T22:42:22.201248] [INFO ] [MAIN ] SMFG: Loaded 48531 primary data records. [2025-10-09T22:42:22.270988] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1807 records). [2025-10-09T22:42:22.299895] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-09T22:42:22.319187] [INFO ] [MAIN ] Derivative Progress: 1282/1690 symbols completed. SMBK took 0.9s. Estimated remaining: 2m 38s. Rate: 154.5 symbols/min [2025-10-09T22:42:22.339470] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:22.379842] [DEBUG] [MAIN ] SMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:22.433257] [INFO ] [MAIN ] SMC: Generated 1807 derivative records from 11351 primary records. [2025-10-09T22:42:22.439849] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-09T22:42:22.585863] [DEBUG] [LOCAL ] SMC: Derivative data saved (1807 records). [2025-10-09T22:42:22.586525] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-09T22:42:22.599183] [INFO ] [MAIN ] Derivative Progress: 1283/1690 symbols completed. SMC took 1.0s. Estimated remaining: 2m 38s. Rate: 154.6 symbols/min [2025-10-09T22:42:22.599590] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:22.618836] [DEBUG] [LOCAL ] SMG: Loaded 43897 existing records from primary storage. [2025-10-09T22:42:22.619100] [INFO ] [MAIN ] SMG: Loaded 43897 primary data records. [2025-10-09T22:42:22.686576] [DEBUG] [LOCAL ] SMHI: Loaded 13175 existing records from primary storage. [2025-10-09T22:42:22.701061] [INFO ] [MAIN ] SMHI: Loaded 13175 primary data records. [2025-10-09T22:42:22.796671] [DEBUG] [MAIN ] SMFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:22.828255] [INFO ] [MAIN ] SMFG: Generated 1807 derivative records from 48531 primary records. [2025-10-09T22:42:22.842250] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-09T22:42:23.208897] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1807 records). [2025-10-09T22:42:23.250331] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-09T22:42:23.252597] [INFO ] [MAIN ] Derivative Progress: 1284/1690 symbols completed. SMFG took 1.4s. Estimated remaining: 2m 38s. Rate: 154.5 symbols/min [2025-10-09T22:42:23.253059] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:23.406000] [DEBUG] [LOCAL ] SMP: Loaded 19095 existing records from primary storage. [2025-10-09T22:42:23.406612] [INFO ] [MAIN ] SMP: Loaded 19095 primary data records. [2025-10-09T22:42:23.601968] [DEBUG] [MAIN ] SMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:23.724465] [INFO ] [MAIN ] SMG: Generated 1807 derivative records from 43897 primary records. [2025-10-09T22:42:23.727199] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-09T22:42:23.763785] [DEBUG] [LOCAL ] SMG: Derivative data saved (1807 records). [2025-10-09T22:42:23.763629] [DEBUG] [MAIN ] SMHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:23.765524] [INFO ] [MAIN ] SMHI: Generated 1807 derivative records from 13175 primary records. [2025-10-09T22:42:23.764615] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-09T22:42:23.765861] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-09T22:42:23.768223] [INFO ] [MAIN ] Derivative Progress: 1285/1690 symbols completed. SMG took 1.4s. Estimated remaining: 2m 37s. Rate: 154.4 symbols/min [2025-10-09T22:42:23.770221] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:23.787362] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1807 records). [2025-10-09T22:42:23.787526] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-09T22:42:23.790682] [INFO ] [MAIN ] Derivative Progress: 1286/1690 symbols completed. SMHI took 1.2s. Estimated remaining: 2m 37s. Rate: 154.6 symbols/min [2025-10-09T22:42:23.791185] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:23.816360] [DEBUG] [MAIN ] SMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:23.817216] [INFO ] [MAIN ] SMP: Generated 1807 derivative records from 19095 primary records. [2025-10-09T22:42:23.817323] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-09T22:42:23.835620] [DEBUG] [LOCAL ] SMP: Derivative data saved (1807 records). [2025-10-09T22:42:23.835836] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-09T22:42:23.838815] [INFO ] [MAIN ] Derivative Progress: 1287/1690 symbols completed. SMP took 0.6s. Estimated remaining: 2m 36s. Rate: 154.7 symbols/min [2025-10-09T22:42:23.839130] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:23.886621] [DEBUG] [LOCAL ] SMRT: Loaded 44367 existing records from primary storage. [2025-10-09T22:42:23.909509] [INFO ] [MAIN ] SMRT: Loaded 44367 primary data records. [2025-10-09T22:42:23.937890] [DEBUG] [LOCAL ] SMR: Loaded 54188 existing records from primary storage. [2025-10-09T22:42:23.990862] [INFO ] [MAIN ] SMR: Loaded 54188 primary data records. [2025-10-09T22:42:24.029988] [DEBUG] [LOCAL ] SMWB: Loaded 32522 existing records from primary storage. [2025-10-09T22:42:24.057408] [INFO ] [MAIN ] SMWB: Loaded 32522 primary data records. [2025-10-09T22:42:25.021675] [DEBUG] [MAIN ] SMRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:25.026308] [INFO ] [MAIN ] SMRT: Generated 1807 derivative records from 44367 primary records. [2025-10-09T22:42:25.026788] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-09T22:42:25.054154] [DEBUG] [MAIN ] SMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:25.055143] [INFO ] [MAIN ] SMR: Generated 1807 derivative records from 54188 primary records. [2025-10-09T22:42:25.053152] [DEBUG] [MAIN ] SMWB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:25.063391] [INFO ] [MAIN ] SMWB: Generated 1807 derivative records from 32522 primary records. [2025-10-09T22:42:25.055491] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-09T22:42:25.063693] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-09T22:42:25.100709] [DEBUG] [LOCAL ] SMR: Derivative data saved (1807 records). [2025-10-09T22:42:25.101819] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-09T22:42:25.105339] [INFO ] [MAIN ] Derivative Progress: 1288/1690 symbols completed. SMR took 1.3s. Estimated remaining: 2m 36s. Rate: 154.4 symbols/min [2025-10-09T22:42:25.111589] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1807 records). [2025-10-09T22:42:25.111450] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1807 records). [2025-10-09T22:42:25.111819] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-09T22:42:25.114936] [INFO ] [MAIN ] Derivative Progress: 1289/1690 symbols completed. SMWB took 1.3s. Estimated remaining: 2m 36s. Rate: 154.5 symbols/min [2025-10-09T22:42:25.111940] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-09T22:42:25.117740] [INFO ] [MAIN ] Derivative Progress: 1290/1690 symbols completed. SMRT took 1.3s. Estimated remaining: 2m 35s. Rate: 154.6 symbols/min [2025-10-09T22:42:25.118243] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:25.118305] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:25.118807] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:25.152592] [DEBUG] [LOCAL ] SNA: Loaded 25838 existing records from primary storage. [2025-10-09T22:42:25.152906] [INFO ] [MAIN ] SNA: Loaded 25838 primary data records. [2025-10-09T22:42:25.356690] [DEBUG] [LOCAL ] SN: Loaded 50297 existing records from primary storage. [2025-10-09T22:42:25.377381] [INFO ] [MAIN ] SN: Loaded 50297 primary data records. [2025-10-09T22:42:25.570435] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-10-09T22:42:25.587276] [INFO ] [MAIN ] SNAP: Loaded 54186 primary data records. [2025-10-09T22:42:26.149371] [DEBUG] [MAIN ] SNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:26.151719] [INFO ] [MAIN ] SNA: Generated 1807 derivative records from 25838 primary records. [2025-10-09T22:42:26.151978] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-09T22:42:26.194991] [DEBUG] [MAIN ] SN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:26.203721] [INFO ] [MAIN ] SN: Generated 1807 derivative records from 50297 primary records. [2025-10-09T22:42:26.189759] [DEBUG] [LOCAL ] SNA: Derivative data saved (1807 records). [2025-10-09T22:42:26.208659] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-09T22:42:26.209142] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-09T22:42:26.213298] [INFO ] [MAIN ] Derivative Progress: 1291/1690 symbols completed. SNA took 1.1s. Estimated remaining: 2m 35s. Rate: 154.4 symbols/min [2025-10-09T22:42:26.213942] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:26.213793] [DEBUG] [MAIN ] SNAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:26.229609] [DEBUG] [LOCAL ] SN: Derivative data saved (1807 records). [2025-10-09T22:42:26.230146] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-09T22:42:26.232172] [INFO ] [MAIN ] Derivative Progress: 1292/1690 symbols completed. SN took 1.1s. Estimated remaining: 2m 35s. Rate: 154.5 symbols/min [2025-10-09T22:42:26.233791] [INFO ] [MAIN ] SNAP: Generated 1807 derivative records from 54186 primary records. [2025-10-09T22:42:26.234114] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:26.234301] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-09T22:42:26.253369] [DEBUG] [LOCAL ] SNDA: Loaded 4468 existing records from primary storage. [2025-10-09T22:42:26.257316] [INFO ] [MAIN ] SNDA: Loaded 4468 primary data records. [2025-10-09T22:42:26.289972] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1807 records). [2025-10-09T22:42:26.322359] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-09T22:42:26.332776] [INFO ] [MAIN ] Derivative Progress: 1293/1690 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 34s. Rate: 154.6 symbols/min [2025-10-09T22:42:26.338607] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:26.590766] [DEBUG] [LOCAL ] SNDR: Loaded 41466 existing records from primary storage. [2025-10-09T22:42:26.591029] [INFO ] [MAIN ] SNDR: Loaded 41466 primary data records. [2025-10-09T22:42:26.918948] [DEBUG] [LOCAL ] SNN: Loaded 44528 existing records from primary storage. [2025-10-09T22:42:26.919901] [INFO ] [MAIN ] SNN: Loaded 44528 primary data records. [2025-10-09T22:42:27.042002] [DEBUG] [MAIN ] SNDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:27.113737] [INFO ] [MAIN ] SNDA: Generated 1807 derivative records from 4468 primary records. [2025-10-09T22:42:27.159078] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-09T22:42:27.301339] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1807 records). [2025-10-09T22:42:27.301754] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-09T22:42:27.304275] [INFO ] [MAIN ] Derivative Progress: 1294/1690 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 34s. Rate: 154.4 symbols/min [2025-10-09T22:42:27.304697] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:27.323770] [DEBUG] [MAIN ] SNDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:27.324674] [INFO ] [MAIN ] SNDR: Generated 1807 derivative records from 41466 primary records. [2025-10-09T22:42:27.324900] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-09T22:42:27.344099] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1807 records). [2025-10-09T22:42:27.344380] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-09T22:42:27.347160] [INFO ] [MAIN ] Derivative Progress: 1295/1690 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 33s. Rate: 154.5 symbols/min [2025-10-09T22:42:27.347457] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:27.363723] [DEBUG] [MAIN ] SNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:27.364436] [INFO ] [MAIN ] SNN: Generated 1807 derivative records from 44528 primary records. [2025-10-09T22:42:27.364550] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-09T22:42:27.395574] [DEBUG] [LOCAL ] SNN: Derivative data saved (1807 records). [2025-10-09T22:42:27.395757] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-09T22:42:27.404822] [INFO ] [MAIN ] Derivative Progress: 1296/1690 symbols completed. SNN took 1.1s. Estimated remaining: 2m 33s. Rate: 154.6 symbols/min [2025-10-09T22:42:27.405058] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:27.432885] [DEBUG] [LOCAL ] SNOW: Loaded 53983 existing records from primary storage. [2025-10-09T22:42:27.433618] [INFO ] [MAIN ] SNOW: Loaded 53983 primary data records. [2025-10-09T22:42:27.630405] [DEBUG] [LOCAL ] SNV: Loaded 49251 existing records from primary storage. [2025-10-09T22:42:27.668878] [INFO ] [MAIN ] SNV: Loaded 49251 primary data records. [2025-10-09T22:42:27.818440] [DEBUG] [LOCAL ] SNX: Loaded 40296 existing records from primary storage. [2025-10-09T22:42:27.840711] [INFO ] [MAIN ] SNX: Loaded 40296 primary data records. [2025-10-09T22:42:28.458281] [DEBUG] [MAIN ] SNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:28.459530] [INFO ] [MAIN ] SNOW: Generated 1807 derivative records from 53983 primary records. [2025-10-09T22:42:28.459633] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-09T22:42:28.482117] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1807 records). [2025-10-09T22:42:28.490248] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-09T22:42:28.497844] [INFO ] [MAIN ] Derivative Progress: 1297/1690 symbols completed. SNOW took 1.2s. Estimated remaining: 2m 33s. Rate: 154.4 symbols/min [2025-10-09T22:42:28.498188] [DEBUG] [MAIN ] SNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:28.498751] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:28.499920] [INFO ] [MAIN ] SNV: Generated 1807 derivative records from 49251 primary records. [2025-10-09T22:42:28.500762] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-09T22:42:28.519276] [DEBUG] [LOCAL ] SNV: Derivative data saved (1807 records). [2025-10-09T22:42:28.519438] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-09T22:42:28.521633] [INFO ] [MAIN ] Derivative Progress: 1298/1690 symbols completed. SNV took 1.2s. Estimated remaining: 2m 32s. Rate: 154.5 symbols/min [2025-10-09T22:42:28.522008] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:28.541515] [DEBUG] [MAIN ] SNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:28.542619] [INFO ] [MAIN ] SNX: Generated 1807 derivative records from 40296 primary records. [2025-10-09T22:42:28.542725] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-09T22:42:28.560557] [DEBUG] [LOCAL ] SNX: Derivative data saved (1807 records). [2025-10-09T22:42:28.560779] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-09T22:42:28.565783] [INFO ] [MAIN ] Derivative Progress: 1299/1690 symbols completed. SNX took 1.2s. Estimated remaining: 2m 32s. Rate: 154.6 symbols/min [2025-10-09T22:42:28.566026] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:28.631470] [DEBUG] [LOCAL ] SOBO: Loaded 39595 existing records from primary storage. [2025-10-09T22:42:28.631828] [INFO ] [MAIN ] SOBO: Loaded 39595 primary data records. [2025-10-09T22:42:28.636402] [DEBUG] [LOCAL ] SO: Loaded 53999 existing records from primary storage. [2025-10-09T22:42:28.648690] [INFO ] [MAIN ] SO: Loaded 53999 primary data records. [2025-10-09T22:42:29.001066] [DEBUG] [LOCAL ] SOC: Loaded 51018 existing records from primary storage. [2025-10-09T22:42:29.068429] [INFO ] [MAIN ] SOC: Loaded 51018 primary data records. [2025-10-09T22:42:29.740165] [DEBUG] [MAIN ] SOBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:29.755459] [INFO ] [MAIN ] SOBO: Generated 1807 derivative records from 39595 primary records. [2025-10-09T22:42:29.754436] [DEBUG] [MAIN ] SO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:29.757494] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-09T22:42:29.758710] [INFO ] [MAIN ] SO: Generated 1807 derivative records from 53999 primary records. [2025-10-09T22:42:29.759984] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-09T22:42:29.792478] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1807 records). [2025-10-09T22:42:29.793055] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-09T22:42:29.796947] [INFO ] [MAIN ] Derivative Progress: 1300/1690 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 32s. Rate: 154.4 symbols/min [2025-10-09T22:42:29.801517] [DEBUG] [LOCAL ] SO: Derivative data saved (1807 records). [2025-10-09T22:42:29.801859] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:29.802321] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-09T22:42:29.809022] [INFO ] [MAIN ] Derivative Progress: 1301/1690 symbols completed. SO took 1.3s. Estimated remaining: 2m 31s. Rate: 154.5 symbols/min [2025-10-09T22:42:29.809419] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:29.825465] [DEBUG] [MAIN ] SOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:29.829055] [INFO ] [MAIN ] SOC: Generated 1807 derivative records from 51018 primary records. [2025-10-09T22:42:29.829392] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-09T22:42:29.847621] [DEBUG] [LOCAL ] SOJC: Loaded 5009 existing records from primary storage. [2025-10-09T22:42:29.855379] [INFO ] [MAIN ] SOJC: Loaded 5009 primary data records. [2025-10-09T22:42:29.869481] [DEBUG] [LOCAL ] SOC: Derivative data saved (1807 records). [2025-10-09T22:42:29.911115] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-09T22:42:29.898002] [DEBUG] [LOCAL ] SOJD: Loaded 13098 existing records from primary storage. [2025-10-09T22:42:29.945360] [INFO ] [MAIN ] SOJD: Loaded 13098 primary data records. [2025-10-09T22:42:29.948363] [INFO ] [MAIN ] Derivative Progress: 1302/1690 symbols completed. SOC took 1.4s. Estimated remaining: 2m 31s. Rate: 154.6 symbols/min [2025-10-09T22:42:29.953995] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:30.183543] [DEBUG] [LOCAL ] SOJE: Loaded 9109 existing records from primary storage. [2025-10-09T22:42:30.324599] [INFO ] [MAIN ] SOJE: Loaded 9109 primary data records. [2025-10-09T22:42:30.855888] [DEBUG] [MAIN ] SOJC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:42:30.856962] [INFO ] [MAIN ] SOJC: Generated 1806 derivative records from 5009 primary records. [2025-10-09T22:42:30.857175] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-09T22:42:30.887845] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1806 records). [2025-10-09T22:42:30.893731] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-09T22:42:30.896408] [INFO ] [MAIN ] Derivative Progress: 1303/1690 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 30s. Rate: 154.4 symbols/min [2025-10-09T22:42:30.897129] [DEBUG] [MAIN ] SOJD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:30.898966] [INFO ] [MAIN ] SOJD: Generated 1807 derivative records from 13098 primary records. [2025-10-09T22:42:30.899100] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-09T22:42:30.919447] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1807 records). [2025-10-09T22:42:30.919552] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-09T22:42:30.922442] [INFO ] [MAIN ] Derivative Progress: 1304/1690 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 30s. Rate: 154.5 symbols/min [2025-10-09T22:42:30.936033] [DEBUG] [MAIN ] SOJE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:30.936882] [INFO ] [MAIN ] SOJE: Generated 1807 derivative records from 9109 primary records. [2025-10-09T22:42:30.936951] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-09T22:42:30.953347] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1807 records). [2025-10-09T22:42:30.953428] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-09T22:42:30.957889] [INFO ] [MAIN ] Derivative Progress: 1305/1690 symbols completed. SOJE took 1.0s. Estimated remaining: 2m 29s. Rate: 154.6 symbols/min [2025-10-09T22:42:30.958558] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:30.958476] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:30.958878] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:30.976260] [DEBUG] [LOCAL ] SOL: Loaded 13107 existing records from primary storage. [2025-10-09T22:42:30.976440] [INFO ] [MAIN ] SOL: Loaded 13107 primary data records. [2025-10-09T22:42:31.402992] [DEBUG] [LOCAL ] SON: Loaded 43399 existing records from primary storage. [2025-10-09T22:42:31.405368] [INFO ] [MAIN ] SON: Loaded 43399 primary data records. [2025-10-09T22:42:31.405050] [DEBUG] [LOCAL ] SOLV: Loaded 44207 existing records from primary storage. [2025-10-09T22:42:31.405697] [INFO ] [MAIN ] SOLV: Loaded 44207 primary data records. [2025-10-09T22:42:32.081621] [DEBUG] [MAIN ] SOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:32.083438] [INFO ] [MAIN ] SOL: Generated 1807 derivative records from 13107 primary records. [2025-10-09T22:42:32.083667] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-09T22:42:32.107547] [DEBUG] [LOCAL ] SOL: Derivative data saved (1807 records). [2025-10-09T22:42:32.108243] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-09T22:42:32.110876] [INFO ] [MAIN ] Derivative Progress: 1306/1690 symbols completed. SOL took 1.2s. Estimated remaining: 2m 29s. Rate: 154.4 symbols/min [2025-10-09T22:42:32.111315] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:32.135565] [DEBUG] [MAIN ] SOLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:32.136848] [INFO ] [MAIN ] SOLV: Generated 1807 derivative records from 44207 primary records. [2025-10-09T22:42:32.137277] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-09T22:42:32.167369] [DEBUG] [MAIN ] SON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:32.169832] [INFO ] [MAIN ] SON: Generated 1807 derivative records from 43399 primary records. [2025-10-09T22:42:32.172697] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-09T22:42:32.176829] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1807 records). [2025-10-09T22:42:32.177405] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-09T22:42:32.180173] [INFO ] [MAIN ] Derivative Progress: 1307/1690 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 29s. Rate: 154.5 symbols/min [2025-10-09T22:42:32.180479] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:32.219268] [DEBUG] [LOCAL ] SON: Derivative data saved (1807 records). [2025-10-09T22:42:32.218556] [DEBUG] [LOCAL ] SOR: Loaded 2909 existing records from primary storage. [2025-10-09T22:42:32.219714] [INFO ] [MAIN ] SOR: Loaded 2909 primary data records. [2025-10-09T22:42:32.219580] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-09T22:42:32.235816] [INFO ] [MAIN ] Derivative Progress: 1308/1690 symbols completed. SON took 1.3s. Estimated remaining: 2m 28s. Rate: 154.6 symbols/min [2025-10-09T22:42:32.257872] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:32.358132] [DEBUG] [LOCAL ] SONY: Loaded 53756 existing records from primary storage. [2025-10-09T22:42:32.368354] [INFO ] [MAIN ] SONY: Loaded 53756 primary data records. [2025-10-09T22:42:32.389670] [DEBUG] [LOCAL ] SOS: Loaded 9215 existing records from primary storage. [2025-10-09T22:42:32.417942] [INFO ] [MAIN ] SOS: Loaded 9215 primary data records. [2025-10-09T22:42:33.347324] [DEBUG] [MAIN ] SOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:33.360860] [INFO ] [MAIN ] SOR: Generated 1807 derivative records from 2909 primary records. [2025-10-09T22:42:33.360959] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-09T22:42:33.361222] [DEBUG] [MAIN ] SONY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:33.371983] [INFO ] [MAIN ] SONY: Generated 1807 derivative records from 53756 primary records. [2025-10-09T22:42:33.376380] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-09T22:42:33.406931] [DEBUG] [LOCAL ] SOR: Derivative data saved (1807 records). [2025-10-09T22:42:33.408074] [DEBUG] [MAIN ] SOS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:42:33.409582] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-09T22:42:33.409480] [INFO ] [MAIN ] SOS: Generated 1806 derivative records from 9215 primary records. [2025-10-09T22:42:33.412691] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-09T22:42:33.412022] [INFO ] [MAIN ] Derivative Progress: 1309/1690 symbols completed. SOR took 1.2s. Estimated remaining: 2m 28s. Rate: 154.3 symbols/min [2025-10-09T22:42:33.414191] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:33.428181] [DEBUG] [LOCAL ] SONY: Derivative data saved (1807 records). [2025-10-09T22:42:33.429849] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-09T22:42:33.434363] [INFO ] [MAIN ] Derivative Progress: 1310/1690 symbols completed. SONY took 1.3s. Estimated remaining: 2m 28s. Rate: 154.5 symbols/min [2025-10-09T22:42:33.435704] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:33.438380] [DEBUG] [LOCAL ] SOS: Derivative data saved (1806 records). [2025-10-09T22:42:33.438539] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-09T22:42:33.443583] [INFO ] [MAIN ] Derivative Progress: 1311/1690 symbols completed. SOS took 1.2s. Estimated remaining: 2m 27s. Rate: 154.6 symbols/min [2025-10-09T22:42:33.444063] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:33.456589] [DEBUG] [LOCAL ] SPE: Loaded 6317 existing records from primary storage. [2025-10-09T22:42:33.456941] [INFO ] [MAIN ] SPE: Loaded 6317 primary data records. [2025-10-09T22:42:33.623201] [DEBUG] [LOCAL ] SPB: Loaded 34429 existing records from primary storage. [2025-10-09T22:42:33.639847] [INFO ] [MAIN ] SPB: Loaded 34429 primary data records. [2025-10-09T22:42:33.837355] [DEBUG] [LOCAL ] SPCE: Loaded 50318 existing records from primary storage. [2025-10-09T22:42:33.912389] [INFO ] [MAIN ] SPCE: Loaded 50318 primary data records. [2025-10-09T22:42:34.515269] [DEBUG] [MAIN ] SPE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:42:34.517910] [INFO ] [MAIN ] SPE: Generated 1806 derivative records from 6317 primary records. [2025-10-09T22:42:34.518188] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-09T22:42:34.555333] [DEBUG] [MAIN ] SPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:34.556751] [INFO ] [MAIN ] SPB: Generated 1807 derivative records from 34429 primary records. [2025-10-09T22:42:34.556855] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-09T22:42:34.555442] [DEBUG] [LOCAL ] SPE: Derivative data saved (1806 records). [2025-10-09T22:42:34.557734] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-09T22:42:34.561412] [INFO ] [MAIN ] Derivative Progress: 1312/1690 symbols completed. SPE took 1.1s. Estimated remaining: 2m 27s. Rate: 154.3 symbols/min [2025-10-09T22:42:34.571593] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:34.583224] [DEBUG] [LOCAL ] SPB: Derivative data saved (1807 records). [2025-10-09T22:42:34.583389] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-09T22:42:34.587049] [INFO ] [MAIN ] Derivative Progress: 1313/1690 symbols completed. SPB took 1.2s. Estimated remaining: 2m 26s. Rate: 154.5 symbols/min [2025-10-09T22:42:34.587802] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:34.604264] [DEBUG] [MAIN ] SPCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:34.605185] [INFO ] [MAIN ] SPCE: Generated 1807 derivative records from 50318 primary records. [2025-10-09T22:42:34.605359] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-09T22:42:34.623456] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1807 records). [2025-10-09T22:42:34.623574] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-09T22:42:34.628083] [INFO ] [MAIN ] Derivative Progress: 1314/1690 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 26s. Rate: 154.6 symbols/min [2025-10-09T22:42:34.628404] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:34.673223] [DEBUG] [LOCAL ] SPH: Loaded 16976 existing records from primary storage. [2025-10-09T22:42:34.673514] [INFO ] [MAIN ] SPH: Loaded 16976 primary data records. [2025-10-09T22:42:34.811558] [DEBUG] [LOCAL ] SPGI: Loaded 46139 existing records from primary storage. [2025-10-09T22:42:34.812308] [INFO ] [MAIN ] SPGI: Loaded 46139 primary data records. [2025-10-09T22:42:34.823749] [DEBUG] [LOCAL ] SPG: Loaded 50593 existing records from primary storage. [2025-10-09T22:42:34.867535] [INFO ] [MAIN ] SPG: Loaded 50593 primary data records. [2025-10-09T22:42:35.738165] [DEBUG] [MAIN ] SPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:35.739558] [INFO ] [MAIN ] SPH: Generated 1807 derivative records from 16976 primary records. [2025-10-09T22:42:35.740042] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-09T22:42:35.791038] [DEBUG] [MAIN ] SPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:35.791522] [DEBUG] [LOCAL ] SPH: Derivative data saved (1807 records). [2025-10-09T22:42:35.791426] [DEBUG] [MAIN ] SPGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:35.792599] [INFO ] [MAIN ] SPG: Generated 1807 derivative records from 50593 primary records. [2025-10-09T22:42:35.792796] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-09T22:42:35.795700] [INFO ] [MAIN ] Derivative Progress: 1315/1690 symbols completed. SPH took 1.2s. Estimated remaining: 2m 26s. Rate: 154.3 symbols/min [2025-10-09T22:42:35.796908] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:35.796726] [INFO ] [MAIN ] SPGI: Generated 1807 derivative records from 46139 primary records. [2025-10-09T22:42:35.795847] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-09T22:42:35.797335] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-09T22:42:35.831289] [DEBUG] [LOCAL ] SPG: Derivative data saved (1807 records). [2025-10-09T22:42:35.831876] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-09T22:42:35.834824] [INFO ] [MAIN ] Derivative Progress: 1316/1690 symbols completed. SPG took 1.3s. Estimated remaining: 2m 25s. Rate: 154.4 symbols/min [2025-10-09T22:42:35.835445] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:35.836741] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1807 records). [2025-10-09T22:42:35.836934] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-09T22:42:35.840152] [INFO ] [MAIN ] Derivative Progress: 1317/1690 symbols completed. SPGI took 1.3s. Estimated remaining: 2m 25s. Rate: 154.5 symbols/min [2025-10-09T22:42:35.840454] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:35.859679] [DEBUG] [LOCAL ] SPMC: Loaded 5366 existing records from primary storage. [2025-10-09T22:42:35.859852] [INFO ] [MAIN ] SPMC: Loaded 5366 primary data records. [2025-10-09T22:42:35.991452] [DEBUG] [LOCAL ] SPHR: Loaded 40671 existing records from primary storage. [2025-10-09T22:42:36.001139] [INFO ] [MAIN ] SPHR: Loaded 40671 primary data records. [2025-10-09T22:42:36.052166] [DEBUG] [LOCAL ] SPIR: Loaded 37664 existing records from primary storage. [2025-10-09T22:42:36.115349] [INFO ] [MAIN ] SPIR: Loaded 37664 primary data records. [2025-10-09T22:42:36.882908] [DEBUG] [MAIN ] SPMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:36.884345] [INFO ] [MAIN ] SPMC: Generated 1807 derivative records from 5366 primary records. [2025-10-09T22:42:36.884672] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-09T22:42:36.916708] [DEBUG] [MAIN ] SPHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:36.918374] [INFO ] [MAIN ] SPHR: Generated 1807 derivative records from 40671 primary records. [2025-10-09T22:42:36.918727] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-09T22:42:36.919041] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1807 records). [2025-10-09T22:42:36.920801] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-09T22:42:36.925363] [INFO ] [MAIN ] Derivative Progress: 1318/1690 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 25s. Rate: 154.3 symbols/min [2025-10-09T22:42:36.954459] [DEBUG] [MAIN ] SPIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:36.955710] [INFO ] [MAIN ] SPIR: Generated 1807 derivative records from 37664 primary records. [2025-10-09T22:42:36.955796] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-09T22:42:36.954873] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1807 records). [2025-10-09T22:42:36.956352] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-09T22:42:36.959723] [INFO ] [MAIN ] Derivative Progress: 1319/1690 symbols completed. SPHR took 1.2s. Estimated remaining: 2m 24s. Rate: 154.4 symbols/min [2025-10-09T22:42:36.975312] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1807 records). [2025-10-09T22:42:36.975382] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-09T22:42:36.978006] [INFO ] [MAIN ] Derivative Progress: 1320/1690 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 24s. Rate: 154.6 symbols/min [2025-10-09T22:42:36.978563] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:36.978489] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:36.978721] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:37.053313] [DEBUG] [LOCAL ] SPNT: Loaded 34903 existing records from primary storage. [2025-10-09T22:42:37.053502] [INFO ] [MAIN ] SPNT: Loaded 34903 primary data records. [2025-10-09T22:42:37.183260] [DEBUG] [LOCAL ] SPR: Loaded 41394 existing records from primary storage. [2025-10-09T22:42:37.184828] [INFO ] [MAIN ] SPR: Loaded 41394 primary data records. [2025-10-09T22:42:37.184695] [DEBUG] [LOCAL ] SPOT: Loaded 50814 existing records from primary storage. [2025-10-09T22:42:37.205078] [INFO ] [MAIN ] SPOT: Loaded 50814 primary data records. [2025-10-09T22:42:38.131786] [DEBUG] [MAIN ] SPNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:38.132730] [INFO ] [MAIN ] SPNT: Generated 1807 derivative records from 34903 primary records. [2025-10-09T22:42:38.133023] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-09T22:42:38.170495] [DEBUG] [MAIN ] SPOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:38.172152] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1807 records). [2025-10-09T22:42:38.180985] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-09T22:42:38.173020] [INFO ] [MAIN ] SPOT: Generated 1807 derivative records from 50814 primary records. [2025-10-09T22:42:38.189149] [INFO ] [MAIN ] Derivative Progress: 1321/1690 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 23s. Rate: 154.3 symbols/min [2025-10-09T22:42:38.190163] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-09T22:42:38.190537] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:38.190914] [DEBUG] [MAIN ] SPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:38.200880] [INFO ] [MAIN ] SPR: Generated 1807 derivative records from 41394 primary records. [2025-10-09T22:42:38.201106] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-09T22:42:38.222452] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1807 records). [2025-10-09T22:42:38.225411] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-09T22:42:38.228486] [INFO ] [MAIN ] Derivative Progress: 1322/1690 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 23s. Rate: 154.4 symbols/min [2025-10-09T22:42:38.229268] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:38.236639] [DEBUG] [LOCAL ] SPRU: Loaded 9627 existing records from primary storage. [2025-10-09T22:42:38.237733] [INFO ] [MAIN ] SPRU: Loaded 9627 primary data records. [2025-10-09T22:42:38.253102] [DEBUG] [LOCAL ] SPR: Derivative data saved (1807 records). [2025-10-09T22:42:38.273447] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-09T22:42:38.282229] [INFO ] [MAIN ] Derivative Progress: 1323/1690 symbols completed. SPR took 1.3s. Estimated remaining: 2m 23s. Rate: 154.5 symbols/min [2025-10-09T22:42:38.289822] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:38.415976] [DEBUG] [LOCAL ] SPXC: Loaded 23389 existing records from primary storage. [2025-10-09T22:42:38.433777] [INFO ] [MAIN ] SPXC: Loaded 23389 primary data records. [2025-10-09T22:42:38.460345] [DEBUG] [LOCAL ] SPXX: Loaded 9562 existing records from primary storage. [2025-10-09T22:42:38.479208] [INFO ] [MAIN ] SPXX: Loaded 9562 primary data records. [2025-10-09T22:42:39.345047] [DEBUG] [MAIN ] SPRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:39.347905] [INFO ] [MAIN ] SPRU: Generated 1807 derivative records from 9627 primary records. [2025-10-09T22:42:39.348288] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-09T22:42:39.370952] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1807 records). [2025-10-09T22:42:39.371573] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-09T22:42:39.374512] [INFO ] [MAIN ] Derivative Progress: 1324/1690 symbols completed. SPRU took 1.2s. Estimated remaining: 2m 22s. Rate: 154.3 symbols/min [2025-10-09T22:42:39.375084] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:39.409231] [DEBUG] [MAIN ] SPXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:39.409634] [DEBUG] [MAIN ] SPXX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:39.410616] [INFO ] [MAIN ] SPXX: Generated 1807 derivative records from 9562 primary records. [2025-10-09T22:42:39.410784] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-09T22:42:39.421305] [INFO ] [MAIN ] SPXC: Generated 1807 derivative records from 23389 primary records. [2025-10-09T22:42:39.428250] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-09T22:42:39.432337] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1807 records). [2025-10-09T22:42:39.432449] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-09T22:42:39.443387] [INFO ] [MAIN ] Derivative Progress: 1325/1690 symbols completed. SPXX took 1.2s. Estimated remaining: 2m 22s. Rate: 154.4 symbols/min [2025-10-09T22:42:39.445019] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:39.465815] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1807 records). [2025-10-09T22:42:39.465997] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-09T22:42:39.468580] [INFO ] [MAIN ] Derivative Progress: 1326/1690 symbols completed. SPXC took 1.2s. Estimated remaining: 2m 21s. Rate: 154.5 symbols/min [2025-10-09T22:42:39.468933] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:39.498197] [DEBUG] [LOCAL ] SQM: Loaded 49015 existing records from primary storage. [2025-10-09T22:42:39.498550] [INFO ] [MAIN ] SQM: Loaded 49015 primary data records. [2025-10-09T22:42:39.565131] [DEBUG] [LOCAL ] SQNS: Loaded 27209 existing records from primary storage. [2025-10-09T22:42:39.590053] [INFO ] [MAIN ] SQNS: Loaded 27209 primary data records. [2025-10-09T22:42:39.842052] [DEBUG] [LOCAL ] SR: Loaded 32794 existing records from primary storage. [2025-10-09T22:42:39.865442] [INFO ] [MAIN ] SR: Loaded 32794 primary data records. [2025-10-09T22:42:40.624639] [DEBUG] [MAIN ] SQM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:40.626603] [INFO ] [MAIN ] SQM: Generated 1807 derivative records from 49015 primary records. [2025-10-09T22:42:40.627330] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-09T22:42:40.642785] [DEBUG] [MAIN ] SQNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:40.645112] [INFO ] [MAIN ] SQNS: Generated 1807 derivative records from 27209 primary records. [2025-10-09T22:42:40.653063] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-09T22:42:40.681520] [DEBUG] [LOCAL ] SQM: Derivative data saved (1807 records). [2025-10-09T22:42:40.682057] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-09T22:42:40.686069] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1807 records). [2025-10-09T22:42:40.685457] [INFO ] [MAIN ] Derivative Progress: 1327/1690 symbols completed. SQM took 1.3s. Estimated remaining: 2m 21s. Rate: 154.3 symbols/min [2025-10-09T22:42:40.686349] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-09T22:42:40.689610] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:40.689797] [INFO ] [MAIN ] Derivative Progress: 1328/1690 symbols completed. SQNS took 1.2s. Estimated remaining: 2m 21s. Rate: 154.4 symbols/min [2025-10-09T22:42:40.690454] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:40.704804] [DEBUG] [MAIN ] SR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:40.705631] [INFO ] [MAIN ] SR: Generated 1807 derivative records from 32794 primary records. [2025-10-09T22:42:40.705824] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-09T22:42:40.731480] [DEBUG] [LOCAL ] SR: Derivative data saved (1807 records). [2025-10-09T22:42:40.732073] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-09T22:42:40.735264] [INFO ] [MAIN ] Derivative Progress: 1329/1690 symbols completed. SR took 1.3s. Estimated remaining: 2m 20s. Rate: 154.5 symbols/min [2025-10-09T22:42:40.736083] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:40.735943] [DEBUG] [LOCAL ] SREA: Loaded 10293 existing records from primary storage. [2025-10-09T22:42:40.736593] [INFO ] [MAIN ] SREA: Loaded 10293 primary data records. [2025-10-09T22:42:40.977928] [DEBUG] [LOCAL ] SRE: Loaded 53804 existing records from primary storage. [2025-10-09T22:42:41.085679] [INFO ] [MAIN ] SRE: Loaded 53804 primary data records. [2025-10-09T22:42:41.125830] [DEBUG] [LOCAL ] SRFM: Loaded 38214 existing records from primary storage. [2025-10-09T22:42:41.148439] [INFO ] [MAIN ] SRFM: Loaded 38214 primary data records. [2025-10-09T22:42:41.742418] [DEBUG] [MAIN ] SREA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:41.743311] [INFO ] [MAIN ] SREA: Generated 1807 derivative records from 10293 primary records. [2025-10-09T22:42:41.743776] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-09T22:42:41.762460] [DEBUG] [LOCAL ] SREA: Derivative data saved (1807 records). [2025-10-09T22:42:41.762673] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-09T22:42:41.765181] [INFO ] [MAIN ] Derivative Progress: 1330/1690 symbols completed. SREA took 1.1s. Estimated remaining: 2m 20s. Rate: 154.3 symbols/min [2025-10-09T22:42:41.765435] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:41.784627] [DEBUG] [MAIN ] SRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:41.786992] [INFO ] [MAIN ] SRE: Generated 1807 derivative records from 53804 primary records. [2025-10-09T22:42:41.787254] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-09T22:42:41.819842] [DEBUG] [LOCAL ] SRE: Derivative data saved (1807 records). [2025-10-09T22:42:41.820416] [DEBUG] [MAIN ] SRFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:41.820570] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-09T22:42:41.821444] [INFO ] [MAIN ] SRFM: Generated 1807 derivative records from 38214 primary records. [2025-10-09T22:42:41.823986] [INFO ] [MAIN ] Derivative Progress: 1331/1690 symbols completed. SRE took 1.1s. Estimated remaining: 2m 20s. Rate: 154.4 symbols/min [2025-10-09T22:42:41.824227] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-09T22:42:41.824330] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:41.831129] [DEBUG] [LOCAL ] SRG: Loaded 15439 existing records from primary storage. [2025-10-09T22:42:41.831486] [INFO ] [MAIN ] SRG: Loaded 15439 primary data records. [2025-10-09T22:42:42.023715] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1807 records). [2025-10-09T22:42:42.034166] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-09T22:42:42.042153] [INFO ] [MAIN ] Derivative Progress: 1332/1690 symbols completed. SRFM took 1.3s. Estimated remaining: 2m 19s. Rate: 154.4 symbols/min [2025-10-09T22:42:42.043067] [DEBUG] [LOCAL ] SRI: Loaded 26857 existing records from primary storage. [2025-10-09T22:42:42.055002] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:42.064046] [INFO ] [MAIN ] SRI: Loaded 26857 primary data records. [2025-10-09T22:42:42.331471] [DEBUG] [LOCAL ] SRV: Loaded 7411 existing records from primary storage. [2025-10-09T22:42:42.352929] [INFO ] [MAIN ] SRV: Loaded 7411 primary data records. [2025-10-09T22:42:42.848485] [DEBUG] [MAIN ] SRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:42.850097] [INFO ] [MAIN ] SRG: Generated 1807 derivative records from 15439 primary records. [2025-10-09T22:42:42.850783] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-09T22:42:42.885737] [DEBUG] [MAIN ] SRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:42.887118] [INFO ] [MAIN ] SRI: Generated 1807 derivative records from 26857 primary records. [2025-10-09T22:42:42.887346] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-09T22:42:42.886300] [DEBUG] [LOCAL ] SRG: Derivative data saved (1807 records). [2025-10-09T22:42:42.888557] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-09T22:42:42.891021] [INFO ] [MAIN ] Derivative Progress: 1333/1690 symbols completed. SRG took 1.1s. Estimated remaining: 2m 19s. Rate: 154.3 symbols/min [2025-10-09T22:42:42.907517] [DEBUG] [LOCAL ] SRI: Derivative data saved (1807 records). [2025-10-09T22:42:42.908689] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-09T22:42:42.912464] [INFO ] [MAIN ] Derivative Progress: 1334/1690 symbols completed. SRI took 1.1s. Estimated remaining: 2m 18s. Rate: 154.4 symbols/min [2025-10-09T22:42:42.925849] [DEBUG] [MAIN ] SRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:42.926506] [INFO ] [MAIN ] SRV: Generated 1807 derivative records from 7411 primary records. [2025-10-09T22:42:42.926569] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-09T22:42:42.941701] [DEBUG] [LOCAL ] SRV: Derivative data saved (1807 records). [2025-10-09T22:42:42.941767] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-09T22:42:42.944876] [INFO ] [MAIN ] Derivative Progress: 1335/1690 symbols completed. SRV took 0.9s. Estimated remaining: 2m 18s. Rate: 154.5 symbols/min [2025-10-09T22:42:42.945491] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:42.945635] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:42.945788] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:42.974818] [DEBUG] [LOCAL ] SSD: Loaded 22618 existing records from primary storage. [2025-10-09T22:42:42.975144] [INFO ] [MAIN ] SSD: Loaded 22618 primary data records. [2025-10-09T22:42:43.126284] [DEBUG] [LOCAL ] SSL: Loaded 41671 existing records from primary storage. [2025-10-09T22:42:43.142310] [INFO ] [MAIN ] SSL: Loaded 41671 primary data records. [2025-10-09T22:42:43.169496] [DEBUG] [LOCAL ] SSB: Loaded 42877 existing records from primary storage. [2025-10-09T22:42:43.201063] [INFO ] [MAIN ] SSB: Loaded 42877 primary data records. [2025-10-09T22:42:44.094228] [DEBUG] [MAIN ] SSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:44.095672] [INFO ] [MAIN ] SSD: Generated 1807 derivative records from 22618 primary records. [2025-10-09T22:42:44.096313] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-09T22:42:44.114040] [DEBUG] [LOCAL ] SSD: Derivative data saved (1807 records). [2025-10-09T22:42:44.114385] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-09T22:42:44.117718] [INFO ] [MAIN ] Derivative Progress: 1336/1690 symbols completed. SSD took 1.2s. Estimated remaining: 2m 18s. Rate: 154.3 symbols/min [2025-10-09T22:42:44.120545] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:44.149511] [DEBUG] [MAIN ] SSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:44.150994] [INFO ] [MAIN ] SSL: Generated 1807 derivative records from 41671 primary records. [2025-10-09T22:42:44.151336] [DEBUG] [MAIN ] SSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:44.151557] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-09T22:42:44.155057] [INFO ] [MAIN ] SSB: Generated 1807 derivative records from 42877 primary records. [2025-10-09T22:42:44.156100] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-09T22:42:44.182419] [DEBUG] [LOCAL ] SST: Loaded 11781 existing records from primary storage. [2025-10-09T22:42:44.187351] [INFO ] [MAIN ] SST: Loaded 11781 primary data records. [2025-10-09T22:42:44.213338] [DEBUG] [LOCAL ] SSB: Derivative data saved (1807 records). [2025-10-09T22:42:44.225183] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-09T22:42:44.233779] [INFO ] [MAIN ] Derivative Progress: 1337/1690 symbols completed. SSB took 1.3s. Estimated remaining: 2m 17s. Rate: 154.4 symbols/min [2025-10-09T22:42:44.239713] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:44.295413] [DEBUG] [LOCAL ] SSL: Derivative data saved (1807 records). [2025-10-09T22:42:44.300873] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-09T22:42:44.318375] [INFO ] [MAIN ] Derivative Progress: 1338/1690 symbols completed. SSL took 1.4s. Estimated remaining: 2m 17s. Rate: 154.5 symbols/min [2025-10-09T22:42:44.318640] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:44.538696] [DEBUG] [LOCAL ] SSTK: Loaded 25722 existing records from primary storage. [2025-10-09T22:42:44.539090] [INFO ] [MAIN ] SSTK: Loaded 25722 primary data records. [2025-10-09T22:42:44.747898] [DEBUG] [LOCAL ] ST: Loaded 50184 existing records from primary storage. [2025-10-09T22:42:44.748996] [INFO ] [MAIN ] ST: Loaded 50184 primary data records. [2025-10-09T22:42:45.178008] [DEBUG] [MAIN ] SST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:45.195120] [INFO ] [MAIN ] SST: Generated 1807 derivative records from 11781 primary records. [2025-10-09T22:42:45.196360] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-09T22:42:45.226120] [DEBUG] [LOCAL ] SST: Derivative data saved (1807 records). [2025-10-09T22:42:45.234942] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-09T22:42:45.243779] [INFO ] [MAIN ] Derivative Progress: 1339/1690 symbols completed. SST took 1.1s. Estimated remaining: 2m 16s. Rate: 154.3 symbols/min [2025-10-09T22:42:45.244439] [DEBUG] [MAIN ] SSTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:45.245550] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:45.246734] [INFO ] [MAIN ] SSTK: Generated 1807 derivative records from 25722 primary records. [2025-10-09T22:42:45.247266] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-09T22:42:45.267199] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1807 records). [2025-10-09T22:42:45.267447] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-09T22:42:45.270841] [INFO ] [MAIN ] Derivative Progress: 1340/1690 symbols completed. SSTK took 1.0s. Estimated remaining: 2m 16s. Rate: 154.4 symbols/min [2025-10-09T22:42:45.271317] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:45.292726] [DEBUG] [MAIN ] ST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:45.299886] [INFO ] [MAIN ] ST: Generated 1807 derivative records from 50184 primary records. [2025-10-09T22:42:45.300145] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-09T22:42:45.330637] [DEBUG] [LOCAL ] STC: Loaded 17464 existing records from primary storage. [2025-10-09T22:42:45.332730] [INFO ] [MAIN ] STC: Loaded 17464 primary data records. [2025-10-09T22:42:45.412079] [DEBUG] [LOCAL ] ST: Derivative data saved (1807 records). [2025-10-09T22:42:45.412405] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-09T22:42:45.438667] [INFO ] [MAIN ] Derivative Progress: 1341/1690 symbols completed. ST took 1.1s. Estimated remaining: 2m 16s. Rate: 154.5 symbols/min [2025-10-09T22:42:45.449295] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:45.466048] [DEBUG] [LOCAL ] STAG: Loaded 50435 existing records from primary storage. [2025-10-09T22:42:45.470257] [INFO ] [MAIN ] STAG: Loaded 50435 primary data records. [2025-10-09T22:42:46.024400] [DEBUG] [LOCAL ] STE: Loaded 35659 existing records from primary storage. [2025-10-09T22:42:46.025290] [INFO ] [MAIN ] STE: Loaded 35659 primary data records. [2025-10-09T22:42:46.388802] [DEBUG] [MAIN ] STAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:46.389416] [DEBUG] [MAIN ] STC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:46.390278] [INFO ] [MAIN ] STAG: Generated 1807 derivative records from 50435 primary records. [2025-10-09T22:42:46.390381] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-09T22:42:46.392372] [INFO ] [MAIN ] STC: Generated 1807 derivative records from 17464 primary records. [2025-10-09T22:42:46.393909] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-09T22:42:46.431008] [DEBUG] [LOCAL ] STAG: Derivative data saved (1807 records). [2025-10-09T22:42:46.432233] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-09T22:42:46.435590] [INFO ] [MAIN ] Derivative Progress: 1342/1690 symbols completed. STAG took 1.2s. Estimated remaining: 2m 15s. Rate: 154.3 symbols/min [2025-10-09T22:42:46.435854] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:46.438845] [DEBUG] [LOCAL ] STC: Derivative data saved (1807 records). [2025-10-09T22:42:46.439273] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-09T22:42:46.441878] [INFO ] [MAIN ] Derivative Progress: 1343/1690 symbols completed. STC took 1.2s. Estimated remaining: 2m 15s. Rate: 154.4 symbols/min [2025-10-09T22:42:46.443288] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:46.484851] [DEBUG] [MAIN ] STE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:46.485304] [DEBUG] [LOCAL ] STEL: Loaded 22955 existing records from primary storage. [2025-10-09T22:42:46.485494] [INFO ] [MAIN ] STEL: Loaded 22955 primary data records. [2025-10-09T22:42:46.486222] [INFO ] [MAIN ] STE: Generated 1807 derivative records from 35659 primary records. [2025-10-09T22:42:46.486372] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-09T22:42:46.726729] [DEBUG] [LOCAL ] STE: Derivative data saved (1807 records). [2025-10-09T22:42:46.827243] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-09T22:42:46.826778] [DEBUG] [LOCAL ] STEM: Loaded 39229 existing records from primary storage. [2025-10-09T22:42:46.830084] [INFO ] [MAIN ] Derivative Progress: 1344/1690 symbols completed. STE took 1.4s. Estimated remaining: 2m 14s. Rate: 154.4 symbols/min [2025-10-09T22:42:46.830264] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:46.830680] [INFO ] [MAIN ] STEM: Loaded 39229 primary data records. [2025-10-09T22:42:47.024742] [DEBUG] [LOCAL ] STEW: Loaded 16229 existing records from primary storage. [2025-10-09T22:42:47.122852] [INFO ] [MAIN ] STEW: Loaded 16229 primary data records. [2025-10-09T22:42:47.351315] [DEBUG] [MAIN ] STEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:47.474244] [INFO ] [MAIN ] STEL: Generated 1807 derivative records from 22955 primary records. [2025-10-09T22:42:47.474917] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-09T22:42:47.499252] [DEBUG] [LOCAL ] STEL: Derivative data saved (1807 records). [2025-10-09T22:42:47.500288] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-09T22:42:47.504461] [INFO ] [MAIN ] Derivative Progress: 1345/1690 symbols completed. STEL took 1.1s. Estimated remaining: 2m 14s. Rate: 154.3 symbols/min [2025-10-09T22:42:47.505293] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:47.538800] [DEBUG] [MAIN ] STEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:47.540025] [INFO ] [MAIN ] STEM: Generated 1807 derivative records from 39229 primary records. [2025-10-09T22:42:47.544964] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-09T22:42:47.545274] [DEBUG] [LOCAL ] STK: Loaded 9650 existing records from primary storage. [2025-10-09T22:42:47.546605] [INFO ] [MAIN ] STK: Loaded 9650 primary data records. [2025-10-09T22:42:47.678715] [DEBUG] [LOCAL ] STEM: Derivative data saved (1807 records). [2025-10-09T22:42:47.691226] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-09T22:42:47.694063] [INFO ] [MAIN ] Derivative Progress: 1346/1690 symbols completed. STEM took 1.3s. Estimated remaining: 2m 14s. Rate: 154.4 symbols/min [2025-10-09T22:42:47.710894] [DEBUG] [MAIN ] STEW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:47.717093] [INFO ] [MAIN ] STEW: Generated 1807 derivative records from 16229 primary records. [2025-10-09T22:42:47.716205] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:47.738935] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-09T22:42:47.995009] [DEBUG] [LOCAL ] STEW: Derivative data saved (1807 records). [2025-10-09T22:42:47.995449] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-09T22:42:48.000448] [INFO ] [MAIN ] Derivative Progress: 1347/1690 symbols completed. STEW took 1.2s. Estimated remaining: 2m 13s. Rate: 154.4 symbols/min [2025-10-09T22:42:48.001135] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:48.057480] [DEBUG] [LOCAL ] STLA: Loaded 53941 existing records from primary storage. [2025-10-09T22:42:48.071022] [INFO ] [MAIN ] STLA: Loaded 53941 primary data records. [2025-10-09T22:42:48.096503] [DEBUG] [MAIN ] STK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:48.122391] [INFO ] [MAIN ] STK: Generated 1807 derivative records from 9650 primary records. [2025-10-09T22:42:48.186982] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-09T22:42:48.219375] [DEBUG] [LOCAL ] STM: Loaded 53960 existing records from primary storage. [2025-10-09T22:42:48.246098] [INFO ] [MAIN ] STM: Loaded 53960 primary data records. [2025-10-09T22:42:48.347852] [DEBUG] [LOCAL ] STK: Derivative data saved (1807 records). [2025-10-09T22:42:48.496859] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-09T22:42:48.511764] [INFO ] [MAIN ] Derivative Progress: 1348/1690 symbols completed. STK took 1.0s. Estimated remaining: 2m 13s. Rate: 154.4 symbols/min [2025-10-09T22:42:48.754455] [DEBUG] [MAIN ] STLA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:48.756031] [INFO ] [MAIN ] STLA: Generated 1807 derivative records from 53941 primary records. [2025-10-09T22:42:48.756318] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-09T22:42:48.772822] [DEBUG] [LOCAL ] STLA: Derivative data saved (1807 records). [2025-10-09T22:42:48.773009] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-09T22:42:48.775740] [INFO ] [MAIN ] Derivative Progress: 1349/1690 symbols completed. STLA took 1.1s. Estimated remaining: 2m 13s. Rate: 154.4 symbols/min [2025-10-09T22:42:48.791189] [DEBUG] [MAIN ] STM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:48.791838] [INFO ] [MAIN ] STM: Generated 1807 derivative records from 53960 primary records. [2025-10-09T22:42:48.791902] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-09T22:42:48.808222] [DEBUG] [LOCAL ] STM: Derivative data saved (1807 records). [2025-10-09T22:42:48.808366] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-09T22:42:48.810677] [INFO ] [MAIN ] Derivative Progress: 1350/1690 symbols completed. STM took 0.8s. Estimated remaining: 2m 12s. Rate: 154.5 symbols/min [2025-10-09T22:42:48.811230] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:48.811159] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:48.811410] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:48.826680] [DEBUG] [LOCAL ] STRV: Loaded 11368 existing records from primary storage. [2025-10-09T22:42:48.826899] [INFO ] [MAIN ] STRV: Loaded 11368 primary data records. [2025-10-09T22:42:49.032430] [DEBUG] [LOCAL ] STN: Loaded 23000 existing records from primary storage. [2025-10-09T22:42:49.049706] [INFO ] [MAIN ] STN: Loaded 23000 primary data records. [2025-10-09T22:42:49.222567] [DEBUG] [LOCAL ] STNG: Loaded 44007 existing records from primary storage. [2025-10-09T22:42:49.242937] [INFO ] [MAIN ] STNG: Loaded 44007 primary data records. [2025-10-09T22:42:49.822148] [DEBUG] [MAIN ] STRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:49.823242] [INFO ] [MAIN ] STRV: Generated 1807 derivative records from 11368 primary records. [2025-10-09T22:42:49.823817] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-09T22:42:49.842244] [DEBUG] [LOCAL ] STRV: Derivative data saved (1807 records). [2025-10-09T22:42:49.842348] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-09T22:42:49.845008] [INFO ] [MAIN ] Derivative Progress: 1351/1690 symbols completed. STRV took 1.0s. Estimated remaining: 2m 12s. Rate: 154.3 symbols/min [2025-10-09T22:42:49.845602] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:49.863223] [DEBUG] [MAIN ] STN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:49.864250] [INFO ] [MAIN ] STN: Generated 1807 derivative records from 23000 primary records. [2025-10-09T22:42:49.864462] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-09T22:42:49.881921] [DEBUG] [LOCAL ] STN: Derivative data saved (1807 records). [2025-10-09T22:42:49.883659] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-09T22:42:49.887015] [INFO ] [MAIN ] Derivative Progress: 1352/1690 symbols completed. STN took 1.1s. Estimated remaining: 2m 11s. Rate: 154.4 symbols/min [2025-10-09T22:42:49.887306] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:49.901134] [DEBUG] [MAIN ] STNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:49.901901] [INFO ] [MAIN ] STNG: Generated 1807 derivative records from 44007 primary records. [2025-10-09T22:42:49.902010] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-09T22:42:49.918844] [DEBUG] [LOCAL ] STNG: Derivative data saved (1807 records). [2025-10-09T22:42:49.919003] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-09T22:42:49.922059] [INFO ] [MAIN ] Derivative Progress: 1353/1690 symbols completed. STNG took 1.1s. Estimated remaining: 2m 11s. Rate: 154.5 symbols/min [2025-10-09T22:42:49.937944] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:49.978954] [DEBUG] [LOCAL ] STVN: Loaded 26765 existing records from primary storage. [2025-10-09T22:42:49.979870] [INFO ] [MAIN ] STVN: Loaded 26765 primary data records. [2025-10-09T22:42:49.979988] [DEBUG] [LOCAL ] STT: Loaded 51314 existing records from primary storage. [2025-10-09T22:42:49.980347] [INFO ] [MAIN ] STT: Loaded 51314 primary data records. [2025-10-09T22:42:50.389499] [DEBUG] [LOCAL ] STWD: Loaded 52326 existing records from primary storage. [2025-10-09T22:42:50.521980] [INFO ] [MAIN ] STWD: Loaded 52326 primary data records. [2025-10-09T22:42:51.015842] [DEBUG] [MAIN ] STVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:51.016109] [DEBUG] [MAIN ] STT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:51.017608] [INFO ] [MAIN ] STT: Generated 1807 derivative records from 51314 primary records. [2025-10-09T22:42:51.019150] [INFO ] [MAIN ] STVN: Generated 1807 derivative records from 26765 primary records. [2025-10-09T22:42:51.019585] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-09T22:42:51.019688] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-09T22:42:51.049208] [DEBUG] [LOCAL ] STT: Derivative data saved (1807 records). [2025-10-09T22:42:51.049564] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-09T22:42:51.053453] [INFO ] [MAIN ] Derivative Progress: 1354/1690 symbols completed. STT took 1.2s. Estimated remaining: 2m 11s. Rate: 154.3 symbols/min [2025-10-09T22:42:51.054375] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:51.061396] [DEBUG] [LOCAL ] STVN: Derivative data saved (1807 records). [2025-10-09T22:42:51.061611] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-09T22:42:51.064037] [INFO ] [MAIN ] Derivative Progress: 1355/1690 symbols completed. STVN took 1.2s. Estimated remaining: 2m 10s. Rate: 154.4 symbols/min [2025-10-09T22:42:51.066571] [DEBUG] [LOCAL ] STXD: Loaded 1244 existing records from primary storage. [2025-10-09T22:42:51.066997] [INFO ] [MAIN ] STXD: Loaded 1244 primary data records. [2025-10-09T22:42:51.074981] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:51.135338] [DEBUG] [MAIN ] STWD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:51.162523] [INFO ] [MAIN ] STWD: Generated 1807 derivative records from 52326 primary records. [2025-10-09T22:42:51.182795] [DEBUG] [LOCAL ] STXE: Loaded 2107 existing records from primary storage. [2025-10-09T22:42:51.185981] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-09T22:42:51.186938] [INFO ] [MAIN ] STXE: Loaded 2107 primary data records. [2025-10-09T22:42:51.582539] [DEBUG] [LOCAL ] STWD: Derivative data saved (1807 records). [2025-10-09T22:42:51.697768] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-09T22:42:51.701773] [INFO ] [MAIN ] Derivative Progress: 1356/1690 symbols completed. STWD took 1.8s. Estimated remaining: 2m 10s. Rate: 154.3 symbols/min [2025-10-09T22:42:51.702106] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:51.711172] [DEBUG] [LOCAL ] STXG: Loaded 2480 existing records from primary storage. [2025-10-09T22:42:51.711384] [INFO ] [MAIN ] STXG: Loaded 2480 primary data records. [2025-10-09T22:42:51.930380] [DEBUG] [MAIN ] STXD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:42:52.101203] [INFO ] [MAIN ] STXD: Generated 1806 derivative records from 1244 primary records. [2025-10-09T22:42:52.102974] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-09T22:42:52.129339] [DEBUG] [MAIN ] STXE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:42:52.131034] [INFO ] [MAIN ] STXE: Generated 1806 derivative records from 2107 primary records. [2025-10-09T22:42:52.131940] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-09T22:42:52.148392] [DEBUG] [LOCAL ] STXD: Derivative data saved (1806 records). [2025-10-09T22:42:52.149047] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-09T22:42:52.151932] [INFO ] [MAIN ] Derivative Progress: 1357/1690 symbols completed. STXD took 1.1s. Estimated remaining: 2m 9s. Rate: 154.3 symbols/min [2025-10-09T22:42:52.152372] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:52.154773] [DEBUG] [LOCAL ] STXE: Derivative data saved (1806 records). [2025-10-09T22:42:52.155732] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-09T22:42:52.159095] [INFO ] [MAIN ] Derivative Progress: 1358/1690 symbols completed. STXE took 1.1s. Estimated remaining: 2m 9s. Rate: 154.4 symbols/min [2025-10-09T22:42:52.159254] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:52.163431] [DEBUG] [LOCAL ] STXK: Loaded 1534 existing records from primary storage. [2025-10-09T22:42:52.164696] [INFO ] [MAIN ] STXK: Loaded 1534 primary data records. [2025-10-09T22:42:52.203871] [DEBUG] [LOCAL ] STXT: Loaded 2515 existing records from primary storage. [2025-10-09T22:42:52.211020] [INFO ] [MAIN ] STXT: Loaded 2515 primary data records. [2025-10-09T22:42:52.476075] [DEBUG] [MAIN ] STXG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:42:52.478366] [INFO ] [MAIN ] STXG: Generated 1806 derivative records from 2480 primary records. [2025-10-09T22:42:52.478467] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-09T22:42:52.819058] [DEBUG] [LOCAL ] STXG: Derivative data saved (1806 records). [2025-10-09T22:42:52.819634] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-09T22:42:52.823400] [INFO ] [MAIN ] Derivative Progress: 1359/1690 symbols completed. STXG took 1.1s. Estimated remaining: 2m 9s. Rate: 154.4 symbols/min [2025-10-09T22:42:52.823917] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:52.831489] [DEBUG] [LOCAL ] STXV: Loaded 1550 existing records from primary storage. [2025-10-09T22:42:52.832896] [INFO ] [MAIN ] STXV: Loaded 1550 primary data records. [2025-10-09T22:42:52.994879] [DEBUG] [MAIN ] STXK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:42:53.036619] [INFO ] [MAIN ] STXK: Generated 1806 derivative records from 1534 primary records. [2025-10-09T22:42:53.041941] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-09T22:42:53.190355] [DEBUG] [MAIN ] STXT: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:42:53.192568] [INFO ] [MAIN ] STXT: Generated 1805 derivative records from 2515 primary records. [2025-10-09T22:42:53.193938] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-09T22:42:53.208113] [DEBUG] [LOCAL ] STXK: Derivative data saved (1806 records). [2025-10-09T22:42:53.209053] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-09T22:42:53.211630] [INFO ] [MAIN ] Derivative Progress: 1360/1690 symbols completed. STXK took 1.1s. Estimated remaining: 2m 8s. Rate: 154.4 symbols/min [2025-10-09T22:42:53.212590] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:53.217289] [DEBUG] [LOCAL ] STXT: Derivative data saved (1805 records). [2025-10-09T22:42:53.217730] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-09T22:42:53.220466] [INFO ] [MAIN ] Derivative Progress: 1361/1690 symbols completed. STXT took 1.1s. Estimated remaining: 2m 8s. Rate: 154.5 symbols/min [2025-10-09T22:42:53.220834] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:53.239752] [DEBUG] [MAIN ] STXV: Filtered 6966 bins outside market hours, 7763 incomplete bins [2025-10-09T22:42:53.240427] [INFO ] [MAIN ] STXV: Generated 1803 derivative records from 1550 primary records. [2025-10-09T22:42:53.240611] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-09T22:42:53.255099] [DEBUG] [LOCAL ] STXV: Derivative data saved (1803 records). [2025-10-09T22:42:53.255272] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-09T22:42:53.258139] [INFO ] [MAIN ] Derivative Progress: 1362/1690 symbols completed. STXV took 0.4s. Estimated remaining: 2m 7s. Rate: 154.6 symbols/min [2025-10-09T22:42:53.258332] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:53.324896] [DEBUG] [LOCAL ] STZ: Loaded 52717 existing records from primary storage. [2025-10-09T22:42:53.326342] [INFO ] [MAIN ] STZ: Loaded 52717 primary data records. [2025-10-09T22:42:53.338712] [DEBUG] [LOCAL ] SU: Loaded 53823 existing records from primary storage. [2025-10-09T22:42:53.359034] [INFO ] [MAIN ] SU: Loaded 53823 primary data records. [2025-10-09T22:42:53.660792] [DEBUG] [LOCAL ] SUI: Loaded 42042 existing records from primary storage. [2025-10-09T22:42:53.727489] [INFO ] [MAIN ] SUI: Loaded 42042 primary data records. [2025-10-09T22:42:54.415047] [DEBUG] [MAIN ] STZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:54.415997] [INFO ] [MAIN ] STZ: Generated 1807 derivative records from 52717 primary records. [2025-10-09T22:42:54.428556] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-09T22:42:54.429368] [DEBUG] [MAIN ] SU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:54.430982] [INFO ] [MAIN ] SU: Generated 1807 derivative records from 53823 primary records. [2025-10-09T22:42:54.431171] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-09T22:42:54.463896] [DEBUG] [LOCAL ] STZ: Derivative data saved (1807 records). [2025-10-09T22:42:54.465831] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-09T22:42:54.482204] [DEBUG] [LOCAL ] SU: Derivative data saved (1807 records). [2025-10-09T22:42:54.485255] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-09T22:42:54.484805] [INFO ] [MAIN ] Derivative Progress: 1363/1690 symbols completed. STZ took 1.3s. Estimated remaining: 2m 7s. Rate: 154.3 symbols/min [2025-10-09T22:42:54.485177] [DEBUG] [MAIN ] SUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:54.488760] [INFO ] [MAIN ] Derivative Progress: 1364/1690 symbols completed. SU took 1.3s. Estimated remaining: 2m 7s. Rate: 154.4 symbols/min [2025-10-09T22:42:54.489714] [INFO ] [MAIN ] SUI: Generated 1807 derivative records from 42042 primary records. [2025-10-09T22:42:54.489908] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-09T22:42:54.505773] [DEBUG] [LOCAL ] SUI: Derivative data saved (1807 records). [2025-10-09T22:42:54.505858] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-09T22:42:54.510204] [INFO ] [MAIN ] Derivative Progress: 1365/1690 symbols completed. SUI took 1.3s. Estimated remaining: 2m 6s. Rate: 154.5 symbols/min [2025-10-09T22:42:54.510683] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:54.510790] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:54.510617] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:54.587237] [DEBUG] [LOCAL ] SUN: Loaded 38241 existing records from primary storage. [2025-10-09T22:42:54.587431] [INFO ] [MAIN ] SUN: Loaded 38241 primary data records. [2025-10-09T22:42:54.588299] [DEBUG] [LOCAL ] SUPV: Loaded 47846 existing records from primary storage. [2025-10-09T22:42:54.599850] [INFO ] [MAIN ] SUPV: Loaded 47846 primary data records. [2025-10-09T22:42:54.766572] [DEBUG] [LOCAL ] SUZ: Loaded 45890 existing records from primary storage. [2025-10-09T22:42:54.790085] [INFO ] [MAIN ] SUZ: Loaded 45890 primary data records. [2025-10-09T22:42:55.543401] [DEBUG] [MAIN ] SUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:55.546376] [INFO ] [MAIN ] SUN: Generated 1807 derivative records from 38241 primary records. [2025-10-09T22:42:55.546513] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-09T22:42:55.570342] [DEBUG] [MAIN ] SUPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:55.576844] [INFO ] [MAIN ] SUPV: Generated 1807 derivative records from 47846 primary records. [2025-10-09T22:42:55.578562] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-09T22:42:55.593093] [DEBUG] [MAIN ] SUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:55.594579] [INFO ] [MAIN ] SUZ: Generated 1807 derivative records from 45890 primary records. [2025-10-09T22:42:55.603895] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-09T22:42:55.630238] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1807 records). [2025-10-09T22:42:55.621706] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1807 records). [2025-10-09T22:42:55.631125] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-09T22:42:55.635267] [INFO ] [MAIN ] Derivative Progress: 1366/1690 symbols completed. SUPV took 1.1s. Estimated remaining: 2m 6s. Rate: 154.3 symbols/min [2025-10-09T22:42:55.630943] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-09T22:42:55.630879] [DEBUG] [LOCAL ] SUN: Derivative data saved (1807 records). [2025-10-09T22:42:55.635535] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:55.638663] [INFO ] [MAIN ] Derivative Progress: 1367/1690 symbols completed. SUZ took 1.1s. Estimated remaining: 2m 5s. Rate: 154.4 symbols/min [2025-10-09T22:42:55.638852] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-09T22:42:55.639413] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:55.641504] [INFO ] [MAIN ] Derivative Progress: 1368/1690 symbols completed. SUN took 1.1s. Estimated remaining: 2m 5s. Rate: 154.5 symbols/min [2025-10-09T22:42:55.641905] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:55.711825] [DEBUG] [LOCAL ] SVV: Loaded 40238 existing records from primary storage. [2025-10-09T22:42:55.712141] [INFO ] [MAIN ] SVV: Loaded 40238 primary data records. [2025-10-09T22:42:55.753719] [DEBUG] [LOCAL ] SW: Loaded 53574 existing records from primary storage. [2025-10-09T22:42:55.801086] [INFO ] [MAIN ] SW: Loaded 53574 primary data records. [2025-10-09T22:42:55.882909] [DEBUG] [LOCAL ] SWK: Loaded 52815 existing records from primary storage. [2025-10-09T22:42:55.908805] [INFO ] [MAIN ] SWK: Loaded 52815 primary data records. [2025-10-09T22:42:56.768254] [DEBUG] [MAIN ] SVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:56.781692] [INFO ] [MAIN ] SVV: Generated 1807 derivative records from 40238 primary records. [2025-10-09T22:42:56.782219] [DEBUG] [MAIN ] SW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:56.783271] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-09T22:42:56.783179] [INFO ] [MAIN ] SW: Generated 1807 derivative records from 53574 primary records. [2025-10-09T22:42:56.784197] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-09T22:42:56.814443] [DEBUG] [LOCAL ] SVV: Derivative data saved (1807 records). [2025-10-09T22:42:56.817512] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-09T22:42:56.820036] [INFO ] [MAIN ] Derivative Progress: 1369/1690 symbols completed. SVV took 1.2s. Estimated remaining: 2m 5s. Rate: 154.3 symbols/min [2025-10-09T22:42:56.828449] [DEBUG] [LOCAL ] SW: Derivative data saved (1807 records). [2025-10-09T22:42:56.828595] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:56.833893] [DEBUG] [MAIN ] SWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:56.834680] [INFO ] [MAIN ] SWK: Generated 1807 derivative records from 52815 primary records. [2025-10-09T22:42:56.834774] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-09T22:42:56.837463] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-09T22:42:56.837388] [INFO ] [MAIN ] Derivative Progress: 1370/1690 symbols completed. SW took 1.2s. Estimated remaining: 2m 4s. Rate: 154.4 symbols/min [2025-10-09T22:42:56.837681] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:56.857133] [DEBUG] [LOCAL ] SWK: Derivative data saved (1807 records). [2025-10-09T22:42:56.857280] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-09T22:42:56.860287] [INFO ] [MAIN ] Derivative Progress: 1371/1690 symbols completed. SWK took 1.2s. Estimated remaining: 2m 4s. Rate: 154.5 symbols/min [2025-10-09T22:42:56.860480] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:56.864401] [DEBUG] [LOCAL ] SWZ: Loaded 6129 existing records from primary storage. [2025-10-09T22:42:56.864505] [INFO ] [MAIN ] SWZ: Loaded 6129 primary data records. [2025-10-09T22:42:57.076912] [DEBUG] [LOCAL ] SWX: Loaded 31366 existing records from primary storage. [2025-10-09T22:42:57.192809] [INFO ] [MAIN ] SWX: Loaded 31366 primary data records. [2025-10-09T22:42:57.322834] [DEBUG] [LOCAL ] SXC: Loaded 41724 existing records from primary storage. [2025-10-09T22:42:57.323161] [INFO ] [MAIN ] SXC: Loaded 41724 primary data records. [2025-10-09T22:42:57.887439] [DEBUG] [MAIN ] SWZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:57.888553] [INFO ] [MAIN ] SWZ: Generated 1807 derivative records from 6129 primary records. [2025-10-09T22:42:57.889978] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-09T22:42:57.912112] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1807 records). [2025-10-09T22:42:57.912228] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-09T22:42:57.915105] [INFO ] [MAIN ] Derivative Progress: 1372/1690 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 4s. Rate: 154.3 symbols/min [2025-10-09T22:42:57.915675] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:57.933122] [DEBUG] [MAIN ] SWX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:57.933997] [INFO ] [MAIN ] SWX: Generated 1807 derivative records from 31366 primary records. [2025-10-09T22:42:57.938140] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-09T22:42:57.955730] [DEBUG] [LOCAL ] SWX: Derivative data saved (1807 records). [2025-10-09T22:42:57.973298] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-09T22:42:57.976066] [INFO ] [MAIN ] Derivative Progress: 1373/1690 symbols completed. SWX took 1.1s. Estimated remaining: 2m 3s. Rate: 154.4 symbols/min [2025-10-09T22:42:57.973747] [DEBUG] [LOCAL ] SXI: Loaded 11775 existing records from primary storage. [2025-10-09T22:42:57.976733] [INFO ] [MAIN ] SXI: Loaded 11775 primary data records. [2025-10-09T22:42:57.976350] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:57.977224] [DEBUG] [MAIN ] SXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:57.983833] [INFO ] [MAIN ] SXC: Generated 1807 derivative records from 41724 primary records. [2025-10-09T22:42:57.984008] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-09T22:42:58.170362] [DEBUG] [LOCAL ] SXT: Loaded 30046 existing records from primary storage. [2025-10-09T22:42:58.198057] [INFO ] [MAIN ] SXT: Loaded 30046 primary data records. [2025-10-09T22:42:58.239627] [DEBUG] [LOCAL ] SXC: Derivative data saved (1807 records). [2025-10-09T22:42:58.270314] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-09T22:42:58.284738] [INFO ] [MAIN ] Derivative Progress: 1374/1690 symbols completed. SXC took 1.4s. Estimated remaining: 2m 3s. Rate: 154.5 symbols/min [2025-10-09T22:42:58.310685] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:58.757711] [DEBUG] [MAIN ] SXI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:58.784823] [INFO ] [MAIN ] SXI: Generated 1807 derivative records from 11775 primary records. [2025-10-09T22:42:58.785615] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-09T22:42:58.788450] [DEBUG] [LOCAL ] SYF: Loaded 53836 existing records from primary storage. [2025-10-09T22:42:58.789880] [INFO ] [MAIN ] SYF: Loaded 53836 primary data records. [2025-10-09T22:42:58.900123] [DEBUG] [MAIN ] SXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:58.899743] [DEBUG] [LOCAL ] SXI: Derivative data saved (1807 records). [2025-10-09T22:42:58.935369] [INFO ] [MAIN ] SXT: Generated 1807 derivative records from 30046 primary records. [2025-10-09T22:42:58.939217] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-09T22:42:58.939130] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-09T22:42:58.948212] [INFO ] [MAIN ] Derivative Progress: 1375/1690 symbols completed. SXI took 1.0s. Estimated remaining: 2m 2s. Rate: 154.4 symbols/min [2025-10-09T22:42:58.966394] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:59.036582] [DEBUG] [LOCAL ] SXT: Derivative data saved (1807 records). [2025-10-09T22:42:59.042547] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-09T22:42:59.163373] [INFO ] [MAIN ] Derivative Progress: 1376/1690 symbols completed. SXT took 1.2s. Estimated remaining: 2m 2s. Rate: 154.4 symbols/min [2025-10-09T22:42:59.163997] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:59.202415] [DEBUG] [MAIN ] SYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:42:59.216908] [INFO ] [MAIN ] SYF: Generated 1807 derivative records from 53836 primary records. [2025-10-09T22:42:59.217136] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-09T22:42:59.219812] [DEBUG] [LOCAL ] SYK: Loaded 47241 existing records from primary storage. [2025-10-09T22:42:59.227254] [INFO ] [MAIN ] SYK: Loaded 47241 primary data records. [2025-10-09T22:42:59.275132] [DEBUG] [LOCAL ] SYF: Derivative data saved (1807 records). [2025-10-09T22:42:59.308970] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-09T22:42:59.334813] [INFO ] [MAIN ] Derivative Progress: 1377/1690 symbols completed. SYF took 1.0s. Estimated remaining: 2m 2s. Rate: 154.5 symbols/min [2025-10-09T22:42:59.350936] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:42:59.465840] [DEBUG] [LOCAL ] SYY: Loaded 53622 existing records from primary storage. [2025-10-09T22:42:59.582708] [INFO ] [MAIN ] SYY: Loaded 53622 primary data records. [2025-10-09T22:42:59.952947] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-10-09T22:42:59.965195] [INFO ] [MAIN ] T: Loaded 54188 primary data records. [2025-10-09T22:43:00.358163] [DEBUG] [MAIN ] SYK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:00.359715] [INFO ] [MAIN ] SYK: Generated 1807 derivative records from 47241 primary records. [2025-10-09T22:43:00.360275] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-09T22:43:00.388358] [DEBUG] [LOCAL ] SYK: Derivative data saved (1807 records). [2025-10-09T22:43:00.389700] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-09T22:43:00.392096] [INFO ] [MAIN ] Derivative Progress: 1378/1690 symbols completed. SYK took 1.4s. Estimated remaining: 2m 1s. Rate: 154.3 symbols/min [2025-10-09T22:43:00.406425] [DEBUG] [MAIN ] SYY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:00.407500] [INFO ] [MAIN ] SYY: Generated 1807 derivative records from 53622 primary records. [2025-10-09T22:43:00.407792] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-09T22:43:00.429598] [DEBUG] [LOCAL ] SYY: Derivative data saved (1807 records). [2025-10-09T22:43:00.429760] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-09T22:43:00.433408] [INFO ] [MAIN ] Derivative Progress: 1379/1690 symbols completed. SYY took 1.3s. Estimated remaining: 2m 1s. Rate: 154.4 symbols/min [2025-10-09T22:43:00.447172] [DEBUG] [MAIN ] T: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:00.448185] [INFO ] [MAIN ] T: Generated 1807 derivative records from 54188 primary records. [2025-10-09T22:43:00.448257] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-09T22:43:00.464449] [DEBUG] [LOCAL ] T: Derivative data saved (1807 records). [2025-10-09T22:43:00.464521] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-09T22:43:00.467912] [INFO ] [MAIN ] Derivative Progress: 1380/1690 symbols completed. T took 1.1s. Estimated remaining: 2m 0s. Rate: 154.5 symbols/min [2025-10-09T22:43:00.468770] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:00.468485] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:00.468630] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:00.540449] [DEBUG] [LOCAL ] TAC: Loaded 43025 existing records from primary storage. [2025-10-09T22:43:00.541175] [INFO ] [MAIN ] TAC: Loaded 43025 primary data records. [2025-10-09T22:43:00.664346] [DEBUG] [LOCAL ] TAK: Loaded 50348 existing records from primary storage. [2025-10-09T22:43:00.665454] [DEBUG] [LOCAL ] TAL: Loaded 52193 existing records from primary storage. [2025-10-09T22:43:00.665809] [INFO ] [MAIN ] TAK: Loaded 50348 primary data records. [2025-10-09T22:43:00.666072] [INFO ] [MAIN ] TAL: Loaded 52193 primary data records. [2025-10-09T22:43:01.565392] [DEBUG] [MAIN ] TAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:01.567292] [INFO ] [MAIN ] TAC: Generated 1807 derivative records from 43025 primary records. [2025-10-09T22:43:01.567452] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-09T22:43:01.596906] [DEBUG] [MAIN ] TAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:01.598321] [INFO ] [MAIN ] TAK: Generated 1807 derivative records from 50348 primary records. [2025-10-09T22:43:01.607902] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-09T22:43:01.617438] [DEBUG] [MAIN ] TAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:01.632226] [INFO ] [MAIN ] TAL: Generated 1807 derivative records from 52193 primary records. [2025-10-09T22:43:01.632891] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-09T22:43:01.636964] [DEBUG] [LOCAL ] TAC: Derivative data saved (1807 records). [2025-10-09T22:43:01.648346] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-09T22:43:01.653823] [INFO ] [MAIN ] Derivative Progress: 1381/1690 symbols completed. TAC took 1.2s. Estimated remaining: 2m 0s. Rate: 154.3 symbols/min [2025-10-09T22:43:01.655183] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:01.664407] [DEBUG] [LOCAL ] TAL: Derivative data saved (1807 records). [2025-10-09T22:43:01.664757] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-09T22:43:01.664558] [DEBUG] [LOCAL ] TAK: Derivative data saved (1807 records). [2025-10-09T22:43:01.667857] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-09T22:43:01.667627] [INFO ] [MAIN ] Derivative Progress: 1382/1690 symbols completed. TAL took 1.2s. Estimated remaining: 1m 60s. Rate: 154.4 symbols/min [2025-10-09T22:43:01.668043] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:01.671466] [INFO ] [MAIN ] Derivative Progress: 1383/1690 symbols completed. TAK took 1.2s. Estimated remaining: 1m 59s. Rate: 154.5 symbols/min [2025-10-09T22:43:01.671762] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:01.694807] [DEBUG] [LOCAL ] TBB: Loaded 11747 existing records from primary storage. [2025-10-09T22:43:01.711705] [INFO ] [MAIN ] TBB: Loaded 11747 primary data records. [2025-10-09T22:43:01.864746] [DEBUG] [LOCAL ] TALO: Loaded 51225 existing records from primary storage. [2025-10-09T22:43:01.868204] [INFO ] [MAIN ] TALO: Loaded 51225 primary data records. [2025-10-09T22:43:02.087790] [DEBUG] [LOCAL ] TAP: Loaded 53307 existing records from primary storage. [2025-10-09T22:43:02.208752] [INFO ] [MAIN ] TAP: Loaded 53307 primary data records. [2025-10-09T22:43:02.822354] [DEBUG] [MAIN ] TBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:02.823456] [INFO ] [MAIN ] TBB: Generated 1807 derivative records from 11747 primary records. [2025-10-09T22:43:02.823806] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-09T22:43:02.859631] [DEBUG] [LOCAL ] TBB: Derivative data saved (1807 records). [2025-10-09T22:43:02.860158] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-09T22:43:02.863452] [INFO ] [MAIN ] Derivative Progress: 1384/1690 symbols completed. TBB took 1.2s. Estimated remaining: 1m 59s. Rate: 154.3 symbols/min [2025-10-09T22:43:02.861093] [DEBUG] [MAIN ] TALO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:02.864065] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:02.865041] [INFO ] [MAIN ] TALO: Generated 1807 derivative records from 51225 primary records. [2025-10-09T22:43:02.866333] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-09T22:43:02.893032] [DEBUG] [MAIN ] TAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:02.894203] [INFO ] [MAIN ] TAP: Generated 1807 derivative records from 53307 primary records. [2025-10-09T22:43:02.894988] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-09T22:43:02.911346] [DEBUG] [LOCAL ] TALO: Derivative data saved (1807 records). [2025-10-09T22:43:02.911990] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-09T22:43:02.914832] [INFO ] [MAIN ] Derivative Progress: 1385/1690 symbols completed. TALO took 1.3s. Estimated remaining: 1m 59s. Rate: 154.4 symbols/min [2025-10-09T22:43:02.915604] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:02.928547] [DEBUG] [LOCAL ] TAP: Derivative data saved (1807 records). [2025-10-09T22:43:02.928639] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-09T22:43:02.931409] [INFO ] [MAIN ] Derivative Progress: 1386/1690 symbols completed. TAP took 1.3s. Estimated remaining: 1m 58s. Rate: 154.5 symbols/min [2025-10-09T22:43:02.932124] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:02.943371] [DEBUG] [LOCAL ] TBBB: Loaded 35892 existing records from primary storage. [2025-10-09T22:43:02.943599] [INFO ] [MAIN ] TBBB: Loaded 35892 primary data records. [2025-10-09T22:43:03.022897] [DEBUG] [LOCAL ] TBN: Loaded 3895 existing records from primary storage. [2025-10-09T22:43:03.045134] [INFO ] [MAIN ] TBN: Loaded 3895 primary data records. [2025-10-09T22:43:03.106435] [DEBUG] [LOCAL ] TBI: Loaded 22583 existing records from primary storage. [2025-10-09T22:43:03.164534] [INFO ] [MAIN ] TBI: Loaded 22583 primary data records. [2025-10-09T22:43:03.907574] [DEBUG] [MAIN ] TBBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:03.908552] [INFO ] [MAIN ] TBBB: Generated 1807 derivative records from 35892 primary records. [2025-10-09T22:43:03.908636] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-09T22:43:03.928158] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1807 records). [2025-10-09T22:43:03.928274] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-09T22:43:03.930308] [INFO ] [MAIN ] Derivative Progress: 1387/1690 symbols completed. TBBB took 1.1s. Estimated remaining: 1m 58s. Rate: 154.3 symbols/min [2025-10-09T22:43:03.930693] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:03.945604] [DEBUG] [MAIN ] TBN: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:43:03.947257] [INFO ] [MAIN ] TBN: Generated 1805 derivative records from 3895 primary records. [2025-10-09T22:43:03.947480] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-09T22:43:03.973207] [DEBUG] [MAIN ] TBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:03.974127] [INFO ] [MAIN ] TBI: Generated 1807 derivative records from 22583 primary records. [2025-10-09T22:43:03.974515] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-09T22:43:03.980424] [DEBUG] [LOCAL ] TCBX: Loaded 10220 existing records from primary storage. [2025-10-09T22:43:03.983274] [DEBUG] [LOCAL ] TBN: Derivative data saved (1805 records). [2025-10-09T22:43:03.983207] [INFO ] [MAIN ] TCBX: Loaded 10220 primary data records. [2025-10-09T22:43:04.006759] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-09T22:43:04.018792] [INFO ] [MAIN ] Derivative Progress: 1388/1690 symbols completed. TBN took 1.1s. Estimated remaining: 1m 57s. Rate: 154.4 symbols/min [2025-10-09T22:43:04.026053] [DEBUG] [LOCAL ] TBI: Derivative data saved (1807 records). [2025-10-09T22:43:04.026181] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-09T22:43:04.042506] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:04.048130] [INFO ] [MAIN ] Derivative Progress: 1389/1690 symbols completed. TBI took 1.1s. Estimated remaining: 1m 57s. Rate: 154.5 symbols/min [2025-10-09T22:43:04.081054] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:04.366167] [DEBUG] [LOCAL ] TD: Loaded 52741 existing records from primary storage. [2025-10-09T22:43:04.380228] [INFO ] [MAIN ] TD: Loaded 52741 primary data records. [2025-10-09T22:43:04.381045] [DEBUG] [LOCAL ] TDC: Loaded 46902 existing records from primary storage. [2025-10-09T22:43:04.386697] [INFO ] [MAIN ] TDC: Loaded 46902 primary data records. [2025-10-09T22:43:04.538127] [DEBUG] [MAIN ] TCBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:04.605850] [INFO ] [MAIN ] TCBX: Generated 1807 derivative records from 10220 primary records. [2025-10-09T22:43:04.658142] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-09T22:43:04.926691] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1807 records). [2025-10-09T22:43:04.935470] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-09T22:43:04.938279] [INFO ] [MAIN ] Derivative Progress: 1390/1690 symbols completed. TCBX took 1.0s. Estimated remaining: 1m 57s. Rate: 154.3 symbols/min [2025-10-09T22:43:04.938767] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:05.302474] [DEBUG] [LOCAL ] TDF: Loaded 6286 existing records from primary storage. [2025-10-09T22:43:05.304909] [INFO ] [MAIN ] TDF: Loaded 6286 primary data records. [2025-10-09T22:43:05.739966] [DEBUG] [MAIN ] TD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:05.740351] [DEBUG] [MAIN ] TDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:05.742101] [INFO ] [MAIN ] TD: Generated 1807 derivative records from 52741 primary records. [2025-10-09T22:43:05.743461] [INFO ] [MAIN ] TDC: Generated 1807 derivative records from 46902 primary records. [2025-10-09T22:43:05.742322] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-09T22:43:05.744095] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-09T22:43:05.776418] [DEBUG] [LOCAL ] TD: Derivative data saved (1807 records). [2025-10-09T22:43:05.776788] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-09T22:43:05.778731] [INFO ] [MAIN ] Derivative Progress: 1391/1690 symbols completed. TD took 1.7s. Estimated remaining: 1m 56s. Rate: 154.2 symbols/min [2025-10-09T22:43:05.780540] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:05.780423] [DEBUG] [LOCAL ] TDC: Derivative data saved (1807 records). [2025-10-09T22:43:05.781575] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-09T22:43:05.784332] [INFO ] [MAIN ] Derivative Progress: 1392/1690 symbols completed. TDC took 1.7s. Estimated remaining: 1m 56s. Rate: 154.3 symbols/min [2025-10-09T22:43:05.784619] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:05.806547] [DEBUG] [MAIN ] TDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:05.807257] [INFO ] [MAIN ] TDF: Generated 1807 derivative records from 6286 primary records. [2025-10-09T22:43:05.807422] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-09T22:43:05.849094] [DEBUG] [LOCAL ] TDF: Derivative data saved (1807 records). [2025-10-09T22:43:05.849793] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-09T22:43:05.849707] [DEBUG] [LOCAL ] TDG: Loaded 22182 existing records from primary storage. [2025-10-09T22:43:05.852597] [INFO ] [MAIN ] Derivative Progress: 1393/1690 symbols completed. TDF took 0.9s. Estimated remaining: 1m 55s. Rate: 154.4 symbols/min [2025-10-09T22:43:05.852907] [INFO ] [MAIN ] TDG: Loaded 22182 primary data records. [2025-10-09T22:43:06.066503] [DEBUG] [LOCAL ] TDOC: Loaded 53739 existing records from primary storage. [2025-10-09T22:43:06.079619] [INFO ] [MAIN ] TDOC: Loaded 53739 primary data records. [2025-10-09T22:43:06.502561] [DEBUG] [MAIN ] TDG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:06.503334] [INFO ] [MAIN ] TDG: Generated 1807 derivative records from 22182 primary records. [2025-10-09T22:43:06.503528] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-09T22:43:06.520541] [DEBUG] [LOCAL ] TDG: Derivative data saved (1807 records). [2025-10-09T22:43:06.522276] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-09T22:43:06.524969] [INFO ] [MAIN ] Derivative Progress: 1394/1690 symbols completed. TDG took 0.7s. Estimated remaining: 1m 55s. Rate: 154.3 symbols/min [2025-10-09T22:43:06.537449] [DEBUG] [MAIN ] TDOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:06.538131] [INFO ] [MAIN ] TDOC: Generated 1807 derivative records from 53739 primary records. [2025-10-09T22:43:06.538193] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-09T22:43:06.553768] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1807 records). [2025-10-09T22:43:06.553831] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-09T22:43:06.555919] [INFO ] [MAIN ] Derivative Progress: 1395/1690 symbols completed. TDOC took 0.8s. Estimated remaining: 1m 55s. Rate: 154.4 symbols/min [2025-10-09T22:43:06.556507] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:06.556689] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:06.556580] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:06.583076] [DEBUG] [LOCAL ] TDY: Loaded 22540 existing records from primary storage. [2025-10-09T22:43:06.583226] [INFO ] [MAIN ] TDY: Loaded 22540 primary data records. [2025-10-09T22:43:06.875347] [DEBUG] [LOCAL ] TDW: Loaded 45430 existing records from primary storage. [2025-10-09T22:43:06.947007] [INFO ] [MAIN ] TDW: Loaded 45430 primary data records. [2025-10-09T22:43:06.947927] [DEBUG] [LOCAL ] TDS: Loaded 42883 existing records from primary storage. [2025-10-09T22:43:06.969714] [INFO ] [MAIN ] TDS: Loaded 42883 primary data records. [2025-10-09T22:43:07.586413] [DEBUG] [MAIN ] TDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:07.588155] [INFO ] [MAIN ] TDY: Generated 1807 derivative records from 22540 primary records. [2025-10-09T22:43:07.588682] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-09T22:43:07.606418] [DEBUG] [LOCAL ] TDY: Derivative data saved (1807 records). [2025-10-09T22:43:07.607897] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-09T22:43:07.610406] [INFO ] [MAIN ] Derivative Progress: 1396/1690 symbols completed. TDY took 1.1s. Estimated remaining: 1m 54s. Rate: 154.2 symbols/min [2025-10-09T22:43:07.611124] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:07.629212] [DEBUG] [MAIN ] TDW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:07.632994] [INFO ] [MAIN ] TDW: Generated 1807 derivative records from 45430 primary records. [2025-10-09T22:43:07.634737] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-09T22:43:07.646809] [DEBUG] [LOCAL ] TEAF: Loaded 7566 existing records from primary storage. [2025-10-09T22:43:07.660875] [DEBUG] [MAIN ] TDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:07.651830] [INFO ] [MAIN ] TEAF: Loaded 7566 primary data records. [2025-10-09T22:43:07.664330] [INFO ] [MAIN ] TDS: Generated 1807 derivative records from 42883 primary records. [2025-10-09T22:43:07.667725] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-09T22:43:07.674964] [DEBUG] [LOCAL ] TDW: Derivative data saved (1807 records). [2025-10-09T22:43:07.704811] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-09T22:43:07.755121] [INFO ] [MAIN ] Derivative Progress: 1397/1690 symbols completed. TDW took 1.2s. Estimated remaining: 1m 54s. Rate: 154.3 symbols/min [2025-10-09T22:43:07.768989] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:07.804203] [DEBUG] [LOCAL ] TDS: Derivative data saved (1807 records). [2025-10-09T22:43:07.815473] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-09T22:43:07.848293] [INFO ] [MAIN ] Derivative Progress: 1398/1690 symbols completed. TDS took 1.3s. Estimated remaining: 1m 53s. Rate: 154.4 symbols/min [2025-10-09T22:43:07.867001] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:08.079310] [DEBUG] [MAIN ] TEAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:08.081358] [INFO ] [MAIN ] TEAF: Generated 1807 derivative records from 7566 primary records. [2025-10-09T22:43:08.095980] [DEBUG] [LOCAL ] TEF: Loaded 37317 existing records from primary storage. [2025-10-09T22:43:08.097456] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-09T22:43:08.097752] [INFO ] [MAIN ] TEF: Loaded 37317 primary data records. [2025-10-09T22:43:08.099125] [DEBUG] [LOCAL ] TECK: Loaded 53829 existing records from primary storage. [2025-10-09T22:43:08.111555] [INFO ] [MAIN ] TECK: Loaded 53829 primary data records. [2025-10-09T22:43:08.203056] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1807 records). [2025-10-09T22:43:08.203227] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-09T22:43:08.232676] [INFO ] [MAIN ] Derivative Progress: 1399/1690 symbols completed. TEAF took 0.6s. Estimated remaining: 1m 53s. Rate: 154.4 symbols/min [2025-10-09T22:43:08.257244] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:08.789998] [DEBUG] [LOCAL ] TEI: Loaded 21591 existing records from primary storage. [2025-10-09T22:43:08.790598] [INFO ] [MAIN ] TEI: Loaded 21591 primary data records. [2025-10-09T22:43:09.114210] [DEBUG] [MAIN ] TECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:09.115252] [INFO ] [MAIN ] TECK: Generated 1807 derivative records from 53829 primary records. [2025-10-09T22:43:09.115731] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-09T22:43:09.132372] [DEBUG] [LOCAL ] TECK: Derivative data saved (1807 records). [2025-10-09T22:43:09.135500] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-09T22:43:09.139240] [INFO ] [MAIN ] Derivative Progress: 1400/1690 symbols completed. TECK took 1.4s. Estimated remaining: 1m 53s. Rate: 154.2 symbols/min [2025-10-09T22:43:09.139429] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:09.155303] [DEBUG] [MAIN ] TEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:09.156452] [INFO ] [MAIN ] TEF: Generated 1807 derivative records from 37317 primary records. [2025-10-09T22:43:09.156665] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-09T22:43:09.173217] [DEBUG] [LOCAL ] TEF: Derivative data saved (1807 records). [2025-10-09T22:43:09.173432] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-09T22:43:09.178183] [INFO ] [MAIN ] Derivative Progress: 1401/1690 symbols completed. TEF took 1.3s. Estimated remaining: 1m 52s. Rate: 154.3 symbols/min [2025-10-09T22:43:09.178604] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:09.192799] [DEBUG] [MAIN ] TEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:09.193665] [INFO ] [MAIN ] TEI: Generated 1807 derivative records from 21591 primary records. [2025-10-09T22:43:09.193771] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-09T22:43:09.209291] [DEBUG] [LOCAL ] TEI: Derivative data saved (1807 records). [2025-10-09T22:43:09.222770] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-09T22:43:09.225675] [INFO ] [MAIN ] Derivative Progress: 1402/1690 symbols completed. TEI took 1.0s. Estimated remaining: 1m 52s. Rate: 154.4 symbols/min [2025-10-09T22:43:09.226275] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:09.261574] [DEBUG] [LOCAL ] TEN: Loaded 30606 existing records from primary storage. [2025-10-09T22:43:09.267304] [INFO ] [MAIN ] TEN: Loaded 30606 primary data records. [2025-10-09T22:43:09.267155] [DEBUG] [LOCAL ] TEL: Loaded 51443 existing records from primary storage. [2025-10-09T22:43:09.287925] [INFO ] [MAIN ] TEL: Loaded 51443 primary data records. [2025-10-09T22:43:09.345096] [DEBUG] [LOCAL ] TEO: Loaded 22593 existing records from primary storage. [2025-10-09T22:43:09.368770] [INFO ] [MAIN ] TEO: Loaded 22593 primary data records. [2025-10-09T22:43:10.229844] [DEBUG] [MAIN ] TEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:10.231300] [INFO ] [MAIN ] TEN: Generated 1807 derivative records from 30606 primary records. [2025-10-09T22:43:10.231433] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-09T22:43:10.274751] [DEBUG] [MAIN ] TEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:10.274836] [DEBUG] [LOCAL ] TEN: Derivative data saved (1807 records). [2025-10-09T22:43:10.280101] [DEBUG] [MAIN ] TEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:10.281087] [INFO ] [MAIN ] TEL: Generated 1807 derivative records from 51443 primary records. [2025-10-09T22:43:10.281247] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-09T22:43:10.282076] [INFO ] [MAIN ] TEO: Generated 1807 derivative records from 22593 primary records. [2025-10-09T22:43:10.282507] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-09T22:43:10.282608] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-09T22:43:10.286040] [INFO ] [MAIN ] Derivative Progress: 1403/1690 symbols completed. TEN took 1.1s. Estimated remaining: 1m 52s. Rate: 154.2 symbols/min [2025-10-09T22:43:10.295394] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:10.317387] [DEBUG] [LOCAL ] TEO: Derivative data saved (1807 records). [2025-10-09T22:43:10.317683] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-09T22:43:10.320835] [INFO ] [MAIN ] Derivative Progress: 1404/1690 symbols completed. TEO took 1.1s. Estimated remaining: 1m 51s. Rate: 154.3 symbols/min [2025-10-09T22:43:10.321336] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:10.322311] [DEBUG] [LOCAL ] TEL: Derivative data saved (1807 records). [2025-10-09T22:43:10.322554] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-09T22:43:10.325955] [INFO ] [MAIN ] Derivative Progress: 1405/1690 symbols completed. TEL took 1.2s. Estimated remaining: 1m 51s. Rate: 154.5 symbols/min [2025-10-09T22:43:10.326375] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:10.400407] [DEBUG] [LOCAL ] TEVA: Loaded 54020 existing records from primary storage. [2025-10-09T22:43:10.401814] [INFO ] [MAIN ] TEVA: Loaded 54020 primary data records. [2025-10-09T22:43:10.407777] [DEBUG] [LOCAL ] TEX: Loaded 44337 existing records from primary storage. [2025-10-09T22:43:10.430498] [INFO ] [MAIN ] TEX: Loaded 44337 primary data records. [2025-10-09T22:43:10.619455] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-10-09T22:43:10.639581] [INFO ] [MAIN ] TFC: Loaded 54057 primary data records. [2025-10-09T22:43:11.475570] [DEBUG] [MAIN ] TEVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:11.477209] [INFO ] [MAIN ] TEVA: Generated 1807 derivative records from 54020 primary records. [2025-10-09T22:43:11.476254] [DEBUG] [MAIN ] TEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:11.478063] [INFO ] [MAIN ] TEX: Generated 1807 derivative records from 44337 primary records. [2025-10-09T22:43:11.478266] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-09T22:43:11.478500] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-09T22:43:11.513193] [DEBUG] [LOCAL ] TEX: Derivative data saved (1807 records). [2025-10-09T22:43:11.513462] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-09T22:43:11.516291] [INFO ] [MAIN ] Derivative Progress: 1406/1690 symbols completed. TEX took 1.2s. Estimated remaining: 1m 50s. Rate: 154.2 symbols/min [2025-10-09T22:43:11.516447] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:11.530341] [DEBUG] [MAIN ] TFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:11.531967] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1807 records). [2025-10-09T22:43:11.532064] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-09T22:43:11.532785] [INFO ] [MAIN ] TFC: Generated 1807 derivative records from 54057 primary records. [2025-10-09T22:43:11.532877] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-09T22:43:11.535572] [INFO ] [MAIN ] Derivative Progress: 1407/1690 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 50s. Rate: 154.3 symbols/min [2025-10-09T22:43:11.536672] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:11.555710] [DEBUG] [LOCAL ] TFC: Derivative data saved (1807 records). [2025-10-09T22:43:11.555934] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-09T22:43:11.559132] [INFO ] [MAIN ] Derivative Progress: 1408/1690 symbols completed. TFC took 1.2s. Estimated remaining: 1m 50s. Rate: 154.4 symbols/min [2025-10-09T22:43:11.593043] [DEBUG] [LOCAL ] TFIN: Loaded 23689 existing records from primary storage. [2025-10-09T22:43:11.593207] [INFO ] [MAIN ] TFIN: Loaded 23689 primary data records. [2025-10-09T22:43:11.625158] [DEBUG] [LOCAL ] TFII: Loaded 33623 existing records from primary storage. [2025-10-09T22:43:11.657316] [INFO ] [MAIN ] TFII: Loaded 33623 primary data records. [2025-10-09T22:43:12.231231] [DEBUG] [MAIN ] TFII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:12.245037] [INFO ] [MAIN ] TFII: Generated 1807 derivative records from 33623 primary records. [2025-10-09T22:43:12.245540] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-09T22:43:12.245469] [DEBUG] [MAIN ] TFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:12.246921] [INFO ] [MAIN ] TFIN: Generated 1807 derivative records from 23689 primary records. [2025-10-09T22:43:12.247168] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-09T22:43:12.271310] [DEBUG] [LOCAL ] TFII: Derivative data saved (1807 records). [2025-10-09T22:43:12.273965] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-09T22:43:12.276264] [INFO ] [MAIN ] Derivative Progress: 1409/1690 symbols completed. TFII took 0.8s. Estimated remaining: 1m 49s. Rate: 154.3 symbols/min [2025-10-09T22:43:12.281163] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1807 records). [2025-10-09T22:43:12.281228] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-09T22:43:12.283240] [INFO ] [MAIN ] Derivative Progress: 1410/1690 symbols completed. TFIN took 0.7s. Estimated remaining: 1m 49s. Rate: 154.5 symbols/min [2025-10-09T22:43:12.283876] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:12.284258] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:12.283973] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:12.297670] [DEBUG] [LOCAL ] TG: Loaded 10436 existing records from primary storage. [2025-10-09T22:43:12.297874] [INFO ] [MAIN ] TG: Loaded 10436 primary data records. [2025-10-09T22:43:12.531118] [DEBUG] [LOCAL ] TFX: Loaded 37007 existing records from primary storage. [2025-10-09T22:43:12.663312] [INFO ] [MAIN ] TFX: Loaded 37007 primary data records. [2025-10-09T22:43:12.671110] [DEBUG] [LOCAL ] TFPM: Loaded 38919 existing records from primary storage. [2025-10-09T22:43:12.681427] [INFO ] [MAIN ] TFPM: Loaded 38919 primary data records. [2025-10-09T22:43:13.336968] [DEBUG] [MAIN ] TG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:13.338950] [INFO ] [MAIN ] TG: Generated 1807 derivative records from 10436 primary records. [2025-10-09T22:43:13.339058] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-09T22:43:13.358141] [DEBUG] [LOCAL ] TG: Derivative data saved (1807 records). [2025-10-09T22:43:13.358996] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-09T22:43:13.361335] [INFO ] [MAIN ] Derivative Progress: 1411/1690 symbols completed. TG took 1.1s. Estimated remaining: 1m 49s. Rate: 154.3 symbols/min [2025-10-09T22:43:13.361603] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:13.383475] [DEBUG] [MAIN ] TFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:13.384407] [INFO ] [MAIN ] TFX: Generated 1807 derivative records from 37007 primary records. [2025-10-09T22:43:13.396899] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-09T22:43:13.398123] [DEBUG] [MAIN ] TFPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:13.406549] [INFO ] [MAIN ] TFPM: Generated 1807 derivative records from 38919 primary records. [2025-10-09T22:43:13.406737] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-09T22:43:13.444124] [DEBUG] [LOCAL ] TGLS: Loaded 27715 existing records from primary storage. [2025-10-09T22:43:13.445451] [INFO ] [MAIN ] TGLS: Loaded 27715 primary data records. [2025-10-09T22:43:13.446694] [DEBUG] [LOCAL ] TFX: Derivative data saved (1807 records). [2025-10-09T22:43:13.457838] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-09T22:43:13.469733] [INFO ] [MAIN ] Derivative Progress: 1412/1690 symbols completed. TFX took 1.2s. Estimated remaining: 1m 48s. Rate: 154.3 symbols/min [2025-10-09T22:43:13.480184] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:13.531327] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1807 records). [2025-10-09T22:43:13.553810] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-09T22:43:13.556856] [INFO ] [MAIN ] Derivative Progress: 1413/1690 symbols completed. TFPM took 1.3s. Estimated remaining: 1m 48s. Rate: 154.4 symbols/min [2025-10-09T22:43:13.557096] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:13.814284] [DEBUG] [LOCAL ] TGNA: Loaded 48984 existing records from primary storage. [2025-10-09T22:43:13.813270] [DEBUG] [LOCAL ] TGS: Loaded 33223 existing records from primary storage. [2025-10-09T22:43:13.814968] [INFO ] [MAIN ] TGS: Loaded 33223 primary data records. [2025-10-09T22:43:13.815110] [INFO ] [MAIN ] TGNA: Loaded 48984 primary data records. [2025-10-09T22:43:14.443500] [DEBUG] [MAIN ] TGLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:14.454290] [INFO ] [MAIN ] TGLS: Generated 1807 derivative records from 27715 primary records. [2025-10-09T22:43:14.454882] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-09T22:43:14.480411] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1807 records). [2025-10-09T22:43:14.480556] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-09T22:43:14.483361] [INFO ] [MAIN ] Derivative Progress: 1414/1690 symbols completed. TGLS took 1.1s. Estimated remaining: 1m 47s. Rate: 154.3 symbols/min [2025-10-09T22:43:14.485325] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:14.503837] [DEBUG] [MAIN ] TGNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:14.504755] [INFO ] [MAIN ] TGNA: Generated 1807 derivative records from 48984 primary records. [2025-10-09T22:43:14.504840] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-09T22:43:14.536689] [DEBUG] [MAIN ] TGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:14.538066] [INFO ] [MAIN ] TGS: Generated 1807 derivative records from 33223 primary records. [2025-10-09T22:43:14.538730] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-09T22:43:14.554024] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1807 records). [2025-10-09T22:43:14.554846] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-09T22:43:14.557851] [INFO ] [MAIN ] Derivative Progress: 1415/1690 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 47s. Rate: 154.4 symbols/min [2025-10-09T22:43:14.558251] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:14.576587] [DEBUG] [LOCAL ] TGS: Derivative data saved (1807 records). [2025-10-09T22:43:14.576788] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-09T22:43:14.582918] [INFO ] [MAIN ] Derivative Progress: 1416/1690 symbols completed. TGS took 1.0s. Estimated remaining: 1m 46s. Rate: 154.5 symbols/min [2025-10-09T22:43:14.583235] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:14.607309] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-10-09T22:43:14.607685] [INFO ] [MAIN ] TGT: Loaded 54168 primary data records. [2025-10-09T22:43:14.755055] [DEBUG] [LOCAL ] THG: Loaded 21678 existing records from primary storage. [2025-10-09T22:43:14.760841] [INFO ] [MAIN ] THG: Loaded 21678 primary data records. [2025-10-09T22:43:14.900710] [DEBUG] [LOCAL ] THC: Loaded 47679 existing records from primary storage. [2025-10-09T22:43:14.919380] [INFO ] [MAIN ] THC: Loaded 47679 primary data records. [2025-10-09T22:43:15.676748] [DEBUG] [MAIN ] TGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:15.679307] [INFO ] [MAIN ] TGT: Generated 1807 derivative records from 54168 primary records. [2025-10-09T22:43:15.679550] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-09T22:43:15.707749] [DEBUG] [MAIN ] THG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:15.709266] [INFO ] [MAIN ] THG: Generated 1807 derivative records from 21678 primary records. [2025-10-09T22:43:15.709616] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-09T22:43:15.737196] [DEBUG] [LOCAL ] TGT: Derivative data saved (1807 records). [2025-10-09T22:43:15.744270] [DEBUG] [LOCAL ] THG: Derivative data saved (1807 records). [2025-10-09T22:43:15.744677] [DEBUG] [MAIN ] THC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:15.744367] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-09T22:43:15.745381] [INFO ] [MAIN ] THC: Generated 1807 derivative records from 47679 primary records. [2025-10-09T22:43:15.747871] [INFO ] [MAIN ] Derivative Progress: 1417/1690 symbols completed. THG took 1.2s. Estimated remaining: 1m 46s. Rate: 154.2 symbols/min [2025-10-09T22:43:15.745507] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-09T22:43:15.748808] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:15.744758] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-09T22:43:15.758459] [INFO ] [MAIN ] Derivative Progress: 1418/1690 symbols completed. TGT took 1.3s. Estimated remaining: 1m 46s. Rate: 154.4 symbols/min [2025-10-09T22:43:15.762584] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:15.769280] [DEBUG] [LOCAL ] THIR: Loaded 2297 existing records from primary storage. [2025-10-09T22:43:15.770259] [INFO ] [MAIN ] THIR: Loaded 2297 primary data records. [2025-10-09T22:43:15.790584] [DEBUG] [LOCAL ] THLV: Loaded 1551 existing records from primary storage. [2025-10-09T22:43:15.797005] [INFO ] [MAIN ] THLV: Loaded 1551 primary data records. [2025-10-09T22:43:15.808547] [DEBUG] [LOCAL ] THC: Derivative data saved (1807 records). [2025-10-09T22:43:15.830667] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-09T22:43:15.858579] [INFO ] [MAIN ] Derivative Progress: 1419/1690 symbols completed. THC took 1.3s. Estimated remaining: 1m 45s. Rate: 154.4 symbols/min [2025-10-09T22:43:15.931444] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:16.437292] [DEBUG] [LOCAL ] THO: Loaded 41932 existing records from primary storage. [2025-10-09T22:43:16.438231] [INFO ] [MAIN ] THO: Loaded 41932 primary data records. [2025-10-09T22:43:16.582767] [DEBUG] [MAIN ] THLV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:43:16.594006] [INFO ] [MAIN ] THLV: Generated 1806 derivative records from 1551 primary records. [2025-10-09T22:43:16.657895] [DEBUG] [MAIN ] THIR: Filtered 6966 bins outside market hours, 7768 incomplete bins [2025-10-09T22:43:16.655157] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-09T22:43:16.857853] [INFO ] [MAIN ] THIR: Generated 1798 derivative records from 2297 primary records. [2025-10-09T22:43:16.868626] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-09T22:43:16.895466] [DEBUG] [LOCAL ] THIR: Derivative data saved (1798 records). [2025-10-09T22:43:16.896213] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-09T22:43:16.899623] [INFO ] [MAIN ] Derivative Progress: 1420/1690 symbols completed. THIR took 1.2s. Estimated remaining: 1m 45s. Rate: 154.2 symbols/min [2025-10-09T22:43:16.900981] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:16.905870] [DEBUG] [LOCAL ] THLV: Derivative data saved (1806 records). [2025-10-09T22:43:16.906181] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-09T22:43:16.909056] [INFO ] [MAIN ] Derivative Progress: 1421/1690 symbols completed. THLV took 1.1s. Estimated remaining: 1m 45s. Rate: 154.4 symbols/min [2025-10-09T22:43:16.910962] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:16.941215] [DEBUG] [MAIN ] THO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:16.942193] [INFO ] [MAIN ] THO: Generated 1807 derivative records from 41932 primary records. [2025-10-09T22:43:16.942300] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-09T22:43:16.969150] [DEBUG] [LOCAL ] THQ: Loaded 25352 existing records from primary storage. [2025-10-09T22:43:16.969887] [INFO ] [MAIN ] THQ: Loaded 25352 primary data records. [2025-10-09T22:43:17.087889] [DEBUG] [LOCAL ] THR: Loaded 19941 existing records from primary storage. [2025-10-09T22:43:17.091544] [DEBUG] [LOCAL ] THO: Derivative data saved (1807 records). [2025-10-09T22:43:17.112965] [INFO ] [MAIN ] THR: Loaded 19941 primary data records. [2025-10-09T22:43:17.113053] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-09T22:43:17.145294] [INFO ] [MAIN ] Derivative Progress: 1422/1690 symbols completed. THO took 1.2s. Estimated remaining: 1m 44s. Rate: 154.4 symbols/min [2025-10-09T22:43:17.327936] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:17.669142] [DEBUG] [LOCAL ] THS: Loaded 38695 existing records from primary storage. [2025-10-09T22:43:17.670061] [INFO ] [MAIN ] THS: Loaded 38695 primary data records. [2025-10-09T22:43:17.768359] [DEBUG] [MAIN ] THQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:17.780312] [INFO ] [MAIN ] THQ: Generated 1807 derivative records from 25352 primary records. [2025-10-09T22:43:17.791413] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-09T22:43:18.029105] [DEBUG] [MAIN ] THR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:18.029754] [DEBUG] [LOCAL ] THQ: Derivative data saved (1807 records). [2025-10-09T22:43:18.031499] [INFO ] [MAIN ] THR: Generated 1807 derivative records from 19941 primary records. [2025-10-09T22:43:18.031577] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-09T22:43:18.031978] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-09T22:43:18.035344] [INFO ] [MAIN ] Derivative Progress: 1423/1690 symbols completed. THQ took 1.1s. Estimated remaining: 1m 44s. Rate: 154.3 symbols/min [2025-10-09T22:43:18.057035] [DEBUG] [LOCAL ] THR: Derivative data saved (1807 records). [2025-10-09T22:43:18.057362] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-09T22:43:18.060539] [INFO ] [MAIN ] Derivative Progress: 1424/1690 symbols completed. THR took 1.1s. Estimated remaining: 1m 43s. Rate: 154.4 symbols/min [2025-10-09T22:43:18.081428] [DEBUG] [MAIN ] THS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:18.082269] [INFO ] [MAIN ] THS: Generated 1807 derivative records from 38695 primary records. [2025-10-09T22:43:18.082332] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-09T22:43:18.098503] [DEBUG] [LOCAL ] THS: Derivative data saved (1807 records). [2025-10-09T22:43:18.098632] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-09T22:43:18.101441] [INFO ] [MAIN ] Derivative Progress: 1425/1690 symbols completed. THS took 0.8s. Estimated remaining: 1m 43s. Rate: 154.5 symbols/min [2025-10-09T22:43:18.101989] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:18.102080] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:18.102235] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:18.110889] [DEBUG] [LOCAL ] TISI: Loaded 3481 existing records from primary storage. [2025-10-09T22:43:18.111161] [INFO ] [MAIN ] TISI: Loaded 3481 primary data records. [2025-10-09T22:43:18.255316] [DEBUG] [LOCAL ] THW: Loaded 19800 existing records from primary storage. [2025-10-09T22:43:18.296445] [INFO ] [MAIN ] THW: Loaded 19800 primary data records. [2025-10-09T22:43:18.560300] [DEBUG] [LOCAL ] TIMB: Loaded 35792 existing records from primary storage. [2025-10-09T22:43:18.560747] [INFO ] [MAIN ] TIMB: Loaded 35792 primary data records. [2025-10-09T22:43:19.213592] [DEBUG] [MAIN ] TISI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:19.215683] [INFO ] [MAIN ] TISI: Generated 1807 derivative records from 3481 primary records. [2025-10-09T22:43:19.216082] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-09T22:43:19.237540] [DEBUG] [LOCAL ] TISI: Derivative data saved (1807 records). [2025-10-09T22:43:19.238035] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-09T22:43:19.240593] [INFO ] [MAIN ] Derivative Progress: 1426/1690 symbols completed. TISI took 1.1s. Estimated remaining: 1m 43s. Rate: 154.2 symbols/min [2025-10-09T22:43:19.241178] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:19.255084] [DEBUG] [MAIN ] THW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:19.255821] [INFO ] [MAIN ] THW: Generated 1807 derivative records from 19800 primary records. [2025-10-09T22:43:19.255916] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-09T22:43:19.289303] [DEBUG] [MAIN ] TIMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:19.290928] [INFO ] [MAIN ] TIMB: Generated 1807 derivative records from 35792 primary records. [2025-10-09T22:43:19.291456] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-09T22:43:19.292350] [DEBUG] [LOCAL ] THW: Derivative data saved (1807 records). [2025-10-09T22:43:19.302006] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-09T22:43:19.304755] [INFO ] [MAIN ] Derivative Progress: 1427/1690 symbols completed. THW took 1.2s. Estimated remaining: 1m 42s. Rate: 154.3 symbols/min [2025-10-09T22:43:19.312353] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:19.329966] [DEBUG] [LOCAL ] TIXT: Loaded 32214 existing records from primary storage. [2025-10-09T22:43:19.330936] [INFO ] [MAIN ] TIXT: Loaded 32214 primary data records. [2025-10-09T22:43:19.406597] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1807 records). [2025-10-09T22:43:19.414010] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-09T22:43:19.435625] [INFO ] [MAIN ] Derivative Progress: 1428/1690 symbols completed. TIMB took 1.3s. Estimated remaining: 1m 42s. Rate: 154.4 symbols/min [2025-10-09T22:43:19.447495] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:19.678938] [DEBUG] [LOCAL ] TJX: Loaded 54058 existing records from primary storage. [2025-10-09T22:43:19.680087] [INFO ] [MAIN ] TJX: Loaded 54058 primary data records. [2025-10-09T22:43:19.876425] [DEBUG] [LOCAL ] TK: Loaded 39475 existing records from primary storage. [2025-10-09T22:43:19.899923] [INFO ] [MAIN ] TK: Loaded 39475 primary data records. [2025-10-09T22:43:20.221836] [DEBUG] [MAIN ] TIXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:20.343509] [INFO ] [MAIN ] TIXT: Generated 1807 derivative records from 32214 primary records. [2025-10-09T22:43:20.343816] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-09T22:43:20.363883] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1807 records). [2025-10-09T22:43:20.364412] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-09T22:43:20.367170] [INFO ] [MAIN ] Derivative Progress: 1429/1690 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 42s. Rate: 154.3 symbols/min [2025-10-09T22:43:20.367864] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:20.389633] [DEBUG] [MAIN ] TJX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:20.390609] [INFO ] [MAIN ] TJX: Generated 1807 derivative records from 54058 primary records. [2025-10-09T22:43:20.390969] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-09T22:43:20.422096] [DEBUG] [LOCAL ] TJX: Derivative data saved (1807 records). [2025-10-09T22:43:20.422737] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-09T22:43:20.426423] [INFO ] [MAIN ] Derivative Progress: 1430/1690 symbols completed. TJX took 1.1s. Estimated remaining: 1m 41s. Rate: 154.4 symbols/min [2025-10-09T22:43:20.426978] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:20.440223] [DEBUG] [MAIN ] TK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:20.440958] [INFO ] [MAIN ] TK: Generated 1807 derivative records from 39475 primary records. [2025-10-09T22:43:20.441185] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-09T22:43:20.466538] [DEBUG] [LOCAL ] TKC: Loaded 39447 existing records from primary storage. [2025-10-09T22:43:20.467478] [INFO ] [MAIN ] TKC: Loaded 39447 primary data records. [2025-10-09T22:43:20.533783] [DEBUG] [LOCAL ] TK: Derivative data saved (1807 records). [2025-10-09T22:43:20.555688] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-09T22:43:20.564616] [INFO ] [MAIN ] Derivative Progress: 1431/1690 symbols completed. TK took 1.1s. Estimated remaining: 1m 41s. Rate: 154.4 symbols/min [2025-10-09T22:43:20.575498] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:20.697597] [DEBUG] [LOCAL ] TKO: Loaded 44214 existing records from primary storage. [2025-10-09T22:43:20.818783] [INFO ] [MAIN ] TKO: Loaded 44214 primary data records. [2025-10-09T22:43:21.017080] [DEBUG] [LOCAL ] TKR: Loaded 40194 existing records from primary storage. [2025-10-09T22:43:21.039385] [INFO ] [MAIN ] TKR: Loaded 40194 primary data records. [2025-10-09T22:43:21.549196] [DEBUG] [MAIN ] TKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:21.550389] [INFO ] [MAIN ] TKC: Generated 1807 derivative records from 39447 primary records. [2025-10-09T22:43:21.550620] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-09T22:43:21.584947] [DEBUG] [MAIN ] TKO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:21.586911] [INFO ] [MAIN ] TKO: Generated 1807 derivative records from 44214 primary records. [2025-10-09T22:43:21.588186] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-09T22:43:21.590497] [DEBUG] [LOCAL ] TKC: Derivative data saved (1807 records). [2025-10-09T22:43:21.590799] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-09T22:43:21.593720] [INFO ] [MAIN ] Derivative Progress: 1432/1690 symbols completed. TKC took 1.2s. Estimated remaining: 1m 40s. Rate: 154.2 symbols/min [2025-10-09T22:43:21.601948] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:21.613408] [DEBUG] [LOCAL ] TKO: Derivative data saved (1807 records). [2025-10-09T22:43:21.613610] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-09T22:43:21.618475] [INFO ] [MAIN ] Derivative Progress: 1433/1690 symbols completed. TKO took 1.2s. Estimated remaining: 1m 40s. Rate: 154.3 symbols/min [2025-10-09T22:43:21.618764] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:21.632256] [DEBUG] [MAIN ] TKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:21.633122] [INFO ] [MAIN ] TKR: Generated 1807 derivative records from 40194 primary records. [2025-10-09T22:43:21.633185] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-09T22:43:21.666183] [DEBUG] [LOCAL ] TKR: Derivative data saved (1807 records). [2025-10-09T22:43:21.666399] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-09T22:43:21.673254] [INFO ] [MAIN ] Derivative Progress: 1434/1690 symbols completed. TKR took 1.1s. Estimated remaining: 1m 39s. Rate: 154.4 symbols/min [2025-10-09T22:43:21.673479] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:21.681732] [DEBUG] [LOCAL ] TLYS: Loaded 16546 existing records from primary storage. [2025-10-09T22:43:21.681870] [INFO ] [MAIN ] TLYS: Loaded 16546 primary data records. [2025-10-09T22:43:21.822426] [DEBUG] [LOCAL ] TLK: Loaded 39054 existing records from primary storage. [2025-10-09T22:43:21.880759] [INFO ] [MAIN ] TLK: Loaded 39054 primary data records. [2025-10-09T22:43:22.045025] [DEBUG] [LOCAL ] TM: Loaded 36635 existing records from primary storage. [2025-10-09T22:43:22.104842] [INFO ] [MAIN ] TM: Loaded 36635 primary data records. [2025-10-09T22:43:22.696398] [DEBUG] [MAIN ] TLYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:22.697579] [INFO ] [MAIN ] TLYS: Generated 1807 derivative records from 16546 primary records. [2025-10-09T22:43:22.698500] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-09T22:43:22.718380] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1807 records). [2025-10-09T22:43:22.719669] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-09T22:43:22.723531] [INFO ] [MAIN ] Derivative Progress: 1435/1690 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 39s. Rate: 154.3 symbols/min [2025-10-09T22:43:22.723942] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:22.738124] [DEBUG] [MAIN ] TLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:22.739063] [INFO ] [MAIN ] TLK: Generated 1807 derivative records from 39054 primary records. [2025-10-09T22:43:22.740531] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-09T22:43:22.770565] [DEBUG] [MAIN ] TM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:22.771750] [INFO ] [MAIN ] TM: Generated 1807 derivative records from 36635 primary records. [2025-10-09T22:43:22.772034] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-09T22:43:22.773178] [DEBUG] [LOCAL ] TLK: Derivative data saved (1807 records). [2025-10-09T22:43:22.773429] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-09T22:43:22.783565] [INFO ] [MAIN ] Derivative Progress: 1436/1690 symbols completed. TLK took 1.2s. Estimated remaining: 1m 39s. Rate: 154.3 symbols/min [2025-10-09T22:43:22.783880] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:22.794695] [DEBUG] [LOCAL ] TM: Derivative data saved (1807 records). [2025-10-09T22:43:22.795065] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-09T22:43:22.798791] [INFO ] [MAIN ] Derivative Progress: 1437/1690 symbols completed. TM took 1.1s. Estimated remaining: 1m 38s. Rate: 154.4 symbols/min [2025-10-09T22:43:22.799198] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:22.839870] [DEBUG] [LOCAL ] TME: Loaded 53567 existing records from primary storage. [2025-10-09T22:43:22.840317] [INFO ] [MAIN ] TME: Loaded 53567 primary data records. [2025-10-09T22:43:22.993690] [DEBUG] [LOCAL ] TMHC: Loaded 45681 existing records from primary storage. [2025-10-09T22:43:22.994075] [INFO ] [MAIN ] TMHC: Loaded 45681 primary data records. [2025-10-09T22:43:23.421127] [DEBUG] [LOCAL ] TMO: Loaded 52801 existing records from primary storage. [2025-10-09T22:43:23.432723] [INFO ] [MAIN ] TMO: Loaded 52801 primary data records. [2025-10-09T22:43:24.038449] [DEBUG] [MAIN ] TME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:24.040696] [INFO ] [MAIN ] TME: Generated 1807 derivative records from 53567 primary records. [2025-10-09T22:43:24.041170] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-09T22:43:24.075356] [DEBUG] [MAIN ] TMHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:24.077546] [INFO ] [MAIN ] TMHC: Generated 1807 derivative records from 45681 primary records. [2025-10-09T22:43:24.078319] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-09T22:43:24.079691] [DEBUG] [LOCAL ] TME: Derivative data saved (1807 records). [2025-10-09T22:43:24.080428] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-09T22:43:24.083571] [INFO ] [MAIN ] Derivative Progress: 1438/1690 symbols completed. TME took 1.4s. Estimated remaining: 1m 38s. Rate: 154.2 symbols/min [2025-10-09T22:43:24.117170] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1807 records). [2025-10-09T22:43:24.117680] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-09T22:43:24.121525] [INFO ] [MAIN ] Derivative Progress: 1439/1690 symbols completed. TMHC took 1.3s. Estimated remaining: 1m 38s. Rate: 154.3 symbols/min [2025-10-09T22:43:24.117885] [DEBUG] [MAIN ] TMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:24.122440] [INFO ] [MAIN ] TMO: Generated 1807 derivative records from 52801 primary records. [2025-10-09T22:43:24.122508] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-09T22:43:24.138408] [DEBUG] [LOCAL ] TMO: Derivative data saved (1807 records). [2025-10-09T22:43:24.138485] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-09T22:43:24.141365] [INFO ] [MAIN ] Derivative Progress: 1440/1690 symbols completed. TMO took 1.3s. Estimated remaining: 1m 37s. Rate: 154.4 symbols/min [2025-10-09T22:43:24.141927] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:24.142037] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:24.142357] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:24.167007] [DEBUG] [LOCAL ] TNC: Loaded 14670 existing records from primary storage. [2025-10-09T22:43:24.167232] [INFO ] [MAIN ] TNC: Loaded 14670 primary data records. [2025-10-09T22:43:24.347831] [DEBUG] [LOCAL ] TNK: Loaded 35458 existing records from primary storage. [2025-10-09T22:43:24.381758] [INFO ] [MAIN ] TNK: Loaded 35458 primary data records. [2025-10-09T22:43:24.548405] [DEBUG] [LOCAL ] TNET: Loaded 28458 existing records from primary storage. [2025-10-09T22:43:24.575104] [INFO ] [MAIN ] TNET: Loaded 28458 primary data records. [2025-10-09T22:43:25.136718] [DEBUG] [MAIN ] TNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:25.138064] [INFO ] [MAIN ] TNC: Generated 1807 derivative records from 14670 primary records. [2025-10-09T22:43:25.138348] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-09T22:43:25.160877] [DEBUG] [LOCAL ] TNC: Derivative data saved (1807 records). [2025-10-09T22:43:25.161328] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-09T22:43:25.164061] [INFO ] [MAIN ] Derivative Progress: 1441/1690 symbols completed. TNC took 1.0s. Estimated remaining: 1m 37s. Rate: 154.2 symbols/min [2025-10-09T22:43:25.173699] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:25.180960] [DEBUG] [MAIN ] TNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:25.183032] [INFO ] [MAIN ] TNK: Generated 1807 derivative records from 35458 primary records. [2025-10-09T22:43:25.184264] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-09T22:43:25.212409] [DEBUG] [MAIN ] TNET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:25.214490] [INFO ] [MAIN ] TNET: Generated 1807 derivative records from 28458 primary records. [2025-10-09T22:43:25.215145] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-09T22:43:25.233867] [DEBUG] [LOCAL ] TNET: Derivative data saved (1807 records). [2025-10-09T22:43:25.234737] [DEBUG] [LOCAL ] TNK: Derivative data saved (1807 records). [2025-10-09T22:43:25.235013] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-09T22:43:25.234844] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-09T22:43:25.237529] [INFO ] [MAIN ] Derivative Progress: 1442/1690 symbols completed. TNK took 1.1s. Estimated remaining: 1m 36s. Rate: 154.3 symbols/min [2025-10-09T22:43:25.250593] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:25.250767] [INFO ] [MAIN ] Derivative Progress: 1443/1690 symbols completed. TNET took 1.1s. Estimated remaining: 1m 36s. Rate: 154.4 symbols/min [2025-10-09T22:43:25.251443] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:25.268539] [DEBUG] [LOCAL ] TNL: Loaded 42062 existing records from primary storage. [2025-10-09T22:43:25.268720] [INFO ] [MAIN ] TNL: Loaded 42062 primary data records. [2025-10-09T22:43:25.660312] [DEBUG] [LOCAL ] TOST: Loaded 54073 existing records from primary storage. [2025-10-09T22:43:25.673106] [INFO ] [MAIN ] TOST: Loaded 54073 primary data records. [2025-10-09T22:43:25.740134] [DEBUG] [LOCAL ] TOL: Loaded 51135 existing records from primary storage. [2025-10-09T22:43:25.762689] [INFO ] [MAIN ] TOL: Loaded 51135 primary data records. [2025-10-09T22:43:26.311380] [DEBUG] [MAIN ] TNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:26.313097] [INFO ] [MAIN ] TNL: Generated 1807 derivative records from 42062 primary records. [2025-10-09T22:43:26.314011] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-09T22:43:26.333905] [DEBUG] [LOCAL ] TNL: Derivative data saved (1807 records). [2025-10-09T22:43:26.334673] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-09T22:43:26.338674] [INFO ] [MAIN ] Derivative Progress: 1444/1690 symbols completed. TNL took 1.2s. Estimated remaining: 1m 36s. Rate: 154.2 symbols/min [2025-10-09T22:43:26.339011] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:26.354961] [DEBUG] [MAIN ] TOST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:26.355820] [INFO ] [MAIN ] TOST: Generated 1807 derivative records from 54073 primary records. [2025-10-09T22:43:26.355968] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-09T22:43:26.384826] [DEBUG] [MAIN ] TOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:26.395283] [DEBUG] [LOCAL ] TOST: Derivative data saved (1807 records). [2025-10-09T22:43:26.385778] [INFO ] [MAIN ] TOL: Generated 1807 derivative records from 51135 primary records. [2025-10-09T22:43:26.395440] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-09T22:43:26.397490] [INFO ] [MAIN ] Derivative Progress: 1445/1690 symbols completed. TOST took 1.1s. Estimated remaining: 1m 35s. Rate: 154.3 symbols/min [2025-10-09T22:43:26.397765] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:26.398234] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-09T22:43:26.422833] [DEBUG] [LOCAL ] TOL: Derivative data saved (1807 records). [2025-10-09T22:43:26.423433] [DEBUG] [LOCAL ] TPB: Loaded 25800 existing records from primary storage. [2025-10-09T22:43:26.423062] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-09T22:43:26.426801] [INFO ] [MAIN ] Derivative Progress: 1446/1690 symbols completed. TOL took 1.2s. Estimated remaining: 1m 35s. Rate: 154.4 symbols/min [2025-10-09T22:43:26.427012] [INFO ] [MAIN ] TPB: Loaded 25800 primary data records. [2025-10-09T22:43:26.427188] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:26.769266] [DEBUG] [LOCAL ] TPC: Loaded 39226 existing records from primary storage. [2025-10-09T22:43:26.770134] [INFO ] [MAIN ] TPC: Loaded 39226 primary data records. [2025-10-09T22:43:26.865678] [DEBUG] [LOCAL ] TPH: Loaded 45227 existing records from primary storage. [2025-10-09T22:43:26.884672] [INFO ] [MAIN ] TPH: Loaded 45227 primary data records. [2025-10-09T22:43:27.518886] [DEBUG] [MAIN ] TPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:27.519786] [INFO ] [MAIN ] TPB: Generated 1807 derivative records from 25800 primary records. [2025-10-09T22:43:27.520710] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-09T22:43:27.546963] [DEBUG] [LOCAL ] TPB: Derivative data saved (1807 records). [2025-10-09T22:43:27.547585] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-09T22:43:27.550273] [INFO ] [MAIN ] Derivative Progress: 1447/1690 symbols completed. TPB took 1.2s. Estimated remaining: 1m 35s. Rate: 154.2 symbols/min [2025-10-09T22:43:27.550462] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:27.567772] [DEBUG] [MAIN ] TPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:27.568604] [INFO ] [MAIN ] TPC: Generated 1807 derivative records from 39226 primary records. [2025-10-09T22:43:27.568876] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-09T22:43:27.591078] [DEBUG] [LOCAL ] TPC: Derivative data saved (1807 records). [2025-10-09T22:43:27.597846] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-09T22:43:27.597754] [DEBUG] [LOCAL ] TPL: Loaded 12371 existing records from primary storage. [2025-10-09T22:43:27.600827] [INFO ] [MAIN ] TPL: Loaded 12371 primary data records. [2025-10-09T22:43:27.600565] [INFO ] [MAIN ] Derivative Progress: 1448/1690 symbols completed. TPC took 1.2s. Estimated remaining: 1m 34s. Rate: 154.3 symbols/min [2025-10-09T22:43:27.642328] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:27.682790] [DEBUG] [MAIN ] TPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:27.688909] [INFO ] [MAIN ] TPH: Generated 1807 derivative records from 45227 primary records. [2025-10-09T22:43:27.706756] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-09T22:43:27.942350] [DEBUG] [LOCAL ] TPH: Derivative data saved (1807 records). [2025-10-09T22:43:27.942552] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-09T22:43:27.945298] [INFO ] [MAIN ] Derivative Progress: 1449/1690 symbols completed. TPH took 1.5s. Estimated remaining: 1m 34s. Rate: 154.3 symbols/min [2025-10-09T22:43:27.945743] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:27.990357] [DEBUG] [LOCAL ] TPVG: Loaded 27262 existing records from primary storage. [2025-10-09T22:43:27.990744] [INFO ] [MAIN ] TPVG: Loaded 27262 primary data records. [2025-10-09T22:43:28.075907] [DEBUG] [MAIN ] TPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:28.103301] [DEBUG] [LOCAL ] TPR: Loaded 53825 existing records from primary storage. [2025-10-09T22:43:28.108713] [INFO ] [MAIN ] TPR: Loaded 53825 primary data records. [2025-10-09T22:43:28.115176] [INFO ] [MAIN ] TPL: Generated 1807 derivative records from 12371 primary records. [2025-10-09T22:43:28.164856] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-09T22:43:28.660137] [DEBUG] [LOCAL ] TPL: Derivative data saved (1807 records). [2025-10-09T22:43:28.661103] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-09T22:43:28.663714] [INFO ] [MAIN ] Derivative Progress: 1450/1690 symbols completed. TPL took 1.1s. Estimated remaining: 1m 33s. Rate: 154.2 symbols/min [2025-10-09T22:43:28.664536] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:28.680270] [DEBUG] [LOCAL ] TPYP: Loaded 7959 existing records from primary storage. [2025-10-09T22:43:28.680771] [INFO ] [MAIN ] TPYP: Loaded 7959 primary data records. [2025-10-09T22:43:28.887499] [DEBUG] [MAIN ] TPVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:28.901177] [INFO ] [MAIN ] TPVG: Generated 1807 derivative records from 27262 primary records. [2025-10-09T22:43:29.002440] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-09T22:43:29.008216] [DEBUG] [MAIN ] TPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:29.019899] [INFO ] [MAIN ] TPR: Generated 1807 derivative records from 53825 primary records. [2025-10-09T22:43:29.020478] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-09T22:43:29.047976] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1807 records). [2025-10-09T22:43:29.054510] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-09T22:43:29.058695] [INFO ] [MAIN ] Derivative Progress: 1451/1690 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 33s. Rate: 154.2 symbols/min [2025-10-09T22:43:29.060054] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:29.062505] [DEBUG] [LOCAL ] TPR: Derivative data saved (1807 records). [2025-10-09T22:43:29.062730] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-09T22:43:29.065752] [INFO ] [MAIN ] Derivative Progress: 1452/1690 symbols completed. TPR took 1.4s. Estimated remaining: 1m 33s. Rate: 154.3 symbols/min [2025-10-09T22:43:29.066168] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:29.075040] [DEBUG] [LOCAL ] TPZ: Loaded 4867 existing records from primary storage. [2025-10-09T22:43:29.075194] [INFO ] [MAIN ] TPZ: Loaded 4867 primary data records. [2025-10-09T22:43:29.271361] [DEBUG] [LOCAL ] TR: Loaded 18876 existing records from primary storage. [2025-10-09T22:43:29.285322] [INFO ] [MAIN ] TR: Loaded 18876 primary data records. [2025-10-09T22:43:29.558530] [DEBUG] [MAIN ] TPYP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:29.621754] [INFO ] [MAIN ] TPYP: Generated 1807 derivative records from 7959 primary records. [2025-10-09T22:43:29.625969] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-09T22:43:29.843848] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1807 records). [2025-10-09T22:43:29.845195] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-09T22:43:29.848734] [INFO ] [MAIN ] Derivative Progress: 1453/1690 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 32s. Rate: 154.2 symbols/min [2025-10-09T22:43:29.873055] [DEBUG] [MAIN ] TPZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:43:29.874144] [INFO ] [MAIN ] TPZ: Generated 1806 derivative records from 4867 primary records. [2025-10-09T22:43:29.874340] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-09T22:43:29.905214] [DEBUG] [MAIN ] TR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:29.907042] [INFO ] [MAIN ] TR: Generated 1807 derivative records from 18876 primary records. [2025-10-09T22:43:29.907684] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-09T22:43:29.908518] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1806 records). [2025-10-09T22:43:29.909297] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-09T22:43:29.912048] [INFO ] [MAIN ] Derivative Progress: 1454/1690 symbols completed. TPZ took 0.9s. Estimated remaining: 1m 32s. Rate: 154.3 symbols/min [2025-10-09T22:43:29.927288] [DEBUG] [LOCAL ] TR: Derivative data saved (1807 records). [2025-10-09T22:43:29.927371] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-09T22:43:29.931520] [INFO ] [MAIN ] Derivative Progress: 1455/1690 symbols completed. TR took 0.9s. Estimated remaining: 1m 31s. Rate: 154.4 symbols/min [2025-10-09T22:43:29.932010] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:29.932182] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:29.932368] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:29.953371] [DEBUG] [LOCAL ] TRAK: Loaded 9675 existing records from primary storage. [2025-10-09T22:43:29.960948] [INFO ] [MAIN ] TRAK: Loaded 9675 primary data records. [2025-10-09T22:43:29.961877] [DEBUG] [LOCAL ] TRC: Loaded 15744 existing records from primary storage. [2025-10-09T22:43:29.962104] [INFO ] [MAIN ] TRC: Loaded 15744 primary data records. [2025-10-09T22:43:30.306118] [DEBUG] [LOCAL ] TREX: Loaded 50263 existing records from primary storage. [2025-10-09T22:43:30.336208] [INFO ] [MAIN ] TREX: Loaded 50263 primary data records. [2025-10-09T22:43:31.008194] [DEBUG] [MAIN ] TRAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:31.022594] [INFO ] [MAIN ] TRAK: Generated 1807 derivative records from 9675 primary records. [2025-10-09T22:43:31.023126] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-09T22:43:31.023031] [DEBUG] [MAIN ] TRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:31.037790] [INFO ] [MAIN ] TRC: Generated 1807 derivative records from 15744 primary records. [2025-10-09T22:43:31.040818] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-09T22:43:31.053796] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1807 records). [2025-10-09T22:43:31.058915] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-09T22:43:31.061801] [INFO ] [MAIN ] Derivative Progress: 1456/1690 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 31s. Rate: 154.2 symbols/min [2025-10-09T22:43:31.059415] [DEBUG] [MAIN ] TREX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:31.062727] [INFO ] [MAIN ] TREX: Generated 1807 derivative records from 50263 primary records. [2025-10-09T22:43:31.063171] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-09T22:43:31.063600] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:31.088145] [DEBUG] [LOCAL ] TRC: Derivative data saved (1807 records). [2025-10-09T22:43:31.092692] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-09T22:43:31.096572] [INFO ] [MAIN ] Derivative Progress: 1457/1690 symbols completed. TRC took 1.2s. Estimated remaining: 1m 31s. Rate: 154.3 symbols/min [2025-10-09T22:43:31.096999] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:31.099309] [DEBUG] [LOCAL ] TREX: Derivative data saved (1807 records). [2025-10-09T22:43:31.099387] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-09T22:43:31.101993] [INFO ] [MAIN ] Derivative Progress: 1458/1690 symbols completed. TREX took 1.2s. Estimated remaining: 1m 30s. Rate: 154.4 symbols/min [2025-10-09T22:43:31.102628] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:31.161822] [DEBUG] [LOCAL ] TRN: Loaded 37031 existing records from primary storage. [2025-10-09T22:43:31.161968] [INFO ] [MAIN ] TRN: Loaded 37031 primary data records. [2025-10-09T22:43:31.270965] [DEBUG] [LOCAL ] TRNO: Loaded 44218 existing records from primary storage. [2025-10-09T22:43:31.282811] [INFO ] [MAIN ] TRNO: Loaded 44218 primary data records. [2025-10-09T22:43:31.309875] [DEBUG] [LOCAL ] TRGP: Loaded 51169 existing records from primary storage. [2025-10-09T22:43:31.329905] [INFO ] [MAIN ] TRGP: Loaded 51169 primary data records. [2025-10-09T22:43:32.191705] [DEBUG] [MAIN ] TRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:32.204884] [INFO ] [MAIN ] TRN: Generated 1807 derivative records from 37031 primary records. [2025-10-09T22:43:32.205117] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-09T22:43:32.209125] [DEBUG] [MAIN ] TRNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:32.218696] [INFO ] [MAIN ] TRNO: Generated 1807 derivative records from 44218 primary records. [2025-10-09T22:43:32.218933] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-09T22:43:32.255116] [DEBUG] [MAIN ] TRGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:32.257032] [INFO ] [MAIN ] TRGP: Generated 1807 derivative records from 51169 primary records. [2025-10-09T22:43:32.257135] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-09T22:43:32.255596] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1807 records). [2025-10-09T22:43:32.259141] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-09T22:43:32.262933] [INFO ] [MAIN ] Derivative Progress: 1459/1690 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 30s. Rate: 154.2 symbols/min [2025-10-09T22:43:32.272009] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:32.275552] [DEBUG] [LOCAL ] TRN: Derivative data saved (1807 records). [2025-10-09T22:43:32.275918] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-09T22:43:32.280799] [INFO ] [MAIN ] Derivative Progress: 1460/1690 symbols completed. TRN took 1.2s. Estimated remaining: 1m 29s. Rate: 154.3 symbols/min [2025-10-09T22:43:32.281554] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:32.286229] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1807 records). [2025-10-09T22:43:32.286309] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-09T22:43:32.288998] [INFO ] [MAIN ] Derivative Progress: 1461/1690 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 29s. Rate: 154.4 symbols/min [2025-10-09T22:43:32.289325] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:32.342018] [DEBUG] [LOCAL ] TRTX: Loaded 37713 existing records from primary storage. [2025-10-09T22:43:32.342144] [INFO ] [MAIN ] TRTX: Loaded 37713 primary data records. [2025-10-09T22:43:32.447198] [DEBUG] [LOCAL ] TROX: Loaded 52360 existing records from primary storage. [2025-10-09T22:43:32.453402] [INFO ] [MAIN ] TROX: Loaded 52360 primary data records. [2025-10-09T22:43:32.579349] [DEBUG] [LOCAL ] TRP: Loaded 52533 existing records from primary storage. [2025-10-09T22:43:32.602228] [INFO ] [MAIN ] TRP: Loaded 52533 primary data records. [2025-10-09T22:43:33.363764] [DEBUG] [MAIN ] TRTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:33.366272] [INFO ] [MAIN ] TRTX: Generated 1807 derivative records from 37713 primary records. [2025-10-09T22:43:33.366714] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-09T22:43:33.405242] [DEBUG] [MAIN ] TROX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:33.406424] [INFO ] [MAIN ] TROX: Generated 1807 derivative records from 52360 primary records. [2025-10-09T22:43:33.409558] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-09T22:43:33.411078] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1807 records). [2025-10-09T22:43:33.409839] [DEBUG] [MAIN ] TRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:33.412817] [INFO ] [MAIN ] TRP: Generated 1807 derivative records from 52533 primary records. [2025-10-09T22:43:33.419764] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-09T22:43:33.419841] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-09T22:43:33.423422] [INFO ] [MAIN ] Derivative Progress: 1462/1690 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 29s. Rate: 154.2 symbols/min [2025-10-09T22:43:33.435490] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:33.446495] [DEBUG] [LOCAL ] TROX: Derivative data saved (1807 records). [2025-10-09T22:43:33.447945] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-09T22:43:33.451338] [INFO ] [MAIN ] Derivative Progress: 1463/1690 symbols completed. TROX took 1.2s. Estimated remaining: 1m 28s. Rate: 154.3 symbols/min [2025-10-09T22:43:33.451574] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:33.452510] [DEBUG] [LOCAL ] TRP: Derivative data saved (1807 records). [2025-10-09T22:43:33.453085] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-09T22:43:33.456202] [INFO ] [MAIN ] Derivative Progress: 1464/1690 symbols completed. TRP took 1.2s. Estimated remaining: 1m 28s. Rate: 154.4 symbols/min [2025-10-09T22:43:33.456443] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:33.510102] [DEBUG] [LOCAL ] TRU: Loaded 51727 existing records from primary storage. [2025-10-09T22:43:33.522765] [INFO ] [MAIN ] TRU: Loaded 51727 primary data records. [2025-10-09T22:43:33.625670] [DEBUG] [LOCAL ] TRV: Loaded 47850 existing records from primary storage. [2025-10-09T22:43:33.643074] [INFO ] [MAIN ] TRV: Loaded 47850 primary data records. [2025-10-09T22:43:33.744000] [DEBUG] [LOCAL ] TS: Loaded 52055 existing records from primary storage. [2025-10-09T22:43:33.766712] [INFO ] [MAIN ] TS: Loaded 52055 primary data records. [2025-10-09T22:43:34.548990] [DEBUG] [MAIN ] TRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:34.550219] [INFO ] [MAIN ] TRU: Generated 1807 derivative records from 51727 primary records. [2025-10-09T22:43:34.550403] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-09T22:43:34.563928] [DEBUG] [MAIN ] TRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:34.572912] [INFO ] [MAIN ] TRV: Generated 1807 derivative records from 47850 primary records. [2025-10-09T22:43:34.574503] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-09T22:43:34.602873] [DEBUG] [LOCAL ] TRV: Derivative data saved (1807 records). [2025-10-09T22:43:34.603688] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-09T22:43:34.614445] [INFO ] [MAIN ] Derivative Progress: 1465/1690 symbols completed. TRV took 1.2s. Estimated remaining: 1m 28s. Rate: 154.2 symbols/min [2025-10-09T22:43:34.620124] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:34.621098] [DEBUG] [MAIN ] TS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:34.623633] [INFO ] [MAIN ] TS: Generated 1807 derivative records from 52055 primary records. [2025-10-09T22:43:34.623938] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-09T22:43:34.624358] [DEBUG] [LOCAL ] TRU: Derivative data saved (1807 records). [2025-10-09T22:43:34.624694] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-09T22:43:34.628484] [INFO ] [MAIN ] Derivative Progress: 1466/1690 symbols completed. TRU took 1.2s. Estimated remaining: 1m 27s. Rate: 154.3 symbols/min [2025-10-09T22:43:34.629085] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:34.657305] [DEBUG] [LOCAL ] TS: Derivative data saved (1807 records). [2025-10-09T22:43:34.657574] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-09T22:43:34.660600] [INFO ] [MAIN ] Derivative Progress: 1467/1690 symbols completed. TS took 1.2s. Estimated remaining: 1m 27s. Rate: 154.4 symbols/min [2025-10-09T22:43:34.664812] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:34.664545] [DEBUG] [LOCAL ] TSI: Loaded 7608 existing records from primary storage. [2025-10-09T22:43:34.665127] [INFO ] [MAIN ] TSI: Loaded 7608 primary data records. [2025-10-09T22:43:34.752107] [DEBUG] [LOCAL ] TSE: Loaded 28066 existing records from primary storage. [2025-10-09T22:43:34.775672] [INFO ] [MAIN ] TSE: Loaded 28066 primary data records. [2025-10-09T22:43:35.103864] [DEBUG] [LOCAL ] TSLX: Loaded 35737 existing records from primary storage. [2025-10-09T22:43:35.124295] [INFO ] [MAIN ] TSLX: Loaded 35737 primary data records. [2025-10-09T22:43:35.695048] [DEBUG] [MAIN ] TSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:35.697798] [INFO ] [MAIN ] TSI: Generated 1807 derivative records from 7608 primary records. [2025-10-09T22:43:35.698745] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-09T22:43:35.729614] [DEBUG] [LOCAL ] TSI: Derivative data saved (1807 records). [2025-10-09T22:43:35.729901] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-09T22:43:35.727828] [DEBUG] [MAIN ] TSE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:35.733178] [INFO ] [MAIN ] TSE: Generated 1807 derivative records from 28066 primary records. [2025-10-09T22:43:35.732162] [INFO ] [MAIN ] Derivative Progress: 1468/1690 symbols completed. TSI took 1.1s. Estimated remaining: 1m 26s. Rate: 154.2 symbols/min [2025-10-09T22:43:35.733677] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-09T22:43:35.752547] [DEBUG] [LOCAL ] TSE: Derivative data saved (1807 records). [2025-10-09T22:43:35.752706] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-09T22:43:35.755695] [INFO ] [MAIN ] Derivative Progress: 1469/1690 symbols completed. TSE took 1.1s. Estimated remaining: 1m 26s. Rate: 154.3 symbols/min [2025-10-09T22:43:35.770944] [DEBUG] [MAIN ] TSLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:35.771506] [INFO ] [MAIN ] TSLX: Generated 1807 derivative records from 35737 primary records. [2025-10-09T22:43:35.771565] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-09T22:43:35.787085] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1807 records). [2025-10-09T22:43:35.787146] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-09T22:43:35.789935] [INFO ] [MAIN ] Derivative Progress: 1470/1690 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 25s. Rate: 154.4 symbols/min [2025-10-09T22:43:35.790852] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:35.791011] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:35.790732] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:35.805572] [DEBUG] [LOCAL ] TSQ: Loaded 11789 existing records from primary storage. [2025-10-09T22:43:35.805860] [INFO ] [MAIN ] TSQ: Loaded 11789 primary data records. [2025-10-09T22:43:36.161639] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-10-09T22:43:36.162006] [INFO ] [MAIN ] TSM: Loaded 54209 primary data records. [2025-10-09T22:43:36.175908] [DEBUG] [LOCAL ] TSN: Loaded 53344 existing records from primary storage. [2025-10-09T22:43:36.196909] [INFO ] [MAIN ] TSN: Loaded 53344 primary data records. [2025-10-09T22:43:36.828932] [DEBUG] [MAIN ] TSQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:36.830381] [INFO ] [MAIN ] TSQ: Generated 1807 derivative records from 11789 primary records. [2025-10-09T22:43:36.830897] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-09T22:43:36.849235] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1807 records). [2025-10-09T22:43:36.849743] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-09T22:43:36.852439] [INFO ] [MAIN ] Derivative Progress: 1471/1690 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 25s. Rate: 154.2 symbols/min [2025-10-09T22:43:36.852920] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:36.870093] [DEBUG] [MAIN ] TSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:36.870847] [INFO ] [MAIN ] TSM: Generated 1807 derivative records from 54209 primary records. [2025-10-09T22:43:36.871055] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-09T22:43:36.906255] [DEBUG] [MAIN ] TSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:36.908100] [INFO ] [MAIN ] TSN: Generated 1807 derivative records from 53344 primary records. [2025-10-09T22:43:36.908232] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-09T22:43:36.909734] [DEBUG] [LOCAL ] TSM: Derivative data saved (1807 records). [2025-10-09T22:43:36.931686] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-09T22:43:36.936672] [INFO ] [MAIN ] Derivative Progress: 1472/1690 symbols completed. TSM took 1.1s. Estimated remaining: 1m 25s. Rate: 154.3 symbols/min [2025-10-09T22:43:36.938099] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:36.940484] [DEBUG] [LOCAL ] TSN: Derivative data saved (1807 records). [2025-10-09T22:43:36.940565] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-09T22:43:36.943268] [INFO ] [MAIN ] Derivative Progress: 1473/1690 symbols completed. TSN took 1.2s. Estimated remaining: 1m 24s. Rate: 154.4 symbols/min [2025-10-09T22:43:36.943533] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:36.960135] [DEBUG] [LOCAL ] TT: Loaded 47820 existing records from primary storage. [2025-10-09T22:43:36.960389] [INFO ] [MAIN ] TT: Loaded 47820 primary data records. [2025-10-09T22:43:37.304074] [DEBUG] [LOCAL ] TTC: Loaded 42360 existing records from primary storage. [2025-10-09T22:43:37.304788] [INFO ] [MAIN ] TTC: Loaded 42360 primary data records. [2025-10-09T22:43:37.423924] [DEBUG] [LOCAL ] TTE: Loaded 51981 existing records from primary storage. [2025-10-09T22:43:37.433434] [INFO ] [MAIN ] TTE: Loaded 51981 primary data records. [2025-10-09T22:43:38.011411] [DEBUG] [MAIN ] TT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:43:38.012696] [INFO ] [MAIN ] TT: Generated 1806 derivative records from 47820 primary records. [2025-10-09T22:43:38.013144] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-09T22:43:38.034571] [DEBUG] [LOCAL ] TT: Derivative data saved (1806 records). [2025-10-09T22:43:38.035069] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-09T22:43:38.038814] [INFO ] [MAIN ] Derivative Progress: 1474/1690 symbols completed. TT took 1.2s. Estimated remaining: 1m 24s. Rate: 154.2 symbols/min [2025-10-09T22:43:38.039094] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:38.060777] [DEBUG] [MAIN ] TTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:38.061917] [INFO ] [MAIN ] TTC: Generated 1807 derivative records from 42360 primary records. [2025-10-09T22:43:38.062158] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-09T22:43:38.082183] [DEBUG] [LOCAL ] TTC: Derivative data saved (1807 records). [2025-10-09T22:43:38.085334] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-09T22:43:38.088723] [INFO ] [MAIN ] Derivative Progress: 1475/1690 symbols completed. TTC took 1.2s. Estimated remaining: 1m 24s. Rate: 154.3 symbols/min [2025-10-09T22:43:38.089060] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:38.115551] [DEBUG] [MAIN ] TTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:38.116392] [INFO ] [MAIN ] TTE: Generated 1807 derivative records from 51981 primary records. [2025-10-09T22:43:38.116456] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-09T22:43:38.134132] [DEBUG] [LOCAL ] TTE: Derivative data saved (1807 records). [2025-10-09T22:43:38.135089] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-09T22:43:38.139617] [INFO ] [MAIN ] Derivative Progress: 1476/1690 symbols completed. TTE took 1.2s. Estimated remaining: 1m 23s. Rate: 154.4 symbols/min [2025-10-09T22:43:38.140013] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:38.156446] [DEBUG] [LOCAL ] TTI: Loaded 46300 existing records from primary storage. [2025-10-09T22:43:38.156965] [INFO ] [MAIN ] TTI: Loaded 46300 primary data records. [2025-10-09T22:43:38.497041] [DEBUG] [LOCAL ] TU: Loaded 50202 existing records from primary storage. [2025-10-09T22:43:38.497322] [INFO ] [MAIN ] TU: Loaded 50202 primary data records. [2025-10-09T22:43:38.604745] [DEBUG] [LOCAL ] TUYA: Loaded 46266 existing records from primary storage. [2025-10-09T22:43:38.615552] [INFO ] [MAIN ] TUYA: Loaded 46266 primary data records. [2025-10-09T22:43:39.159003] [DEBUG] [MAIN ] TTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:39.161213] [INFO ] [MAIN ] TTI: Generated 1807 derivative records from 46300 primary records. [2025-10-09T22:43:39.162800] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-09T22:43:39.183885] [DEBUG] [LOCAL ] TTI: Derivative data saved (1807 records). [2025-10-09T22:43:39.184312] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-09T22:43:39.186710] [INFO ] [MAIN ] Derivative Progress: 1477/1690 symbols completed. TTI took 1.1s. Estimated remaining: 1m 23s. Rate: 154.2 symbols/min [2025-10-09T22:43:39.186983] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:39.206903] [DEBUG] [MAIN ] TU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:39.208137] [INFO ] [MAIN ] TU: Generated 1807 derivative records from 50202 primary records. [2025-10-09T22:43:39.208224] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-09T22:43:39.229668] [DEBUG] [MAIN ] TUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:39.235738] [INFO ] [MAIN ] TUYA: Generated 1807 derivative records from 46266 primary records. [2025-10-09T22:43:39.239091] [DEBUG] [LOCAL ] TU: Derivative data saved (1807 records). [2025-10-09T22:43:39.239357] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-09T22:43:39.239280] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-09T22:43:39.242783] [INFO ] [MAIN ] Derivative Progress: 1478/1690 symbols completed. TU took 1.2s. Estimated remaining: 1m 22s. Rate: 154.3 symbols/min [2025-10-09T22:43:39.243265] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:39.270809] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1807 records). [2025-10-09T22:43:39.273505] [DEBUG] [LOCAL ] TVC: Loaded 3335 existing records from primary storage. [2025-10-09T22:43:39.273841] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-09T22:43:39.273769] [INFO ] [MAIN ] TVC: Loaded 3335 primary data records. [2025-10-09T22:43:39.276453] [INFO ] [MAIN ] Derivative Progress: 1479/1690 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 22s. Rate: 154.4 symbols/min [2025-10-09T22:43:39.297348] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:39.381765] [DEBUG] [LOCAL ] TV: Loaded 42296 existing records from primary storage. [2025-10-09T22:43:39.392848] [INFO ] [MAIN ] TV: Loaded 42296 primary data records. [2025-10-09T22:43:39.407681] [DEBUG] [LOCAL ] TVE: Loaded 2784 existing records from primary storage. [2025-10-09T22:43:39.437769] [INFO ] [MAIN ] TVE: Loaded 2784 primary data records. [2025-10-09T22:43:40.317528] [DEBUG] [MAIN ] TVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:40.320491] [INFO ] [MAIN ] TVC: Generated 1807 derivative records from 3335 primary records. [2025-10-09T22:43:40.320845] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-09T22:43:40.347527] [DEBUG] [MAIN ] TV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:40.350835] [INFO ] [MAIN ] TV: Generated 1807 derivative records from 42296 primary records. [2025-10-09T22:43:40.351043] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-09T22:43:40.354579] [DEBUG] [LOCAL ] TVC: Derivative data saved (1807 records). [2025-10-09T22:43:40.362728] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-09T22:43:40.370448] [INFO ] [MAIN ] Derivative Progress: 1480/1690 symbols completed. TVC took 1.1s. Estimated remaining: 1m 22s. Rate: 154.2 symbols/min [2025-10-09T22:43:40.371735] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:40.388208] [DEBUG] [MAIN ] TVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:40.392891] [INFO ] [MAIN ] TVE: Generated 1807 derivative records from 2784 primary records. [2025-10-09T22:43:40.393193] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-09T22:43:40.393023] [DEBUG] [LOCAL ] TV: Derivative data saved (1807 records). [2025-10-09T22:43:40.393753] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-09T22:43:40.397128] [INFO ] [MAIN ] Derivative Progress: 1481/1690 symbols completed. TV took 1.2s. Estimated remaining: 1m 21s. Rate: 154.3 symbols/min [2025-10-09T22:43:40.408146] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:40.412527] [DEBUG] [LOCAL ] TVE: Derivative data saved (1807 records). [2025-10-09T22:43:40.412609] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-09T22:43:40.416348] [INFO ] [MAIN ] Derivative Progress: 1482/1690 symbols completed. TVE took 1.1s. Estimated remaining: 1m 21s. Rate: 154.4 symbols/min [2025-10-09T22:43:40.416609] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:40.434737] [DEBUG] [LOCAL ] TWN: Loaded 3208 existing records from primary storage. [2025-10-09T22:43:40.434898] [INFO ] [MAIN ] TWN: Loaded 3208 primary data records. [2025-10-09T22:43:40.556178] [DEBUG] [LOCAL ] TWI: Loaded 34326 existing records from primary storage. [2025-10-09T22:43:40.560618] [INFO ] [MAIN ] TWI: Loaded 34326 primary data records. [2025-10-09T22:43:40.930855] [DEBUG] [LOCAL ] TWLO: Loaded 53147 existing records from primary storage. [2025-10-09T22:43:40.941587] [INFO ] [MAIN ] TWLO: Loaded 53147 primary data records. [2025-10-09T22:43:41.468189] [DEBUG] [MAIN ] TWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:41.471102] [INFO ] [MAIN ] TWN: Generated 1807 derivative records from 3208 primary records. [2025-10-09T22:43:41.471483] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-09T22:43:41.485088] [DEBUG] [MAIN ] TWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:41.486987] [INFO ] [MAIN ] TWI: Generated 1807 derivative records from 34326 primary records. [2025-10-09T22:43:41.487203] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-09T22:43:41.518104] [DEBUG] [LOCAL ] TWN: Derivative data saved (1807 records). [2025-10-09T22:43:41.518510] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-09T22:43:41.522122] [INFO ] [MAIN ] Derivative Progress: 1483/1690 symbols completed. TWN took 1.1s. Estimated remaining: 1m 21s. Rate: 154.2 symbols/min [2025-10-09T22:43:41.527828] [DEBUG] [LOCAL ] TWI: Derivative data saved (1807 records). [2025-10-09T22:43:41.527997] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-09T22:43:41.530426] [INFO ] [MAIN ] Derivative Progress: 1484/1690 symbols completed. TWI took 1.2s. Estimated remaining: 1m 20s. Rate: 154.3 symbols/min [2025-10-09T22:43:41.542899] [DEBUG] [MAIN ] TWLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:41.543556] [INFO ] [MAIN ] TWLO: Generated 1807 derivative records from 53147 primary records. [2025-10-09T22:43:41.543618] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-09T22:43:41.560179] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1807 records). [2025-10-09T22:43:41.560242] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-09T22:43:41.562860] [INFO ] [MAIN ] Derivative Progress: 1485/1690 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 20s. Rate: 154.4 symbols/min [2025-10-09T22:43:41.563383] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:41.563506] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:41.563286] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:41.599791] [DEBUG] [LOCAL ] TX: Loaded 23510 existing records from primary storage. [2025-10-09T22:43:41.600178] [DEBUG] [LOCAL ] TXO: Loaded 19452 existing records from primary storage. [2025-10-09T22:43:41.600386] [INFO ] [MAIN ] TX: Loaded 23510 primary data records. [2025-10-09T22:43:41.600500] [INFO ] [MAIN ] TXO: Loaded 19452 primary data records. [2025-10-09T22:43:42.279004] [DEBUG] [LOCAL ] TWO: Loaded 48896 existing records from primary storage. [2025-10-09T22:43:42.279606] [INFO ] [MAIN ] TWO: Loaded 48896 primary data records. [2025-10-09T22:43:42.655383] [DEBUG] [MAIN ] TX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:42.656399] [DEBUG] [MAIN ] TXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:42.657620] [INFO ] [MAIN ] TX: Generated 1807 derivative records from 23510 primary records. [2025-10-09T22:43:42.659274] [INFO ] [MAIN ] TXO: Generated 1807 derivative records from 19452 primary records. [2025-10-09T22:43:42.660335] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-09T22:43:42.661380] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-09T22:43:42.687210] [DEBUG] [LOCAL ] TX: Derivative data saved (1807 records). [2025-10-09T22:43:42.691676] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-09T22:43:42.694572] [INFO ] [MAIN ] Derivative Progress: 1486/1690 symbols completed. TX took 1.1s. Estimated remaining: 1m 19s. Rate: 154.2 symbols/min [2025-10-09T22:43:42.695195] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:42.704242] [DEBUG] [LOCAL ] TXO: Derivative data saved (1807 records). [2025-10-09T22:43:42.704686] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-09T22:43:42.708244] [INFO ] [MAIN ] Derivative Progress: 1487/1690 symbols completed. TXO took 1.1s. Estimated remaining: 1m 19s. Rate: 154.3 symbols/min [2025-10-09T22:43:42.708541] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:42.723748] [DEBUG] [MAIN ] TWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:42.725006] [INFO ] [MAIN ] TWO: Generated 1807 derivative records from 48896 primary records. [2025-10-09T22:43:42.725247] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-09T22:43:42.747609] [DEBUG] [LOCAL ] TY: Loaded 7663 existing records from primary storage. [2025-10-09T22:43:42.748841] [INFO ] [MAIN ] TY: Loaded 7663 primary data records. [2025-10-09T22:43:42.849134] [DEBUG] [LOCAL ] TWO: Derivative data saved (1807 records). [2025-10-09T22:43:42.854544] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-09T22:43:42.882708] [INFO ] [MAIN ] Derivative Progress: 1488/1690 symbols completed. TWO took 1.3s. Estimated remaining: 1m 19s. Rate: 154.4 symbols/min [2025-10-09T22:43:42.889167] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:42.988384] [DEBUG] [LOCAL ] TXT: Loaded 50058 existing records from primary storage. [2025-10-09T22:43:43.097970] [INFO ] [MAIN ] TXT: Loaded 50058 primary data records. [2025-10-09T22:43:43.159299] [DEBUG] [LOCAL ] TYG: Loaded 13993 existing records from primary storage. [2025-10-09T22:43:43.174066] [INFO ] [MAIN ] TYG: Loaded 13993 primary data records. [2025-10-09T22:43:43.809516] [DEBUG] [MAIN ] TY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:43.811315] [INFO ] [MAIN ] TY: Generated 1807 derivative records from 7663 primary records. [2025-10-09T22:43:43.811981] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-09T22:43:43.837624] [DEBUG] [LOCAL ] TY: Derivative data saved (1807 records). [2025-10-09T22:43:43.837906] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-09T22:43:43.841272] [INFO ] [MAIN ] Derivative Progress: 1489/1690 symbols completed. TY took 1.1s. Estimated remaining: 1m 18s. Rate: 154.2 symbols/min [2025-10-09T22:43:43.841615] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:43.856165] [DEBUG] [MAIN ] TXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:43.857395] [INFO ] [MAIN ] TXT: Generated 1807 derivative records from 50058 primary records. [2025-10-09T22:43:43.857585] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-09T22:43:43.887699] [DEBUG] [MAIN ] TYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:43.896770] [INFO ] [MAIN ] TYG: Generated 1807 derivative records from 13993 primary records. [2025-10-09T22:43:43.897362] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-09T22:43:43.924365] [DEBUG] [LOCAL ] TYG: Derivative data saved (1807 records). [2025-10-09T22:43:43.924810] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-09T22:43:43.924925] [DEBUG] [LOCAL ] TXT: Derivative data saved (1807 records). [2025-10-09T22:43:43.925140] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-09T22:43:43.928004] [INFO ] [MAIN ] Derivative Progress: 1490/1690 symbols completed. TYG took 1.0s. Estimated remaining: 1m 18s. Rate: 154.3 symbols/min [2025-10-09T22:43:43.933639] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:43.933760] [INFO ] [MAIN ] Derivative Progress: 1491/1690 symbols completed. TXT took 1.2s. Estimated remaining: 1m 17s. Rate: 154.4 symbols/min [2025-10-09T22:43:43.934065] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:43.935954] [DEBUG] [LOCAL ] TYL: Loaded 22514 existing records from primary storage. [2025-10-09T22:43:43.936256] [INFO ] [MAIN ] TYL: Loaded 22514 primary data records. [2025-10-09T22:43:44.348995] [DEBUG] [LOCAL ] UA: Loaded 50807 existing records from primary storage. [2025-10-09T22:43:44.350070] [INFO ] [MAIN ] UA: Loaded 50807 primary data records. [2025-10-09T22:43:44.351049] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-10-09T22:43:44.374713] [INFO ] [MAIN ] U: Loaded 54189 primary data records. [2025-10-09T22:43:45.049012] [DEBUG] [MAIN ] TYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:45.050485] [INFO ] [MAIN ] TYL: Generated 1807 derivative records from 22514 primary records. [2025-10-09T22:43:45.050719] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-09T22:43:45.069059] [DEBUG] [LOCAL ] TYL: Derivative data saved (1807 records). [2025-10-09T22:43:45.069432] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-09T22:43:45.071947] [INFO ] [MAIN ] Derivative Progress: 1492/1690 symbols completed. TYL took 1.2s. Estimated remaining: 1m 17s. Rate: 154.2 symbols/min [2025-10-09T22:43:45.072251] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:45.092547] [DEBUG] [MAIN ] UA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:45.094290] [INFO ] [MAIN ] UA: Generated 1807 derivative records from 50807 primary records. [2025-10-09T22:43:45.094507] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-09T22:43:45.109792] [DEBUG] [MAIN ] U: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:45.122605] [INFO ] [MAIN ] U: Generated 1807 derivative records from 54189 primary records. [2025-10-09T22:43:45.123425] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-09T22:43:45.160352] [DEBUG] [LOCAL ] U: Derivative data saved (1807 records). [2025-10-09T22:43:45.161468] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-09T22:43:45.164721] [INFO ] [MAIN ] Derivative Progress: 1493/1690 symbols completed. U took 1.2s. Estimated remaining: 1m 17s. Rate: 154.3 symbols/min [2025-10-09T22:43:45.165670] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:45.165938] [DEBUG] [LOCAL ] UA: Derivative data saved (1807 records). [2025-10-09T22:43:45.166558] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-09T22:43:45.169507] [INFO ] [MAIN ] Derivative Progress: 1494/1690 symbols completed. UA took 1.2s. Estimated remaining: 1m 16s. Rate: 154.4 symbols/min [2025-10-09T22:43:45.169862] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:45.189981] [DEBUG] [LOCAL ] UAA: Loaded 53898 existing records from primary storage. [2025-10-09T22:43:45.193738] [INFO ] [MAIN ] UAA: Loaded 53898 primary data records. [2025-10-09T22:43:45.193636] [DEBUG] [LOCAL ] UAN: Loaded 5459 existing records from primary storage. [2025-10-09T22:43:45.193920] [INFO ] [MAIN ] UAN: Loaded 5459 primary data records. [2025-10-09T22:43:45.877383] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-10-09T22:43:45.878161] [INFO ] [MAIN ] UBER: Loaded 54196 primary data records. [2025-10-09T22:43:46.254158] [DEBUG] [MAIN ] UAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:46.267897] [INFO ] [MAIN ] UAA: Generated 1807 derivative records from 53898 primary records. [2025-10-09T22:43:46.268381] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-09T22:43:46.269702] [DEBUG] [MAIN ] UAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:46.271496] [INFO ] [MAIN ] UAN: Generated 1807 derivative records from 5459 primary records. [2025-10-09T22:43:46.271968] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-09T22:43:46.300455] [DEBUG] [LOCAL ] UAA: Derivative data saved (1807 records). [2025-10-09T22:43:46.302230] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-09T22:43:46.304630] [INFO ] [MAIN ] Derivative Progress: 1495/1690 symbols completed. UAA took 1.2s. Estimated remaining: 1m 16s. Rate: 154.2 symbols/min [2025-10-09T22:43:46.305350] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:46.310290] [DEBUG] [LOCAL ] UAN: Derivative data saved (1807 records). [2025-10-09T22:43:46.312259] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-09T22:43:46.315615] [INFO ] [MAIN ] Derivative Progress: 1496/1690 symbols completed. UAN took 1.1s. Estimated remaining: 1m 15s. Rate: 154.3 symbols/min [2025-10-09T22:43:46.316045] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:46.329375] [DEBUG] [MAIN ] UBER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:46.330071] [INFO ] [MAIN ] UBER: Generated 1807 derivative records from 54196 primary records. [2025-10-09T22:43:46.330132] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-09T22:43:46.347166] [DEBUG] [LOCAL ] UBER: Derivative data saved (1807 records). [2025-10-09T22:43:46.347310] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-09T22:43:46.350135] [INFO ] [MAIN ] Derivative Progress: 1497/1690 symbols completed. UBER took 1.2s. Estimated remaining: 1m 15s. Rate: 154.4 symbols/min [2025-10-09T22:43:46.350354] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:46.384848] [DEBUG] [LOCAL ] UCB: Loaded 38026 existing records from primary storage. [2025-10-09T22:43:46.402978] [INFO ] [MAIN ] UCB: Loaded 38026 primary data records. [2025-10-09T22:43:46.606832] [DEBUG] [LOCAL ] UBS: Loaded 52720 existing records from primary storage. [2025-10-09T22:43:46.767191] [INFO ] [MAIN ] UBS: Loaded 52720 primary data records. [2025-10-09T22:43:46.769860] [DEBUG] [LOCAL ] UDR: Loaded 52279 existing records from primary storage. [2025-10-09T22:43:46.775767] [INFO ] [MAIN ] UDR: Loaded 52279 primary data records. [2025-10-09T22:43:47.475063] [DEBUG] [MAIN ] UCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:47.476988] [INFO ] [MAIN ] UCB: Generated 1807 derivative records from 38026 primary records. [2025-10-09T22:43:47.478132] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-09T22:43:47.503025] [DEBUG] [LOCAL ] UCB: Derivative data saved (1807 records). [2025-10-09T22:43:47.506604] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-09T22:43:47.509954] [INFO ] [MAIN ] Derivative Progress: 1498/1690 symbols completed. UCB took 1.2s. Estimated remaining: 1m 15s. Rate: 154.2 symbols/min [2025-10-09T22:43:47.536154] [DEBUG] [MAIN ] UBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:47.537854] [INFO ] [MAIN ] UBS: Generated 1807 derivative records from 52720 primary records. [2025-10-09T22:43:47.537950] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-09T22:43:47.536801] [DEBUG] [MAIN ] UDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:47.539150] [INFO ] [MAIN ] UDR: Generated 1807 derivative records from 52279 primary records. [2025-10-09T22:43:47.540086] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-09T22:43:47.570465] [DEBUG] [LOCAL ] UBS: Derivative data saved (1807 records). [2025-10-09T22:43:47.570870] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-09T22:43:47.573168] [INFO ] [MAIN ] Derivative Progress: 1499/1690 symbols completed. UBS took 1.3s. Estimated remaining: 1m 14s. Rate: 154.3 symbols/min [2025-10-09T22:43:47.576425] [DEBUG] [LOCAL ] UDR: Derivative data saved (1807 records). [2025-10-09T22:43:47.576553] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-09T22:43:47.580445] [INFO ] [MAIN ] Derivative Progress: 1500/1690 symbols completed. UDR took 1.2s. Estimated remaining: 1m 14s. Rate: 154.4 symbols/min [2025-10-09T22:43:47.581106] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:47.581270] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:47.581397] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:47.593379] [DEBUG] [LOCAL ] UFI: Loaded 8205 existing records from primary storage. [2025-10-09T22:43:47.593601] [INFO ] [MAIN ] UFI: Loaded 8205 primary data records. [2025-10-09T22:43:47.957235] [DEBUG] [LOCAL ] UE: Loaded 42867 existing records from primary storage. [2025-10-09T22:43:47.957488] [INFO ] [MAIN ] UE: Loaded 42867 primary data records. [2025-10-09T22:43:48.087788] [DEBUG] [LOCAL ] UGI: Loaded 50938 existing records from primary storage. [2025-10-09T22:43:48.127235] [INFO ] [MAIN ] UGI: Loaded 50938 primary data records. [2025-10-09T22:43:48.537716] [DEBUG] [MAIN ] UFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:48.580251] [INFO ] [MAIN ] UFI: Generated 1807 derivative records from 8205 primary records. [2025-10-09T22:43:48.604859] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-09T22:43:48.742281] [DEBUG] [MAIN ] UE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:48.743027] [DEBUG] [LOCAL ] UFI: Derivative data saved (1807 records). [2025-10-09T22:43:48.745585] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-09T22:43:48.745278] [INFO ] [MAIN ] UE: Generated 1807 derivative records from 42867 primary records. [2025-10-09T22:43:48.748085] [INFO ] [MAIN ] Derivative Progress: 1501/1690 symbols completed. UFI took 1.2s. Estimated remaining: 1m 14s. Rate: 154.2 symbols/min [2025-10-09T22:43:48.748569] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-09T22:43:48.749867] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:48.768454] [DEBUG] [LOCAL ] UE: Derivative data saved (1807 records). [2025-10-09T22:43:48.768852] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-09T22:43:48.772058] [INFO ] [MAIN ] Derivative Progress: 1502/1690 symbols completed. UE took 1.2s. Estimated remaining: 1m 13s. Rate: 154.3 symbols/min [2025-10-09T22:43:48.772822] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:48.790971] [DEBUG] [MAIN ] UGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:48.791993] [INFO ] [MAIN ] UGI: Generated 1807 derivative records from 50938 primary records. [2025-10-09T22:43:48.792281] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-09T22:43:48.828050] [DEBUG] [LOCAL ] UHAL: Loaded 16874 existing records from primary storage. [2025-10-09T22:43:48.829026] [INFO ] [MAIN ] UHAL: Loaded 16874 primary data records. [2025-10-09T22:43:48.947244] [DEBUG] [LOCAL ] UGP: Loaded 43221 existing records from primary storage. [2025-10-09T22:43:48.946177] [DEBUG] [LOCAL ] UGI: Derivative data saved (1807 records). [2025-10-09T22:43:48.955526] [INFO ] [MAIN ] UGP: Loaded 43221 primary data records. [2025-10-09T22:43:48.987124] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-09T22:43:49.040980] [INFO ] [MAIN ] Derivative Progress: 1503/1690 symbols completed. UGI took 1.5s. Estimated remaining: 1m 13s. Rate: 154.3 symbols/min [2025-10-09T22:43:49.115743] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:49.554208] [DEBUG] [LOCAL ] UHS: Loaded 40845 existing records from primary storage. [2025-10-09T22:43:49.554581] [INFO ] [MAIN ] UHS: Loaded 40845 primary data records. [2025-10-09T22:43:49.551272] [DEBUG] [MAIN ] UHAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:49.556036] [INFO ] [MAIN ] UHAL: Generated 1807 derivative records from 16874 primary records. [2025-10-09T22:43:49.567898] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-09T22:43:49.687785] [DEBUG] [MAIN ] UGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:49.694199] [INFO ] [MAIN ] UGP: Generated 1807 derivative records from 43221 primary records. [2025-10-09T22:43:49.710972] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-09T22:43:49.913774] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1807 records). [2025-10-09T22:43:49.917903] [DEBUG] [LOCAL ] UGP: Derivative data saved (1807 records). [2025-10-09T22:43:49.918478] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-09T22:43:49.918566] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-09T22:43:49.920797] [INFO ] [MAIN ] Derivative Progress: 1504/1690 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 12s. Rate: 154.2 symbols/min [2025-10-09T22:43:49.924335] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:49.924826] [INFO ] [MAIN ] Derivative Progress: 1505/1690 symbols completed. UGP took 1.2s. Estimated remaining: 1m 12s. Rate: 154.3 symbols/min [2025-10-09T22:43:49.925405] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:49.944020] [DEBUG] [LOCAL ] UHT: Loaded 10086 existing records from primary storage. [2025-10-09T22:43:49.944417] [INFO ] [MAIN ] UHT: Loaded 10086 primary data records. [2025-10-09T22:43:50.020079] [DEBUG] [LOCAL ] UI: Loaded 13490 existing records from primary storage. [2025-10-09T22:43:50.037211] [INFO ] [MAIN ] UI: Loaded 13490 primary data records. [2025-10-09T22:43:50.246846] [DEBUG] [MAIN ] UHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:50.416308] [INFO ] [MAIN ] UHS: Generated 1807 derivative records from 40845 primary records. [2025-10-09T22:43:50.422766] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-09T22:43:50.659404] [DEBUG] [LOCAL ] UHS: Derivative data saved (1807 records). [2025-10-09T22:43:50.659589] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-09T22:43:50.662226] [INFO ] [MAIN ] Derivative Progress: 1506/1690 symbols completed. UHS took 1.5s. Estimated remaining: 1m 12s. Rate: 154.2 symbols/min [2025-10-09T22:43:50.663112] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:50.686051] [DEBUG] [MAIN ] UHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:50.687226] [INFO ] [MAIN ] UHT: Generated 1807 derivative records from 10086 primary records. [2025-10-09T22:43:50.687475] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-09T22:43:50.715186] [DEBUG] [LOCAL ] UHT: Derivative data saved (1807 records). [2025-10-09T22:43:50.715599] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-09T22:43:50.717908] [INFO ] [MAIN ] Derivative Progress: 1507/1690 symbols completed. UHT took 0.8s. Estimated remaining: 1m 11s. Rate: 154.3 symbols/min [2025-10-09T22:43:50.725779] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:50.731475] [DEBUG] [MAIN ] UI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:50.732194] [INFO ] [MAIN ] UI: Generated 1807 derivative records from 13490 primary records. [2025-10-09T22:43:50.732310] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-09T22:43:50.758763] [DEBUG] [LOCAL ] UIS: Loaded 37228 existing records from primary storage. [2025-10-09T22:43:50.760191] [INFO ] [MAIN ] UIS: Loaded 37228 primary data records. [2025-10-09T22:43:50.793692] [DEBUG] [LOCAL ] UI: Derivative data saved (1807 records). [2025-10-09T22:43:50.806112] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-09T22:43:50.836565] [INFO ] [MAIN ] Derivative Progress: 1508/1690 symbols completed. UI took 0.9s. Estimated remaining: 1m 11s. Rate: 154.3 symbols/min [2025-10-09T22:43:50.877115] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:51.089536] [DEBUG] [LOCAL ] ULS: Loaded 39657 existing records from primary storage. [2025-10-09T22:43:51.090549] [INFO ] [MAIN ] ULS: Loaded 39657 primary data records. [2025-10-09T22:43:51.456789] [DEBUG] [LOCAL ] UMC: Loaded 53076 existing records from primary storage. [2025-10-09T22:43:51.457582] [INFO ] [MAIN ] UMC: Loaded 53076 primary data records. [2025-10-09T22:43:51.668188] [DEBUG] [MAIN ] UIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:51.781561] [INFO ] [MAIN ] UIS: Generated 1807 derivative records from 37228 primary records. [2025-10-09T22:43:51.792246] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-09T22:43:51.815661] [DEBUG] [LOCAL ] UIS: Derivative data saved (1807 records). [2025-10-09T22:43:51.828337] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-09T22:43:51.830683] [INFO ] [MAIN ] Derivative Progress: 1509/1690 symbols completed. UIS took 1.2s. Estimated remaining: 1m 10s. Rate: 154.2 symbols/min [2025-10-09T22:43:51.831101] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:51.832050] [DEBUG] [MAIN ] ULS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:51.834332] [INFO ] [MAIN ] ULS: Generated 1807 derivative records from 39657 primary records. [2025-10-09T22:43:51.834564] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-09T22:43:51.851894] [DEBUG] [LOCAL ] ULS: Derivative data saved (1807 records). [2025-10-09T22:43:51.852115] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-09T22:43:51.854552] [INFO ] [MAIN ] Derivative Progress: 1510/1690 symbols completed. ULS took 1.1s. Estimated remaining: 1m 10s. Rate: 154.3 symbols/min [2025-10-09T22:43:51.854925] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:51.873486] [DEBUG] [MAIN ] UMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:51.874275] [INFO ] [MAIN ] UMC: Generated 1807 derivative records from 53076 primary records. [2025-10-09T22:43:51.877340] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-09T22:43:51.904905] [DEBUG] [LOCAL ] UNF: Loaded 12201 existing records from primary storage. [2025-10-09T22:43:51.915778] [INFO ] [MAIN ] UNF: Loaded 12201 primary data records. [2025-10-09T22:43:51.962088] [DEBUG] [LOCAL ] UMH: Loaded 34107 existing records from primary storage. [2025-10-09T22:43:51.974454] [DEBUG] [LOCAL ] UMC: Derivative data saved (1807 records). [2025-10-09T22:43:51.974771] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-09T22:43:51.988578] [INFO ] [MAIN ] UMH: Loaded 34107 primary data records. [2025-10-09T22:43:51.991755] [INFO ] [MAIN ] Derivative Progress: 1511/1690 symbols completed. UMC took 1.1s. Estimated remaining: 1m 10s. Rate: 154.3 symbols/min [2025-10-09T22:43:52.026806] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:52.614882] [DEBUG] [LOCAL ] UNFI: Loaded 42684 existing records from primary storage. [2025-10-09T22:43:52.615352] [INFO ] [MAIN ] UNFI: Loaded 42684 primary data records. [2025-10-09T22:43:52.961145] [DEBUG] [MAIN ] UNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:52.962853] [INFO ] [MAIN ] UNF: Generated 1807 derivative records from 12201 primary records. [2025-10-09T22:43:52.963499] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-09T22:43:53.000280] [DEBUG] [LOCAL ] UNF: Derivative data saved (1807 records). [2025-10-09T22:43:52.999853] [DEBUG] [MAIN ] UMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:53.000617] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-09T22:43:53.001323] [INFO ] [MAIN ] UMH: Generated 1807 derivative records from 34107 primary records. [2025-10-09T22:43:53.003780] [INFO ] [MAIN ] Derivative Progress: 1512/1690 symbols completed. UNF took 1.1s. Estimated remaining: 1m 9s. Rate: 154.2 symbols/min [2025-10-09T22:43:53.004190] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-09T22:43:53.004108] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:53.022164] [DEBUG] [LOCAL ] UMH: Derivative data saved (1807 records). [2025-10-09T22:43:53.023221] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-09T22:43:53.026701] [INFO ] [MAIN ] Derivative Progress: 1513/1690 symbols completed. UMH took 1.2s. Estimated remaining: 1m 9s. Rate: 154.3 symbols/min [2025-10-09T22:43:53.041222] [DEBUG] [MAIN ] UNFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:53.041963] [INFO ] [MAIN ] UNFI: Generated 1807 derivative records from 42684 primary records. [2025-10-09T22:43:53.042026] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-09T22:43:53.058742] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1807 records). [2025-10-09T22:43:53.058829] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-09T22:43:53.061286] [INFO ] [MAIN ] Derivative Progress: 1514/1690 symbols completed. UNFI took 1.0s. Estimated remaining: 1m 8s. Rate: 154.4 symbols/min [2025-10-09T22:43:53.102945] [DEBUG] [LOCAL ] UNH: Loaded 54193 existing records from primary storage. [2025-10-09T22:43:53.103105] [INFO ] [MAIN ] UNH: Loaded 54193 primary data records. [2025-10-09T22:43:53.426163] [DEBUG] [MAIN ] UNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:53.426842] [INFO ] [MAIN ] UNH: Generated 1807 derivative records from 54193 primary records. [2025-10-09T22:43:53.426905] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-09T22:43:53.443329] [DEBUG] [LOCAL ] UNH: Derivative data saved (1807 records). [2025-10-09T22:43:53.443418] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-09T22:43:53.445578] [INFO ] [MAIN ] Derivative Progress: 1515/1690 symbols completed. UNH took 0.4s. Estimated remaining: 1m 8s. Rate: 154.4 symbols/min [2025-10-09T22:43:53.446414] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:53.446834] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:53.446728] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:53.458533] [DEBUG] [LOCAL ] UNMA: Loaded 3567 existing records from primary storage. [2025-10-09T22:43:53.458875] [INFO ] [MAIN ] UNMA: Loaded 3567 primary data records. [2025-10-09T22:43:53.838691] [DEBUG] [LOCAL ] UNM: Loaded 48566 existing records from primary storage. [2025-10-09T22:43:53.839674] [INFO ] [MAIN ] UNM: Loaded 48566 primary data records. [2025-10-09T22:43:53.839531] [DEBUG] [LOCAL ] UNP: Loaded 53694 existing records from primary storage. [2025-10-09T22:43:53.861057] [INFO ] [MAIN ] UNP: Loaded 53694 primary data records. [2025-10-09T22:43:54.535008] [DEBUG] [MAIN ] UNMA: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-10-09T22:43:54.536326] [INFO ] [MAIN ] UNMA: Generated 1805 derivative records from 3567 primary records. [2025-10-09T22:43:54.536458] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-09T22:43:54.557367] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1805 records). [2025-10-09T22:43:54.557630] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-09T22:43:54.560046] [INFO ] [MAIN ] Derivative Progress: 1516/1690 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 8s. Rate: 154.2 symbols/min [2025-10-09T22:43:54.560503] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:54.575048] [DEBUG] [MAIN ] UNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:54.576303] [INFO ] [MAIN ] UNP: Generated 1807 derivative records from 53694 primary records. [2025-10-09T22:43:54.576749] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-09T22:43:54.605274] [DEBUG] [LOCAL ] UNP: Derivative data saved (1807 records). [2025-10-09T22:43:54.611091] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-09T22:43:54.611003] [DEBUG] [MAIN ] UNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:54.614376] [INFO ] [MAIN ] UNM: Generated 1807 derivative records from 48566 primary records. [2025-10-09T22:43:54.614563] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-09T22:43:54.613322] [INFO ] [MAIN ] Derivative Progress: 1517/1690 symbols completed. UNP took 1.2s. Estimated remaining: 1m 7s. Rate: 154.3 symbols/min [2025-10-09T22:43:54.615577] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:54.645495] [DEBUG] [LOCAL ] UNM: Derivative data saved (1807 records). [2025-10-09T22:43:54.645691] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-09T22:43:54.648637] [INFO ] [MAIN ] Derivative Progress: 1518/1690 symbols completed. UNM took 1.2s. Estimated remaining: 1m 7s. Rate: 154.3 symbols/min [2025-10-09T22:43:54.648988] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:54.664906] [DEBUG] [LOCAL ] UP: Loaded 44091 existing records from primary storage. [2025-10-09T22:43:54.665056] [INFO ] [MAIN ] UP: Loaded 44091 primary data records. [2025-10-09T22:43:55.013058] [DEBUG] [LOCAL ] UPS: Loaded 54107 existing records from primary storage. [2025-10-09T22:43:55.014610] [INFO ] [MAIN ] UPS: Loaded 54107 primary data records. [2025-10-09T22:43:55.015451] [DEBUG] [LOCAL ] URI: Loaded 35396 existing records from primary storage. [2025-10-09T22:43:55.021933] [INFO ] [MAIN ] URI: Loaded 35396 primary data records. [2025-10-09T22:43:55.748864] [DEBUG] [MAIN ] UP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:55.750271] [INFO ] [MAIN ] UP: Generated 1807 derivative records from 44091 primary records. [2025-10-09T22:43:55.751150] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-09T22:43:55.775740] [DEBUG] [LOCAL ] UP: Derivative data saved (1807 records). [2025-10-09T22:43:55.776133] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-09T22:43:55.778946] [INFO ] [MAIN ] Derivative Progress: 1519/1690 symbols completed. UP took 1.2s. Estimated remaining: 1m 7s. Rate: 154.2 symbols/min [2025-10-09T22:43:55.779465] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:55.800766] [DEBUG] [MAIN ] URI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:55.801978] [INFO ] [MAIN ] URI: Generated 1807 derivative records from 35396 primary records. [2025-10-09T22:43:55.803072] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-09T22:43:55.834840] [DEBUG] [MAIN ] UPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:55.839499] [INFO ] [MAIN ] UPS: Generated 1807 derivative records from 54107 primary records. [2025-10-09T22:43:55.838093] [DEBUG] [LOCAL ] URI: Derivative data saved (1807 records). [2025-10-09T22:43:55.839818] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-09T22:43:55.839767] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-09T22:43:55.843713] [INFO ] [MAIN ] Derivative Progress: 1520/1690 symbols completed. URI took 1.2s. Estimated remaining: 1m 6s. Rate: 154.2 symbols/min [2025-10-09T22:43:55.845006] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:55.874813] [DEBUG] [LOCAL ] UPS: Derivative data saved (1807 records). [2025-10-09T22:43:55.886203] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-09T22:43:55.886980] [DEBUG] [LOCAL ] USA: Loaded 36317 existing records from primary storage. [2025-10-09T22:43:55.887241] [INFO ] [MAIN ] USA: Loaded 36317 primary data records. [2025-10-09T22:43:55.894860] [INFO ] [MAIN ] Derivative Progress: 1521/1690 symbols completed. UPS took 1.3s. Estimated remaining: 1m 6s. Rate: 154.3 symbols/min [2025-10-09T22:43:55.917851] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:56.022718] [DEBUG] [LOCAL ] USAC: Loaded 21710 existing records from primary storage. [2025-10-09T22:43:56.023570] [INFO ] [MAIN ] USAC: Loaded 21710 primary data records. [2025-10-09T22:43:56.578252] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-10-09T22:43:56.657694] [INFO ] [MAIN ] USB: Loaded 54078 primary data records. [2025-10-09T22:43:57.006181] [DEBUG] [MAIN ] USA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:57.007809] [INFO ] [MAIN ] USA: Generated 1807 derivative records from 36317 primary records. [2025-10-09T22:43:57.007928] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-09T22:43:57.034527] [DEBUG] [LOCAL ] USA: Derivative data saved (1807 records). [2025-10-09T22:43:57.035717] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-09T22:43:57.039560] [INFO ] [MAIN ] Derivative Progress: 1522/1690 symbols completed. USA took 1.3s. Estimated remaining: 1m 5s. Rate: 154.1 symbols/min [2025-10-09T22:43:57.040382] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:57.055186] [DEBUG] [MAIN ] USAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:57.057535] [INFO ] [MAIN ] USAC: Generated 1807 derivative records from 21710 primary records. [2025-10-09T22:43:57.057862] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-09T22:43:57.076592] [DEBUG] [LOCAL ] USAC: Derivative data saved (1807 records). [2025-10-09T22:43:57.077009] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-09T22:43:57.080263] [INFO ] [MAIN ] Derivative Progress: 1523/1690 symbols completed. USAC took 1.2s. Estimated remaining: 1m 5s. Rate: 154.2 symbols/min [2025-10-09T22:43:57.080619] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:57.099805] [DEBUG] [MAIN ] USB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:57.104795] [INFO ] [MAIN ] USB: Generated 1807 derivative records from 54078 primary records. [2025-10-09T22:43:57.104883] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-09T22:43:57.149715] [DEBUG] [LOCAL ] USB: Derivative data saved (1807 records). [2025-10-09T22:43:57.149052] [DEBUG] [LOCAL ] USNA: Loaded 17770 existing records from primary storage. [2025-10-09T22:43:57.150206] [INFO ] [MAIN ] USNA: Loaded 17770 primary data records. [2025-10-09T22:43:57.150110] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-09T22:43:57.152554] [INFO ] [MAIN ] Derivative Progress: 1524/1690 symbols completed. USB took 1.2s. Estimated remaining: 1m 5s. Rate: 154.3 symbols/min [2025-10-09T22:43:57.200777] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:57.280402] [DEBUG] [LOCAL ] USFD: Loaded 51527 existing records from primary storage. [2025-10-09T22:43:57.286220] [INFO ] [MAIN ] USFD: Loaded 51527 primary data records. [2025-10-09T22:43:57.694020] [DEBUG] [LOCAL ] USPH: Loaded 17114 existing records from primary storage. [2025-10-09T22:43:57.701042] [INFO ] [MAIN ] USPH: Loaded 17114 primary data records. [2025-10-09T22:43:58.196494] [DEBUG] [MAIN ] USNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:58.198535] [INFO ] [MAIN ] USNA: Generated 1807 derivative records from 17770 primary records. [2025-10-09T22:43:58.207833] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-09T22:43:58.214506] [DEBUG] [MAIN ] USFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:58.215974] [INFO ] [MAIN ] USFD: Generated 1807 derivative records from 51527 primary records. [2025-10-09T22:43:58.225369] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-09T22:43:58.245850] [DEBUG] [LOCAL ] USNA: Derivative data saved (1807 records). [2025-10-09T22:43:58.248570] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-09T22:43:58.251490] [INFO ] [MAIN ] Derivative Progress: 1525/1690 symbols completed. USNA took 1.2s. Estimated remaining: 1m 4s. Rate: 154.1 symbols/min [2025-10-09T22:43:58.252938] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:58.255591] [DEBUG] [LOCAL ] USFD: Derivative data saved (1807 records). [2025-10-09T22:43:58.255778] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-09T22:43:58.258259] [INFO ] [MAIN ] Derivative Progress: 1526/1690 symbols completed. USFD took 1.2s. Estimated remaining: 1m 4s. Rate: 154.2 symbols/min [2025-10-09T22:43:58.258688] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:58.279004] [DEBUG] [MAIN ] USPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:58.280116] [INFO ] [MAIN ] USPH: Generated 1807 derivative records from 17114 primary records. [2025-10-09T22:43:58.280569] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-09T22:43:58.310535] [DEBUG] [LOCAL ] USPH: Derivative data saved (1807 records). [2025-10-09T22:43:58.310738] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-09T22:43:58.313444] [INFO ] [MAIN ] Derivative Progress: 1527/1690 symbols completed. USPH took 1.1s. Estimated remaining: 1m 3s. Rate: 154.3 symbols/min [2025-10-09T22:43:58.314396] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:58.325242] [DEBUG] [LOCAL ] UTF: Loaded 30516 existing records from primary storage. [2025-10-09T22:43:58.325513] [INFO ] [MAIN ] UTF: Loaded 30516 primary data records. [2025-10-09T22:43:58.490441] [DEBUG] [LOCAL ] UTL: Loaded 11697 existing records from primary storage. [2025-10-09T22:43:58.524877] [INFO ] [MAIN ] UTL: Loaded 11697 primary data records. [2025-10-09T22:43:58.546396] [DEBUG] [LOCAL ] UTI: Loaded 40842 existing records from primary storage. [2025-10-09T22:43:58.571437] [INFO ] [MAIN ] UTI: Loaded 40842 primary data records. [2025-10-09T22:43:59.361114] [DEBUG] [MAIN ] UTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:59.362511] [INFO ] [MAIN ] UTF: Generated 1807 derivative records from 30516 primary records. [2025-10-09T22:43:59.363244] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-09T22:43:59.382582] [DEBUG] [LOCAL ] UTF: Derivative data saved (1807 records). [2025-10-09T22:43:59.382944] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-09T22:43:59.385167] [INFO ] [MAIN ] Derivative Progress: 1528/1690 symbols completed. UTF took 1.1s. Estimated remaining: 1m 3s. Rate: 154.1 symbols/min [2025-10-09T22:43:59.406274] [DEBUG] [MAIN ] UTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:59.419566] [INFO ] [MAIN ] UTI: Generated 1807 derivative records from 40842 primary records. [2025-10-09T22:43:59.419712] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-09T22:43:59.421600] [DEBUG] [MAIN ] UTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:43:59.422921] [INFO ] [MAIN ] UTL: Generated 1807 derivative records from 11697 primary records. [2025-10-09T22:43:59.430303] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-09T22:43:59.439757] [DEBUG] [LOCAL ] UTI: Derivative data saved (1807 records). [2025-10-09T22:43:59.448037] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-09T22:43:59.456544] [INFO ] [MAIN ] Derivative Progress: 1529/1690 symbols completed. UTI took 1.2s. Estimated remaining: 1m 3s. Rate: 154.2 symbols/min [2025-10-09T22:43:59.461315] [DEBUG] [LOCAL ] UTL: Derivative data saved (1807 records). [2025-10-09T22:43:59.461448] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-09T22:43:59.463850] [INFO ] [MAIN ] Derivative Progress: 1530/1690 symbols completed. UTL took 1.1s. Estimated remaining: 1m 2s. Rate: 154.3 symbols/min [2025-10-09T22:43:59.464541] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:59.464719] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:59.464876] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:43:59.505418] [DEBUG] [LOCAL ] UVV: Loaded 22860 existing records from primary storage. [2025-10-09T22:43:59.506080] [DEBUG] [LOCAL ] UVE: Loaded 22004 existing records from primary storage. [2025-10-09T22:43:59.506577] [INFO ] [MAIN ] UVE: Loaded 22004 primary data records. [2025-10-09T22:43:59.506483] [INFO ] [MAIN ] UVV: Loaded 22860 primary data records. [2025-10-09T22:43:59.776464] [DEBUG] [LOCAL ] UTZ: Loaded 44883 existing records from primary storage. [2025-10-09T22:43:59.805798] [INFO ] [MAIN ] UTZ: Loaded 44883 primary data records. [2025-10-09T22:44:00.507625] [DEBUG] [MAIN ] UVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:00.508886] [INFO ] [MAIN ] UVV: Generated 1807 derivative records from 22860 primary records. [2025-10-09T22:44:00.509126] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-09T22:44:00.544105] [DEBUG] [MAIN ] UVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:00.543237] [DEBUG] [LOCAL ] UVV: Derivative data saved (1807 records). [2025-10-09T22:44:00.545917] [INFO ] [MAIN ] UVE: Generated 1807 derivative records from 22004 primary records. [2025-10-09T22:44:00.546833] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-09T22:44:00.546628] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-09T22:44:00.550082] [INFO ] [MAIN ] Derivative Progress: 1531/1690 symbols completed. UVV took 1.1s. Estimated remaining: 1m 2s. Rate: 154.1 symbols/min [2025-10-09T22:44:00.558367] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:00.575867] [DEBUG] [MAIN ] UTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:00.577878] [INFO ] [MAIN ] UTZ: Generated 1807 derivative records from 44883 primary records. [2025-10-09T22:44:00.578683] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-09T22:44:00.581807] [DEBUG] [LOCAL ] UVE: Derivative data saved (1807 records). [2025-10-09T22:44:00.582094] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-09T22:44:00.591992] [INFO ] [MAIN ] Derivative Progress: 1532/1690 symbols completed. UVE took 1.1s. Estimated remaining: 1m 1s. Rate: 154.2 symbols/min [2025-10-09T22:44:00.593691] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:00.601520] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1807 records). [2025-10-09T22:44:00.601989] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-09T22:44:00.605358] [INFO ] [MAIN ] Derivative Progress: 1533/1690 symbols completed. UTZ took 1.1s. Estimated remaining: 1m 1s. Rate: 154.3 symbols/min [2025-10-09T22:44:00.605792] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:00.613139] [DEBUG] [LOCAL ] UZD: Loaded 6439 existing records from primary storage. [2025-10-09T22:44:00.613806] [INFO ] [MAIN ] UZD: Loaded 6439 primary data records. [2025-10-09T22:44:00.723384] [DEBUG] [LOCAL ] UZE: Loaded 7495 existing records from primary storage. [2025-10-09T22:44:00.741898] [INFO ] [MAIN ] UZE: Loaded 7495 primary data records. [2025-10-09T22:44:00.881903] [DEBUG] [LOCAL ] UWMC: Loaded 53243 existing records from primary storage. [2025-10-09T22:44:00.947211] [INFO ] [MAIN ] UWMC: Loaded 53243 primary data records. [2025-10-09T22:44:01.670420] [DEBUG] [MAIN ] UZD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:01.671584] [INFO ] [MAIN ] UZD: Generated 1807 derivative records from 6439 primary records. [2025-10-09T22:44:01.671727] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-09T22:44:01.699942] [DEBUG] [LOCAL ] UZD: Derivative data saved (1807 records). [2025-10-09T22:44:01.706100] [DEBUG] [MAIN ] UZE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:01.707138] [INFO ] [MAIN ] UZE: Generated 1807 derivative records from 7495 primary records. [2025-10-09T22:44:01.705755] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-09T22:44:01.707719] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-09T22:44:01.710318] [INFO ] [MAIN ] Derivative Progress: 1534/1690 symbols completed. UZD took 1.1s. Estimated remaining: 1m 1s. Rate: 154.1 symbols/min [2025-10-09T22:44:01.711681] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:01.738284] [DEBUG] [LOCAL ] UZE: Derivative data saved (1807 records). [2025-10-09T22:44:01.742684] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-09T22:44:01.745831] [INFO ] [MAIN ] Derivative Progress: 1535/1690 symbols completed. UZE took 1.1s. Estimated remaining: 1m 0s. Rate: 154.2 symbols/min [2025-10-09T22:44:01.746238] [DEBUG] [MAIN ] UWMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:01.746487] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:01.747417] [INFO ] [MAIN ] UWMC: Generated 1807 derivative records from 53243 primary records. [2025-10-09T22:44:01.749618] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-09T22:44:01.766698] [DEBUG] [LOCAL ] UZF: Loaded 6371 existing records from primary storage. [2025-10-09T22:44:01.769519] [INFO ] [MAIN ] UZF: Loaded 6371 primary data records. [2025-10-09T22:44:01.811184] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1807 records). [2025-10-09T22:44:01.832619] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-09T22:44:01.874765] [INFO ] [MAIN ] Derivative Progress: 1536/1690 symbols completed. UWMC took 1.3s. Estimated remaining: 59.9s. Rate: 154.3 symbols/min [2025-10-09T22:44:01.887056] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:02.123345] [DEBUG] [LOCAL ] V: Loaded 54142 existing records from primary storage. [2025-10-09T22:44:02.124604] [INFO ] [MAIN ] V: Loaded 54142 primary data records. [2025-10-09T22:44:02.251152] [DEBUG] [LOCAL ] VAC: Loaded 34438 existing records from primary storage. [2025-10-09T22:44:02.267739] [INFO ] [MAIN ] VAC: Loaded 34438 primary data records. [2025-10-09T22:44:02.837578] [DEBUG] [MAIN ] UZF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:02.838519] [INFO ] [MAIN ] UZF: Generated 1807 derivative records from 6371 primary records. [2025-10-09T22:44:02.838830] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-09T22:44:02.859280] [DEBUG] [LOCAL ] UZF: Derivative data saved (1807 records). [2025-10-09T22:44:02.860297] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-09T22:44:02.863053] [INFO ] [MAIN ] Derivative Progress: 1537/1690 symbols completed. UZF took 1.2s. Estimated remaining: 59.6s. Rate: 154.1 symbols/min [2025-10-09T22:44:02.863217] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:02.895790] [DEBUG] [MAIN ] V: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:02.897907] [INFO ] [MAIN ] V: Generated 1807 derivative records from 54142 primary records. [2025-10-09T22:44:02.898022] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-09T22:44:02.924483] [DEBUG] [MAIN ] VAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:02.932209] [INFO ] [MAIN ] VAC: Generated 1807 derivative records from 34438 primary records. [2025-10-09T22:44:02.932291] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-09T22:44:02.960201] [DEBUG] [LOCAL ] V: Derivative data saved (1807 records). [2025-10-09T22:44:02.964259] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-09T22:44:02.968396] [INFO ] [MAIN ] Derivative Progress: 1538/1690 symbols completed. V took 1.2s. Estimated remaining: 59.1s. Rate: 154.2 symbols/min [2025-10-09T22:44:02.970420] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:02.973398] [DEBUG] [LOCAL ] VAC: Derivative data saved (1807 records). [2025-10-09T22:44:02.987460] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-09T22:44:02.990106] [INFO ] [MAIN ] Derivative Progress: 1539/1690 symbols completed. VAC took 1.1s. Estimated remaining: 58.7s. Rate: 154.3 symbols/min [2025-10-09T22:44:02.990741] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:02.992514] [DEBUG] [LOCAL ] VAL: Loaded 50558 existing records from primary storage. [2025-10-09T22:44:02.992716] [INFO ] [MAIN ] VAL: Loaded 50558 primary data records. [2025-10-09T22:44:03.101461] [DEBUG] [LOCAL ] VATE: Loaded 5295 existing records from primary storage. [2025-10-09T22:44:03.101780] [INFO ] [MAIN ] VATE: Loaded 5295 primary data records. [2025-10-09T22:44:03.634363] [DEBUG] [LOCAL ] VALE: Loaded 54083 existing records from primary storage. [2025-10-09T22:44:03.635444] [INFO ] [MAIN ] VALE: Loaded 54083 primary data records. [2025-10-09T22:44:03.966179] [DEBUG] [MAIN ] VAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:03.969530] [INFO ] [MAIN ] VAL: Generated 1807 derivative records from 50558 primary records. [2025-10-09T22:44:03.969880] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-09T22:44:03.998116] [DEBUG] [MAIN ] VATE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:04.007045] [INFO ] [MAIN ] VATE: Generated 1807 derivative records from 5295 primary records. [2025-10-09T22:44:04.006141] [DEBUG] [LOCAL ] VAL: Derivative data saved (1807 records). [2025-10-09T22:44:04.007308] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-09T22:44:04.011072] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-09T22:44:04.010949] [INFO ] [MAIN ] Derivative Progress: 1540/1690 symbols completed. VAL took 1.1s. Estimated remaining: 58.4s. Rate: 154.1 symbols/min [2025-10-09T22:44:04.012614] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:04.029183] [DEBUG] [LOCAL ] VATE: Derivative data saved (1807 records). [2025-10-09T22:44:04.030336] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-09T22:44:04.033008] [INFO ] [MAIN ] Derivative Progress: 1541/1690 symbols completed. VATE took 1.0s. Estimated remaining: 58.0s. Rate: 154.2 symbols/min [2025-10-09T22:44:04.033720] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:04.047437] [DEBUG] [MAIN ] VALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:04.048274] [INFO ] [MAIN ] VALE: Generated 1807 derivative records from 54083 primary records. [2025-10-09T22:44:04.048467] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-09T22:44:04.071223] [DEBUG] [LOCAL ] VALE: Derivative data saved (1807 records). [2025-10-09T22:44:04.075068] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-09T22:44:04.077813] [INFO ] [MAIN ] Derivative Progress: 1542/1690 symbols completed. VALE took 1.1s. Estimated remaining: 57.5s. Rate: 154.3 symbols/min [2025-10-09T22:44:04.078214] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:04.074934] [DEBUG] [LOCAL ] VBF: Loaded 7049 existing records from primary storage. [2025-10-09T22:44:04.083628] [DEBUG] [LOCAL ] VCV: Loaded 13626 existing records from primary storage. [2025-10-09T22:44:04.084185] [INFO ] [MAIN ] VBF: Loaded 7049 primary data records. [2025-10-09T22:44:04.095803] [INFO ] [MAIN ] VCV: Loaded 13626 primary data records. [2025-10-09T22:44:04.772102] [DEBUG] [LOCAL ] VEEV: Loaded 47509 existing records from primary storage. [2025-10-09T22:44:04.774158] [INFO ] [MAIN ] VEEV: Loaded 47509 primary data records. [2025-10-09T22:44:05.114924] [DEBUG] [MAIN ] VCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:05.122041] [INFO ] [MAIN ] VCV: Generated 1807 derivative records from 13626 primary records. [2025-10-09T22:44:05.120876] [DEBUG] [MAIN ] VBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:05.122855] [INFO ] [MAIN ] VBF: Generated 1807 derivative records from 7049 primary records. [2025-10-09T22:44:05.123008] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-09T22:44:05.122966] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-09T22:44:05.157076] [DEBUG] [LOCAL ] VCV: Derivative data saved (1807 records). [2025-10-09T22:44:05.155935] [DEBUG] [LOCAL ] VBF: Derivative data saved (1807 records). [2025-10-09T22:44:05.157324] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-09T22:44:05.160209] [INFO ] [MAIN ] Derivative Progress: 1543/1690 symbols completed. VCV took 1.1s. Estimated remaining: 57.2s. Rate: 154.1 symbols/min [2025-10-09T22:44:05.157249] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-09T22:44:05.163284] [INFO ] [MAIN ] Derivative Progress: 1544/1690 symbols completed. VBF took 1.2s. Estimated remaining: 56.8s. Rate: 154.2 symbols/min [2025-10-09T22:44:05.180717] [DEBUG] [MAIN ] VEEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:05.181275] [INFO ] [MAIN ] VEEV: Generated 1807 derivative records from 47509 primary records. [2025-10-09T22:44:05.181380] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-09T22:44:05.197273] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1807 records). [2025-10-09T22:44:05.197340] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-09T22:44:05.199564] [INFO ] [MAIN ] Derivative Progress: 1545/1690 symbols completed. VEEV took 1.1s. Estimated remaining: 56.4s. Rate: 154.3 symbols/min [2025-10-09T22:44:05.200051] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:05.199963] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:05.200692] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:05.217051] [DEBUG] [LOCAL ] VEL: Loaded 12524 existing records from primary storage. [2025-10-09T22:44:05.217279] [INFO ] [MAIN ] VEL: Loaded 12524 primary data records. [2025-10-09T22:44:05.597631] [DEBUG] [LOCAL ] VET: Loaded 44339 existing records from primary storage. [2025-10-09T22:44:05.598479] [INFO ] [MAIN ] VET: Loaded 44339 primary data records. [2025-10-09T22:44:05.599311] [DEBUG] [LOCAL ] VFC: Loaded 53997 existing records from primary storage. [2025-10-09T22:44:05.627005] [INFO ] [MAIN ] VFC: Loaded 53997 primary data records. [2025-10-09T22:44:06.244039] [DEBUG] [MAIN ] VEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:06.245489] [INFO ] [MAIN ] VEL: Generated 1807 derivative records from 12524 primary records. [2025-10-09T22:44:06.245841] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-09T22:44:06.264481] [DEBUG] [LOCAL ] VEL: Derivative data saved (1807 records). [2025-10-09T22:44:06.265057] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-09T22:44:06.267750] [INFO ] [MAIN ] Derivative Progress: 1546/1690 symbols completed. VEL took 1.1s. Estimated remaining: 56.0s. Rate: 154.2 symbols/min [2025-10-09T22:44:06.267935] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:06.288135] [DEBUG] [MAIN ] VET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:06.289845] [INFO ] [MAIN ] VET: Generated 1807 derivative records from 44339 primary records. [2025-10-09T22:44:06.290860] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-09T22:44:06.302281] [DEBUG] [LOCAL ] VGI: Loaded 5227 existing records from primary storage. [2025-10-09T22:44:06.317276] [INFO ] [MAIN ] VGI: Loaded 5227 primary data records. [2025-10-09T22:44:06.355707] [DEBUG] [MAIN ] VFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:06.375189] [INFO ] [MAIN ] VFC: Generated 1807 derivative records from 53997 primary records. [2025-10-09T22:44:06.384157] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-09T22:44:06.426043] [DEBUG] [LOCAL ] VET: Derivative data saved (1807 records). [2025-10-09T22:44:06.437675] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-09T22:44:06.440437] [INFO ] [MAIN ] Derivative Progress: 1547/1690 symbols completed. VET took 1.2s. Estimated remaining: 55.6s. Rate: 154.2 symbols/min [2025-10-09T22:44:06.440918] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:06.676441] [DEBUG] [LOCAL ] VFC: Derivative data saved (1807 records). [2025-10-09T22:44:06.681091] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-09T22:44:06.684417] [INFO ] [MAIN ] Derivative Progress: 1548/1690 symbols completed. VFC took 1.5s. Estimated remaining: 55.2s. Rate: 154.3 symbols/min [2025-10-09T22:44:06.685359] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:06.694608] [DEBUG] [LOCAL ] VGM: Loaded 18599 existing records from primary storage. [2025-10-09T22:44:06.696151] [INFO ] [MAIN ] VGM: Loaded 18599 primary data records. [2025-10-09T22:44:06.742186] [DEBUG] [LOCAL ] VHI: Loaded 2752 existing records from primary storage. [2025-10-09T22:44:06.763465] [INFO ] [MAIN ] VHI: Loaded 2752 primary data records. [2025-10-09T22:44:07.241018] [DEBUG] [MAIN ] VGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:07.326289] [INFO ] [MAIN ] VGI: Generated 1807 derivative records from 5227 primary records. [2025-10-09T22:44:07.326605] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-09T22:44:07.348284] [DEBUG] [LOCAL ] VGI: Derivative data saved (1807 records). [2025-10-09T22:44:07.348757] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-09T22:44:07.350878] [INFO ] [MAIN ] Derivative Progress: 1549/1690 symbols completed. VGI took 1.1s. Estimated remaining: 54.9s. Rate: 154.2 symbols/min [2025-10-09T22:44:07.351310] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:07.373725] [DEBUG] [MAIN ] VGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:07.375444] [INFO ] [MAIN ] VGM: Generated 1807 derivative records from 18599 primary records. [2025-10-09T22:44:07.375597] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-09T22:44:07.404745] [DEBUG] [MAIN ] VHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:07.406591] [INFO ] [MAIN ] VHI: Generated 1807 derivative records from 2752 primary records. [2025-10-09T22:44:07.407199] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-09T22:44:07.409850] [DEBUG] [LOCAL ] VGM: Derivative data saved (1807 records). [2025-10-09T22:44:07.410276] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-09T22:44:07.418729] [INFO ] [MAIN ] Derivative Progress: 1550/1690 symbols completed. VGM took 1.0s. Estimated remaining: 54.5s. Rate: 154.3 symbols/min [2025-10-09T22:44:07.419000] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:07.441569] [DEBUG] [LOCAL ] VHI: Derivative data saved (1807 records). [2025-10-09T22:44:07.441703] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-09T22:44:07.444913] [INFO ] [MAIN ] Derivative Progress: 1551/1690 symbols completed. VHI took 0.8s. Estimated remaining: 54.0s. Rate: 154.4 symbols/min [2025-10-09T22:44:07.445123] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:07.466712] [DEBUG] [LOCAL ] VICI: Loaded 54040 existing records from primary storage. [2025-10-09T22:44:07.466960] [INFO ] [MAIN ] VICI: Loaded 54040 primary data records. [2025-10-09T22:44:07.688169] [DEBUG] [LOCAL ] VIK: Loaded 52834 existing records from primary storage. [2025-10-09T22:44:07.689033] [INFO ] [MAIN ] VIK: Loaded 52834 primary data records. [2025-10-09T22:44:07.971079] [DEBUG] [LOCAL ] VIPS: Loaded 51610 existing records from primary storage. [2025-10-09T22:44:07.981534] [INFO ] [MAIN ] VIPS: Loaded 51610 primary data records. [2025-10-09T22:44:08.483462] [DEBUG] [MAIN ] VICI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:08.485433] [INFO ] [MAIN ] VICI: Generated 1807 derivative records from 54040 primary records. [2025-10-09T22:44:08.485673] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-09T22:44:08.518087] [DEBUG] [MAIN ] VIK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:08.519940] [INFO ] [MAIN ] VIK: Generated 1807 derivative records from 52834 primary records. [2025-10-09T22:44:08.520939] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-09T22:44:08.532247] [DEBUG] [LOCAL ] VICI: Derivative data saved (1807 records). [2025-10-09T22:44:08.535160] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-09T22:44:08.541101] [INFO ] [MAIN ] Derivative Progress: 1552/1690 symbols completed. VICI took 1.2s. Estimated remaining: 53.7s. Rate: 154.2 symbols/min [2025-10-09T22:44:08.542181] [DEBUG] [LOCAL ] VIK: Derivative data saved (1807 records). [2025-10-09T22:44:08.544288] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:08.543325] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-09T22:44:08.548325] [INFO ] [MAIN ] Derivative Progress: 1553/1690 symbols completed. VIK took 1.1s. Estimated remaining: 53.3s. Rate: 154.3 symbols/min [2025-10-09T22:44:08.548783] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:08.561841] [DEBUG] [MAIN ] VIPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:08.562496] [INFO ] [MAIN ] VIPS: Generated 1807 derivative records from 51610 primary records. [2025-10-09T22:44:08.562557] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-09T22:44:08.579426] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1807 records). [2025-10-09T22:44:08.579540] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-09T22:44:08.582875] [INFO ] [MAIN ] Derivative Progress: 1554/1690 symbols completed. VIPS took 1.1s. Estimated remaining: 52.9s. Rate: 154.4 symbols/min [2025-10-09T22:44:08.583160] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:08.628139] [DEBUG] [LOCAL ] VIRT: Loaded 47109 existing records from primary storage. [2025-10-09T22:44:08.628461] [INFO ] [MAIN ] VIRT: Loaded 47109 primary data records. [2025-10-09T22:44:08.764045] [DEBUG] [LOCAL ] VIST: Loaded 46544 existing records from primary storage. [2025-10-09T22:44:08.778851] [INFO ] [MAIN ] VIST: Loaded 46544 primary data records. [2025-10-09T22:44:09.125900] [DEBUG] [LOCAL ] VIV: Loaded 45144 existing records from primary storage. [2025-10-09T22:44:09.126275] [INFO ] [MAIN ] VIV: Loaded 45144 primary data records. [2025-10-09T22:44:09.662049] [DEBUG] [MAIN ] VIRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:09.663236] [INFO ] [MAIN ] VIRT: Generated 1807 derivative records from 47109 primary records. [2025-10-09T22:44:09.663350] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-09T22:44:09.697227] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1807 records). [2025-10-09T22:44:09.697548] [DEBUG] [MAIN ] VIST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:09.698598] [INFO ] [MAIN ] VIST: Generated 1807 derivative records from 46544 primary records. [2025-10-09T22:44:09.698867] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-09T22:44:09.699903] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-09T22:44:09.702204] [INFO ] [MAIN ] Derivative Progress: 1555/1690 symbols completed. VIRT took 1.2s. Estimated remaining: 52.5s. Rate: 154.2 symbols/min [2025-10-09T22:44:09.702625] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:09.735588] [DEBUG] [MAIN ] VIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:09.736479] [INFO ] [MAIN ] VIV: Generated 1807 derivative records from 45144 primary records. [2025-10-09T22:44:09.736572] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-09T22:44:09.735286] [DEBUG] [LOCAL ] VIST: Derivative data saved (1807 records). [2025-10-09T22:44:09.741201] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-09T22:44:09.744127] [INFO ] [MAIN ] Derivative Progress: 1556/1690 symbols completed. VIST took 1.2s. Estimated remaining: 52.1s. Rate: 154.3 symbols/min [2025-10-09T22:44:09.745137] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:09.767405] [DEBUG] [LOCAL ] VIV: Derivative data saved (1807 records). [2025-10-09T22:44:09.767701] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-09T22:44:09.766923] [DEBUG] [LOCAL ] VKQ: Loaded 17513 existing records from primary storage. [2025-10-09T22:44:09.767806] [INFO ] [MAIN ] VKQ: Loaded 17513 primary data records. [2025-10-09T22:44:09.770580] [INFO ] [MAIN ] Derivative Progress: 1557/1690 symbols completed. VIV took 1.2s. Estimated remaining: 51.7s. Rate: 154.4 symbols/min [2025-10-09T22:44:09.791715] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:10.099617] [DEBUG] [LOCAL ] VLN: Loaded 30025 existing records from primary storage. [2025-10-09T22:44:10.099972] [INFO ] [MAIN ] VLN: Loaded 30025 primary data records. [2025-10-09T22:44:10.442098] [DEBUG] [LOCAL ] VLO: Loaded 53457 existing records from primary storage. [2025-10-09T22:44:10.442671] [INFO ] [MAIN ] VLO: Loaded 53457 primary data records. [2025-10-09T22:44:10.651215] [DEBUG] [MAIN ] VKQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:10.796417] [INFO ] [MAIN ] VKQ: Generated 1807 derivative records from 17513 primary records. [2025-10-09T22:44:10.819820] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-09T22:44:10.837867] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1807 records). [2025-10-09T22:44:10.838597] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-09T22:44:10.844604] [INFO ] [MAIN ] Derivative Progress: 1558/1690 symbols completed. VKQ took 1.1s. Estimated remaining: 51.4s. Rate: 154.2 symbols/min [2025-10-09T22:44:10.859228] [DEBUG] [MAIN ] VLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:10.860046] [INFO ] [MAIN ] VLN: Generated 1807 derivative records from 30025 primary records. [2025-10-09T22:44:10.860127] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-09T22:44:10.877225] [DEBUG] [LOCAL ] VLN: Derivative data saved (1807 records). [2025-10-09T22:44:10.877516] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-09T22:44:10.880108] [INFO ] [MAIN ] Derivative Progress: 1559/1690 symbols completed. VLN took 1.1s. Estimated remaining: 50.9s. Rate: 154.3 symbols/min [2025-10-09T22:44:10.895811] [DEBUG] [MAIN ] VLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:10.896347] [INFO ] [MAIN ] VLO: Generated 1807 derivative records from 53457 primary records. [2025-10-09T22:44:10.896404] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-09T22:44:10.912711] [DEBUG] [LOCAL ] VLO: Derivative data saved (1807 records). [2025-10-09T22:44:10.912780] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-09T22:44:10.915961] [INFO ] [MAIN ] Derivative Progress: 1560/1690 symbols completed. VLO took 1.1s. Estimated remaining: 50.5s. Rate: 154.4 symbols/min [2025-10-09T22:44:10.916682] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:10.916813] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:10.916565] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:10.925544] [DEBUG] [LOCAL ] VLT: Loaded 4541 existing records from primary storage. [2025-10-09T22:44:10.925698] [INFO ] [MAIN ] VLT: Loaded 4541 primary data records. [2025-10-09T22:44:11.265343] [DEBUG] [LOCAL ] VLRS: Loaded 40415 existing records from primary storage. [2025-10-09T22:44:11.265817] [INFO ] [MAIN ] VLRS: Loaded 40415 primary data records. [2025-10-09T22:44:11.360981] [DEBUG] [LOCAL ] VLTO: Loaded 46451 existing records from primary storage. [2025-10-09T22:44:11.385776] [INFO ] [MAIN ] VLTO: Loaded 46451 primary data records. [2025-10-09T22:44:11.929834] [DEBUG] [MAIN ] VLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:11.931418] [INFO ] [MAIN ] VLT: Generated 1807 derivative records from 4541 primary records. [2025-10-09T22:44:11.931638] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-09T22:44:11.948178] [DEBUG] [LOCAL ] VLT: Derivative data saved (1807 records). [2025-10-09T22:44:11.948362] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-09T22:44:11.950863] [INFO ] [MAIN ] Derivative Progress: 1561/1690 symbols completed. VLT took 1.0s. Estimated remaining: 50.2s. Rate: 154.2 symbols/min [2025-10-09T22:44:11.951020] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:11.971182] [DEBUG] [MAIN ] VLRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:11.972230] [INFO ] [MAIN ] VLRS: Generated 1807 derivative records from 40415 primary records. [2025-10-09T22:44:11.972503] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-09T22:44:11.991392] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1807 records). [2025-10-09T22:44:11.991730] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-09T22:44:11.993944] [INFO ] [MAIN ] Derivative Progress: 1562/1690 symbols completed. VLRS took 1.1s. Estimated remaining: 49.8s. Rate: 154.3 symbols/min [2025-10-09T22:44:11.994201] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:12.007856] [DEBUG] [MAIN ] VLTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:12.008578] [INFO ] [MAIN ] VLTO: Generated 1807 derivative records from 46451 primary records. [2025-10-09T22:44:12.008700] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-09T22:44:12.038535] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1807 records). [2025-10-09T22:44:12.039409] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-09T22:44:12.045614] [INFO ] [MAIN ] Derivative Progress: 1563/1690 symbols completed. VLTO took 1.1s. Estimated remaining: 49.4s. Rate: 154.4 symbols/min [2025-10-09T22:44:12.046003] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:12.059015] [DEBUG] [LOCAL ] VMC: Loaded 43080 existing records from primary storage. [2025-10-09T22:44:12.059160] [INFO ] [MAIN ] VMC: Loaded 43080 primary data records. [2025-10-09T22:44:12.136374] [DEBUG] [LOCAL ] VMI: Loaded 15383 existing records from primary storage. [2025-10-09T22:44:12.165638] [INFO ] [MAIN ] VMI: Loaded 15383 primary data records. [2025-10-09T22:44:12.528486] [DEBUG] [LOCAL ] VMO: Loaded 21053 existing records from primary storage. [2025-10-09T22:44:12.539804] [INFO ] [MAIN ] VMO: Loaded 21053 primary data records. [2025-10-09T22:44:13.157358] [DEBUG] [MAIN ] VMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:13.160732] [INFO ] [MAIN ] VMC: Generated 1807 derivative records from 43080 primary records. [2025-10-09T22:44:13.162013] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-09T22:44:13.204337] [DEBUG] [MAIN ] VMI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:44:13.207458] [DEBUG] [LOCAL ] VMC: Derivative data saved (1807 records). [2025-10-09T22:44:13.207768] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-09T22:44:13.207252] [INFO ] [MAIN ] VMI: Generated 1806 derivative records from 15383 primary records. [2025-10-09T22:44:13.211293] [INFO ] [MAIN ] Derivative Progress: 1564/1690 symbols completed. VMC took 1.3s. Estimated remaining: 49.0s. Rate: 154.2 symbols/min [2025-10-09T22:44:13.211725] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-09T22:44:13.212944] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:13.251252] [DEBUG] [MAIN ] VMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:13.253320] [INFO ] [MAIN ] VMO: Generated 1807 derivative records from 21053 primary records. [2025-10-09T22:44:13.255674] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-09T22:44:13.260531] [DEBUG] [LOCAL ] VMI: Derivative data saved (1806 records). [2025-10-09T22:44:13.263529] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-09T22:44:13.266809] [INFO ] [MAIN ] Derivative Progress: 1565/1690 symbols completed. VMI took 1.3s. Estimated remaining: 48.6s. Rate: 154.3 symbols/min [2025-10-09T22:44:13.281202] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:13.296050] [DEBUG] [LOCAL ] VMO: Derivative data saved (1807 records). [2025-10-09T22:44:13.295884] [DEBUG] [LOCAL ] VNCE: Loaded 8599 existing records from primary storage. [2025-10-09T22:44:13.296507] [INFO ] [MAIN ] VNCE: Loaded 8599 primary data records. [2025-10-09T22:44:13.302617] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-09T22:44:13.329333] [INFO ] [MAIN ] Derivative Progress: 1566/1690 symbols completed. VMO took 1.3s. Estimated remaining: 48.2s. Rate: 154.3 symbols/min [2025-10-09T22:44:13.353447] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:13.644108] [DEBUG] [LOCAL ] VNO: Loaded 49196 existing records from primary storage. [2025-10-09T22:44:13.649524] [INFO ] [MAIN ] VNO: Loaded 49196 primary data records. [2025-10-09T22:44:13.909915] [DEBUG] [LOCAL ] VNT: Loaded 43984 existing records from primary storage. [2025-10-09T22:44:13.940983] [INFO ] [MAIN ] VNT: Loaded 43984 primary data records. [2025-10-09T22:44:14.670686] [DEBUG] [MAIN ] VNCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:14.671777] [INFO ] [MAIN ] VNCE: Generated 1807 derivative records from 8599 primary records. [2025-10-09T22:44:14.672188] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-09T22:44:14.692804] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1807 records). [2025-10-09T22:44:14.694973] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-09T22:44:14.711959] [DEBUG] [MAIN ] VNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:14.711455] [INFO ] [MAIN ] Derivative Progress: 1567/1690 symbols completed. VNCE took 1.5s. Estimated remaining: 47.9s. Rate: 154.1 symbols/min [2025-10-09T22:44:14.713137] [INFO ] [MAIN ] VNT: Generated 1807 derivative records from 43984 primary records. [2025-10-09T22:44:14.713367] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-09T22:44:14.726712] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:14.727587] [DEBUG] [MAIN ] VNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:14.728762] [INFO ] [MAIN ] VNO: Generated 1807 derivative records from 49196 primary records. [2025-10-09T22:44:14.728997] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-09T22:44:14.764694] [DEBUG] [LOCAL ] VNT: Derivative data saved (1807 records). [2025-10-09T22:44:14.769042] [DEBUG] [LOCAL ] VOC: Loaded 9062 existing records from primary storage. [2025-10-09T22:44:14.768774] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-09T22:44:14.769880] [INFO ] [MAIN ] VOC: Loaded 9062 primary data records. [2025-10-09T22:44:14.772881] [DEBUG] [LOCAL ] VNO: Derivative data saved (1807 records). [2025-10-09T22:44:14.784561] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-09T22:44:14.772439] [INFO ] [MAIN ] Derivative Progress: 1568/1690 symbols completed. VNT took 1.4s. Estimated remaining: 47.5s. Rate: 154.2 symbols/min [2025-10-09T22:44:14.820315] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:14.820489] [INFO ] [MAIN ] Derivative Progress: 1569/1690 symbols completed. VNO took 1.5s. Estimated remaining: 47.1s. Rate: 154.3 symbols/min [2025-10-09T22:44:14.833009] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:15.120968] [DEBUG] [LOCAL ] VPG: Loaded 17148 existing records from primary storage. [2025-10-09T22:44:15.130234] [INFO ] [MAIN ] VPG: Loaded 17148 primary data records. [2025-10-09T22:44:15.251879] [DEBUG] [LOCAL ] VOYA: Loaded 42548 existing records from primary storage. [2025-10-09T22:44:15.257678] [INFO ] [MAIN ] VOYA: Loaded 42548 primary data records. [2025-10-09T22:44:15.775618] [DEBUG] [MAIN ] VOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:15.776745] [INFO ] [MAIN ] VOC: Generated 1807 derivative records from 9062 primary records. [2025-10-09T22:44:15.776846] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-09T22:44:15.800794] [DEBUG] [LOCAL ] VOC: Derivative data saved (1807 records). [2025-10-09T22:44:15.801229] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-09T22:44:15.803605] [INFO ] [MAIN ] Derivative Progress: 1570/1690 symbols completed. VOC took 1.1s. Estimated remaining: 46.7s. Rate: 154.1 symbols/min [2025-10-09T22:44:15.816055] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:15.817024] [DEBUG] [MAIN ] VPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:15.817811] [INFO ] [MAIN ] VPG: Generated 1807 derivative records from 17148 primary records. [2025-10-09T22:44:15.818043] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-09T22:44:15.837602] [DEBUG] [LOCAL ] VPV: Loaded 5450 existing records from primary storage. [2025-10-09T22:44:15.841496] [DEBUG] [LOCAL ] VPG: Derivative data saved (1807 records). [2025-10-09T22:44:15.841046] [INFO ] [MAIN ] VPV: Loaded 5450 primary data records. [2025-10-09T22:44:15.841719] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-09T22:44:15.865216] [INFO ] [MAIN ] Derivative Progress: 1571/1690 symbols completed. VPG took 1.0s. Estimated remaining: 46.3s. Rate: 154.2 symbols/min [2025-10-09T22:44:15.908881] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:15.932210] [DEBUG] [MAIN ] VOYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:15.933010] [INFO ] [MAIN ] VOYA: Generated 1807 derivative records from 42548 primary records. [2025-10-09T22:44:15.952954] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-09T22:44:16.194531] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1807 records). [2025-10-09T22:44:16.194856] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-09T22:44:16.197503] [INFO ] [MAIN ] Derivative Progress: 1572/1690 symbols completed. VOYA took 1.4s. Estimated remaining: 45.9s. Rate: 154.2 symbols/min [2025-10-09T22:44:16.197821] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:16.212959] [DEBUG] [LOCAL ] VRE: Loaded 35315 existing records from primary storage. [2025-10-09T22:44:16.214237] [INFO ] [MAIN ] VRE: Loaded 35315 primary data records. [2025-10-09T22:44:16.584152] [DEBUG] [MAIN ] VPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:16.601496] [INFO ] [MAIN ] VPV: Generated 1807 derivative records from 5450 primary records. [2025-10-09T22:44:16.601734] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-09T22:44:16.603636] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-10-09T22:44:16.603802] [INFO ] [MAIN ] VRT: Loaded 54143 primary data records. [2025-10-09T22:44:16.739744] [DEBUG] [LOCAL ] VPV: Derivative data saved (1807 records). [2025-10-09T22:44:16.745486] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-09T22:44:16.753475] [INFO ] [MAIN ] Derivative Progress: 1573/1690 symbols completed. VPV took 0.9s. Estimated remaining: 45.5s. Rate: 154.2 symbols/min [2025-10-09T22:44:16.948819] [DEBUG] [MAIN ] VRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:16.950331] [INFO ] [MAIN ] VRE: Generated 1807 derivative records from 35315 primary records. [2025-10-09T22:44:16.950636] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-09T22:44:16.969918] [DEBUG] [LOCAL ] VRE: Derivative data saved (1807 records). [2025-10-09T22:44:16.970843] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-09T22:44:16.973544] [INFO ] [MAIN ] Derivative Progress: 1574/1690 symbols completed. VRE took 1.1s. Estimated remaining: 45.1s. Rate: 154.2 symbols/min [2025-10-09T22:44:16.992095] [DEBUG] [MAIN ] VRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:16.992835] [INFO ] [MAIN ] VRT: Generated 1807 derivative records from 54143 primary records. [2025-10-09T22:44:16.992897] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-09T22:44:17.008959] [DEBUG] [LOCAL ] VRT: Derivative data saved (1807 records). [2025-10-09T22:44:17.009069] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-09T22:44:17.011336] [INFO ] [MAIN ] Derivative Progress: 1575/1690 symbols completed. VRT took 0.8s. Estimated remaining: 44.7s. Rate: 154.3 symbols/min [2025-10-09T22:44:17.011987] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:17.012140] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:17.011896] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:17.032519] [DEBUG] [LOCAL ] VRTS: Loaded 9355 existing records from primary storage. [2025-10-09T22:44:17.032692] [INFO ] [MAIN ] VRTS: Loaded 9355 primary data records. [2025-10-09T22:44:17.359893] [DEBUG] [LOCAL ] VSH: Loaded 48557 existing records from primary storage. [2025-10-09T22:44:17.430282] [INFO ] [MAIN ] VSH: Loaded 48557 primary data records. [2025-10-09T22:44:17.431172] [DEBUG] [LOCAL ] VSCO: Loaded 53132 existing records from primary storage. [2025-10-09T22:44:17.441669] [INFO ] [MAIN ] VSCO: Loaded 53132 primary data records. [2025-10-09T22:44:18.096813] [DEBUG] [MAIN ] VRTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:18.097733] [INFO ] [MAIN ] VRTS: Generated 1807 derivative records from 9355 primary records. [2025-10-09T22:44:18.097942] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-09T22:44:18.118307] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1807 records). [2025-10-09T22:44:18.118420] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-09T22:44:18.121268] [INFO ] [MAIN ] Derivative Progress: 1576/1690 symbols completed. VRTS took 1.1s. Estimated remaining: 44.4s. Rate: 154.1 symbols/min [2025-10-09T22:44:18.121664] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:18.155740] [DEBUG] [MAIN ] VSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:18.155982] [DEBUG] [MAIN ] VSH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:18.156845] [INFO ] [MAIN ] VSH: Generated 1807 derivative records from 48557 primary records. [2025-10-09T22:44:18.157463] [INFO ] [MAIN ] VSCO: Generated 1807 derivative records from 53132 primary records. [2025-10-09T22:44:18.157730] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-09T22:44:18.157676] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-09T22:44:18.190533] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1807 records). [2025-10-09T22:44:18.191906] [DEBUG] [LOCAL ] VSH: Derivative data saved (1807 records). [2025-10-09T22:44:18.191446] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-09T22:44:18.194256] [INFO ] [MAIN ] Derivative Progress: 1577/1690 symbols completed. VSCO took 1.2s. Estimated remaining: 44.0s. Rate: 154.2 symbols/min [2025-10-09T22:44:18.194426] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-09T22:44:18.194535] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:18.198689] [INFO ] [MAIN ] Derivative Progress: 1578/1690 symbols completed. VSH took 1.2s. Estimated remaining: 43.6s. Rate: 154.3 symbols/min [2025-10-09T22:44:18.213310] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:18.237421] [DEBUG] [LOCAL ] VST: Loaded 54102 existing records from primary storage. [2025-10-09T22:44:18.237765] [INFO ] [MAIN ] VST: Loaded 54102 primary data records. [2025-10-09T22:44:18.477295] [DEBUG] [LOCAL ] VTEX: Loaded 43274 existing records from primary storage. [2025-10-09T22:44:18.596008] [INFO ] [MAIN ] VTEX: Loaded 43274 primary data records. [2025-10-09T22:44:18.598683] [DEBUG] [LOCAL ] VSTS: Loaded 49305 existing records from primary storage. [2025-10-09T22:44:18.610253] [INFO ] [MAIN ] VSTS: Loaded 49305 primary data records. [2025-10-09T22:44:19.299475] [DEBUG] [MAIN ] VST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:19.301346] [INFO ] [MAIN ] VST: Generated 1807 derivative records from 54102 primary records. [2025-10-09T22:44:19.301467] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-09T22:44:19.328321] [DEBUG] [LOCAL ] VST: Derivative data saved (1807 records). [2025-10-09T22:44:19.328963] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-09T22:44:19.331822] [INFO ] [MAIN ] Derivative Progress: 1579/1690 symbols completed. VST took 1.2s. Estimated remaining: 43.2s. Rate: 154.1 symbols/min [2025-10-09T22:44:19.332116] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:19.348368] [DEBUG] [MAIN ] VSTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:19.349340] [INFO ] [MAIN ] VSTS: Generated 1807 derivative records from 49305 primary records. [2025-10-09T22:44:19.349675] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-09T22:44:19.363066] [DEBUG] [MAIN ] VTEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:19.371101] [INFO ] [MAIN ] VTEX: Generated 1807 derivative records from 43274 primary records. [2025-10-09T22:44:19.375266] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-09T22:44:19.391828] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1807 records). [2025-10-09T22:44:19.392624] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-09T22:44:19.395307] [INFO ] [MAIN ] Derivative Progress: 1580/1690 symbols completed. VSTS took 1.2s. Estimated remaining: 42.8s. Rate: 154.2 symbols/min [2025-10-09T22:44:19.396009] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:19.400525] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1807 records). [2025-10-09T22:44:19.400600] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-09T22:44:19.403169] [INFO ] [MAIN ] Derivative Progress: 1581/1690 symbols completed. VTEX took 1.2s. Estimated remaining: 42.4s. Rate: 154.3 symbols/min [2025-10-09T22:44:19.403371] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:19.426857] [DEBUG] [LOCAL ] VTN: Loaded 7036 existing records from primary storage. [2025-10-09T22:44:19.427023] [INFO ] [MAIN ] VTN: Loaded 7036 primary data records. [2025-10-09T22:44:19.489224] [DEBUG] [LOCAL ] VTMX: Loaded 17652 existing records from primary storage. [2025-10-09T22:44:19.550787] [INFO ] [MAIN ] VTMX: Loaded 17652 primary data records. [2025-10-09T22:44:19.539992] [DEBUG] [LOCAL ] VTLE: Loaded 48528 existing records from primary storage. [2025-10-09T22:44:19.551018] [INFO ] [MAIN ] VTLE: Loaded 48528 primary data records. [2025-10-09T22:44:20.403610] [DEBUG] [MAIN ] VTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:20.406009] [INFO ] [MAIN ] VTN: Generated 1807 derivative records from 7036 primary records. [2025-10-09T22:44:20.406401] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-09T22:44:20.434310] [DEBUG] [MAIN ] VTLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:20.436018] [INFO ] [MAIN ] VTLE: Generated 1807 derivative records from 48528 primary records. [2025-10-09T22:44:20.435368] [DEBUG] [LOCAL ] VTN: Derivative data saved (1807 records). [2025-10-09T22:44:20.436945] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-09T22:44:20.436834] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-09T22:44:20.440955] [INFO ] [MAIN ] Derivative Progress: 1582/1690 symbols completed. VTN took 1.0s. Estimated remaining: 42.0s. Rate: 154.1 symbols/min [2025-10-09T22:44:20.441207] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:20.469765] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1807 records). [2025-10-09T22:44:20.470415] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-09T22:44:20.473496] [INFO ] [MAIN ] Derivative Progress: 1583/1690 symbols completed. VTLE took 1.1s. Estimated remaining: 41.6s. Rate: 154.2 symbols/min [2025-10-09T22:44:20.470778] [DEBUG] [MAIN ] VTMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:20.473787] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:20.474775] [INFO ] [MAIN ] VTMX: Generated 1807 derivative records from 17652 primary records. [2025-10-09T22:44:20.475267] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-09T22:44:20.499905] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1807 records). [2025-10-09T22:44:20.507244] [DEBUG] [LOCAL ] VTOL: Loaded 19596 existing records from primary storage. [2025-10-09T22:44:20.507372] [INFO ] [MAIN ] VTOL: Loaded 19596 primary data records. [2025-10-09T22:44:20.506869] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-09T22:44:20.549348] [INFO ] [MAIN ] Derivative Progress: 1584/1690 symbols completed. VTMX took 1.2s. Estimated remaining: 41.2s. Rate: 154.3 symbols/min [2025-10-09T22:44:20.576818] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:20.852187] [DEBUG] [LOCAL ] VTR: Loaded 53144 existing records from primary storage. [2025-10-09T22:44:20.853512] [INFO ] [MAIN ] VTR: Loaded 53144 primary data records. [2025-10-09T22:44:20.864020] [DEBUG] [LOCAL ] VTS: Loaded 30351 existing records from primary storage. [2025-10-09T22:44:20.881533] [INFO ] [MAIN ] VTS: Loaded 30351 primary data records. [2025-10-09T22:44:21.547327] [DEBUG] [MAIN ] VTOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:21.551110] [INFO ] [MAIN ] VTOL: Generated 1807 derivative records from 19596 primary records. [2025-10-09T22:44:21.551937] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-09T22:44:21.573782] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1807 records). [2025-10-09T22:44:21.574122] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-09T22:44:21.577000] [INFO ] [MAIN ] Derivative Progress: 1585/1690 symbols completed. VTOL took 1.1s. Estimated remaining: 40.9s. Rate: 154.1 symbols/min [2025-10-09T22:44:21.577162] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:21.606536] [DEBUG] [MAIN ] VTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:21.612083] [INFO ] [MAIN ] VTR: Generated 1807 derivative records from 53144 primary records. [2025-10-09T22:44:21.612414] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-09T22:44:21.612586] [DEBUG] [MAIN ] VTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:21.613919] [INFO ] [MAIN ] VTS: Generated 1807 derivative records from 30351 primary records. [2025-10-09T22:44:21.614170] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-09T22:44:21.652047] [DEBUG] [LOCAL ] VTR: Derivative data saved (1807 records). [2025-10-09T22:44:21.653037] [DEBUG] [LOCAL ] VTS: Derivative data saved (1807 records). [2025-10-09T22:44:21.653147] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-09T22:44:21.655362] [INFO ] [MAIN ] Derivative Progress: 1586/1690 symbols completed. VTS took 1.1s. Estimated remaining: 40.5s. Rate: 154.2 symbols/min [2025-10-09T22:44:21.655501] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-09T22:44:21.655709] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:21.658672] [INFO ] [MAIN ] Derivative Progress: 1587/1690 symbols completed. VTR took 1.2s. Estimated remaining: 40.1s. Rate: 154.3 symbols/min [2025-10-09T22:44:21.667356] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:21.669440] [DEBUG] [LOCAL ] VVR: Loaded 31723 existing records from primary storage. [2025-10-09T22:44:21.669525] [INFO ] [MAIN ] VVR: Loaded 31723 primary data records. [2025-10-09T22:44:21.858990] [DEBUG] [LOCAL ] VVX: Loaded 23044 existing records from primary storage. [2025-10-09T22:44:21.875215] [INFO ] [MAIN ] VVX: Loaded 23044 primary data records. [2025-10-09T22:44:22.109096] [DEBUG] [LOCAL ] VVV: Loaded 50631 existing records from primary storage. [2025-10-09T22:44:22.112826] [INFO ] [MAIN ] VVV: Loaded 50631 primary data records. [2025-10-09T22:44:22.628498] [DEBUG] [MAIN ] VVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:22.630323] [INFO ] [MAIN ] VVR: Generated 1807 derivative records from 31723 primary records. [2025-10-09T22:44:22.630729] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-09T22:44:22.649732] [DEBUG] [LOCAL ] VVR: Derivative data saved (1807 records). [2025-10-09T22:44:22.651490] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-09T22:44:22.654758] [INFO ] [MAIN ] Derivative Progress: 1588/1690 symbols completed. VVR took 1.1s. Estimated remaining: 39.7s. Rate: 154.1 symbols/min [2025-10-09T22:44:22.670440] [DEBUG] [MAIN ] VVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:22.672047] [INFO ] [MAIN ] VVX: Generated 1807 derivative records from 23044 primary records. [2025-10-09T22:44:22.672184] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-09T22:44:22.684936] [DEBUG] [MAIN ] VVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:22.685702] [INFO ] [MAIN ] VVV: Generated 1807 derivative records from 50631 primary records. [2025-10-09T22:44:22.693780] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-09T22:44:22.712971] [DEBUG] [LOCAL ] VVX: Derivative data saved (1807 records). [2025-10-09T22:44:22.713268] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-09T22:44:22.716265] [INFO ] [MAIN ] Derivative Progress: 1589/1690 symbols completed. VVX took 1.0s. Estimated remaining: 39.3s. Rate: 154.2 symbols/min [2025-10-09T22:44:22.719537] [DEBUG] [LOCAL ] VVV: Derivative data saved (1807 records). [2025-10-09T22:44:22.719616] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-09T22:44:22.722322] [INFO ] [MAIN ] Derivative Progress: 1590/1690 symbols completed. VVV took 1.1s. Estimated remaining: 38.9s. Rate: 154.3 symbols/min [2025-10-09T22:44:22.722862] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:22.722793] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:22.723092] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:22.821945] [DEBUG] [LOCAL ] VYX: Loaded 48885 existing records from primary storage. [2025-10-09T22:44:22.837342] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-10-09T22:44:22.836524] [INFO ] [MAIN ] VYX: Loaded 48885 primary data records. [2025-10-09T22:44:22.837838] [INFO ] [MAIN ] VZ: Loaded 54181 primary data records. [2025-10-09T22:44:22.843846] [DEBUG] [LOCAL ] W: Loaded 53828 existing records from primary storage. [2025-10-09T22:44:22.855748] [INFO ] [MAIN ] W: Loaded 53828 primary data records. [2025-10-09T22:44:23.883173] [DEBUG] [MAIN ] VYX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:23.886781] [INFO ] [MAIN ] VYX: Generated 1807 derivative records from 48885 primary records. [2025-10-09T22:44:23.887532] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-09T22:44:23.927226] [DEBUG] [MAIN ] W: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:23.927755] [DEBUG] [MAIN ] VZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:23.928529] [INFO ] [MAIN ] W: Generated 1807 derivative records from 53828 primary records. [2025-10-09T22:44:23.929573] [INFO ] [MAIN ] VZ: Generated 1807 derivative records from 54181 primary records. [2025-10-09T22:44:23.930711] [DEBUG] [LOCAL ] VYX: Derivative data saved (1807 records). [2025-10-09T22:44:23.930774] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-09T22:44:23.930911] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-09T22:44:23.934602] [INFO ] [MAIN ] Derivative Progress: 1591/1690 symbols completed. VYX took 1.2s. Estimated remaining: 38.5s. Rate: 154.1 symbols/min [2025-10-09T22:44:23.934978] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-09T22:44:23.942916] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:23.963172] [DEBUG] [LOCAL ] W: Derivative data saved (1807 records). [2025-10-09T22:44:23.967425] [DEBUG] [LOCAL ] VZ: Derivative data saved (1807 records). [2025-10-09T22:44:23.967673] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-09T22:44:23.970207] [INFO ] [MAIN ] Derivative Progress: 1592/1690 symbols completed. VZ took 1.2s. Estimated remaining: 38.1s. Rate: 154.2 symbols/min [2025-10-09T22:44:23.967617] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-09T22:44:23.973259] [INFO ] [MAIN ] Derivative Progress: 1593/1690 symbols completed. W took 1.3s. Estimated remaining: 37.7s. Rate: 154.3 symbols/min [2025-10-09T22:44:23.970365] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:23.973710] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:24.041290] [DEBUG] [LOCAL ] WAB: Loaded 44351 existing records from primary storage. [2025-10-09T22:44:24.041469] [INFO ] [MAIN ] WAB: Loaded 44351 primary data records. [2025-10-09T22:44:24.095005] [DEBUG] [LOCAL ] WAT: Loaded 35717 existing records from primary storage. [2025-10-09T22:44:24.127583] [INFO ] [MAIN ] WAT: Loaded 35717 primary data records. [2025-10-09T22:44:24.241138] [DEBUG] [LOCAL ] WAL: Loaded 45558 existing records from primary storage. [2025-10-09T22:44:24.297871] [INFO ] [MAIN ] WAL: Loaded 45558 primary data records. [2025-10-09T22:44:25.027595] [DEBUG] [MAIN ] WAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:25.028393] [INFO ] [MAIN ] WAB: Generated 1807 derivative records from 44351 primary records. [2025-10-09T22:44:25.028607] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-09T22:44:25.076739] [DEBUG] [LOCAL ] WAB: Derivative data saved (1807 records). [2025-10-09T22:44:25.070199] [DEBUG] [MAIN ] WAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:25.078121] [INFO ] [MAIN ] WAL: Generated 1807 derivative records from 45558 primary records. [2025-10-09T22:44:25.078461] [DEBUG] [MAIN ] WAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:25.078735] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-09T22:44:25.078837] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-09T22:44:25.079611] [INFO ] [MAIN ] WAT: Generated 1807 derivative records from 35717 primary records. [2025-10-09T22:44:25.083183] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-09T22:44:25.082263] [INFO ] [MAIN ] Derivative Progress: 1594/1690 symbols completed. WAB took 1.1s. Estimated remaining: 37.4s. Rate: 154.1 symbols/min [2025-10-09T22:44:25.100412] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:25.114505] [DEBUG] [LOCAL ] WAL: Derivative data saved (1807 records). [2025-10-09T22:44:25.115119] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-09T22:44:25.117937] [INFO ] [MAIN ] Derivative Progress: 1595/1690 symbols completed. WAL took 1.1s. Estimated remaining: 37.0s. Rate: 154.2 symbols/min [2025-10-09T22:44:25.118750] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:25.120357] [DEBUG] [LOCAL ] WAT: Derivative data saved (1807 records). [2025-10-09T22:44:25.120802] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-09T22:44:25.123168] [INFO ] [MAIN ] Derivative Progress: 1596/1690 symbols completed. WAT took 1.1s. Estimated remaining: 36.6s. Rate: 154.3 symbols/min [2025-10-09T22:44:25.123444] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:25.133923] [DEBUG] [LOCAL ] WBX: Loaded 11071 existing records from primary storage. [2025-10-09T22:44:25.134182] [INFO ] [MAIN ] WBX: Loaded 11071 primary data records. [2025-10-09T22:44:25.366448] [DEBUG] [LOCAL ] WBS: Loaded 49017 existing records from primary storage. [2025-10-09T22:44:25.431836] [INFO ] [MAIN ] WBS: Loaded 49017 primary data records. [2025-10-09T22:44:25.591854] [DEBUG] [LOCAL ] WCC: Loaded 39384 existing records from primary storage. [2025-10-09T22:44:25.604321] [INFO ] [MAIN ] WCC: Loaded 39384 primary data records. [2025-10-09T22:44:26.159542] [DEBUG] [MAIN ] WBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:26.161107] [INFO ] [MAIN ] WBX: Generated 1807 derivative records from 11071 primary records. [2025-10-09T22:44:26.161396] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-09T22:44:26.193001] [DEBUG] [MAIN ] WBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:26.197547] [DEBUG] [LOCAL ] WBX: Derivative data saved (1807 records). [2025-10-09T22:44:26.197429] [INFO ] [MAIN ] WBS: Generated 1807 derivative records from 49017 primary records. [2025-10-09T22:44:26.197785] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-09T22:44:26.197901] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-09T22:44:26.200116] [INFO ] [MAIN ] Derivative Progress: 1597/1690 symbols completed. WBX took 1.1s. Estimated remaining: 36.2s. Rate: 154.1 symbols/min [2025-10-09T22:44:26.200418] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:26.235796] [DEBUG] [MAIN ] WCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:26.237540] [INFO ] [MAIN ] WCC: Generated 1807 derivative records from 39384 primary records. [2025-10-09T22:44:26.237693] [DEBUG] [LOCAL ] WBS: Derivative data saved (1807 records). [2025-10-09T22:44:26.238101] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-09T22:44:26.238030] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-09T22:44:26.242919] [INFO ] [MAIN ] Derivative Progress: 1598/1690 symbols completed. WBS took 1.1s. Estimated remaining: 35.8s. Rate: 154.2 symbols/min [2025-10-09T22:44:26.243214] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:26.270897] [DEBUG] [LOCAL ] WCC: Derivative data saved (1807 records). [2025-10-09T22:44:26.271241] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-09T22:44:26.274358] [INFO ] [MAIN ] Derivative Progress: 1599/1690 symbols completed. WCC took 1.2s. Estimated remaining: 35.4s. Rate: 154.3 symbols/min [2025-10-09T22:44:26.274701] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:26.291746] [DEBUG] [LOCAL ] WD: Loaded 23234 existing records from primary storage. [2025-10-09T22:44:26.291998] [INFO ] [MAIN ] WD: Loaded 23234 primary data records. [2025-10-09T22:44:26.401847] [DEBUG] [LOCAL ] WCN: Loaded 48291 existing records from primary storage. [2025-10-09T22:44:26.432554] [INFO ] [MAIN ] WCN: Loaded 48291 primary data records. [2025-10-09T22:44:26.432418] [DEBUG] [LOCAL ] WDH: Loaded 18104 existing records from primary storage. [2025-10-09T22:44:26.485317] [INFO ] [MAIN ] WDH: Loaded 18104 primary data records. [2025-10-09T22:44:27.360357] [DEBUG] [MAIN ] WD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:27.377772] [DEBUG] [MAIN ] WCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:27.379693] [INFO ] [MAIN ] WCN: Generated 1807 derivative records from 48291 primary records. [2025-10-09T22:44:27.378791] [INFO ] [MAIN ] WD: Generated 1807 derivative records from 23234 primary records. [2025-10-09T22:44:27.379955] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-09T22:44:27.379997] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-09T22:44:27.394957] [DEBUG] [MAIN ] WDH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:27.405213] [INFO ] [MAIN ] WDH: Generated 1807 derivative records from 18104 primary records. [2025-10-09T22:44:27.413756] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-09T22:44:27.431375] [DEBUG] [LOCAL ] WCN: Derivative data saved (1807 records). [2025-10-09T22:44:27.440580] [DEBUG] [LOCAL ] WD: Derivative data saved (1807 records). [2025-10-09T22:44:27.444920] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-09T22:44:27.442018] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-09T22:44:27.447281] [INFO ] [MAIN ] Derivative Progress: 1600/1690 symbols completed. WD took 1.2s. Estimated remaining: 35.0s. Rate: 154.1 symbols/min [2025-10-09T22:44:27.450442] [INFO ] [MAIN ] Derivative Progress: 1601/1690 symbols completed. WCN took 1.3s. Estimated remaining: 34.6s. Rate: 154.2 symbols/min [2025-10-09T22:44:27.447752] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:27.450619] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:27.457931] [DEBUG] [LOCAL ] WDH: Derivative data saved (1807 records). [2025-10-09T22:44:27.458158] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-09T22:44:27.460560] [INFO ] [MAIN ] Derivative Progress: 1602/1690 symbols completed. WDH took 1.2s. Estimated remaining: 34.2s. Rate: 154.3 symbols/min [2025-10-09T22:44:27.460802] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:27.486130] [DEBUG] [LOCAL ] WEA: Loaded 7554 existing records from primary storage. [2025-10-09T22:44:27.486796] [DEBUG] [LOCAL ] WDI: Loaded 21207 existing records from primary storage. [2025-10-09T22:44:27.496857] [INFO ] [MAIN ] WEA: Loaded 7554 primary data records. [2025-10-09T22:44:27.496993] [INFO ] [MAIN ] WDI: Loaded 21207 primary data records. [2025-10-09T22:44:27.708540] [DEBUG] [LOCAL ] WDS: Loaded 43398 existing records from primary storage. [2025-10-09T22:44:27.746396] [INFO ] [MAIN ] WDS: Loaded 43398 primary data records. [2025-10-09T22:44:28.543595] [DEBUG] [MAIN ] WDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:28.544162] [DEBUG] [MAIN ] WEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:28.545379] [INFO ] [MAIN ] WDI: Generated 1807 derivative records from 21207 primary records. [2025-10-09T22:44:28.546554] [INFO ] [MAIN ] WEA: Generated 1807 derivative records from 7554 primary records. [2025-10-09T22:44:28.546879] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-09T22:44:28.548004] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-09T22:44:28.596367] [DEBUG] [MAIN ] WDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:28.598557] [INFO ] [MAIN ] WDS: Generated 1807 derivative records from 43398 primary records. [2025-10-09T22:44:28.599223] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-09T22:44:28.613231] [DEBUG] [LOCAL ] WDI: Derivative data saved (1807 records). [2025-10-09T22:44:28.617213] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-09T22:44:28.619706] [INFO ] [MAIN ] Derivative Progress: 1603/1690 symbols completed. WDI took 1.2s. Estimated remaining: 33.9s. Rate: 154.1 symbols/min [2025-10-09T22:44:28.620347] [DEBUG] [LOCAL ] WEA: Derivative data saved (1807 records). [2025-10-09T22:44:28.621100] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-09T22:44:28.624004] [INFO ] [MAIN ] Derivative Progress: 1604/1690 symbols completed. WEA took 1.2s. Estimated remaining: 33.5s. Rate: 154.2 symbols/min [2025-10-09T22:44:28.628108] [DEBUG] [LOCAL ] WDS: Derivative data saved (1807 records). [2025-10-09T22:44:28.628191] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-09T22:44:28.631848] [INFO ] [MAIN ] Derivative Progress: 1605/1690 symbols completed. WDS took 1.2s. Estimated remaining: 33.1s. Rate: 154.3 symbols/min [2025-10-09T22:44:28.632247] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:28.632301] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:28.632520] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:28.689764] [DEBUG] [LOCAL ] WEAV: Loaded 42226 existing records from primary storage. [2025-10-09T22:44:28.689999] [INFO ] [MAIN ] WEAV: Loaded 42226 primary data records. [2025-10-09T22:44:28.869881] [DEBUG] [LOCAL ] WEC: Loaded 52539 existing records from primary storage. [2025-10-09T22:44:28.878999] [INFO ] [MAIN ] WEC: Loaded 52539 primary data records. [2025-10-09T22:44:29.107870] [DEBUG] [LOCAL ] WELL: Loaded 52728 existing records from primary storage. [2025-10-09T22:44:29.125394] [INFO ] [MAIN ] WELL: Loaded 52728 primary data records. [2025-10-09T22:44:29.773010] [DEBUG] [MAIN ] WEAV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:29.774050] [INFO ] [MAIN ] WEAV: Generated 1807 derivative records from 42226 primary records. [2025-10-09T22:44:29.775346] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-09T22:44:29.805004] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1807 records). [2025-10-09T22:44:29.805233] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-09T22:44:29.808362] [INFO ] [MAIN ] Derivative Progress: 1606/1690 symbols completed. WEAV took 1.2s. Estimated remaining: 32.7s. Rate: 154.1 symbols/min [2025-10-09T22:44:29.809408] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:29.828529] [DEBUG] [MAIN ] WELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:29.830127] [INFO ] [MAIN ] WELL: Generated 1807 derivative records from 52728 primary records. [2025-10-09T22:44:29.830447] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-09T22:44:29.858866] [DEBUG] [MAIN ] WEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:29.860876] [INFO ] [MAIN ] WEC: Generated 1807 derivative records from 52539 primary records. [2025-10-09T22:44:29.861243] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-09T22:44:29.879053] [DEBUG] [LOCAL ] WELL: Derivative data saved (1807 records). [2025-10-09T22:44:29.882214] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-09T22:44:29.883066] [DEBUG] [LOCAL ] WEC: Derivative data saved (1807 records). [2025-10-09T22:44:29.886764] [INFO ] [MAIN ] Derivative Progress: 1607/1690 symbols completed. WELL took 1.3s. Estimated remaining: 32.3s. Rate: 154.2 symbols/min [2025-10-09T22:44:29.886963] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-09T22:44:29.902444] [INFO ] [MAIN ] Derivative Progress: 1608/1690 symbols completed. WEC took 1.3s. Estimated remaining: 31.9s. Rate: 154.3 symbols/min [2025-10-09T22:44:29.902720] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:29.899542] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:29.925360] [DEBUG] [LOCAL ] WES: Loaded 48662 existing records from primary storage. [2025-10-09T22:44:29.926045] [INFO ] [MAIN ] WES: Loaded 48662 primary data records. [2025-10-09T22:44:29.951606] [DEBUG] [LOCAL ] WF: Loaded 10809 existing records from primary storage. [2025-10-09T22:44:29.973684] [INFO ] [MAIN ] WF: Loaded 10809 primary data records. [2025-10-09T22:44:30.416141] [DEBUG] [LOCAL ] WEX: Loaded 33944 existing records from primary storage. [2025-10-09T22:44:30.438167] [INFO ] [MAIN ] WEX: Loaded 33944 primary data records. [2025-10-09T22:44:30.921533] [DEBUG] [MAIN ] WES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:30.922928] [INFO ] [MAIN ] WES: Generated 1807 derivative records from 48662 primary records. [2025-10-09T22:44:30.923038] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-09T22:44:30.943217] [DEBUG] [LOCAL ] WES: Derivative data saved (1807 records). [2025-10-09T22:44:30.951592] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-09T22:44:30.959282] [INFO ] [MAIN ] Derivative Progress: 1609/1690 symbols completed. WES took 1.1s. Estimated remaining: 31.5s. Rate: 154.1 symbols/min [2025-10-09T22:44:30.959950] [DEBUG] [MAIN ] WF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:30.961312] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:30.962309] [INFO ] [MAIN ] WF: Generated 1807 derivative records from 10809 primary records. [2025-10-09T22:44:30.962734] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-09T22:44:30.981233] [DEBUG] [LOCAL ] WF: Derivative data saved (1807 records). [2025-10-09T22:44:30.981447] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-09T22:44:30.984083] [INFO ] [MAIN ] Derivative Progress: 1610/1690 symbols completed. WF took 1.1s. Estimated remaining: 31.1s. Rate: 154.2 symbols/min [2025-10-09T22:44:30.984283] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:31.003698] [DEBUG] [MAIN ] WEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:31.004583] [INFO ] [MAIN ] WEX: Generated 1807 derivative records from 33944 primary records. [2025-10-09T22:44:31.004853] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-09T22:44:31.054572] [DEBUG] [LOCAL ] WEX: Derivative data saved (1807 records). [2025-10-09T22:44:31.055467] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-09T22:44:31.055362] [DEBUG] [LOCAL ] WFG: Loaded 25001 existing records from primary storage. [2025-10-09T22:44:31.059597] [INFO ] [MAIN ] Derivative Progress: 1611/1690 symbols completed. WEX took 1.2s. Estimated remaining: 30.7s. Rate: 154.3 symbols/min [2025-10-09T22:44:31.060056] [INFO ] [MAIN ] WFG: Loaded 25001 primary data records. [2025-10-09T22:44:31.060909] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:31.128893] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-10-09T22:44:31.139923] [INFO ] [MAIN ] WFC: Loaded 54138 primary data records. [2025-10-09T22:44:31.587944] [DEBUG] [LOCAL ] WGO: Loaded 38744 existing records from primary storage. [2025-10-09T22:44:31.589675] [INFO ] [MAIN ] WGO: Loaded 38744 primary data records. [2025-10-09T22:44:32.114371] [DEBUG] [MAIN ] WFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:32.127421] [DEBUG] [MAIN ] WFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:32.129034] [INFO ] [MAIN ] WFC: Generated 1807 derivative records from 54138 primary records. [2025-10-09T22:44:32.128355] [INFO ] [MAIN ] WFG: Generated 1807 derivative records from 25001 primary records. [2025-10-09T22:44:32.129289] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-09T22:44:32.130280] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-09T22:44:32.160244] [DEBUG] [LOCAL ] WFC: Derivative data saved (1807 records). [2025-10-09T22:44:32.161475] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-09T22:44:32.165401] [INFO ] [MAIN ] Derivative Progress: 1612/1690 symbols completed. WFC took 1.2s. Estimated remaining: 30.4s. Rate: 154.1 symbols/min [2025-10-09T22:44:32.169143] [DEBUG] [LOCAL ] WFG: Derivative data saved (1807 records). [2025-10-09T22:44:32.165602] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:32.169316] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-09T22:44:32.171689] [INFO ] [MAIN ] Derivative Progress: 1613/1690 symbols completed. WFG took 1.2s. Estimated remaining: 30.0s. Rate: 154.2 symbols/min [2025-10-09T22:44:32.172258] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:32.188900] [DEBUG] [MAIN ] WGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:32.189696] [INFO ] [MAIN ] WGO: Generated 1807 derivative records from 38744 primary records. [2025-10-09T22:44:32.189988] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-09T22:44:32.215950] [DEBUG] [LOCAL ] WGO: Derivative data saved (1807 records). [2025-10-09T22:44:32.216292] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-09T22:44:32.222030] [INFO ] [MAIN ] Derivative Progress: 1614/1690 symbols completed. WGO took 1.2s. Estimated remaining: 29.6s. Rate: 154.3 symbols/min [2025-10-09T22:44:32.222234] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:32.246677] [DEBUG] [LOCAL ] WHG: Loaded 3246 existing records from primary storage. [2025-10-09T22:44:32.246852] [INFO ] [MAIN ] WHG: Loaded 3246 primary data records. [2025-10-09T22:44:32.374974] [DEBUG] [LOCAL ] WH: Loaded 45599 existing records from primary storage. [2025-10-09T22:44:32.375757] [INFO ] [MAIN ] WH: Loaded 45599 primary data records. [2025-10-09T22:44:32.375520] [DEBUG] [LOCAL ] WHD: Loaded 40299 existing records from primary storage. [2025-10-09T22:44:32.387960] [INFO ] [MAIN ] WHD: Loaded 40299 primary data records. [2025-10-09T22:44:33.243639] [DEBUG] [MAIN ] WHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:33.244621] [INFO ] [MAIN ] WHG: Generated 1807 derivative records from 3246 primary records. [2025-10-09T22:44:33.245087] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-09T22:44:33.277629] [DEBUG] [MAIN ] WH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:33.277099] [DEBUG] [LOCAL ] WHG: Derivative data saved (1807 records). [2025-10-09T22:44:33.278461] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-09T22:44:33.279839] [INFO ] [MAIN ] WH: Generated 1807 derivative records from 45599 primary records. [2025-10-09T22:44:33.282611] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-09T22:44:33.282430] [INFO ] [MAIN ] Derivative Progress: 1615/1690 symbols completed. WHG took 1.1s. Estimated remaining: 29.2s. Rate: 154.1 symbols/min [2025-10-09T22:44:33.295512] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:33.296022] [DEBUG] [MAIN ] WHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:33.297080] [INFO ] [MAIN ] WHD: Generated 1807 derivative records from 40299 primary records. [2025-10-09T22:44:33.308545] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-09T22:44:33.327199] [DEBUG] [LOCAL ] WHD: Derivative data saved (1807 records). [2025-10-09T22:44:33.327355] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-09T22:44:33.330451] [INFO ] [MAIN ] Derivative Progress: 1616/1690 symbols completed. WHD took 1.2s. Estimated remaining: 28.8s. Rate: 154.2 symbols/min [2025-10-09T22:44:33.330862] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:33.332588] [DEBUG] [LOCAL ] WH: Derivative data saved (1807 records). [2025-10-09T22:44:33.332687] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-09T22:44:33.335195] [INFO ] [MAIN ] Derivative Progress: 1617/1690 symbols completed. WH took 1.2s. Estimated remaining: 28.4s. Rate: 154.3 symbols/min [2025-10-09T22:44:33.335429] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:33.343568] [DEBUG] [LOCAL ] WIA: Loaded 5003 existing records from primary storage. [2025-10-09T22:44:33.343730] [INFO ] [MAIN ] WIA: Loaded 5003 primary data records. [2025-10-09T22:44:33.481852] [DEBUG] [LOCAL ] WINN: Loaded 11606 existing records from primary storage. [2025-10-09T22:44:33.497728] [INFO ] [MAIN ] WINN: Loaded 11606 primary data records. [2025-10-09T22:44:33.788304] [DEBUG] [LOCAL ] WHR: Loaded 48754 existing records from primary storage. [2025-10-09T22:44:33.798927] [INFO ] [MAIN ] WHR: Loaded 48754 primary data records. [2025-10-09T22:44:34.396548] [DEBUG] [MAIN ] WIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:34.397665] [INFO ] [MAIN ] WIA: Generated 1807 derivative records from 5003 primary records. [2025-10-09T22:44:34.398180] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-09T22:44:34.417044] [DEBUG] [LOCAL ] WIA: Derivative data saved (1807 records). [2025-10-09T22:44:34.418006] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-09T22:44:34.421234] [INFO ] [MAIN ] Derivative Progress: 1618/1690 symbols completed. WIA took 1.1s. Estimated remaining: 28.0s. Rate: 154.1 symbols/min [2025-10-09T22:44:34.435923] [DEBUG] [MAIN ] WINN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:44:34.436981] [INFO ] [MAIN ] WINN: Generated 1806 derivative records from 11606 primary records. [2025-10-09T22:44:34.437086] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-09T22:44:34.455799] [DEBUG] [LOCAL ] WINN: Derivative data saved (1806 records). [2025-10-09T22:44:34.455939] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-09T22:44:34.458785] [INFO ] [MAIN ] Derivative Progress: 1619/1690 symbols completed. WINN took 1.1s. Estimated remaining: 27.6s. Rate: 154.2 symbols/min [2025-10-09T22:44:34.472104] [DEBUG] [MAIN ] WHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:34.472785] [INFO ] [MAIN ] WHR: Generated 1807 derivative records from 48754 primary records. [2025-10-09T22:44:34.472850] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-09T22:44:34.488887] [DEBUG] [LOCAL ] WHR: Derivative data saved (1807 records). [2025-10-09T22:44:34.488950] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-09T22:44:34.492219] [INFO ] [MAIN ] Derivative Progress: 1620/1690 symbols completed. WHR took 1.2s. Estimated remaining: 27.2s. Rate: 154.3 symbols/min [2025-10-09T22:44:34.492851] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:34.492759] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:34.493007] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:34.515786] [DEBUG] [LOCAL ] WIW: Loaded 20563 existing records from primary storage. [2025-10-09T22:44:34.524072] [INFO ] [MAIN ] WIW: Loaded 20563 primary data records. [2025-10-09T22:44:34.660850] [DEBUG] [LOCAL ] WK: Loaded 37473 existing records from primary storage. [2025-10-09T22:44:34.677338] [INFO ] [MAIN ] WK: Loaded 37473 primary data records. [2025-10-09T22:44:35.003474] [DEBUG] [LOCAL ] WIT: Loaded 52792 existing records from primary storage. [2025-10-09T22:44:35.041364] [INFO ] [MAIN ] WIT: Loaded 52792 primary data records. [2025-10-09T22:44:35.559934] [DEBUG] [MAIN ] WIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:35.561028] [INFO ] [MAIN ] WIW: Generated 1807 derivative records from 20563 primary records. [2025-10-09T22:44:35.561213] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-09T22:44:35.596813] [DEBUG] [LOCAL ] WIW: Derivative data saved (1807 records). [2025-10-09T22:44:35.597287] [DEBUG] [MAIN ] WK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:35.598168] [INFO ] [MAIN ] WK: Generated 1807 derivative records from 37473 primary records. [2025-10-09T22:44:35.598343] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-09T22:44:35.598258] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-09T22:44:35.600761] [INFO ] [MAIN ] Derivative Progress: 1621/1690 symbols completed. WIW took 1.1s. Estimated remaining: 26.9s. Rate: 154.1 symbols/min [2025-10-09T22:44:35.601385] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:35.621862] [DEBUG] [LOCAL ] WK: Derivative data saved (1807 records). [2025-10-09T22:44:35.634767] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-09T22:44:35.634700] [DEBUG] [MAIN ] WIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:35.638911] [INFO ] [MAIN ] WIT: Generated 1807 derivative records from 52792 primary records. [2025-10-09T22:44:35.639042] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-09T22:44:35.638075] [INFO ] [MAIN ] Derivative Progress: 1622/1690 symbols completed. WK took 1.1s. Estimated remaining: 26.5s. Rate: 154.2 symbols/min [2025-10-09T22:44:35.640013] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:35.664445] [DEBUG] [LOCAL ] WIT: Derivative data saved (1807 records). [2025-10-09T22:44:35.664728] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-09T22:44:35.667987] [INFO ] [MAIN ] Derivative Progress: 1623/1690 symbols completed. WIT took 1.2s. Estimated remaining: 26.1s. Rate: 154.3 symbols/min [2025-10-09T22:44:35.668388] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:35.686509] [DEBUG] [LOCAL ] WKC: Loaded 34872 existing records from primary storage. [2025-10-09T22:44:35.688301] [INFO ] [MAIN ] WKC: Loaded 34872 primary data records. [2025-10-09T22:44:35.778801] [DEBUG] [LOCAL ] WLKP: Loaded 6946 existing records from primary storage. [2025-10-09T22:44:35.805601] [INFO ] [MAIN ] WLKP: Loaded 6946 primary data records. [2025-10-09T22:44:35.987187] [DEBUG] [LOCAL ] WLK: Loaded 45905 existing records from primary storage. [2025-10-09T22:44:36.107256] [INFO ] [MAIN ] WLK: Loaded 45905 primary data records. [2025-10-09T22:44:36.664175] [DEBUG] [MAIN ] WKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:36.666019] [INFO ] [MAIN ] WKC: Generated 1807 derivative records from 34872 primary records. [2025-10-09T22:44:36.666191] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-09T22:44:36.680367] [DEBUG] [MAIN ] WLKP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:36.692196] [INFO ] [MAIN ] WLKP: Generated 1807 derivative records from 6946 primary records. [2025-10-09T22:44:36.694047] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-09T22:44:36.697489] [DEBUG] [LOCAL ] WKC: Derivative data saved (1807 records). [2025-10-09T22:44:36.697682] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-09T22:44:36.699922] [INFO ] [MAIN ] Derivative Progress: 1624/1690 symbols completed. WKC took 1.1s. Estimated remaining: 25.7s. Rate: 154.1 symbols/min [2025-10-09T22:44:36.700090] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:36.717831] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1807 records). [2025-10-09T22:44:36.718065] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-09T22:44:36.720684] [INFO ] [MAIN ] Derivative Progress: 1625/1690 symbols completed. WLKP took 1.1s. Estimated remaining: 25.3s. Rate: 154.2 symbols/min [2025-10-09T22:44:36.720849] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:36.733982] [DEBUG] [MAIN ] WLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:36.734631] [INFO ] [MAIN ] WLK: Generated 1807 derivative records from 45905 primary records. [2025-10-09T22:44:36.734716] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-09T22:44:36.760072] [DEBUG] [LOCAL ] WLK: Derivative data saved (1807 records). [2025-10-09T22:44:36.760298] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-09T22:44:36.763413] [INFO ] [MAIN ] Derivative Progress: 1626/1690 symbols completed. WLK took 1.1s. Estimated remaining: 24.9s. Rate: 154.3 symbols/min [2025-10-09T22:44:36.763683] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:36.775281] [DEBUG] [LOCAL ] WLY: Loaded 29747 existing records from primary storage. [2025-10-09T22:44:36.775568] [INFO ] [MAIN ] WLY: Loaded 29747 primary data records. [2025-10-09T22:44:37.113350] [DEBUG] [LOCAL ] WM: Loaded 51339 existing records from primary storage. [2025-10-09T22:44:37.113600] [INFO ] [MAIN ] WM: Loaded 51339 primary data records. [2025-10-09T22:44:37.234440] [DEBUG] [LOCAL ] WMB: Loaded 54062 existing records from primary storage. [2025-10-09T22:44:37.240538] [INFO ] [MAIN ] WMB: Loaded 54062 primary data records. [2025-10-09T22:44:37.787240] [DEBUG] [MAIN ] WLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:37.788387] [INFO ] [MAIN ] WLY: Generated 1807 derivative records from 29747 primary records. [2025-10-09T22:44:37.788995] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-09T22:44:37.806161] [DEBUG] [LOCAL ] WLY: Derivative data saved (1807 records). [2025-10-09T22:44:37.806777] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-09T22:44:37.809545] [INFO ] [MAIN ] Derivative Progress: 1627/1690 symbols completed. WLY took 1.1s. Estimated remaining: 24.5s. Rate: 154.2 symbols/min [2025-10-09T22:44:37.809781] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:37.827824] [DEBUG] [MAIN ] WM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:37.828703] [INFO ] [MAIN ] WM: Generated 1807 derivative records from 51339 primary records. [2025-10-09T22:44:37.829058] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-09T22:44:37.856330] [DEBUG] [LOCAL ] WM: Derivative data saved (1807 records). [2025-10-09T22:44:37.857109] [DEBUG] [LOCAL ] WMK: Loaded 14682 existing records from primary storage. [2025-10-09T22:44:37.857227] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-09T22:44:37.858125] [INFO ] [MAIN ] WMK: Loaded 14682 primary data records. [2025-10-09T22:44:37.861034] [INFO ] [MAIN ] Derivative Progress: 1628/1690 symbols completed. WM took 1.1s. Estimated remaining: 24.1s. Rate: 154.2 symbols/min [2025-10-09T22:44:37.894907] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:37.941420] [DEBUG] [MAIN ] WMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:37.964254] [INFO ] [MAIN ] WMB: Generated 1807 derivative records from 54062 primary records. [2025-10-09T22:44:37.964379] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-09T22:44:38.176127] [DEBUG] [LOCAL ] WMB: Derivative data saved (1807 records). [2025-10-09T22:44:38.189850] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-09T22:44:38.201976] [INFO ] [MAIN ] Derivative Progress: 1629/1690 symbols completed. WMB took 1.4s. Estimated remaining: 23.7s. Rate: 154.2 symbols/min [2025-10-09T22:44:38.202373] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:38.221123] [DEBUG] [LOCAL ] WMS: Loaded 39854 existing records from primary storage. [2025-10-09T22:44:38.221587] [INFO ] [MAIN ] WMS: Loaded 39854 primary data records. [2025-10-09T22:44:38.439472] [DEBUG] [MAIN ] WMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:38.548011] [INFO ] [MAIN ] WMK: Generated 1807 derivative records from 14682 primary records. [2025-10-09T22:44:38.557815] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-09T22:44:38.589762] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-10-09T22:44:38.590591] [INFO ] [MAIN ] WMT: Loaded 54190 primary data records. [2025-10-09T22:44:38.588521] [DEBUG] [LOCAL ] WMK: Derivative data saved (1807 records). [2025-10-09T22:44:38.590733] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-09T22:44:38.614335] [INFO ] [MAIN ] Derivative Progress: 1630/1690 symbols completed. WMK took 0.8s. Estimated remaining: 23.3s. Rate: 154.2 symbols/min [2025-10-09T22:44:38.625248] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:38.928345] [DEBUG] [MAIN ] WMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:38.929501] [INFO ] [MAIN ] WMS: Generated 1807 derivative records from 39854 primary records. [2025-10-09T22:44:38.929874] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-09T22:44:38.957240] [DEBUG] [LOCAL ] WNC: Loaded 39050 existing records from primary storage. [2025-10-09T22:44:38.960487] [INFO ] [MAIN ] WNC: Loaded 39050 primary data records. [2025-10-09T22:44:38.961207] [DEBUG] [LOCAL ] WMS: Derivative data saved (1807 records). [2025-10-09T22:44:38.961434] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-09T22:44:38.964427] [INFO ] [MAIN ] Derivative Progress: 1631/1690 symbols completed. WMS took 1.1s. Estimated remaining: 22.9s. Rate: 154.3 symbols/min [2025-10-09T22:44:38.969961] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:39.101007] [DEBUG] [MAIN ] WMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:39.112328] [INFO ] [MAIN ] WMT: Generated 1807 derivative records from 54190 primary records. [2025-10-09T22:44:39.122887] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-09T22:44:39.319285] [DEBUG] [LOCAL ] WMT: Derivative data saved (1807 records). [2025-10-09T22:44:39.328916] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-09T22:44:39.331100] [INFO ] [MAIN ] Derivative Progress: 1632/1690 symbols completed. WMT took 1.1s. Estimated remaining: 22.6s. Rate: 154.3 symbols/min [2025-10-09T22:44:39.331975] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:39.345154] [DEBUG] [LOCAL ] WNS: Loaded 40148 existing records from primary storage. [2025-10-09T22:44:39.345357] [INFO ] [MAIN ] WNS: Loaded 40148 primary data records. [2025-10-09T22:44:39.713632] [DEBUG] [LOCAL ] WOLF: Loaded 53561 existing records from primary storage. [2025-10-09T22:44:39.714953] [INFO ] [MAIN ] WOLF: Loaded 53561 primary data records. [2025-10-09T22:44:39.872911] [DEBUG] [MAIN ] WNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:40.016382] [INFO ] [MAIN ] WNC: Generated 1807 derivative records from 39050 primary records. [2025-10-09T22:44:40.025122] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-09T22:44:40.044403] [DEBUG] [LOCAL ] WNC: Derivative data saved (1807 records). [2025-10-09T22:44:40.046463] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-09T22:44:40.049206] [INFO ] [MAIN ] Derivative Progress: 1633/1690 symbols completed. WNC took 1.4s. Estimated remaining: 22.2s. Rate: 154.2 symbols/min [2025-10-09T22:44:40.062774] [DEBUG] [MAIN ] WNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:40.063494] [INFO ] [MAIN ] WNS: Generated 1807 derivative records from 40148 primary records. [2025-10-09T22:44:40.064362] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-09T22:44:40.082144] [DEBUG] [LOCAL ] WNS: Derivative data saved (1807 records). [2025-10-09T22:44:40.082950] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-09T22:44:40.085629] [INFO ] [MAIN ] Derivative Progress: 1634/1690 symbols completed. WNS took 1.1s. Estimated remaining: 21.8s. Rate: 154.3 symbols/min [2025-10-09T22:44:40.098583] [DEBUG] [MAIN ] WOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:40.099148] [INFO ] [MAIN ] WOLF: Generated 1807 derivative records from 53561 primary records. [2025-10-09T22:44:40.099207] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-09T22:44:40.116847] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1807 records). [2025-10-09T22:44:40.116913] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-09T22:44:40.119331] [INFO ] [MAIN ] Derivative Progress: 1635/1690 symbols completed. WOLF took 0.8s. Estimated remaining: 21.4s. Rate: 154.3 symbols/min [2025-10-09T22:44:40.119834] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:40.119952] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:40.120016] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:40.152752] [DEBUG] [LOCAL ] WOR: Loaded 24817 existing records from primary storage. [2025-10-09T22:44:40.152888] [INFO ] [MAIN ] WOR: Loaded 24817 primary data records. [2025-10-09T22:44:40.263906] [DEBUG] [LOCAL ] WOW: Loaded 30654 existing records from primary storage. [2025-10-09T22:44:40.274937] [INFO ] [MAIN ] WOW: Loaded 30654 primary data records. [2025-10-09T22:44:40.339532] [DEBUG] [LOCAL ] WPC: Loaded 48659 existing records from primary storage. [2025-10-09T22:44:40.403232] [INFO ] [MAIN ] WPC: Loaded 48659 primary data records. [2025-10-09T22:44:41.112117] [DEBUG] [MAIN ] WOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:41.113127] [INFO ] [MAIN ] WOR: Generated 1807 derivative records from 24817 primary records. [2025-10-09T22:44:41.113318] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-09T22:44:41.132451] [DEBUG] [LOCAL ] WOR: Derivative data saved (1807 records). [2025-10-09T22:44:41.133908] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-09T22:44:41.137036] [INFO ] [MAIN ] Derivative Progress: 1636/1690 symbols completed. WOR took 1.0s. Estimated remaining: 21.0s. Rate: 154.2 symbols/min [2025-10-09T22:44:41.137401] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:41.154860] [DEBUG] [MAIN ] WOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:41.156970] [INFO ] [MAIN ] WOW: Generated 1807 derivative records from 30654 primary records. [2025-10-09T22:44:41.157341] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-09T22:44:41.171633] [DEBUG] [MAIN ] WPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:41.172987] [INFO ] [MAIN ] WPC: Generated 1807 derivative records from 48659 primary records. [2025-10-09T22:44:41.180358] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-09T22:44:41.199860] [DEBUG] [LOCAL ] WOW: Derivative data saved (1807 records). [2025-10-09T22:44:41.202969] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-09T22:44:41.207303] [INFO ] [MAIN ] Derivative Progress: 1637/1690 symbols completed. WOW took 1.1s. Estimated remaining: 20.6s. Rate: 154.3 symbols/min [2025-10-09T22:44:41.208860] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:41.212562] [DEBUG] [LOCAL ] WPC: Derivative data saved (1807 records). [2025-10-09T22:44:41.212763] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-09T22:44:41.215893] [INFO ] [MAIN ] Derivative Progress: 1638/1690 symbols completed. WPC took 1.1s. Estimated remaining: 20.2s. Rate: 154.4 symbols/min [2025-10-09T22:44:41.216334] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:41.256072] [DEBUG] [LOCAL ] WPM: Loaded 53128 existing records from primary storage. [2025-10-09T22:44:41.256313] [INFO ] [MAIN ] WPM: Loaded 53128 primary data records. [2025-10-09T22:44:41.475144] [DEBUG] [LOCAL ] WPP: Loaded 34404 existing records from primary storage. [2025-10-09T22:44:41.633506] [INFO ] [MAIN ] WPP: Loaded 34404 primary data records. [2025-10-09T22:44:41.645734] [DEBUG] [LOCAL ] WRB: Loaded 51053 existing records from primary storage. [2025-10-09T22:44:41.665675] [INFO ] [MAIN ] WRB: Loaded 51053 primary data records. [2025-10-09T22:44:42.296056] [DEBUG] [MAIN ] WPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:42.298122] [INFO ] [MAIN ] WPM: Generated 1807 derivative records from 53128 primary records. [2025-10-09T22:44:42.298226] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-09T22:44:42.324780] [DEBUG] [LOCAL ] WPM: Derivative data saved (1807 records). [2025-10-09T22:44:42.325214] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-09T22:44:42.328011] [INFO ] [MAIN ] Derivative Progress: 1639/1690 symbols completed. WPM took 1.2s. Estimated remaining: 19.8s. Rate: 154.2 symbols/min [2025-10-09T22:44:42.328204] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:42.341177] [DEBUG] [MAIN ] WPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:42.342476] [INFO ] [MAIN ] WPP: Generated 1807 derivative records from 34404 primary records. [2025-10-09T22:44:42.342775] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-09T22:44:42.375817] [DEBUG] [MAIN ] WRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:42.378494] [INFO ] [MAIN ] WRB: Generated 1807 derivative records from 51053 primary records. [2025-10-09T22:44:42.379948] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-09T22:44:42.379678] [DEBUG] [LOCAL ] WPP: Derivative data saved (1807 records). [2025-10-09T22:44:42.380168] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-09T22:44:42.382798] [INFO ] [MAIN ] Derivative Progress: 1640/1690 symbols completed. WPP took 1.2s. Estimated remaining: 19.4s. Rate: 154.3 symbols/min [2025-10-09T22:44:42.383592] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:42.404600] [DEBUG] [LOCAL ] WRB: Derivative data saved (1807 records). [2025-10-09T22:44:42.404845] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-09T22:44:42.409083] [INFO ] [MAIN ] Derivative Progress: 1641/1690 symbols completed. WRB took 1.2s. Estimated remaining: 19.0s. Rate: 154.4 symbols/min [2025-10-09T22:44:42.409777] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:42.454617] [DEBUG] [LOCAL ] WS: Loaded 23727 existing records from primary storage. [2025-10-09T22:44:42.455953] [INFO ] [MAIN ] WS: Loaded 23727 primary data records. [2025-10-09T22:44:42.468228] [DEBUG] [LOCAL ] WRBY: Loaded 51073 existing records from primary storage. [2025-10-09T22:44:42.477597] [INFO ] [MAIN ] WRBY: Loaded 51073 primary data records. [2025-10-09T22:44:43.117833] [DEBUG] [LOCAL ] WSM: Loaded 49654 existing records from primary storage. [2025-10-09T22:44:43.120122] [INFO ] [MAIN ] WSM: Loaded 49654 primary data records. [2025-10-09T22:44:43.587380] [DEBUG] [MAIN ] WS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:43.593237] [DEBUG] [MAIN ] WRBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:43.594281] [INFO ] [MAIN ] WRBY: Generated 1807 derivative records from 51073 primary records. [2025-10-09T22:44:43.595595] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-09T22:44:43.595394] [INFO ] [MAIN ] WS: Generated 1807 derivative records from 23727 primary records. [2025-10-09T22:44:43.597031] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-09T22:44:43.632400] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1807 records). [2025-10-09T22:44:43.632754] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-09T22:44:43.637542] [INFO ] [MAIN ] Derivative Progress: 1642/1690 symbols completed. WRBY took 1.3s. Estimated remaining: 18.7s. Rate: 154.2 symbols/min [2025-10-09T22:44:43.638938] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:43.659017] [DEBUG] [LOCAL ] WS: Derivative data saved (1807 records). [2025-10-09T22:44:43.659903] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-09T22:44:43.659668] [DEBUG] [MAIN ] WSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:43.661106] [INFO ] [MAIN ] WSM: Generated 1807 derivative records from 49654 primary records. [2025-10-09T22:44:43.664963] [INFO ] [MAIN ] Derivative Progress: 1643/1690 symbols completed. WS took 1.3s. Estimated remaining: 18.3s. Rate: 154.2 symbols/min [2025-10-09T22:44:43.665261] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:43.665972] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-09T22:44:43.700804] [DEBUG] [LOCAL ] WSO: Loaded 25356 existing records from primary storage. [2025-10-09T22:44:43.701597] [INFO ] [MAIN ] WSO: Loaded 25356 primary data records. [2025-10-09T22:44:43.781025] [DEBUG] [LOCAL ] WSM: Derivative data saved (1807 records). [2025-10-09T22:44:43.787776] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-09T22:44:43.799102] [INFO ] [MAIN ] Derivative Progress: 1644/1690 symbols completed. WSM took 1.4s. Estimated remaining: 17.9s. Rate: 154.3 symbols/min [2025-10-09T22:44:43.811530] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:43.817630] [DEBUG] [LOCAL ] WSR: Loaded 23050 existing records from primary storage. [2025-10-09T22:44:43.829298] [INFO ] [MAIN ] WSR: Loaded 23050 primary data records. [2025-10-09T22:44:44.386010] [DEBUG] [LOCAL ] WST: Loaded 37212 existing records from primary storage. [2025-10-09T22:44:44.386978] [INFO ] [MAIN ] WST: Loaded 37212 primary data records. [2025-10-09T22:44:44.572895] [DEBUG] [MAIN ] WSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:44.584509] [INFO ] [MAIN ] WSO: Generated 1807 derivative records from 25356 primary records. [2025-10-09T22:44:44.627622] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-09T22:44:44.820014] [DEBUG] [MAIN ] WSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:44.821610] [INFO ] [MAIN ] WSR: Generated 1807 derivative records from 23050 primary records. [2025-10-09T22:44:44.822426] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-09T22:44:44.826315] [DEBUG] [LOCAL ] WSO: Derivative data saved (1807 records). [2025-10-09T22:44:44.834708] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-09T22:44:44.842579] [INFO ] [MAIN ] Derivative Progress: 1645/1690 symbols completed. WSO took 1.2s. Estimated remaining: 17.5s. Rate: 154.1 symbols/min [2025-10-09T22:44:44.843883] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:44.850114] [DEBUG] [LOCAL ] WSR: Derivative data saved (1807 records). [2025-10-09T22:44:44.850224] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-09T22:44:44.853142] [INFO ] [MAIN ] Derivative Progress: 1646/1690 symbols completed. WSR took 1.2s. Estimated remaining: 17.1s. Rate: 154.2 symbols/min [2025-10-09T22:44:44.853306] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:44.878194] [DEBUG] [MAIN ] WST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:44.879286] [INFO ] [MAIN ] WST: Generated 1807 derivative records from 37212 primary records. [2025-10-09T22:44:44.879376] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-09T22:44:44.919042] [DEBUG] [LOCAL ] WST: Derivative data saved (1807 records). [2025-10-09T22:44:44.919156] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-09T22:44:44.921802] [INFO ] [MAIN ] Derivative Progress: 1647/1690 symbols completed. WST took 1.1s. Estimated remaining: 16.7s. Rate: 154.3 symbols/min [2025-10-09T22:44:44.922120] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:44.952292] [DEBUG] [LOCAL ] WT: Loaded 48271 existing records from primary storage. [2025-10-09T22:44:44.953667] [INFO ] [MAIN ] WT: Loaded 48271 primary data records. [2025-10-09T22:44:44.954355] [DEBUG] [LOCAL ] WTI: Loaded 44511 existing records from primary storage. [2025-10-09T22:44:44.965940] [INFO ] [MAIN ] WTI: Loaded 44511 primary data records. [2025-10-09T22:44:45.592276] [DEBUG] [LOCAL ] WTRG: Loaded 51344 existing records from primary storage. [2025-10-09T22:44:45.593543] [INFO ] [MAIN ] WTRG: Loaded 51344 primary data records. [2025-10-09T22:44:45.983970] [DEBUG] [MAIN ] WT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:45.993826] [INFO ] [MAIN ] WT: Generated 1807 derivative records from 48271 primary records. [2025-10-09T22:44:45.999469] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-09T22:44:46.000440] [DEBUG] [MAIN ] WTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:46.004065] [INFO ] [MAIN ] WTI: Generated 1807 derivative records from 44511 primary records. [2025-10-09T22:44:46.015821] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-09T22:44:46.039539] [DEBUG] [LOCAL ] WT: Derivative data saved (1807 records). [2025-10-09T22:44:46.042028] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-09T22:44:46.045682] [INFO ] [MAIN ] Derivative Progress: 1648/1690 symbols completed. WT took 1.2s. Estimated remaining: 16.3s. Rate: 154.1 symbols/min [2025-10-09T22:44:46.046801] [DEBUG] [LOCAL ] WTI: Derivative data saved (1807 records). [2025-10-09T22:44:46.047482] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-09T22:44:46.063142] [INFO ] [MAIN ] Derivative Progress: 1649/1690 symbols completed. WTI took 1.2s. Estimated remaining: 16.0s. Rate: 154.2 symbols/min [2025-10-09T22:44:46.063447] [DEBUG] [MAIN ] WTRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:46.064480] [INFO ] [MAIN ] WTRG: Generated 1807 derivative records from 51344 primary records. [2025-10-09T22:44:46.064686] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-09T22:44:46.080621] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1807 records). [2025-10-09T22:44:46.080708] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-09T22:44:46.083789] [INFO ] [MAIN ] Derivative Progress: 1650/1690 symbols completed. WTRG took 1.2s. Estimated remaining: 15.6s. Rate: 154.3 symbols/min [2025-10-09T22:44:46.084471] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:46.084615] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:46.084772] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:46.107047] [DEBUG] [LOCAL ] WTS: Loaded 17817 existing records from primary storage. [2025-10-09T22:44:46.107181] [INFO ] [MAIN ] WTS: Loaded 17817 primary data records. [2025-10-09T22:44:46.450514] [DEBUG] [LOCAL ] WU: Loaded 53845 existing records from primary storage. [2025-10-09T22:44:46.443823] [DEBUG] [LOCAL ] WTTR: Loaded 44933 existing records from primary storage. [2025-10-09T22:44:46.464065] [INFO ] [MAIN ] WTTR: Loaded 44933 primary data records. [2025-10-09T22:44:46.464117] [INFO ] [MAIN ] WU: Loaded 53845 primary data records. [2025-10-09T22:44:47.118546] [DEBUG] [MAIN ] WTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:47.119847] [INFO ] [MAIN ] WTS: Generated 1807 derivative records from 17817 primary records. [2025-10-09T22:44:47.121079] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-09T22:44:47.148112] [DEBUG] [LOCAL ] WTS: Derivative data saved (1807 records). [2025-10-09T22:44:47.148355] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-09T22:44:47.151200] [INFO ] [MAIN ] Derivative Progress: 1651/1690 symbols completed. WTS took 1.1s. Estimated remaining: 15.2s. Rate: 154.2 symbols/min [2025-10-09T22:44:47.151361] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:47.166218] [DEBUG] [MAIN ] WTTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:47.168894] [INFO ] [MAIN ] WTTR: Generated 1807 derivative records from 44933 primary records. [2025-10-09T22:44:47.169256] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-09T22:44:47.197482] [DEBUG] [MAIN ] WU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:47.199126] [INFO ] [MAIN ] WU: Generated 1807 derivative records from 53845 primary records. [2025-10-09T22:44:47.199631] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-09T22:44:47.219831] [DEBUG] [LOCAL ] WU: Derivative data saved (1807 records). [2025-10-09T22:44:47.220733] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-09T22:44:47.223470] [INFO ] [MAIN ] Derivative Progress: 1652/1690 symbols completed. WU took 1.1s. Estimated remaining: 14.8s. Rate: 154.2 symbols/min [2025-10-09T22:44:47.224110] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1807 records). [2025-10-09T22:44:47.224558] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-09T22:44:47.224263] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:47.227437] [INFO ] [MAIN ] Derivative Progress: 1653/1690 symbols completed. WTTR took 1.1s. Estimated remaining: 14.4s. Rate: 154.3 symbols/min [2025-10-09T22:44:47.227878] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:47.262215] [DEBUG] [LOCAL ] WWW: Loaded 49580 existing records from primary storage. [2025-10-09T22:44:47.263392] [INFO ] [MAIN ] WWW: Loaded 49580 primary data records. [2025-10-09T22:44:47.486629] [DEBUG] [LOCAL ] XFLT: Loaded 30065 existing records from primary storage. [2025-10-09T22:44:47.616078] [INFO ] [MAIN ] XFLT: Loaded 30065 primary data records. [2025-10-09T22:44:47.633071] [DEBUG] [LOCAL ] WY: Loaded 53527 existing records from primary storage. [2025-10-09T22:44:47.664537] [INFO ] [MAIN ] WY: Loaded 53527 primary data records. [2025-10-09T22:44:48.318704] [DEBUG] [MAIN ] WWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:48.320227] [INFO ] [MAIN ] WWW: Generated 1807 derivative records from 49580 primary records. [2025-10-09T22:44:48.320715] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-09T22:44:48.346386] [DEBUG] [LOCAL ] WWW: Derivative data saved (1807 records). [2025-10-09T22:44:48.346838] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-09T22:44:48.349484] [INFO ] [MAIN ] Derivative Progress: 1654/1690 symbols completed. WWW took 1.2s. Estimated remaining: 14.0s. Rate: 154.1 symbols/min [2025-10-09T22:44:48.349724] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:48.372781] [DEBUG] [MAIN ] XFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:48.373609] [INFO ] [MAIN ] XFLT: Generated 1807 derivative records from 30065 primary records. [2025-10-09T22:44:48.373780] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-09T22:44:48.404342] [DEBUG] [MAIN ] WY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:48.405553] [INFO ] [MAIN ] WY: Generated 1807 derivative records from 53527 primary records. [2025-10-09T22:44:48.415624] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-09T22:44:48.430206] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1807 records). [2025-10-09T22:44:48.434443] [DEBUG] [LOCAL ] WY: Derivative data saved (1807 records). [2025-10-09T22:44:48.447398] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-09T22:44:48.435331] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-09T22:44:48.450214] [INFO ] [MAIN ] Derivative Progress: 1655/1690 symbols completed. XFLT took 1.2s. Estimated remaining: 13.6s. Rate: 154.2 symbols/min [2025-10-09T22:44:48.453122] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:48.453267] [INFO ] [MAIN ] Derivative Progress: 1656/1690 symbols completed. WY took 1.2s. Estimated remaining: 13.2s. Rate: 154.3 symbols/min [2025-10-09T22:44:48.455221] [DEBUG] [LOCAL ] XHR: Loaded 43952 existing records from primary storage. [2025-10-09T22:44:48.455462] [INFO ] [MAIN ] XHR: Loaded 43952 primary data records. [2025-10-09T22:44:48.455379] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:48.793715] [DEBUG] [LOCAL ] XPER: Loaded 30306 existing records from primary storage. [2025-10-09T22:44:48.804356] [INFO ] [MAIN ] XPER: Loaded 30306 primary data records. [2025-10-09T22:44:49.016559] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-10-09T22:44:49.042965] [INFO ] [MAIN ] XOM: Loaded 54183 primary data records. [2025-10-09T22:44:49.517080] [DEBUG] [MAIN ] XHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:49.520465] [INFO ] [MAIN ] XHR: Generated 1807 derivative records from 43952 primary records. [2025-10-09T22:44:49.520820] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-09T22:44:49.552082] [DEBUG] [MAIN ] XPER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:49.558276] [INFO ] [MAIN ] XPER: Generated 1807 derivative records from 30306 primary records. [2025-10-09T22:44:49.561341] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-09T22:44:49.563046] [DEBUG] [LOCAL ] XHR: Derivative data saved (1807 records). [2025-10-09T22:44:49.564702] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-09T22:44:49.568722] [INFO ] [MAIN ] Derivative Progress: 1657/1690 symbols completed. XHR took 1.2s. Estimated remaining: 12.8s. Rate: 154.1 symbols/min [2025-10-09T22:44:49.569786] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:49.603129] [DEBUG] [MAIN ] XOM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:49.604636] [INFO ] [MAIN ] XOM: Generated 1807 derivative records from 54183 primary records. [2025-10-09T22:44:49.604817] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-09T22:44:49.607305] [DEBUG] [LOCAL ] XPER: Derivative data saved (1807 records). [2025-10-09T22:44:49.618877] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-09T22:44:49.624374] [INFO ] [MAIN ] Derivative Progress: 1658/1690 symbols completed. XPER took 1.2s. Estimated remaining: 12.5s. Rate: 154.2 symbols/min [2025-10-09T22:44:49.625195] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:49.630754] [DEBUG] [LOCAL ] XOM: Derivative data saved (1807 records). [2025-10-09T22:44:49.630994] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-09T22:44:49.634746] [INFO ] [MAIN ] Derivative Progress: 1659/1690 symbols completed. XOM took 1.2s. Estimated remaining: 12.1s. Rate: 154.3 symbols/min [2025-10-09T22:44:49.636151] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:49.685736] [DEBUG] [LOCAL ] XPEV: Loaded 54024 existing records from primary storage. [2025-10-09T22:44:49.698672] [INFO ] [MAIN ] XPEV: Loaded 54024 primary data records. [2025-10-09T22:44:49.853569] [DEBUG] [LOCAL ] XPOF: Loaded 37887 existing records from primary storage. [2025-10-09T22:44:49.865892] [INFO ] [MAIN ] XPOF: Loaded 37887 primary data records. [2025-10-09T22:44:49.865759] [DEBUG] [LOCAL ] XPO: Loaded 48148 existing records from primary storage. [2025-10-09T22:44:49.876626] [INFO ] [MAIN ] XPO: Loaded 48148 primary data records. [2025-10-09T22:44:50.875401] [DEBUG] [MAIN ] XPEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:50.876927] [INFO ] [MAIN ] XPEV: Generated 1807 derivative records from 54024 primary records. [2025-10-09T22:44:50.877162] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-09T22:44:50.897322] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1807 records). [2025-10-09T22:44:50.899417] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-09T22:44:50.902290] [INFO ] [MAIN ] Derivative Progress: 1660/1690 symbols completed. XPEV took 1.3s. Estimated remaining: 11.7s. Rate: 154.1 symbols/min [2025-10-09T22:44:50.903077] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:50.940371] [DEBUG] [MAIN ] XPOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:50.941726] [INFO ] [MAIN ] XPOF: Generated 1807 derivative records from 37887 primary records. [2025-10-09T22:44:50.941796] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-09T22:44:50.943035] [DEBUG] [MAIN ] XPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:50.943513] [INFO ] [MAIN ] XPO: Generated 1807 derivative records from 48148 primary records. [2025-10-09T22:44:50.943570] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-09T22:44:50.974903] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1807 records). [2025-10-09T22:44:50.975701] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-09T22:44:50.980761] [INFO ] [MAIN ] Derivative Progress: 1661/1690 symbols completed. XPOF took 1.3s. Estimated remaining: 11.3s. Rate: 154.2 symbols/min [2025-10-09T22:44:50.982787] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:51.006103] [DEBUG] [LOCAL ] XPO: Derivative data saved (1807 records). [2025-10-09T22:44:51.006361] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-09T22:44:51.009763] [INFO ] [MAIN ] Derivative Progress: 1662/1690 symbols completed. XPO took 1.4s. Estimated remaining: 10.9s. Rate: 154.3 symbols/min [2025-10-09T22:44:51.010224] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:51.031837] [DEBUG] [LOCAL ] XPRO: Loaded 46201 existing records from primary storage. [2025-10-09T22:44:51.032219] [INFO ] [MAIN ] XPRO: Loaded 46201 primary data records. [2025-10-09T22:44:51.213582] [DEBUG] [LOCAL ] XYF: Loaded 28444 existing records from primary storage. [2025-10-09T22:44:51.263704] [INFO ] [MAIN ] XYF: Loaded 28444 primary data records. [2025-10-09T22:44:51.513683] [DEBUG] [LOCAL ] XYL: Loaded 48238 existing records from primary storage. [2025-10-09T22:44:51.530463] [INFO ] [MAIN ] XYL: Loaded 48238 primary data records. [2025-10-09T22:44:52.075163] [DEBUG] [MAIN ] XPRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:52.077305] [INFO ] [MAIN ] XPRO: Generated 1807 derivative records from 46201 primary records. [2025-10-09T22:44:52.077912] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-09T22:44:52.097417] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1807 records). [2025-10-09T22:44:52.097705] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-09T22:44:52.100458] [INFO ] [MAIN ] Derivative Progress: 1663/1690 symbols completed. XPRO took 1.2s. Estimated remaining: 10.5s. Rate: 154.1 symbols/min [2025-10-09T22:44:52.121911] [DEBUG] [MAIN ] XYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:52.122711] [INFO ] [MAIN ] XYF: Generated 1807 derivative records from 28444 primary records. [2025-10-09T22:44:52.123120] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-09T22:44:52.144786] [DEBUG] [LOCAL ] XYF: Derivative data saved (1807 records). [2025-10-09T22:44:52.145076] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-09T22:44:52.147951] [INFO ] [MAIN ] Derivative Progress: 1664/1690 symbols completed. XYF took 1.2s. Estimated remaining: 10.1s. Rate: 154.2 symbols/min [2025-10-09T22:44:52.161875] [DEBUG] [MAIN ] XYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:52.162782] [INFO ] [MAIN ] XYL: Generated 1807 derivative records from 48238 primary records. [2025-10-09T22:44:52.162855] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-09T22:44:52.180831] [DEBUG] [LOCAL ] XYL: Derivative data saved (1807 records). [2025-10-09T22:44:52.180911] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-09T22:44:52.184017] [INFO ] [MAIN ] Derivative Progress: 1665/1690 symbols completed. XYL took 1.2s. Estimated remaining: 9.7s. Rate: 154.3 symbols/min [2025-10-09T22:44:52.184512] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:52.185360] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:52.185203] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:52.266549] [DEBUG] [LOCAL ] YELP: Loaded 45748 existing records from primary storage. [2025-10-09T22:44:52.266920] [INFO ] [MAIN ] YELP: Loaded 45748 primary data records. [2025-10-09T22:44:52.267543] [DEBUG] [LOCAL ] YALA: Loaded 37208 existing records from primary storage. [2025-10-09T22:44:52.282737] [INFO ] [MAIN ] YALA: Loaded 37208 primary data records. [2025-10-09T22:44:52.338275] [DEBUG] [LOCAL ] YETI: Loaded 52832 existing records from primary storage. [2025-10-09T22:44:52.390402] [INFO ] [MAIN ] YETI: Loaded 52832 primary data records. [2025-10-09T22:44:53.324159] [DEBUG] [MAIN ] YELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:53.339307] [INFO ] [MAIN ] YELP: Generated 1807 derivative records from 45748 primary records. [2025-10-09T22:44:53.340563] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-09T22:44:53.340282] [DEBUG] [MAIN ] YETI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:53.350445] [INFO ] [MAIN ] YETI: Generated 1807 derivative records from 52832 primary records. [2025-10-09T22:44:53.350739] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-09T22:44:53.386540] [DEBUG] [LOCAL ] YETI: Derivative data saved (1807 records). [2025-10-09T22:44:53.392833] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-09T22:44:53.397150] [INFO ] [MAIN ] Derivative Progress: 1666/1690 symbols completed. YETI took 1.2s. Estimated remaining: 9.3s. Rate: 154.1 symbols/min [2025-10-09T22:44:53.397322] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:53.393254] [DEBUG] [MAIN ] YALA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:53.399520] [INFO ] [MAIN ] YALA: Generated 1807 derivative records from 37208 primary records. [2025-10-09T22:44:53.399958] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-09T22:44:53.411963] [DEBUG] [LOCAL ] YELP: Derivative data saved (1807 records). [2025-10-09T22:44:53.418880] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-09T22:44:53.421584] [INFO ] [MAIN ] Derivative Progress: 1667/1690 symbols completed. YELP took 1.2s. Estimated remaining: 9.0s. Rate: 154.1 symbols/min [2025-10-09T22:44:53.421852] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:53.421959] [DEBUG] [LOCAL ] YALA: Derivative data saved (1807 records). [2025-10-09T22:44:53.422248] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-09T22:44:53.426120] [INFO ] [MAIN ] Derivative Progress: 1668/1690 symbols completed. YALA took 1.2s. Estimated remaining: 8.6s. Rate: 154.2 symbols/min [2025-10-09T22:44:53.426572] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:53.511541] [DEBUG] [LOCAL ] YEXT: Loaded 43406 existing records from primary storage. [2025-10-09T22:44:53.512417] [INFO ] [MAIN ] YEXT: Loaded 43406 primary data records. [2025-10-09T22:44:53.625993] [DEBUG] [LOCAL ] YMM: Loaded 52979 existing records from primary storage. [2025-10-09T22:44:53.642602] [INFO ] [MAIN ] YMM: Loaded 52979 primary data records. [2025-10-09T22:44:53.651456] [DEBUG] [LOCAL ] YOU: Loaded 50065 existing records from primary storage. [2025-10-09T22:44:53.689146] [INFO ] [MAIN ] YOU: Loaded 50065 primary data records. [2025-10-09T22:44:54.583457] [DEBUG] [MAIN ] YEXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:54.586143] [INFO ] [MAIN ] YEXT: Generated 1807 derivative records from 43406 primary records. [2025-10-09T22:44:54.586704] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-09T22:44:54.605790] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1807 records). [2025-10-09T22:44:54.606252] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-09T22:44:54.609833] [INFO ] [MAIN ] Derivative Progress: 1669/1690 symbols completed. YEXT took 1.2s. Estimated remaining: 8.2s. Rate: 154.0 symbols/min [2025-10-09T22:44:54.610186] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:54.632402] [DEBUG] [MAIN ] YOU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:54.633954] [INFO ] [MAIN ] YOU: Generated 1807 derivative records from 50065 primary records. [2025-10-09T22:44:54.647760] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-09T22:44:54.648078] [DEBUG] [MAIN ] YMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:54.650230] [INFO ] [MAIN ] YMM: Generated 1807 derivative records from 52979 primary records. [2025-10-09T22:44:54.650749] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-09T22:44:54.683499] [DEBUG] [LOCAL ] YMM: Derivative data saved (1807 records). [2025-10-09T22:44:54.699774] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-09T22:44:54.704011] [INFO ] [MAIN ] Derivative Progress: 1670/1690 symbols completed. YMM took 1.3s. Estimated remaining: 7.8s. Rate: 154.1 symbols/min [2025-10-09T22:44:54.704902] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:54.706819] [DEBUG] [LOCAL ] YOU: Derivative data saved (1807 records). [2025-10-09T22:44:54.707058] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-09T22:44:54.709903] [INFO ] [MAIN ] Derivative Progress: 1671/1690 symbols completed. YOU took 1.3s. Estimated remaining: 7.4s. Rate: 154.2 symbols/min [2025-10-09T22:44:54.710142] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:54.745159] [DEBUG] [LOCAL ] YPF: Loaded 50911 existing records from primary storage. [2025-10-09T22:44:54.745611] [INFO ] [MAIN ] YPF: Loaded 50911 primary data records. [2025-10-09T22:44:54.785338] [DEBUG] [LOCAL ] YRD: Loaded 12033 existing records from primary storage. [2025-10-09T22:44:54.810294] [INFO ] [MAIN ] YRD: Loaded 12033 primary data records. [2025-10-09T22:44:54.957589] [DEBUG] [LOCAL ] YSG: Loaded 25476 existing records from primary storage. [2025-10-09T22:44:54.975596] [INFO ] [MAIN ] YSG: Loaded 25476 primary data records. [2025-10-09T22:44:55.755125] [DEBUG] [MAIN ] YPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:55.756428] [INFO ] [MAIN ] YPF: Generated 1807 derivative records from 50911 primary records. [2025-10-09T22:44:55.756845] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-09T22:44:55.771779] [DEBUG] [MAIN ] YRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:55.774062] [INFO ] [MAIN ] YRD: Generated 1807 derivative records from 12033 primary records. [2025-10-09T22:44:55.781921] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-09T22:44:55.804771] [DEBUG] [LOCAL ] YPF: Derivative data saved (1807 records). [2025-10-09T22:44:55.807085] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-09T22:44:55.813058] [INFO ] [MAIN ] Derivative Progress: 1672/1690 symbols completed. YPF took 1.2s. Estimated remaining: 7.0s. Rate: 154.0 symbols/min [2025-10-09T22:44:55.813409] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:55.815587] [DEBUG] [LOCAL ] YRD: Derivative data saved (1807 records). [2025-10-09T22:44:55.828532] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-09T22:44:55.832363] [INFO ] [MAIN ] Derivative Progress: 1673/1690 symbols completed. YRD took 1.1s. Estimated remaining: 6.6s. Rate: 154.1 symbols/min [2025-10-09T22:44:55.832580] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:55.828816] [DEBUG] [MAIN ] YSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:55.833788] [INFO ] [MAIN ] YSG: Generated 1807 derivative records from 25476 primary records. [2025-10-09T22:44:55.834362] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-09T22:44:55.852123] [DEBUG] [LOCAL ] YSG: Derivative data saved (1807 records). [2025-10-09T22:44:55.852211] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-09T22:44:55.855174] [INFO ] [MAIN ] Derivative Progress: 1674/1690 symbols completed. YSG took 1.1s. Estimated remaining: 6.2s. Rate: 154.2 symbols/min [2025-10-09T22:44:55.858232] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:55.916723] [DEBUG] [LOCAL ] YUM: Loaded 51558 existing records from primary storage. [2025-10-09T22:44:55.916963] [INFO ] [MAIN ] YUM: Loaded 51558 primary data records. [2025-10-09T22:44:56.053068] [DEBUG] [LOCAL ] YUMC: Loaded 52975 existing records from primary storage. [2025-10-09T22:44:56.126228] [INFO ] [MAIN ] YUMC: Loaded 52975 primary data records. [2025-10-09T22:44:56.296165] [DEBUG] [LOCAL ] ZBH: Loaded 51177 existing records from primary storage. [2025-10-09T22:44:56.309154] [INFO ] [MAIN ] ZBH: Loaded 51177 primary data records. [2025-10-09T22:44:56.986486] [DEBUG] [MAIN ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:56.987337] [INFO ] [MAIN ] YUM: Generated 1807 derivative records from 51558 primary records. [2025-10-09T22:44:56.987403] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-09T22:44:57.019626] [DEBUG] [LOCAL ] YUM: Derivative data saved (1807 records). [2025-10-09T22:44:57.020416] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-09T22:44:57.023370] [INFO ] [MAIN ] Derivative Progress: 1675/1690 symbols completed. YUM took 1.2s. Estimated remaining: 5.8s. Rate: 154.0 symbols/min [2025-10-09T22:44:57.024961] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:57.056400] [DEBUG] [MAIN ] ZBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:57.068168] [DEBUG] [MAIN ] YUMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:57.069428] [INFO ] [MAIN ] YUMC: Generated 1807 derivative records from 52975 primary records. [2025-10-09T22:44:57.070373] [INFO ] [MAIN ] ZBH: Generated 1807 derivative records from 51177 primary records. [2025-10-09T22:44:57.070518] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-09T22:44:57.070678] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-09T22:44:57.078327] [DEBUG] [LOCAL ] ZEPP: Loaded 18435 existing records from primary storage. [2025-10-09T22:44:57.079406] [INFO ] [MAIN ] ZEPP: Loaded 18435 primary data records. [2025-10-09T22:44:57.144558] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1807 records). [2025-10-09T22:44:57.158566] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-09T22:44:57.173790] [INFO ] [MAIN ] Derivative Progress: 1676/1690 symbols completed. ZBH took 1.3s. Estimated remaining: 5.5s. Rate: 154.1 symbols/min [2025-10-09T22:44:57.189078] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:57.191150] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1807 records). [2025-10-09T22:44:57.197728] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-09T22:44:57.207668] [INFO ] [MAIN ] Derivative Progress: 1677/1690 symbols completed. YUMC took 1.4s. Estimated remaining: 5.1s. Rate: 154.2 symbols/min [2025-10-09T22:44:57.226573] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:57.476195] [DEBUG] [LOCAL ] ZGN: Loaded 41074 existing records from primary storage. [2025-10-09T22:44:57.492236] [INFO ] [MAIN ] ZGN: Loaded 41074 primary data records. [2025-10-09T22:44:57.512307] [DEBUG] [LOCAL ] ZETA: Loaded 53999 existing records from primary storage. [2025-10-09T22:44:57.539860] [INFO ] [MAIN ] ZETA: Loaded 53999 primary data records. [2025-10-09T22:44:57.715314] [DEBUG] [MAIN ] ZEPP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:44:57.726808] [INFO ] [MAIN ] ZEPP: Generated 1806 derivative records from 18435 primary records. [2025-10-09T22:44:57.726927] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-09T22:44:58.167419] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1806 records). [2025-10-09T22:44:58.168116] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-09T22:44:58.170759] [INFO ] [MAIN ] Derivative Progress: 1678/1690 symbols completed. ZEPP took 1.1s. Estimated remaining: 4.7s. Rate: 154.0 symbols/min [2025-10-09T22:44:58.197958] [DEBUG] [MAIN ] ZGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:58.199114] [INFO ] [MAIN ] ZGN: Generated 1807 derivative records from 41074 primary records. [2025-10-09T22:44:58.199353] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-09T22:44:58.219330] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1807 records). [2025-10-09T22:44:58.219734] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-09T22:44:58.222235] [INFO ] [MAIN ] Derivative Progress: 1679/1690 symbols completed. ZGN took 1.0s. Estimated remaining: 4.3s. Rate: 154.1 symbols/min [2025-10-09T22:44:58.235371] [DEBUG] [MAIN ] ZETA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:58.236141] [INFO ] [MAIN ] ZETA: Generated 1807 derivative records from 53999 primary records. [2025-10-09T22:44:58.236205] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-09T22:44:58.252467] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1807 records). [2025-10-09T22:44:58.252530] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-09T22:44:58.255432] [INFO ] [MAIN ] Derivative Progress: 1680/1690 symbols completed. ZETA took 1.1s. Estimated remaining: 3.9s. Rate: 154.2 symbols/min [2025-10-09T22:44:58.255987] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:58.256101] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:58.256285] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:58.286258] [DEBUG] [LOCAL ] ZH: Loaded 25874 existing records from primary storage. [2025-10-09T22:44:58.286450] [INFO ] [MAIN ] ZH: Loaded 25874 primary data records. [2025-10-09T22:44:58.500627] [DEBUG] [LOCAL ] ZIP: Loaded 44170 existing records from primary storage. [2025-10-09T22:44:58.508667] [INFO ] [MAIN ] ZIP: Loaded 44170 primary data records. [2025-10-09T22:44:58.526792] [DEBUG] [LOCAL ] ZIM: Loaded 53891 existing records from primary storage. [2025-10-09T22:44:58.533176] [INFO ] [MAIN ] ZIM: Loaded 53891 primary data records. [2025-10-09T22:44:59.364903] [DEBUG] [MAIN ] ZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:59.366434] [INFO ] [MAIN ] ZH: Generated 1807 derivative records from 25874 primary records. [2025-10-09T22:44:59.368201] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-09T22:44:59.394399] [DEBUG] [LOCAL ] ZH: Derivative data saved (1807 records). [2025-10-09T22:44:59.394675] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-09T22:44:59.397625] [INFO ] [MAIN ] Derivative Progress: 1681/1690 symbols completed. ZH took 1.1s. Estimated remaining: 3.5s. Rate: 154.0 symbols/min [2025-10-09T22:44:59.398035] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:59.416414] [DEBUG] [MAIN ] ZIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:59.417848] [INFO ] [MAIN ] ZIM: Generated 1807 derivative records from 53891 primary records. [2025-10-09T22:44:59.430351] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-09T22:44:59.431430] [DEBUG] [MAIN ] ZIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:44:59.433973] [INFO ] [MAIN ] ZIP: Generated 1807 derivative records from 44170 primary records. [2025-10-09T22:44:59.434107] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-09T22:44:59.470859] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1807 records). [2025-10-09T22:44:59.473344] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-09T22:44:59.477963] [INFO ] [MAIN ] Derivative Progress: 1682/1690 symbols completed. ZIP took 1.2s. Estimated remaining: 3.1s. Rate: 154.1 symbols/min [2025-10-09T22:44:59.478716] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:59.479860] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1807 records). [2025-10-09T22:44:59.480405] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-09T22:44:59.483613] [INFO ] [MAIN ] Derivative Progress: 1683/1690 symbols completed. ZIM took 1.2s. Estimated remaining: 2.7s. Rate: 154.2 symbols/min [2025-10-09T22:44:59.483986] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:44:59.505249] [DEBUG] [LOCAL ] ZKH: Loaded 7684 existing records from primary storage. [2025-10-09T22:44:59.505440] [INFO ] [MAIN ] ZKH: Loaded 7684 primary data records. [2025-10-09T22:44:59.632172] [DEBUG] [LOCAL ] ZK: Loaded 39481 existing records from primary storage. [2025-10-09T22:44:59.648854] [INFO ] [MAIN ] ZK: Loaded 39481 primary data records. [2025-10-09T22:44:59.961488] [DEBUG] [LOCAL ] ZTO: Loaded 49914 existing records from primary storage. [2025-10-09T22:44:59.974355] [INFO ] [MAIN ] ZTO: Loaded 49914 primary data records. [2025-10-09T22:45:00.526825] [DEBUG] [MAIN ] ZKH: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:45:00.529194] [INFO ] [MAIN ] ZKH: Generated 1806 derivative records from 7684 primary records. [2025-10-09T22:45:00.529525] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-09T22:45:00.566174] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1806 records). [2025-10-09T22:45:00.566794] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-09T22:45:00.567126] [DEBUG] [MAIN ] ZK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:45:00.571069] [INFO ] [MAIN ] ZK: Generated 1807 derivative records from 39481 primary records. [2025-10-09T22:45:00.570149] [INFO ] [MAIN ] Derivative Progress: 1684/1690 symbols completed. ZKH took 1.1s. Estimated remaining: 2.3s. Rate: 154.0 symbols/min [2025-10-09T22:45:00.571668] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-09T22:45:00.571885] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:45:00.593931] [DEBUG] [LOCAL ] ZK: Derivative data saved (1807 records). [2025-10-09T22:45:00.594216] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-09T22:45:00.604836] [INFO ] [MAIN ] Derivative Progress: 1685/1690 symbols completed. ZK took 1.2s. Estimated remaining: 1.9s. Rate: 154.1 symbols/min [2025-10-09T22:45:00.610122] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:45:00.610798] [DEBUG] [MAIN ] ZTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:45:00.612092] [INFO ] [MAIN ] ZTO: Generated 1807 derivative records from 49914 primary records. [2025-10-09T22:45:00.612178] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-09T22:45:00.636821] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1807 records). [2025-10-09T22:45:00.637666] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-09T22:45:00.640637] [INFO ] [MAIN ] Derivative Progress: 1686/1690 symbols completed. ZTO took 1.2s. Estimated remaining: 1.6s. Rate: 154.2 symbols/min [2025-10-09T22:45:00.640890] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:45:00.654618] [DEBUG] [LOCAL ] ZTR: Loaded 16901 existing records from primary storage. [2025-10-09T22:45:00.655023] [INFO ] [MAIN ] ZTR: Loaded 16901 primary data records. [2025-10-09T22:45:00.917856] [DEBUG] [LOCAL ] ZVIA: Loaded 35698 existing records from primary storage. [2025-10-09T22:45:01.074102] [DEBUG] [LOCAL ] ZTS: Loaded 53465 existing records from primary storage. [2025-10-09T22:45:01.083614] [INFO ] [MAIN ] ZVIA: Loaded 35698 primary data records. [2025-10-09T22:45:01.084354] [INFO ] [MAIN ] ZTS: Loaded 53465 primary data records. [2025-10-09T22:45:01.848523] [DEBUG] [MAIN ] ZTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:45:01.851142] [INFO ] [MAIN ] ZTR: Generated 1807 derivative records from 16901 primary records. [2025-10-09T22:45:01.851379] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-09T22:45:01.872170] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1807 records). [2025-10-09T22:45:01.872350] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-09T22:45:01.874444] [INFO ] [MAIN ] Derivative Progress: 1687/1690 symbols completed. ZTR took 1.3s. Estimated remaining: 1.2s. Rate: 154.0 symbols/min [2025-10-09T22:45:01.875000] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-09T22:45:01.893615] [DEBUG] [MAIN ] ZTS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-10-09T22:45:01.894476] [INFO ] [MAIN ] ZTS: Generated 1806 derivative records from 53465 primary records. [2025-10-09T22:45:01.894564] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-09T22:45:01.926111] [DEBUG] [MAIN ] ZVIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:45:01.928164] [INFO ] [MAIN ] ZVIA: Generated 1807 derivative records from 35698 primary records. [2025-10-09T22:45:01.929064] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-09T22:45:01.941337] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1806 records). [2025-10-09T22:45:01.942263] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-09T22:45:01.944802] [INFO ] [MAIN ] Derivative Progress: 1688/1690 symbols completed. ZTS took 1.3s. Estimated remaining: 0.8s. Rate: 154.1 symbols/min [2025-10-09T22:45:01.973278] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1807 records). [2025-10-09T22:45:01.974986] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-09T22:45:01.979481] [INFO ] [MAIN ] Derivative Progress: 1689/1690 symbols completed. ZVIA took 1.3s. Estimated remaining: 0.4s. Rate: 154.1 symbols/min [2025-10-09T22:45:01.980949] [DEBUG] [LOCAL ] ZWS: Loaded 42540 existing records from primary storage. [2025-10-09T22:45:01.981128] [INFO ] [MAIN ] ZWS: Loaded 42540 primary data records. [2025-10-09T22:45:02.292041] [DEBUG] [MAIN ] ZWS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-10-09T22:45:02.292827] [INFO ] [MAIN ] ZWS: Generated 1807 derivative records from 42540 primary records. [2025-10-09T22:45:02.292900] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-09T22:45:02.309522] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1807 records). [2025-10-09T22:45:02.309704] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-09T22:45:02.311852] [INFO ] [MAIN ] Derivative Progress: 1690/1690 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 154.2 symbols/min [2025-10-09T22:45:02.313916] [INFO ] [MAIN ] Parallel derivative generation completed in 10m 58s [2025-10-09T22:45:02.314126] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1690/1690 symbols) [2025-10-09T22:45:03.022450] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1690/1690 @ 100.00%)' [2025-10-09T22:45:03.022984] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-09T22:45:03.024198] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-09T22:45:03.024481] [INFO ] [STATE ] Last completion updated: 2025-10-09T22:45:03.024278